title: Restricting $q^2 l^2$ operators from $\pi^0 \rightarrow \mu e$

abstract: In this paper we consider semileptonic lepton flavor violating operators of the type $q^2l^2$ in low energy effective theory (LEFT). At the chiral scale, we match these operators to chiral perturbation theory ($\chi$PT) and place constraints from the process $\pi^0\rightarrow \mu^+ \,\, e^-$. These bounds are shown to depend on the chiral nature of the operators. The scalar operators are significantly more constrained compared to the vector operators. We then compare the limits from $\mu \to e$ conversion in Nuclei and show that the limits on scalar operators are within an order of magnitude of the corresponding limits from $\mu \to e$ conversion in Ti. On the other hand, the limits on vector operators are however much weaker. Towards the end, we evolve the LEFT operators to W-boson mass scale using RGE, and match them to the Standard Model effective field theory (SMEFT) operators. We, then, derive the constraints on the parameter space of Leptoquark models that could generate these SMEFT operators at tree level.


title: Federated Learning for Vision-based Obstacle Avoidance in the Internet of Robotic Things

abstract: Deep learning methods have revolutionized mobile robotics, from advanced perception models for an enhanced situational awareness to novel control approaches through reinforcement learning. This paper explores the potential of federated learning for distributed systems of mobile robots enabling collaboration on the Internet of Robotic Things. To demonstrate the effectiveness of such an approach, we deploy wheeled robots in different indoor environments. We analyze the performance of a federated learning approach and compare it to a traditional centralized training process with a priori aggregated data. We show the benefits of collaborative learning across heterogeneous environments and the potential for sim-to-real knowledge transfer. Our results demonstrate significant performance benefits of FL and sim-to-real transfer for vision-based navigation, in addition to the inherent privacy-preserving nature of FL by keeping computation at the edge. This is, to the best of our knowledge, the first work to leverage FL for vision-based navigation that also tests results in real-world settings.


title: BEHAVE: Dataset and Method for Tracking Human Object Interactions

abstract: Modelling interactions between humans and objects in natural environments is central to many applications including gaming, virtual and mixed reality, as well as human behavior analysis and human-robot collaboration. This challenging operation scenario requires generalization to vast number of objects, scenes, and human actions. Unfortunately, there exist no such dataset. Moreover, this data needs to be acquired in diverse natural environments, which rules out 4D scanners and marker based capture systems. We present BEHAVE dataset, the first full body human- object interaction dataset with multi-view RGBD frames and corresponding 3D SMPL and object fits along with the annotated contacts between them. We record around 15k frames at 5 locations with 8 subjects performing a wide range of interactions with 20 common objects. We use this data to learn a model that can jointly track humans and objects in natural environments with an easy-to-use portable multi-camera setup. Our key insight is to predict correspondences from the human and the object to a statistical body model to obtain human-object contacts during interactions. Our approach can record and track not just the humans and objects but also their interactions, modeled as surface contacts, in 3D. Our code and data can be found at: http://virtualhumans.mpi-inf.mpg.de/behave


title: Unsupervised Deep Learning Meets Chan-Vese Model

abstract: The Chan-Vese (CV) model is a classic region-based method in image segmentation. However, its piecewise constant assumption does not always hold for practical applications. Many improvements have been proposed but the issue is still far from well solved. In this work, we propose an unsupervised image segmentation approach that integrates the CV model with deep neural networks, which significantly improves the original CV model's segmentation accuracy. Our basic idea is to apply a deep neural network that maps the image into a latent space to alleviate the violation of the piecewise constant assumption in image space. We formulate this idea under the classic Bayesian framework by approximating the likelihood with an evidence lower bound (ELBO) term while keeping the prior term in the CV model. Thus, our model only needs the input image itself and does not require pre-training from external datasets. Moreover, we extend the idea to multi-phase case and dataset based unsupervised image segmentation. Extensive experiments validate the effectiveness of our model and show that the proposed method is noticeably better than other unsupervised segmentation approaches.


title: Infomechanics of Independent and Identically Distributed Particles

abstract: The paper moves a step towards the full integration of statistical mechanics and information theory. Starting from the assumption that the thermodynamical system is composed by particles whose quantized energies can be modelled as independent and identically distributed random variables, the paper proposes an approach whose cornerstones are the information-theoretic typical set and the conditional equiprobability of microstates given certain macrostates of the system. When taken together, these two concepts explain why the standard assumption of equally probable microstates is non-necessary (if not misleading) and show that the celebrated Boltzmann-Planck entropy is indeed a conditional entropy with deterministic condition. Several new specific results of physical relevance are derived from this approach, among which are the probability distribution of the occupancy numbers of the energy levels and an exact formula for the ideal gas in a container that gives the entropy of the gas also at low temperature. These specific results are pieces of a self-consistent and unified framework that encompasses the cases of low and high temperature, of indexed and non-indexed particles, of small and large number of particles, of microcanonical, canonical and grand canonical ensembles.


title: Convex Hulls of Grassmannians and Combinatorics of Symmetric Hypermatrices

abstract: It is known that the complex Grassmannian of $k$-dimensional subspaces can be identified with the set of projection matrices of rank $k$. It is also classically known that the convex hull of this set is the set of Hermitian matrices with eigenvalues between $0$ and $1$ and summing to $k$. We give a new proof of this fact. We also give an existence theorem for a certain combinatorial class of hypermatrices by a similar argument. This existence theorem can be rewritten into an existence theorem for a uniform weighted hypergraph with given weighted degree sequence.


title: Trace-Class and Nuclear Operators

abstract: This paper explores the long journey from projective tensor products of a pair of Banach spaces, passing through the definition of nuclear operators still on the realm of projective tensor products, to the of notion of trace-class operators on a Hilbert space, and shows how and why these concepts (nuclear and trace-class operators, that is) agree in the end.


title: LEFM-Nets: Learnable Explicit Feature Map Deep Networks for Segmentation of Histopathological Images of Frozen Sections

abstract: Accurate segmentation of medical images is essential for diagnosis and treatment of diseases. These problems are solved by highly complex models, such as deep networks (DN), requiring a large amount of labeled data for training. Thereby, many DNs possess task- or imaging modality specific architectures with a decision-making process that is often hard to explain and interpret. Here, we propose a framework that embeds existing DNs into a low-dimensional subspace induced by the learnable explicit feature map (LEFM) layer. Compared to the existing DN, the framework adds one hyperparameter and only modestly increase the number of learnable parameters. The method is aimed at, but not limited to, segmentation of low-dimensional medical images, such as color histopathological images of stained frozen sections. Since features in the LEFM layer are polynomial functions of the original features, proposed LEFM-Nets contribute to the interpretability of network decisions. In this work, we combined LEFM with the known networks: DeepLabv3+, UNet, UNet++ and MA-net. New LEFM-Nets are applied to the segmentation of adenocarcinoma of a colon in a liver from images of hematoxylin and eosin (H&E) stained frozen sections. LEFM-Nets are also tested on nuclei segmentation from images of H&E stained frozen sections of ten human organs. On the first problem, LEFM-Nets achieved statistically significant performance improvement in terms of micro balanced accuracy and $F_1$ score than original networks. LEFM-Nets achieved only better performance in comparison with the original networks on the second problem. The source code is available at https://github.com/dsitnik/lefm.


title: Colour Evolution and Infrared Physics

abstract: We give a complete account of how soft gluon, massless quark, evolution equations in colour space originate, from a factorization into a hard cross section density operator and a soft function encoding measurements and the projection on definite colours. We detail this formalism up to the two loop level and we demonstrate how the evolution kernels relate to infrared subtractions, and how the resolution of infrared singular regions conspires with the structure of observables the algorithm should be able to predict. The latter allows us to address evolution in different kinematic variables, including energy ordering and angular cutoffs in non-global observables. The soft factor and its evolution resembles a hadronization model including effects such as colour reconnection, and could give insight into the structure of power corrections in observables which require soft gluon evolution.


title: Are General Circulation Models obsolete?

abstract: Traditional general circulation models, or GCMs -- i.e. 3D dynamical models with unresolved terms represented in equations with tunable parameters -- have been a mainstay of climate research for several decades, and some of the pioneering studies have recently been recognized by a Nobel prize in Physics. Yet, there is considerable debate around their continuing role in the future. Frequently mentioned as limitations of GCMs are the structural error and uncertainty across models with different representations of unresolved scales; and the fact that the models are tuned to reproduce certain aspects of the observed Earth. We consider these shortcomings in the context of a future generation of models that may address these issues through substantially higher resolution and detail, or through the use of machine learning techniques to match them better to observations, theory, and process models. It is our contention that calibration, far from being a weakness of models, is an essential element in the simulation of complex systems, and contributes to our understanding of their inner workings. Models can be calibrated to reveal both fine-scale detail, or the global response to external perturbations. New methods enable us to articulate and improve the connections between the different levels of abstract representation of climate processes, and our understanding resides in an entire hierarchy of models where GCMs will continue to play a central role for the foreseeable future..


title: Ultimate accuracy of frequency to power conversion by single-electron injection

abstract: We analyze theoretically the properties of the recently introduced and experimentally demonstrated converter of frequency to power. The system is composed of a hybrid single-electron box with normal island and superconducting lead, and the detector of the energy flow using a thermometer on a normal metal bolometer. Here we consider its potential for metrology. The errors in power arise mainly from inaccuracy of injecting electrons at the precise energy equal to the energy gap of the superconductor. We calculate the main systematic error in form of the excess average energy of the injected electrons and its cumulants, and due to sub-gap leakage. We demonstrate by analytic and numerical calculations that the systematic error in detection can, in principle, be made much smaller than the injection errors, which also, with proper choice of system parameters, can be very small, < 1 %, at low enough temperature. Finally we propose a simplified configuration for metrological purposes.


title: Analytic Solution for Perturbed Keplerian Motion Under Small Acceleration Using Averaging Theory

abstract: A novel approach is developed for analytic orbit propagation based on asymptotic expansion with respect to a small perturbative acceleration. The method improves upon existing first order asymptotic expansions by leveraging on linear systems and averaging theories. The solution starts with the linearization of Gauss planetary equations with respect to both the small perturbation and the six orbital elements. Then, an approximate solution is obtained in terms of secular and short period components. The method is tested on a low-thrust maneuver scenario consisting of a Keplerian orbit perturbed by a constant tangential acceleration, for which a solution can be obtained in terms of elliptic integrals. Results show that the positional propagation error is about one order of magnitude smaller with respect to state-of-the-art methods. The position accuracy for a LEO orbit, apart from pathological cases, is typically in the range of tens of meters for a dimensionless tangential acceleration of 1e-5 after 5 orbital periods propagation.


title: The replication of equivalence studies

abstract: Replication studies are increasingly conducted to assess the credibility of scientific findings. Most of these replication attempts target studies with a superiority design, but there is a lack of methodology regarding the analysis of replication studies with alternative types of designs, such as equivalence. In order to fill this gap, we propose two approaches, the two-trials rule and the sceptical TOST procedure, adapted from methods used in superiority settings. Both methods have the same overall Type-I error rate, but the sceptical TOST procedure allows replication success even for non-significant original or replication studies. This leads to a larger project power and other differences in relevant operating characteristics. Both methods can be used for sample size calculation of the replication study, based on the results from the original one. The two methods are applied to data from the Reproducibility Project: Cancer Biology.


title: Webs of 3d $\mathcal{N} = 2$ dualities with D-type superpotentials

abstract: We study 3d $\mathcal{N}=2$ dualities arising from the compactification of 4d $\mathcal{N}=1$ $Usp(2 n)$ SQCD with two antisymmetric rank-two tensors and $D_{k+2}$-type superpotential, with odd $k$. The analysis is carried out by using field theory methods and by checking the various steps on the three sphere partition function. Most of the results are based on a conjectural confining duality that we do not prove but that fits consistently with the web of dualities that we obtain. Along the analysis we recover dualities already claimed in the literature and we propose new ones. The final picture that emerges fits with the general scheme worked out for ordinary SQCD and for adjoint SQCD with $A_k$-type superpotentials.


title: Isomorph Invariant Dynamic Mechanical Analysis: A Molecular Dynamics Study

abstract: We simulate dynamic mechanical analysis experiments for the Kob-Andersen binary Lennard-Jones system. For this, the SLLOD algorithm with time-dependent strain rates is applied to give a sinusoidally varying strain at different densities and temperatures. The starting point is a temperature scan at a fixed reference density. Isomorph theory predicts that for other densities corresponding temperatures can be identified at which the mechanical properties are unchanged when scaled appropriately. We determine the isomorphically equivalent temperatures by analysing how particle forces change upon scaling configurations to the new density. Loss moduli expressed in suitable reduced units are compared for isomorphic state points. When plotted against the unscaled temperatures, these reduced loss curves are observed to collapse indicating the validity of isomorph theory for dynamic mechanical analysis experiments. Two different methods to determine isomorphic temperatures are considered. While one of them breaks down for the largest density rescalings considered in this study, the other one is still applicable in this region. The decorrelation of force vectors upon rescaling is investigated as a possible origin of this effect. Our results demonstrate that the simplification of the phase diagram entailed by isomorph theory for a wide class of system is relevant also for the mechanical properties of glasses.


title: Finding MNEMON: Reviving Memories of Node Embeddings

abstract: Previous security research efforts orbiting around graphs have been exclusively focusing on either (de-)anonymizing the graphs or understanding the security and privacy issues of graph neural networks. Little attention has been paid to understand the privacy risks of integrating the output from graph embedding models (e.g., node embeddings) with complex downstream machine learning pipelines. In this paper, we fill this gap and propose a novel model-agnostic graph recovery attack that exploits the implicit graph structural information preserved in the embeddings of graph nodes. We show that an adversary can recover edges with decent accuracy by only gaining access to the node embedding matrix of the original graph without interactions with the node embedding models. We demonstrate the effectiveness and applicability of our graph recovery attack through extensive experiments.


title: Latent Aspect Detection from Online Unsolicited Customer Reviews

abstract: Within the context of review analytics, aspects are the features of products and services at which customers target their opinions and sentiments. Aspect detection helps product owners and service providers to identify shortcomings and prioritize customers' needs, and hence, maintain revenues and mitigate customer churn. Existing methods focus on detecting the surface form of an aspect by training supervised learning methods that fall short when aspects are latent in reviews. In this paper, we propose an unsupervised method to extract latent occurrences of aspects. Specifically, we assume that a customer undergoes a two-stage hypothetical generative process when writing a review: (1) deciding on an aspect amongst the set of aspects available for the product or service, and (2) writing the opinion words that are more interrelated to the chosen aspect from the set of all words available in a language. We employ latent Dirichlet allocation to learn the latent aspects distributions for generating the reviews. Experimental results on benchmark datasets show that our proposed method is able to improve the state of the art when the aspects are latent with no surface form in reviews.


title: Free actions of groups on separated graph C*-algebras

abstract: In this paper we study free actions of groups on separated graphs and their \cstar{}algebras, generalizing previous results involving ordinary (directed) graphs. We prove a version of the Gross-Tucker Theorem for separated graphs yielding a characterization of free actions on separated graphs via a skew product of the (orbit) separated graph by a group labeling function. Moreover, we describe the C*-algebras associated to these skew products as crossed products by certain coactions coming from the labeling function on the graph. Our results deal with both the full and the reduced C*-algebras of separated graphs. To prove our main results we use several techniques that involve certain canonical conditional expectations defined on the C*-algebras of separated graphs and their structure as amalgamated free products of ordinary graph C*-algebras. Moreover, we describe Fell bundles associated with the coactions of the appearing labeling functions. As a byproduct of our results, we deduce that the \cstar{}algebras of separated graphs always have a canonical Fell bundle structure over the free group on their edges.


title: Two Higgs doublets, Effective Interactions and a Strong First-Order Electroweak Phase Transition

abstract: It is well-known that type II two Higgs doublet models (2HDMs) can struggle to facilitate a strong first-order electroweak phase transition in the early universe whilst remaining theoretically appealing scenarios for many reasons. We analyse this apparent shortfall from the perspective of additional new physics. Starting from a consistent dimension-6 effective field theory Higgs potential extension, we identify the Higgs potential extensions that provide the necessary additional contributions required to achieve a strong first-order electroweak phase transition and trace their phenomenological implications for the Large Hadron Collider. In passing, we critically assess the reliability of the dimension-6 approximation depending on the expected 2HDM phenomenology. In particular, we focus on the role of Higgs pair production (resonant and non-resonant) and interference effects expected in top final states, which are the prime candidates of 2HDM exotics discoveries.


title: JUE Insight: The (Non-)Effect of Opportunity Zones on Housing Prices

abstract: Will the Opportunity Zones (OZ) program, America's largest new place-based policy in decades, generate neighborhood change? We compare single-family housing price growth in OZs with price growth in areas that were eligible but not included in the program. We also compare OZs to their nearest geographic neighbors. Our most credible estimates rule out price impacts greater than 0.5 percentage points with 95% confidence, suggesting that, so far, home buyers don't believe that this subsidy will generate major neighborhood change. OZ status reduces prices in areas with little employment, perhaps because buyers think that subsidizing new investment will increase housing supply. Mixed evidence suggests that OZs may have increased residential permitting.


title: Shift Equivalence Testing of Polynomials and Symbolic Summation of Multivariate Rational Functions

abstract: The Shift Equivalence Testing (SET) of polynomials is deciding whether two polynomials $p(x_1, \ldots, x_m)$ and $q(x_1, \ldots, x_m)$ satisfy the relation $p(x_1 + a_1, \ldots, x_m + a_m) = q(x_1, \ldots, x_m)$ for some $a_1, \ldots, a_m$ in the coefficient field. The SET problem is one of basic computational problems in computer algebra and algebraic complexity theory, which was reduced by Dvir, Oliveira and Shpilka in 2014 to the Polynomial Identity Testing (PIT) problem. This paper presents a general scheme for designing algorithms to solve the SET problem which includes Dvir-Oliveira-Shpilka's algorithm as a special case. With the algorithms for the SET problem over integers, we give complete solutions to two challenging problems in symbolic summation of multivariate rational functions, namely the rational summability problem and the existence problem of telescopers for multivariate rational functions. Our approach is based on the structure of isotropy groups of polynomials introduced by Sato in 1960s. Our results can be used to detect the applicability of the Wilf-Zeilberger method to multivariate rational functions.


title: Manually Acquiring Targets from Multiple Viewpoints Using Video Feedback

abstract: Objective: The effect of camera viewpoint was studied when performing visually obstructed psychomotor targeting tasks. Background: Previous research in laparoscopy and robotic teleoperation found that complex perceptual-motor adaptations associated with misaligned viewpoints corresponded to degraded performance in manipulation. Because optimal camera positioning is often unavailable in restricted environments, alternative viewpoints that might mitigate performance effects are not obvious. Methods: A virtual keyboard-controlled targeting task was remotely distributed to workers of Amazon Mechanical Turk. The experiment was performed by 192 subjects for a static viewpoint with independent parameters of target direction, Fitts' law index of difficulty, viewpoint azimuthal angle (AA), and viewpoint polar angle (PA). A dynamic viewpoint experiment was also performed by 112 subjects in which the viewpoint AA changed after every trial. Results: AA and target direction had significant effects on performance for the static viewpoint experiment. Movement time and travel distance increased while AA increased until there was a discrete improvement in performance for 180{\deg}. Increasing AA from 225{\deg} to 315{\deg} linearly decreased movement time and distance. There were significant main effects of current AA and magnitude of transition for the dynamic viewpoint experiment. Orthogonal direction and no-change viewpoint transitions least affected performance. Conclusions: Viewpoint selection should aim to minimize associated rotations within the manipulation plane when performing targeting tasks whether implementing a static or dynamic viewing solution. Because PA rotations had negligible performance effects, PA adjustments may extend the space of viable viewpoints. Applications: These results can inform viewpoint-selection for visual feedback during psychomotor tasks.


title: Can Visual Dialogue Models Do Scorekeeping? Exploring How Dialogue Representations Incrementally Encode Shared Knowledge

abstract: Cognitively plausible visual dialogue models should keep a mental scoreboard of shared established facts in the dialogue context. We propose a theory-based evaluation method for investigating to what degree models pretrained on the VisDial dataset incrementally build representations that appropriately do scorekeeping. Our conclusion is that the ability to make the distinction between shared and privately known statements along the dialogue is moderately present in the analysed models, but not always incrementally consistent, which may partially be due to the limited need for grounding interactions in the original task.


title: Appending Information Reconciliation for Quantum Key Distribution

abstract: Information reconciliation (IR), which corrects the errors in the sifted keys, directly determines the secure key rate and the link distance of quantum key distribution (QKD) systems. In this article, we propose an appending information reconciliation (AIR) scheme based on polar codes, which achieves high efficiency and ultra-low failure probability simultaneously, by gradually disclosing the bit values of the polarized channels with high error probability. The experimental results show that the efficiency of the proposed AIR scheme is closer to the Shannon limit, compared with the state-of-the-art implemented polar codes-based IR schemes, with the overall failure probability around 1E-8, especially when performed with smaller block sizes. Moreover, the efficiency of the proposed AIR scheme is 1.046, when the block size is 1 Gb and the quantum bit error rate of 0.02. Therefore, the proposed AIR scheme can further eradicate the performance gap between theory and implementation for QKD systems.


title: The multi-modal universe of fast-fashion: the Visuelle 2.0 benchmark

abstract: We present Visuelle 2.0, the first dataset useful for facing diverse prediction problems that a fast-fashion company has to manage routinely. Furthermore, we demonstrate how the use of computer vision is substantial in this scenario. Visuelle 2.0 contains data for 6 seasons / 5355 clothing products of Nuna Lie, a famous Italian company with hundreds of shops located in different areas within the country. In particular, we focus on a specific prediction problem, namely short-observation new product sale forecasting (SO-fore). SO-fore assumes that the season has started and a set of new products is on the shelves of the different stores. The goal is to forecast the sales for a particular horizon, given a short, available past (few weeks), since no earlier statistics are available. To be successful, SO-fore approaches should capture this short past and exploit other modalities or exogenous data. To these aims, Visuelle 2.0 is equipped with disaggregated data at the item-shop level and multi-modal information for each clothing item, allowing computer vision approaches to come into play. The main message that we deliver is that the use of image data with deep networks boosts performances obtained when using the time series in long-term forecasting scenarios, ameliorating the WAPE and MAE by up to 5.48% and 7% respectively compared to competitive baseline methods. The dataset is available at https://humaticslab.github.io/forecasting/visuelle


title: Automatic generation of complementary auxiliary basis sets (CABS) for explicitly correlated methods

abstract: Explicitly correlated calculations, aside from the orbital basis set, typically require three auxiliary basis sets: JK (Coulomb-exchange fitting), RI-MP2 (resolution of the identity MP2), and CABS (complementary auxiliary basis set). If unavailable for the orbital basis set and chemical elements of interest, the first two can be auto-generated on the fly using existing algorithms, but not the third. In this paper, we present a quite simple algorithm named autoCABS; a Python implementation under a free software license is offered at Github. For the cc-pVnZ-F12 (n=D,T,Q,5) and the W4-08 thermochemical benchmark, we demonstrate that autoCABS-generated CABS basis sets are comparable in quality to purpose-optimized OptRI basis sets from the literature, and that the quality difference becomes entirely negligible as n increases.


title: Planting Undetectable Backdoors in Machine Learning Models

abstract: Given the computational cost and technical expertise required to train machine learning models, users may delegate the task of learning to a service provider. We show how a malicious learner can plant an undetectable backdoor into a classifier. On the surface, such a backdoored classifier behaves normally, but in reality, the learner maintains a mechanism for changing the classification of any input, with only a slight perturbation. Importantly, without the appropriate "backdoor key", the mechanism is hidden and cannot be detected by any computationally-bounded observer. We demonstrate two frameworks for planting undetectable backdoors, with incomparable guarantees. First, we show how to plant a backdoor in any model, using digital signature schemes. The construction guarantees that given black-box access to the original model and the backdoored version, it is computationally infeasible to find even a single input where they differ. This property implies that the backdoored model has generalization error comparable with the original model. Second, we demonstrate how to insert undetectable backdoors in models trained using the Random Fourier Features (RFF) learning paradigm or in Random ReLU networks. In this construction, undetectability holds against powerful white-box distinguishers: given a complete description of the network and the training data, no efficient distinguisher can guess whether the model is "clean" or contains a backdoor. Our construction of undetectable backdoors also sheds light on the related issue of robustness to adversarial examples. In particular, our construction can produce a classifier that is indistinguishable from an "adversarially robust" classifier, but where every input has an adversarial example! In summary, the existence of undetectable backdoors represent a significant theoretical roadblock to certifying adversarial robustness.


title: Non-equilibrium Phonon Thermal Resistance at MoS2/Oxide and Graphene/Oxide Interfaces

abstract: Accurate measurements and physical understanding of thermal boundary resistance (R) of two-dimensional (2D) materials are imperative for effective thermal management of 2D electronics and photonics. In previous studies, heat dissipation from 2D material devices was presumed to be dominated by phonon transport across the interfaces. In this study, we find that in addition to phonon transport, thermal resistance between non-equilibrium phonons in the 2D materials could play a critical role too when the 2D material devices are internally self-heated, either optically or electrically. We accurately measure R of oxide/MoS2/oxide and oxide/graphene/oxide interfaces for three oxides (SiO2, HfO2, Al2O3) by differential time-domain thermoreflectance (TDTR). Our measurements of R across these interfaces with external heating are 2-to-4 times lower than previously reported R of the similar interfaces measured by Raman thermometry with internal self-heating. Using a simple model, we show that the observed discrepancy can be explained by an additional internal thermal resistance (Rint) between non-equilibrium phonons present during Raman measurements. We subsequently estimate that for MoS2 and graphene, Rint is about 31 and 22 m2 K/GW, respectively. The values are comparable to the thermal resistance due to finite phonon transmission across interfaces of 2D materials and thus cannot be ignored in the design of 2D material devices. Moreover, the non-equilibrium phonons also lead to a different temperature dependence than that by phonon transport. As such, our work provides important insights into physical understanding of heat dissipation in 2D material devices.


title: Arithmetic level raising for certain quaternionic unitary Shimura variety

abstract: In this article we prove an arithmetic level raising theorem for the symplectic group of degree four in the ramified case. This result is a key step towards the Beilinson-Bloch-Kato conjecture for certain Rankin-Selberg motives associated to orthogonal groups within the framework of the Gan-Gross-Prasad conjecture. The theorem itself can be also viewed as an analogue of the Ihara's lemma or the Tate conjecture for special fibers of Shimura varieties at ramified characteristics. The proof relies heavily on the description of the supersingular locus of certain quaternionic unitary Shimura variety which is closely related to the classical Siegel threefold.


title: Long range entanglement in quantum dot systems under the Fermi-Hubbard approach

abstract: In the present paper we are interested in analyzing the pairwise entanglement in quantum dots, as ququart systems, naturally described by the Fermi-Hubbard model. Using the lower bound of concurrence we show the effect of the Coulomb interaction on the pairwise entanglement and creating entanglement within the pairs. Specifically, it is shown that the range of entanglement can be extended to the third neighboring site for a system size of $L=4$, while for $L>4$ the range could be created and extended to the third neighboring site by means of the Coulomb interaction. A rigorous description of the pairs is given in terms of a local half filled state associated to each pair with an electron number $N=2$ and a spin $S=0$. A thorough study of this state provides a proper explanation related to the pairwise entanglement, namely its amount and its behavior under the effect of the Coulomb interaction as well as the system's size.


title: Impact of centre vortex removal on the Landau-gauge quark propagator in dynamical QCD

abstract: The important role of centre vortices in dynamical chiral symmetry breaking and corresponding dynamical mass generation has been demonstrated in pure gauge studies of the Landau-gauge quark propagator. We present initial results of our investigation into the impact of centre vortex removal on the Landau-gauge propagator on dynamical gauge fields. To ensure sensitivity to the topology of the gauge fields, the propagator is computed with overlap fermions. Upon removal of centre vortices we find that dynamical mass generation is suppressed. The quark renormalisation function remains remarkably flat except in the deep infrared where it exhibits significant suppression. These effects become more prominent at lighter quark masses.


title: HyDe: The First Open-Source, Python-Based, GPU-Accelerated Hyperspectral Denoising Package

abstract: As with any physical instrument, hyperspectral cameras induce different kinds of noise in the acquired data. Therefore, Hyperspectral denoising is a crucial step for analyzing hyperspectral images (HSIs). Conventional computational methods rarely use GPUs to improve efficiency and are not fully open-source. Alternatively, deep learning-based methods are often open-source and use GPUs, but their training and utilization for real-world applications remain non-trivial for many researchers. Consequently, we propose HyDe: the first open-source, GPU-accelerated Python-based, hyperspectral image denoising toolbox, which aims to provide a large set of methods with an easy-to-use environment. HyDe includes a variety of methods ranging from low-rank wavelet-based methods to deep neural network (DNN) models. HyDe's interface dramatically improves the interoperability of these methods and the performance of the underlying functions. In fact, these methods maintain similar HSI denoising performance to their original implementations while consuming nearly ten times less energy. Furthermore, we present a method for training DNNs for denoising HSIs which are not spatially related to the training dataset, i.e., training on ground-level HSIs for denoising HSIs with other perspectives including airborne, drone-borne, and space-borne. To utilize the trained DNNs, we show a sliding window method to effectively denoise HSIs which would otherwise require more than 40 GB. The package can be found at: \url{https://github.com/Helmholtz-AI-Energy/HyDe}.


title: Few Observation Binary Orbit Solver (FOBOS) from two (or more) astrometric observations

abstract: We have developed a new, fast method of estimating the orbital properties of a binary or triple system using as few as two epochs of astrometric data. FOBOS (Few Observation Binary Orbit Solver) uses a flat prior brute force Monte Carlo method to produce probability density functions of the likely orbital parameters. We test the code on fake observations and show that it can (fairly often) constrain the semi-major axis to within a factor of 2-3, and the inclination to within $\sim$20$^{\circ}$ from only two astrometric observations. We also show that the 68 and 95 per cent confidence intervals are statistically reliable. Applying this method to triple systems allows the relative inclination of the secondary and tertiary star orbits to be constrained. FOBOS can usually find a statistically significant number of possible matches in CPU minutes for binary systems, and CPU hours for triple systems.


title: Gravitational wave memory and its tail in cosmology

abstract: We study gravitational wave memory effect in the FRW cosmological model with matter and cosmological constant. Since the background is curved, gravitational radiation develops a tail part arriving after the main signal that travels along the past light cone of the observer. First we discuss first order gravitational wave sourced by a binary system, and find that the tail only gives a negligible memory, in accord with previous results. Then we study the nonlinear memory effect coming from induced gravitational radiation sourced by first order gravitational radiation propagating over cosmological distances. In the light cone part of the induced gravitational wave we find a novel term missed in previous studies of the cosmological memory effect. Furthermore, we show that the induced gravitational wave has a tail part that slowly accumulates after the light cone part has passed and grows to a sizeable magnitude over a cosmological timescale. This tail part of the memory effect will be a new component in the stochastic gravitational wave background.


title: Gibbs partitions: a comprehensive phase diagram

abstract: We study Gibbs partition models, also known as composition schemes. Our main results comprehensively describe their phase diagram, including a phase transition from the convergent case described in Stufler (2018, Random Structures \& Algorithms) to a new dense regime characterized by a linear number of components with fluctuations of smaller order quantified by an $\alpha$-stable law for $1< \alpha \le 2$. We prove a functional scaling limit for a process whose jumps correspond to the component sizes and discuss applications to extremal component sizes. At the transition we observe a mixture of the two asymptotic shapes. We also treat extended composition schemes and prove a local limit theorem in a dilute regime with the limiting law being related to an $\alpha$-stable law for $0< \alpha < 1$. We describe the asymptotic size of the largest components via a point process limit.


title: Cutting rules on a cylinder and simplified diagrammatic approach to $CP$ violation in quantum kinetic theory

abstract: We briefly explain a novel diagrammatic method for including thermal corrections in $CP$ asymmetric reaction rates entering the quantum Boltzmann equation. In thermal equilibrium, the asymmetries have to cancel precisely due to the $S$-matrix unitarity and $CPT$ invariance. Such cancelations are easy to track in zero-temperature leading-order calculations. However, accounting for medium effects requires modification of the on-shell part of propagators and, consequently, the $CP$ violating rates. In the literature, the correct form of the statistical factors in the asymmetry source term has been obtained employing the real-time-formalism of non-equilibrium field theory in a certain approximation. We demonstrate that the same results can be obtained by summing an infinite sequence of zero-temperature asymmetries. Those are derived from cuttings of forward diagrams drawn on a cylindrical surface, while thermal corrections come from windings of their propagators. The procedure is entirely diagrammatic, and the $CPT$ and unitarity cancelations are formulated for thermally corrected reaction rate asymmetries. The simplification achieved is the primary focus of our work. The aspect of infrared finiteness in higher-order corrections will also be discussed.


title: Repulsive Fermi and Bose Polarons in Quantum Gases

abstract: Polaron quasiparticles are formed when a mobile impurity is coupled to the elementary excitations of a many-particle background. In the field of ultracold atoms, the study of the associated impurity problem has attracted a growing interest over the last fifteen years. Polaron quasiparticle properties are essential to our understanding of a variety of paradigmatic quantum many-body systems realized in ultracold atomic gases and in the solid state, from imbalanced Bose-Fermi and Fermi-Fermi mixtures to fermionic Hubbard models. In this topical review, we focus on the so-called repulsive polaron branch, which emerges as an excited many-body state in systems with underlying attractive interactions such as ultracold atomic mixtures, and is characterized by an effective repulsion between the impurity and the surrounding medium. We give a brief account of the current theoretical and experimental understanding of repulsive polaron properties, for impurities embedded in both fermionic and bosonic media, and we highlight open issues deserving future investigations.


title: The average Euler-genus of the vertex-amalgamation of signed graphs

abstract: In this paper, we first generalize a theorem for counting the number of faces of an oriented embedding of a graph that passing through a given cut-edge set [S. Stahl, Trans. Amer. Math. Soc. 259 (1980), 129--145] to all surfaces. Then we extend Stahl's bounds for the average genus of the vertex-amalgamation of graphs [S. Stahl, Discrete Math. 142 (1995), 235--245] to signed graphs.


title: Cross-Image Relational Knowledge Distillation for Semantic Segmentation

abstract: Current Knowledge Distillation (KD) methods for semantic segmentation often guide the student to mimic the teacher's structured information generated from individual data samples. However, they ignore the global semantic relations among pixels across various images that are valuable for KD. This paper proposes a novel Cross-Image Relational KD (CIRKD), which focuses on transferring structured pixel-to-pixel and pixel-to-region relations among the whole images. The motivation is that a good teacher network could construct a well-structured feature space in terms of global pixel dependencies. CIRKD makes the student mimic better structured semantic relations from the teacher, thus improving the segmentation performance. Experimental results over Cityscapes, CamVid and Pascal VOC datasets demonstrate the effectiveness of our proposed approach against state-of-the-art distillation methods. The code is available at https://github.com/winycg/CIRKD.


title: Non-autonomous hybrid stochastic systems with delays

abstract: The aim of this paper is to study the dynamical behavior of non-autonomous stochastic hybrid systems with delays. By general Krylov-Bogolyubov's method, we first obtain the sufficient conditions for the existence of an evolution system of measures of the non-autonomous stochastic system and also give some easily verifiable conditions. We then prove a sufficient condition for convergence of evolution systems of measures as the delay approaches zero. As an application of the abstract theory, we first prove the existence of evolution systems of measures for stochastic system with time-vary delays, which comes from feedback control problem based on discrete-time state observations. Furthermore, when observation interval goes to zero, we show every limit point of a sequence of evolution system of measures of the non-autonomous stochastic system must be a evolution system of measures of the limiting system.


title: Trust2Vec: Large-Scale IoT Trust Management System based on Signed Network Embeddings

abstract: A trust management system (TMS) is an integral component of any IoT network. A reliable trust management system must guarantee the network security, data integrity, and act as a referee that promotes legitimate devices, and punishes any malicious activities. Trust scores assigned by TMSs reflect devices' reputations, which can help predict the future behaviours of network entities and subsequently judge the reliability of different network entities in IoT networks. Many TMSs have been proposed in the literature, these systems are designed for small-scale trust attacks, and can deal with attacks where a malicious device tries to undermine TMS by spreading fake trust reports. However, these systems are prone to large-scale trust attacks. To address this problem, in this paper, we propose a TMS for large-scale IoT systems called Trust2Vec, which can manage trust relationships in large-scale IoT systems and can mitigate large-scale trust attacks that are performed by hundreds of malicious devices. Trust2Vec leverages a random-walk network exploration algorithm that navigates the trust relationship among devices and computes trust network embeddings, which enables it to analyze the latent network structure of trust relationships, even if there is no direct trust rating between two malicious devices. To detect large-scale attacks, suck as self-promoting and bad-mouthing, we propose a network embeddings community detection algorithm that detects and blocks communities of malicious nodes. The effectiveness of Trust2Vec is validated through large-scale IoT network simulation. The results show that Trust2Vec can achieve up to 94\% mitigation rate in various network scenarios.


title: Atmospheric Turbulence Removal with Complex-Valued Convolutional Neural Network

abstract: Atmospheric turbulence distorts visual imagery and is always problematic for information interpretation by both human and machine. Most well-developed approaches to remove atmospheric turbulence distortion are model-based. However, these methods require high computation and large memory making real-time operation infeasible. Deep learning-based approaches have hence gained more attention but currently work efficiently only on static scenes. This paper presents a novel learning-based framework offering short temporal spanning to support dynamic scenes. We exploit complex-valued convolutions as phase information, altered by atmospheric turbulence, is captured better than using ordinary real-valued convolutions. Two concatenated modules are proposed. The first module aims to remove geometric distortions and, if enough memory, the second module is applied to refine micro details of the videos. Experimental results show that our proposed framework efficiently mitigates the atmospheric turbulence distortion and significantly outperforms existing methods.


title: Observable adjustments in single-index models for regularized M-estimators

abstract: We consider observations $(X,y)$ from single index models with unknown link function, Gaussian covariates and a regularized M-estimator $\hat\beta$ constructed from convex loss function and regularizer. In the regime where sample size $n$ and dimension $p$ are both increasing such that $p/n$ has a finite limit, the behavior of the empirical distribution of $\hat\beta$ and the predicted values $X\hat\beta$ has been previously characterized in a number of models: The empirical distributions are known to converge to proximal operators of the loss and penalty in a related Gaussian sequence model, which captures the interplay between ratio $p/n$, loss, regularization and the data generating process. This connection between$(\hat\beta,X\hat\beta)$ and the corresponding proximal operators require solving fixed-point equations that typically involve unobservable quantities such as the prior distribution on the index or the link function. This paper develops a different theory to describe the empirical distribution of $\hat\beta$ and $X\hat\beta$: Approximations of $(\hat\beta,X\hat\beta)$ in terms of proximal operators are provided that only involve observable adjustments. These proposed observable adjustments are data-driven, e.g., do not require prior knowledge of the index or the link function. These new adjustments yield confidence intervals for individual components of the index, as well as estimators of the correlation of $\hat\beta$ with the index. The interplay between loss, regularization and the model is thus captured in a data-driven manner, without solving the fixed-point equations studied in previous works. The results apply to both strongly convex regularizers and unregularized M-estimation. Simulations are provided for the square and logistic loss in single index models including logistic regression and 1-bit compressed sensing with 20\% corrupted bits.


title: Role of Polarons in Single-Atom Catalysts: Case Study of Me1 [Au1, Pt1, and Rh1] on TiO2(110)

abstract: The local environment of metal-oxide supported single-atom catalysts plays a decisive role in the surface reactivity and related catalytic properties. The study of such systems is complicated by the presence of point defects on the surface, which are often associated with the localization of excess charge in the form of polarons. This can affect the stability, the electronic configuration, and the local geometry of the adsorbed adatoms. In this work, through the use of density functional theory and surface-sensitive experiments, we study the adsorption of Rh1, Pt1, and Au1 metals on the reduced TiO2(110) surface; a prototypical polaronic material. A systematic analysis of the adsorption configurations and oxidation states of the adsorbed metals reveals different types of couplings between adsorbates and polarons. As confirmed by scanning tunneling microscopy measurements, the favored Pt1 and Au1 adsorption at oxygen vacancy sites is associated with a strong electronic charge transfer from polaronic states to adatom orbitals, which results in a reduction of the adsorbed metal. In contrast, the Rh1 adatoms interact weakly with the excess charge, which leaves the polarons largely unaffected. Our results show that an accurate understanding of the properties of single-atom catalysts on oxide surfaces requires a careful account of the interplay between adatoms, vacancy sites, and polarons.


title: Presentations for wreath products involving symmetric inverse monoids and categories

abstract: Wreath products involving symmetric inverse monoids/semigroups/categories arise in many areas of algebra and science, and presentations by generators and relations are crucial tools in such studies. The current paper finds such presentations for $M\wr\mathcal I_n$, $M\wr\operatorname{Sing}(\mathcal I_n)$ and $M\wr\mathcal I$. Here $M$ is an arbitrary monoid, $\mathcal I_n$ is the symmetric inverse monoid, $\operatorname{Sing}(\mathcal I_n)$ its singular ideal, and $\mathcal I$ is the symmetric inverse category.


title: Measurement of energy differential spectrum of cosmic-ray muons below 400 MeV

abstract: Recent applications of cosmic-ray muons require accurate modeling of their flux at low-energy. However, no measurement has been reported below 400 MeV. Therefore, we developed a full-absorption muon energy spectrometer to obtain energy differential flux below 400 MeV. Because our main detector can measure muon energies below 75 MeV, an energy degradation method is adopted (using 5- and 20-cm thick lead blocks) to shift the sensitive energy range. Three measurements were performed (in the normal mode and the two energy degrading modes) for 10 and 11 days each. The measurement results were compared with an analytical cosmic-ray model, PARMA (the particle and heavy ion transport code system-based analytical radiation model in the atmosphere) and we found that the model can precisely predict the lower energy part of the flux.


title: Benchmarking an improved statistical adiabatic channel model for competing inelastic and reactive processes

abstract: Inelastic collisions and elementary chemical reactions proceeding through the formation and subsequent decay of an intermediate collision complex, with an associated deep well on the potential energy surface, pose a challenge for accurate fully quantum mechanical approaches, such as the close-coupling method. In this study, we report on the theoretical prediction of temperature-dependent state-to-state rate coefficients for these complex-mode processes, using a statistical quantum method. This statistical adiabatic channel model is benchmarked by a direct comparison using accurate rate coefficients from the literature for a number of systems (H2 + H+, HD + H+, SH+ + H, and CH+ + H) of interest in astrochemistry and astrophysics. For all of the systems considered, an error of less than factor 2 was found, at least for the dominant transitions and at low temperatures, which is sufficiently accurate for applications in the above mentioned disciplines.


title: $\beta^{2}$ corrections to spherical EDF calculations for root-mean-square charge radii

abstract: Root-mean-square charge radii are discussed in terms of spherical Energy Density Functional (EDF) models corrected for quadrupole deformations. Comparisons between experiment and theory are made for the absolute radii of all even-even nuclei, for the isotonic shift between cadmium and tin isotopes, the isotopic shifts of the calcium isotopes and the isotonic shift for nuclei with $ N=28 $. We conclude that the data are well described in this approach, except for the sharp rise just after the neutron magic numbers.


title: Optimal Myopic Attacks on Nonlinear Estimation

abstract: Recent high-profile incidents have exposed security risks in control systems. Particularly important and safety-critical modules for security analysis are estimation and control (E&C). Prior works have analyzed the security of E&C for linear, time-invariant systems; however, there are few analyses of nonlinear systems despite their broad use. In an effort to facilitate identifying vulnerabilities in control systems, in this work we establish a class of optimal attacks on nonlinear E&C. Specifically, we define two attack objectives and illustrate that realizing the optimal attacks against the widely-adopted extended Kalman filter with industry-standard $\chi^2$ anomaly detection is equivalent to solving convex quadratically-constrained quadratic programs. Given an appropriate information model for the attacker (i.e.,~a specified amount of attacker knowledge), we provide practical relaxations on the optimal attacks to allow for their computation at runtime. We also show that the difference between the optimal and relaxed attacks is bounded. Finally, we illustrate the use of the introduced attack designs on a case-study.


title: A Machine Learning Approach to Automatic Classification of Eight Sleep Disorders

abstract: In this research, we attempt to answer the following basic research questions: Is a machine learning model able to classify all types of sleep disorders with high accuracy? Among the different modalities of sleep disorder signals, are some more important than others? Do raw signals improve the performance of a deep learning model when they are used as inputs? Prior research showed that most sleep disorders belong to eight categories. To study the performance of machine learning models in classifying polysomnography recordings into the eight categories of sleep pathologies, we selected the Cyclic Alternating Pattern Sleep Database. We developed a multi-channel Deep Learning model where a set of Convolutional Neural Networks were applied to six channels of raw signals of different modalities, including three channels of EEG signals and one channel each of EMG, ECG , and EOG signals. To compare the performance of the DL model with other models, we designed a model that took spectral features, instead of raw signals, as its inputs. We first studied the "importance" issue of signal modalities using the RF algorithm. We found that ECG contributed most to the important features and EMG second, among the four signal modalities. We then studied the accuracy performance of the proposed machine learning models. We verified that the multi-channel DL-R model, which took raw signals as its inputs, outperformed all other models, with its sensitivity and specificity scores both being above 95 %. This accuracy performance is on a par with those published results which dealt with fewer types of sleep disorders. We adopted two popular heatmap-generating techniques, with which we confirmed that the DL model's superior performance was owing to the CNN network's ability to extract potent features from raw signals.


title: QCD Phase Boundary and the Hadrochemical Horizon

abstract: I review the physics of the phase boundary between hadronic matter and quark matter from several different points of view. These include thermodynamics, statistical physics, and chemical kinetics. In particular, the review focuses on the role of the chemical freeze-out line and its relation to the concept of valence quark percolation. The review ends with some recollections of Jean Cleymans.


title: "Double-path" ferroelectrics and the sign of the piezoelectric response

abstract: In this work, we propose a class of ferroelectrics (which we denote "double-path" ferroelectrics), characterized by two competing polarization switching paths for which the change in polarization is different and in fact of opposite sign. Depending on which path is favorable under given conditions, this leads to different identification of up- and down-polarized states. Since the sign of piezoelectric response depends on the assignment of up- or down-polarized state for a specific structure, this means that the material can exhibit different signs of the piezoelectric response under different conditions. We focus on HfO$_2$ as a key example. Our first-principles calculations show that there are two competing paths in HfO$_2$, resulting from different displacements of the atoms from the initial to the final structures, and the change in polarization along these two paths is of opposite sign. These results provide a natural explanation for the recently observed discrepancy in the signs of piezoelectric responses in HfO$_2$ between theoretical first-principles calculations and experimental observation. Further, this allows predictions of how to favor one path over another by changes in conditions and compositional tuning. This family of materials also includes other candidates, such as CuInP$_2$S$_6$ and theoretically proposed LaVO$_3$-SrVO$_3$ superlattice. We finally note that double-path ferroelectrics possess novel electromechanical properties since the signs of their piezoelectric responses can be switched.


title: Solving AC Power Flow with Graph Neural Networks under Realistic Constraints

abstract: In this paper, we propose a graph neural network architecture to solve the AC power flow problem under realistic constraints. To ensure a safe and resilient operation of distribution grids, AC power flow calculations are the means of choice to determine grid operating limits or analyze grid asset utilization in planning procedures. In our approach, we demonstrate the development of a framework that uses graph neural networks to learn the physical constraints of the power flow. We present our model architecture on which we perform unsupervised training to learn a general solution of the AC power flow formulation independent of the specific topologies and supply tasks used for training. Finally, we demonstrate, validate and discuss our results on medium voltage benchmark grids. In our approach, we focus on the physical and topological properties of distribution grids to provide scalable solutions for real grid topologies. Therefore, we take a data-driven approach, using large and diverse data sets consisting of realistic grid topologies, for the unsupervised training of the AC power flow graph neural network architecture and compare the results to a prior neural architecture and the Newton-Raphson method. Our approach shows a high increase in computation time and good accuracy compared to state-of-the-art solvers. It also out-performs that neural solver for power flow in terms of accuracy.


title: Surface and electronic structure at atomic length scales of the non-symmorphic antiferromagnet Eu$_5$In$_2$Sb$_6$

abstract: We performed Scanning Tunneling Microscopy and Spectroscopy (STM/STS) measurements to investigate the Zintl phase Eu$_5$In$_2$Sb$_6$, a non-symmorphic antiferromagnet. The theoretical prediction of a non-trivial Fermi surface topology stabilized by the non-symmorphic symmetry motivated our research. On the cleaved (010) plane, we obtained striped patterns that can be correlated to the stacking of the [In$_2$Sb$_6$]$^{10-}$ double chains along the crystallographic $c$ axis. The attempted cleavage along the $a$ axis revealed a more complex pattern. We combined the STS measurement on non-reconstructed (010) and (081) surfaces with DFT calculations to further elucidate the electronic structure of Eu$_5$In$_2$Sb$_6$. From our investigations so far, direct experimental evidence of the predicted topological surface states remains elusive.


title: XLMRQA: Open-Domain Question Answering on Vietnamese Wikipedia-based Textual Knowledge Source

abstract: Question answering (QA) is a natural language understanding task within the fields of information retrieval and information extraction that has attracted much attention from the computational linguistics and artificial intelligence research community in recent years because of the strong development of machine reading comprehension-based models. A reader-based QA system is a high-level search engine that can find correct answers to queries or questions in open-domain or domain-specific texts using machine reading comprehension (MRC) techniques. The majority of advancements in data resources and machine-learning approaches in the MRC and QA systems especially are developed significantly in two resource-rich languages such as English and Chinese. A low-resource language like Vietnamese has witnessed a scarcity of research on QA systems. This paper presents XLMRQA, the first Vietnamese QA system using a supervised transformer-based reader on the Wikipedia-based textual knowledge source (using the UIT-ViQuAD corpus), outperforming the two robust QA systems using deep neural network models: DrQA and BERTserini with 24.46% and 6.28%, respectively. From the results obtained on the three systems, we analyze the influence of question types on the performance of the QA systems.


title: Probability monads with submonads of deterministic states - Extended version

abstract: Probability theory can be studied synthetically as the computational effect embodied by a commutative monad. In the recently proposed Markov categories, one works with an abstraction of the Kleisli category and then defines deterministic morphisms equationally in terms of copying and discarding. The resulting difference between 'pure' and 'deterministic' leads us to investigate the 'sober' objects for a probability monad, for which the two concepts coincide. We propose natural conditions on a probability monad which allow us to identify the sober objects and define an idempotent sobrification functor. Our framework applies to many examples of interest, including the Giry monad on measurable spaces, and allows us to sharpen a previously given version of de Finetti's theorem for Markov categories. This is an extended version of the paper accepted for the Logic In Computer Science (LICS) conference 2022. In this document we include more mathematical details, including all the proofs, of the statements and constructions given in the published version.


title: Medical Application of Geometric Deep Learning for the Diagnosis of Glaucoma

abstract: Purpose: (1) To assess the performance of geometric deep learning (PointNet) in diagnosing glaucoma from a single optical coherence tomography (OCT) 3D scan of the optic nerve head (ONH); (2) To compare its performance to that obtained with a standard 3D convolutional neural network (CNN), and with a gold-standard glaucoma parameter, i.e. retinal nerve fiber layer (RNFL) thickness. Methods: 3D raster scans of the ONH were acquired with Spectralis OCT for 477 glaucoma and 2,296 non-glaucoma subjects at the Singapore National Eye Centre. All volumes were automatically segmented using deep learning to identify 7 major neural and connective tissues including the RNFL, the prelamina, and the lamina cribrosa (LC). Each ONH was then represented as a 3D point cloud with 1,000 points chosen randomly from all tissue boundaries. To simplify the problem, all ONH point clouds were aligned with respect to the plane and center of Bruch's membrane opening. Geometric deep learning (PointNet) was then used to provide a glaucoma diagnosis from a single OCT point cloud. The performance of our approach was compared to that obtained with a 3D CNN, and with RNFL thickness. Results: PointNet was able to provide a robust glaucoma diagnosis solely from the ONH represented as a 3D point cloud (AUC=95%). The performance of PointNet was superior to that obtained with a standard 3D CNN (AUC=87%) and with that obtained from RNFL thickness alone (AUC=80%). Discussion: We provide a proof-of-principle for the application of geometric deep learning in the field of glaucoma. Our technique requires significantly less information as input to perform better than a 3D CNN, and with an AUC superior to that obtained from RNFL thickness alone. Geometric deep learning may have wide applicability in the field of Ophthalmology.


title: Interpretability of Machine Learning Methods Applied to Neuroimaging

abstract: Deep learning methods have become very popular for the processing of natural images, and were then successfully adapted to the neuroimaging field. As these methods are non-transparent, interpretability methods are needed to validate them and ensure their reliability. Indeed, it has been shown that deep learning models may obtain high performance even when using irrelevant features, by exploiting biases in the training set. Such undesirable situations can potentially be detected by using interpretability methods. Recently, many methods have been proposed to interpret neural networks. However, this domain is not mature yet. Machine learning users face two major issues when aiming to interpret their models: which method to choose, and how to assess its reliability? Here, we aim at providing answers to these questions by presenting the most common interpretability methods and metrics developed to assess their reliability, as well as their applications and benchmarks in the neuroimaging context. Note that this is not an exhaustive survey: we aimed to focus on the studies which we found to be the most representative and relevant.


title: Independent sequences and freeness criteria

abstract: Let $M$ be a module over a Noetherian local ring $A$. We study $M$-independent sequences of elements of $\mathfrak{m}_A$ in the sense of Lech and Hanes. The main tool is a new characterization of the $M$-independence of a sequence in terms of the associated Koszul complex. As applications, we give a result in linkage theory, a freeness criterion for $M$ in terms of the existence of a strongly $M$-independent sequence of length $edim(A)$, and another freeness criterion inspired from the patching method of Calegari and Geraghty for balanced modules in their 2018 paper.


title: Symplectic monodromy at radius zero and equimultiplicity of $\mu$-constant families

abstract: We show that every family of isolated hypersurface singularity with constant Milnor number has constant multiplicity. To achieve this, we endow the A'Campo model of "radius zero" monodromy with a symplectic structure. This new approach allows to generalize a spectral sequence of McLean converging to fixed point Floer homology of iterates of the monodromy to a more general setting which is well suited to study $\mu$-constant families.


title: Parabolic optimal control problems with combinatorial switching constraints -- Part II: Outer approximation algorithm

abstract: We consider optimal control problems for partial differential equations where the controls take binary values but vary over the time horizon, they can thus be seen as dynamic switches. The switching patterns may be subject to combinatorial constraints such as, e.g., an upper bound on the total number of switchings or a lower bound on the time between two switchings. In a companion paper [arXiv:2203.07121], we describe the $L^p$-closure of the convex hull of feasible switching patterns as intersection of convex sets derived from finite-dimensional projections. In this paper, the resulting outer description is used for the construction of an outer approximation algorithm in function space, whose iterates are proven to converge strongly in $L^2$ to the global minimizer of the convexified optimal control problem. The linear-quadratic subproblems arising in each iteration of the outer approximation algorithm are solved by means of a semi-smooth Newton method. A numerical example in two spatial dimensions illustrates the efficiency of the overall algorithm.


title: Learning Invariances with Generalised Input-Convex Neural Networks

abstract: Considering smooth mappings from input vectors to continuous targets, our goal is to characterise subspaces of the input domain, which are invariant under such mappings. Thus, we want to characterise manifolds implicitly defined by level sets. Specifically, this characterisation should be of a global parametric form, which is especially useful for different informed data exploration tasks, such as building grid-based approximations, sampling points along the level curves, or finding trajectories on the manifold. However, global parameterisations can only exist if the level sets are connected. For this purpose, we introduce a novel and flexible class of neural networks that generalise input-convex networks. These networks represent functions that are guaranteed to have connected level sets forming smooth manifolds on the input space. We further show that global parameterisations of these level sets can be always found efficiently. Lastly, we demonstrate that our novel technique for characterising invariances is a powerful generative data exploration tool in real-world applications, such as computational chemistry.


title: Anti-Asian Hate Speech Detection via Data Augmented Semantic Relation Inference

abstract: With the spreading of hate speech on social media in recent years, automatic detection of hate speech is becoming a crucial task and has attracted attention from various communities. This task aims to recognize online posts (e.g., tweets) that contain hateful information. The peculiarities of languages in social media, such as short and poorly written content, lead to the difficulty of learning semantics and capturing discriminative features of hate speech. Previous studies have utilized additional useful resources, such as sentiment hashtags, to improve the performance of hate speech detection. Hashtags are added as input features serving either as sentiment-lexicons or extra context information. However, our close investigation shows that directly leveraging these features without considering their context may introduce noise to classifiers. In this paper, we propose a novel approach to leverage sentiment hashtags to enhance hate speech detection in a natural language inference framework. We design a novel framework SRIC that simultaneously performs two tasks: (1) semantic relation inference between online posts and sentiment hashtags, and (2) sentiment classification on these posts. The semantic relation inference aims to encourage the model to encode sentiment-indicative information into representations of online posts. We conduct extensive experiments on two real-world datasets and demonstrate the effectiveness of our proposed framework compared with state-of-the-art representation learning models.


title: Programming Quantum Hardware via Levenberg Marquardt Machine Learning

abstract: Significant challenges remain with the development of macroscopic quantum computing, hardware problems of noise, decoherence, and scaling, software problems of error correction, and, most important, algorithm construction. Finding truly quantum algorithms is quite difficult, and many quantum algorithms, like Shor prime factoring or phase estimation, require extremely long circuit depth for any practical application, necessitating error correction. Machine learning can be used as a systematic method to nonalgorithmically program quantum computers. Quantum machine learning enables us to perform computations without breaking down an algorithm into its gate building blocks, eliminating that difficult step and potentially reducing unnecessary complexity. In addition, we have shown that our machine learning approach is robust to both noise and to decoherence, which is ideal for running on inherently noisy NISQ devices which are limited in the number of qubits available for error correction. We demonstrated this using a fundamentally non classical calculation, experimentally estimating the entanglement of an unknown quantum state. Results from this have been successfully ported to the IBM hardware and trained using a powerful hybrid reinforcement learning technique which is a modified Levenberg Marquardt LM method. The LM method is ideally suited to quantum machine learning as it only requires knowledge of the final measured output of the quantum computation, not intermediate quantum states which are generally not accessible. Since it processes all the learning data simultaneously, it also requires significantly fewer hits on the quantum hardware. Machine learning is demonstrated with results from simulations and runs on the IBM Qiskit hardware interface.


title: The gMOSS: the galaxy survey and galaxy populations of the large homogeneous field

abstract: We present the gMOSS (Galaxies of Medium-band One-meter Schmidt telescope Survey) catalog of $\sim$ 19,000 galaxies in 20 filters (4 broadband SDSS and 16 medium-band filters). We observed 2.386 $\mathrm{deg^2}$ on the central part of the HS47.5-22 field with the 1-m Schmidt telescope of the Byurakan Astrophysical Observatory. The gMOSS is a complete flux-limited sample of galaxies with a threshold magnitude of $r$ SDSS $\le$ 22.5 AB. From photometric measurements with 16 medium-band filters and $u$ SDSS, we get spectral energy distributions for each object in the field, which are used for further analysis. Galaxy classification and photometric redshift estimation based on spectral template matching with ZEBRA software. The obtained redshift accuracy is $\sigma_\mathrm{{NMAD}} < 0.0043$. Using the SED-fitting CIGALE code, we obtained the main properties of the stellar population of galaxies, such as rest-frame $(u - r)_{\mathrm{res}}$ colour, stellar mass, extinction, and mass-weighted age with a precision of $0.16 \pm 0.07$ mag, $0.14 \pm 0.04$ dex, $0.27 \pm 0.1$ mag, and $0.08 \pm 0.04$ dex, respectively. Using a dust-corrected colour-mass diagram, we divided the full sample into populations of red and blue galaxies and considered the dependencies between stellar mass and age. Throughout cosmic time, red sequence galaxies remain older and more massive than blue cloud galaxies. The star formation history of a complete subsample of galaxies selected in the redshift range $0.05\le z\le0.015$ with <$\mathrm{log} M \mathrm{>}_\mathrm{[M_\odot]}$>8.3 shows an increase in the SFRD up to $z\sim3$, under the results obtained in earlier studies.


title: Optimal Reference for DNA Synthesis

abstract: In the recent years, DNA has emerged as a potentially viable storage technology. DNA synthesis, which refers to the task of writing the data into DNA, is perhaps the most costly part of existing storage systems. Accordingly, this high cost and low throughput limits the practical use in available DNA synthesis technologies. It has been found that the homopolymer run (i.e., the repetition of the same nucleotide) is a major factor affecting the synthesis and sequencing errors. Quite recently, [26] studied the role of batch optimization in reducing the cost of large scale DNA synthesis, for a given pool $\mathcal{S}$ of random quaternary strings of fixed length. Among other things, it was shown that the asymptotic cost savings of batch optimization are significantly greater when the strings in $\mathcal{S}$ contain repeats of the same character (homopolymer run of length one), as compared to the case where strings are unconstrained. Following the lead of [26], in this paper, we take a step forward towards the theoretical understanding of DNA synthesis, and study the homopolymer run of length $k\geq1$. Specifically, we are given a set of DNA strands $\mathcal{S}$, randomly drawn from a natural Markovian distribution modeling a general homopolymer run length constraint, that we wish to synthesize. For this problem, we prove that for any $k\geq 1$, the optimal reference strand, minimizing the cost of DNA synthesis is, perhaps surprisingly, the periodic sequence $\overline{\mathsf{ACGT}}$. It turns out that tackling the homopolymer constraint of length $k\geq2$ is a challenging problem; our main technical contribution is the representation of the DNA synthesis process as a certain constrained system, for which string techniques can be applied.


title: Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model

abstract: Row completion is the task of augmenting a given table of text and numbers with additional, relevant rows. The task divides into two steps: subject suggestion, the task of populating the main column; and gap filling, the task of populating the remaining columns. We present state-of-the-art results for subject suggestion and gap filling measured on a standard benchmark (WikiTables). Our idea is to solve this task by harmoniously combining knowledge base table interpretation and free text generation. We interpret the table using the knowledge base to suggest new rows and generate metadata like headers through property linking. To improve candidate diversity, we synthesize additional rows using free text generation via GPT-3, and crucially, we exploit the metadata we interpret to produce better prompts for text generation. Finally, we verify that the additional synthesized content can be linked to the knowledge base or a trusted web source such as Wikipedia.


title: NASA/GSFC's Flight Software Core Flight System Implementation For A Lunar Surface Imaging Mission

abstract: The interest in returning to the Moon for research and exploration has increased as new tipping point technologies are providing the possibility to do so. One of these initiatives is the Artemis program by NASA, which plans to return humans by 2024 to the lunar surface and study water deposits on the surface. This program will also serve as a practice run to plan the logistics of sending humans to explore Mars. To return humans safely to the Moon, multiple technological advances and diverse knowledge about the nature of the lunar surface are needed. This paper will discuss the design and implementation of the flight software of EagleCam, a CubeSat camera system based on the free open-source core Flight System (cFS) architecture developed by NASA's Goddard Space Flight Center. EagleCam is a payload transported to the Moon by the Commercial Lunar Payload Services Nova-C lander developed by Intuitive Machines. The camera system will capture the first third-person view of a spacecraft performing a Moon landing and collect other scientific data such as plume interaction with the surface. The complete system is composed of the CubeSat and the deployer that will eject it. This will be the first time WiFi protocol is used on the Moon to establish a local communication network.


title: The de Finetti problem with unknown competition

abstract: We consider a resource extraction problem which extends the classical de Finetti problem for a Wiener process to include the case when a competitor, who is equipped with the possibility to extract all the remaining resources in one piece, may exist; we interpret this unknown competition as the agent being subject to possible fraud. This situation is modelled as a controller-and-stopper non-zero-sum stochastic game with incomplete information. In order to allow the fraudster to hide his existence, we consider strategies where his action time is randomised. Under these conditions, we provide a Nash equilibrium which is fully described in terms of the corresponding single-player de Finetti problem. In this equilibrium, the agent and the fraudster use singular strategies in such a way that a two-dimensional process, which represents available resources and the filtering estimate of active competition, reflects in a specific direction along a given boundary.


title: OneMax is not the Easiest Function for Fitness Improvements

abstract: We study the $(1:s+1)$ success rule for controlling the population size of the $(1,\lambda)$-EA. It was shown by Hevia Fajardo and Sudholt that this parameter control mechanism can run into problems for large $s$ if the fitness landscape is too easy. They conjectured that this problem is worst for the OneMax benchmark, since in some well-established sense OneMax is known to be the easiest fitness landscape. In this paper we disprove this conjecture and show that OneMax is not the easiest fitness landscape with respect to finding improving steps. As a consequence, we show that there exists $s$ and $\varepsilon$ such that the self-adjusting $(1,\lambda)$-EA with $(1:s+1)$-rule optimizes OneMax efficiently when started with $\varepsilon n$ zero-bits, but does not find the optimum in polynomial time on Dynamic BinVal. Hence, we show that there are landscapes where the problem of the $(1:s+1)$-rule for controlling the population size of the $(1, \lambda)$-EA is more severe than for OneMax.


title: From Environmental Sound Representation to Robustness of 2D CNN Models Against Adversarial Attacks

abstract: This paper investigates the impact of different standard environmental sound representations (spectrograms) on the recognition performance and adversarial attack robustness of a victim residual convolutional neural network, namely ResNet-18. Our main motivation for focusing on such a front-end classifier rather than other complex architectures is balancing recognition accuracy and the total number of training parameters. Herein, we measure the impact of different settings required for generating more informative Mel-frequency cepstral coefficient (MFCC), short-time Fourier transform (STFT), and discrete wavelet transform (DWT) representations on our front-end model. This measurement involves comparing the classification performance over the adversarial robustness. We demonstrate an inverse relationship between recognition accuracy and model robustness against six benchmarking attack algorithms on the balance of average budgets allocated by the adversary and the attack cost. Moreover, our experimental results have shown that while the ResNet-18 model trained on DWT spectrograms achieves a high recognition accuracy, attacking this model is relatively more costly for the adversary than other 2D representations. We also report some results on different convolutional neural network architectures such as ResNet-34, ResNet-56, AlexNet, and GoogLeNet, SB-CNN, and LSTM-based.


title: Improved Volume-of-Solid formulations for micro-continuum simulation of mineral dissolution at the pore-scale

abstract: We present two novel Volume-of-Solid (VoS) formulations for micro-continuum simulation of mineral dissolution at the pore-scale. The traditional VoS formulation (VoS-psi) uses a diffuse interface localization function psi to ensure stability and limit diffusion of the reactive surface. The main limitation of this formulation is that accuracy is strongly dependent on the choice of the localization function. Our first novel improved formulation (iVoS) uses the divergence of a reactive flux to localize the reaction at the fluid-solid interface, so no localization function is required. Our second novel formulation (VoS-psi') uses a localization function with a parameter that is fitted to ensure that the reactive surface area is conserved globally. Both novel methods are validated by comparison with experiments, numerical simulations using an interface tracking method based on the Arbitrary Eulerian Lagrangian (ALE) framework, and numerical simulations using the VoS-psi. All numerical methods are implemented in GeoChemFoam, our reactive transport toolbox and three benchmark test cases in both synthetic and real pore geometries are considered: (1) dissolution of a calcite post by acid injection in a microchannel and experimental comparison, (2) dissolution in a 2D polydisperse disc micromodel at different dissolution regimes and (3) dissolution in a Ketton carbonate rock sample and comparison to \textit{in-situ} micro-CT experiments. We find that the iVoS results match accurately experimental results and simulation results obtained with the ALE method, while the VoS-psi method leads to inaccuracies that are mostly corrected by the VoS-psi' formulation. In addition, the VoS methods are significantly faster than the ALE method, with a speed-up factor of between 2 and 12.


title: Least-Squares Methods with Nonconforming Finite Elements for General Second-Order Elliptic Equations

abstract: In this paper, we study least-squares finite element methods (LSFEM) for general second-order elliptic equations with nonconforming finite element approximations. The equation may be indefinite. For the two-field potential-flux div LSFEM with Crouzeix-Raviart (CR) element approximation, we present three proofs of the discrete solvability under the condition that mesh size is small enough. One of the proof is based on the coerciveness of the original bilinear form. The other two are based on the minimal assumption of the uniqueness of the solution of the second-order elliptic equation. A counterexample shows that div least-squares functional does not have norm equivalence in the sum space of $H^1$ and CR finite element spaces. Thus it cannot be used as an a posteriori error estimator. Several versions of reliable and efficient error estimators are proposed for the method. We also propose a three-filed potential-flux-intensity div-curl least-squares method with general nonconforming finite element approximations. The norm equivalence in the abstract nonconforming piecewise $H^1$-space is established for the three-filed formulation on the minimal assumption of the uniqueness of the solution of the second-order elliptic equation. The three-filed div-curl nonconforming formulation thus has no restriction on the mesh size, and the least-squares functional can be used as the built-in a posteriori error estimator. Under some restrictive conditions, we also discuss a potential-flux div-curl least-squares method.


title: On Measuring Model Complexity in Heteroscedastic Linear Regression

abstract: Heteroscedasticity is common in real world applications and is often handled by incorporating case weights into a modeling procedure. Intuitively, models fitted with different weight schemes would have a different level of complexity depending on how well the weights match the inverse of error variances. However, existing statistical theories on model complexity, also known as model degrees of freedom, were primarily established under the assumption of equal error variances. In this work, we focus on linear regression procedures and seek to extend the existing measures to a heteroscedastic setting. Our analysis of the weighted least squares method reveals some interesting properties of the extended measures. In particular, we find that they depend on both the weights used for model fitting and those for model evaluation. Moreover, modeling heteroscedastic data with optimal weights generally results in fewer degrees of freedom than with equal weights, and the size of reduction depends on the unevenness of error variance. This provides additional insights into weighted modeling procedures that are useful in risk estimation and model selection.


title: $W$ boson mass and muon $g-2$ in a lepton portal dark matter model

abstract: We study a lepton portal dark matter model, motivated by the deviation of the $W$ boson mass reported by the CDF collaboration. We introduce vector-like leptons and a scalar dark matter (DM) which exclusively couples to the extra leptons and muon. The one-loop corrections induced by the new particles can shift the $W$ boson mass. Besides, the discrepancy in the muon anomalous magnetic moment and the DM density can simultaneously be explained by this setup, if the vector-like lepton is lighter than 200 GeV and nearly degenerate with the DM particle. We also see that the constraints on such a light extra lepton from the collider experiments can be evaded due to the existence of the DM particle.


title: Composite Code Sparse Autoencoders for first stage retrieval

abstract: We propose a Composite Code Sparse Autoencoder (CCSA) approach for Approximate Nearest Neighbor (ANN) search of document representations based on Siamese-BERT models. In Information Retrieval (IR), the ranking pipeline is generally decomposed in two stages: the first stage focus on retrieving a candidate set from the whole collection. The second stage re-ranks the candidate set by relying on more complex models. Recently, Siamese-BERT models have been used as first stage ranker to replace or complement the traditional bag-of-word models. However, indexing and searching a large document collection require efficient similarity search on dense vectors and this is why ANN techniques come into play. Since composite codes are naturally sparse, we first show how CCSA can learn efficient parallel inverted index thanks to an uniformity regularizer. Second, CCSA can be used as a binary quantization method and we propose to combine it with the recent graph based ANN techniques. Our experiments on MSMARCO dataset reveal that CCSA outperforms IVF with product quantization. Furthermore, CCSA binary quantization is beneficial for the index size, and memory usage for the graph-based HNSW method, while maintaining a good level of recall and MRR. Third, we compare with recent supervised quantization methods for image retrieval and find that CCSA is able to outperform them.


title: Q-TART: Quickly Training for Adversarial Robustness and in-Transferability

abstract: Raw deep neural network (DNN) performance is not enough; in real-world settings, computational load, training efficiency and adversarial security are just as or even more important. We propose to simultaneously tackle Performance, Efficiency, and Robustness, using our proposed algorithm Q-TART, Quickly Train for Adversarial Robustness and in-Transferability. Q-TART follows the intuition that samples highly susceptible to noise strongly affect the decision boundaries learned by DNNs, which in turn degrades their performance and adversarial susceptibility. By identifying and removing such samples, we demonstrate improved performance and adversarial robustness while using only a subset of the training data. Through our experiments we highlight Q-TART's high performance across multiple Dataset-DNN combinations, including ImageNet, and provide insights into the complementary behavior of Q-TART alongside existing adversarial training approaches to increase robustness by over 1.3% while using up to 17.9% less training time.


title: Autonomous Satellite Detection and Tracking using Optical Flow

abstract: In this paper, an autonomous method of satellite detection and tracking in images is implemented using optical flow. Optical flow is used to estimate the image velocities of detected objects in a series of space images. Given that most objects in an image will be stars, the overall image velocity from star motion is used to estimate the image's frame-to-frame motion. Objects seen to be moving with velocity profiles distinct from the overall image velocity are then classified as potential resident space objects. The detection algorithm is exercised using both simulated star images and ground-based imagery of satellites. Finally, this algorithm will be tested and compared using a commercial and an open-source software approach to provide the reader with two different options based on their need.


title: Blending Primitive Policies in Shared Control for Assisted Teleoperation

abstract: Movement primitives have the property to accommodate changes in the robot state while maintaining attraction to the original policy. As such, we investigate the use of primitives as a blending mechanism by considering that state deviations from the original policy are caused by user inputs. As the primitive recovers from the user input, it implicitly blends human and robot policies without requiring their weightings -- referred to as arbitration. In this paper, we adopt Dynamical Movement Primitives (DMPs), which allow us to avoid the need for multiple demonstrations, and are fast enough to enable numerous instantiations, one for each hypothesis of the human intent. User studies are presented on assisted teleoperation tasks of reaching multiple goals and dynamic obstacle avoidance. Comparable performance to conventional teleoperation was achieved while significantly decreasing human intervention, often by more than 60%.


title: The QCD phase transition behind a PBH origin of LIGO/Virgo events?

abstract: The best-motivated scenario for a sizable primordial black hole (PBH) contribution to the LIGO/Virgo binary black hole mergers invokes the QCD phase transition, which naturally enhances the probability to form PBH with masses of stellar scale. We reconsider the expected mass function associated not only to the QCD phase transition proper, but also the following particle antiparticle annihilation processes, and analyse the constraints on this scenario from a number of observations: The specific pattern in cosmic microwave background (CMB) anisotropies induced by accretion onto PBHs, CMB spectral distortions, gravitational wave searches, and direct counts of supermassive black holes (SMBHs) at high redshift. We find that the scenario is not viable, unless an ad hoc mass evolution for the PBH mass function and a cutoff in power-spectrum very close to the QCD scale are introduced by hand. Despite these negative results, we note that a future detection of coalescing binaries involving sub-solar PBHs has the potential to check the cosmological origin of SMBHs at the $e^\pm$ annihilation epoch, if indeed the PBH mass function is shaped by the changes to the equation of state driven by the thermal history of the universe.


title: Exploring the Distributed Knowledge Congruence in Proxy-data-free Federated Distillation

abstract: Federated learning (FL) is a privacy-preserving machine learning paradigm in which the server periodically aggregates local model parameters from clients without assembling their private data. Constrained communication and personalization requirements pose severe challenges to FL. Federated distillation (FD) is proposed to simultaneously address the above two problems, which exchanges knowledge between the server and clients, supporting heterogeneous local models while significantly reducing communication overhead. However, most existing FD methods require a proxy dataset, which is often unavailable in reality. A few recent proxy-data-free FD approaches can eliminate the need for additional public data, but suffer from remarkable discrepancy among local knowledge due to client-side model heterogeneity, leading to ambiguous representation on the server and inevitable accuracy degradation. To tackle this issue, we propose a proxy-data-free FD algorithm based on distributed knowledge congruence (FedDKC). FedDKC leverages well-designed refinement strategies to narrow local knowledge differences into an acceptable upper bound, so as to mitigate the negative effects of knowledge incongruence. Specifically, from perspectives of peak probability and Shannon entropy of local knowledge, we design kernel-based knowledge refinement (KKR) and searching-based knowledge refinement (SKR) respectively, and theoretically guarantee that the refined-local knowledge can satisfy an approximately-similar distribution and be regarded as congruent. Extensive experiments conducted on three common datasets demonstrate that our proposed FedDKC significantly outperforms the state-of-the-art on various heterogeneous settings while evidently improving the convergence speed.