title: Periodic Extrapolative Generalisation in Neural Networks

abstract: The learning of the simplest possible computational pattern -- periodicity -- is an open problem in the research of strong generalisation in neural networks. We formalise the problem of extrapolative generalisation for periodic signals and systematically investigate the generalisation abilities of classical, population-based, and recently proposed periodic architectures on a set of benchmarking tasks. We find that periodic and "snake" activation functions consistently fail at periodic extrapolation, regardless of the trainability of their periodicity parameters. Further, our results show that traditional sequential models still outperform the novel architectures designed specifically for extrapolation, and that these are in turn trumped by population-based training. We make our benchmarking and evaluation toolkit, PerKit, available and easily accessible to facilitate future work in the area.


title: Characterizations of discs via weighted means

abstract: New theorems characterizing analytically discs in the Euclidean plane $\RR^2$ are proved. Weighted mean value properties of solutions to the modified Helmholtz equation and harmonic functions are used for this purpose. The presence of a logarithmic weight diminish coefficients in the mean value identities. A weighted mean is also valid for solutions of the Helmholtz equation.


title: The integration theory of curved absolute L-infinity algebras

abstract: In this article, we introduce the notion of a curved absolute $\mathcal{L}_\infty$-algebra, a structure that behaves like a curved $\mathcal{L}_\infty$-algebra where all infinite sums of operations are well-defined by definition. We develop their integration theory by introducing two new methods in integration theory: the complete Bar construction and intrinsic model category structures. They allow us to generalize all essential results of this theory quickly and from a conceptual point of view. We provide applications of our theory to rational homotopy theory, and show that curved absolute $\mathcal{L}_\infty$-algebras provide us with rational models for finite type nilpotent spaces without any pointed or connected assumptions. Furthermore, we show that the homology of rational spaces can be recovered as the homology of the complete Bar construction. We also construct new smaller models for rational mapping spaces without any hypothesis on the source simplicial set. Another source of applications is deformation theory: on the algebraic side, we show that curved absolute $\mathcal{L}_\infty$-algebras are mandatory in order to encode the deformation complexes of $\infty$-morphisms of (co)-algebras. On the geometrical side, we construct a curved absolute $\mathcal{L}_\infty$-algebra from a derived affine stack and show that it encodes the formal geometry of any finite collection of points living in any finite field extension of the base field.


title: A Comparative Analysis of the Time and Energy Demand of Versatile Video Coding and High Efficiency Video Coding Reference Decoders

abstract: This paper investigates the decoding energy and decoding time demand of VTM-7.0 in relation to HM-16.20. We present the first detailed comparison of two video codecs in terms of software decoder energy consumption. The evaluation shows that the energy demand of the VTM decoder is increased significantly compared to HM and that the increase depends on the coding configuration. For the coding configuration randomaccess, we find that the decoding energy is increased by over 80% at a decoding time increase of over 70%. Furthermore, results indicate that the energy demand increases by up to 207% when Single Instruction Multiple Data (SIMD) instructions are disabled, which corresponds to the HM implementation style. By measurements, it is revealed that the coding tools MIP, AMVR, TPM, LFNST, and MTS increase the energy efficiency of the decoder. Furthermore, we propose a new coding configuration based on our analysis, which reduces the energy demand of the VTM decoder by over 17% on average.


title: Reconciling observations of solar irradiance variability with cloud size distributions

abstract: Clouds cast shadows on the surface and locally enhance solar irradiance by absorbing and scattering sunlight, resulting in fast and large solar irradiance fluctuations on the surface. Typical spatiotemporal scales and driving mechanisms of this intra-day irradiance variability are not well known, hence even one day ahead forecasts of variability are inaccurate. Here we use long term, high frequency solar irradiance observations combined with satellite imagery, numerical simulations, and conceptual modelling to show how irradiance variability is linked to the cloud size distribution. Cloud shadow sizes are distributed according to a power law over multiple orders of magnitude, deviating only from the cloud size distribution due to cloud edge transparency at scales below 750 meters. Locally cloud-enhanced irradiance occurs as frequently as shadows, and is similarly driven mostly by boundary layer clouds, but distributed over a smaller range of scales. We reconcile studies of solar irradiance variability with those on clouds, which brings fundamental understanding to what drives irradiance variability. Our findings have implications for not only for weather and climate modelling, but also for solar energy and photosynthesis by vegetation, where detailed knowledge of surface solar irradiance is essential.


title: AirFi: Empowering WiFi-based Passive Human Gesture Recognition to Unseen Environment via Domain Generalization

abstract: WiFi-based smart human sensing technology enabled by Channel State Information (CSI) has received great attention in recent years. However, CSI-based sensing systems suffer from performance degradation when deployed in different environments. Existing works solve this problem by domain adaptation using massive unlabeled high-quality data from the new environment, which is usually unavailable in practice. In this paper, we propose a novel augmented environment-invariant robust WiFi gesture recognition system named AirFi that deals with the issue of environment dependency from a new perspective. The AirFi is a novel domain generalization framework that learns the critical part of CSI regardless of different environments and generalizes the model to unseen scenarios, which does not require collecting any data for adaptation to the new environment. AirFi extracts the common features from several training environment settings and minimizes the distribution differences among them. The feature is further augmented to be more robust to environments. Moreover, the system can be further improved by few-shot learning techniques. Compared to state-of-the-art methods, AirFi is able to work in different environment settings without acquiring any CSI data from the new environment. The experimental results demonstrate that our system remains robust in the new environment and outperforms the compared systems.


title: Influence Maximization in Real-World Closed Social Networks

abstract: In the last few years, many closed social networks such as WhatsAPP and WeChat have emerged to cater for people's growing demand of privacy and independence. In a closed social network, the posted content is not available to all users or senders can set limits on who can see the posted content. Under such a constraint, we study the problem of influence maximization in a closed social network. It aims to recommend users (not just the seed users) a limited number of existing friends who will help propagate the information, such that the seed users' influence spread can be maximized. We first prove that this problem is NP-hard. Then, we propose a highly effective yet efficient method to augment the diffusion network, which initially consists of seed users only. The augmentation is done by iteratively and intelligently selecting and inserting a limited number of edges from the original network. Through extensive experiments on real-world social networks including deployment into a real-world application, we demonstrate the effectiveness and efficiency of our proposed method.


title: Impact of Rastall gravity on mass, radius and sound speed of the pulsar PSR J0740+6620

abstract: Millisecond pulsars are perfect laboratories to test possible matter-geometry coupling and its physical implications in light of recent Neutron Star Interior Composition Explorer (NICER) observations. We apply Rastall field equations of gravity, where matter and geometry are nonminimally coupled, to Krori-Barua interior spacetime whereas the matter source is assumed to be anisotropic fluid. We show that all physical quantities inside the star can be expressed in terms of Rastall, $\epsilon$, and compactness, $C=2GM/Rc^2$, parameters. Using NICER and X-ray Multi-Mirror X-ray observational constraints on the mass and radius of the pulsar PSR J0740+6620 we determine Rastall parameter to be at most $\epsilon=0.041$ in the positive range. The obtained solution provides a stable compact object; in addition the squared sound speed does not violate the conjectured sound speed $c_s^2\leq c^2/3$ unlike the general relativistic treatment. We note that no equations of state are assumed; the model however fits well with linear patterns with bag constants. In general, for $\epsilon>0$, the theory predicts a slightly larger size star in comparison to general relativity for the same mass. This has been explained as an additional force, due to matter-geometry coupling, in the hydrodynamic equilibrium equation, which contributes to partially diminish the gravitational force effect. Consequently, we calculate the maximal compactness as allowed by the strong energy condition to be $C = 0.735$ which is $\sim 2\%$ higher than general relativity prediction. Moreover, for the surface density at saturation nuclear density $\rho_{\text{nuc}} = 2.7\times 10^{14}$ g/cm$^3$ we estimate the maximum mass $M=4 M_\odot$ at radius $R=16$ km.


title: Tree Methods for Hierarchical Classification in Parallel

abstract: We propose methods that enable efficient hierarchical classification in parallel. Our methods transform a batch of classification scores and labels, corresponding to given nodes in a semantic tree, to scores and labels corresponding to all nodes in the ancestral paths going down the tree to every given node, relying only on tensor operations that execute efficiently on hardware accelerators. We implement our methods and test them on current hardware accelerators with a tree incorporating all English-language synsets in WordNet 3.0, spanning 117,659 classes in 20 levels of depth. We transform batches of scores and labels to their respective ancestral paths, incurring negligible computation and consuming only a fixed 0.04GB of memory over the footprint of data.


title: Finite polynomial cohomology with coefficients

abstract: We introduce a theory of finite polynomial cohomology with coefficients in this paper. We prove several basic properties and introduce an Abel-Jacobi map with coefficients. As applications, we use such a cohomology theory to study arithmetics of compact Shimura curves over $\mathbb{Q}$, and simplify proofs of the works of Darmon-Rotger and Bertolini-Darmon-Prasanna.


title: Spin current driven by ultrafast magnetization of FeRh

abstract: Laser-induced ultrafast demagnetization is an important phenomenon that probes arguably ultimate limits of the angular momentum dynamics in solid. Unfortunately, many aspects of the dynamics remain unclear except that the demagnetization transfers the angular momentum eventually to the lattice. In particular, roles of electron-carried spin current are debated. Here we experimentally probe the spin current in the opposite phenomenon, i.e., laser-induced ultrafast magnetization of FeRh, where the laser pump pulse initiates the angular momentum build-up rather than its dissipation. Using the time-resolved magneto-optical Kerr effect, we directly measure the ultrafast-magnetization-driven spin current in a FeRh/Cu heterostructure. Strong correlation between the spin current and the net magnetization change rate of FeRh is found even though the spin filter effect is negligible in this opposite process. This result implies that the angular momentum build-up is achieved by an angular momentum transfer from the electron bath (supplier) to the magnon bath (receiver) and followed by the spatial transport of angular momentum (spin current) and dissipation of angular momentum to the phonon bath (spin relaxation).


title: The Dispersive Art Gallery Problem

abstract: We introduce a new variant of the art gallery problem that comes from safety issues. In this variant we are not interested in guard sets of smallest cardinality, but in guard sets with largest possible distances between these guards. To the best of our knowledge, this variant has not been considered before. We call it the Dispersive Art Gallery Problem. In particular, in the dispersive art gallery problem we are given a polygon $\mathcal{P}$ and a real number $\ell$, and want to decide whether $\mathcal{P}$ has a guard set such that every pair of guards in this set is at least a distance of $\ell$ apart. In this paper, we study the vertex guard variant of this problem for the class of polyominoes. We consider rectangular visibility and distances as geodesics in the $L_1$-metric. Our results are as follows. We give a (simple) thin polyomino such that every guard set has minimum pairwise distances of at most $3$. On the positive side, we describe an algorithm that computes guard sets for simple polyominoes that match this upper bound, i.e., the algorithm constructs worst-case optimal solutions. We also study the computational complexity of computing guard sets that maximize the smallest distance between all pairs of guards within the guard sets. We prove that deciding whether there exists a guard set realizing a minimum pairwise distance for all pairs of guards of at least $5$ in a given polyomino is NP-complete. We were also able to find an optimal dynamic programming approach that computes a guard set that maximizes the minimum pairwise distance between guards in tree-shaped polyominoes, i.e., computes optimal solutions. Because the shapes constructed in the NP-hardness reduction are thin as well (but have holes), this result completes the case for thin polyominoes.


title: Fast Few shot Self-attentive Semi-supervised Political Inclination Prediction

abstract: With the rising participation of the common mass in social media, it is increasingly common now for policymakers/journalists to create online polls on social media to understand the political leanings of people in specific locations. The caveat here is that only influential people can make such an online polling and reach out at a mass scale. Further, in such cases, the distribution of voters is not controllable and may be, in fact, biased. On the other hand,if we can interpret the publicly available data over social media to probe the political inclination of users, we will be able to have controllable insights about the survey population, keep the cost of survey low and also collect publicly available data without involving the concerned persons. Hence we introduce a self-attentive semi-supervised framework for political inclination detection to further that objective. The advantage of our model is that it neither needs huge training data nor does it need to store social network parameters. Nevertheless, it achieves an accuracy of 93.7\% with no annotated data; further, with only a few annotated examples per class it achieves competitive performance. We found that the model is highly efficient even in resource-constrained settings, and insights drawn from its predictions match the manual survey outcomes when applied to diverse real-life scenarios.


title: LEO small satellite QKD downlink performance: QuantSat-PT case study

abstract: In this work, we model and simulate the performance of a quantum key distribution (QKD) downlink from a low earth orbit (LEO) small satellite to an optical ground station (OGS), as integral part of the concept and preliminary design phase of the QuantSat-PT mission. By modelling and simulating in detail downlink transmission channel effects, with emphasis on turbulent and atmospheric losses for BB84 and E91 protocols, we find a consistent set of values for the performance envelope that resolves ambiguities of mission experimental data that had been reported previous to this work. We obtain for the 4-state BB84 protocol a sifted key rate and Quantum Bit Error Rate (QBER) of 32.1 kbit/s and $4\%$, respectively, for zenith at 750 km orbit. For the E91 protocol the Clauser, Horne, Shimony and Holt (CHSH) test was performed resulting in a correlation factor of $S \in[-2.63\pm0.02,-1.91\pm0.03]$ for the mission. The consistency of these results with the state of the art simulators and its relevance on experimental satellite based QKD is discussed.


title: Tailoring microcombs with inverse-designed, meta-dispersion microresonators

abstract: Nonlinear-wave mixing in optical microresonators offers new perspectives to generate compact optical-frequency microcombs, which enable an ever-growing number of applications. Microcombs exhibit a spectral profile that is primarily determined by their microresonator's dispersion; an example is the $ \operatorname{sech}^2 $ spectrum of dissipative Kerr solitons under anomalous group-velocity dispersion. Here, we introduce an inverse-design approach to spectrally shape microcombs, by optimizing an arbitrary meta-dispersion in a resonator. By incorporating the system's governing equation into a genetic algorithm, we are able to efficiently identify a dispersion profile that produces a microcomb closely matching a user-defined target spectrum, such as spectrally-flat combs or near-Gaussian pulses. We show a concrete implementation of these intricate optimized dispersion profiles, using selective bidirectional-mode hybridization in photonic-crystal resonators. Moreover, we fabricate and explore several microcomb generators with such flexible `meta' dispersion control. Their dispersion is not only controlled by the waveguide composing the resonator, but also by a corrugation inside the resonator, which geometrically controls the spectral distribution of the bidirectional coupling in the resonator. This approach provides programmable mode-by-mode frequency splitting and thus greatly increases the design space for controlling the nonlinear dynamics of optical states such as Kerr solitons.


title: Hidden Symmetries and Model Reduction in Markov Decision Processes: Explained and Applied to the Multi-period Newsvendor Problem

abstract: Symmetry breaking is a common approach for model reduction of Markov decision processes (MDPs). This approach only uses directly accessible symmetries such as geometric symmetries. For some MDPs, it is possible to transform them equivalently such that symmetries become accessible -- we call this type of symmetries hidden symmetries. For these MDPs, hidden symmetries allow substantially better model reduction compared to directly accessible symmetries. The main idea is to reveal a hidden symmetry by altering the reward structure and then exploit the revealed symmetry by forming a quotient MDP. The quotient MDP is the reduced MDP, since it is sufficient to solve the quotient MDP instead of the original one. In this paper, we introduce hidden symmetries and the associated concept of model reduction. We demonstrate this concept on the multi-period newsvendor problem, which is the newsvendor problem considered over an infinite number of days. In this way, we show that hidden symmetries can reduce problems that directly accessible symmetries cannot, and present a basic idea of revealing hidden symmetries in multi-period problems. The presented approach can be extended to more sophisticated problems.


title: Free electron laser seeded by betatron radiation

abstract: In this paper the use of betatron radiation as a seed for the Free Electron Laser (FEL) is presented. The scheme shown can be adopted from all FEL driven by plasma accelerated electron beams via Particle or Laser Wake Field Acceleration. Intense radiation in the region of X ray characterized by a broad spectrum, the betatron radiation, is indeed produced in the plasma acceleration process from the electron passing through the ionized gas. It is proposed to use this radiation, suitably selected in wavelength and properly synchronized, to stimulate the emission of the Free Electron Laser.


title: Cobordism, Singularities and the Ricci Flow Conjecture

abstract: In the following work, an attempt to conciliate the Ricci flow conjecture and the Cobordism conjecture, stated as refinements of the Swampland distance conjecture and of the No global symmetries conjecture respectively, is presented. This is done by starting from a suitable manifold with trivial cobordism class, applying surgery techniques to Ricci flow singularities and trivialising the cobordism class of one of the resulting connected components via the introduction of appropriate defects. The specific example of $\Omega^{SO}_4$ is studied in detail. A connection between the process of blowing up a point of a manifold and that of taking the connected sum of such with $\mathbb{CP}^n$ is explored. Hence, the problem of studying the Ricci flow of a $K3$ whose cobordism class is trivialised by the addition of $16$ copies of $\mathbb{CP}^2$ is tackled by applying both the techniques developed in the previous sections and the classification of singularities in terms of ADE groups.


title: Artificial Intelligence-Based Image Reconstruction in Cardiac Magnetic Resonance

abstract: Artificial intelligence (AI) and Machine Learning (ML) have shown great potential in improving the medical imaging workflow, from image acquisition and reconstruction to disease diagnosis and treatment. Particularly, in recent years, there has been a significant growth in the use of AI and ML algorithms, especially Deep Learning (DL) based methods, for medical image reconstruction. DL techniques have shown to be competitive and often superior over conventional reconstruction methods in terms of both reconstruction quality and computational efficiency. The use of DL-based image reconstruction also provides promising opportunities to transform the way cardiac images are acquired and reconstructed. In this chapter, we will review recent advances in DL-based reconstruction techniques for cardiac imaging, with emphasis on cardiac magnetic resonance (CMR) image reconstruction. We mainly focus on supervised DL methods for the application, including image post-processing techniques, model-driven approaches and k-space based methods. Current limitations, challenges and future opportunities of DL for cardiac image reconstruction are also discussed.


title: DPCN: Towards Deadline-aware Payment Channel Networks

abstract: Payment channel is a class of techniques designed to solve the scalability problem of blockchain. By establishing channels off the blockchain to form payment channel networks (PCNs), users can make instant payments without interacting with the blockchain, avoiding the problems of long transaction consensus delays and high transaction fees. Recently, the optimization of PCNs has mainly focused on improving the network throughput via multi-path routing. However, the transaction's atomicity comes at a non-trivial cost for transaction completion latency that affects user experience in deadline-sensitive applications of PCNs. In this paper, we propose a new and systematic framework DPCN to consider the deadlines of transactions for payment channel networks while improving the success ratio of transactions. DPCN is enabled via a synergy of three components: (1) deadline-based dynamic transaction split mechanism that splits the transaction according to current network status and the transaction's deadline; (2) deadline-aware transaction scheduling that prioritizes near-deadline transactions; (3) deadline-aware transaction congestion avoidance algorithm, which uses a path window to balance transactions with different deadlines. Our extensive experiments show that compared with existing methods, DPCN can well meet the needs of transactions with different deadlines and ensure a higher success ratio for transactions in the payment channel networks.


title: 5G-Enabled Smart Manufacturing -- A booklet by 5G-SMART

abstract: In this booklet the most important learnings and key results of 5G-SMART in the area of smart manufacturing are summarized.


title: The spatiotemporal coupling in delay-coordinates dynamic mode decomposition

abstract: Dynamic mode decomposition (DMD) is a leading tool for equation-free analysis of high-dimensional dynamical systems from observations. In this work, we focus on a combination of delay-coordinates embedding and DMD, i.e., delay-coordinates DMD, which accommodates the analysis of a broad family of observations. An important utility of DMD is the compact and reduced-order spectral representation of observations in terms of the DMD eigenvalues and modes, where the temporal information is separated from the spatial information. From a spatiotemporal viewpoint, we show that when DMD is applied to delay-coordinates embedding, temporal information is intertwined with spatial information, inducing a particular spectral structure on the DMD components. We formulate and analyze this structure, which we term the spatiotemporal coupling in delay-coordinates DMD. Based on this spatiotemporal coupling, we propose a new method for DMD components selection. When using delay-coordinates DMD that comprises redundant modes, this selection is an essential step for obtaining a compact and reduced-order representation of the observations. We demonstrate our method on noisy simulated signals and various dynamical systems and show superior component selection compared to a commonly-used method that relies on the amplitudes of the modes.


title: Quantum embedding of multi-orbital fragments using the Block-Householder-transformation

abstract: Recently, some of the authors introduced the use of the Householder transformation as a simple and intuitive method for the embedding of local molecular fragments (see Sekaran et. al., Phys. Rev. B 104, 035121 (2021), and Sekaran et. al., Computation 10, 45 (2022)). In this work, we present an extension of this approach to the more general case of multi-orbital fragments using the block version of the Householder transformation applied to the one-body reduced density matrix, yet unlocking the applicability to general quantum chemistry/condensed-matter physics Hamiltonians. A step by step construction of the Block-Householder transformation is presented. Both physical and numerical interest of the approach are highlighted. The specific mean-field (non-interacting) case is thoroughly detailed as it is shown that the embedding of a given $N$ spin-orbitals fragment leads to the generation of two separated sub-systems: a $2N$ spin-orbitals "fragment+bath" cluster that exactly contains $N$ electrons, and a remaining cluster's "environment" which is described by so-called core electrons. We illustrate the use of this transformation in different cases of embedding {scheme} for practical applications. We particularly focus on the extension of the previously introduced Local Potential Functional Embedding Theory (LPFET) and Householder-transformed Density Matrix Functional Embedding Theory (Ht-DMFET) to the case of multi-orbital fragments. These calculations are realized on different types of systems such as model Hamiltonians (Hubbard rings) and \textit{ab initio} molecular systems (hydrogen rings).


title: The intermediate neutron capture process. III. The i-process in AGB stars of different masses and metallicities without overshoot

abstract: Alongside the slow (s) and rapid (r) neutron capture processes, an intermediate neutron capture process (i-process) is thought to exist. It happens when protons are mixed in a convective helium-burning zone, and is referred to as proton ingestion event (PIE). A possible astrophysical site is the asymptotic giant branch (AGB) phase of low-mass low-metallicity stars. We provide i-process yields of a grid of AGB stars experiencing PIEs. We computed 12 models with initial masses of 1, 2, and 3 $M_{\odot}$ and metallicities of [Fe/H] $=-3.0$, $-2.5$ $-2.3,$ and $-2.0, $ with the stellar evolution code STAREVOL. We used a nuclear network of 1160 species at maximum, coupled to the chemical transport equations. These simulations do not include any extra mixing process. Proton ingestion takes place in six out of our 12 AGB models. These models experience i-process nucleosynthesis characterized by neutron densities of $\simeq 10^{14} -10^{15}$ cm$^{-3}$. Depending on the PIE properties two different evolution paths follow: either the stellar envelope is quickly lost and no more thermal pulses develop or the AGB phase resumes with additional thermal pulses. This behaviour critically depends on the pulse number when the PIE occurs, the mass of the ingested protons, and the extent to which the pulse material is diluted in the convective envelope. The surface enrichment after a PIE is a robust feature of our models and it persists under various convective assumptions. Our models can synthesise heavy elements up to Pb without any parametrized extra mixing process such as overshoot or inclusion of a $^{13}$C-pocket. Nevertheless, it remains to be explored how the i-process depends on mixing processes, such as overshoot, thermohaline, or rotation.


title: I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classification

abstract: Despite the tremendous progress in zero-shot learning(ZSL), the majority of existing methods still rely on human-annotated attributes, which are difficult to annotate and scale. An unsupervised alternative is to represent each class using the word embedding associated with its semantic class name. However, word embeddings extracted from pre-trained language models do not necessarily capture visual similarities, resulting in poor zero-shot performance. In this work, we argue that online textual documents, e.g., Wikipedia, contain rich visual descriptions about object classes, therefore can be used as powerful unsupervised side information for ZSL. To this end, we propose I2DFormer, a novel transformer-based ZSL framework that jointly learns to encode images and documents by aligning both modalities in a shared embedding space. In order to distill discriminative visual words from noisy documents, we introduce a new cross-modal attention module that learns fine-grained interactions between image patches and document words. Consequently, our I2DFormer not only learns highly discriminative document embeddings that capture visual similarities but also gains the ability to localize visually relevant words in image regions. Quantitatively, we demonstrate that our I2DFormer significantly outperforms previous unsupervised semantic embeddings under both zero-shot and generalized zero-shot learning settings on three public datasets. Qualitatively, we show that our method leads to highly interpretable results where document words can be grounded in the image regions.


title: KXNet: A Model-Driven Deep Neural Network for Blind Super-Resolution

abstract: Although current deep learning-based methods have gained promising performance in the blind single image super-resolution (SISR) task, most of them mainly focus on heuristically constructing diverse network architectures and put less emphasis on the explicit embedding of the physical generation mechanism between blur kernels and high-resolution (HR) images. To alleviate this issue, we propose a model-driven deep neural network, called KXNet, for blind SISR. Specifically, to solve the classical SISR model, we propose a simple-yet-effective iterative algorithm. Then by unfolding the involved iterative steps into the corresponding network module, we naturally construct the KXNet. The main specificity of the proposed KXNet is that the entire learning process is fully and explicitly integrated with the inherent physical mechanism underlying this SISR task. Thus, the learned blur kernel has clear physical patterns and the mutually iterative process between blur kernel and HR image can soundly guide the KXNet to be evolved in the right direction. Extensive experiments on synthetic and real data finely demonstrate the superior accuracy and generality of our method beyond the current representative state-of-the-art blind SISR methods. Code is available at: https://github.com/jiahong-fu/KXNet.


title: Realizable and Context-Free Hyperlanguages

abstract: Hyperproperties lift conventional trace-based languages from a set of execution traces to a set of sets of executions. From a formal-language perspective, these are sets of sets of words, namely hyperlanguages. Hyperautomata are based on classical automata models that are lifted to handle hyperlanguages. Finite hyperautomata (NFH) have been suggested to express regular hyperproperties. We study the realizability problem for regular hyperlanguages: given a set of languages, can it be precisely described by an NFH? We show that the problem is complex already for singleton hyperlanguages. We then go beyond regular hyperlanguages, and study context-free hyperlanguages. We show that the natural extension to context-free hypergrammars is highly undecidable. We then suggest a refined model, namely synchronous hypergrammars, which enables describing interesting non-regular hyperproperties, while retaining many decidable properties of context-free grammars.


title: Understanding the Tricks of Deep Learning in Medical Image Segmentation: Challenges and Future Directions

abstract: Over the past few years, the rapid development of deep learning technologies for computer vision has significantly improved the performance of medical image segmentation (MedISeg). However, the diverse implementation strategies of various models have led to an extremely complex MedISeg system, resulting in a potential problem of unfair result comparisons. In this paper, we collect a series of MedISeg tricks for different model implementation phases (i.e., pre-training model, data pre-processing, data augmentation, model implementation, model inference, and result post-processing), and experimentally explore the effectiveness of these tricks on consistent baselines. With the extensive experimental results on both the representative 2D and 3D medical image datasets, we explicitly clarify the effect of these tricks. Moreover, based on the surveyed tricks, we also open-sourced a strong MedISeg repository, where each component has the advantage of plug-and-play. We believe that this milestone work not only completes a comprehensive and complementary survey of the state-of-the-art MedISeg approaches, but also offers a practical guide for addressing the future medical image processing challenges including but not limited to small dataset, class imbalance learning, multi-modality learning, and domain adaptation. The code and training weights have been released at: https://github.com/hust-linyi/seg_trick.


title: Response to "Comment on 'Phase transition temperatures of 405-725 K in superfluid ultra-dense hydrogen clusters on metal surfaces' [AIP Advances 6, 045111 (2016)]"

abstract: In this invited response we answer all comments by Engelen and Hansen [arXiv:2207.07844]. We point out that the superfluid and superconductive properties of H(0) have been published previously. We explain some differences between covalently bonded molecules and the molecules in the ultradense matter H(0) form, and explain some aspects of the energetics of H(0) molecules during Coulomb explosions. We point out that the experimental spectra shown in our publication are not ion time-of-flight spectra but neutral time-of-flight spectra with the peak width given by the internal energetics and not by experimental factors. We point out that no phase diagram has been measured for H(0). Further we point out that a Rydberg state is a hydrogenic state and thus that all hydrogen atom states are Rydberg states. That Rydberg states always have large principal quantum numbers is a complete misunderstanding. We point out that a QM description of H(0) is published. We point out that the internuclear distances in p(0), D(0) and pD(0) have been measured by rotational spectroscopy in two publications for three different spin states. They are measured in the pm range with fm precision.


title: On the Existential Fragments of Local First-Order Logics with Data

abstract: We study first-order logic over unordered structures whose elements carry a finite number of data values from an infinite domain which can be compared wrt. equality. As the satisfiability problem for this logic is undecidable in general, in a previous work, we have introduced a family of local fragments that restrict quantification to neighbourhoods of a given reference point. We provide here the precise complexity characterisation of the satisfiability problem for the existential fragments of this local logic depending on the number of data values carried by each element and the radius of the considered neighbourhoods.


title: Seeking Diverse Reasoning Logic: Controlled Equation Expression Generation for Solving Math Word Problems

abstract: To solve Math Word Problems, human students leverage diverse reasoning logic that reaches different possible equation solutions. However, the mainstream sequence-to-sequence approach of automatic solvers aims to decode a fixed solution equation supervised by human annotation. In this paper, we propose a controlled equation generation solver by leveraging a set of control codes to guide the model to consider certain reasoning logic and decode the corresponding equations expressions transformed from the human reference. The empirical results suggest that our method universally improves the performance on single-unknown (Math23K) and multiple-unknown (DRAW1K, HMWP) benchmarks, with substantial improvements up to 13.2% accuracy on the challenging multiple-unknown datasets.


title: Capturing Bisimulation-Invariant Exponential-Time Complexity Classes

abstract: Otto's Theorem characterises the bisimulation-invariant PTIME queries over graphs as exactly those that can be formulated in the polyadic mu-calculus, hinging on the Immerman-Vardi Theorem which characterises PTIME (over ordered structures) by First-Order Logic with least fixpoints. This connection has been extended to characterise bisimulation-invariant EXPTIME by an extension of the polyadic mu-calculus with functions on predicates, making use of Immerman's characterisation of EXPTIME by Second-Order Logic with least fixpoints. In this paper we show that the bisimulation-invariant versions of all classes in the exponential time hierarchy have logical counterparts which arise as extensions of the polyadic mu-calculus by higher-order functions. This makes use of the characterisation of k-EXPTIME by Higher-Order Logic (of order k+1) with least fixpoints, due to Freire and Martins.


title: Schema-Based Automata Determinization

abstract: We propose an algorithm for schema-based determinization of finite automata on words and of step-wise hedge automata on nested words. The idea is to integrate schema-based cleaning directly into automata determinization. We prove the correctness of our new algorithm and show that it is alway smore efficient than standard determinization followed by schema-based cleaning. Our implementation permits to obtain a small deterministic automaton for an example of an XPath query, where standard determinization yields a huge stepwise hedge automaton for which schema-based cleaning runs out of memory.


title: Generating Tokenizers with Flat Automata

abstract: We introduce flat automata for automatic generation of tokenizers. Flat automata are a simple representation of standard finite automata. Using the flat representation, automata can be easily constructed, combined and printed. Due to the use of border functions, flat automata are more compact than standard automata in the case where intervals of characters are attached to transitions, and the standard algorithms on automata are simpler. We give the standard algorithms for tokenizer construction with automata, namely construction using regular operations, determinization, and minimization. We prove their correctness. The algorithms work with intervals of characters, but are not more complicated than their counterparts on single characters. It is easy to generate C++ code from the final deterministic automaton. All procedures have been implemented in C++ and are publicly available. The implementation has been used in applications and in teaching.


title: TeLeMan: Teleoperation for Legged Robot Loco-Manipulation using Wearable IMU-based Motion Capture

abstract: Human life is invaluable. When dangerous or life-threatening tasks need to be completed, robotic platforms could be ideal in replacing human operators. Such a task that we focus on in this work is the Explosive Ordnance Disposal. Robot telepresence has the potential to provide safety solutions, given that mobile robots have shown robust capabilities when operating in several environments. However, autonomy may be challenging and risky at this stage, compared to human operation. Teleoperation could be a compromise between full robot autonomy and human presence. In this paper, we present a relatively cheap solution for telepresence and robot teleoperation, to assist with Explosive Ordnance Disposal, using a legged manipulator (i.e., a legged quadruped robot, embedded with a manipulator and RGB-D sensing). We propose a novel system integration for the non-trivial problem of quadruped manipulator whole-body control. Our system is based on a wearable IMU-based motion capture system that is used for teleoperation and a VR headset for visual telepresence. We experimentally validate our method in real-world, for loco-manipulation tasks that require whole-body robot control and visual telepresence.


title: Analyzing Robustness of Angluin's L* Algorithm in Presence of Noise

abstract: Angluin's L* algorithm learns the minimal (complete) deterministic finite automaton (DFA) of a regular language using membership and equivalence queries. Its probabilistic approximatively correct (PAC) version substitutes an equivalence query by a large enough set of random membership queries to get a high level confidence to the answer. Thus it can be applied to any kind of (also non-regular) device and may be viewed as an algorithm for synthesizing an automaton abstracting the behavior of the device based on observations. Here we are interested on how Angluin's PAC learning algorithm behaves for devices which are obtained from a DFA by introducing some noise. More precisely we study whether Angluin's algorithm reduces the noise and produces a DFA closer to the original one than the noisy device. We propose several ways to introduce the noise: (1) the noisy device inverts the classification of words w.r.t. the DFA with a small probability, (2) the noisy device modifies with a small probability the letters of the word before asking its classification w.r.t. the DFA, and (3) the noisy device combines the classification of a word w.r.t. the DFA and its classification w.r.t. a counter automaton. Our experiments were performed on several hundred DFAs. Our main contributions, bluntly stated, consist in showing that: (1) Angluin's algorithm behaves well whenever the noisy device is produced by a random process, (2) but poorly with a structured noise, and, that (3) almost surely randomness yields systems with non-recursively enumerable languages.


title: Parametric Interval Temporal Logic over Infinite Words

abstract: Model checking for Halpern and Shoham's interval temporal logic HS has been recently investigated in a systematic way, and it is known to be decidable under three distinct semantics. Here, we focus on the trace-based semantics, where the infinite execution paths (traces) of the given (finite) Kripke structure are the main semantic entities. In this setting, each finite infix of a trace is interpreted as an interval, and a proposition holds over an interval if and only if it holds over each component state (homogeneity assumption). In this paper, we introduce a quantitative extension of HS over traces, called parametric HS (PHS). The novel logic allows to express parametric timing constraints on the duration (length) of the intervals. We show that checking the existence of a parameter valuation for which a Kripke structure satisfies a PHS formula (model checking), or a PHS formula admits a trace as a model under the homogeneity assumption (satisfiability) is decidable. Moreover, we identify a fragment of PHS which subsumes parametric LTL and for which model checking and satisfiability are shown to be EXPSPACE-complete.


title: Android Private Compute Core Architecture

abstract: Android's Private Compute Core (PCC) is a secure, isolated environment within the operating system, that maintains separation from apps while enabling users and developers to maintain control over their data. It is backed by open-source code in the Android Framework introduced in Android 12. PCC allows features to communicate with a server to receive model updates and contribute to global model training through Private Compute Services (PCS), the core of which has been open sourced. PCC is part of the OS, and by virtue of being isolated, constrained, and trusted, it can host sophisticated ML features. The hosted features themselves, running inside PCC, can be closed source and updatable. In this way, PCC enables machine learning features to process ambient and OS-level data and improve over time, while restricting the availability of information about individual users to servers or apps.


title: Rethinking the compositionality of point clouds through regularization in the hyperbolic space

abstract: Point clouds of 3D objects exhibit an inherent compositional nature where simple parts can be assembled into progressively more complex shapes to form whole objects. Explicitly capturing such part-whole hierarchy is a long-sought objective in order to build effective models, but its tree-like nature has made the task elusive. In this paper, we propose to embed the features of a point cloud classifier into the hyperbolic space and explicitly regularize the space to account for the part-whole hierarchy. The hyperbolic space is the only space that can successfully embed the tree-like nature of the hierarchy. This leads to substantial improvements in the performance of state-of-art supervised models for point cloud classification.


title: Controller Synthesis for Timeline-based Games

abstract: In the timeline-based approach to planning, originally born in the space sector, the evolution over time of a set of state variables (the timelines) is governed by a set of temporal constraints. Traditional timeline-based planning systems excel at the integration of planning with execution by handling temporal uncertainty. In order to handle general nondeterminism as well, the concept of timeline-based games has been recently introduced. It has been proved that finding whether a winning strategy exists for such games is 2EXPTIME-complete. However, a concrete approach to synthesize controllers implementing such strategies is missing. This paper fills this gap, outlining an approach to controller synthesis for timeline-based games.


title: Continual VQA for Disaster Response Systems

abstract: Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an important line of research due to the scope of problems that are answered by the VQA system. However, the main challenge is the delay caused by the generation of labels in the assessment of the affected areas. To tackle this, we deployed pre-trained CLIP model, which is trained on visual-image pairs. however, we empirically see that the model has poor zero-shot performance. Thus, we instead use pre-trained embeddings of text and image from this model for our supervised training and surpass previous state-of-the-art results on the FloodNet dataset. We expand this to a continual setting, which is a more real-life scenario. We tackle the problem of catastrophic forgetting using various experience replay methods. Our training runs are available at: https://wandb.ai/compyle/continual_vqa_final. Our code is available at https://github.com/AdityaKane2001/continual_vqa.


title: CryptoSolve: Towards a Tool for the Symbolic Analysis of Cryptographic Algorithms

abstract: Recently, interest has been emerging in the application of symbolic techniques to the specification and analysis of cryptosystems. These techniques, when accompanied by suitable proofs of soundness/completeness, can be used both to identify insecure cryptosystems and prove sound ones secure. But although a number of such symbolic algorithms have been developed and implemented, they remain scattered throughout the literature. In this paper, we present a tool, CryptoSolve, which provides a common basis for specification and implementation of these algorithms, CryptoSolve includes libraries that provide the term algebras used to express symbolic cryptographic systems, as well as implementations of useful algorithms, such as unification and variant generation. In its current initial iteration, it features several algorithms for the generation and analysis of cryptographic modes of operation, which allow one to use block ciphers to encrypt messages more than one block long. The goal of our work is to continue expanding the tool in order to consider additional cryptosystems and security questions, as well as extend the symbolic libraries to increase their applicability.


title: Adversarial Formal Semantics of Attack Trees and Related Problems

abstract: Security is a subject of increasing attention in our actual society in order to protect critical resources from information disclosure, theft or damage. The informal model of attack trees introduced by Schneier, and widespread in the industry, is advocated in the 2008 NATO report to govern the evaluation of the threat in risk analysis. Attack-defense trees have since been the subject of many theoretical works addressing different formal approaches. In 2017, M. Audinot et al. introduced a path semantics over a transition system for attack trees. Inspired by the later, we propose a two-player interpretation of the attack-tree formalism. To do so, we replace transition systems by concurrent game arenas and our associated semantics consist of strategies. We then show that the emptiness problem, known to be NP-complete for the path semantics, is now PSPACE-complete. Additionally, we show that the membership problem is coNP-complete for our two-player interpretation while it collapses to P in the path semantics.


title: Avoid One's Doom: Finding Cliff-Edge Configurations in Petri Nets

abstract: A crucial question in analyzing a concurrent system is to determine its long-run behaviour, and in particular, whether there are irreversible choices in its evolution, leading into parts of the reachability space from which there is no return to other parts. Casting this problem in the unifying framework of safe Petri nets, our previous work has provided techniques for identifying attractors, i.e. terminal strongly connected components of the reachability space, whose attraction basins we wish to determine. Here, we provide a solution for the case of safe Petri nets. Our algorithm uses net unfoldings and provides a map of all of the system's configurations (concurrent executions) that act as cliff-edges, i.e. any maximal extension for those configurations lies in some basin that is considered fatal. The computation turns out to require only a relatively small prefix of the unfolding, just twice the depth of Esparza's complete prefix.


title: Characterizing the Decidability of Finite State Automata Team Games with Communication

abstract: In this paper we define a new model of limited communication for multiplayer team games of imperfect information. We prove that the Team DFA Game and Team Formula Game, which have bounded state, remain undecidable when players have a rate of communication which is less than the rate at which they make moves in the game. We also show that meeting this communication threshold causes these games to be decidable.


title: Kirillov-Reshetikhin modules and quantum $K$-matrices

abstract: From a quantum $K$-matrix of the fundamental representation, we construct one for the Kirillov-Reshetikhin module by fusion construction. Using the $\imath$crystal theory by the last author, we also obtain combinatorial $K$-matrices corresponding to the symmetric tensor representations of affine type $A$ for all quasi-split Satake diagrams.


title: Toward 3D Spatial Reasoning for Human-like Text-based Visual Question Answering

abstract: Text-based Visual Question Answering~(TextVQA) aims to produce correct answers for given questions about the images with multiple scene texts. In most cases, the texts naturally attach to the surface of the objects. Therefore, spatial reasoning between texts and objects is crucial in TextVQA. However, existing approaches are constrained within 2D spatial information learned from the input images and rely on transformer-based architectures to reason implicitly during the fusion process. Under this setting, these 2D spatial reasoning approaches cannot distinguish the fine-grain spatial relations between visual objects and scene texts on the same image plane, thereby impairing the interpretability and performance of TextVQA models. In this paper, we introduce 3D geometric information into a human-like spatial reasoning process to capture the contextual knowledge of key objects step-by-step. %we formulate a human-like spatial reasoning process by introducing 3D geometric information for capturing key objects' contextual knowledge. To enhance the model's understanding of 3D spatial relationships, Specifically, (i)~we propose a relation prediction module for accurately locating the region of interest of critical objects; (ii)~we design a depth-aware attention calibration module for calibrating the OCR tokens' attention according to critical objects. Extensive experiments show that our method achieves state-of-the-art performance on TextVQA and ST-VQA datasets. More encouragingly, our model surpasses others by clear margins of 5.7\% and 12.1\% on questions that involve spatial reasoning in TextVQA and ST-VQA valid split. Besides, we also verify the generalizability of our model on the text-based image captioning task.


title: SDA-$x$Net: Selective Depth Attention Networks for Adaptive Multi-scale Feature Representation

abstract: Existing multi-scale solutions lead to a risk of just increasing the receptive field sizes while neglecting small receptive fields. Thus, it is a challenging problem to effectively construct adaptive neural networks for recognizing various spatial-scale objects. To tackle this issue, we first introduce a new attention dimension, i.e., depth, in addition to existing attention dimensions such as channel, spatial, and branch, and present a novel selective depth attention network to symmetrically handle multi-scale objects in various vision tasks. Specifically, the blocks within each stage of a given neural network, i.e., ResNet, output hierarchical feature maps sharing the same resolution but with different receptive field sizes. Based on this structural property, we design a stage-wise building module, namely SDA, which includes a trunk branch and a SE-like attention branch. The block outputs of the trunk branch are fused to globally guide their depth attention allocation through the attention branch. According to the proposed attention mechanism, we can dynamically select different depth features, which contributes to adaptively adjusting the receptive field sizes for the variable-sized input objects. In this way, the cross-block information interaction leads to a long-range dependency along the depth direction. Compared with other multi-scale approaches, our SDA method combines multiple receptive fields from previous blocks into the stage output, thus offering a wider and richer range of effective receptive fields. Moreover, our method can be served as a pluggable module to other multi-scale networks as well as attention networks, coined as SDA-$x$Net. Their combination further extends the range of the effective receptive fields towards small receptive fields, enabling interpretable neural networks. Our source code is available at \url{https://github.com/QingbeiGuo/SDA-xNet.git}.


title: Comparing Channel Restrictions of Communicating State Machines, High-level Message Sequence Charts, and Multiparty Session Types

abstract: Communicating state machines provide a formal foundation for distributed computation. Unfortunately, they are Turing-complete and, thus, challenging to analyse. In this paper, we classify restrictions on channels which have been proposed to work around the undecidability of verification questions. We compare half-duplex communication, existential B-boundedness, and k-synchronisability. These restrictions do not prevent the communication channels from growing arbitrarily large but still restrict the power of the model. Each restriction gives rise to a set of languages so, for every pair of restrictions, we check whether one subsumes the other or if they are incomparable. We investigate their relationship in two different contexts: first, the one of communicating state machines, and, second, the one of communication protocol specifications using high-level message sequence charts. Surprisingly, these two contexts yield different conclusions. In addition, we integrate multiparty session types, another approach to specify communication protocols, into our classification. We show that multiparty session type languages are half-duplex, existentially 1-bounded, and 1-synchronisable. To show this result, we provide the first formal embedding of multiparty session types into high-level message sequence charts.


title: Modelling the Dynamics of Partially Wetting Droplets on Fibres

abstract: We simulate gravity driven dynamics of partially wetting droplets moving along a fibre using the lattice Boltzmann method. For the so-called clamshell morphology, we find three possible dynamic regimes upon varying the droplet Bond number and the fibre radius: compact droplet, droplet breakup and droplet oscillation. For small Bond numbers, in the compact droplet regime, the droplet reaches a steady state and its velocity scales linearly with the driving body force. A similar scaling law can also be observed for the barrel morphology. For higher Bond numbers, in the droplet breakup regime, satellite droplets are formed trailing the initial moving droplet. We find such droplet satellite formation is easier with increasing fibre curvature (smaller fibre radius). Finally, in the droplet oscillation regime, favoured in the mid-range of fibre radius, the droplet shape periodically extends and contracts along the fibre.


title: Shrinkage Estimators Dominating Some Naive Estimators of the Selected Entropy

abstract: Consider two populations characterized by independent random variables $X_1$ and $X_2$ such that $X_i, i=1,2,$ follows a gamma distribution with an unknown scale parameter $\theta_i>0$, and known shape parameter $\alpha >0$ (the same shape parameter for both the populations). Here $(X_1,X_2)$ may be an appropriate minimal sufficient statistic based on independent random samples from the two populations. The population associated with the larger (smaller) Shannon entropy is referred to as the "worse" ("better") population. For the goal of selecting the worse (better) population, a natural selection rule is the one that selects the population corresponding to $\max\{X_1,X_2\} ~(\min\{X_1,X_2\})$ as the worse (better) population. This natural selection rule is known to possess several optimum properties. We consider the problem of estimating the Shannon entropy of the population selected using the natural selection rule (to be referred to as the selected entropy) under the mean squared error criterion. In order to improve upon various naive estimators of the selected entropy, we derive a class of shrinkage estimators that shrink various naive estimators towards the central entropy. For this purpose, we first consider a class of naive estimators comprising linear, scale and permutation equivariant estimators and identify optimum estimators within this class. The class of naive estimators considered by us contains three natural plug-in estimators. To further improve upon the optimum naive estimators, we consider a general class of equivariant estimators and obtain dominating shrinkage estimators. We also present a simulation study on the performances of various competing estimators. A real data analysis is also reported to illustrate the applicability of proposed estimators.


title: Some explicit cocycles on the Furstenberg boundary for products of isometries of hyperbolic spaces and $\mathrm{SL}(3,\mathbb{K})$

abstract: Nicolas Monod showed that the evaluation map $H^*_m(G\curvearrowright G/P)\longrightarrow H^*_m(G)$ between the measurable cohomology of the action of a connected semisimple Lie group $G$ on its Furstenberg boundary $G/P$ and the measurable cohomology of $G$ is surjective with a kernel that can be entirely described in terms of invariants in the cohomology of the maximal split torus $A<G$. In a recent paper the authors refine Monod's result and show in particular that the cohomology of non-alternating cocycles on $G/P$, namely those lying in the kernel of the alternation map, is in general not trivial and lies in the kernel of the evaluation. In this paper we describe explicitly such non-alternating and alternating cocycles on $G/P$ in low degrees when $G$ is either a product of isometries of real hyperbolic spaces or $G=\mathrm{SL}(3,\mathbb{K})$, where $\mathbb{K}$ is either the real or the complex field. As a consequence, we deduce that the comparison map $H^*_{m,b}(G)\rightarrow H^*_m(G)$ from the measurable bounded cohomology is injective in degree $3$, which is new for nontrivial products of isometries of hyperbolic spaces.


title: Deep Learning for Multi-User MIMO Systems: Joint Design of Pilot, Limited Feedback, and Precoding

abstract: In conventional multi-user multiple-input multiple-output (MU-MIMO) systems with frequency division duplexing (FDD), channel acquisition and precoder optimization processes have been designed separately although they are highly coupled. This paper studies an end-to-end design of downlink MU-MIMO systems which include pilot sequences, limited feedback, and precoding. To address this problem, we propose a novel deep learning (DL) framework which jointly optimizes the feedback information generation at users and the precoder design at a base station (BS). Each procedure in the MU-MIMO systems is replaced by intelligently designed multiple deep neural networks (DNN) units. At the BS, a neural network generates pilot sequences and helps the users obtain accurate channel state information. At each user, the channel feedback operation is carried out in a distributed manner by an individual user DNN. Then, another BS DNN collects feedback information from the users and determines the MIMO precoding matrices. A joint training algorithm is proposed to optimize all DNN units in an end-to-end manner. In addition, a training strategy which can avoid retraining for different network sizes for a scalable design is proposed. Numerical results demonstrate the effectiveness of the proposed DL framework compared to classical optimization techniques and other conventional DNN schemes.


title: A Deep Learning Approach to Infer Galaxy Cluster Masses from Planck Compton$-y$ parameter maps

abstract: Galaxy clusters are useful laboratories to investigate the evolution of the Universe, and accurately measuring their total masses allows us to constrain important cosmological parameters. However, estimating mass from observations that use different methods and spectral bands introduces various systematic errors. This paper evaluates the use of a Convolutional Neural Network (CNN) to reliably and accurately infer the masses of galaxy clusters from the Compton-y parameter maps provided by the Planck satellite. The CNN is trained with mock images generated from hydrodynamic simulations of galaxy clusters, with Planck's observational limitations taken into account. We observe that the CNN approach is not subject to the usual observational assumptions, and so is not affected by the same biases. By applying the trained CNNs to the real Planck maps, we find cluster masses compatible with Planck measurements within a 15% bias. Finally, we show that this mass bias can be explained by the well known hydrostatic equilibrium assumption in Planck masses, and the different parameters in the Y500-M500 scaling laws. This work highlights that CNNs, supported by hydrodynamic simulations, are a promising and independent tool for estimating cluster masses with high accuracy, which can be extended to other surveys as well as to observations in other bands.


title: Trade Co-occurrence, Trade Flow Decomposition, and Conditional Order Imbalance in Equity Markets

abstract: The time proximity of high-frequency trades can contain a salient signal. In this paper, we propose a method to classify every trade, based on its proximity with other trades in the market within a short period of time, into five types. By means of a suitably defined normalized order imbalance associated to each type of trade, which we denote as conditional order imbalance (COI), we investigate the price impact of the decomposed trade flows. Our empirical findings indicate strong positive correlations between contemporaneous returns and COIs. In terms of predictability, we document that associations with future returns are positive for COIs of trades which are isolated from trades of stocks other than themselves, and negative otherwise. Furthermore, trading strategies which we develop using COIs achieve conspicuous returns and Sharpe ratios, in an extensive experimental setup on a universe of 457 stocks using daily data for a period of four years.


title: Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling

abstract: Natural Language Processing (NLP) has become increasingly utilized to provide adaptivity in educational applications. However, recent research has highlighted a variety of biases in pre-trained language models. While existing studies investigate bias in different domains, they are limited in addressing fine-grained analysis on educational and multilingual corpora. In this work, we analyze bias across text and through multiple architectures on a corpus of 9,165 German peer-reviews collected from university students over five years. Notably, our corpus includes labels such as helpfulness, quality, and critical aspect ratings from the peer-review recipient as well as demographic attributes. We conduct a Word Embedding Association Test (WEAT) analysis on (1) our collected corpus in connection with the clustered labels, (2) the most common pre-trained German language models (T5, BERT, and GPT-2) and GloVe embeddings, and (3) the language models after fine-tuning on our collected data-set. In contrast to our initial expectations, we found that our collected corpus does not reveal many biases in the co-occurrence analysis or in the GloVe embeddings. However, the pre-trained German language models find substantial conceptual, racial, and gender bias and have significant changes in bias across conceptual and racial axes during fine-tuning on the peer-review data. With our research, we aim to contribute to the fourth UN sustainability goal (quality education) with a novel dataset, an understanding of biases in natural language education data, and the potential harms of not counteracting biases in language models for educational tasks.


title: Anderson Acceleration for Nonsmooth Fixed Point Problems

abstract: We give new convergence results of Anderson acceleration for the composite $\max$ fixed point problem. We prove that Anderson(1) and EDIIS(1) are q-linear convergent with a smaller q-factor than existing q-factors. Moreover, we propose a smoothing approximation of the composite max function in the contractive fixed point problem. We show that the smoothing approximation is a contraction mapping with the same fixed point as the composite $\max$ fixed point problem. Our results rigorously confirm that the nonsmoothness does not affect the convergence rate of Anderson acceleration method when we use the proposed smoothing approximation for the composite $\max$ fixed point problem. Numerical results for constrained minimax problems, complementarity problems and nonsmooth differential equations are presented to show the efficiency and good performance of the proposed Anderson acceleration method with smoothing approximation.


title: Multiplicities and dimensions in enveloping tensor categories

abstract: In the previous paper arxiv:math/0610552 semisimple tensor categories were constructed out of certain regular Mal'cev categories. In this paper, we calculate the tensor product multiplicities and the categorical dimensions of the simple objects. This yields also the Grothendieck ring. The main tool is the subquotient decomposition of the basic objects.


title: Cellular resolutions of monomial ideals and their Artinian reductions

abstract: The question we address in this paper is: which monomial ideals have minimal cellular resolutions, that is, minimal resolutions obtained from homogenizing the chain maps of CW-complexes? Velasco gave families of examples of monomial ideals that do not have minimal cellular resolutions, but those examples have large minimal generating sets. In this paper, we show that if a monomial ideal has at most four generators, then the ideal and its (monomial) Artinian reductions have minimal cellular resolutions. When the ideal is generated by two monomials, we can give a precise description of the CW-complex supporting minimal free resolution of the ideal and its Artinian reduction. Also, in this case, we compute the multigraded Betti numbers, Cohen-Macaulay type and determine when the corresponding algebra is a level algebra.


title: Structural mean models for instrumented difference-in-differences

abstract: In the standard difference-in-differences research design, the parallel trends assumption may be violated when the relationship between the exposure trend and the outcome trend is confounded by unmeasured confounders. Progress can be made if there is an exogenous variable that (i) does not directly influence the change in outcome means (i.e. the outcome trend) except through influencing the change in exposure means (i.e. the exposure trend), and (ii) is not related to the unmeasured exposure - outcome confounders on the trend scale. Such exogenous variable is called an instrument for difference-in-differences. For continuous outcomes that lend themselves to linear modelling, so-called instrumented difference-in-differences methods have been proposed. In this paper, we will suggest novel multiplicative structural mean models for instrumented difference-in-differences, which allow one to identify and estimate the average treatment effect on count and rare binary outcomes, in the whole population or among the treated, when a valid instrument for difference-in-differences is available. We discuss the identifiability of these models, then develop efficient semi-parametric estimation approaches that allow the use of flexible, data-adaptive or machine learning methods to estimate the nuisance parameters. We apply our proposal on health care data to investigate the risk of moderate to severe weight gain under sulfonylurea treatment compared to metformin treatment, among new users of antihyperglycemic drugs.


title: FNeVR: Neural Volume Rendering for Face Animation

abstract: Face animation, one of the hottest topics in computer vision, has achieved a promising performance with the help of generative models. However, it remains a critical challenge to generate identity preserving and photo-realistic images due to the sophisticated motion deformation and complex facial detail modeling. To address these problems, we propose a Face Neural Volume Rendering (FNeVR) network to fully explore the potential of 2D motion warping and 3D volume rendering in a unified framework. In FNeVR, we design a 3D Face Volume Rendering (FVR) module to enhance the facial details for image rendering. Specifically, we first extract 3D information with a well-designed architecture, and then introduce an orthogonal adaptive ray-sampling module for efficient rendering. We also design a lightweight pose editor, enabling FNeVR to edit the facial pose in a simple yet effective way. Extensive experiments show that our FNeVR obtains the best overall quality and performance on widely used talking-head benchmarks.


title: LCRL: Certified Policy Synthesis via Logically-Constrained Reinforcement Learning

abstract: LCRL is a software tool that implements model-free Reinforcement Learning (RL) algorithms over unknown Markov Decision Processes (MDPs), synthesising policies that satisfy a given linear temporal specification with maximal probability. LCRL leverages partially deterministic finite-state machines known as Limit Deterministic Buchi Automata (LDBA) to express a given linear temporal specification. A reward function for the RL algorithm is shaped on-the-fly, based on the structure of the LDBA. Theoretical guarantees under proper assumptions ensure the convergence of the RL algorithm to an optimal policy that maximises the satisfaction probability. We present case studies to demonstrate the applicability, ease of use, scalability, and performance of LCRL. Owing to the LDBA-guided exploration and LCRL model-free architecture, we observe robust performance, which also scales well when compared to standard RL approaches (whenever applicable to LTL specifications). Full instructions on how to execute all the case studies in this paper are provided on a GitHub page that accompanies the LCRL distribution www.github.com/grockious/lcrl.


title: Partially Observable Markov Decision Processes in Robotics: A Survey

abstract: Noisy sensing, imperfect control, and environment changes are defining characteristics of many real-world robot tasks. The partially observable Markov decision process (POMDP) provides a principled mathematical framework for modeling and solving robot decision and control tasks under uncertainty. Over the last decade, it has seen many successful applications, spanning localization and navigation, search and tracking, autonomous driving, multi-robot systems, manipulation, and human-robot interaction. This survey aims to bridge the gap between the development of POMDP models and algorithms at one end and application to diverse robot decision tasks at the other. It analyzes the characteristics of these tasks and connects them with the mathematical and algorithmic properties of the POMDP framework for effective modeling and solution. For practitioners, the survey provides some of the key task characteristics in deciding when and how to apply POMDPs to robot tasks successfully. For POMDP algorithm designers, the survey provides new insights into the unique challenges of applying POMDPs to robot systems and points to promising new directions for further research.


title: Cumulants of net-strangeness multiplicity distributions at energies available at the BNL Relativistic Heavy Ion Collider

abstract: The higher-order cumulants of net-proton number, net-charge, and net-strangeness multiplicity distributions are widely studied to search for the quantum-chromodynamics critical point and extract the chemical freeze-out parameters in heavy-ion collisions. In this context, the event-by-event fluctuations of the net-strangeness multiplicity distributions play important roles in extracting the chemical freeze-out parameter in the strangeness sector. Due to having difficulties in detecting all strange hadrons event by event, the kaon ($K$) and lambda ($\Lambda$) particles serve as a proxy for the strangeness-related observables in heavy-ion collisions. We have studied the net-$K$, net-$\Lambda$, and net-($K$ + $\Lambda$) multiplicity distributions and calculated their different order of cumulants using the ultrarelativistic quantum molecular dynamics model and hadron resonance gas calculation. To adequately account for the net-strangeness cumulants, it has been found that the inclusion of resonance decay contributions in $K$ and $\Lambda$ is necessary.


title: Construction of boundary conditions for Navier-Stokes equations from the moment system

abstract: This work concerns with boundary conditions (BCs) of the linearized moment system for rarefied gases. As the Knudsen number is sufficiently small, we analyze the boundary-layer behaviors of the moment system by resorting to a three-scale asymptotic expansion. The asymptotic analysis casts the flows into the outer solution, the viscous layer and the Knudsen layer. Starting from the BCs of the moment system, we propose a matching requirement and construct BCs for the Navier-Stokes equations. The obtained BCs contain the effect of second-order terms on the velocity slip and temperature jump. For the illustrative case of the Couette flow, we prove the validity of the constructed BCs through the error estimates. Meanwhile, numerical tests are presented to show the performance of the constructed BCs.


title: Learning capability of parametrized quantum circuits

abstract: Variational quantum algorithms (VQAs) and their applications in the field of quantum machine learning through parametrized quantum circuits (PQCs) are thought to be one major way of leveraging noisy intermediate-scale quantum computing devices. However, differences in the performance of certain VQA architectures are often unclear since established best practices as well as detailed studies are missing. In this paper, we build upon the work by Schuld et al. and Vidal et al. and compare popular ans\"atze for PQCs through the new measure of learning capability. We also examine dissipative quantum neural networks (dQNN) as introduced by Beer et al. and propose a data re-upload structure for dQNNs to increase their learning capability. Comparing the results for the different PQC architectures, we can provide guidelines for designing efficient PQCs.


title: On the Complexity of Finding Small Subgradients in Nonsmooth Optimization

abstract: We study the oracle complexity of producing $(\delta,\epsilon)$-stationary points of Lipschitz functions, in the sense proposed by Zhang et al. [2020]. While there exist dimension-free randomized algorithms for producing such points within $\widetilde{O}(1/\delta\epsilon^3)$ first-order oracle calls, we show that no dimension-free rate can be achieved by a deterministic algorithm. On the other hand, we point out that this rate can be derandomized for smooth functions with merely a logarithmic dependence on the smoothness parameter. Moreover, we establish several lower bounds for this task which hold for any randomized algorithm, with or without convexity. Finally, we show how the convergence rate of finding $(\delta,\epsilon)$-stationary points can be improved in case the function is convex, a setting which we motivate by proving that in general no finite time algorithm can produce points with small subgradients even for convex functions.


title: Presolar Silicon Carbide Grains of Types Y and Z: Their Strontium and Barium Isotopic Compositions and Stellar Origins

abstract: We report the Sr and Ba isotopic compositions of 18 presolar SiC grains of types Y (11) and Z (7), rare types commonly argued to have formed in lower-than-solar metallicity asymptotic giant branch (AGB) stars. We find that the Y and Z grains show higher 88Sr/87Sr and more variable 138Ba/136Ba ratios than mainstream (MS) grains. According to FRANEC Torino AGB models, the Si, Sr, and Ba isotopic compositions of our Y and Z grains can be consistently explained if the grains came from low mass AGB stars with 0.15 Zsun <= Z < 1.00 Zsun, in which the 13C neutron exposure for the slow neutron-capture process is greatly reduced with respect to that required by MS grains for a 1.0 Z8 AGB star. This scenario is in line with the previous finding based on Ti isotopes, but it fails to explain the indistinguishable Mo isotopic compositions of MS, Y, and Z grains.


title: Stochastic evolution equations with rough boundary noise

abstract: We investigate the pathwise well-posedness of stochastic evolution equations perturbed by multiplicative Neumann boundary noise, such as fractional Brownian motion for $H\in(1/3,1/2]$. Combining the controlled rough path approach with the theory of extrapolation operators, we establish global existence of solutions and flows for such equations. For Dirichlet boundary noise we obtain similar results in the Young regime.


title: Thermodynamic model of the fluid system H2O-CO2-NaCl-CaCl2 at P-T parameters of the middle and lower crust

abstract: Based on the earlier obtained equations of state for the ternary systems H2O-CO2-CaCl2 and H2O-CO2-NaCl, an equation of state for the four-component fluid system H2O-CO2-NaCl-CaCl2 is derived in terms of the Gibbs excess free energy. A corresponding numerical thermodynamic model is build. The main part of the numerical parameters of the model coincides with the corresponding parameters of the ternary systems. The NaCl-CaCl2 interaction parameter was obtained from the experimental liquidus of the salt mixture. Similar to the thermodynamic models for H2O-CO2-CaCl2 and H2O-CO2-NaCl, the range of applicability of the model is pressure 1-20 kbar and temperature from 500C to 1400C. The model makes it possible to predict the physicochemical properties of the fluid involved in most processes of deep petrogenesis: the phase state of the system (homogeneous or multiphase fluid, presence or absence of solid salts), chemical activities of the components, densities of the fluid phases, and concentrations of the components in the coexisting phases. The model was used for a detailed study of the phase state and activity of water on the H2O-CO2-salt sections when changing the ratio xNaCl/(xNaCl+xCaCl2) from 1 to 0. Changes in the composition and density of coexisting fluid phases at a constant activity of water and changes in the total composition of the system are studied. A set of phase diagrams on sections H2O-NaCl-CaCl2 for different mole fractions of CO2 is obtained. Pressure dependencies of the maximal activity of water in the field of coexisting unmixable fluid phases are obtained for several salt compositions of the system. Due to removal of restrictions resulting from a smaller number of components in ternary systems, the thermodynamic behavior of systems with a mixed composition of the salt is significantly differ from the behavior of those with a single salt component.


title: Extraction-based Deep Learning Reconstruction of Interior Tomography

abstract: Interior tomography is a typical strategy for radiation dose reduction in computed tomography, where only a certain region-of-interest (ROI) is scanned. However, given the truncated projection data, ROI reconstruction by conventional analytical algorithms may suffer from severe cupping artifacts. In this paper, we proposed a new extraction-based deep learning method for the reconstruction of interior tomography. Our approach works in dual domains where a sinogram-domain network (SDNet) estimates the contribution of the exterior region to the truncated projection and an image-domain network (IDNet) further mitigates artifacts. Unlike the previous extrapolation-based methods, SDNet is intended to obtain a complete ROI-only sinogram via extraction instead of a fully non-truncated sinogram for both the ROI and exterior regions. Our experiments validated the proposed method and the results indicate that the proposed method can disclose more reliable structures. It achieved better image quality with better generalization performance than extrapolation-based methods.


title: Particle-based, rapid incremental smoother meets particle Gibbs

abstract: The particle-based, rapid incremental smoother (PARIS) is a sequential Monte Carlo technique allowing for efficient online approximation of expectations of additive functionals under Feynman--Kac path distributions. Under weak assumptions, the algorithm has linear computational complexity and limited memory requirements. It also comes with a number of non-asymptotic bounds and convergence results. However, being based on self-normalised importance sampling, the PARIS estimator is biased; its bias is inversely proportional to the number of particles but has been found to grow linearly with the time horizon under appropriate mixing conditions. In this work, we propose the Parisian particle Gibbs (PPG) sampler, whose complexity is essentially the same as that of the PARIS and which significantly reduces the bias for a given computational complexity at the price of a modest increase in the variance. This method is a wrapper in the sense that it uses the PARIS algorithm in the inner loop of particle Gibbs to form a bias-reduced version of the targeted quantities. We substantiate the PPG algorithm with theoretical results, including new bounds on bias and variance as well as deviation inequalities. We illustrate our theoretical results with numerical experiments supporting our claims.


title: On directed strongly regular Cayley graphs over non-abelian groups with an abelian subgroup of index $2$

abstract: In 1988, Duval introduced the concept of directed strongly regular graphs, which can be viewed as a directed graph version of strongly regular graphs. Such directed graphs have similar structural and algebraic properties to strongly regular graphs. In the past three decades, it was found that Cayley graphs, especially those over dihedral groups, play a key role in the construction of directed strongly regular graphs. In this paper, we focus on the characterization of directed strongly regular Cayley graphs over more general groups. Let $G$ be a non-abelian group with an abelian subgroup of index $2$. We give some necessary conditions for a Cayley graph over $G$ to be directed strongly regular, and characterize the directed strongly regular Cayley graphs over $G$ satisfying specified conditions. This extends some previous results of He and Zhang (2019).


title: Matched Quality Evaluation of Temporally Downsampled Videos with Non-Integer Factors

abstract: Recent research has shown that temporal downsampling of high-frame-rate sequences can be exploited to improve the rate-distortion performance in video coding. However, until now, research only targeted downsampling factors of powers of two, which greatly restricts the potential applicability of temporal downsampling. A major reason is that traditional, objective quality metrics such as peak signal-to-noise ratio or more recent approaches, which try to mimic subjective quality, can only be evaluated between two sequences whose frame rate ratio is an integer value. To relieve this problem, we propose a quality evaluation method that allows calculating the distortion between two sequences whose frame rate ratio is fractional. The proposed method can be applied to any full-reference quality metric.


title: Microscopic analysis of the valence transition in tetragonal EuPd$_2$Si$_2$

abstract: Under temperature or pressure tuning, tetragonal EuPd$_2$Si$_2$ is known to undergo a valence transition from nearly divalent to nearly trivalent Eu accompanied by a volume reduction. Albeit intensive work, its microscopic origin is still being discussed. Here, we investigate the mechanism of the valence transition under volume compression by $ab~initio$ density functional theory (DFT) calculations. Our analysis of the electronic and magnetic properties of EuPd$_2$Si$_2$ when approaching the valence transition shows an enhanced $c$-$f$ hybridization between localized Eu 4$f$ states and itinerant conduction states (Eu 5$d$, Pd 4$d$, and Si 3$p$) where an electronic charge redistribution takes place. We observe that the change in the electronic structure is intimately related to the volume reduction where Eu-Pd(Si) bond lengths shorten and, for the transition to happen, we trace the delicate balance between electronic bandwidth, crystal field splitting, Coulomb repulsion, Hund's coupling and spin-orbit coupling. In a next step we compare and benchmark our DFT results to surface-sensitive photoemission data in which the mixed-valent properties of EuPd$_2$Si$_2$ are reflected in a simultaneous observation of divalent and trivalent signals from the Eu $4f$ shell. The study serves as well to explore the limits of density functional theory and the choice of exchange correlation functionals to describe such a phenomenon as a valence transition.


title: Conditions for graviton emission in the recombination of a delocalized mass

abstract: In a known gedanken experiment, a delocalized mass is recombined while the gravitational field sourced by it is probed by another (distant) particle; in it, this is used to explore a possible tension between complementarity and causality in case the gravitational field entangles with the superposed locations, a proposed resolution being graviton emission from quadrupole moments. Here, we focus on the delocalized particle (forgetting about the probe and the gedanken experiment) and explore the conditions (in terms of mass, separation, and recombination time) for graviton emission. Through this, we find that the variations of quadrupole moments in the recombination are generically greatly enhanced if the field is entangled compared to if it is sourced instead by the energy momentum expectation value on the delocalized state (moment variation $\sim m \, d^2$ in the latter case, with $m$ mass, $d$ separation). In addition, we obtain the (upper) limit recombination time for graviton emission growing as $m$ in place of the naive expectation $\sqrt{m}$. In this, the Planck mass acts as threshold mass (huge, for delocalized objects): no graviton emission is possible below it, however fast the recombination occurs. If this is compared with the decay times foreseen in the collapse models of Di\'osi and Penrose (in their basic form), one finds that no (quadrupole) graviton emission from recombination is possible in them. Indeed, right when $m$ becomes large enough to allow for emission, it also becomes too large for the superposition to survive collapse long enough to recombine.


title: Tailoring spin waves in 2D transition metal phosphorus trichalcogenides via atomic-layer substitution

abstract: The family of two-dimensional (2D) van der Waals transition metal phosphorus trichalcogenides has received a renewed interest due to their intrinsic 2D antiferromagnetism, which proves them as unprecedented and highly tunable building blocks for spintronics and magnonics at the single-layer limit. Herein, motivated by the exciting potential of atomic-substitution demonstrated in Janus transition metal dichalcogenides, we investigate the crystal, electronic and magnetic structure of selenized Janus monolayers based on MnPS$_3$ and NiPS$_3$ from first-principles. In addition, we calculate the magnon dispersion and perform real-time real-space atomistic dynamic simulations to explore the propagation of spin waves in MnPS$_3$, NiPS$_3$, MnPS$_{1.5}$Se$_{1.5}$ and NiPS$_{1.5}$Se$_{1.5}$. Our calculations predict a drastic enhancement of magnetic anisotropy and the emergence of large Dzyaloshinskii-Moriya interactions, which arises from the induced broken inversion symmetry in the 2D Janus layers. These results pave the way to the development of Janus 2D transition metal phosphorus trichalcogenides and highlight their potential for magnonic applications.


title: GIST-AiTeR System for the Diarization Task of the 2022 VoxCeleb Speaker Recognition Challenge

abstract: This report describes the submission system of the GIST-AiTeR team at the 2022 VoxCeleb Speaker Recognition Challenge (VoxSRC) Track 4. Our system mainly includes speech enhancement, voice activity detection , multi-scaled speaker embedding, probabilistic linear discriminant analysis-based speaker clustering, and overlapped speech detection models. We first construct four different diarization systems according to different model combinations with the best experimental efforts. Our final submission is an ensemble system of all the four systems and achieves a diarization error rate of 5.12% on the challenge evaluation set, ranked third at the diarization track of the challenge.


title: Two-Nanorod PT Structure with Large Spontaneous Enhancement

abstract: Two-mode coupling is very common and basic in optics. Recently, a lot more works are focusing on the optical mode coupling with gain and loss due to its tighter link to actual world. For a couple between one gain and one loss mode, by adjusting the coupling constant, the mode in the spectrum will at first stay then move after the constant passing some critical point. This phase transition can be explained by non-Hermitian PT phase transition theory.However, only few works research the spontaneous emission adjustment based on this procedure. It has a lot of promising utilization in on chip optic systems if we can adjust spontaneous emission. We look more deeply in this mode coupling process using metallic nanorods, find the Exceptional Point, show the phase transition between PT symmetry and PT broken regime, and show the adjustment to quantum dot emission. Our work not only promote the understanding of multi-mode system, but also bring up with a new way to adjust high enhancement of spontaneous emission, tamping the foundation for future on chip nano photonics.


title: Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation

abstract: Data-free Knowledge Distillation (DFKD) has attracted attention recently thanks to its appealing capability of transferring knowledge from a teacher network to a student network without using training data. The main idea is to use a generator to synthesize data for training the student. As the generator gets updated, the distribution of synthetic data will change. Such distribution shift could be large if the generator and the student are trained adversarially, causing the student to forget the knowledge it acquired at previous steps. To alleviate this problem, we propose a simple yet effective method called Momentum Adversarial Distillation (MAD) which maintains an exponential moving average (EMA) copy of the generator and uses synthetic samples from both the generator and the EMA generator to train the student. Since the EMA generator can be considered as an ensemble of the generator's old versions and often undergoes a smaller change in updates compared to the generator, training on its synthetic samples can help the student recall the past knowledge and prevent the student from adapting too quickly to new updates of the generator. Our experiments on six benchmark datasets including big datasets like ImageNet and Places365 demonstrate the superior performance of MAD over competing methods for handling the large distribution shift problem. Our method also compares favorably to existing DFKD methods and even achieves state-of-the-art results in some cases.


title: Performance Impact of Channel Aging and Phase Noise on Intelligent Reflecting Surface

abstract: This letter aims to clarify the impact of channel aging and phase noise on the performance of intelligent reflecting surface-aided wireless systems. We first model mathematically the outdated channel state information (CSI) due to Doppler shifts and phase noise stemming from hardware impairment. Then, a closed-form expression of achievable spectral efficiency under noisy and aged CSI is theoretically derived. Some typical simulation results to numerically demonstrate the performance impact are illustrated.


title: MulBot: Unsupervised Bot Detection Based on Multivariate Time Series

abstract: Online social networks are actively involved in the removal of malicious social bots due to their role in the spread of low quality information. However, most of the existing bot detectors are supervised classifiers incapable of capturing the evolving behavior of sophisticated bots. Here we propose MulBot, an unsupervised bot detector based on multivariate time series (MTS). For the first time, we exploit multidimensional temporal features extracted from user timelines. We manage the multidimensionality with an LSTM autoencoder, which projects the MTS in a suitable latent space. Then, we perform a clustering step on this encoded representation to identify dense groups of very similar users -- a known sign of automation. Finally, we perform a binary classification task achieving f1-score $= 0.99$, outperforming state-of-the-art methods (f1-score $\le 0.97$). Not only does MulBot achieve excellent results in the binary classification task, but we also demonstrate its strengths in a novel and practically-relevant task: detecting and separating different botnets. In this multi-class classification task we achieve f1-score $= 0.96$. We conclude by estimating the importance of the different features used in our model and by evaluating MulBot's capability to generalize to new unseen bots, thus proposing a solution to the generalization deficiencies of supervised bot detectors.


title: Neutrino Frontier Topical Group Report (NF03): Physics Beyond the Standard Model

abstract: This topical group focuses on searches for signals from physics Beyond the Standard Model (BSM), both from a theoretical and experimental perspective, including neutrino-related BSM and searches for BSM in other sectors using neutrino facilities.