title: Sample-Then-Optimize Batch Neural Thompson Sampling

abstract: Bayesian optimization (BO), which uses a Gaussian process (GP) as a surrogate to model its objective function, is popular for black-box optimization. However, due to the limitations of GPs, BO underperforms in some problems such as those with categorical, high-dimensional or image inputs. To this end, recent works have used the highly expressive neural networks (NNs) as the surrogate model and derived theoretical guarantees using the theory of neural tangent kernel (NTK). However, these works suffer from the limitations of the requirement to invert an extremely large parameter matrix and the restriction to the sequential (rather than batch) setting. To overcome these limitations, we introduce two algorithms based on the Thompson sampling (TS) policy named Sample-Then-Optimize Batch Neural TS (STO-BNTS) and STO-BNTS-Linear. To choose an input query, we only need to train an NN (resp. a linear model) and then choose the query by maximizing the trained NN (resp. linear model), which is equivalently sampled from the GP posterior with the NTK as the kernel function. As a result, our algorithms sidestep the need to invert the large parameter matrix yet still preserve the validity of the TS policy. Next, we derive regret upper bounds for our algorithms with batch evaluations, and use insights from batch BO and NTK to show that they are asymptotically no-regret under certain conditions. Finally, we verify their empirical effectiveness using practical AutoML and reinforcement learning experiments.


title: Equality scale-based and sound horizon-based analysis of the Hubble tension

abstract: The Hubble horizon at matter-radiation equality ($k^{-1}_{\rm{eq}}$) and the sound horizon at the last scattering surface ($r_s(z_*)$) provides interesting consistency check for the $\Lambda$CDM model and its extensions. It is well known that the reduction of $r_s$ can be compensated by the increase of $H_0$, while the same is true for the standard rulers $k_{\rm{eq}}$. Adding extra radiational component to the early universe can reduce $k_{\rm{eq}}$. The addition of early dark energy (EDE), however, tends to increase $k_{\rm{eq}}$. We perform $k_{\rm{eq}}$- and $r_s$-based analyses in both the EDE model and the Wess-Zumino Dark Radiation (WZDR) model. In the latter case we find $\Delta H_0 = 0.4$ between the $r_s$- and $k_{\rm{eq}}$-based datasets, while in the former case we find $\Delta H_0 = 1.2$. This result suggests that the dark radiation scenario is more consistent in the fit of the two standard rulers ($k_{\rm{eq}}$ and $r_s$). As a forecast analyses, we fit the two models with a mock $k_{\rm{eq}}$ prior derived from \emph{Planck} best-fit $\Lambda$CDM model. Compared with the best-fit $H_0$ in baseline $\Lambda$CDM model, we find $\Delta H_0 = 1.1$ for WZDR model and $\Delta H_0 = - 2.4$ for EDE model.


title: Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering

abstract: This paper presents an overview of the tenth edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2022. BioASQ is an ongoing series of challenges that promotes advances in the domain of large-scale biomedical semantic indexing and question answering. In this edition, the challenge was composed of the three established tasks a, b, and Synergy, and a new task named DisTEMIST for automatic semantic annotation and grounding of diseases from clinical content in Spanish, a key concept for semantic indexing and search engines of literature and clinical records. This year, BioASQ received more than 170 distinct systems from 38 teams in total for the four different tasks of the challenge. As in previous years, the majority of the competing systems outperformed the strong baselines, indicating the continuous advancement of the state-of-the-art in this domain.


title: NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstruction

abstract: We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct surfaces from multiview images due to their high-quality results and simplicity. However, implicit neural representations usually cannot reconstruct indoor scenes well because they suffer severe shape-radiance ambiguity. We assume that the indoor scene consists of texture-rich and flat texture-less regions. In texture-rich regions, the multiview stereo can obtain accurate results. In the flat area, normal estimation networks usually obtain a good normal estimation. Based on the above observations, we reduce the possible spatial variation range of implicit neural surfaces by reliable geometric priors to alleviate shape-radiance ambiguity. Specifically, we use multiview stereo results to limit the NeuralRoom optimization space and then use reliable geometric priors to guide NeuralRoom training. Then the NeuralRoom would produce a neural scene representation that can render an image consistent with the input training images. In addition, we propose a smoothing method called perturbation-residual restrictions to improve the accuracy and completeness of the flat region, which assumes that the sampling points in a local surface should have the same normal and similar distance to the observation center. Experiments on the ScanNet dataset show that our method can reconstruct the texture-less area of indoor scenes while maintaining the accuracy of detail. We also apply NeuralRoom to more advanced multiview reconstruction algorithms and significantly improve their reconstruction quality.


title: Gauge Invariance of the Thermal Conductivity in the Quantum Regime

abstract: The widely used linear-response (LR) theory of thermal conduction in the quantum regime rests on the yet unproven assumption, that the thermal conductivity is invariant with respect to the gauge of the energy density of the system. This assumption manifests itself clearly in, e.g., Hardy's formulation of the heat-flux operator [Phys. Rev. 132, 168 (1963)]. In this work, we rigorously prove this assumption. Our proof, being valid for the nuclear and electronic subsystems, not only puts the state-of-the-art theory on solid grounds, but also enables going beyond the scope of the widely-used Boltzmann transport equation (BTE) within the LR framework for many-body systems.


title: First principles study on the mechanism of abnormal viscosity change of pure Al & Pb melts based on Wulff cluster model

abstract: In this paper, the Wulff cluster model combined phonon calculation is used to investigate the relationship between the structure of metallic melts (Pb/Al) and the abnormal viscosity change. Although absolute value of the surface energy does not change significantly with temperature, the Wulff shape changed evidently. When temperature raise to 975K, Pb(321) surface that has the highest interaction strength completely disappears, while the abnormal viscosity drop happens at the same temperature range. Oppositely, Al(100) surface that has the lowest interaction strength disappears when temperature is higher than 1075K, and at the same temperature range, the abnormal viscosity rise has been observed. The abnormal viscosity drop corresponds to the disappearance of surface with the highest interaction strength (Pb(321) surface), while the rise one corresponds to the disappearance of surface with the lowest adsorption energy (Al(100) surface). All evidence indicates that the uniformity between abnormal viscosity change and the change of Wulff shape is not a coincidence. A possible mechanism of the abnormal viscosity change is that it caused by the significant structure change of cluster (short range ordering) in the metallic melts.


title: Federated Learning for Tabular Data: Exploring Potential Risk to Privacy

abstract: Federated Learning (FL) has emerged as a potentially powerful privacy-preserving machine learning methodology, since it avoids exchanging data between participants, but instead exchanges model parameters. FL has traditionally been applied to image, voice and similar data, but recently it has started to draw attention from domains including financial services where the data is predominantly tabular. However, the work on tabular data has not yet considered potential attacks, in particular attacks using Generative Adversarial Networks (GANs), which have been successfully applied to FL for non-tabular data. This paper is the first to explore leakage of private data in Federated Learning systems that process tabular data. We design a Generative Adversarial Networks (GANs)-based attack model which can be deployed on a malicious client to reconstruct data and its properties from other participants. As a side-effect of considering tabular data, we are able to statistically assess the efficacy of the attack (without relying on human observation such as done for FL for images). We implement our attack model in a recently developed generic FL software framework for tabular data processing. The experimental results demonstrate the effectiveness of the proposed attack model, thus suggesting that further research is required to counter GAN-based privacy attacks.


title: $B\pi$-state contamination in $B$-meson observables

abstract: Multi-particle states with additional pions are expected to result in a non-negligible excited-state contamination in lattice simulations. We show that heavy meson chiral perturbation theory can be employed to calculate the contamination due to two-particle $B\pi$ states in various $B$-meson observables like the $B$-meson decay constant and the $BB^*\pi$ coupling. We work in the static limit and to next-to-leading order in the chiral expansion. The $B\pi$ states are found to typically overestimate the observables at the few percent level depending on the size of two currently unknown NLO low-energy coefficients. A strategy to independently measure one of them with the 3-point function of the light axial vector current will be discussed.


title: Adopting Microservices and DevOps in the Cyber-Physical Systems Domain: A Rapid Review and Case Study

abstract: The domain of cyber-physical systems (CPS) has recently seen strong growth, e.g., due to the rise of the Internet of Things (IoT) in industrial domains, commonly referred to as "Industry 4.0". However, CPS challenges like the strong hardware focus can impact modern software development practices, especially in the context of modernizing legacy systems. While microservices and DevOps have been widely studied for enterprise applications, there is insufficient coverage for the CPS domain. Our goal is therefore to analyze the peculiarities of such systems regarding challenges and practices for using and migrating towards microservices and DevOps. We conducted a rapid review based on 146 scientific papers, and subsequently validated our findings in an interview-based case study with 9 CPS professionals in different business units at Siemens AG. The combined results picture the specifics of microservices and DevOps in the CPS domain. While several differences were revealed that may require adapted methods, many challenges and practices are shared with typical enterprise applications. Our study supports CPS researchers and practitioners with a summary of challenges, practices to address them, and research opportunities.


title: Finite-temperature stability of hydrocarbons: fullerenes versus flakes

abstract: The effects of a finite temperature on the equilibrium structures of hydrocarbon molecules are computationally explored as a function of size and relative chemical composition in hydrogen and carbon. Using parallel tempering Monte Carlo simulations employing a reactive force field, we find that in addition to the phases already known for pure carbon, namely cages, flakes, rings and branched structures, strong effects due to temperature and the addition of little amounts of hydrogen are reported. Both entropy and the addition of moderate amounts of hydrogen favor planar structures such as nanoribbons over fullerenes. Accurate phase diagrams are proposed, highlighting the possible presence of multiple phase changes at finite size and composition. Astrophysical implications are also discussed.


title: $\mathbf{c_\textbf{SW}}$ at One-Loop Order for Brillouin Fermions

abstract: Wilson-like Dirac operators can be written in the form $D=\gamma_\mu\nabla_\mu-\frac {ar}{2} \Delta$. For Wilson fermions the standard two-point derivative $\nabla_\mu^{(\mathrm{std})}$ and 9-point Laplacian $\Delta^{(\mathrm{std})}$ are used. For Brillouin fermions these are replaced by improved discretizations $\nabla_\mu^{(\mathrm{iso})}$ and $\Delta^{(\mathrm{bri})}$ which have 54- and 81-point stencils respectively. We derive the Feynman rules in lattice perturbation theory for the Brillouin action and apply them to the calculation of the improvement coefficient ${c_\mathrm{SW}}$, which, similar to the Wilson case, has a perturbative expansion of the form ${c_\mathrm{SW}}=1+{c_\mathrm{SW}}^{(1)}g_0^2+\mathcal{O}(g_0^4)$. For $N_c=3$ we find ${c_\mathrm{SW}}^{(1)}_\mathrm{Brillouin} =0.12362580(1) $, compared to ${c_\mathrm{SW}}^{(1)}_\mathrm{Wilson} = 0.26858825(1)$, both for $r=1$.


title: Lifetime of scalar cloud formation around a rotating regular black hole

abstract: Does circumventing the curvature singularity of the Kerr black hole affects the timescale of the scalar cloud formation around it? By definition, the scalar cloud, forms a gravitational atom with hydrogen-like bound states, lying on the threshold of a massive scalar field's superradiant instability regime (time-growing quasi-bound states) and beyond (time-decaying quasi-bound states). By taking a novel type of rotating hollow regular black hole proposed by Simpson and Visser which unlike its standard rivals has an asymptotically Minkowski core, we address this question. The metric has a minimal extension relative to the standard Kerr, originating from a single regularization parameter $\ell$, with length dimension. We show with the inclusion of the regularization length scale $\ell$ into the Kerr spacetime, without affecting the standard superradiant instability regime, the timescale of scalar cloud formation gets shorter. Since the scalar cloud after its formation, via energy dissipation, can play the role of a continuum source for gravitational waves, such a reduction in the instability growth time improves the phenomenological detection prospects of new physics because the shorter the time, the more astrophysically important.


title: Maps from braids to virtual braids and braid representations

abstract: Virtual knot theory has experienced a lot of nice features that did not appear in classical knot theory, e.g., parity and picture-valued invariants. In the present paper we use virtual knot theory effects to construct new representations of classical (pure) braids.


title: Estimating excited states contamination of $B \to \pi$ form factors using heavy meson chiral perturbation theory

abstract: Using Heavy Meson Chiral Perturbation Theory (HMChPT), the $B^* \pi$ excited states contamination of the $B \to \pi$ vector form factors is computed to NLO in the chiral expansion and in the static limit. The results suggest that the excited states for $h_\parallel$ are of the order of a few percent whereas $h_\perp$ receives large negative contributions and thus might be significantly underestimated in lattice simulations.


title: Heavy quarks structure functions $F^{q\bar{q}}_{2}(x, Q^{2})$ and $F^{q\bar{q}}_{L}(x, Q^{2})$ at the NLO approximation

abstract: We provide compact formulas for the heavy quarks structure functions $F^{q\bar{q}}_{2}(x, Q^{2})$ and $F^{q\bar{q}}_{L}(x, Q^{2})$, with $q = c, b$ and $t$, in $e^{-}p$ interaction with respect to the behavior of the gluon density at the next-to-leading order (NLO) approximation and present ratios $R ^{q\bar{q}} = F^{q\bar{q}}_{L} /F^{q\bar{q}}_{2}$ for these quarks. To do this, we obtain a fitted form of the heavy quark coefficient functions for deep-inelastic lepton-hadron scattering at a wide range of $Q^{2}$ values. The obtained numerical results are compared with experimental data from HERA and with the results from the KLN model and the MSTW2008 predictions.


title: Fast genomic optical map assembly algorithm using binary representation

abstract: Reducing the cost of sequencing genomes provided by next-generation sequencing technologies has greatly increased the number of genomic projects. As a result, there is a growing need for better assembly and assembly validation methods. One promising idea is to use heterogeneous data in assembly projects. Optical Mapping (OM) is beneficial in validating genomic assemblies, correction and scaffolding. Single raw OM read describes a DNA molecule's long fragment, up to 1Mbp. Raw OM data from the same genome could be assembled to create consensus maps that span an entire chromosome. The assembly process is computationally hard because of the large number of errors in input data. This work describes a new algorithm and computer program to assemble OM reads without a reference genome. In our algorithm, we explored binary representation for genome maps. We focused on the efficiency of data structures and algorithms and scale on parallel platforms. The algorithm consists of several steps, of which the most important are : (1) conversion of the restriction maps into binary strings, (2) detection of overlaps between restriction maps, (3) determining the layout of restriction maps set, (4) creation of consensus genomic maps. Our algorithm deals with optical mapping data with low error levels but fails with high-level error reads. We developed a software library, console application and module for Python language. The approach presented in this paper proved to be faster than a dynamic programming approach and performed well on error-free data. It could be used as a step of \textit{de~novo} assembly pipelines or to detect misassemblies.The software is freely available in a public repository under GNU LGPL v3 license (https://sourceforge.net/p/binary-genome-maps/code).


title: Competition among Parallel Contests

abstract: We investigate the model of multiple contests held in parallel, where each contestant selects one contest to join and each contest designer decides the prize structure to compete for the participation of contestants. We first analyze the strategic behaviors of contestants and completely characterize the symmetric Bayesian Nash equilibrium. As for the strategies of contest designers, when other designers' strategies are known, we show that computing the best response is NP-hard and propose a fully polynomial time approximation scheme (FPTAS) to output the $\epsilon$-approximate best response. When other designers' strategies are unknown, we provide a worst case analysis on one designer's strategy. We give an upper bound on the utility of any strategy and propose a method to construct a strategy whose utility can guarantee a constant ratio of this upper bound in the worst case.


title: On anisotropic two-fluid stellar objects in General Relativity

abstract: We apply the 1+1+2 covariant semi-tetrad approach to describe a general static and spherically symmetric relativistic stellar object which contains two fluids with anisotropic pressure. The corresponding Tolman-Oppenheimer-Volkoff equations are then obtained in covariant form for the anisotropic case. These equations are used to obtain new exact solutions using direct resolution and reconstruction techniques. Finally, we show that three of the generating theorems known for the single fluid case can also be used to obtain two-fluid solutions from single fluid ones.


title: Generalized metric tree arrangements and Dressians

abstract: Metric trees and metric tree arrangements index cones in the polyhedral fan structure in Dressian Dr(2, n) and Dr(3, n) respectively. We study the adjacency of cones in Dressian Dr(3, n) and introduce general Whitehead moves which provide a condition for adjacency of cones in Dr(3, n) in terms of the associated metric tree arrangements. Based on these results we introduce the notion of generalized metric tree arrangements which parameterize points in Dr(k, n) and extend previously known results to Dr(k, n).


title: Voltage Fluctuations in ac Biased Superconducting Transition-Edge Sensors

abstract: We present a detailed analysis of the fundamental noise sources in superconducting transition-edge sensors (TESs), ac voltage biased at MHz frequencies and treated as superconducting weak links. We have studied the noise in the resistive transition as a function of bath temperature of several detectors with different normal resistances and geometries. We show that the excess noise, typically observed in the TES electrical bandwidth, can be explained by the equilibrium Johnson noise of the quasiparticles generated within the weak link. The fluctuations at the Josephson frequency and higher harmonics contribute significantly to the measured voltage noise at the detector bandwidth through the nonlinear response of the weak link with a sinusoidal current-phase relation.


title: Direct visualization and control of SrOx segregation on semiconducting Nb doped SrTiO3 (100) surface

abstract: We investigated how SrOx segregates on a Nb doped SrTiO3 (100) surface by in air annealing. Using atomic force and photoemission electron microscopes, we can directly visualize the morphology and the electronic phase changes with SrOx segregation. SrOx islands less than 2 micron meter in size and 1-5 unit cells thick nucleate first and grow in a labyrinth domain pattern. After prolonged annealing, SrOx forms a ~10 nm thick film. We show that the domain pattern can be controlled by introducing a surface miscut angle of SrTiO3. Additionally, the segregated SrOx has a lower work function, compared to that of SrTiO3. These results suggest that the control and tunability of SrOx segregation is applicable to the design of a new functional electronic devices in the semiconducting SrTiO3 based heterostructure.


title: Adv-Attribute: Inconspicuous and Transferable Adversarial Attack on Face Recognition

abstract: Deep learning models have shown their vulnerability when dealing with adversarial attacks. Existing attacks almost perform on low-level instances, such as pixels and super-pixels, and rarely exploit semantic clues. For face recognition attacks, existing methods typically generate the l_p-norm perturbations on pixels, however, resulting in low attack transferability and high vulnerability to denoising defense models. In this work, instead of performing perturbations on the low-level pixels, we propose to generate attacks through perturbing on the high-level semantics to improve attack transferability. Specifically, a unified flexible framework, Adversarial Attributes (Adv-Attribute), is designed to generate inconspicuous and transferable attacks on face recognition, which crafts the adversarial noise and adds it into different attributes based on the guidance of the difference in face recognition features from the target. Moreover, the importance-aware attribute selection and the multi-objective optimization strategy are introduced to further ensure the balance of stealthiness and attacking strength. Extensive experiments on the FFHQ and CelebA-HQ datasets show that the proposed Adv-Attribute method achieves the state-of-the-art attacking success rates while maintaining better visual effects against recent attack methods.


title: Dirichlet process mixture models for non-stationary data streams

abstract: In recent years, we have seen a handful of work on inference algorithms over non-stationary data streams. Given their flexibility, Bayesian non-parametric models are a good candidate for these scenarios. However, reliable streaming inference under the concept drift phenomenon is still an open problem for these models. In this work, we propose a variational inference algorithm for Dirichlet process mixture models. Our proposal deals with the concept drift by including an exponential forgetting over the prior global parameters. Our algorithm allows to adapt the learned model to the concept drifts automatically. We perform experiments in both synthetic and real data, showing that the proposed model is competitive with the state-of-the-art algorithms in the density estimation problem, and it outperforms them in the clustering problem.


title: Data augmentation on-the-fly and active learning in data stream classification

abstract: There is an emerging need for predictive models to be trained on-the-fly, since in numerous machine learning applications data are arriving in an online fashion. A critical challenge encountered is that of limited availability of ground truth information (e.g., labels in classification tasks) as new data are observed one-by-one online, while another significant challenge is that of class imbalance. This work introduces the novel Augmented Queues method, which addresses the dual-problem by combining in a synergistic manner online active learning, data augmentation, and a multi-queue memory to maintain separate and balanced queues for each class. We perform an extensive experimental study using image and time-series augmentations, in which we examine the roles of the active learning budget, memory size, imbalance level, and neural network type. We demonstrate two major advantages of Augmented Queues. First, it does not reserve additional memory space as the generation of synthetic data occurs only at training times. Second, learning models have access to more labelled data without the need to increase the active learning budget and / or the original memory size. Learning on-the-fly poses major challenges which, typically, hinder the deployment of learning models. Augmented Queues significantly improves the performance in terms of learning quality and speed. Our code is made publicly available.


title: Stochastic and Tensor Network simulations of the Hubbard Model

abstract: The Hubbard model is an important tool to understand the electrical properties of various materials. More specifically, on the honeycomb lattice it is used to describe graphene predicting a quantum phase transition from a semimetal to a Mott insulating state. In this work two different numerical techniques are presented that have been employed for simulations of the Hubbard model: The Hybrid Monte Carlo algorithm on the one hand allowed us to simulate unprecedentedly large lattices, whereas Tensor Networks can be used to completely avoid the sign problem. Respective strengths and weaknesses of the methods are discussed.


title: Lattice QCD at finite temperature: some aspects related to chiral symmetry

abstract: Out of the many exciting results obtained with the lattice approach to QCD under extreme conditions, I discuss a few selected items related to chiral symmetry: the chiral condensate as an approximate order parameter, meson screening masses, and masses of baryons and mesons, including D(s) mesons, when approaching the crossover from the hadronic side.


title: Learning Physical Dynamics with Subequivariant Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have become a prevailing tool for learning physical dynamics. However, they still encounter several challenges: 1) Physical laws abide by symmetry, which is a vital inductive bias accounting for model generalization and should be incorporated into the model design. Existing simulators either consider insufficient symmetry, or enforce excessive equivariance in practice when symmetry is partially broken by gravity. 2) Objects in the physical world possess diverse shapes, sizes, and properties, which should be appropriately processed by the model. To tackle these difficulties, we propose a novel backbone, Subequivariant Graph Neural Network, which 1) relaxes equivariance to subequivariance by considering external fields like gravity, where the universal approximation ability holds theoretically; 2) introduces a new subequivariant object-aware message passing for learning physical interactions between multiple objects of various shapes in the particle-based representation; 3) operates in a hierarchical fashion, allowing for modeling long-range and complex interactions. Our model achieves on average over 3% enhancement in contact prediction accuracy across 8 scenarios on Physion and 2X lower rollout MSE on RigidFall compared with state-of-the-art GNN simulators, while exhibiting strong generalization and data efficiency.


title: Pre-Avatar: An Automatic Presentation Generation Framework Leveraging Talking Avatar

abstract: Since the beginning of the COVID-19 pandemic, remote conferencing and school-teaching have become important tools. The previous applications aim to save the commuting cost with real-time interactions. However, our application is going to lower the production and reproduction costs when preparing the communication materials. This paper proposes a system called Pre-Avatar, generating a presentation video with a talking face of a target speaker with 1 front-face photo and a 3-minute voice recording. Technically, the system consists of three main modules, user experience interface (UEI), talking face module and few-shot text-to-speech (TTS) module. The system firstly clones the target speaker's voice, and then generates the speech, and finally generate an avatar with appropriate lip and head movements. Under any scenario, users only need to replace slides with different notes to generate another new video. The demo has been released here and will be published as free software for use.


title: CS-Insights: A System for Analyzing Computer Science Research

abstract: This paper presents CS-Insights, an interactive web application to analyze computer science publications from DBLP through multiple perspectives. The dedicated interfaces allow its users to identify trends in research activity, productivity, accessibility, author's productivity, venues' statistics, topics of interest, and the impact of computer science research on other fields. CS-Insightsis publicly available, and its modular architecture can be easily adapted to domains other than computer science.


title: Optimizing Rydberg Gates for Logical Qubit Performance

abstract: Robust gate sequences are widely used to reduce the sensitivity of gate operations to experimental imperfections. Typically, the optimization minimizes the average gate error, however, recent work in quantum error correction has demonstrated that the performance of encoded logical qubits is sensitive to not only the average error rate, but also the type of errors that occur. Here, we present a family of Rydberg blockade gates for neutral atom qubits that are robust against two common, major imperfections: intensity inhomogeneity and Doppler shifts. These gates outperform existing gates for moderate or large imperfections. We also consider the logical performance of these gates in the context of an erasure-biased qubit based on metastable $~^{171}$Yb. In this case, we observe that the robust gates outperform existing gates for even very small values of the imperfections, because they maintain the native large bias towards erasure errors for these qubits. These results significantly reduce the laser stability and atomic temperature requirements to achieve fault-tolerant quantum computing with neutral atoms. The approach of optimizing gates for logical qubit performance may be applied to other qubit platforms.


title: Asymptotics for real monotone double Hurwitz numbers

abstract: In recent years, monotone double Hurwitz numbers were introduced as a naturally combinatorial modification of double Hurwitz numbers. Monotone double Hurwitz numbers share many structural properties with their classical counterparts, such as piecewise polynomaility, while the quantitative properties of these two numbers are quite different. We consider real analogues of monotone double Hurwitz numbers and study the asymptotics for these real analogues. The key ingredient is an interpretation of real tropical covers with arbitrary splittings as factorizations in the symmetric group which generalizes the result from Guay-Paquet, Markwig, and Rau (Int. Math. Res. Not. IMRN, 2016(1):258-293, 2016). By using the above interpretation, we consider three types of real analogues of monotone double Hurwitz numbers: real monotone double Hurwitz numbers relative to simple splittings, relative to arbitrary splittings and real mixed double Hurwitz numbers. Under certain conditions, we find lower bounds for these real analogues, and obtain logarithmic asymptotics for real monotone double Hurwitz numbers relative to arbitrary splittings and real mixed double Hurwitz numbers. In particular, under given conditions real mixed double Hurwitz numbers are logarithmically equivalent to complex double Hurwitz numbers. We construct a family of real tropical covers and use them to show that real monotone double Hurwitz numbers relative to simple splittings are logarithmically equivalent to monotone double Hurwitz numbers with specific conditions. This is consistent with the logarithmic equivalence of real double Hurwitz numbers and complex double Hurwitz numbers.


title: RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval

abstract: Video language pre-training methods have mainly adopted sparse sampling techniques to alleviate the temporal redundancy of videos. Though effective, sparse sampling still suffers inter-modal redundancy: visual redundancy and textual redundancy. Compared with highly generalized text, sparsely sampled frames usually contain text-independent portions, called visual redundancy. Sparse sampling is also likely to miss important frames corresponding to some text portions, resulting in textual redundancy. Inter-modal redundancy leads to a mismatch of video and text information, hindering the model from better learning the shared semantics across modalities. To alleviate it, we propose Redundancy-aware Video-language Pre-training. We design a redundancy measurement of video patches and text tokens by calculating the cross-modal minimum dis-similarity. Then, we penalize the highredundant video patches and text tokens through a proposed redundancy-aware contrastive learning. We evaluate our method on four benchmark datasets, MSRVTT, MSVD, DiDeMo, and LSMDC, achieving a significant improvement over the previous stateof-the-art results. Our code are available at https://github.com/caskcsg/VLP/tree/main/RaP.


title: Beeping Shortest Paths via Hypergraph Bipartite Decomposition

abstract: Constructing a shortest path between two network nodes is a fundamental task in distributed computing. This work develops schemes for the construction of shortest paths in randomized beeping networks between a predetermined source node and an arbitrary set of destination nodes. Our first scheme constructs a (single) shortest path to an arbitrary destination in $O (D \log\log n + \log^3 n)$ rounds with high probability. Our second scheme constructs multiple shortest paths, one per each destination, in $O (D \log^2 n + \log^3 n)$ rounds with high probability. Our schemes are based on a reduction of the above shortest path construction tasks to a decomposition of hypergraphs into bipartite hypergraphs: We develop a beeping procedure that partitions the (polynomially-large) hyperedge set of a hypergraph $H = (V_H, E_H)$ into $k = \Theta (\log^2 n)$ disjoint subsets $F_1 \cup \cdots \cup F_k = E_H$ such that the (sub-)hypergraph $(V_H, F_i)$ is bipartite in the sense that there exists a vertex subset $U \subseteq V$ such that $|U \cap e| = 1$ for every $e \in F_i$. This procedure turns out to be instrumental in speeding up shortest path constructions under the beeping model.


title: A Study on mm-wave Propagation in and around Buildings

abstract: mm-waves are envisaged as key enabler for 5G and 6G wireless communications, thanks to the wider bandwidth and to the possibility of implementing large-scale antenna arrays and new advanced transmission techniques, such as massive MIMO and beamforming, that can take advantage of the multidimensional properties of the wireless channel. In order to further study the mm-wave wireless channel, where propagation shows different characteristics compared to the sub-6 GHz band, a joint measurement and simulation campaigns in indoor and outdoor microcellular environments has been carried out. The investigation highlights that the traditional assumption that mm-wave NLoS propagation is problematic is not true since significant reflections, scattering and even transmission mechanisms provide good NLoS coverage in most indoor and outdoor scenarios. This also reflects in the limited angle-spread differences between LoS and NLoS locations in some cases. Finally, the contribution of different propagation mechanisms (reflection, diffraction, scattering and combination of them) to the received power is analyzed in the paper with the help of ray tracing simulations.


title: Algorithms for Weighted Pushdown Automata

abstract: Weighted pushdown automata (WPDAs) are at the core of many natural language processing tasks, like syntax-based statistical machine translation and transition-based dependency parsing. As most existing dynamic programming algorithms are designed for context-free grammars (CFGs), algorithms for PDAs often resort to a PDA-to-CFG conversion. In this paper, we develop novel algorithms that operate directly on WPDAs. Our algorithms are inspired by Lang's algorithm, but use a more general definition of pushdown automaton and either reduce the space requirements by a factor of $|\Gamma|$ (the size of the stack alphabet) or reduce the runtime by a factor of more than $|Q|$ (the number of states). When run on the same class of PDAs as Lang's algorithm, our algorithm is both more space-efficient by a factor of $|\Gamma|$ and more time-efficient by a factor of $|Q| \cdot |\Gamma|$.


title: Geometric Active Learning for Segmentation of Large 3D Volumes

abstract: Segmentation, i.e., the partitioning of volumetric data into components, is a crucial task in many image processing applications ever since such data could be generated. Most existing applications nowadays, specifically CNNs, make use of voxelwise classification systems which need to be trained on a large number of annotated training volumes. However, in many practical applications such data sets are seldom available and the generation of annotations is time-consuming and cumbersome. In this paper, we introduce a novel voxelwise segmentation method based on active learning on geometric features. Our method uses interactively provided seed points to train a voxelwise classifier based entirely on local information. The combination of an ad hoc incorporation of domain knowledge and local processing results in a flexible yet efficient segmentation method that is applicable to three-dimensional volumes without size restrictions. We illustrate the potential and flexibility of our approach by applying it to selected computed tomography scans where we perform different segmentation tasks to scans from different domains and of different sizes.


title: ImaginaryNet: Learning Object Detectors without Real Images and Annotations

abstract: Without the demand of training in reality, humans can easily detect a known concept simply based on its language description. Empowering deep learning with this ability undoubtedly enables the neural network to handle complex vision tasks, e.g., object detection, without collecting and annotating real images. To this end, this paper introduces a novel challenging learning paradigm Imaginary-Supervised Object Detection (ISOD), where neither real images nor manual annotations are allowed for training object detectors. To resolve this challenge, we propose ImaginaryNet, a framework to synthesize images by combining pretrained language model and text-to-image synthesis model. Given a class label, the language model is used to generate a full description of a scene with a target object, and the text-to-image model deployed to generate a photo-realistic image. With the synthesized images and class labels, weakly supervised object detection can then be leveraged to accomplish ISOD. By gradually introducing real images and manual annotations, ImaginaryNet can collaborate with other supervision settings to further boost detection performance. Experiments show that ImaginaryNet can (i) obtain about 70% performance in ISOD compared with the weakly supervised counterpart of the same backbone trained on real data, (ii) significantly improve the baseline while achieving state-of-the-art or comparable performance by incorporating ImaginaryNet with other supervision settings.


title: ROS-PyBullet Interface: A Framework for Reliable Contact Simulation and Human-Robot Interaction

abstract: Reliable contact simulation plays a key role in the development of (semi-)autonomous robots, especially when dealing with contact-rich manipulation scenarios, an active robotics research topic. Besides simulation, components such as sensing, perception, data collection, robot hardware control, human interfaces, etc. are all key enablers towards applying machine learning algorithms or model-based approaches in real world systems. However, there is a lack of software connecting reliable contact simulation with the larger robotics ecosystem (i.e. ROS, Orocos), for a more seamless application of novel approaches, found in the literature, to existing robotic hardware. In this paper, we present the ROS-PyBullet Interface, a framework that provides a bridge between the reliable contact/impact simulator PyBullet and the Robot Operating System (ROS). Furthermore, we provide additional utilities for facilitating Human-Robot Interaction (HRI) in the simulated environment. We also present several use-cases that highlight the capabilities and usefulness of our framework. Please check our video, source code, and examples included in the supplementary material. Our full code base is open source and can be found at https://github.com/cmower/ros_pybullet_interface.


title: AccelAT: A Framework for Accelerating the Adversarial Training of Deep Neural Networks through Accuracy Gradient

abstract: Adversarial training is exploited to develop a robust Deep Neural Network (DNN) model against the malicious altered data. These attacks may have catastrophic effects on DNN models but are indistinguishable for a human being. For example, an external attack can modify an image adding noises invisible for a human eye, but a DNN model misclassified the image. A key objective for developing robust DNN models is to use a learning algorithm that is fast but can also give model that is robust against different types of adversarial attacks. Especially for adversarial training, enormously long training times are needed for obtaining high accuracy under many different types of adversarial samples generated using different adversarial attack techniques. This paper aims at accelerating the adversarial training to enable fast development of robust DNN models against adversarial attacks. The general method for improving the training performance is the hyperparameters fine-tuning, where the learning rate is one of the most crucial hyperparameters. By modifying its shape (the value over time) and value during the training, we can obtain a model robust to adversarial attacks faster than standard training. First, we conduct experiments on two different datasets (CIFAR10, CIFAR100), exploring various techniques. Then, this analysis is leveraged to develop a novel fast training methodology, AccelAT, which automatically adjusts the learning rate for different epochs based on the accuracy gradient. The experiments show comparable results with the related works, and in several experiments, the adversarial training of DNNs using our AccelAT framework is conducted up to 2 times faster than the existing techniques. Thus, our findings boost the speed of adversarial training in an era in which security and performance are fundamental optimization objectives in DNN-based applications.


title: Multi-recipient and threshold encryption based on hidden multipliers

abstract: Let $S$ be a pool of $s$ parties and Alice be the dealer. In this paper, we propose a scheme that allows the dealer to encrypt messages in such a way that only one authorized coalition of parties (which the dealer chooses depending on the message) can decrypt. At the setup stage, each of the parties involved in the process receives an individual key from the dealer. To decrypt information, an authorized coalition of parties must work together to use their keys. Based on this scheme, we propose a threshold encryption scheme. For a given message $f$ the dealer can choose any threshold $m = m(f).$ More precisely, any set of parties of size at least $m$ can evaluate $f$; any set of size less than $m$ cannot do this. Similarly, the distribution of keys among the included parties can be done in such a way that authorized coalitions of parties will be given the opportunity to put a collective digital signature on any documents. This primitive can be generalized to the dynamic setting, where any user can dynamically join the pool $S$. In this case the new user receives a key from the dealer. Also any user can leave the pool $S$. In both cases, already distributed keys of other users do not change. The main feature of the proposed schemes is that for a given $s$ the keys are distributed once and can be used multiple times. The proposed scheme is based on the idea of hidden multipliers in encryption. As a platform, one can use both multiplicative groups of finite fields and groups of invertible elements of commutative rings, in particular, multiplicative groups of residue rings. We propose two versions of this scheme.


title: Switch-based Hybrid Beamforming Transceiver Design for Wideband Communications with Beam Squint

abstract: Hybrid beamforming (HBF) transceiver architectures based on frequency-independent phase shifters (PS-HBF) are sensitive to the phases and physical directions with limited capability to compensate for the detrimental effects of the beam squint. Motivated by the fact that switches are phase-independent and more power/cost efficient than PSs, we consider the switch-based HBF (SW-HBF) for wideband large-scale multiple-input multiple-output systems in this paper. We first derive a closed-form expression of the beam squint ratio and compare the expected array gains of both SW-HBF and PS-HBF architectures. The results show that SW-HBF is more robust to the beam squint effect. We then focus on the SW-HBF designs to maximize the spectral efficiency (SE) in both single-user and multiuser systems, which are both non-convex mixed-integer problems. For the former, by combining the tabu search (TS) method and projected gradient ascend (PGA), we propose an efficient heuristic PGA-TS algorithm to design analog beamformers while the digital ones admit closed-form solutions. For the latter, we develop a two-step algorithm based on fractional programming and the PGA-TS method. Simulations show that the proposed SW-HBF schemes are efficient and can outperform PS-based HBF architectures in terms of both SE and energy efficiency in terahertz communication systems.


title: Experimental Design for Multi-Channel Imaging via Task-Driven Feature Selection

abstract: This paper presents a data-driven, task-specific paradigm for experimental design, to shorten acquisition time, reduce costs, and accelerate the deployment of imaging devices. Current approaches in experimental design focus on model-parameter estimation and require specification of a particular model, whereas in imaging, other tasks may drive the design. Furthermore, such approaches often lead to intractable optimization problems in real-world imaging applications. Here we present a new paradigm for experimental design that simultaneously optimizes the design (set of image channels) and trains a machine-learning model to execute a user-specified image-analysis task. The approach obtains data densely-sampled over the measurement space (many image channels) for a small number of acquisitions, then identifies a subset of channels of prespecified size that best supports the task. We propose a method: TADRED for TAsk-DRiven Experimental Design in imaging, to identify the most informative channel-subset whilst simultaneously training a network to execute the task given the subset. Experiments demonstrate the potential of TADRED in diverse imaging applications: several clinically-relevant tasks in magnetic resonance imaging; and remote sensing and physiological applications of hyperspectral imaging. Results show substantial improvement over classical experimental design, two recent application-specific methods within the new paradigm, and state-of-the-art approaches in supervised feature selection. We anticipate further applications of our approach. Code is available: https://github.com/sbb-gh/experimental-design-multichannel


title: Detection of barium in the atmospheres of the ultra-hot gas giants WASP-76b and WASP-121b

abstract: High-resolution spectroscopy studies of ultra-hot Jupiters have been key in our understanding of exoplanet atmospheres. Observing into the atmospheres of these giant planets allows for direct constraints on their atmospheric compositions and dynamics while laying the groundwork for new research regarding their formation and evolution environments. Two of the most well-studied ultra-hot Jupiters are WASP-76b and WASP-121b, with multiple detected chemical species and strong signatures of their atmospheric dynamics. We take a new look at these two exceptional ultra-hot Jupiters by reanalyzing the transit observations taken with ESPRESSO at the Very Large Telescope and attempt to detect additional species. To extract the planetary spectra of the two targets, we corrected for the telluric absorption and removed the stellar spectrum contributions. We then exploited new synthetic templates that were specifically designed for ultra-hot Jupiters in combination with the cross-correlation technique to unveil species that remained undetected by previous analyses. We add a novel detection of Ba+ to the known atmospheric compositions of WASP-76b and WASP-121b, the heaviest species detected to date in any exoplanetary atmosphere, with additional new detections of Co and Sr+ and a tentative detection of Ti+ for WASP-121b. We also confirm the presence of Ca+, Cr, Fe, H, Li, Mg, Mn, Na, and V on both WASP-76b and WASP-121b, with the addition of Ca, Fe+, and Ni for the latter. Finally, we also confirm the clear asymmetric absorption feature of Ca+ on WASP-121b, with an excess absorption at the bluer wavelengths and an effective planet radius beyond the Roche lobe. This indicates that the signal may arise from the escape of planetary atmosphere.


title: Bug Analysis in Jupyter Notebook Projects: An Empirical Study

abstract: Computational notebooks, such as Jupyter, have been widely adopted by data scientists to write code for analyzing and visualizing data. Despite their growing adoption and popularity, there has been no thorough study to understand Jupyter development challenges from the practitioners' point of view. This paper presents a systematic study of bugs and challenges that Jupyter practitioners face through a large-scale empirical investigation. We mined 14,740 commits from 105 GitHub open-source projects with Jupyter notebook code. Next, we analyzed 30,416 Stack Overflow posts which gave us insights into bugs that practitioners face when developing Jupyter notebook projects. Finally, we conducted nineteen interviews with data scientists to uncover more details about Jupyter bugs and to gain insights into Jupyter developers' challenges. We propose a bug taxonomy for Jupyter projects based on our results. We also highlight bug categories, their root causes, and the challenges that Jupyter practitioners face.


title: Dim-Krum: Backdoor-Resistant Federated Learning for NLP with Dimension-wise Krum-Based Aggregation

abstract: Despite the potential of federated learning, it is known to be vulnerable to backdoor attacks. Many robust federated aggregation methods are proposed to reduce the potential backdoor risk. However, they are mainly validated in the CV field. In this paper, we find that NLP backdoors are hard to defend against than CV, and we provide a theoretical analysis that the malicious update detection error probabilities are determined by the relative backdoor strengths. NLP attacks tend to have small relative backdoor strengths, which may result in the failure of robust federated aggregation methods for NLP attacks. Inspired by the theoretical results, we can choose some dimensions with higher backdoor strengths to settle this issue. We propose a novel federated aggregation algorithm, Dim-Krum, for NLP tasks, and experimental results validate its effectiveness.


title: GA-SAM: Gradient-Strength based Adaptive Sharpness-Aware Minimization for Improved Generalization

abstract: Recently, Sharpness-Aware Minimization (SAM) algorithm has shown state-of-the-art generalization abilities in vision tasks. It demonstrates that flat minima tend to imply better generalization abilities. However, it has some difficulty implying SAM to some natural language tasks, especially to models with drastic gradient changes, such as RNNs. In this work, we analyze the relation between the flatness of the local minimum and its generalization ability from a novel and straightforward theoretical perspective. We propose that the shift of the training and test distributions can be equivalently seen as a virtual parameter corruption or perturbation, which can explain why flat minima that are robust against parameter corruptions or perturbations have better generalization performances. On its basis, we propose a Gradient-Strength based Adaptive Sharpness-Aware Minimization (GA-SAM) algorithm to help to learn algorithms find flat minima that generalize better. Results in various language benchmarks validate the effectiveness of the proposed GA-SAM algorithm on natural language tasks.


title: Schatten Class Hankel Operators on Weighted Bergman Spaces induced by regular weights

abstract: In this paper, for $1\leq p<\infty$, we provide several descriptions of Schatten $p$-class Hankel operators $H_f$ and $H_{\overline{f}}$ on the weight Bergman space $A^2_\omega$, in terms of a certain global and local mean oscillation of the symbol $f\in L^2_\omega$, provided $\omega$ is a class of regular weights. The approaches applied to rely on several classical methods, and simultaneously rely on a novel but more convenient construction associated with the atomic decomposition of $A^2_\omega$.


title: Orbital Expansion Variational Quantum Eigensolver: Enabling Efficient Simulation of Molecules with Shallow Quantum Circuit

abstract: In the noisy-intermediate-scale-quantum era, Variational Quantum Eigensolver (VQE) is a promising method to study ground state properties in quantum chemistry, materials science, and condensed physics. However, general quantum eigensolvers are lack of systematical improvability, and achieve rigorous convergence is generally hard in practice, especially in solving strong-correlated systems. Here, we propose an Orbital Expansion VQE~(OE-VQE) framework to construct an efficient convergence path. The path starts from a highly correlated compact active space and rapidly expands and converges to the ground state, enabling simulating ground states with much shallower quantum circuits. We benchmark the OE-VQE on a series of typical molecules including H$_{6}$-chain, H$_{10}$-ring and N$_2$, and the simulation results show that proposed convergence paths dramatically enhance the performance of general quantum eigensolvers.


title: All Order Merging of High Energy and Soft Collinear Resummation

abstract: We present a method of merging the exclusive LO-matched high energy resummation of High Energy Jets (HEJ) with the parton shower of Pythia which preserves the accuracy of the LO cross sections and the logarithmic accuracy of both resummation schemes across all of phase space. Predictions produced with this merging prescription are presented with comparisons to data from experimental studies and suggestions are made for further observables and experimental cuts which highlight the importance of both high energy and soft-collinear effects.


title: Projective Fra\"{i}ss\'{e} limits and generalized Wa\.{z}ewski dendrites

abstract: We continue the study of projective Fra\"{i}ss\'{e} limits of trees initiated by Charatonik and Roe and we construct many generalized Wa\.{z}ewski dendrites as the topological realization of a projective Fra\"{i}ss\'{e} limit of families of finite trees with (weakly) coherent epimorphisms. Moreover we use the categorical approach to Fra\"{i}ss\'{e} limits developed by Kubi\'{s} to construct all generalized Wa\.{z}ewski dendrites as topological realizations of Fra\"{i}ss\'{e} limits of suitable categories of finite structures. As an application we recover a homogeneity result for countable dense sets of endpoints in generalized Wa\.{z}ewski dendrites.


title: Evidence of a signature of planet formation processes from solar neutrino fluxes

abstract: Solar evolutionary models are thus far unable to reproduce spectroscopic, helioseismic, and neutrino constraints consistently, resulting in the so-called solar modeling problem. In parallel, planet formation models predict that the evolving composition of the protosolar disk and, thus, of the gas accreted by the proto-Sun must have been variable. We show that solar evolutionary models that include a realistic planet formation scenario lead to an increased core metallicity of up to 5%, implying that accurate neutrino flux measurements are sensitive to the initial stages of the formation of the Solar System. Models with homogeneous accretion match neutrino constraints to no better than 2.7$\sigma$. In contrast, accretion with a variable composition due to planet formation processes, leading to metal-poor accretion of the last $\sim$4% of the young Sun's total mass, yields solar models within 1.3$\sigma$ of all neutrino constraints. We thus demonstrate that in addition to increased opacities at the base of the convective envelope, the formation history of the Solar System constitutes a key element in resolving the current crisis of solar models.


title: Entropy Approximation by Machine Learning Regression: Application for Irregularity Evaluation of Images in Remote Sensing

abstract: Approximation of entropies of various types using machine learning (ML) regression methods are shown for the first time. The ML models presented in this study define the complexity of the short time series by approximating dissimilar entropy techniques such as Singular value decomposition entropy (SvdEn), Permutation entropy (PermEn), Sample entropy (SampEn) and Neural Network entropy (NNetEn) and their 2D analogies. A new method for calculating SvdEn2D, PermEn2D and SampEn2D for 2D images was tested using the technique of circular kernels. Training and testing datasets on the basis of Sentinel-2 images are presented (two training images and one hundred and ninety-eight testing images). The results of entropy approximation are demonstrated using the example of calculating the 2D entropy of Sentinel-2 images and R^2 metric evaluation. The applicability of the method for the short time series with a length from N = 5 to N = 113 elements is shown. A tendency for the R^2 metric to decrease with an increase in the length of the time series was found. For SvdEn entropy, the regression accuracy is R^2 > 0.99 for N = 5 and R^2 > 0.82 for N = 113. The best metrics were observed for the ML_SvdEn2D and ML_NNetEn2D models. The results of the study can be used for fundamental research of entropy approximations of various types using ML regression, as well as for accelerating entropy calculations in remote sensing. The versatility of the model is shown on a synthetic chaotic time series using Planck map and logistic map.


title: Quantum direct communication protocol using recurrence in k-cycle quantum walk

abstract: The ability of quantum walks to evolve in a superposition of distinct quantum states has been used as a resource in quantum communication protocols. Under certain settings, the $k$-cycle discrete-time quantum walks\,(DTQW) are known to recur to its initial state after every $t_r$ steps. We first present a scheme to optically realize any $k$-cycle DTQW using $J$-plate, orbital angular momentum\,(OAM) sorters, optical switch, and optical delay line. This entangles the polarization and OAM degrees of freedom\,(DoF) of a single photon. Making use of this recurrence phenomena of $k$-cycle DTQW and the entanglement generated during the evolution, we present a new quantum direct communication protocol. The recurrence and entanglement in $k$-cycle walk are effectively used to retrieve and secure the information, respectively, in the proposed protocol. We investigate the security of the protocol against intercept and resend attack. We also quantify the effect of amplitude damping and depolarizing noises on recurrence and mutual information between polarization and OAM DoF of a single photon.


title: Optimising the H$\alpha$ index for the identification of activity signals in FGK stars. Improvement of the correlation between H$\alpha$ and CaII H&K

abstract: In this work we investigate the effect of the H$\alpha$ bandpass width in the correlation between the CaII H&K and H$\alpha$ indices with the aim of improving the H$\alpha$ index to better identify and model the signals coming from activity variability. We used a sample of 152 FGK dwarfs observed with HARPS for more than 13 years with enough cadence to be able to detect rotational modulations and cycles in activity proxies. We calculated the CaII H&K and H$\alpha$ activity indices using a range of bandwidths for H$\alpha$ between 0.1 and 2.0 Ang. We studied the correlation between the indices time series at long and short timescales and analysed the impact of stellar parameters, activity level and variability on the correlations. The correlation between CaII H&K and H$\alpha$ both at short and long timespans is maximised when using narrow H$\alpha$ bandwidths, with a maximum at 0.6 Ang. For some inactive stars, as the activity level increases, the flux in the H$\alpha$ line core increases while the flux in the line wings decreases as the line becomes shallower and broader. The balance between these fluxes can cause stars to show the negative correlations observed in the literature when using a wide bandwidth on H$\alpha$. These anti-correlations may become positive correlations if using the 0.6 Ang bandwidth. Calculating the H$\alpha$ index using a bandpass of 0.6 Ang maximises the correlation between CaII H&K and H$\alpha$ both at short and long timescales. On the other hand, the use of the broader 1.6 Ang, generally used in exoplanet detection to identify stellar activity signals, degrades the signal by including the flux in the line wings. In face to these results we strongly recommend the use of a 0.6 Ang bandwidth when computing the H$\alpha$ index for the identification of activity rotational modulation and magnetic cycle signals in solar-type stars. (Abridged)


title: Contributions of structural variations to the asymptotic mixed-mode coupling Factor in red giant stars

abstract: The advent of ultra-precise photometry space missions enable the possibility of investigating stellar interior with mixed modes. The structural variations induced by the discontinuity of the chemical composition left behind during the first dredge--up is an important feature in the stellar mid-layers located between the hydrogen-burning shell and the base of the convective zone of red giants, as the mixed-mode properties can be significantly affected by these variations. In this paper, the contributing factors to variations of the mixed-mode coupling factor, $q$, are discussed with stellar models. In general, the structural variations give rise to a subtle displacement in the Lamb frequency and a sharp change in the buoyancy frequency, which lead to variations in the value of $q$ computed using the asymptotic formalisms that assuming a smooth background free of structural variations. The impact of these two factors can be felt in detectable mixed modes in low-luminosity red giants. Furthermore, the different nature of variations of the two characteristic frequencies with radius near the base of the convective zone, produces a sudden increase in $q$ in evolved red giants. This is followed by a quick drop in $q$ as the star evolves further along the red giant branch.


title: Method comparison for simulating non-Gaussian Beams and Diffraction for Precision Interferometry

abstract: In the context of simulating precision laser interferometers, we compare via several examples two wavefront decomposition methods: the Mode Expansion Method (MEM) and the Gaussian beam decomposition (GBD) for their precision and applicability. To judge the performance of these methods, we define different types of errors and study their properties. We specify how the two methods can be fairly compared and based on that, the quality of the MEM and GBD are compared in several examples. We test here cases for which analytic results are available, i.e., non-clipped circular and general astigmatic Gaussian beams, as well as clipped circular Gaussian beams, in the near-, far-, and extreme far-field of millions of kilometers occurring in space-gravitational wave detectors. Additionally, we compare the methods for aberrated wavefronts and the interaction with optical components by testing reflections from differently curved mirrors. We find that both methods can be generally used for decomposing non-Gaussian beams. However, which method is more accurate depends on the optical system and simulation settings. In the given examples, the MEM more accurately describes non-clipped Gaussian beams, while for clipped Gaussian beams and the interaction with surfaces, the GBD is more precise.


title: Hierarchical and Progressive Image Matting

abstract: Most matting researches resort to advanced semantics to achieve high-quality alpha mattes, and direct low-level features combination is usually explored to complement alpha details. However, we argue that appearance-agnostic integration can only provide biased foreground details and alpha mattes require different-level feature aggregation for better pixel-wise opacity perception. In this paper, we propose an end-to-end Hierarchical and Progressive Attention Matting Network (HAttMatting++), which can better predict the opacity of the foreground from single RGB images without additional input. Specifically, we utilize channel-wise attention to distill pyramidal features and employ spatial attention at different levels to filter appearance cues. This progressive attention mechanism can estimate alpha mattes from adaptive semantics and semantics-indicated boundaries. We also introduce a hybrid loss function fusing Structural SIMilarity (SSIM), Mean Square Error (MSE), Adversarial loss, and sentry supervision to guide the network to further improve the overall foreground structure. Besides, we construct a large-scale and challenging image matting dataset comprised of 59, 600 training images and 1000 test images (a total of 646 distinct foreground alpha mattes), which can further improve the robustness of our hierarchical and progressive aggregation model. Extensive experiments demonstrate that the proposed HAttMatting++ can capture sophisticated foreground structures and achieve state-of-the-art performance with single RGB images as input.


title: No Dimension-Free Deterministic Algorithm Computes Approximate Stationarities of Lipschitzians

abstract: We consider the computation of an approximately stationary point for a Lipschitz and semialgebraic function $f$ with a local oracle. If $f$ is smooth, simple deterministic methods have dimension-free finite oracle complexities. For the general Lipschitz setting, only recently, Zhang et al. [47] introduced a randomized algorithm that computes Goldstein's approximate stationarity [25] to arbitrary precision with a dimension-free polynomial oracle complexity. In this paper, we show that no deterministic algorithm can do the same. Even without the dimension-free requirement, we show that any finite time guaranteed deterministic method cannot be general zero-respecting, which rules out most of the oracle-based methods in smooth optimization and any trivial derandomization of Zhang et al. [47]. Our results reveal a fundamental hurdle of nonconvex nonsmooth problems in the modern large-scale setting and their infinite-dimensional extension.


title: Feature-Proxy Transformer for Few-Shot Segmentation

abstract: Few-shot segmentation (FSS) aims at performing semantic segmentation on novel classes given a few annotated support samples. With a rethink of recent advances, we find that the current FSS framework has deviated far from the supervised segmentation framework: Given the deep features, FSS methods typically use an intricate decoder to perform sophisticated pixel-wise matching, while the supervised segmentation methods use a simple linear classification head. Due to the intricacy of the decoder and its matching pipeline, it is not easy to follow such an FSS framework. This paper revives the straightforward framework of "feature extractor $+$ linear classification head" and proposes a novel Feature-Proxy Transformer (FPTrans) method, in which the "proxy" is the vector representing a semantic class in the linear classification head. FPTrans has two keypoints for learning discriminative features and representative proxies: 1) To better utilize the limited support samples, the feature extractor makes the query interact with the support features from the bottom to top layers using a novel prompting strategy. 2) FPTrans uses multiple local background proxies (instead of a single one) because the background is not homogeneous and may contain some novel foreground regions. These two keypoints are easily integrated into the vision transformer backbone with the prompting mechanism in the transformer. Given the learned features and proxies, FPTrans directly compares their cosine similarity for segmentation. Although the framework is straightforward, we show that FPTrans achieves competitive FSS accuracy on par with state-of-the-art decoder-based methods.


title: HoechstGAN: Virtual Lymphocyte Staining Using Generative Adversarial Networks

abstract: The presence and density of specific types of immune cells are important to understand a patient's immune response to cancer. However, immunofluorescence staining required to identify T cell subtypes is expensive, time-consuming, and rarely performed in clinical settings. We present a framework to virtually stain Hoechst images (which are cheap and widespread) with both CD3 and CD8 to identify T cell subtypes in clear cell renal cell carcinoma using generative adversarial networks. Our proposed method jointly learns both staining tasks, incentivising the network to incorporate mutually beneficial information from each task. We devise a novel metric to quantify the virtual staining quality, and use it to evaluate our method.


title: CNTN: Cyclic Noise-tolerant Network for Gait Recognition

abstract: Gait recognition aims to identify individuals by recognizing their walking patterns. However, an observation is made that most of the previous gait recognition methods degenerate significantly due to two memorization effects, namely appearance memorization and label noise memorization. To address the problem, for the first time noisy gait recognition is studied, and a cyclic noise-tolerant network (CNTN) is proposed with a cyclic training algorithm, which equips the two parallel networks with explicitly different abilities, namely one forgetting network and one memorizing network. The overall model will not memorize the pattern unless the two different networks both memorize it. Further, a more refined co-teaching constraint is imposed to help the model learn intrinsic patterns which are less influenced by memorization. Also, to address label noise memorization, an adaptive noise detection module is proposed to rule out the samples with high possibility to be noisy from updating the model. Experiments are conducted on the three most popular benchmarks and CNTN achieves state-of-the-art performances. We also reconstruct two noisy gait recognition datasets, and CNTN gains significant improvements (especially 6% improvements on CL setting). CNTN is also compatible with any off-the-shelf backbones and improves them consistently.


title: Single- and Multimagnon Dynamics in Antiferromagnetic $\alpha$-Fe$_2$O$_3$ Thin Films

abstract: Understanding the spin dynamics in antiferromagnetic (AFM) thin films is fundamental for designing novel devices based on AFM magnon transport. Here, we study the magnon dynamics in thin films of AFM $S=5/2$ $\alpha$-Fe$_2$O$_3$ by combining resonant inelastic x-ray scattering, Anderson impurity model plus dynamical mean-field theory, and Heisenberg spin model. Below 100 meV, we observe the thickness-independent (down to 15 nm) acoustic single-magnon mode. At higher energies (100-500 meV), an unexpected sequence of equally spaced, optical modes is resolved and ascribed to $\Delta S_z = 1$, 2, 3, 4, and 5 magnetic excitations corresponding to multiple, noninteracting magnons. Our study unveils the energy, character, and momentum-dependence of single and multimagnons in $\alpha$-Fe$_2$O$_3$ thin films, with impact on AFM magnon transport and its related phenomena. From a broader perspective, we generalize the use of L-edge resonant inelastic x-ray scattering as a multispin-excitation probe up to $\Delta S_z = 2S$. Our analysis identifies the spin-orbital mixing in the valence shell as the key element for accessing excitations beyond $\Delta S_z = 1$, and up to, e.g., $\Delta S_z = 5$. At the same time, we elucidate the novel origin of the spin excitations beyond the $\Delta S_z = 2$, emphasizing the key role played by the crystal lattice as a reservoir of angular momentum that complements the quanta carried by the absorbed and emitted photons.


title: Interface superconductivity in a type-II Dirac semimetal NiTe$_2$

abstract: We experimentally investigate charge transport through a single planar junction between a NiTe$_2$ Dirac semimetal and a normal gold lead. At millikelvin temperatures we observe non-Ohmic $dV/dI(V)$ behavior resembling Andreev reflection at a superconductor -- normal metal interface, while NiTe$_2$ bulk remains non-superconducting. The conclusion on superconductivity is also supported by suppression of the effect by temperature and magnetic field. In analogy with the known results for Cd$_3$As$_2$ Dirac semimetal, we connect this behavior with interfacial superconductivity due to the flat-band formation at the Au-NiTe$_2$ interface. Since the flat-band and topological surface states are closely connected, the claim on the flat-band-induced superconductivity is also supported by the Josephson current through the topological surface states on the pristine NiTe$_2$ surface. We demonstrate the pronounced Josephson diode effect, which results from the momentum shift of topological surface states of NiTe$_2$ under an in-plane magnetic field.


title: Distributed Primal Outer Approximation Algorithm for Sparse Convex Programming with Separable Structures

abstract: This paper presents the Distributed Primal Outer Approximation (DiPOA) algorithm for solving Sparse Convex Programming (SCP) problems with separable structures, efficiently, and in a decentralized manner. The DiPOA algorithm development consists of embedding the recently proposed Relaxed Hybrid Alternating Direction Method of Multipliers (RH-ADMM) algorithm into the Outer Approximation (OA) algorithm. We also propose two main improvements to control the quality and the number of cutting planes that approximate nonlinear functions. In particular, the RH-ADMM algorithm acts as a distributed numerical engine inside the DiPOA algorithm. DiPOA takes advantage of the multi-core architecture of modern processors to speed up optimization algorithms. The proposed distributed algorithm makes practical the solution of SCP in learning and control problems from the application side. This paper concludes with a performance analysis of DiPOA for the distributed sparse logistic regression and quadratically constrained optimization problems. Finally, the paper concludes with a numerical comparison with state-of-the-art optimization solvers.


title: A Review of X-ray Microcalorimeters Based on Superconducting Transition Edge Sensors for Astrophysics and Particle Physics

abstract: The state-of-the-art technology of X-ray microcalorimeters based on superconducting transition edge sensors (TESs), for applications in astrophysics and particle physics, is reviewed. We will show the advance in understanding the detector physics and describe the recent breakthroughs in the TES design that are opening the way towards the fabrication and the read-out of very large arrays of pixels with unprecedented energy resolution. The most challenging low temperature instruments for space- and ground-base experiments will be described.


title: Adapting Behaviour Based On Trust In Human-Agent Ad Hoc Teamwork

abstract: This work proposes a framework that incorporates trust in an ad hoc teamwork scenario with human-agent teams, where an agent must collaborate with a human to perform a task. During the task, the agent must infer, through interactions and observations, how much the human trusts it and adapt its behaviour to maximize the team's performance. To achieve this, we propose collecting data from human participants in experiments to define different settings (based on trust levels) and learning optimal policies for each of them. Then, we create a module to infer the current setting (depending on the amount of trust). Finally, we validate this framework in a real-world scenario and analyse how this adaptable behaviour affects trust.


title: On the Evaluation of the Plausibility and Faithfulness of Sentiment Analysis Explanations

abstract: Current Explainable AI (ExAI) methods, especially in the NLP field, are conducted on various datasets by employing different metrics to evaluate several aspects. The lack of a common evaluation framework is hindering the progress tracking of such methods and their wider adoption. In this work, inspired by offline information retrieval, we propose different metrics and techniques to evaluate the explainability of SA models from two angles. First, we evaluate the strength of the extracted "rationales" in faithfully explaining the predicted outcome. Second, we measure the agreement between ExAI methods and human judgment on a homegrown dataset1 to reflect on the rationales plausibility. Our conducted experiments comprise four dimensions: (1) the underlying architectures of SA models, (2) the approach followed by the ExAI method, (3) the reasoning difficulty, and (4) the homogeneity of the ground-truth rationales. We empirically demonstrate that anchors explanations are more aligned with the human judgment and can be more confident in extracting supporting rationales. As can be foreseen, the reasoning complexity of sentiment is shown to thwart ExAI methods from extracting supporting evidence. Moreover, a remarkable discrepancy is discerned between the results of different explainability methods on the various architectures suggesting the need for consolidation to observe enhanced performance. Predominantly, transformers are shown to exhibit better explainability than convolutional and recurrent architectures. Our work paves the way towards designing more interpretable NLP models and enabling a common evaluation ground for their relative strengths and robustness.


title: A Direct Approximation of AIXI Using Logical State Abstractions

abstract: We propose a practical integration of logical state abstraction with AIXI, a Bayesian optimality notion for reinforcement learning agents, to significantly expand the model class that AIXI agents can be approximated over to complex history-dependent and structured environments. The state representation and reasoning framework is based on higher-order logic, which can be used to define and enumerate complex features on non-Markovian and structured environments. We address the problem of selecting the right subset of features to form state abstractions by adapting the $\Phi$-MDP optimisation criterion from state abstraction theory. Exact Bayesian model learning is then achieved using a suitable generalisation of Context Tree Weighting over abstract state sequences. The resultant architecture can be integrated with different planning algorithms. Experimental results on controlling epidemics on large-scale contact networks validates the agent's performance.


title: Automotive Multilingual Fault Diagnosis

abstract: Automated fault diagnosis can facilitate diagnostics assistance, speedier troubleshooting, and better-organised logistics. Currently, AI-based prognostics and health management in the automotive industry ignore the textual descriptions of the experienced problems or symptoms. With this study, however, we show that a multilingual pre-trained Transformer can effectively classify the textual claims from a large company with vehicle fleets, despite the task's challenging nature due to the 38 languages and 1,357 classes involved. Overall, we report an accuracy of more than 80% for high-frequency classes and above 60% for above-low-frequency classes, bringing novel evidence that multilingual classification can benefit automotive troubleshooting management.


title: Wider and Higher: Intensive Integration and Global Foreground Perception for Image Matting

abstract: This paper reviews recent deep-learning-based matting research and conceives our wider and higher motivation for image matting. Many approaches achieve alpha mattes with complex encoders to extract robust semantics, then resort to the U-net-like decoder to concatenate or fuse encoder features. However, image matting is essentially a pixel-wise regression, and the ideal situation is to perceive the maximum opacity correspondence from the input image. In this paper, we argue that the high-resolution feature representation, perception and communication are more crucial for matting accuracy. Therefore, we propose an Intensive Integration and Global Foreground Perception network (I2GFP) to integrate wider and higher feature streams. Wider means we combine intensive features in each decoder stage, while higher suggests we retain high-resolution intermediate features and perceive large-scale foreground appearance. Our motivation sacrifices model depth for a significant performance promotion. We perform extensive experiments to prove the proposed I2GFP model, and state-of-the-art results can be achieved on different public datasets.


title: The calculation of the probability density and distribution function of a strictly stable law in the vicinity of zero

abstract: The problem of calculating the probability density and distribution function of a strictly stable law is considered at $x\to0$. The expansions of these values into power series were obtained to solve this problem. It was shown that in the case $\alpha<1$ the obtained series were asymptotic at $x\to0$, in the case $\alpha>1$ they were convergent and in the case $\alpha=1$ in the domain $|x|<1$ these series converged to an asymmetric Cauchy distribution. It has been shown that at $x\to0$ the obtained expansions can be successfully used to calculate the probability density and distribution function of strictly stable laws.


title: Generalized Bayes Approach to Inverse Problems with Model Misspecification

abstract: We propose a general framework for obtaining probabilistic solutions to PDE-based inverse problems. Bayesian methods are attractive for uncertainty quantification but assume knowledge of the likelihood model or data generation process. This assumption is difficult to justify in many inverse problems, where the specification of the data generation process is not obvious. We adopt a Gibbs posterior framework that directly posits a regularized variational problem on the space of probability distributions of the parameter. We propose a novel model comparison framework that evaluates the optimality of a given loss based on its "predictive performance". We provide cross-validation procedures to calibrate the regularization parameter of the variational objective and compare multiple loss functions. Some novel theoretical properties of Gibbs posteriors are also presented. We illustrate the utility of our framework via a simulated example, motivated by dispersion-based wave models used to characterize arterial vessels in ultrasound vibrometry.


title: Extending the Sunspot Area Series from Kodaikanal Solar Observatory

abstract: Kodaikanal Solar Observatory (KoSO) possesses one of world's longest and homogeneous records of sunspot observations that span more than a century (1904-2017). Interestingly, these observations (originally recorded in photographic plates/films) were taken with the same setup over this entire time period which makes this data unique and best suitable for long-term solar variability studies. A large part of this data, between 1921-2011, were digitized earlier and a catalog containing the detected sunspot parameters (e.g., area and location) was published in Mandal et al.(2017). In this article, we extend the earlier catalog by including new sets of data between 1904-1921 and 2011-2017. To this end, we digitize and calibrate these new datasets which include resolving the issue of random image orientation. We fix this by comparing the KoSO images with co-temporal data from Royal Greenwich Observatory. Following that, a semi-automated sunspot detection and automated umbra detection algorithm are implemented onto these calibrated images to detect sunspots and umbra. Additionally, during this catalog updation, we also filled data gaps in the existing KoSO sunspot catalog (1921-2011) by virtue of re-calibrating the 'rouge' plates. This updated sunspot area series covering nearly 115 years (1904-2017) are being made available to the community and will be a unique source to study the long term variability of the Sun


title: Imaginary time evolution with quantum nondemolition measurements: multi-qubit interactions via measurement nonlinearities

abstract: We show that quantum nondemolition (QND) measurements can be used to realize measurement-based imaginary time evolution. In our proposed scheme, repeated weak QND measurements are used to estimate the energy of a given Hamiltonian. Based on this estimated energy, adaptive unitary operations are applied such that only the targeted energy eigenstates are fixed points of the evolution. In this way, the system is deterministically driven towards the desired state. The nonlinear nature of the QND measurement, which allows for producing interactions between systems, is explicitly derived in terms of measurement operators. We show that for suitable interaction times, single qubit QND Hamiltonians can be converted to effective multi-qubit imaginary time operations. We illustrate our techniques with the example of preparing a four qubit cluster state, which is prepared using only collective single qubit QND measurements and single qubit adaptive operations.


title: Scene Text Image Super-Resolution via Content Perceptual Loss and Criss-Cross Transformer Blocks

abstract: Text image super-resolution is a unique and important task to enhance readability of text images to humans. It is widely used as pre-processing in scene text recognition. However, due to the complex degradation in natural scenes, recovering high-resolution texts from the low-resolution inputs is ambiguous and challenging. Existing methods mainly leverage deep neural networks trained with pixel-wise losses designed for natural image reconstruction, which ignore the unique character characteristics of texts. A few works proposed content-based losses. However, they only focus on text recognizers' accuracy, while the reconstructed images may still be ambiguous to humans. Further, they often have weak generalizability to handle cross languages. To this end, we present TATSR, a Text-Aware Text Super-Resolution framework, which effectively learns the unique text characteristics using Criss-Cross Transformer Blocks (CCTBs) and a novel Content Perceptual (CP) Loss. The CCTB extracts vertical and horizontal content information from text images by two orthogonal transformers, respectively. The CP Loss supervises the text reconstruction with content semantics by multi-scale text recognition features, which effectively incorporates content awareness into the framework. Extensive experiments on various language datasets demonstrate that TATSR outperforms state-of-the-art methods in terms of both recognition accuracy and human perception.


title: Propagation of anisotropic Gelfand-Shilov wave front sets

abstract: We show a result on propagation of the anisotropic Gelfand--Shilov wave front set for linear operators with Schwartz kernel which is a Gelfand--Shilov ultradistribution of Beurling type. This anisotropic wave front set is parametrized by two positive parameters relating the space and frequency variables. The anisotropic Gelfand--Shilov wave front set of the Schwartz kernel of the operator is assumed to satisfy a graph type criterion. The result is applied to a class of evolution equations that generalizes the Schr\"odinger equation for the free particle. The Laplacian is replaced by a partial differential operator defined by a symbol which is a polynomial with real coefficients and order at least two.


title: Delta-Closure Structure for Studying Data Distribution

abstract: In this paper, we revisit pattern mining and study the distribution underlying a binary dataset thanks to the closure structure which is based on passkeys, i.e., minimum generators in equivalence classes robust to noise. We introduce $\Delta$-closedness, a generalization of the closure operator, where $\Delta$ measures how a closed set differs from its upper neighbors in the partial order induced by closure. A $\Delta$-class of equivalence includes minimum and maximum elements and allows us to characterize the distribution underlying the data. Moreover, the set of $\Delta$-classes of equivalence can be partitioned into the so-called $\Delta$-closure structure. In particular, a $\Delta$-class of equivalence with a high level demonstrates correlations among many attributes, which are supported by more observations when $\Delta$ is large. In the experiments, we study the $\Delta$-closure structure of several real-world datasets and show that this structure is very stable for large $\Delta$ and does not substantially depend on the data sampling used for the analysis.


title: Prediction can be safely used as a proxy for explanation in causally consistent Bayesian generalized linear models

abstract: Bayesian modeling provides a principled approach to quantifying uncertainty in model parameters and model structure and has seen a surge of applications in recent years. Within the context of a Bayesian workflow, we are concerned with model selection for the purpose of finding models that best explain the data, that is, help us understand the underlying data generating process. Since we rarely have access to the true process, all we are left with during real-world analyses is incomplete causal knowledge from sources outside of the current data and model predictions of said data. This leads to the important question of when the use of prediction as a proxy for explanation for the purpose of model selection is valid. We approach this question by means of large-scale simulations of Bayesian generalized linear models where we investigate various causal and statistical misspecifications. Our results indicate that the use of prediction as proxy for explanation is valid and safe only when the models under consideration are sufficiently consistent with the underlying causal structure of the true data generating process.


title: Sentence Ambiguity, Grammaticality and Complexity Probes

abstract: It is unclear whether, how and where large pre-trained language models capture subtle linguistic traits like ambiguity, grammaticality and sentence complexity. We present results of automatic classification of these traits and compare their viability and patterns across representation types. We demonstrate that template-based datasets with surface-level artifacts should not be used for probing, careful comparisons with baselines should be done and that t-SNE plots should not be used to determine the presence of a feature among dense vectors representations. We also show how features might be highly localized in the layers for these models and get lost in the upper layers.


title: On the Explainability of Natural Language Processing Deep Models

abstract: While there has been a recent explosion of work on ExplainableAI ExAI on deep models that operate on imagery and tabular data, textual datasets present new challenges to the ExAI community. Such challenges can be attributed to the lack of input structure in textual data, the use of word embeddings that add to the opacity of the models and the difficulty of the visualization of the inner workings of deep models when they are trained on textual data. Lately, methods have been developed to address the aforementioned challenges and present satisfactory explanations on Natural Language Processing (NLP) models. However, such methods are yet to be studied in a comprehensive framework where common challenges are properly stated and rigorous evaluation practices and metrics are proposed. Motivated to democratize ExAI methods in the NLP field, we present in this work a survey that studies model-agnostic as well as model-specific explainability methods on NLP models. Such methods can either develop inherently interpretable NLP models or operate on pre-trained models in a post-hoc manner. We make this distinction and we further decompose the methods into three categories according to what they explain: (1) word embeddings (input-level), (2) inner workings of NLP models (processing-level) and (3) models' decisions (output-level). We also detail the different evaluation approaches interpretability methods in the NLP field. Finally, we present a case-study on the well-known neural machine translation in an appendix and we propose promising future research directions for ExAI in the NLP field.


title: Identification of exciton complexes in a charge-tuneable Janus WSeS monolayer

abstract: Janus transition-metal dichalcogenide monolayers are fully artificial materials, where one plane of chalcogen atoms is replaced by chalcogen atoms of a different type. Theory predicts an in-built out-of-plane electric field, giving rise to long-lived, dipolar excitons, while preserving direct-bandgap optical transitions in a uniform potential landscape. Previous Janus studies had broad photoluminescence (>15 meV) spectra obfuscating their excitonic origin. Here, we identify the neutral, and negatively charged inter- and intravalley exciton transitions in Janus WSeS monolayer with $\sim 6$ meV optical linewidth. We combine a recently developed synthesis technique, with the integration of Janus monolayers into vertical heterostructures, allowing doping control. Further, magneto-optic measurements indicate that monolayer WSeS has a direct bandgap at the K points. This work provides the foundation for applications such as nanoscale sensing, which relies on resolving excitonic energy shifts, and photo-voltaic energy harvesting, which requires efficient creation of long-lived excitons and integration into vertical heterostructures.


title: Masonry elements strengthened through Textile-Reinforced Mortar: application of detailed level modelling with a free open-source Finite-Element code

abstract: The paper concerns the modelling of masonry elements strengthened through Textile Reinforced Mortar (TRM), a near surface system made of fiber-based grids or textiles embedded in mortar layers. Recently, the author, focusing on the mechanical characterization of TRM composites, developed a detailed level modelling approach by using the free, open-source Finite-Element code OOFEM, for the simulation of experimental tests on TRM coupons (pull-out tests, tensile tests, shear bond tests and in-plane shear tests). The model was capable to account for the failure of single components (e.g. the fibers tensile failure, the mortar cracking and crushing), as well as of their interactions (the debonding of the fibers from the mortar and of the mortar from the masonry substrate). In this paper, the detailed-level modelling approach is applied to the simulation of TRM strengthened masonry elements subjected to diagonal compression, in-plane and out-of-plane bending tests, investigating on the typical failure modes of masonry. Non-linear static analyses are performed, with nonlinearities of materials and interfaces deduced from experimental evidences. The comparison with some experimental results and a parametric study allowed to evidence the reliability of the models and their sensitivity to the main components characteristics.


title: NoMorelization: Building Normalizer-Free Models from a Sample's Perspective

abstract: The normalizing layer has become one of the basic configurations of deep learning models, but it still suffers from computational inefficiency, interpretability difficulties, and low generality. After gaining a deeper understanding of the recent normalization and normalizer-free research works from a sample's perspective, we reveal the fact that the problem lies in the sampling noise and the inappropriate prior assumption. In this paper, we propose a simple and effective alternative to normalization, which is called "NoMorelization". NoMorelization is composed of two trainable scalars and a zero-centered noise injector. Experimental results demonstrate that NoMorelization is a general component for deep learning and is suitable for different model paradigms (e.g., convolution-based and attention-based models) to tackle different tasks (e.g., discriminative and generative tasks). Compared with existing mainstream normalizers (e.g., BN, LN, and IN) and state-of-the-art normalizer-free methods, NoMorelization shows the best speed-accuracy trade-off.


title: The wave equation with specular derivatives

abstract: In this paper, we construct the transport equation and the wave equation with specular derivatives and solve these equations in one-dimension. To solve these equations, we introduce new function spaces, which we term specular spaces, consisting of certain specularly differentiable functions.