title: A Cough-based deep learning framework for detecting COVID-19

abstract: This paper presents a deep learning framework for detecting COVID-19 positive subjects from their cough sounds. In particular, the proposed approach comprises two main steps. In the first step, we generate a feature representing the cough sound by combining an embedding extracted from a pre-trained model and handcrafted features extracted from draw audio recording, referred to as the front-end feature extraction. Then, the combined features are fed into different back-end classification models for detecting COVID-19 positive subjects in the second step. Our experiments on the Track-2 dataset of the Second 2021 DiCOVA Challenge achieved the second top ranking with an AUC score of 81.21 and the top F1 score of 53.21 on a Blind Test set, improving the challenge baseline by 8.43% and 23.4% respectively and showing deployability, robustness and competitiveness with the state-of-the-art systems.


title: Layer-wise Pruning of Transformer Attention Heads for Efficient Language Modeling

abstract: While Transformer-based models have shown impressive language modeling performance, the large computation cost is often prohibitive for practical use. Attention head pruning, which removes unnecessary attention heads in the multihead attention, is a promising technique to solve this problem. However, it does not evenly reduce the overall load because the heavy feedforward module is not affected by head pruning. In this paper, we apply layer-wise attention head pruning on All-attention Transformer so that the entire computation and the number of parameters can be reduced proportionally to the number of pruned heads. While the architecture has the potential to fully utilize head pruning, we propose three training methods that are especially helpful to minimize performance degradation and stabilize the pruning process. Our pruned model shows consistently lower perplexity within a comparable parameter size than Transformer-XL on WikiText-103 language modeling benchmark.


abstract: Hypothesis of Riemann is rejected by definition, because {\zeta}(s), where s zeros of {\zeta}(s)=0, is not be equal by definition to the particular sum, which it assumes to be equal. R(s) = 1/2 holds only for the zeros of {\zeta}(s) = 0 and for the zeros of certain related functions. However, it does not hold for certain special generalized functions of {\zeta}(), such the Zeta Hurwitz functions and their sums.


title: Palindromic linearization and numerical solution of nonsymmetric algebraic T-Riccati equations

abstract: We identify a relationship between the solutions of a nonsymmetric algebraic T-Riccati equation (T-NARE) and the deflating subspaces of a palindromic matrix pencil, obtained by arranging the coefficients of the T-NARE. The interplay between T-NARE and palindromic pencils allows one to derive both theoretical properties of the solutions of the equation, and new methods for its numerical solution. In particular, we propose methods based on the (palindromic) QZ algorithm and the doubling algorithm, whose effectiveness is demonstrated by several numerical tests


title: X-ray luminosity function of accreting neutron stars and black holes

abstract: We model X-ray luminosity functions (XLF) of accreting neutron stars and black holes in $10^{35} \leq L_X \leq 10^{41}$ erg/s range in star-forming galaxies and galaxies with the initial star formation burst. XLFs are obtained by combining a fast generation of compact object+normal star population using the binary population synthesis code BSE and calculation of the subsequent detailed binary evolution by the MESA code. XLFs in the galaxies of both types is broadly reproduced using the standard assumptions of the binary star evolution.


title: Stochastic Homogenization on Irregularly Perforated Domains

abstract: We study stochastic homogenization of a quasilinear parabolic PDE with nonlinear microscopic Robin conditions on a perforated domain. The focus of our work lies on the underlying geometry that does not allow standard homogenization techniques to be applied directly. Instead we prove homogenization on a regularized geometry and demonstrate afterwards that the form of the homogenized equation is independent from the regularization. Then we pass to the regularization limit to obtain the anticipated limit equation. Furthermore, we show that Boolean models of Poisson point processes are covered by our approach.


title: Radio-frequency C-V measurements with sub-attofarad sensitivity

abstract: We demonstrate the use of radio-frequency (rf) resonators to measure the capacitance of nano-scale semiconducting devices in field-effect transistor configurations. The rf resonator is attached to the gate or the lead of the device. Consequently, tuning the carrier density in the conducting channel of the device affects the resonance frequency, quantitatively reflecting its capacitance. We test the measurement method on InSb and InAs nanowires at dilution-refrigerator temperatures. The measured capacitances are consistent with those inferred from the periodicity of the Coulomb blockade of quantum dots realized in the same devices. In an implementation of the resonator using an off-chip superconducting spiral inductor we find sensitivity values reaching down to 75~zF/$\sqHz$ at 1~kHz measurement bandwidth, and noise down to 0.45~aF at 1~Hz bandwidth. We estimate the sensitivity of the method for a number of other implementations. In particular we predict typical sensitivity of about 40~zF/$\sqHz$ at room temperature with a resonator comprised of off-the-shelf components. Of several proposed applications, we demonstrate two: the capacitance measurement of several identical 80~nm-wide gates with a single resonator, and the field-effect mobility measurement of an individual nanowire with the gate capacitance measured in-situ.


title: Type $A$ DAHA and Doubly Periodic Tableaux

abstract: Analogously to the construction of Suzuki and Vazirani, we construct representations of the $GL_m$-type Double Affine Hecke Algebra at roots of unity. These representations are graded and the weight spaces for the $X$-variables are parametrized by the combinatorial objects we call doubly periodic tableaux. We show that our representations exhaust all graded $X$-semisimple representations, and the direct sum of all our representations is faithful. Analogously to the construction of Jordan and Vazirani of rectangular DAHA representations, we show that our representations can be interpreted in terms of ribbon fusion categories associated to $U_q(\mathfrak{gl}_N)$ at roots of unity. Combining the ribbon structure with faithfulness we deduce a conjecture of Morton and Samuelson about realization of DAHA as a skein algebra of the torus with base string modulo certain local relations.


title: Influence of plasmon resonances and symmetry effects on second harmonic generation in WS2-plasmonic hybrid metasurfaces

abstract: The nonlinear process of second harmonic generation (SHG) in monolayer (1L) transition metal dichalcogenides (TMD), like $WS_2$, strongly depends on the polarization state of the excitation light. Combining plasmonic nanostructures with $1L-WS_2$ by transferring it onto a plasmonic nanoantenna array, a hybrid metasurface is realized impacting the polarization dependency of its SHG. Here, we investigate how plasmonic dipole resonances affect the process of SHG in plasmonic-TMD hybrid metasurfaces by nonlinear spectroscopy. We show, that the polarization dependency is affected by the lattice structure of plasmonic nanoantenna arrays as well as by the relative orientation between the $1L-WS_2$ and the individual plasmonic nanoantennas. In addition, such hybrid metasurfaces show SHG in polarization states, where SHG is usually forbidden for either $1L-WS_2$ or plasmonic nanoantennas. By comparing the SHG in these channels with the SHG generated by the hybrid metasurface components, we detect an enhancement of the SHG signal by a factor of more than 40. Meanwhile, an attenuation of the SHG signal in usually allowed polarization states is observed. Our study provides valuable insight into hybrid systems where symmetries strongly affecting the SHG and open up the possibility for tailoring the SHG in $1L-WS_2$ for future applications.


title: An Uncertainty-aware Loss Function for Training Neural Networks with Calibrated Predictions

abstract: Uncertainty quantification of machine learning and deep learning methods plays an important role in enhancing trust to the obtained result. In recent years, a numerous number of uncertainty quantification methods have been introduced. Monte Carlo dropout (MC-Dropout) is one of the most well-known techniques to quantify uncertainty in deep learning methods. In this study, we propose two new loss functions by combining cross entropy with Expected Calibration Error (ECE) and Predictive Entropy (PE). The obtained results clearly show that the new proposed loss functions lead to having a calibrated MC-Dropout method. Our results confirmed the great impact of the new hybrid loss functions for minimising the overlap between the distributions of uncertainty estimates for correct and incorrect predictions without sacrificing the model's overall performance.


title: Numerical Simulations of Convective 3-Dimensional Red Supergiant Envelopes

abstract: We explore the three-dimensional properties of convective, luminous ($L\approx10^{4.5}-10^{5}L_\odot$), Hydrogen-rich envelopes of Red Supergiants (RSGs) based on radiation hydrodynamic simulations in spherical geometry using $\texttt{Athena++}$. These computations comprise $\approx30\%$ of the stellar volume, include gas and radiation pressure, and self-consistently track the gravitational potential for the outer $\approx 3M_\odot$ of the simulated $M\approx15M_\odot$ stars. This work reveals a radius, $R_\mathrm{corr}$, around which the nature of the convection changes. For $r>R_\mathrm{corr}$, though still optically thick, diffusion of photons dominates the energy transport. Such a regime is well-studied in less luminous stars, but in RSGs, the near- (or above-) Eddington luminosity (due to opacity enhancements at ionization transitions) leads to the unusual outcome of denser regions moving outwards rather than inward. This region of the star also has a large amount of turbulent pressure, yielding a density structure much more extended than 1D stellar evolution predicts. This "halo" of material will impact predictions for both shock breakout and early lightcurves of Type II-P supernovae. Inside of $R_\mathrm{corr}$, we find a nearly flat entropy profile as expected in the efficient regime of mixing-length-theory (MLT). Radiation pressure provides $\approx1/3$ of the support against gravity in this region. Our comparisons to MLT suggest a mixing length of $\alpha=3-4$, consistent with the sizes of convective plumes seen in the simulations. The temporal variability of these 3D models is mostly on the timescale of the convective plume lifetimes ($\approx300$ days), with amplitudes consistent with those observed photometrically.


title: Situated Dialogue Learning through Procedural Environment Generation

abstract: We teach goal-driven agents to interactively act and speak in situated environments by training on generated curriculums. Our agents operate in LIGHT (Urbanek et al. 2019) -- a large-scale crowd-sourced fantasy text adventure game wherein an agent perceives and interacts with the world through textual natural language. Goals in this environment take the form of character-based quests, consisting of personas and motivations. We augment LIGHT by learning to procedurally generate additional novel textual worlds and quests to create a curriculum of steadily increasing difficulty for training agents to achieve such goals. In particular, we measure curriculum difficulty in terms of the rarity of the quest in the original training distribution -- an easier environment is one that is more likely to have been found in the unaugmented dataset. An ablation study shows that this method of learning from the tail of a distribution results in significantly higher generalization abilities as measured by zero-shot performance on never-before-seen quests.


title: Lie algebra for rotational subsystems of a driven asymmetric top

abstract: We present an analytical approach to construct the Lie algebra of finite-dimensional subsystems of the driven asymmetric top rotor. Each rotational level is degenerate due to the isotropy of space, and the degeneracy increases with rotational excitation. For a given rotational excitation, we determine the nested commutators between drift and drive Hamiltonians using a graph representation. We then generate the Lie algebra for subsystems with arbitrary rotational excitation using an inductive argument.


title: RNA Number of Some Parity Signed Generalized Petersen Graphs

abstract: A signed graph $\Sigma=(G,\sigma)$ is said to be parity signed if there exists a bijection $f : V(G) \rightarrow \{1,2,...,|V(G)|\}$ such that $\sigma(uv)=+$ if and only if $f(u)$ and $f(v)$ are of same parity, where $uv$ is an edge of $G$. The rna number of a graph $G$, denoted $\sigma^{-}(G)$, is the minimum number of negative edges among all possible parity signed graphs over $G$. The rna number is also equal to the minimum cut size that has nearly equal sides. In this paper, for generalized Petersen graph $P(n,k)$, we prove that $3 \leq \sigma^{-}(P(n,k)) \leq n$ and these bounds are sharp. The exact value of $\sigma^{-}(P(n,k))$ is determined for $k=1,2$. Some famous generalized Petersen graphs namely, Petersen graph $P(5,2)$, Durer graph $P(6,2)$, Mobius-Kantor graph $P(8,3)$, Dodecahedron $P(10,2)$, Desargues graph $P(10,3)$ and Nauru graph $P(12,5)$ are also treated. We show that the minimum order of a $(4n-1)$-regular graph having rna number one is bounded above by $12n-2$. The sharpness of this upper bound is also shown for $n=1$. We also show that the minimum order of a $(4n+1)$-regular graph having rna number one is $8n+6$. Finally, for any simple connected graph of order $n$, we propose an $O(2^n + n^{\lfloor \frac{n}{2} \rfloor})$ time algorithm for computing its rna number.


title: Optical secret sharing with cascaded metasurface holography

abstract: Secret sharing is a well-established cryptographic primitive for storing highly sensitive information like encryption keys for encoded data. It describes the problem of splitting a secret into different shares, without revealing any information about the secret to its shareholders. Here, we demonstrate an all-optical solution for secret sharing based on metasurface holography. In our concept, metasurface holograms are used as spatially separable shares that carry an encrypted message in form of a holographic image. Two of these shares can be recombined by bringing them close together. Light passing through this stack of metasurfaces accumulates the phase shift of both holograms and can optically reconstruct the secret with high fidelity. On the other hand, the holograms generated by the single metasurfaces can be used for identifying each shareholder. Furthermore, we demonstrate that the inherent translational alignment sensitivity between the two stacked metasurface holograms can be used for spatial multiplexing, which can be further extended to realize optical rulers.


title: Lagrangian Neural Network with Differentiable Symmetries and Relational Inductive Bias

abstract: Realistic models of physical world rely on differentiable symmetries that, in turn, correspond to conservation laws. Recent works on Lagrangian and Hamiltonian neural networks show that the underlying symmetries of a system can be easily learned by a neural network when provided with an appropriate inductive bias. However, these models still suffer from issues such as inability to generalize to arbitrary system sizes, poor interpretability, and most importantly, inability to learn translational and rotational symmetries, which lead to the conservation laws of linear and angular momentum, respectively. Here, we present a momentum conserving Lagrangian neural network (MCLNN) that learns the Lagrangian of a system, while also preserving the translational and rotational symmetries. We test our approach on linear and non-linear spring systems, and a gravitational system, demonstrating the energy and momentum conservation. We also show that the model developed can generalize to systems of any arbitrary size. Finally, we discuss the interpretability of the MCLNN, which directly provides physical insights into the interactions of multi-particle systems.


title: Propagating State Uncertainty Through Trajectory Forecasting

abstract: Uncertainty pervades through the modern robotic autonomy stack, with nearly every component (e.g., sensors, detection, classification, tracking, behavior prediction) producing continuous or discrete probabilistic distributions. Trajectory forecasting, in particular, is surrounded by uncertainty as its inputs are produced by (noisy) upstream perception and its outputs are predictions that are often probabilistic for use in downstream planning. However, most trajectory forecasting methods do not account for upstream uncertainty, instead taking only the most-likely values. As a result, perceptual uncertainties are not propagated through forecasting and predictions are frequently overconfident. To address this, we present a novel method for incorporating perceptual state uncertainty in trajectory forecasting, a key component of which is a new statistical distance-based loss function which encourages predicting uncertainties that better match upstream perception. We evaluate our approach both in illustrative simulations and on large-scale, real-world data, demonstrating its efficacy in propagating perceptual state uncertainty through prediction and producing more calibrated predictions.


title: H-integral and Gaussian integral normal mixed Cayley graphs

abstract: If all the eigenvalues of the Hermitian-adjacency matrix of a mixed graph are integers, then the mixed graph is called \emph{H-integral}. If all the eigenvalues of the (0,1)-adjacency matrix of a mixed graph are \emph{Gaussian integers}, then the mixed graph is called \emph{Gaussian integral}. For any finite group $\Gamma$, we characterize the set $S$ for which the normal mixed Cayley graph $\text{Cay}(\Gamma, S)$ is H-integral. We further prove that a normal mixed Cayley graph is H-integral if and only if it is Gaussian integral.


title: Multi-tasking Dialogue Comprehension with Discourse Parsing

abstract: Multi-party dialogue machine reading comprehension (MRC) raises an even more challenging understanding goal on dialogue with more than two involved speakers, compared with the traditional plain passage style MRC. To accurately perform the question-answering (QA) task according to such multi-party dialogue, models have to handle fundamentally different discourse relationships from common non-dialogue plain text, where discourse relations are supposed to connect two far apart utterances in a linguistics-motivated way.To further explore the role of such unusual discourse structure on the correlated QA task in terms of MRC, we propose the first multi-task model for jointly performing QA and discourse parsing (DP) on the multi-party dialogue MRC task. Our proposed model is evaluated on the latest benchmark Molweni, whose results indicate that training with complementary tasks indeed benefits not only QA task, but also DP task itself. We further find that the joint model is distinctly stronger when handling longer dialogues which again verifies the necessity of DP in the related MRC.


title: Injecting Planning-Awareness into Prediction and Detection Evaluation

abstract: Detecting other agents and forecasting their behavior is an integral part of the modern robotic autonomy stack, especially in safety-critical scenarios entailing human-robot interaction such as autonomous driving. Due to the importance of these components, there has been a significant amount of interest and research in perception and trajectory forecasting, resulting in a wide variety of approaches. Common to most works, however, is the use of the same few accuracy-based evaluation metrics, e.g., intersection-over-union, displacement error, log-likelihood, etc. While these metrics are informative, they are task-agnostic and outputs that are evaluated as equal can lead to vastly different outcomes in downstream planning and decision making. In this work, we take a step back and critically assess current evaluation metrics, proposing task-aware metrics as a better measure of performance in systems where they are deployed. Experiments on an illustrative simulation as well as real-world autonomous driving data validate that our proposed task-aware metrics are able to account for outcome asymmetry and provide a better estimate of a model's closed-loop performance.


title: Graphene nanoribbons for quantum electronics

abstract: Graphene nanoribbons (GNRs) are a family of one-dimensional (1D) materials carved from graphene lattice. GNRs possess high mobility and current carrying capability, sizable bandgap, and versatile electronic properties tailored by the orientations and open edge structures. These unique properties make GNRs promising candidates for prospective electronics applications including nano-sized field-effect transistors (FETs), spintronic devices, and quantum information processing. To fully exploit the potential of GNRs, fundamental understanding of structure-property relationship, precise control of atomic structures and scalable production are the main challenges. In the last several years, significant progress has been made toward atomically precise bottom-up synthesis of GNRs and heterojunctions that provide an ideal platform for functional molecular devices, as well as successful production of semiconducting GNR arrays on insulating substrates potentially useful for large-scale digital circuits. With further development, GNRs can be envisioned as a competitive candidate material in future quantum information sciences (QIS). In this Perspective, we review recent progress in GNR research and identify key challenges and new directions likely to develop in the near future.


title: A Novel Blind Source Separation Framework Towards Maximum Signal-To-Interference Ratio

abstract: This letter proposes a new blind source separation (BSS) framework termed minimum variance independent component analysis (MVICA), which can potentially achieve the maximum output signal-to-interference ratio (SIR) while also allowing more flexibility in real implementations. The statistical independence assumption has been the foundation of the most dominant BSS techniques in recent decades. However, this assumption does not always hold true and the accurate probabilistic modeling of source is inherently difficult. To overcome these limitations and improve the separation performance, the MVICA framework is rigorously derived by optimizing the design of these independence-based BSS algorithms with the maximum SIR criterion. A deep neural network-supported implementation of MVICA is subsequently described. Experimental results under various conditions show the superiority of MVICA over the state-of-the-art BSS algorithms, in terms of not only SIR but also signal-to-distortion ratio and automatic speech recognition rate.


title: AgFlow: Fast Model Selection of Penalized PCA via Implicit Regularization Effects of Gradient Flow

abstract: Principal component analysis (PCA) has been widely used as an effective technique for feature extraction and dimension reduction. In the High Dimension Low Sample Size (HDLSS) setting, one may prefer modified principal components, with penalized loadings, and automated penalty selection by implementing model selection among these different models with varying penalties. The earlier work [1, 2] has proposed penalized PCA, indicating the feasibility of model selection in $L_2$- penalized PCA through the solution path of Ridge regression, however, it is extremely time-consuming because of the intensive calculation of matrix inverse. In this paper, we propose a fast model selection method for penalized PCA, named Approximated Gradient Flow (AgFlow), which lowers the computation complexity through incorporating the implicit regularization effect introduced by (stochastic) gradient flow [3, 4] and obtains the complete solution path of $L_2$-penalized PCA under varying $L_2$-regularization. We perform extensive experiments on real-world datasets. AgFlow outperforms existing methods (Oja [5], Power [6], and Shamir [7] and the vanilla Ridge estimators) in terms of computation costs.


title: Three Operator Splitting with Subgradients, Stochastic Gradients, and Adaptive Learning Rates

abstract: Three Operator Splitting (TOS) (Davis & Yin, 2017) can minimize the sum of multiple convex functions effectively when an efficient gradient oracle or proximal operator is available for each term. This requirement often fails in machine learning applications: (i) instead of full gradients only stochastic gradients may be available; and (ii) instead of proximal operators, using subgradients to handle complex penalty functions may be more efficient and realistic. Motivated by these concerns, we analyze three potentially valuable extensions of TOS. The first two permit using subgradients and stochastic gradients, and are shown to ensure a $\mathcal{O}(1/\sqrt{t})$ convergence rate. The third extension AdapTOS endows TOS with adaptive step-sizes. For the important setting of optimizing a convex loss over the intersection of convex sets AdapTOS attains universal convergence rates, i.e., the rate adapts to the unknown smoothness degree of the objective. We compare our proposed methods with competing methods on various applications.


title: Doing Data Right: How Lessons Learned Working with Conventional Data should Inform the Future of Synthetic Data for Recommender Systems

abstract: We present a case that the newly emerging field of synthetic data in the area of recommender systems should prioritize `doing data right'. We consider this catchphrase to have two aspects: First, we should not repeat the mistakes of the past, and, second, we should explore the full scope of opportunities presented by synthetic data as we move into the future. We argue that explicit attention to dataset design and description will help to avoid past mistakes with dataset bias and evaluation. In order to fully exploit the opportunities of synthetic data, we point out that researchers can investigate new areas such as using data synthesize to support reproducibility by making data open, as well as FAIR, and to push forward our understanding of data minimization.


title: Inferring Substitutable and Complementary Products with Knowledge-Aware Path Reasoning based on Dynamic Policy Network

abstract: Inferring the substitutable and complementary products for a given product is an essential and fundamental concern for the recommender system. To achieve this, existing approaches take advantage of the knowledge graphs to learn more evidences for inference, whereas they often suffer from invalid reasoning for lack of elegant decision making strategies. Therefore, we propose a novel Knowledge-Aware Path Reasoning (KAPR) model which leverages the dynamic policy network to make explicit reasoning over knowledge graphs, for inferring the substitutable and complementary relationships. Our contributions can be highlighted as three aspects. Firstly, we model this inference scenario as a Markov Decision Process in order to accomplish a knowledge-aware path reasoning over knowledge graphs. Secondly,we integrate both structured and unstructured knowledge to provide adequate evidences for making accurate decision-making. Thirdly, we evaluate our model on a series of real-world datasets, achieving competitive performance compared with state-of-the-art approaches. Our code is released on https://gitee.com/yangzijing flower/kapr/tree/master.


title: Detecting heat leaks with trapped ion qubits

abstract: Recently, the principle of \textit{passivity} has been used to set bounds on the evolution of a microscopic quantum system with a thermal initial state. In this work, we experimentally demonstrate the utility of two passivity based frameworks: global passivity and passivity deformation, for the detection of a "hidden" or unaccounted environment. We employ two trapped-ion qubits undergoing unitary evolution, which may optionally be coupled to an unobserved environment qubit. Evaluating the measurement data from the system qubits, we show that global passivity can verify the presence of a coupling to an unobserved environment - a heat leak - in a case where the second law of thermodynamics fails. We also show that passivity deformation is even more sensitive, detecting a heat leak where global passivity fails.


title: Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object Interaction

abstract: Most existing human matting algorithms tried to separate pure human-only foreground from the background. In this paper, we propose a Virtual Multi-modality Foreground Matting (VMFM) method to learn human-object interactive foreground (human and objects interacted with him or her) from a raw RGB image. The VMFM method requires no additional inputs, e.g. trimap or known background. We reformulate foreground matting as a self-supervised multi-modality problem: factor each input image into estimated depth map, segmentation mask, and interaction heatmap using three auto-encoders. In order to fully utilize the characteristics of each modality, we first train a dual encoder-to-decoder network to estimate the same alpha matte. Then we introduce a self-supervised method: Complementary Learning(CL) to predict deviation probability map and exchange reliable gradients across modalities without label. We conducted extensive experiments to analyze the effectiveness of each modality and the significance of different components in complementary learning. We demonstrate that our model outperforms the state-of-the-art methods.


title: Polynomial Turing Kernels for Clique with an Optimal Number of Queries

abstract: A polynomial Turing kernel for some parameterized problem $P$ is a polynomial-time algorithm that solves $P$ using queries to an oracle of $P$ whose sizes are upper-bounded by some polynomial in the parameter. Here the term "polynomial" refers to the bound on the query sizes, as the running time of any kernel is required to be polynomial. One of the most important open goals in parameterized complexity is to understand the applicability and limitations of polynomial Turing Kernels. As any fixed-parameter tractable problem admits a Turing kernel of some size, the focus has mostly being on determining which problems admit such kernels whose query sizes can be indeed bounded by some polynomial. In this paper we take a different approach, and instead focus on the number of queries that a Turing kernel uses, assuming it is restricted to using only polynomial sized queries. Our study focuses on one the main problems studied in parameterized complexity, the Clique problem: Given a graph $G$ and an integer $k$, determine whether there are $k$ pairwise adjacent vertices in $G$. We show that Clique parameterized by several structural parameters exhibits the following phenomena: - It admits polynomial Turing kernels which use a sublinear number of queries, namely $O(n/\log^c n)$ queries where $n$ is the total size of the graph and $c$ is any constant. This holds even for a very restrictive type of Turing kernels which we call OR-kernels. - It does not admit polynomial Turing kernels which use $O(n^{1-\epsilon})$ queries, unless NP$\subseteq$coNP/poly. For proving the second item above, we develop a new framework for bounding the number of queries needed by polynomial Turing kernels. This framework is inspired by the standard lower bounds framework for Karp kernels, and while it is quite similar, it still requires some novel ideas to allow its extension to the Turing setting.


title: Locally conformal SKT structures

abstract: A Hermitian metric on a complex manifold is called SKT (strong K\"ahler with torsion) if the Bismut torsion $3$-form $H$ is closed. As the conformal generalization of the SKT condition, we introduce a new type of Hermitian structure, called \emph{locally conformal SKT} (or shortly LCSKT). More precisely, a Hermitian structure $(J,g)$ is said to be LCSKT if there exists a closed non-zero $1$-form $\alpha$ such that $d H = \alpha \wedge H$. In the paper we consider non-trivial LCSKT structures, i.e. we assume that $d H \neq 0$ and we study their existence on Lie groups and their compact quotients by lattices. In particular, we classify 6-dimensional nilpotent Lie algebras admitting a LCSKT structure and we show that, in contrast to the SKT case, there exists a $6$-dimensional $3$-step nilpotent Lie algebra admitting a non-trivial LCSKT structure. Moreover, we show a characterization of even dimensional almost abelian Lie algebras admitting a non-trivial LCSKT structure, which allows us to construct explicit examples of $6$-dimensional unimodular almost abelian Lie algebras admitting a non-trivial LCSKT structure. The compatibility between the LCSKT and the balanced condition is also discussed, showing that a Hermitian structure on a 6-dimensional nilpotent or a $2n$-dimensional almost abelian Lie algebra cannot be simultaneously LCSKT and balanced, unless it is K\"{a}hler.


title: Detecting Autism Spectrum Disorders with Machine Learning Models Using Speech Transcripts

abstract: Autism spectrum disorder (ASD) can be defined as a neurodevelopmental disorder that affects how children interact, communicate and socialize with others. This disorder can occur in a broad spectrum of symptoms, with varying effects and severity. While there is no permanent cure for ASD, early detection and proactive treatment can substantially improve the lives of many children. Current methods to accurately diagnose ASD are invasive, time-consuming, and tedious. They can also be subjective perspectives of a number of clinicians involved, including pediatricians, speech pathologists, psychologists, and psychiatrists. New technologies are rapidly emerging that include machine learning models using speech, computer vision from facial, retinal, and brain MRI images of patients to accurately and timely detect this disorder. Our research focuses on computational linguistics and machine learning using speech data from TalkBank, the world's largest spoken language database. We used data of both ASD and Typical Development (TD) in children from TalkBank to develop machine learning models to accurately predict ASD. More than 50 features were used from specifically two datasets in TalkBank to run our experiments using five different classifiers. Logistic Regression and Random Forest models were found to be the most effective for each of these two main datasets, with an accuracy of 0.75. These experiments confirm that while significant opportunities exist for improving the accuracy, machine learning models can reliably predict ASD status in children for effective diagnosis.


title: FilterAugment: An Acoustic Environmental Data Augmentation Method

abstract: Acoustic environments affect acoustic characteristics of sound to be recognized by physically interacting with sound wave propagation. Thus, training acoustic models for audio and speech tasks requires regularization on various acoustic environments in order to achieve robust performance in real life applications. We propose FilterAugment, a data augmentation method for regularization of acoustic models on various acoustic environments. FilterAugment mimics acoustic filters by applying different weights on frequency bands, therefore enables model to extract relevant information from wider frequency region. It is an improved version of frequency masking which masks information on random frequency bands. FilterAugment improved sound event detection (SED) model performance by 6.50% while frequency masking only improved 2.13% in terms of polyphonic sound detection score (PSDS). It achieved equal error rate (EER) of 1.22% when applied to a text-independent speaker verification model, outperforming model used frequency masking with EER of 1.26%. Prototype of FilterAugment was applied in our participation in DCASE 2021 challenge task 4, and played a major role in achieving the 3rd rank.


title: Experimental investigation on STFT phase representations for deep learning-based dysarthric speech detection

abstract: Mainstream deep learning-based dysarthric speech detection approaches typically rely on processing the magnitude spectrum of the short-time Fourier transform of input signals, while ignoring the phase spectrum. Although considerable insight about the structure of a signal can be obtained from the magnitude spectrum, the phase spectrum also contains inherent structures which are not immediately apparent due to phase discontinuity. To reveal meaningful phase structures, alternative phase representations such as the modified group delay (MGD) and instantaneous frequency (IF) spectra have been investigated in several applications. The objective of this paper is to investigate the applicability of the unprocessed phase, MGD, and IF spectra for dysarthric speech detection. Experimental results show that dysarthric cues are present in all considered phase representations. Further, it is shown that using phase representations as complementary features to the magnitude spectrum is beneficial for deep learning-based dysarthric speech detection, with the combination of magnitude and IF spectra yielding a high performance. The presented results should raise awareness in the research community about the potential of the phase spectrum for dysarthric speech detection and motivate research into novel architectures which optimally exploit magnitude and phase information.


title: Investigation of the ground-state spin inversion in the neutron-rich 47,49Cl isotopes

abstract: A first gamma-ray study of 47,49Cl spectroscopy was performed at the Radioactive Isotope Beam Factory with 50Ar projectiles at 217 MeV/nucleon, impinging on the liquid hydrogen target of the MINOS device. Prompt de-excitation gamma-rays were measured with the NaI(Tl) array DALI2+. Through the one-proton knockout reaction 50Ar(p,2p), a spin assignment could be determined for the low-lying states of 49Cl from the momentum distribution obtained with the SAMURAI spectrometer. A spin-parity J = 3/2+ is deduced for the ground state of 49Cl, similar to the recently studied N = 32 isotope 51K.


title: M\"ossbauer measurements of GaFeO$_3$ single crystal multiferroic

abstract: M\"ossbauer measurements on single crystal absorbers at room and at low temperatures were performed. The results are fully consistent with previously published reports by other groups. Spectra of single crystals were simultaneously analyzed including magnetic dipole and electric quadrupole interactions. The analysis shows that there is a small component of magnetic moments perpendicular to the magnetic easy axis. M\"ossbauer data seem not agree with commonly accepted ferrimagnetic structure of GaFeO$_3$.


title: Symmetry and quantitative stability for the parallel surface fractional torsion problem

abstract: We study symmetry and quantitative approximate symmetry for an overdetermined problem involving the fractional torsion problem in a bounded domain $\Omega \subset \mathbb R^n$. More precisely, we prove that if the fractional torsion function has a $C^1$ level surface which is parallel to the boundary $\partial \Omega$ then the domain is a ball. If instead we assume that the solution is close to a constant on a parallel surface to the boundary, then we quantitatively prove that $\Omega$ is close to a ball. Our results use techniques which are peculiar to the nonlocal case as, for instance, quantitative versions of fractional Hopf boundary point lemma and boundary Harnack estimates for antisymmetric functions. We also provide an application to the study of rural-urban fringes in population settlements.


title: Solid solution and precipitation strengthening effects in basal slip, extension twinning and pyramidal slip in Mg-Zn alloys

abstract: A high-throughput methodology is proposed, based on the combination of diffusion couples and advanced nanomechanical testing methods, to directly measure alloying effects on the critical resolved shear stress (CRSS) of individual deformation modes in Mg alloys. The methodology is tested in Mg-Zn alloys by assessing the alloying effects, up to Zn contents of 2 at.%, on basal slip, extension twining and pyramidal slip in two metallurgical condition: as-quenched, for which the Zn solute atoms remain homogenously dispersed in solid solution; and peak-aged, for which the Zn atoms form rod-shape $MgZn_{2}$ precipitates. A combined approach including micromechanical testing, transmission Kikuchi diffraction, and high-resolution transmission electron microscopy was performed to reveal the corresponding deformation mechanisms. It was found that the CRSS enhancement for basal slip and extension twinning by $MgZn_{2}$ precipitates is considerably larger than the effect of Zn in solid solution, while the strengthening of pyramidal slip is similar in both cases. As a result, the anisotropy ratios remain high and similar to pure Mg in the solid solution strengthened Mg-Zn alloys. However, they are substantially reduced in precipitation strengthened Mg-Zn alloys.


title: On the Distribution of large values of $|\zeta(\sigma+{\rm i}t)|$

abstract: We investigate the distribution of large values of the Riemann zeta function $\zeta(s)$ in the strip $1/2<\re s<1$. For any fixed $\re s=\sigma\in(1/2,1)$, we obtain an improved distribution function of large values of $|\zeta(\sigma+\i t)|$, holding in the same range as that given by Lamzouri.


title: Existence Results for double phase problem in Sobolev-Orlicz spaces with variable exponents in Complete Manifold

abstract: In this paper, we study the existence of non-negative non-trivial solutions for a class of double-phase problems where the source term is a Caratheodory function that satisfies the Ambrosetti-Rabinowitz type condition in the framework of Sobolev-Orlicz spaces with variable exponents in complete compact Riemannian n-manifolds. Our approach is based on the Nehari manifold and some variational techniques. Furthermore, the H\"older inequality, continuous and compact embedding results are proved.


title: MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

abstract: As the remarkable development of facial manipulation technologies is accompanied by severe security concerns, face forgery detection has become a recent research hotspot. Most existing detection methods train a binary classifier under global supervision to judge real or fake. However, advanced manipulations only perform small-scale tampering, posing challenges to comprehensively capture subtle and local forgery artifacts, especially in high compression settings and cross-dataset scenarios. To address such limitations, we propose a novel framework named Multi-modal Contrastive Classification by Locally Correlated Representations(MC-LCR), for effective face forgery detection. Instead of specific appearance features, our MC-LCR aims to amplify implicit local discrepancies between authentic and forged faces from both spatial and frequency domains. Specifically, we design the shallow style representation block that measures the pairwise correlation of shallow feature maps, which encodes local style information to extract more discriminative features in the spatial domain. Moreover, we make a key observation that subtle forgery artifacts can be further exposed in the patch-wise phase and amplitude spectrum and exhibit different clues. According to the complementarity of amplitude and phase information, we develop a patch-wise amplitude and phase dual attention module to capture locally correlated inconsistencies with each other in the frequency domain. Besides the above two modules, we further introduce the collaboration of supervised contrastive loss with cross-entropy loss. It helps the network learn more discriminative and generalized representations. Through extensive experiments and comprehensive studies, we achieve state-of-the-art performance and demonstrate the robustness and generalization of our method.


title: Effect of noncircularity on the dynamic behaviors of particles in a disformal rotating black-hole spacetime

abstract: A disformal rotating black-hole solution is a black-hole solution in quadratic degenerate higher-order scalar-tensor theories. It breaks the circular condition of spacetime different from the case of the usual Kerr spacetime. This study investigated the dynamic behaviors of the motion of timelike particles in such disformal black-hole spacetime with an extra deformation parameter. Results showed that the characteristics of the particle's motion depend on the sign of the deformation parameter. For the positive deformation parameter, the motion is regular and orderly. For the negative one, as the deformation parameter changes, the motion of the particles undergoes a series of transitions between the chaotic motion and the regular motion and falls into the horizon or escapes to spatial infinity. This means that the dynamic behavior of timelike particles in the disformal Kerr black-hole spacetime with noncircularity becomes richer than that in the usual Kerr black-hole case.


title: Robotic Lever Manipulation using Hindsight Experience Replay and Shapley Additive Explanations

abstract: This paper deals with robotic lever control using Explainable Deep Reinforcement Learning. First, we train a policy by using the Deep Deterministic Policy Gradient algorithm and the Hindsight Experience Replay technique, where the goal is to control a robotic manipulator to manipulate a lever. This enables us both to use continuous states and actions and to learn with sparse rewards. Being able to learn from sparse rewards is especially desirable for Deep Reinforcement Learning because designing a reward function for complex tasks such as this is challenging. We first train in the PyBullet simulator, which accelerates the training procedure, but is not accurate on this task compared to the real-world environment. After completing the training in PyBullet, we further train in the Gazebo simulator, which runs more slowly than PyBullet, but is more accurate on this task. We then transfer the policy to the real-world environment, where it achieves comparable performance to the simulated environments for most episodes. To explain the decisions of the policy we use the SHAP method to create an explanation model based on the episodes done in the real-world environment. This gives us some results that agree with intuition, and some that do not. We also question whether the independence assumption made when approximating the SHAP values influences the accuracy of these values for a system such as this, where there are some correlations between the states.


title: On the distribution of large values of $|\zeta(1+{\rm i}t)|$

abstract: In this article, we study the distribution of large values of the Riemann zeta function on the 1-line. We obtain an improved density function concerning large values, holding in the same range as that given by Granville and Soundararajan.


title: EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback

abstract: First proposed by Seide (2014) as a heuristic, error feedback (EF) is a very popular mechanism for enforcing convergence of distributed gradient-based optimization methods enhanced with communication compression strategies based on the application of contractive compression operators. However, existing theory of EF relies on very strong assumptions (e.g., bounded gradients), and provides pessimistic convergence rates (e.g., while the best known rate for EF in the smooth nonconvex regime, and when full gradients are compressed, is $O(1/T^{2/3})$, the rate of gradient descent in the same regime is $O(1/T)$). Recently, Richt\'{a}rik et al. (2021) proposed a new error feedback mechanism, EF21, based on the construction of a Markov compressor induced by a contractive compressor. EF21 removes the aforementioned theoretical deficiencies of EF and at the same time works better in practice. In this work we propose six practical extensions of EF21, all supported by strong convergence theory: partial participation, stochastic approximation, variance reduction, proximal setting, momentum and bidirectional compression. Several of these techniques were never analyzed in conjunction with EF before, and in cases where they were (e.g., bidirectional compression), our rates are vastly superior.


title: Carbon cycling and habitability of massive Earth-like exoplanets

abstract: As the number of detected rocky extrasolar planets increases, the question of whether their surfaces could be habitable is becoming more pertinent. On Earth, the long-term carbonate silicate cycle is able to regulate surface temperatures over timescales larger than one million years. Elevated temperatures enhance weathering, removing CO$_2$ from the atmosphere, which is subducted into the mantle. At mid-ocean ridges, CO$_2$ is supplied to the atmosphere from the interior. The carbon degassing flux is controlled by the melting depth beneath mid-ocean ridges and the spreading rate, influenced by the pressure- and temperature-dependent mantle viscosity. The influences of temperature and pressure on mantle degassing become increasingly important for more massive planets. Here, we couple a thermal evolution model of Earth-like planets of different masses with a model of the long-term carbon cycle and assess their surface temperature evolution. We find that the spreading rate at 4.5 Gyr increases with planetary mass up to 3 $M_\oplus$, since the temperature-dependence of viscosity dominates over its pressure-dependency. For higher mass planets, pressure-dependence dominates and the plates slow down. In addition, the effective melting depth at 4.5 Gyr as a function of planetary mass has its maximum at 3 $M_\oplus$. Altogether, at 4.5 Gyr, the degassing rate and therefore surface temperature have their maximum at 3 $M_\oplus$. This work emphasizes that both age and mass should be considered when predicting the habitability of exoplanets. Despite these effects, the long-term carbon cycle remains an effective mechanism that regulates the surface temperature of massive Earth-like planets.


title: Ranking Warnings of Static Analysis Tools Using Representation Learning

abstract: Static analysis tools are frequently used to detect potential vulnerabilities in software systems. However, an inevitable problem of these tools is their large number of warnings with a high false positive rate, which consumes time and effort for investigating. In this paper, we present DeFP, a novel method for ranking static analysis warnings. Based on the intuition that warnings which have similar contexts tend to have similar labels (true positive or false positive), DeFP is built with two BiLSTM models to capture the patterns associated with the contexts of labeled warnings. After that, for a set of new warnings, DeFP can calculate and rank them according to their likelihoods to be true positives (i.e., actual vulnerabilities). Our experimental results on a dataset of 10 real-world projects show that using DeFP, by investigating only 60% of the warnings, developers can find +90% of actual vulnerabilities. Moreover, DeFP improves the state-of-the-art approach 30% in both Precision and Recall.


title: Heat capacity anomaly near magnetic phase transition in GaFeO$_3$

abstract: A heat capacity anomaly in the vicinity of magnetic transition was observed in single crystal GaFeO3 for the first time. The crystals grown along the expected electric polarization direction were characterized by X-ray diffraction, M\"ossbauer and magnetic measurements. Two separate data analyses of heat capacity showed similar results within the experimental accuracy. Critical exponent, {\alpha}=-0.2(1), and amplitude ratios of positive and negative reduced temperatures near the critical point, A_+/A_-=1.2(1), are consistent with behavior of a 3-D Heisenberg ferromagnet.


title: End-to-End Supermask Pruning: Learning to Prune Image Captioning Models

abstract: With the advancement of deep models, research work on image captioning has led to a remarkable gain in raw performance over the last decade, along with increasing model complexity and computational cost. However, surprisingly works on compression of deep networks for image captioning task has received little to no attention. For the first time in image captioning research, we provide an extensive comparison of various unstructured weight pruning methods on three different popular image captioning architectures, namely Soft-Attention, Up-Down and Object Relation Transformer. Following this, we propose a novel end-to-end weight pruning method that performs gradual sparsification based on weight sensitivity to the training loss. The pruning schemes are then extended with encoder pruning, where we show that conducting both decoder pruning and training simultaneously prior to the encoder pruning provides good overall performance. Empirically, we show that an 80% to 95% sparse network (up to 75% reduction in model size) can either match or outperform its dense counterpart. The code and pre-trained models for Up-Down and Object Relation Transformer that are capable of achieving CIDEr scores >120 on the MS-COCO dataset but with only 8.7 MB and 14.5 MB in model size (size reduction of 96% and 94% respectively against dense versions) are publicly available at https://github.com/jiahuei/sparse-image-captioning.


title: End-To-End Label Uncertainty Modeling for Speech-based Arousal Recognition Using Bayesian Neural Networks

abstract: Emotions are subjective constructs. Recent end-to-end speech emotion recognition systems are typically agnostic to the subjective nature of emotions, despite their state-of-the-art performance. In this work, we introduce an end-to-end Bayesian neural network architecture to capture the inherent subjectivity in the arousal dimension of emotional expressions. To the best of our knowledge, this work is the first to use Bayesian neural networks for speech emotion recognition. At training, the network learns a distribution of weights to capture the inherent uncertainty related to subjective arousal annotations. To this end, we introduce a loss term that enables the model to be explicitly trained on a distribution of annotations, rather than training them exclusively on mean or gold-standard labels. We evaluate the proposed approach on the AVEC'16 dataset. Qualitative and quantitative analysis of the results reveals that the proposed model can aptly capture the distribution of subjective arousal annotations, with state-of-the-art results in mean and standard deviation estimations for uncertainty modeling.


title: Permutation Compressors for Provably Faster Distributed Nonconvex Optimization

abstract: We study the MARINA method of Gorbunov et al (2021) -- the current state-of-the-art distributed non-convex optimization method in terms of theoretical communication complexity. Theoretical superiority of this method can be largely attributed to two sources: the use of a carefully engineered biased stochastic gradient estimator, which leads to a reduction in the number of communication rounds, and the reliance on {\em independent} stochastic communication compression operators, which leads to a reduction in the number of transmitted bits within each communication round. In this paper we i) extend the theory of MARINA to support a much wider class of potentially {\em correlated} compressors, extending the reach of the method beyond the classical independent compressors setting, ii) show that a new quantity, for which we coin the name {\em Hessian variance}, allows us to significantly refine the original analysis of MARINA without any additional assumptions, and iii) identify a special class of correlated compressors based on the idea of {\em random permutations}, for which we coin the term Perm$K$, the use of which leads to $O(\sqrt{n})$ (resp. $O(1 + d/\sqrt{n})$) improvement in the theoretical communication complexity of MARINA in the low Hessian variance regime when $d\geq n$ (resp. $d \leq n$), where $n$ is the number of workers and $d$ is the number of parameters describing the model we are learning. We corroborate our theoretical results with carefully engineered synthetic experiments with minimizing the average of nonconvex quadratics, and on autoencoder training with the MNIST dataset.


title: EvadeDroid: A Practical Evasion Attack on Machine Learning for Black-box Android Malware Detection

abstract: Over the last decade, researchers have extensively explored the vulnerabilities of Android malware detectors to adversarial examples through the development of evasion attacks; however, the practicality of these attacks in real-world scenarios remains arguable. The majority of studies have assumed attackers know the details of the target classifiers used for malware detection, while in reality, malicious actors have limited access to the target classifiers. This paper introduces EvadeDroid, a problem-space adversarial attack designed to effectively evade black-box Android malware detectors in real-world scenarios. EvadeDroid constructs a collection of problem-space transformations derived from benign donors that share opcode-level similarity with malware apps by leveraging an n-gram-based approach. These transformations are then used to morph malware instances into benign ones via an iterative and incremental manipulation strategy. The proposed manipulation technique is a query-efficient optimization algorithm that can find and inject optimal sequences of transformations into malware apps. Our empirical evaluations, carried out on 1K malware apps, demonstrate the effectiveness of our approach in generating real-world adversarial examples in both soft- and hard-label settings. Our findings reveal that EvadeDroid can effectively deceive diverse malware detectors that utilize different features with various feature types. Specifically, EvadeDroid achieves evasion rates of 80%-95% against DREBIN, Sec-SVM, ADE-MA, MaMaDroid, and Opcode-SVM with only 1-9 queries. Furthermore, we show that the proposed problem-space adversarial attack is able to preserve its stealthiness against five popular commercial antiviruses with an average of 79% evasion rate, thus demonstrating its feasibility in the real world.


title: MPSN: Motion-aware Pseudo Siamese Network for Indoor Video Head Detection in Buildings

abstract: Head detection in the indoor video is an essential component of building occupancy detection. While deep models have achieved remarkable progress in general object detection, they are not satisfying enough in complex indoor scenes. The indoor surveillance video often includes cluttered background objects, among which heads have small scales and diverse poses. In this paper, we propose Motion-aware Pseudo Siamese Network (MPSN), an end-to-end approach that leverages head motion information to guide the deep model to extract effective head features in indoor scenarios. By taking the pixel-wise difference of adjacent frames as the auxiliary input, MPSN effectively enhances human head motion information and removes the irrelevant objects in the background. Compared with prior methods, it achieves superior performance on the two indoor video datasets. Our experiments show that MPSN successfully suppresses static background objects and highlights the moving instances, especially human heads in indoor videos. We also compare different methods to capture head motion, which demonstrates the simplicity and flexibility of MPSN. To validate the robustness of MPSN, we conduct adversarial experiments with a mathematical solution of small perturbations for robust model selection. Finally, for confirming its potential in building control systems, we apply MPSN to occupancy counting. Code is available at https://github.com/pl-share/MPSN.


title: Universal Approximation Under Constraints is Possible with Transformers

abstract: Many practical problems need the output of a machine learning model to satisfy a set of constraints, $K$. Nevertheless, there is no known guarantee that classical neural network architectures can exactly encode constraints while simultaneously achieving universality. We provide a quantitative constrained universal approximation theorem which guarantees that for any non-convex compact set $K$ and any continuous function $f:\mathbb{R}^n\rightarrow K$, there is a probabilistic transformer $\hat{F}$ whose randomized outputs all lie in $K$ and whose expected output uniformly approximates $f$. Our second main result is a "deep neural version" of Berge's Maximum Theorem (1963). The result guarantees that given an objective function $L$, a constraint set $K$, and a family of soft constraint sets, there is a probabilistic transformer $\hat{F}$ that approximately minimizes $L$ and whose outputs belong to $K$; moreover, $\hat{F}$ approximately satisfies the soft constraints. Our results imply the first universal approximation theorem for classical transformers with exact convex constraint satisfaction. They also yield that a chart-free universal approximation theorem for Riemannian manifold-valued functions subject to suitable geodesically convex constraints.


title: Response of RAW 264.7 and J774A.1 macrophages to particles and nanoparticles of a mesoporous bioactive glass: A comparative study"

abstract: Mesoporous bioactive glasses (MBGs) are bioceramics designed to induce bone tissue regeneration and very useful materials with the ability to act as drug delivery systems. MBGs can be implanted in contact with bone tissue in different ways, as particulate material, in 3D scaffolds or as nanospheres. In this work, we assessed the effects of particles of mesoporous bioactive glass MBG-75S and mesoporous nanospheres NanoMBG-75S on RAW 264.7 and J774A.1 macrophages, which present different sensitivity and are considered as ideal models for the study of innate immune response. After evaluating several cellular parameters (morphology, size, complexity, proliferation, cell cycle and intracellular content of reactive oxygen species), the action of MBG-75S particles and NanoMBG-75S on the polarization of these macrophages towards the proinflammatory (M1) or reparative (M2) phenotype was determined by the expression of specific M1 (CD80) and M2 (CD206, CD163) markers. We previously measured the adsorption of albumin and fibrinogen on MBG-75S particles and the production of proinflammatory cytokines as TNF-{\alpha} and IL-6 by macrophages in response to these particles. This comparative study demonstrates that particles of mesoporous bioactive glass MBG-75S and mesoporous nanospheres NanoMBG-75S allow the appropriated development and function of RAW 264.7 and J774A.1 macrophages and do not induce polarization towards the M1 pro-inflammatory phenotype. Therefore, considering that these mesoporous biomaterials offer the possibility of loading drugs into their pores, the results obtained indicate their high potential for use as drug-delivery systems in bone repair and osteoporosis treatments without triggering an adverse inflammatory response.


title: A spatio-temporal adaptive phase-field fracture method

abstract: We present an energy-preserving mechanic formulation for dynamic quasi-brittle fracture in an Eulerian-Lagrangian formulation, where a second-order phase-field equation controls the damage evolution. The numerical formulation adapts in space and time to bound the errors, solving the mesh-bias issues these models typically suffer. The time-step adaptivity estimates the temporal truncation error of the partial differential equation that governs the solid equilibrium. The second-order generalized-$\alpha$ time-marching scheme evolves the dynamic system. We estimate the temporal error by extrapolating a first-order approximation of the present time-step solution using previous ones with backward difference formulas; the estimate compares the extrapolation with the time-marching solution. We use an adaptive scheme built on a residual minimization formulation in space. We estimate the spatial error by enriching the discretization with elemental bubbles; then, we localize an error indicator norm to guide the mesh refinement as the fracture propagates. The combined space and time adaptivity allows us to use low-order linear elements in problems involving complex stress paths. We efficiently and robustly use low-order spatial discretizations while avoiding mesh bias in structured and unstructured meshes. We demonstrate the method's efficiency with numerical experiments that feature dynamic crack branching, where the capacity of the adaptive space-time scheme is apparent. The adaptive method delivers accurate and reproducible crack paths on meshes with fewer elements.


title: Scintillation characteristics of a NaI(Tl) crystal at low-temperature with silicon photomultiplier

abstract: Scintillation characteristics of a thallium doped sodium iodide (NaI(Tl)) crystal with a dimension of 0.6 x 0.6 x 2 cm3 are studied by attaching a silicon photomultiplier (SiPM) direct to the crystal over a temperature range from 93 to 300 K. The scintillation light output and decay time are measured by irradiating 59.54 keV gamma-rays from a 241Am source. We observed approximately 20% increase in light yield at 230K compared to that at the room temperature. At this condition, the NaI(Tl) crystal coupled with the SiPM can be a good candidate for future dark matter search detector.


title: Subtrees and BC-subtrees of maximum degree no more than k in trees

abstract: The subtrees and BC-subtrees (subtrees where any two leaves are at even distance apart) have been extensively studied in recent years. Such structures, under special constraints on degrees, have applications in many fields. Through an approach based on generating functions, we present recursive algorithms for enumerating various subtrees and BC-subtrees of maximum degree $\leq k$ in trees. The algorithms are illustrated through detailed examples. We also briefly discuss, in trees, the densities of subtrees (resp.~BC-subtrees) of maximum degree $\leq k(\geq 2)$ among all subtrees (resp.~BC-subtrees).


title: Improving Detection of Gravitational wave Microlensing Using Repeated Signals Induced by Strong Lensing

abstract: Microlensing imprints by typical stellar mass lenses on gravitational waves are challenging to identify in the LIGO and Virgo frequency band because such effects are weak. However, stellar mass lenses are generally embedded in lens galaxies such that strong lensing accompanies microlensing. Therefore, events that are strongly lensed in addition to being microlensed may significantly improve the inference of the latter. We present a proof of principle demonstration of how one can use parameter estimation results from one strongly lensed signal to enhance the inference of the microlensing effects of the other signal with the Bayesian inference method currently used in gravitational wave astronomy. We expect this to significantly enhance our future ability to detect the weak imprints from stellar mass objects on gravitational-wave signals from colliding compact objects.


title: Explaining deep learning models for spoofing and deepfake detection with SHapley Additive exPlanations

abstract: Substantial progress in spoofing and deepfake detection has been made in recent years. Nonetheless, the community has yet to make notable inroads in providing an explanation for how a classifier produces its output. The dominance of black box spoofing detection solutions is at further odds with the drive toward trustworthy, explainable artificial intelligence. This paper describes our use of SHapley Additive exPlanations (SHAP) to gain new insights in spoofing detection. We demonstrate use of the tool in revealing unexpected classifier behaviour, the artefacts that contribute most to classifier outputs and differences in the behaviour of competing spoofing detection models. The tool is both efficient and flexible, being readily applicable to a host of different architecture models in addition to related, different applications. All results reported in the paper are reproducible using open-source software.


title: Solving the Dirichlet problem for the Monge-Amp\`ere equation using neural networks

abstract: The Monge-Amp\`ere equation is a fully nonlinear partial differential equation (PDE) of fundamental importance in analysis, geometry and in the applied sciences. In this paper we solve the Dirichlet problem associated with the Monge-Amp\`ere equation using neural networks and we show that an ansatz using deep input convex neural networks can be used to find the unique convex solution. As part of our analysis we study the effect of singularities, discontinuities and noise in the source function, we consider nontrivial domains, and we investigate how the method performs in higher dimensions. We investigate the convergence numerically and present error estimates based on a stability result. We also compare this method to an alternative approach in which standard feed-forward networks are used together with a loss function which penalizes lack of convexity.


title: GeoChemFoam: Direct Modelling of flow and heat transfer in micro-CT images of porous media

abstract: GeoChemFoam is an open-source OpenFOAM-based numerical modelling toolbox that includes a range of custom packages to solve complex flow processes including multiphase transport with interface transfer, single-phase flow in multiscale porous media, and reactive transport with mineral dissolution. In this paper, we present GeoChemFoam's novel numerical model for simulation of conjugate heat transfer in micro-CT images of porous media. GeoChemFoam uses the micro-continuum approach to describe the fluid-solid interface using the volume fraction of fluid and solid in each computational cell. The velocity field is solved using Brinkman's equation with permeability calculated using the Kozeny-Carman equation which results in a near-zero permeability in the solid phase. Conjugate heat transfer is then solved with heat convection where the velocity is non-zero, and the thermal conductivity is calculated as the harmonic average of phase conductivity weighted by the phase volume fraction. Our model is validated by comparison with the standard two-medium approach for a simple 2D geometry. We then simulate conjugate heat transfer and calculate heat transfer coefficients for different flow regimes and injected fluid analogous to injection into a geothermal reservoir in a micro-CT image of Bentheimer sandstone and perform a sensitivity analysis in a porous heat exchanger with a random sphere packing.


title: Imaginary powers of $(k,1)$-generalized harmonic oscillator

abstract: In this paper we will define and investigate the imaginary powers $\left(-\triangle_{k,1}\right)^{-i\sigma},\sigma\in\mathbb{R}$ of the $(k,1)$-generalized harmonic oscillator $-\triangle_{k,1}=-\left\|x\right\|\triangle_k+\left\|x\right\|$ and prove the $L^p$-boundedness $(1<p<\infty)$ and weak $L^1$-boundedness of such operators. It is a parallel result to the $L^p$-boundedness $(1<p<\infty)$ and weak $L^1$-boundedness of the imaginary powers of the Dunkl harmonic oscillator $-\triangle_k+\left\|x\right\|^2$. To prove this result, we develop the Calder\'on--Zygmund theory adapted to the $(k,1)$-generalized setting by constructing the metric space of homogeneous type corresponding to the $(k,1)$-generalized setting, and show that $\left(-\triangle_{k,1}\right)^{-i\sigma}$ are singular integral operators satisfying the corresponding H\"ormander type condition.


title: Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees

abstract: Variational inequalities in general and saddle point problems in particular are increasingly relevant in machine learning applications, including adversarial learning, GANs, transport and robust optimization. With increasing data and problem sizes necessary to train high performing models across various applications, we need to rely on parallel and distributed computing. However, in distributed training, communication among the compute nodes is a key bottleneck during training, and this problem is exacerbated for high dimensional and over-parameterized models. Due to these considerations, it is important to equip existing methods with strategies that would allow to reduce the volume of transmitted information during training while obtaining a model of comparable quality. In this paper, we present the first theoretically grounded distributed methods for solving variational inequalities and saddle point problems using compressed communication: MASHA1 and MASHA2. Our theory and methods allow for the use of both unbiased (such as Rand$k$; MASHA1) and contractive (such as Top$k$; MASHA2) compressors. New algorithms support bidirectional compressions, and also can be modified for stochastic setting with batches and for federated learning with partial participation of clients. We empirically validated our conclusions using two experimental setups: a standard bilinear min-max problem, and large-scale distributed adversarial training of transformers.


title: Lifting graph $C^*$-algebra maps to Leavitt path algebra maps

abstract: Let $\xi:C^*(E)\to C^*(F)$ be a unital $*$-homomorphism between simple purely infinite Cuntz-Krieger algebras of finite graphs. We prove that there exists a unital $*$-homomorphism $\phi:L(E)\to L(F)$ between the corresponding Leavitt path-algebras such that $\xi$ is homotopic to the map $\hat{\phi}:C^*(E)\to C^*(F)$ induced by completion. We show moreover that $\hat{\phi}$ is a homotopy equivalence in the $C^*$-algebraic sense if and only if $\phi$ is a homotopy equivalence in the algebraic, polynomial sense. We deduce, in particular, that any isomorphism between simple purely infinite Cuntz-Krieger algebras is homotopic to the completion of a unital algebraic homotopy equivalence.


title: On Equivalence Checking for Orthocomplemented Bisemilattices in Log-Linear Time

abstract: We present a quasilinear time algorithm to decide the word problem on a natural algebraic structures we call orthocomplemented bisemilattices, a subtheory of boolean algebra. We use as a base a variation of Hopcroft, Ullman and Aho algorithm for tree isomorphism which we combine with a term rewriting system to decide equivalence of two terms. We prove that the rewriting system is terminating and confluent and hence the existence of a normal form, and that our algorithm is computing it. We also discuss applications and present an effective implementation in Scala.


title: Correct Me if I am Wrong: Interactive Learning for Robotic Manipulation

abstract: Learning to solve complex manipulation tasks from visual observations is a dominant challenge for real-world robot learning. Although deep reinforcement learning algorithms have recently demonstrated impressive results in this context, they still require an impractical amount of time-consuming trial-and-error iterations. In this work, we consider the promising alternative paradigm of interactive learning in which a human teacher provides feedback to the policy during execution, as opposed to imitation learning where a pre-collected dataset of perfect demonstrations is used. Our proposed CEILing (Corrective and Evaluative Interactive Learning) framework combines both corrective and evaluative feedback from the teacher to train a stochastic policy in an asynchronous manner, and employs a dedicated mechanism to trade off human corrections with the robot's own experience. We present results obtained with our framework in extensive simulation and real-world experiments to demonstrate that CEILing can effectively solve complex robot manipulation tasks directly from raw images in less than one hour of real-world training.


title: Reduction of the 2D Toda Hierarchy and Linear Hodge Integrals

abstract: We construct a certain reduction of the 2D Toda hierarchy and obtain a tau-symmetric Hamiltonian integrable hierarchy. This reduced integrable hierarchy controls the linear Hodge integrals in the way that one part of its flows yields the intermediate long wave hierarchy, and the remaining flows coincide with a certain limit of the flows of the fractional Volterra hierarchy which controls the special cubic Hodge integrals.


title: On the Latent Holes of VAEs for Text Generation

abstract: In this paper, we provide the first focused study on the discontinuities (aka. holes) in the latent space of Variational Auto-Encoders (VAEs), a phenomenon which has been shown to have a detrimental effect on model capacity. When investigating latent holes, existing works are exclusively centred around the encoder network and they merely explore the existence of holes. We tackle these limitations by proposing a highly efficient Tree-based Decoder-Centric (TDC) algorithm for latent hole identification, with a focal point on the text domain. In contrast to past studies, our approach pays attention to the decoder network, as a decoder has a direct impact on the model's output quality. Furthermore, we provide, for the first time, in-depth empirical analysis of the latent hole phenomenon, investigating several important aspects such as how the holes impact VAE algorithms' performance on text generation, and how the holes are distributed in the latent space.


title: Towards Federated Learning-Enabled Visible Light Communication in 6G Systems

abstract: Visible light communication (VLC) technology was introduced as a key enabler for the next generation of wireless networks, mainly thanks to its simple and low-cost implementation. However, several challenges prohibit the realization of the full potentials of VLC, namely, limited modulation bandwidth, ambient light interference, optical diffuse reflection effects, devices non-linearity, and random receiver orientation. On the contrary, centralized machine learning (ML) techniques have demonstrated a significant potential in handling different challenges relating to wireless communication systems. Specifically, it was shown that ML algorithms exhibit superior capabilities in handling complicated network tasks, such as channel equalization, estimation and modeling, resources allocation, and opportunistic spectrum access control, to name a few. Nevertheless, concerns pertaining to privacy and communication overhead when sharing raw data of the involved clients with a server constitute major bottlenecks in the implementation of centralized ML techniques. This has motivated the emergence of a new distributed ML paradigm, namely federated learning (FL), which can reduce the cost associated with transferring raw data, and preserve privacy by training ML models locally and collaboratively at the clients' side. Hence, it becomes evident that integrating FL into VLC networks can provide ubiquitous and reliable implementation of VLC systems. With this motivation, this is the first in-depth review in the literature on the application of FL in VLC networks. To that end, besides the different architectures and related characteristics of FL, we provide a thorough overview on the main design aspects of FL based VLC systems. Finally, we also highlight some potential future research directions of FL that are envisioned to substantially enhance the performance and robustness of VLC systems.


title: Automated Testing of AI Models

abstract: The last decade has seen tremendous progress in AI technology and applications. With such widespread adoption, ensuring the reliability of the AI models is crucial. In past, we took the first step of creating a testing framework called AITEST for metamorphic properties such as fairness, robustness properties for tabular, time-series, and text classification models. In this paper, we extend the capability of the AITEST tool to include the testing techniques for Image and Speech-to-text models along with interpretability testing for tabular models. These novel extensions make AITEST a comprehensive framework for testing AI models.


title: Robustness and Reliability When Training With Noisy Labels

abstract: Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will inevitably shift the solution towards the conditional distribution over noisy labels. Nevertheless, while deep neural networks have proven capable of fitting random labels, regularisation and the use of robust loss functions empirically mitigate the effects of label noise. However, such observations concern robustness in accuracy, which is insufficient if reliable uncertainty quantification is critical. We demonstrate this by analysing the properties of the conditional distribution over noisy labels for an input-dependent noise model. In addition, we evaluate the set of robust loss functions characterised by noise-insensitive, asymptotic risk minimisers. We find that strictly proper and robust loss functions both offer asymptotic robustness in accuracy, but neither guarantee that the final model is calibrated. Moreover, even with robust loss functions, overfitting is an issue in practice. With these results, we aim to explain observed robustness of common training practices, such as early stopping, to label noise. In addition, we aim to encourage the development of new noise-robust algorithms that not only preserve accuracy but that also ensure reliability.


title: Implications of the low frequency turn-over in the spectrum of radio knot C in DG Tau

abstract: The synchrotron spectrum of radio knot C in the protostellar object DG Tau has a low frequency turn-over. This is used to show that its magnetic field strength is likely to be at least 10 mG, which is roughly two orders of magnitude larger than previously estimated. The earlier, lower value is due to an overestimate of the emission volume together with an omission of the dependence of the minimum magnetic field on the synchrotron spectral index. Since the source is partially resolved, this implies a low volume filling factor for the synchrotron emission. It is argued that the high pressure needed to account for the observations is due to shocks. In addition, cooling of the thermal gas is probably necessary in order to further enhance the magnetic field strength as well as the density of relativistic electrons. It is suggested that the observed spectral index implies that the energy of the radio emitting electrons is below that needed to take part in first order Fermi acceleration. Hence, the radio emission gives insights to the properties of its pre-acceleration phase. Attention is also drawn to the similarities between the properties of radio knot C and the shock induced radio emission in supernovae.


title: A Logic-Based Framework for Natural Language Inference in Dutch

abstract: We present a framework for deriving inference relations between Dutch sentence pairs. The proposed framework relies on logic-based reasoning to produce inspectable proofs leading up to inference labels; its judgements are therefore transparent and formally verifiable. At its core, the system is powered by two ${\lambda}$-calculi, used as syntactic and semantic theories, respectively. Sentences are first converted to syntactic proofs and terms of the linear ${\lambda}$-calculus using a choice of two parsers: an Alpino-based pipeline, and Neural Proof Nets. The syntactic terms are then converted to semantic terms of the simply typed ${\lambda}$-calculus, via a set of hand designed type- and term-level transformations. Pairs of semantic terms are then fed to an automated theorem prover for natural logic which reasons with them while using the lexical relations found in the Open Dutch WordNet. We evaluate the reasoning pipeline on the recently created Dutch natural language inference dataset, and achieve promising results, remaining only within a $1.1-3.2{\%}$ performance margin to strong neural baselines. To the best of our knowledge, the reasoning pipeline is the first logic-based system for Dutch.


title: Structured Channel Covariance Estimation from Limited Samples for Large Antenna Arrays

abstract: In massive multiple-input multiple-output (MIMO) systems, the knowledge of the users' channel covariance matrix is crucial for minimum mean square error (MMSE) channel estimation in the uplink as well as it plays an important role in several multiuser beamforming schemes in the downlink. Due to the large number of base station antennas in massive MIMO, accurate covariance estimation is challenging especially in the case where the number of samples is limited and thus comparable to the channel vector dimension. As a result, the standard sample covariance estimator may yield a too large estimation error which in turn may yield significant system performance degradation with respect to the ideal channel covariance knowledge case. To address such problem, we propose a method based on a parametric representation of the channel angular scattering function. The proposed parametric representation includes a discrete specular component which is addressed using the well-known MUltiple SIgnal Classification (MUSIC) method, and a diffuse scattering component, which is modeled as the superposition of suitable dictionary functions. To obtain the representation parameters we propose two methods, where the first solves a non-negative least-squares problem and the second maximizes the likelihood function using expectation-maximization. Our simulation results show that the proposed methods outperform the state of the art with respect to various estimation quality metrics and different sample sizes.


title: Rapporteur Talk: Cosmic Ray Direct

abstract: This is the report on the cosmic ray direct track of the 37th International Cosmic Ray Conference (ICRC 2021), broadly covering the contributions relating to charged cosmic rays (CRs) of Galactic origin. The contributions highlighted here are of both observational and theoretical nature and aim at interpreting the local fluxes of CRs as well as studying the wider dynamical effects of CRs. New data from space-borne experiments on CR electrons and positrons, proton and helium as well as heavier nuclei and their isotopes are reviewed. We cover some models of CR acceleration and their feedback on Galactic scales. Diffuse emission in gamma-rays as far as it concerns the CR spectra in the immediate vicinity of the solar system and CR anisotropies are covered briefly. Some upcoming and proposed experiments are highlighted towards the end.


title: Back from the future: bidirectional CTC decoding using future information in speech recognition

abstract: In this paper, we propose a simple but effective method to decode the output of Connectionist Temporal Classifier (CTC) model using a bi-directional neural language model. The bidirectional language model uses the future as well as the past information in order to predict the next output in the sequence. The proposed method based on bi-directional beam search takes advantage of the CTC greedy decoding output to represent the noisy future information. Experiments on the Librispeechdataset demonstrate the superiority of our proposed method compared to baselines using unidirectional decoding. In particular, the boost inaccuracy is most apparent at the start of a sequence which is the most erroneous part for existing systems based on unidirectional decoding.


title: Improving Confidence Estimation on Out-of-Domain Data for End-to-End Speech Recognition

abstract: As end-to-end automatic speech recognition (ASR) models reach promising performance, various downstream tasks rely on good confidence estimators for these systems. Recent research has shown that model-based confidence estimators have a significant advantage over using the output softmax probabilities. If the input data to the speech recogniser is from mismatched acoustic and linguistic conditions, the ASR performance and the corresponding confidence estimators may exhibit severe degradation. Since confidence models are often trained on the same in-domain data as the ASR, generalising to out-of-domain (OOD) scenarios is challenging. By keeping the ASR model untouched, this paper proposes two approaches to improve the model-based confidence estimators on OOD data: using pseudo transcriptions and an additional OOD language model. With an ASR model trained on LibriSpeech, experiments show that the proposed methods can greatly improve the confidence metrics on TED-LIUM and Switchboard datasets while preserving in-domain performance. Furthermore, the improved confidence estimators are better calibrated on OOD data and can provide a much more reliable criterion for data selection.


title: Sasaki structures distinguished by their basic Hodge numbers

abstract: In all odd dimensions $\geq 5$ we produce examples of manifolds admitting pairs of Sasaki structures with different basic Hodge numbers. In dimension $5$ we prove more precise results, for example we show that on connected sums of copies of $S^2\times S^3$ the number of Sasaki structures with different basic Hodge numbers within a fixed homotopy class of almost contact structures is unbounded. All the Sasaki structures we consider are negative in the sense that the basic first Chern class is represented by a negative definite form of type $(1,1)$. We also discuss the relation of these results to contact topology.


title: Towards Universal Neural Vocoding with a Multi-band Excited WaveNet

abstract: This paper introduces the Multi-Band Excited WaveNet a neural vocoder for speaking and singing voices. It aims to advance the state of the art towards an universal neural vocoder, which is a model that can generate voice signals from arbitrary mel spectrograms extracted from voice signals. Following the success of the DDSP model and following the development of the recently proposed excitation vocoders we propose a vocoder structure consisting of multiple specialized DNN that are combined with dedicated signal processing components. All components are implemented as differentiable operators and therefore allow joined optimization of the model parameters. To prove the capacity of the model to reproduce high quality voice signals we evaluate the model on single and multi speaker/singer datasets. We conduct a subjective evaluation demonstrating that the models support a wide range of domain variations (unseen voices, languages, expressivity) achieving perceptive quality that compares with a state of the art universal neural vocoder, however using significantly smaller training datasets and significantly less parameters. We also demonstrate remaining limits of the universality of neural vocoders e.g. the creation of saturated singing voices.


title: First Dirichlet eigenvalue and exit time moment spectra comparisons

abstract: We prove explicit upper and lower bounds for the Poisson hierarchy, the averaged $L^1$-moment spectra $\{\dfrac{\mathcal{A}_k\left(B_R^M\right)}{\text{vol}\left(S_R^M\right)}\}_{k=1}^\infty$, and the torsional rigidity $\mathcal{A}_1(B^M_R)$ of a geodesic ball $B^M_R$ in a Riemannian manifold $M^n$ which satisfies that the mean curvatures of the geodesic spheres $S^M_r$ included in it, (up to the boundary $S^M_R$), are controlled by the radial mean curvature of the geodesic spheres $S^\omega_r(o_\omega)$ with same radius centered at the center $o_\omega$ of a rotationally symmetric model space $M^n_\omega$. As a consecuence, we prove a first Dirichlet eigenvalue $\lambda_1(B^M_R)$ comparison theorem and show that equality with the bound $\lambda_1(B^\omega_R(o_\omega))$, (where $B^\omega_r(o_\omega)$ is the geodesic $r$-ball in $M^n_\omega$), characterizes the $L^1$-moment spectrum $\{\mathcal{A}_k(B^M_R)\}_{k=1}^\infty$ as the sequence $\{\mathcal{A}_k(B^\omega_R)\}_{k=1}^\infty$ and vice-versa.


title: CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and Comparability

abstract: What is the state of the art in continual machine learning? Although a natural question for predominant static benchmarks, the notion to train systems in a lifelong manner entails a plethora of additional challenges with respect to set-up and evaluation. The latter have recently sparked a growing amount of critiques on prominent algorithm-centric perspectives and evaluation protocols being too narrow, resulting in several attempts at constructing guidelines in favor of specific desiderata or arguing against the validity of prevalent assumptions. In this work, we depart from this mindset and argue that the goal of a precise formulation of desiderata is an ill-posed one, as diverse applications may always warrant distinct scenarios. Instead, we introduce the Continual Learning EValuation Assessment Compass: the CLEVA-Compass. The compass provides the visual means to both identify how approaches are practically reported and how works can simultaneously be contextualized in the broader literature landscape. In addition to promoting compact specification in the spirit of recent replication trends, it thus provides an intuitive chart to understand the priorities of individual systems, where they resemble each other, and what elements are missing towards a fair comparison.


title: PLATO Hare-and-Hounds exercise: Asteroseismic model fitting of main-sequence solar-like pulsators

abstract: Asteroseismology is a powerful tool to infer fundamental stellar properties. The use of these asteroseismic-inferred properties in a growing number of astrophysical contexts makes it vital to understand their accuracy. Consequently, we performed a hare-and-hounds exercise where the hares simulated data for 6 artificial main-sequence stars and the hounds inferred their properties based on different inference procedures. To mimic a pipeline such as that planned for the PLATO mission, all hounds used the same model grid. Some stars were simulated using the physics adopted in the grid, others a different one. The maximum relative differences found (in absolute value) between the inferred and true values of the mass, radius, and age were 4.32 per cent, 1.33 per cent, and 11.25 per cent, respectively. The largest systematic differences in radius and age were found for a star simulated assuming gravitational settling, not accounted for in the model grid, with biases of -0.88 per cent (radius) and 8.66 per cent (age). For the mass, the most significant bias (-3.16 per cent) was found for a star with a helium enrichment ratio outside the grid range. Moreover, a ~7 per cent dispersion in age was found when adopting different prescriptions for the surface corrections or shifting the classical observations by $\pm 1\sigma$. The choice of the relative weight given to the classical and seismic constraints also impacted significantly the accuracy and precision of the results. Interestingly, only a few frequencies were required to achieve accurate results on the mass and radius. For the age the same was true when at least one $l=2$ mode was considered.


title: Future Constraints on Primordial Black Holes from XGIS-THESEUS

abstract: Current observations allow Primordial Black Holes (PBHs) in asteroid mass range $10^{17}-10^{22}$ g to constitute the entire dark matter (DM) energy density (barring a small mass range constrained by 21 cm observations). In this work, we explore the possibility of probing PBH with masses $10^{17}-10^{19}\,{\rm g}$ via upcoming X and Gamma Imaging Spectrometer (XGIS) telescope array on-board the Transient High-Energy Sky and Early Universe Surveyor (THESEUS) mission. While our projected limits are comparable with those proposed in the literature for $10^{16}\,{\rm g}\,<\,M_{\mathrm{PBH}}\,<\,10^{17}\,{\rm g}$, we show that the XGIS-THESEUS mission can potentially provide the strongest bound for $10^{17} \mathrm{~g}<M_{\mathrm{PBH}} \lesssim 3\times 10^{18} \mathrm{~g}$ for non-rotating PBHs. The bounds become more stringent by nearly an order of magnitude for maximally rotating PBHs in the mass range $5\times10^{15}\,{\rm g}\,<\,M_{\rm PBH}\,\lesssim\,10^{19}\,{\rm g}$.


title: Knowledge Distillation for Neural Transducers from Large Self-Supervised Pre-trained Models

abstract: Self-supervised pre-training is an effective approach to leveraging a large amount of unlabelled data to reduce word error rates (WERs) of automatic speech recognition (ASR) systems. Since it is impractical to use large pre-trained models for many real-world ASR applications, it is desirable to have a much smaller model while retaining the performance of the pre-trained model. In this paper, we propose a simple knowledge distillation (KD) loss function for neural transducers that focuses on the one-best path in the output probability lattice under both streaming and non-streaming setups, which allows a small student model to approach the performance of the large pre-trained teacher model. Experiments on the LibriSpeech dataset show that despite being 10 times smaller than the teacher model, the proposed loss results in relative WER reductions (WERRs) of 11.5% and 6.8% on the test-other set for non-streaming and streaming student models compared to the baseline transducers trained without KD using the labelled 100-hour clean data. With an additional 860 hours of unlabelled data for KD, the WERRs increase to 48.2% and 38.5% for non-streaming and streaming students. If language model shallow fusion is used for producing distillation targets, a further improvement in the student model is observed.