title: Automated Quality Assessment of Cognitive Behavioral Therapy Sessions Through Highly Contextualized Language Representations

abstract: During a psychotherapy session, the counselor typically adopts techniques which are codified along specific dimensions (e.g., 'displays warmth and confidence', or 'attempts to set up collaboration') to facilitate the evaluation of the session. Those constructs, traditionally scored by trained human raters, reflect the complex nature of psychotherapy and highly depend on the context of the interaction. Recent advances in deep contextualized language models offer an avenue for accurate in-domain linguistic representations which can lead to robust recognition and scoring of such psychotherapy-relevant behavioral constructs, and support quality assurance and supervision. In this work, we propose a BERT-based model for automatic behavioral scoring of a specific type of psychotherapy, called Cognitive Behavioral Therapy (CBT), where prior work is limited to frequency-based language features and/or short text excerpts which do not capture the unique elements involved in a spontaneous long conversational interaction. The model focuses on the classification of therapy sessions with respect to the overall score achieved on the widely-used Cognitive Therapy Rating Scale (CTRS), but is trained in a multi-task manner in order to achieve higher interpretability. BERT-based representations are further augmented with available therapy metadata, providing relevant non-linguistic context and leading to consistent performance improvements. We train and evaluate our models on a set of 1,118 real-world therapy sessions, recorded and automatically transcribed. Our best model achieves an F1 score equal to 72.61% on the binary classification task of low vs. high total CTRS.


title: Limitations on sharing Bell nonlocality between sequential pairs of observers

abstract: We give strong analytic and numerical evidence that, under mild measurement assumptions, two qubits cannot both be recycled to generate Bell nonlocality between multiple independent observers on each side. This is surprising, as under the same assumptions it is possible to recycle just one of the qubits an arbitrarily large number of times [P. J. Brown and R. Colbeck, Phys. Rev. Lett. 125, 090401 (2020)]. We derive corresponding 'one-sided monogamy relations' that rule out two-sided recycling for a wide range of parameters, based on a general tradeoff relation between the strengths and maximum reversibilities of qubit measurements. We also show if the assumptions are relaxed to allow sufficiently biased measurement selections, then there is a narrow range of measurement strengths that allows two-sided recycling for two observers on each side, and propose an experimental test. Our methods may be readily applied to other types of quantum correlations, such as steering and entanglement, and hence to general information protocols involving sequential measurements.


title: Product-form estimators: exploiting independence to scale up Monte Carlo

abstract: We introduce a class of Monte Carlo estimators that aim to overcome the rapid growth of variance with dimension often observed for standard estimators by exploiting the target's independence structure. We identify the most basic incarnations of these estimators with a class of generalized U-statistics, and thus establish their unbiasedness, consistency, and asymptotic normality. Moreover, we show that they obtain the minimum possible variance amongst a broad class of estimators; and we investigate their computational cost and delineate the settings in which they are most efficient. We exemplify the merger of these estimators with other well-known Monte Carlo estimators so as to better adapt the latter to the target's independence structure and improve their performance. We do this via three simple mergers: one with importance sampling, another with importance sampling squared, and a final one with pseudo-marginal Metropolis-Hasting. In all cases, we show that the resulting estimators are well-founded and achieve lower variances than their standard counterparts. Lastly, we illustrate the various variance reductions through several examples.


title: A preconditioner based on sine transform for two-dimensional Riesz space factional diffusion equations in convex domains

abstract: In this paper, we develop a fast numerical method for solving the time-dependent Riesz space fractional diffusion equations with a nonlinear source term in the convex domain. An implicit finite difference method is employed to discretize the Riesz space fractional diffusion equations with a penalty term in a rectangular region by the volume-penalization approach. The stability and the convergence of the proposed method are studied. As the coefficient matrix is with the Toeplitz-like structure, the generalized minimum residual method with a preconditioner based on the sine transform is exploited to solve the discretized linear system, where the preconditioner is constructed in view of the combination of two approximate inverse ${\tau}$ matrices, which can be diagonalized by the sine transform. The spectrum of the preconditioned matrix is also investigated. Numerical experiments are carried out to demonstrate the efficiency of the proposed method.


title: To study the structural, electronic and optical properties of predicted stable halide perovskites ABX3

abstract: Structure, optical and electronic properties of predicted stables Perovskites ABX3 are calculated using DFT approach. The modified Becke-Johnson potential is also used to investigate electrical and optical properties. The density of states and electronic band structure calculations reveal that the predicted stable halides Perovskites ABX3 have a direct as well as indirect band gap, with dielectric function, optical reflectivity, absorption coefficient, optical conductivity, extinction coefficient, refractive index are calculated in different ranges of energy. The maximum value of static dielectric function is observed for KNiI3 and RbIrBr3 are 3.5 and 3 respectively. The highest absorption peak among the all is observed at 26eV for SrLiF3, while refractive index of that SrLiF3 gives peak at 24eV then refractive index decreases below the unity as energy increases up to 27.5eV. The maximum peaks of optical conductivity of predicted stables halides Perovskites are observed in visible to ultraviolet range (1.7eV to 30eV). The maximum peaks of optical conductivity are observed for SrLiF3 at 24eV. For the first time, all of the properties evaluated for predicted stable halides ABX3Perovskites are reported, because no theoretical work is reported yet on most of the physical properties.


title: A Graphical Framework to Study the Correlation between Geometric Design and Simulation

abstract: Partial differential equations can be solved on general polygonal and polyhedral meshes, through Polytopal Element Methods (PEMs). Unfortunately, the relation between geometry and analysis is still unknown and subject to ongoing research in order to identify weaker shape-regularity criteria under which PEMs can reliably work. We propose PEMesh, a graphical framework to support the analysis of the relation between the geometric properties of polygonal meshes and the numerical performances of PEM solvers. PEMesh allows the design of polygonal meshes that increasingly stress some geometric properties, by exploiting any external PEM solver, and supports the study of the correlation between the performances of such a solver and geometric properties of the input mesh. Furthermore, it is highly modular, customisable, easy to use, and provides the possibility to export analysis results both as numerical values and graphical plots. PEMesh has a potential practical impact on ongoing and future research activities related to PEM methods, polygonal mesh generation and processing.


title: Neural Nano-Optics for High-quality Thin Lens Imaging

abstract: Nano-optic imagers that modulate light at sub-wavelength scales could unlock unprecedented applications in diverse domains ranging from robotics to medicine. Although metasurface optics offer a path to such ultra-small imagers, existing methods have achieved image quality far worse than bulky refractive alternatives, fundamentally limited by aberrations at large apertures and low f-numbers. In this work, we close this performance gap by presenting the first neural nano-optics. We devise a fully differentiable learning method that learns a metasurface physical structure in conjunction with a novel, neural feature-based image reconstruction algorithm. Experimentally validating the proposed method, we achieve an order of magnitude lower reconstruction error. As such, we present the first high-quality, nano-optic imager that combines the widest field of view for full-color metasurface operation while simultaneously achieving the largest demonstrated 0.5 mm, f/2 aperture.


title: Anomalous Raman Modes in Tellurides

abstract: Two broad bands are usually found in the Raman spectrum of many Te-based chalcogenides, which include binary compounds, like ZnTe, CdTe, HgTe, GaTe, GeTe, SnTe, PbTe, GeTe2, As2Te3, Sb2Te3, Bi2Te3, NiTe2, IrTe2, TiTe2, as well as ternary compounds, like GaGeTe, SnSb2Te4, SnBi2Te4, and GeSb2Te5. Many different explanations have been proposed in the literature for the origin of these two anomalous broad bands in tellurides, usually located between 119 and 145 cm-1. They have been attributed to the own sample, to oxidation, to the folding of Brillouin-edge modes onto the zone center, to the existence of a double resonance, like that of graphene, or to the formation of Te precipitates. In this paper, we provide arguments to demonstrate that such bands correspond to clusters or precipitates of trigonal Te in form of nanosize or microsize grains or layers that are segregated either inside or at the surface of the samples. Several mechanisms for Te segregation are discussed and sample heating caused by excessive laser power during Raman scattering measurements is emphasized. Finally, we show that anomalous Raman modes related to Se precipitates also occur in selenides, thus providing a general vision for a better characterization of selenides and tellurides by means of Raman scattering measurements and for a better understanding of chalcogenides in general.


title: The nonconforming Trefftz virtual element method: general setting, applications, and dispersion analysis for the Helmholtz equation

abstract: We present a survey of the nonconforming Trefftz virtual element method for the Laplace and Helmholtz equations. For the latter, we present a new abstract analysis, based on weaker assumptions on the stabilization, and numerical results on the dispersion analysis, including comparison with the plane wave discontinuous Galerkin method.


title: Deep Deterministic Uncertainty: A Simple Baseline

abstract: Reliable uncertainty from deterministic single-forward pass models is sought after because conventional methods of uncertainty quantification are computationally expensive. We take two complex single-forward-pass uncertainty approaches, DUQ and SNGP, and examine whether they mainly rely on a well-regularized feature space. Crucially, without using their more complex methods for estimating uncertainty, a single softmax neural net with such a feature-space, achieved via residual connections and spectral normalization, *outperforms* DUQ and SNGP's epistemic uncertainty predictions using simple Gaussian Discriminant Analysis *post-training* as a separate feature-space density estimator -- without fine-tuning on OoD data, feature ensembling, or input pre-procressing. This conceptually simple *Deep Deterministic Uncertainty (DDU)* baseline can also be used to disentangle aleatoric and epistemic uncertainty and performs as well as Deep Ensembles, the state-of-the art for uncertainty prediction, on several OoD benchmarks (CIFAR-10/100 vs SVHN/Tiny-ImageNet, ImageNet vs ImageNet-O) as well as in active learning settings across different model architectures, yet is *computationally cheaper*.


title: Particle acceleration and magnetic field amplification in massive young stellar object jets

abstract: Synchrotron radio emission from non-relativistic jets powered by massive protostars has been reported, indicating the presence of relativistic electrons and magnetic fields of strength ~0.3-5 mG. We study diffusive shock acceleration and magnetic field amplification in protostellar jets with speeds between 300 and 1500 km/s. We show that the magnetic field in the synchrotron emitter can be amplified by the non-resonant hybrid (Bell) instability excited by the cosmic-ray streaming. By combining the synchrotron data with basic theory of Bell instability we estimate the magnetic field in the synchrotron emitter and the maximum energy of protons. Protons can achieve maximum energies in the range 0.04-0.65 TeV and emit gamma rays in their interaction with matter fields. We predict detectable levels of gamma rays in IRAS 16547-5247 and IRAS 16848-4603. The gamma ray flux can be significantly enhanced by the gas mixing due to Rayleigh-Taylor instability. The detection of this radiation by the Fermi satellite in the GeV domain and the forthcoming Cherenkov Telescope Array at higher energies may open a new window to study the formation of massive stars, as well as diffusive acceleration and magnetic field amplification in shocks with velocities of about 1000 km/s.


title: Enhancing Model Robustness By Incorporating Adversarial Knowledge Into Semantic Representation

abstract: Despite that deep neural networks (DNNs) have achieved enormous success in many domains like natural language processing (NLP), they have also been proven to be vulnerable to maliciously generated adversarial examples. Such inherent vulnerability has threatened various real-world deployed DNNs-based applications. To strength the model robustness, several countermeasures have been proposed in the English NLP domain and obtained satisfactory performance. However, due to the unique language properties of Chinese, it is not trivial to extend existing defenses to the Chinese domain. Therefore, we propose AdvGraph, a novel defense which enhances the robustness of Chinese-based NLP models by incorporating adversarial knowledge into the semantic representation of the input. Extensive experiments on two real-world tasks show that AdvGraph exhibits better performance compared with previous work: (i) effective - it significantly strengthens the model robustness even under the adaptive attacks setting without negative impact on model performance over legitimate input; (ii) generic - its key component, i.e., the representation of connotative adversarial knowledge is task-agnostic, which can be reused in any Chinese-based NLP models without retraining; and (iii) efficient - it is a light-weight defense with sub-linear computational complexity, which can guarantee the efficiency required in practical scenarios.


title: ROAD: The ROad event Awareness Dataset for Autonomous Driving

abstract: Humans drive in a holistic fashion which entails, in particular, understanding dynamic road events and their evolution. Injecting these capabilities in autonomous vehicles can thus take situational awareness and decision making closer to human-level performance. To this purpose, we introduce the ROad event Awareness Dataset (ROAD) for Autonomous Driving, to our knowledge the first of its kind. ROAD is designed to test an autonomous vehicle's ability to detect road events, defined as triplets composed by an active agent, the action(s) it performs and the corresponding scene locations. ROAD comprises videos originally from the Oxford RobotCar Dataset annotated with bounding boxes showing the location in the image plane of each road event. We benchmark various detection tasks, proposing as a baseline a new incremental algorithm for online road event awareness termed 3D-RetinaNet. We also report the performance on the ROAD tasks of Slowfast and YOLOv5 detectors, as well as that of the winners of the ICCV2021 ROAD challenge, which highlight the challenges faced by situation awareness in autonomous driving. ROAD is designed to allow scholars to investigate exciting tasks such as complex (road) activity detection, future event anticipation and continual learning. The dataset is available at https://github.com/gurkirt/road-dataset; the baseline can be found at https://github.com/gurkirt/3D-RetinaNet.


title: Adversarial Examples Detection beyond Image Space

abstract: Deep neural networks have been proved that they are vulnerable to adversarial examples, which are generated by adding human-imperceptible perturbations to images. To defend these adversarial examples, various detection based methods have been proposed. However, most of them perform poorly on detecting adversarial examples with extremely slight perturbations. By exploring these adversarial examples, we find that there exists compliance between perturbations and prediction confidence, which guides us to detect few-perturbation attacks from the aspect of prediction confidence. To detect both few-perturbation attacks and large-perturbation attacks, we propose a method beyond image space by a two-stream architecture, in which the image stream focuses on the pixel artifacts and the gradient stream copes with the confidence artifacts. The experimental results show that the proposed method outperforms the existing methods under oblivious attacks and is verified effective to defend omniscient attacks as well.


title: Tuning of Bilayer Graphene Heterostructure by Horizontally Incident Circular Polarized Light

abstract: We theoretically investigated the Floquet states of bilayer graphene heterostructure under the irradiation by horizontally incident circular polarized light. The in-plane and out-of-plane electric field of the light periodically perturbs the intra-layer and inter-layer hopping, respectively. For circular polarized light, the two components of the electric field has $\pi/2$ phase difference, so that the two types of hopping are periodically perturbed with the $\pi/2$ phase difference, which modify the effective inter-layer hopping. We focus on the model of bilayer graphene in the heterostructure of antiferromagnetic van der Walls spin valve. The amplitude of the irradiation can tune the band gap and topological properties of the bulk state. The spin-polarized quantum anomalous Hall phase with Chern number being one is predicted. The incident angle of the irradiation can tune the band gap and dispersion of the edge states in zigzag nanoribbons.


title: Data Fusion for Audiovisual Speaker Localization: Extending Dynamic Stream Weights to the Spatial Domain

abstract: Estimating the positions of multiple speakers can be helpful for tasks like automatic speech recognition or speaker diarization. Both applications benefit from a known speaker position when, for instance, applying beamforming or assigning unique speaker identities. Recently, several approaches utilizing acoustic signals augmented with visual data have been proposed for this task. However, both the acoustic and the visual modality may be corrupted in specific spatial regions, for instance due to poor lighting conditions or to the presence of background noise. This paper proposes a novel audiovisual data fusion framework for speaker localization by assigning individual dynamic stream weights to specific regions in the localization space. This fusion is achieved via a neural network, which combines the predictions of individual audio and video trackers based on their time- and location-dependent reliability. A performance evaluation using audiovisual recordings yields promising results, with the proposed fusion approach outperforming all baseline models.

categories: cs.SD cs.AI cs.CL cs.CV cs.LG eess.AS eess.IV


title: Absorption effects in the blazar's gamma-ray spectra due to luminous stars crossing the jet

abstract: Gamma-ray emission in active galaxies is likely produced within the inner jet, or in the close vicinity of the supermassive black hole (SMBH) at sub-parsec distances. Gamma rays have to pass through the surrounding massive stellar cluster which luminous stars can accidentally appear close to the observer's line of sight. In such a case, soft radiation of massive stars can create enough target for transient absorption of the gamma rays in multi-GeV to TeV energy range. We consider the effect of such stellar encounters on the gamma-ray spectrum produced within the massive stellar cluster surrounding a central SMBH. We predict characteristic, time-dependent effects on the gamma-ray spectra due to the encounter with the single luminous star and also stellar binary system. We conclude that during the encounter, the gamma-ray spectrum of an active galaxy should steepen at tens of GeV and harden in the range of hundreds of GeV. As an example, we consider such effects on the spectra observed from a typical blazar, 1ES\ 1959+650 (in an active state) and also in the case of a radio galaxy M87 (in a low state). It is shown that observation of such transient characteristic features in the gamma-ray spectra, observed from blazars and radio galaxies, lays within the sensitivity of the future Cherenkov Telescope Array.


title: Compton driven beam formation and magnetisation via plasma microinstabilities

abstract: Compton scattering of gamma rays propagating in a pair plasma can drive the formation of a relativistic electron positron beam. This process is scrutinised theoretically and numerically via particle-in-cell simulations. In addition, we determine in which conditions the beam can prompt a beam-plasma instability and convert its kinetic energy into magnetic energy. We argue that such conditions can be met at the photosphere radius of bright Gamma Ray Bursts.


title: Time Parametrizations in Long-Range Interacting Bose-Einstein Condensates

abstract: Time-reparametrization invariance in general relativistic space-time does not allow us to single out a time in quantum mechanics in a mechanical way of measurement. Motivated by this problem, we examine this gauge invariance in the ground state of the quasi-stationary coarse-grained state of a long-range interacting closed system of identical or identified, macroscopic, and spatiotemporally inhomogeneous Bose-Einstein condensates in the thermodynamic and Newtonian limits. As a result, we find that it is a theoretical counterexample of this gauge invariance, except for proper-time translational invariance, at a coarse-grained level.


title: Strategic Classification in the Dark

abstract: Strategic classification studies the interaction between a classification rule and the strategic agents it governs. Under the assumption that the classifier is known, rational agents respond to it by manipulating their features. However, in many real-life scenarios of high-stake classification (e.g., credit scoring), the classifier is not revealed to the agents, which leads agents to attempt to learn the classifier and game it too. In this paper we generalize the strategic classification model to such scenarios. We define the price of opacity as the difference in prediction error between opaque and transparent strategy-robust classifiers, characterize it, and give a sufficient condition for this price to be strictly positive, in which case transparency is the recommended policy. Our experiments show how Hardt et al.'s robust classifier is affected by keeping agents in the dark.


title: Millimeter-wave Mobile Sensing and Environment Mapping: Models, Algorithms and Validation

abstract: Integrating efficient connectivity, positioning and sensing functionalities into 5G New Radio (NR) and beyond mobile cellular systems is one timely research paradigm, especially at mm-wave and sub-THz bands. In this article, we address the radio-based sensing and environment mapping prospects with specific emphasis on the user equipment (UE) side. We first describe an efficient l1-regularized least-squares (LS) approach to obtain sparse range-angle charts at individual measurement or sensing locations. For the subsequent environment mapping, we then introduce a novel state model for mapping diffuse and specular scattering, which allows efficient tracking of individual scatterers over time using interacting multiple model (IMM) extended Kalman filter and smoother. Also the related measurement selection and data association problems are addressed. We provide extensive numerical indoor mapping results at the 28 GHz band deploying OFDM-based 5G NR uplink waveform with 400 MHz channel bandwidth, covering both accurate ray-tracing based as well as actual RF measurement results. The results illustrate the superiority of the dynamic tracking-based solutions, compared to static reference methods, while overall demonstrate the excellent prospects of radio-based mobile environment sensing and mapping in future mm-wave networks.


title: Unidirectional Memory-Self-Attention Transducer for Online Speech Recognition

abstract: Self-attention models have been successfully applied in end-to-end speech recognition systems, which greatly improve the performance of recognition accuracy. However, such attention-based models cannot be used in online speech recognition, because these models usually have to utilize a whole acoustic sequences as inputs. A common method is restricting the field of attention sights by a fixed left and right window, which makes the computation costs manageable yet also introduces performance degradation. In this paper, we propose Memory-Self-Attention (MSA), which adds history information into the Restricted-Self-Attention unit. MSA only needs localtime features as inputs, and efficiently models long temporal contexts by attending memory states. Meanwhile, recurrent neural network transducer (RNN-T) has proved to be a great approach for online ASR tasks, because the alignments of RNN-T are local and monotonic. We propose a novel network structure, called Memory-Self-Attention (MSA) Transducer. Both encoder and decoder of the MSA Transducer contain the proposed MSA unit. The experiments demonstrate that our proposed models improve WER results than Restricted-Self-Attention models by $13.5 on WSJ and $7.1 on SWBD datasets relatively, and without much computation costs increase.


title: Segmentation of spectroscopic images of the low solar atmosphere by the Self Organizing Map technique

abstract: We describe the application of Semantic Segmentation by using the Self Organizing Map technique to an high spatial and spectral resolution dataset acquired along the H$\alpha$ line at 656.28 nm by the Interferometric Bi-dimensional Spectrometer installed at the focus plane of the Dunn Solar Telescope. This machine learning approach allowed us to identify several features corresponding to the main structures of the solar photosphere and chromosphere. The obtained results show the capability and flexibility of this method to identifying and analyzing the fine structures which characterize the solar activity in the low atmosphere. This is a first successful application of the SOM technique to astrophysical data sets.


title: Quantum detector tomography of a high dynamic-range superconducting nanowire single-photon detector

abstract: We demonstrate and verify quantum detector tomography of a superconducting nanowire single-photon detector (SNSPD) in a multiplexing scheme which permits measurement of up to 71000 photons per input pulse. We reconstruct the positive operator valued measure (POVM) of this device in the low photon-number regime, and use the extracted parameters to show the POVMs spanning the whole dynamic range of the device. We verify this by finding the mean photon number of a bright state. Our work shows that a reliable quantum description of large-scale SNSPD devices is possible, and should be applicable to other multiplexing configurations.


title: Near-wall turbulence modulation by small inertial particles

abstract: We use interface-resolved simulations to study near-wall turbulence modulation by small inertial particles, much denser than the fluid, in dilute/semi-dilute conditions. We considered three bulk solid mass fractions, $\Psi=0.34\%$, $3.37\%$ and $33.7\%$, with only the latter two showing turbulence modulation. The increase of the drag is strong at $\Psi=3.37\%$, but mild in the densest case. Actually, two distinct regimes of turbulence modulation emerge: for smaller mass fractions, the turbulence statistics are weakly affected and the near-wall particle accumulation increases the drag so the flow appears as a single phase flow at slightly higher Reynolds number. Conversely, at higher mass fractions, the particles modulate the turbulent dynamics over the entire flow, and the interphase coupling becomes more complex. In this case, fluid Reynolds stresses are attenuated, but the inertial particle dynamics increases the drag via correlated velocity fluctuations leading to an overall drag increase. Hence, we conclude that, although particles at high mass fractions reduce the fluid turbulent drag, the solid phase inertial dynamics may still increase the overall drag. However, inspection of the streamwise momentum budget in the two-way coupling limit of vanishing volume fraction, but finite mass fraction, indicates that this trend could reverse at even higher particle load.


title: Gradient-adjusted Incremental Target Propagation Provides Effective Credit Assignment in Deep Neural Networks

abstract: Many of the recent advances in the field of artificial intelligence have been fueled by the highly successful backpropagation of error (BP) algorithm, which efficiently solves the credit assignment problem in artificial neural networks. However, it is unlikely that BP is implemented in its usual form within biological neural networks, because of its reliance on non-local information in propagating error gradients. Since biological neural networks are capable of highly efficient learning and responses from BP trained models can be related to neural responses, it seems reasonable that a biologically viable approximation of BP underlies synaptic plasticity in the brain. Gradient-adjusted incremental target propagation (GAIT-prop or GP for short) has recently been derived directly from BP and has been shown to successfully train networks in a more biologically plausible manner. However, so far, GP has only been shown to work on relatively low-dimensional problems, such as handwritten-digit recognition. This work addresses some of the scaling issues in GP and shows it to perform effective multi-layer credit assignment in deeper networks and on the much more challenging ImageNet dataset.


title: Heat flux deposition on plasma-facing components using a convective model with ripple and Shafranov shift

abstract: A heat flux deposition code is a very useful tool for the design of plasma-facing components. The classical cosine model representative of the convective parallel heat flux was coded within the standard finite element code of the CEA Castem 2000. Two perturbations to the idealised magnetic surfaces were taken into account: the Shafranov shift and the ripple of the toroidal magnetic field. The calculation scheme -- named Tokaflu -- was confronted to previous computations on bottom modular limiters and to experiments on the inner first wall. The code was used to optimise the shape of future plasma-facing components in Tore Supra designed for the CIEL project, namely the toroidal pumped limiter and its neutralisers. Developments are under way to include the shadowing of the components, other power deposition schemes and possibly later plasma sections other than circular.


title: ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks

abstract: Recently, learning algorithms motivated from sharpness of loss surface as an effective measure of generalization gap have shown state-of-the-art performances. Nevertheless, sharpness defined in a rigid region with a fixed radius, has a drawback in sensitivity to parameter re-scaling which leaves the loss unaffected, leading to weakening of the connection between sharpness and generalization gap. In this paper, we introduce the concept of adaptive sharpness which is scale-invariant and propose the corresponding generalization bound. We suggest a novel learning method, adaptive sharpness-aware minimization (ASAM), utilizing the proposed generalization bound. Experimental results in various benchmark datasets show that ASAM contributes to significant improvement of model generalization performance.


title: Large deviation principle for the cutsets and lower large deviation principle for the maximal flow in first passage percolation

abstract: We consider the standard first passage percolation model in the rescaled lattice $\mathbb Z^d/n$ for $d\geq 2$ and a bounded domain $\Omega$ in $\mathbb R^d$. We denote by $\Gamma^1$ and $\Gamma^2$ two disjoint subsets of $\partial \Omega$ representing respectively the sources and the sinks, \textit{i.e.}, where the water can enter in $\Omega$ and escape from $\Omega$. A cutset is a set of edges that separates $\Gamma ^1$ from $\Gamma^2$ in $\Omega$, it has a capacity given by the sum of the capacities of its edges. Under some assumptions on $\Omega$ and the distribution of the capacities of the edges, we already know a law of large numbers for the sequence of minimal cutsets $(\mathcal E_n^{min})_{n\geq 1}$: the sequence $(\mathcal E_n^{min})_{n\geq 1}$ converges almost surely to the set of solutions of a continuous deterministic problem of minimal cutset in an anisotropic network. We aim here to derive a large deviation principle for cutsets and deduce by contraction principle a lower large deviation principle for the maximal flow in $\Omega$.


title: Degree dependent transmission rates in epidemic processes

abstract: The outcome of SIR epidemics with heterogeneous infective lifetimes, or heterogeneous susceptibilities, can be mapped onto a directed percolation process on the underlying contact network. In this paper we study SIR models where heterogeneity is a result of the degree dependence of disease transmission rates. We develop numerical methods to determine the epidemic threshold, the epidemic probability and epidemic size close to the threshold for configuration model contact networks with arbitrary degree distribution and an arbitrary matrix of transmission rates (dependent on transmitting and receiving node degree). For the special case of separable transmission rates we obtain analytical expressions for these quantities. We propose a categorization of spreading processes based on the ratio of the probability of an epidemic and the expected size of an epidemic, and demonstrate that this ratio has a complex dependence on the degree distribution and the degree-dependent transmission rates. For scale-free contact networks and transmission rates that are power functions of transmitting and receiving node degrees, the epidemic threshold may be finite even when the degree distribution powerlaw exponent is below $\gamma < 3$. We give an expression, in terms of the degree distribution and transmission rate exponents, for the limit at which the epidemic threshold vanishes. We find that the expected epidemic size and the probability of an epidemic may grow nonlinearly above the epidemic threshold, with exponents that depend not only on the degree distribution powerlaw exponent, but on the parameters of the transmission rate degree dependence functions, in contrast to ordinary directed percolation and previously studied variations of the SIR model.


title: SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognition

abstract: Visual Place Recognition (VPR) is the task of matching current visual imagery from a camera to images stored in a reference map of the environment. While initial VPR systems used simple direct image methods or hand-crafted visual features, recent work has focused on learning more powerful visual features and further improving performance through either some form of sequential matcher / filter or a hierarchical matching process. In both cases the performance of the initial single-image based system is still far from perfect, putting significant pressure on the sequence matching or (in the case of hierarchical systems) pose refinement stages. In this paper we present a novel hybrid system that creates a high performance initial match hypothesis generator using short learnt sequential descriptors, which enable selective control sequential score aggregation using single image learnt descriptors. Sequential descriptors are generated using a temporal convolutional network dubbed SeqNet, encoding short image sequences using 1-D convolutions, which are then matched against the corresponding temporal descriptors from the reference dataset to provide an ordered list of place match hypotheses. We then perform selective sequential score aggregation using shortlisted single image learnt descriptors from a separate pipeline to produce an overall place match hypothesis. Comprehensive experiments on challenging benchmark datasets demonstrate the proposed method outperforming recent state-of-the-art methods using the same amount of sequential information. Source code and supplementary material can be found at https://github.com/oravus/seqNet.


title: A 3D Magnetohydrodynamic simulation for the propagation of plasma plume transverse to applied magnetic field

abstract: We have carried out a 3D ideal-MHD (Magnetohydrodynamic) simulation to study the evolution of laser generated plasma plume in a moderate external magnetic field (0.13 T) oriented perpendicular to the flow direction of the plasma plume. The simulation shows that the plasma plume pushes the external magnetic field lines outward in the direction of the expansion. This leads to compression and bending of the magnetic field lines.The force resulting from the change in shape and the density of magnetic field lines opposes the expansion of the plume. An elliptic layer of shocked plasma is formed at the plasma/external field interface leaving a cavity in the plume core due to the outward expansion and the inertia of the plume. As the plasma pressure drops due to expansion, the imbalance between the magnetic energy and the internal energy results in the collapse of the cavity. These observations have striking similarities with the observations of the experiments [Phys. Plasmas 24, 033511 (2017)] performed recently to study the plasma plume expansion in the presence of an external transverse magnetic field. This similarity indicates that the physical mechanisms dominantly governing the plasma plume expansion in the moderate magnetic field are aptly described in the ideal MHD regime. The studies thus show that the laser generated plasma plume can be utilized to carry out interesting experiments on MHD phenomena in a simple laboratory set up.


title: A tier-based typed programming language characterizing Feasible Functionals

abstract: The class of Basic Feasible Functionals BFF$_2$ is the type-2 counterpart of the class FP of type-1 functions computable in polynomial time. Several characterizations have been suggested in the literature, but none of these present a programming language with a type system guaranteeing this complexity bound. We give a characterization of BFF$_2$ based on an imperative language with oracle calls using a tier-based type system whose inference is decidable. Such a characterization should make it possible to link higher-order complexity with programming theory. The low complexity (cubic in the size of the program) of the type inference algorithm contrasts with the intractability of the aforementioned methods and does not overly constrain the expressive power of the language.


title: Palmitic Acid Sophorolipid Biosurfactant: From Self-Assembled Fibrillar Network (SAFiN) To Hydrogels with Fast Recovery

abstract: Nanofibers are an interesting phase into which amphiphilic molecules can self-assemble. Described for a large number of synthetic lipids, they were seldom reported for natural lipids like microbial amphiphiles, known as biosurfactants. In this work, we show that the palmitic acid congener of sophorolipids (SLC16:0), one of the most studied families of biosurfactants, spontaneously forms a self-assembled fiber network (SAFiN) at pH below 6 through a pH jump process. pH-resolved in-situ Small Angle X-ray Scattering (SAXS) shows a continuous micelle-to-fiber transition, characterized by an enhanced core-shell contrast between pH 9 and pH 7 and micellar fusion into flat membrane between pH 7 and pH 6, approximately. Below pH 6, homogeneous, infinitely long nanofibers form by peeling off the membranes. Eventually, the nanofiber network spontaneously forms a thixotropic hydrogel with fast recovery rates after applying an oscillatory strain amplitude out of the linear viscoelastic regime (LVER): after being submitted to strain amplitudes during 5 min, the hydrogel recovers about 80% and 100% of its initial elastic modulus after, respectively, 20 s and 10 min. Finally, the strength of the hydrogel depends on the medium's final pH, with an elastic modulus fivefold higher at pH 3 than at pH 6.


title: Comparison between Thermoelectric and Bolometric Microwave Power Standards

abstract: In the paper, a comparison is described of the microwave power standard based on thermoelectric sensors against an analogous standard based on bolometric sensors. Measurements have been carried out with the classical twin-type microcalorimeter, fitted with N-connector test ports suitable for the frequency band 0.05 - 18 GHz. An appropriate measurand definition is given for being suitable to both standard types. A system accuracy assessment is performed applying the Gaussian error propagation through the mathematical models that interpret the microcalorimeter response in each case. The results highlight advantages and weaknesses of each power standard type.


title: A model for NL and SL decays by $\overline{B}^0 \to D^{**}$ transitions with $BR(j=1/2) \ll BR(j=3/2)$ using the $LLSW$ scheme

abstract: We present a model for the vector and axial form factors of the transitions $\overline{B}^0 \to D^{**}$ in good agreement with the presently available data and based on the present theoretical knowledge, combining a) the safe lattice QCD predictions at $m_Q=\infty$ and $w=1$ ; b) the predictions at general $w$ of a relativistic, covariant quark model at $m_Q=\infty$, including the well tested Godfrey and Isgur spectroscopic model and which agrees with lattice QCD at $w=1$ ; c) the constraint of Bjorken and Neubert relating Semi-leptonic (SL) and Class I Non-leptonic (NL) decays, which shows that $\overline{B}^0 \to D_0(2300)^{+} \pi^-$ strongly constrains $\tau_{1/2}(w)$ to be much smaller than $\tau_{3/2}(w)$, in agreement with the theoretical expectation; d) the general HQET expansion which constrains the $1/m_Q$ corrections (cf \cite{LLSW}, denoted hereafter as $LLSW$). An important element in the understanding of data is the large contribution of virtual $D^{(*)}_V$ to the broad structures seen in SL decays at low $D^{(*)} \pi$ masses - which makes it difficult to isolate the broad resonances denoted as $D_{1/2}$ in the following.


title: A low-cost flexible instrument made of off-the-shelf components for pulsed eddy current testing: overview and application to pseudo-noise excitation

abstract: A flexible and low-cost device for eddy current non-destructive testing made of off-the-shelf components is described. The proposed system is compact and easy to operate, and it consists of a dual H-bridge stepper motor driver, a coil winded in-house on an additively manufactured support, a tunnel magnetoresistance sensor, and a data generation/acquisition module. For the latter, two different commercial devices have been used, and both setups have been then tested on a benchmark sample to detect small artificial cracks. The system can flexibly generate the square pulse or square wave with tunable duration and frequency, as well as pseudo-noise binary waveforms that are here used in combination with pulse-compression to increase the inspection sensitivity with respect to standard pulsed eddy current testing. A benchmark sample was analysed, and all the defects were correctly located, demonstrating the good detection capability of the sensor. This was achieved by assembling a very low-cost handy device, which can be further improved in portability and performances with the use of different off-the-shelf components, and that can be easily integrated with single-board PC, paving the way for future developments in this field.


title: Linking numbers, quandles and groups

abstract: We introduce a quandle invariant of classical and virtual links, denoted $Q_{tc} (L)$. This quandle has the property that $Q_{tc} (L) \cong Q_{tc} (L')$ if and only if the components of $L$ and $L'$ can be indexed in such a way that $L=K_1 \cup \dots \cup K_{\mu}$, $L'=K'_1 \cup \dots \cup K'_{\mu}$ and for each index $i$, there is a multiplier $\epsilon_i \in \{-1,1\}$ that connects virtual linking numbers over $K_i$ in $L$ to virtual linking numbers over $K'_i$ in $L'$: $\ell_{j/i}(K_i,K_j)= \epsilon_i \ell_{j/i}(K'_i,K'_j)$ for all $j \neq i$. We also extend to virtual links a classical theorem of Chen, which relates linking numbers to the nilpotent quotient $G(L)/G(L)_3$.


title: Strain glass versus antisite disorder induced ferromagnetic state in Fe doped Ni-Mn-In Heusler martensites

abstract: Fe doping in Ni$_2$Mn$_{1.5}$In$_{0.5}$ results in suppression of the martensitic phase via two contrasting routes. In Ni$_2$Mn$_{1.5-x}$Fe$_{x}$In$_{0.5}$, the martensitic phase is converted to a strain glassy phase, while in Ni$_{2-y}$Fe$_y$Mn$_{1.5}$In$_{0.5}$, a cubic ferromagnetic phase results at the expense of the martensite. Careful studies of magnetic and structural properties reveal the presence of the impurity $\gamma -$(Fe,Ni) phase as the reason for the emergence of non-ergodic strain glassy phase when Fe is sought to be doped at Y/Z (Mn) sites of X$_2$YZ Heusler alloy. Whereas attempts to dope Fe in the X (Ni) sublattice result in an A2 type antisite disorder that promotes a ferromagnetic ground state.


title: Positive results from UK single gene testing for SARS-COV-2 may be inconclusive, negative or detecting past infections

abstract: The UK Office for National Statistics (ONS) publish a regular infection survey that reports data on positive RT-PCR test results for SARS-COV-2 virus. This survey reports that a large proportion of positive test results may be based on the detection of a single target gene rather than on two or more target genes as required in the manufacturer instructions for use, and by the WHO in their emergency use assessment. Without diagnostic validation, for both the original virus and any variants, it is not clear what can be concluded from a positive test resulting from a single target gene call, especially if there was no confirmatory testing. Given this, many of the reported positive results may be inconclusive, negative or from people who suffered past infection for SARS-COV-2.


title: Homogeneous algebras via heat kernel estimates

abstract: We study homogeneous Besov and Triebel--Lizorkin spaces defined on doubling metric measure spaces in terms of a self-adjoint operator whose heat kernel satisfies Gaussian estimates together with its derivatives. When the measure space is a smooth manifold and such operator is a sum of squares of smooth vector fields, we prove that their intersection with $L^\infty$ is an algebra for pointwise multiplication. Our results apply to nilpotent Lie groups and Grushin settings.


title: Self-Supervised Noisy Label Learning for Source-Free Unsupervised Domain Adaptation

abstract: It is a strong prerequisite to access source data freely in many existing unsupervised domain adaptation approaches. However, source data is agnostic in many practical scenarios due to the constraints of expensive data transmission and data privacy protection. Usually, the given source domain pre-trained model is expected to optimize with only unlabeled target data, which is termed as source-free unsupervised domain adaptation. In this paper, we solve this problem from the perspective of noisy label learning, since the given pre-trained model can pre-generate noisy label for unlabeled target data via directly network inference. Under this problem modeling, incorporating self-supervised learning, we propose a novel Self-Supervised Noisy Label Learning method, which can effectively fine-tune the pre-trained model with pre-generated label as well as selfgenerated label on the fly. Extensive experiments had been conducted to validate its effectiveness. Our method can easily achieve state-of-the-art results and surpass other methods by a very large margin. Code will be released.


title: Models we Can Trust: Toward a Systematic Discipline of (Agent-Based) Model Interpretation and Validation

abstract: We advocate the development of a discipline of interacting with and extracting information from models, both mathematical (e.g. game-theoretic ones) and computational (e.g. agent-based models). We outline some directions for the development of a such a discipline: - the development of logical frameworks for the systematic formal specification of stylized facts and social mechanisms in (mathematical and computational) social science. Such frameworks would bring to attention new issues, such as phase transitions, i.e. dramatical changes in the validity of the stylized facts beyond some critical values in parameter space. We argue that such statements are useful for those logical frameworks describing properties of ABM. - the adaptation of tools from the theory of reactive systems (such as bisimulation) to obtain practically relevant notions of two systems "having the same behavior". - the systematic development of an adversarial theory of model perturbations, that investigates the robustness of conclusions derived from models of social behavior to variations in several features of the social dynamics. These may include: activation order, the underlying social network, individual agent behavior.


title: Assessing the correctness of pressure correction to solvation theories in the study of electron transfer reactions

abstract: Liquid states theories have emerged as a numerically efficient alternative to costly molecular dynamics simulations of electron transfer reactions in solution. In a recent paper [Chem. Sci., 2019, 10, 2130], we introduced the framework to compute energy gap, free energy profile and reorganization free energy using molecular density functional theory. However, this technique, as other molecular liquid state theories, overestimates the bulk pressure of the fluids. Because of the too high pressure, the predicted free energy is dramatically exaggerated. Several attempts were made to fix this issue, either based on simple a posteriori correction or by improving the description of the liquid introducing bridge terms. By studying two model half reactions in water, Cl -> Cl+ and Cl -> Cl-, we assess the correctness of these two types of corrections to study electron transfer reactions. We found that a posteriori corrections, because they violate the functional principle, lead to an inconsistency in the definition of the reorganization free energy and should not be used to study electron transfer reactions. The bridge approach, because it is theoretically well grounded, is perfectly suitable for this type of systems.


title: A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020

abstract: Co-speech gestures, gestures that accompany speech, play an important role in human communication. Automatic co-speech gesture generation is thus a key enabling technology for embodied conversational agents (ECAs), since humans expect ECAs to be capable of multi-modal communication. Research into gesture generation is rapidly gravitating towards data-driven methods. Unfortunately, individual research efforts in the field are difficult to compare: there are no established benchmarks, and each study tends to use its own dataset, motion visualisation, and evaluation methodology. To address this situation, we launched the GENEA Challenge, a gesture-generation challenge wherein participating teams built automatic gesture-generation systems on a common dataset, and the resulting systems were evaluated in parallel in a large, crowdsourced user study using the same motion-rendering pipeline. Since differences in evaluation outcomes between systems now are solely attributable to differences between the motion-generation methods, this enables benchmarking recent approaches against one another in order to get a better impression of the state of the art in the field. This paper reports on the purpose, design, results, and implications of our challenge.


title: Highly persistent spin textures with giant tunable spin splitting in the two-dimensional germanium monochalcogenides

abstract: The ability to control the spin textures in semiconductors is a fundamental step toward novel spintronic devices, while seeking desirable materials exhibiting persistent spin texture (PST) remains a key challenge. The PST is the property of materials preserving a unidirectional spin orientation in the momentum space, which has been predicted to support an extraordinarily long spin lifetime of carriers. Herein, by using first-principles density functional theory calculations, we report the emergence of the PST in the two-dimensional (2D) germanium monochalcogenides (GeMC). By considering two stable formations of the 2D GeMC, namely the pure GeX and Janus Ge2XY monolayers (X, Y = S, Se, and Te), we observed the PST around the valence band maximum where the spin orientation is enforced by the lower point group symmetry of the crystal. In the case of the pure GeX monolayers, we found that the PST is characterized by fully out-of-plane spin orientation protected by C2v point group, while the canted PST in the y-z plane is observed in the case of the Janus Ge2XY monolayers due to the lowering symmetry into Cs point group. More importantly, we find large spin-orbit coupling (SOC) parameter in which the PST sustains, which could be effectively tuned by in-plane strain. The large SOC parameter observed in the present systems leads to the small wavelength of the spatially periodic mode of the spin polarization, which is promising for short spin channel in the spin Hall transistor devices.


title: Lower Bounds on the State Complexity of Population Protocols

abstract: Population protocols are a model of computation in which an arbitrary number of indistinguishable finite-state agents interact in pairs. The goal of the agents is to decide by stable consensus whether their initial global configuration satisfies a given property, specified as a predicate on the set of configurations. The state complexity of a predicate is the number of states of a smallest protocol that computes it. Previous work by Blondin \textit{et al.} has shown that the counting predicates $x \geq \eta$ have state complexity $\mathcal{O}(\log \eta)$ for leaderless protocols and $\mathcal{O}(\log \log \eta)$ for protocols with leaders. We obtain the first non-trivial lower bounds: the state complexity of $x \geq \eta$ is $\Omega(\log\log \eta)$ for leaderless protocols, and the inverse of a non-elementary function for protocols with leaders.


title: Extraction of inherent polarization modes from a single light beam

abstract: Superposition of two independent orthogonally polarized beams is a conventional principle of creating a new light beam. Here, we intend to achieve the inverse process, namely, extracting inherent polarization modes from a single light beam. However, inherent polarization modes within a light beam are always entangled so that a stable polarization is maintained during propagation in free space. To overcome this limitation, we report an approach that breaks the modulation symmetry of a light beam, thereby disentangling the inherent polarization modes. Using polarization mode competition along with an optical pen, polarization modes are extracted at will in the focal region of an objective lens. This work demonstrates polarization mode extraction from a light beam, which will not only provide an entirely new principle of polarization modulation but also pave the way for multidimensional manipulation of light fields, thereby facilitating extensive developments in optics.


title: An isoperimetric problem for three-dimensional parallelohedra

abstract: The aim of this note is to investigate isoperimetric-type problems for $3$-dimensional parallelohedra; that is, for convex polyhedra whose translates tile the $3$-dimensional Euclidean space. Our main result states that among $3$-dimensional parallelohedra with unit volume the one with minimal mean width is the regular truncated octahedron.


title: Gromov-Witten theory and Noether-Lefschetz theory for holomorphic-symplectic varieties

abstract: We use Noether-Lefschetz theory to study the reduced Gromov--Witten invariants of a holomorphic-symplectic variety of $K3^{[n]}$-type. This yields strong evidence for a new conjectural formula that expresses Gromov-Witten invariants of this geometry for arbitrary classes in terms of primitive classes. The formula generalizes an earlier conjecture by Pandharipande and the author for K3 surfaces. Using Gromov-Witten techniques we also determine the generating series of Noether-Lefschetz numbers of a general pencil of Debarre-Voisin varieties. This reproves and extends a result of Debarre, Han, O'Grady and Voisin on HLS divisors on the moduli space of Debarre-Voisin fourfolds.


title: PIERES: A Playground for Network Interrupt Experiments on Real-Time Embedded Systems in the IoT

abstract: IoT devices have become an integral part of our lives and the industry. Many of these devices run real-time systems or are used as part of them. As these devices receive network packets over IP networks, the network interface informs the CPU about their arrival using interrupts that might preempt critical processes. Therefore, the question arises whether network interrupts pose a threat to the real-timeness of these devices. However, there are few tools to investigate this issue. We present a playground which enables researchers to conduct experiments in the context of network interrupt simulation. The playground comprises different network interface controller implementations, load generators and timing utilities. It forms a flexible and easy to use foundation for future network interrupt research. We conduct two verification experiments and two real world examples. The latter give insight into the impact of the interrupt handling strategy parameters and the influence of different load types on the execution time with respect to these parameters.


title: Many Electrons and the Photon Field -- The many-body structure of nonrelativistic quantum electrodynamics

abstract: Recent experimental progress in the field of cavity quantum electrodynamics allows to study the regime of strong interaction between quantized light and complex matter systems. Due to the coherent coupling between photons and matter-degrees of freedom, polaritons -- hybrid light-matter quasiparticles -- emerge, which can significantly influence matter properties and complex processes such as chemical reactions (strong coupling). In this thesis we propose a way to overcome these problems by reformulating the coupled electron-photon problem in an exact way in a different, purpose-build Hilbert space, where no longer electrons and photons are the basic physical entities but the polaritons. Representing an N-electron-M-mode system by an N-polariton wave function with hybrid Fermi-Bose statistics, we show explicitly how to turn electronic-structure methods into polaritonic-structure methods that are accurate from the weak to the strong-coupling regime. We elucidate this paradigmatic shift by a comprehensive review of light-matter coupling, as well as by highlighting the connection between different electronic-structure methods and quantum-optical models. This extensive discussion accentuates that the polariton description is not only a mathematical trick, but it is grounded in a simple and intuitive physical argument: when the excitations of a system are hybrid entities a formulation of the theory in terms of these new entities is natural. Finally, we discuss in great detail how to adopt standard algorithms of electronic-structure methods to adhere to the new hybrid Fermi-Bose statistics. Guaranteeing the corresponding nonlinear inequality constraints in practice requires a careful development, implementation and validation of numerical algorithms. This extra numerical complexity is the price we pay for making the coupled matter-photon problem feasible for first-principle methods.


title: Assessing the Readability of Policy Documents on the Digital Single Market of the European Union

abstract: Today, literature skills are necessary. Engineering and other technical professions are not an exception from this requirement. Traditionally, technical reading and writing have been framed with a limited scope, containing documentation, specifications, standards, and related text types. Nowadays, however, the scope covers also other text types, including legal, policy, and related documents. Given this motivation, this paper evaluates the readability of 201 legislations and related policy documents in the European Union (EU). The digital single market (DSM) provides the context. Five classical readability indices provide the methods; these are quantitative measures of a text's readability. The empirical results indicate that (i) generally a Ph.D. level education is required to comprehend the DSM laws and policy documents. Although (ii) the results vary across the five indices used, (iii) readability has slightly improved over time.


title: Fast acquisition of spin-wave dispersion by compressed sensing

abstract: For the realization of magnonic devices, spin-wave dispersions need to be identified. Recently, the time-resolved pump-probe imaging method combined with the Fourier transform was demonstrated for obtaining the dispersions in the lower-wavenumber regime. However, the measurement takes a long time when the sampling rate is sufficiently high. Here, we demonstrated the fast acquisition of spin-wave dispersions by using the compressed sensing technique. Further, we quantitatively evaluated the consistency of the results. Our results can be applied to other various pump-probe measurements, such as observations based on the electro-optical effects.


title: Non-stationary GARCH modelling for fitting higher order moments of financial series within moving time windows

abstract: Here, we have analysed a GARCH(1,1) model with the aim to fit higher order moments for different companies' stock prices. When we assume a gaussian conditional distribution, we fail to capture any empirical data when fitting the first three even moments of financial time series. We show instead that a double gaussian conditional probability distribution better captures the higher order moments of the data. To demonstrate this point, we construct regions (phase diagrams), in the fourth and sixth order standardised moment space, where a GARCH(1,1) model can be used to fit these moments and compare them with the corresponding moments from empirical data for different sectors of the economy. We found that the ability of the GARCH model with a double gaussian conditional distribution to fit higher order moments is dictated by the time window our data spans. We can only fit data collected within specific time window lengths and only with certain parameters of the conditional double gaussian distribution. In order to incorporate the non-stationarity of financial series, we assume that the parameters of the GARCH model have time dependence.


title: FINE Samples for Learning with Noisy Labels

abstract: Modern deep neural networks (DNNs) become frail when the datasets contain noisy (incorrect) class labels. Robust techniques in the presence of noisy labels can be categorized into two folds: developing noise-robust functions or using noise-cleansing methods by detecting the noisy data. Recently, noise-cleansing methods have been considered as the most competitive noisy-label learning algorithms. Despite their success, their noisy label detectors are often based on heuristics more than a theory, requiring a robust classifier to predict the noisy data with loss values. In this paper, we propose a novel detector for filtering label noise. Unlike most existing methods, we focus on each data's latent representation dynamics and measure the alignment between the latent distribution and each representation using the eigendecomposition of the data gram matrix. Our framework, coined as filtering noisy instances via their eigenvectors (FINE), provides a robust detector with derivative-free simple methods having theoretical guarantees. Under our framework, we propose three applications of the FINE: sample-selection approach, semi-supervised learning approach, and collaboration with noise-robust loss functions. Experimental results show that the proposed methods consistently outperform corresponding baselines for all three applications on various benchmark datasets.


title: Bayesian uncertainty quantification for data-driven equation learning

abstract: Equation learning aims to infer differential equation models from data. While a number of studies have shown that differential equation models can be successfully identified when the data are sufficiently detailed and corrupted with relatively small amounts of noise, the relationship between observation noise and uncertainty in the learned differential equation models remains unexplored. We demonstrate that for noisy data sets there exists great variation in both the structure of the learned differential equation models as well as the parameter values. We explore how to combine data sets to quantify uncertainty in the learned models, and at the same time draw mechanistic conclusions about the target differential equations. We generate noisy data using a stochastic agent-based model and combine equation learning methods with approximate Bayesian computation (ABC) to show that the correct differential equation model can be successfully learned from data, while a quantification of uncertainty is given by a posterior distribution in parameter space.


title: Decision Power of Weak Asynchronous Models of Distributed Computing

abstract: Esparza and Reiter have recently conducted a systematic comparative study of models of distributed computing consisting of a network of identical finite-state automata that cooperate to decide if the underlying graph of the network satisfies a given property. The study classifies models according to four criteria, and shows that twenty initially possible combinations collapse into seven equivalence classes with respect to their decision power, i.e. the properties that the automata of each class can decide. However, Esparza and Reiter only show (proper) inclusions between the classes, and so do not characterise their decision power. In this paper we do so for labelling properties, i.e. properties that depend only on the labels of the nodes, but not on the structure of the graph. In particular, majority (whether more nodes carry label $a$ than $b$) is a labelling property. Our results show that only one of the seven equivalence classes identified by Esparza and Reiter can decide majority for arbitrary networks. We then study the expressive power of the classes on bounded-degree networks, and show that three classes can. In particular, we present an algorithm for majority that works for all bounded-degree networks under adversarial schedulers, i.e. even if the scheduler must only satisfy that every node makes a move infinitely often, and prove that no such algorithm can work for arbitrary networks.


title: Template banks based on $\mathbb{Z}^n$ and $A_n^*$ lattices

abstract: Matched filtering is a traditional method used to search a data stream for signals. If the source (and hence its $n$ parameters) are unknown, many filters must be employed. These form a grid in the $n$-dimensional parameter space, known as a template bank. It is often convenient to construct these grids as a lattice. Here, we examine some of the properties of these template banks for $\mathbb{Z}^n$ and $A_n^*$ lattices. In particular, we focus on the distribution of the mismatch function, both in the traditional quadratic approximation and in the recently-proposed spherical approximation. The fraction of signals which are lost is determined by the even moments of this distribution, which we calculate. Many of these quantities we examine have a simple and well-defined $n\to\infty$ limit, which often gives an accurate estimate even for small $n$. Our main conclusions are the following: (i) a fairly effective template-based search can be constructed at mismatch values that are shockingly high in the quadratic approximation; (ii) the minor advantage offered by an $A_n^*$ template bank (compared to $\mathbb{Z}^n$) at small template separation becomes even less significant at large mismatch. So there is little motivation for using template banks based on the $A_n^*$ lattice.


title: Quenched local convergence of Boltzmann planar maps

abstract: Stephenson~(2018) established annealed local convergence of Boltzmann planar maps conditioned to be large. The present work uses results on rerooted multi-type branching trees to prove a quenched version of this limit.


title: The first GeV flare of the radio-loud narrow-line Seyfert 1 galaxy PKS 2004-447

abstract: On 2019 October 25, the Fermi-Large Area Telescope observed the first gamma-ray flare from the radio-loud narrow-line Seyfert 1 (NLSy 1) galaxy PKS 2004$-$447 ($z=0.24$). We report on follow-up observations in the radio, optical-UV, and X-ray bands that were performed by ATCA, the Neil Gehrels Swift observatory, XMM-Newton, and NuSTAR, respectively, and our multi-wavelength analysis. We study the variability across all energy bands and additionally produce $\gamma$-ray light curves with different time binnings to study the variability on short timescales during the flare. We examine the X-ray spectrum from 0.5$-$50 keV by describing the spectral shape with an absorbed power law. We analyse multi-wavelength datasets before, during, and after the flare and compare these with a low activity state of the source by modelling the respective SEDs with a one-zone synchrotron inverse Compton radiative model. Finally, we compare our results to gamma-ray flares previously observed from other $\gamma$-loud NLSy 1 galaxies. At gamma-ray energies (0.1$-$300 GeV) the flare reached a total maximum flux of $(2.7\pm0.6)\times10^{-6}$~ph~cm$^{-2}$~s$^{-1}$ in 3-hour binning. With a photon index of $\Gamma_{0.1-300\mathrm{GeV}}=2.42\pm0.09$ during the flare, this corresponds to an isotropic gamma-ray luminosity of $(2.9\pm0.8)\times10^{47}\,\mathrm{erg}\,\mathrm{s}^{-1}$. The $\gamma$-ray, X-ray, and optical-UV light curves covering the end of September to the middle of November show significant variability, and we find indications for flux-doubling times of $\sim 2.2$~hours at $\gamma$-ray energies. During the flare, the SED exhibits large Compton dominance. While the increase in the optical-UV range can be explained by enhanced synchrotron emission, the elevated $\gamma$-ray flux can be accounted for by an increase in the bulk Lorentz factor of the jet, similarly observed for flaring gamma-ray blazars.


title: Dual-Path Modeling for Long Recording Speech Separation in Meetings

abstract: The continuous speech separation (CSS) is a task to separate the speech sources from a long, partially overlapped recording, which involves a varying number of speakers. A straightforward extension of conventional utterance-level speech separation to the CSS task is to segment the long recording with a size-fixed window and process each window separately. Though effective, this extension fails to model the long dependency in speech and thus leads to sub-optimum performance. The recent proposed dual-path modeling could be a remedy to this problem, thanks to its capability in jointly modeling the cross-window dependency and the local-window processing. In this work, we further extend the dual-path modeling framework for CSS task. A transformer-based dual-path system is proposed, which integrates transform layers for global modeling. The proposed models are applied to LibriCSS, a real recorded multi-talk dataset, and consistent WER reduction can be observed in the ASR evaluation for separated speech. Also, a dual-path transformer equipped with convolutional layers is proposed. It significantly reduces the computation amount by 30% with better WER evaluation. Furthermore, the online processing dual-path models are investigated, which shows 10% relative WER reduction compared to the baseline.


title: A spectrally stratified hot accretion flow in the hard state of MAXI J1820+070

abstract: We study the structure of the accretion flow in the hard state of the black-hole X-ray binary MAXI~J1820+070 with \nicer data. The power spectra show broadband variability which can be fit with four Lorentzian components peaking at different time scales. Extracting power spectra as a function of energy enables the energy spectra of these different power spectral components to be reconstructed. We found significant spectral differences among Lorentzians, with the one corresponding to the shortest variability time scales displaying the hardest spectrum. Both the variability spectra and the time-averaged spectrum are well-modelled by a disc blackbody and thermal Comptonization, but the presence of (at least) two Comptonization zones with different temperatures and optical depths is required. The disc blackbody component is highly variable, but only in the variability components peaking at the longest time scales ($\gsim1$ s). The seed photons for the spectrally harder zone come predominantly from the softer Comptonization zone. Our results require the accretion flow in this source to be structured, and cannot be described by a single Comptonization region upscattering disc blackbody photons, and reflection from the disc.


title: Using a deep neural network to predict the motion of under-resolved triangular rigid bodies in an incompressible flow

abstract: We consider non-spherical rigid body particles in an incompressible fluid in the regime where the particles are too large to assume that they are simply transported with the fluid without back-coupling and where the particles are also too small to make fully resolved direct numerical simulations feasible. Unfitted finite element methods with ghost-penalty stabilisation are well suited to fluid-structure-interaction problems as posed by this setting, due to the flexible and accurate geometry handling and for allowing topology changes in the geometry. In the computationally under resolved setting posed here, accurate computations of the forces by their boundary integral formulation are not viable. Furthermore, analytical laws are not available due to the shape of the particles. However, accurate values of the forces are essential for realistic motion of the particles. To obtain these forces accurately, we train an artificial deep neural network using data from prototypical resolved simulations. This network is then able to predict the force values based on information which can be obtained accurately in an under-resolved setting. As a result, we obtain forces on very coarse and under-resolved meshes which are on average an order of magnitude more accurate compared to the direct boundary-integral computation from the Navier-Stokes solution, leading to solid motion comparable to that obtained on highly resolved meshes that would substantially increase the simulation costs.

categories: physics.flu-dyn cs.NA math.NA physics.comp-ph


title: Mott insulator of strongly interacting two-dimensional excitons

abstract: In condensed-matter physics, electronic Mott insulators have triggered considerable research due to their intricate relation with high-temperature superconductors. However, unlike atomic systems for which Mott phases were recently shown for both bosonic and fermionic species, in the solid-state the fingerprint of a Mott insulator implemented with bosons is yet to be found. Here we unveil such signature by exploring the Bose-Hubbard hamiltonian using semiconductor excitons confined in two-dimensional lattices. We emphasise the regime where on-site interactions are comparable to the energy separation between lattice confined states. We then observe that Mott phases are accessible, with at most two excitons uniformly filling lattice sites. The technology introduced here allows us to program on-demand the geometry of the lattice confining excitons. This versatility, combined with the long-range nature of dipolar interactions between excitons, provide a new route to explore many-body phases spontaneously breaking the lattice symmetry.


title: Enhancing Data-Free Adversarial Distillation with Activation Regularization and Virtual Interpolation

abstract: Knowledge distillation refers to a technique of transferring the knowledge from a large learned model or an ensemble of learned models to a small model. This method relies on access to the original training set, which might not always be available. A possible solution is a data-free adversarial distillation framework, which deploys a generative network to transfer the teacher model's knowledge to the student model. However, the data generation efficiency is low in the data-free adversarial distillation. We add an activation regularizer and a virtual interpolation method to improve the data generation efficiency. The activation regularizer enables the students to match the teacher's predictions close to activation boundaries and decision boundaries. The virtual interpolation method can generate virtual samples and labels in-between decision boundaries. Our experiments show that our approach surpasses state-of-the-art data-free distillation methods. The student model can achieve 95.42% accuracy on CIFAR-10 and 77.05% accuracy on CIFAR-100 without any original training data. Our model's accuracy is 13.8% higher than the state-of-the-art data-free method on CIFAR-100.


title: Commutative Action Logic

abstract: We prove undecidability and pinpoint the place in the arithmetical hierarchy for commutative action logic, that is, the equational theory of commutative residuated Kleene lattices (action lattices), and infinitary commutative action logic, the equational theory of *-continuous action lattices. Namely, we prove that the former is $\Sigma_1^0$-complete and the latter is $\Pi_1^0$-complete. Thus, the situation is the same as in the more well-studied non-commutative case. The methods used, however, are different: we encode infinite and circular computations of counter (Minsky) machines.


title: Mass and density of the transiting hot and rocky super-Earth LHS 1478 b (TOI-1640 b)

abstract: One of the main objectives of the Transiting Exoplanet Survey Satellite ({TESS}) mission is the discovery of small rocky planets around relatively bright nearby stars. Here, we report the discovery and characterization of the transiting super-Earth planet orbiting LHS~1478 (TOI-1640). The star is an inactive red dwarf ($J \sim 9.6$\,mag and spectral type m3\,V) with mass and radius estimates of $0.20\pm0.01$\,$M_{\odot}$ and $0.25\pm0.01$\,$R_{\odot}$, respectively, and an effective temperature of $3381\pm54$\,K.It was observed by \tess in four sectors. These data revealed a transit-like feature with a period of 1.949 days. We combined the TESS data with three ground-based transit measurements, 57 radial velocity (RV) measurements from CARMENES, and 13 RV measurements from IRD, determining that the signal is produced by a planet with a mass of $2.33^{+0.20}_{-0.20}$\,$M_{\oplus}$ and a radius of $1.24^{+0.05}_{-0.05}$\,$R_{\oplus}$. The resulting bulk density of this planet is 6.67\,g\,cm$^{-3}$, which is consistent with a rocky planet with an Fe- and MgSiO$_3$-dominated composition. Although the planet would be too hot to sustain liquid water on its surface (its equilibrium temperature is about $\sim$595\,K, suggesting a Venus-like atmosphere), spectroscopic metrics based on the capabilities of the forthcoming James Webb Space Telescope and the fact that the host star is rather inactive indicate that this is one of the most favorable known rocky exoplanets for atmospheric characterization.


title: Syntactic completeness of proper display calculi

abstract: A recent strand of research in structural proof theory aims at exploring the notion of analytic calculi (i.e. those calculi that support general and modular proof-strategies for cut elimination), and at identifying classes of logics that can be captured in terms of these calculi. In this context, Wansing introduced the notion of proper display calculi as one possible design framework for proof calculi in which the analiticity desiderata are realized in a particularly transparent way. Recently, the theory of properly displayable logics (i.e. those logics that can be equivalently presented with some proper display calculus) has been developed in connection with generalized Sahlqvist theory (aka unified correspondence). Specifically, properly displayable logics have been syntactically characterized as those axiomatized by analytic inductive axioms, which can be equivalently and algorithmically transformed into analytic structural rules so that the resulting proper display calculi enjoy a set of basic properties: soundness, completeness, conservativity, cut elimination and subformula property. In this context, the proof that the given calculus is complete w.r.t. the original logic is usually carried out syntactically, i.e. by showing that a (cut free) derivation exists of each given axiom of the logic in the basic system to which the analytic structural rules algorithmically generated from the given axiom have been added. However, so far this proof strategy for syntactic completeness has been implemented on a case-by-case base, and not in general. In this paper, we address this gap by proving syntactic completeness for properly displayable logics in any normal (distributive) lattice expansion signature. Specifically, we show that for every analytic inductive axiom a cut free derivation can be effectively generated which has a specific shape, referred to as pre-normal form.


title: High-precision determination of the electric and magnetic radius of the proton

abstract: Using dispersion theory with an improved description of the two-pion continuum based on the precise Roy-Steiner analysis of pion-nucleon scattering, we analyze recent data from electron-proton scattering. This allows for a high-precision determination of the electric and magnetic radius of the proton, $r_E = (0.838^{+0.005}_{-0.004}{}^{+0.004}_{-0.003})\,$fm and $r_M = (0.847\pm{0.004}\pm{0.004})\,$fm, where the first error refers to the fitting procedure using bootstrap and the data while the second one refers to the systematic uncertainty related to the underlying spectral functions.


title: Insight into the structure-property relation of UO2 nanoparticles

abstract: Highly crystalline UO2 nanoparticles (NPs) with sizes of 2-3 nm were produced by fast chemical deposition of uranium(IV) under reducing conditions at pH 8-11. The particles were then characterized by microscopic and spectroscopic techniques including high-resolution transmission electron microscopy (HRTEM), X-ray diffraction (XRD), high-energy resolution fluorescence detection (HERFD) X-ray absorption spectroscopy at the U M4 edge and extended X-ray absorption fine structure (EXAFS) spectroscopy at the U L3 edge. The results of this investigation show that despite U(IV) being the dominant oxidation state of the freshly prepared UO2 NPs, they oxidize to U4O9 with time and under the X-ray beam, indicating the high reactivity of U(IV) under these conditions. Moreover, it was found that the oxidation process of NPs is accompanied by their growth in size to 6 nm. We highlight here the major differences and similarities of the UO2 NPs properties with PuO2, ThO2 and CeO2 NPs.


title: Higher order phase averaging for highly oscillatory systems

abstract: We introduce a higher order phase averaging method for nonlinear oscillatory systems. Phase averaging is a technique to filter fast motions from the dynamics whilst still accounting for their effect on the slow dynamics. Phase averaging is useful for deriving reduced models that can be solved numerically with more efficiency, since larger timesteps can be taken. Recently, Haut and Wingate (2014) introduced the idea of computing finite window numerical phase averages in parallel as the basis for a coarse propagator for a parallel-in-time algorithm. In this contribution, we provide a framework for higher order phase averages that aims to better approximate the unaveraged system whilst still filtering fast motions. Whilst the basic phase average assumes that the solution independent of changes of phase, the higher order method expands the phase dependency in a basis which the equations are projected onto. In this new framework, the original numerical phase averaging formulation arises as the lowest order version of this expansion. Our new projection onto functions that are $k$th degree polynomials in the phase gives rise to higher order corrections to the phase averaging formulation. We illustrate the properties of this method on an ODE that describes the dynamics of a swinging spring due to Lynch (2002). Although idealized, this model shows an interesting analogy to geophysical flows as it exhibits a slow dynamics that arises through the resonance between fast oscillations. On this example, we show convergence to the non-averaged (exact) solution with increasing approximation order also for finite averaging windows. At zeroth order, our method coincides with a standard phase average, but at higher order it is more accurate in the sense that solutions of the phase averaged model track the solutions of the unaveraged equations more accurately.


title: Dyadic Martingale Hardy-amalgam spaces: Embeddings and Duality

abstract: We present in this paper some embeddings of various dyadic martingale Hardy-amalgam spaces $H^S_{p,q},\,\, H^s_{p,q},\,\,H^*_{p,q},\,\,\mathcal{Q}_{p,q}$ and $\mathcal{P}_{p,q}$ of the real line. In the same settings, we characterize the dual of $H^s_{p,q}$ for large $p$ and $q$. We also introduce a Garsia-type space $\mathcal{G}_{p,q}$ and characterize its dual space.


title: HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search

abstract: Realistic use of neural networks often requires adhering to multiple constraints on latency, energy and memory among others. A popular approach to find fitting networks is through constrained Neural Architecture Search (NAS), however, previous methods enforce the constraint only softly. Therefore, the resulting networks do not exactly adhere to the resource constraint and their accuracy is harmed. In this work we resolve this by introducing Hard Constrained diffeRentiable NAS (HardCoRe-NAS), that is based on an accurate formulation of the expected resource requirement and a scalable search method that satisfies the hard constraint throughout the search. Our experiments show that HardCoRe-NAS generates state-of-the-art architectures, surpassing other NAS methods, while strictly satisfying the hard resource constraints without any tuning required.


title: How attractive and repulsive interactions affect structure ordering and dynamics of glass-forming liquids?

abstract: The theory developed in our previous papers is applied in this paper to investigate the dependence of slowing down of dynamics of glass-forming liquids on the attractive and repulsive parts of intermolecular interactions. Through an extensive comparison of the behavior of a Lennard-Jones glass-forming liquid and that of its WCA reduction to a model with truncated pair potential without attractive tail, we demonstrate why the two systems exhibit very different dynamics despite having nearly identical pair correlation functions. In particular, we show that local structures characterized by number of mobile and immobile particles around a central particle markedly differ in the two systems at densities and temperatures where their dynamics show large difference and nearly identical where dynamics nearly overlap. We also show how the parameter {\psi}(T ) that measures the role of fluctuations embedded in the system on size of the cooperatively reorganizing cluster (CRC) and the crossover temperature T a depend on the intermolecular interactions. These parameters stemming from the intermolecular interactions characterize the temperature and density dependence of structural relaxation time {\tau} {\alpha}. The quantitative and qualitative agreements found with simulation results for the two systems suggest that our theory brings out the underlying features that determine dynamics of glass-forming liquids.


title: Non-uniqueness in quasar absorption models and implications for measurements of the fine structure constant

abstract: High resolution spectra of quasar absorption systems provide the best constraints on temporal or spatial changes of fundamental constants in the early universe. An important systematic that has never before been quantified concerns model non-uniqueness. The absorption structure is generally complicated, comprising many blended lines. This characteristic means any given system can be fitted equally well by many slightly different models, each having a different value of \alpha, the fine structure constant. We use AI Monte Carlo modelling to quantify non-uniqueness. Extensive supercomputer calculations are reported, revealing new systematic effects that guide future analyses: (i) Whilst higher signal to noise and improved spectral resolution produces a smaller statistical uncertainty for \alpha, model non-uniqueness adds a significant additional uncertainty. (ii) Non-uniqueness depends on the line broadening mechanism used. We show that modelling the spectral data using turbulent line broadening results in far greater non-uniqueness, hence this should no longer be done. Instead, for varying \alpha studies, it is important to use the more physically appropriate compound broadening. (iii) We have studied two absorption systems in detail. Generalising thus requires caution. Nevertheless, if non-uniqueness is present in all or most quasar absorption systems, it seems unavoidable that attempts to determine the existence (or non-existence) of spacetime variations of fundamental constants is best approached using a statistical sample.

categories: astro-ph.CO astro-ph.GA astro-ph.IM gr-qc


title: Relative induction principles for type theories

abstract: We present new induction principles for the syntax of dependent type theories, which we call relative induction principles. The result of the induction principle relative to a functor F into the syntax is stable over the codomain of F. We rely on the internal language of presheaf categories. In order to combine the internal languages of multiple presheaf categories, we use Dependent Right Adjoints and Multimodal Type Theory. Categorical gluing is used to prove these induction principles, but it not visible in their statements, which involve a notion of model without context extensions. As example applications of these induction principles, we give short and boilerplate-free proofs of canonicity and normalization for some small type theories, and sketch proofs of other metatheoretic results.


title: Unsupervised Brain Anomaly Detection and Segmentation with Transformers

abstract: Pathological brain appearances may be so heterogeneous as to be intelligible only as anomalies, defined by their deviation from normality rather than any specific pathological characteristic. Amongst the hardest tasks in medical imaging, detecting such anomalies requires models of the normal brain that combine compactness with the expressivity of the complex, long-range interactions that characterise its structural organisation. These are requirements transformers have arguably greater potential to satisfy than other current candidate architectures, but their application has been inhibited by their demands on data and computational resource. Here we combine the latent representation of vector quantised variational autoencoders with an ensemble of autoregressive transformers to enable unsupervised anomaly detection and segmentation defined by deviation from healthy brain imaging data, achievable at low computational cost, within relative modest data regimes. We compare our method to current state-of-the-art approaches across a series of experiments involving synthetic and real pathological lesions. On real lesions, we train our models on 15,000 radiologically normal participants from UK Biobank, and evaluate performance on four different brain MR datasets with small vessel disease, demyelinating lesions, and tumours. We demonstrate superior anomaly detection performance both image-wise and pixel-wise, achievable without post-processing. These results draw attention to the potential of transformers in this most challenging of imaging tasks.


title: A Novel Deep Learning Method for Textual Sentiment Analysis

abstract: Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional neural networks have obtained remarkable results in recent years, they are still confronted with some limitations. Firstly, they consider that all words in a sentence have equal contributions in the sentence meaning representation and are not able to extract informative words. Secondly, they require a large number of training data to obtain considerable results while they have many parameters that must be accurately adjusted. To this end, a convolutional neural network integrated with a hierarchical attention layer is proposed which is able to extract informative words and assign them higher weight. Moreover, the effect of transfer learning that transfers knowledge learned in the source domain to the target domain with the aim of improving the performance is also explored. Based on the empirical results, the proposed model not only has higher classification accuracy and can extract informative words but also applying incremental transfer learning can significantly enhance the classification performance.


title: An ecologically valid examination of event-based and time-based prospective memory using immersive virtual reality: the influence of attention, memory, and executive function processes on real-world prospective memory

abstract: Studies on prospective memory (PM) predominantly assess either event- or time-based PM by implementing non-ecological laboratory-based tasks. The results deriving from these paradigms have provided findings that are discrepant with ecologically valid research paradigms that converge on the complexity and cognitive demands of everyday tasks. The Virtual Reality Everyday Assessment Lab (VR-EAL), an immersive virtual reality (VR) neuropsychological battery with enhanced ecological validity, was implemented to assess everyday event- and time-based PM, as well as the influence of other cognitive functions on everyday PM functioning. The results demonstrated the importance of delayed recognition, planning, and visuospatial attention on everyday PM. Delayed recognition and planning ability were found to be central in event- and time-based PM respectively. In order of importance, delayed recognition, visuospatial attention speed, and planning ability were found to be involved in event-based PM functioning. Comparably, planning, visuospatial attention accuracy, delayed recognition, and multitasking/task-shifting ability were found to be involved in time-based PM functioning. These findings further suggest the importance of ecological validity in the study of PM, which may be achieved using immersive VR paradigms.


title: Nondegenerate invariant symmetric bilinear forms on simple Lie superalgebras in characteristic 2

abstract: As is well-known, the dimension of the space spanned by the non-degenerate invariant symmetric bilinear forms (NISes) on any simple finite-dimensional Lie algebra or Lie superalgebra is equal to at most 1 if the characteristic of the algebraically closed ground field is not 2. We prove that in characteristic 2, the superdimension of the space spanned by NISes can be equal to 0, or 1, or $0|1$, or $1|1$; it is equal to $1|1$ if and only if the Lie superalgebra is a queerification (defined in arXiv:1407.1695) of a simple classically restricted Lie algebra with a NIS (for examples, mainly in characteristic distinct from 2, see arXiv:1806.05505). We give examples of NISes on deformations (with both even and odd parameters) of several simple finite-dimensional Lie superalgebras in characteristic 2. We also recall examples of multiple NISes on simple Lie algebras over non-closed fields.


title: Nonlinear absorption in interacting Rydberg electromagnetically-induced-transparency spectra on two-photon resonance

abstract: We experimentally investigate the nonlinear transmission spectrum of coherent light fields propagating through a Rydberg EIT medium with strong atomic interactions. In contrast to previous investigations, which have largely focused on resonant control fields, we explore here the full two-dimensional spectral response of the Rydberg gas. Our measurements confirm previously observed spectral features for a vanishing control-field detuning, but also reveal significant differences on two-photon resonance. In particular, we find qualitative deficiencies of mean-field models and rate-equation simulations as well as a third-order nonlinear susceptibility that accounts for pair-wise interaction effects at low probe-field intensities in describing the nonlinear probe-field response under EIT conditions. Our results suggest that a more complete understanding of Rydberg-EIT and emerging photon interactions requires to go beyond existing simplified models as well as few-photon theories.