title: Modeling Users' Contextualized Page-wise Feedback for Click-Through Rate Prediction in E-commerce Search

abstract: Modeling user's historical feedback is essential for Click-Through Rate Prediction in personalized search and recommendation. Existing methods usually only model users' positive feedback information such as click sequences which neglects the context information of the feedback. In this paper, we propose a new perspective for context-aware users' behavior modeling by including the whole page-wisely exposed products and the corresponding feedback as contextualized page-wise feedback sequence. The intra-page context information and inter-page interest evolution can be captured to learn more specific user preference. We design a novel neural ranking model RACP(i.e., Recurrent Attention over Contextualized Page sequence), which utilizes page-context aware attention to model the intra-page context. A recurrent attention process is used to model the cross-page interest convergence evolution as denoising the interest in the previous pages. Experiments on public and real-world industrial datasets verify our model's effectiveness.


title: Expansive Multisets: Asymptotic Enumeration

abstract: Consider a non-negative sequence $c_n = h(n) \cdot n^{\alpha-1} \cdot \rho^{-n}$, where $h$ is slowly varying, $\alpha>0$, $0<\rho<1$ and $n\in\mathbb{N}$. We investigate the coefficients of $G(x,y) = \prod_{k\ge1}(1-x^ky)^{-c_k}$, which is the bivariate generating series of the multiset construction of combinatorial objects. By a powerful blend of probabilistic methods based on the Boltzmann model and analytic techniques exploiting the well-known saddle-point method we determine the number of multisets of total size $n$ with $N$ components, that is, the coefficient of $x^ny^N$ in $G(x,y)$, asymptotically as $n\to\infty$ and for all ranges of $N$. Our results reveal a phase transition in the structure of the counting formula that depends on the ratio $n/N$ and that demonstrates a prototypical passage from a bivariate local limit to an univariate one.


title: Graph Neural Networks are Dynamic Programmers

abstract: Recent advances in neural algorithmic reasoning with graph neural networks (GNNs) are propped up by the notion of algorithmic alignment. Broadly, a neural network will be better at learning to execute a reasoning task (in terms of sample complexity) if its individual components align well with the target algorithm. Specifically, GNNs are claimed to align with dynamic programming (DP), a general problem-solving strategy which expresses many polynomial-time algorithms. However, has this alignment truly been demonstrated and theoretically quantified? Here we show, using methods from category theory and abstract algebra, that there exists an intricate connection between GNNs and DP, going well beyond the initial observations over individual algorithms such as Bellman-Ford. Exposing this connection, we easily verify several prior findings in the literature, produce better-grounded GNN architectures for edge-centric tasks, and demonstrate empirical results on the CLRS algorithmic reasoning benchmark. We hope our exposition will serve as a foundation for building stronger algorithmically aligned GNNs.


title: A simple criterion and experiments for onset of flocculation in kaolin clay suspensions

abstract: Cohesive effects between fine-grained sediment particles greatly influence their effective settling rate and erodibility. Many studies have observed a qualitative difference in settling dynamics between clays in freshwater, where particles remain dispersed, and in saltwater, where aggregates form and settle rapidly. The critical coagulation concentration (CCC) of salt that separates the two regimes however remains under-investigated, even though knowledge of the CCC is crucial to understanding aggregation in settings such as estuaries, where large salt concentration gradients occur. Furthermore, no simple criterion exists to predict the CCC for clay suspensions. In this study, systematic experiments are performed to determine the CCC, by measuring transmitted light intensity through clay suspensions. To investigate the effect of ion valence, sodium chloride (NaCl) and calcium chloride (CaCl$_2$) are used. For kaolin clay, the results show a CCC of 0.6mM NaCl ($\approx 0.04$ppt NaCl $=$ 0.04 PSU), and of 0.04mM CaCl$_2$ ($\approx 0.004$ppt CaCl$_2$). Because these salinities are lower than those commonly observed in nature, these findings indicate that kaolin clay should flocculate in nearly all natural aquatic environments. Furthermore, due to the fact that tap water often has salinities higher than this threshold, these results imply that great care is needed in experiments, especially in large facilities where using distilled water is not feasible. In addition, a simple criterion to estimate the CCC for a kaolin clay suspension is derived. This criterion predicts that flocculation occurs at extremely low salt concentrations and is approximately independent of clay concentration, in agreement with the experimental observations and consistent with experimental evidence from the literature.


title: Modelling Carbon Capture on Metal-Organic Frameworks with Quantum Computing

abstract: Despite the recent progress in quantum computational algorithms for chemistry, there is a dearth of quantum computational simulations focused on material science applications, especially for the energy sector, where next generation sorbing materials are urgently needed to battle climate change. To drive their development, quantum computing is applied to the problem of CO$_2$ adsorption in Al-fumarate Metal-Organic Frameworks. Fragmentation strategies based on Density Matrix Embedding Theory are applied, using a variational quantum algorithm as a fragment solver, along with active space selection to minimise qubit number. By investigating different fragmentation strategies and solvers, we propose a methodology to apply quantum computing to Al-fumarate interacting with a CO$_2$ molecule, demonstrating the feasibility of treating a complex porous system as a concrete application of quantum computing. Our work paves the way for the use of quantum computing techniques in the quest of sorbents optimisation for more efficient carbon capture and conversion applications.

categories: quant-ph cond-mat.mtrl-sci physics.atom-ph physics.chem-ph physics.comp-ph


title: ME-CapsNet: A Multi-Enhanced Capsule Networks with Routing Mechanism

abstract: Convolutional Neural Networks need the construction of informative features, which are determined by channel-wise and spatial-wise information at the network's layers. In this research, we focus on bringing in a novel solution that uses sophisticated optimization for enhancing both the spatial and channel components inside each layer's receptive field. Capsule Networks were used to understand the spatial association between features in the feature map. Standalone capsule networks have shown good results on comparatively simple datasets than on complex datasets as a result of the inordinate amount of feature information. Thus, to tackle this issue, we have proposed ME-CapsNet by introducing deeper convolutional layers to extract important features before passing through modules of capsule layers strategically to improve the performance of the network significantly. The deeper convolutional layer includes blocks of Squeeze-Excitation networks which use a stochastic sampling approach for progressively reducing the spatial size thereby dynamically recalibrating the channels by reconstructing their interdependencies without much loss of important feature information. Extensive experimentation was done using commonly used datasets demonstrating the efficiency of the proposed ME-CapsNet, which clearly outperforms various research works by achieving higher accuracy with minimal model complexity in complex datasets.


title: Image Segmentation with Adaptive Spatial Priors from Joint Registration

abstract: Image segmentation is a crucial but challenging task that has many applications. In medical imaging for instance, intensity inhomogeneity and noise are common. In thigh muscle images, different muscles are closed packed together and there are often no clear boundaries between them. Intensity based segmentation models cannot separate one muscle from another. To solve such problems, in this work we present a segmentation model with adaptive spatial priors from joint registration. This model combines segmentation and registration in a unified framework to leverage their positive mutual influence. The segmentation is based on a modified Gaussian mixture model (GMM), which integrates intensity inhomogeneity and spacial smoothness. The registration plays the role of providing a shape prior. We adopt a modified sum of squared difference (SSD) fidelity term and Tikhonov regularity term for registration, and also utilize Gaussian pyramid and parametric method for robustness. The connection between segmentation and registration is guaranteed by the cross entropy metric that aims to make the segmentation map (from segmentation) and deformed atlas (from registration) as similar as possible. This joint framework is implemented within a constraint optimization framework, which leads to an efficient algorithm. We evaluate our proposed model on synthetic and thigh muscle MR images. Numerical results show the improvement as compared to segmentation and registration performed separately and other joint models.


title: Invariance Learning based on Label Hierarchy

abstract: Deep Neural Networks inherit spurious correlations embedded in training data and hence may fail to predict desired labels on unseen domains (or environments), which have different distributions from the domain used in training. Invariance Learning (IL) has been developed recently to overcome this shortcoming; using training data in many domains, IL estimates such a predictor that is invariant to a change of domain. However, the requirement of training data in multiple domains is a strong restriction of IL, since it often needs high annotation cost. We propose a novel IL framework to overcome this problem. Assuming the availability of data from multiple domains for a higher level of classification task, for which the labeling cost is low, we estimate an invariant predictor for the target classification task with training data in a single domain. Additionally, we propose two cross-validation methods for selecting hyperparameters of invariance regularization to solve the issue of hyperparameter selection, which has not been handled properly in existing IL methods. The effectiveness of the proposed framework, including the cross-validation, is demonstrated empirically, and the correctness of the hyperparameter selection is proved under some conditions.


title: Harmonic flow correlations in Au+Au reactions at 1.23 AGeV: A new testing ground for the Equation-of-State and expansion geometry

abstract: Correlations between the harmonic flow coefficients $v_1$, $v_2$, $v_3$ and $v_4$ of nucleons in semi-peripheral Au+Au collisions at a beam energy of 1.23~AGeV are investigated within the hadronic transport approach Ultra-relativistic Quantum Molecular Dynamics (UrQMD). In contrast to ultra-relativistic collision energies (where the flow coefficients are evaluated with respect to the respective event plane), we predict strong correlations between the flow harmonics with respect to the reaction plane. Based on an event-by-event selection of the midrapidity final state elliptic flow of protons we show that as a function of rapidity, I) the sign of the triangular flow changes, II) that the shape of $v_4$ changes from convex to concave, and III) that $v_3\propto v_1v_2$ and $v_4\propto v_2^2$ for all different event classes, indicating strong correlations between all investigated harmonic flow coefficients.


title: Bourgain's slicing problem and KLS isoperimetry up to polylog

abstract: We prove that Bourgain's hyperplane conjecture and the Kannan-Lov\'asz-Simonovits (KLS) isoperimetric conjecture hold true up to a factor that is polylogarithmic in the dimension.


title: Locally maximizing orbits for the non-standard generating function of convex billiards and applications

abstract: Given an exact symplectic map $T$ of a cylinder with a generating function $H$ satisfying the so-called negative twist condition, $H_{12}>0$, we study the locally maximizing orbits of $T$, that is, configurations which are local maxima of the action functional $\sum_n H(q_n,q_{n+1})$. We provide a necessary and sufficient condition for a configuration to be locally maximizing. Using it, we consider a situation where $T$ has two generating functions with respect to two different sets of symplectic coordinates. We suggest a simple geometric condition which guarantees that the set of locally maximizing orbits with respect to both of these generating functions coincide. As the main application we show that the two generating functions for planar Birkhoff billiards satisfy this geometric condition. We apply it to get the following result: consider a centrally symmetric curve $\gamma$, for which the Birkhoff billiard map has a rotational invariant curve $\alpha$ of $4$-periodic orbits. We prove that a certain $L^2$-distance between $\gamma$ and its "best approximating" ellipse can be bounded from above in terms of the measure of the complement of the set filled by locally maximizing orbits lying between $\alpha$ and the boundary of the phase cylinder. Moreover, this estimate is sharp, giving an effective version of a recent result on Birkhoff conjecture for centrally symmetric curves. We also get a similar bound for arbitrary curves $\gamma$, that relates the measure of the complement of the set of locally maximizing orbits with the $L^2$-distance between $\gamma$ and its "best approximating" circle.


title: Optimal control and selectivity of qubits in contact with a structured environment

abstract: We present a theoretical study of the optimal control of a qubit interacting with a structured environment. We consider a model system in which the bath is a bosonic reservoir at zero temperature and the qubit frequency is the only control parameter. Using optimal control techniques, we show the extent to which qubit population and relaxation effects can be manipulated. The reachable qubit states by a shaped control with a fixed maximum intensity are found numerically. We analyze the role of standard control mechanisms and the structure of the set of reachable states with respect to the coupling strength between the system and the environment. This investigation is used as a starting point to explore the selectivity problem of two uncoupled qubits interacting with their own baths and characterized by a specific coupling strength. We numerically derive the optimal control solution for a wide range of parameters and we show that the control law is close to a sinusoidal function with a specific frequency in some peculiar cases.


title: Propagation of singularities by Osgood vector fields and for 2D inviscid incompressible fluids

abstract: We show that certain singular structures (H\"{o}lderian cusps and mild divergences) are transported by the flow of homeomorphisms generated by an Osgood velocity field. The structure of these singularities is related to the modulus of continuity of the velocity and the results are shown to be sharp in the sense that slightly more singular structures cannot generally be propagated. For the 2D Euler equation, we prove that certain singular structures are preserved by the motion, e.g. a system of $\log\log_+(1/|x|)$ vortices (and those that are slightly less singular) travel with the fluid in a nonlinear fashion, up to bounded perturbations. We also give stability results for weak Euler solutions away from their singular set.


title: Progression models for repeated measures: Estimating novel treatment effects in progressive diseases

abstract: Mixed Models for Repeated Measures (MMRMs) are ubiquitous when analyzing outcomes of clinical trials. However, the linearity of the fixed-effect structure in these models largely restrict their use to estimating treatment effects that are defined as linear combinations of effects on the outcome scale. In some situations, alternative quantifications of treatment effects may be more appropriate. In progressive diseases, for example, one may want to estimate if a drug has cumulative effects resulting in increasing efficacy over time or whether it slows the time progression of disease. This paper introduces a class of nonlinear mixed-effects models called Progression Models for Repeated Measures (PMRMs) that, based on a continuous-time extension of the categorical-time parametrization of MMRMs, enables estimation of novel types of treatment effects, including measures of slowing or delay of the time progression of disease. Compared to conventional estimates of treatment effects where the unit matches that of the outcome scale (e.g. 2 points benefit on a cognitive scale), the time-based treatment effects can offer better interpretability and clinical meaningfulness (e.g. 6 months delay in progression of cognitive decline). The PMRM class includes conventionally used MMRMs and related models for longitudinal data analysis, as well as variants of previously proposed disease progression models as special cases. The potential of the PMRM framework is illustrated using both simulated and historical data from clinical trials in Alzheimer's disease with different types of artificially simulated treatment effects. Compared to conventional models it is shown that PMRMs can offer substantially increased power to detect disease-modifying treatment effects where the benefit is increasing with treatment duration.


title: Training Compute-Optimal Large Language Models

abstract: We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget. We find that current large language models are significantly undertrained, a consequence of the recent focus on scaling language models whilst keeping the amount of training data constant. By training over 400 language models ranging from 70 million to over 16 billion parameters on 5 to 500 billion tokens, we find that for compute-optimal training, the model size and the number of training tokens should be scaled equally: for every doubling of model size the number of training tokens should also be doubled. We test this hypothesis by training a predicted compute-optimal model, Chinchilla, that uses the same compute budget as Gopher but with 70B parameters and 4$\times$ more more data. Chinchilla uniformly and significantly outperforms Gopher (280B), GPT-3 (175B), Jurassic-1 (178B), and Megatron-Turing NLG (530B) on a large range of downstream evaluation tasks. This also means that Chinchilla uses substantially less compute for fine-tuning and inference, greatly facilitating downstream usage. As a highlight, Chinchilla reaches a state-of-the-art average accuracy of 67.5% on the MMLU benchmark, greater than a 7% improvement over Gopher.


title: Near-Field Hierarchical Beam Management for RIS-Enabled Millimeter Wave Multi-Antenna Systems

abstract: In this paper, we present a low overhead beam management approach for near-field millimeter-wave multi-antenna communication systems enabled by Reconfigurable Intelligent Surfaces (RISs). We devise a novel variable-width hierarchical phaseshift codebook suitable for both the near- and far-field of the RIS, and present a fast alignment algorithm for the RIS phase shifts and the transceiver beamformers. Indicative performance evaluation results are shown, verifying the effectiveness of the proposed approach in comparison with various benchmark schemes.


title: Wildfire risk forecast: An optimizable fire danger index

abstract: Wildfire events have caused severe losses in many places around the world and are expected to increase with climate change. Throughout the years many technologies have been developed to identify fire events early on and to simulate fire behavior once they have started. Another particularly helpful technology is fire risk indices, which use weather forcing to make advanced predictions of the risk of fire. Predictions of fire risk indices can be used, for instance, to allocate resources in places with high risk. These indices have been developed over the years as empirical models with parameters that were estimated in lab experiments and field tests. These parameters, however, may not fit well all places where these models are used. In this paper we propose a novel implementation of one index (NFDRS IC) as a differentiable function in which one can optimize its internal parameters via gradient descent. We leverage existing machine learning frameworks (PyTorch) to construct our model. This approach has two benefits: (1) the NFDRS IC parameters can be improved for each region using actual observed fire events, and (2) the internal variables remain intact for interpretations by specialists instead of meaningless hidden layers as in traditional neural networks. In this paper we evaluate our strategy with actual fire events for locations in the USA and Europe.


title: Multifidelity Orbit Uncertainty Propagation using Taylor Polynomials

abstract: A new multifidelity method is developed for nonlinear orbit uncertainty propagation. This approach guarantees improved computational efficiency and limited accuracy losses compared to fully high-fidelity counterparts. The initial uncertainty is modeled as a weighted sum of Gaussian distributions whose number is adapted online to satisfy the required accuracy. As needed, univariate splitting libraries are used to split the mixture components along the direction of maximum nonlinearity. Differential Algebraic techniques are used to propagate these Gaussian kernels and compute a measure of nonlinearity required for the split decision and direction identification. Taylor expansions of the flow of the dynamics are computed using a low-fidelity dynamical model to maximize computational efficiency and corrected with selected high-fidelity samples to minimize accuracy losses. The effectiveness of the proposed method is demonstrated for different dynamical regimes combining SGP4 theory and numerical propagation as low- and high-fidelity models respectively.


title: Orbital-selective Band Hybridisation at the Charge Density Wave Transition in Monolayer TiTe$_2$

abstract: An anomalous $(2\times2)$ charge density wave (CDW) phase emerges in monolayer 1T-TiTe$_2$ which is absent for the bulk compound, and whose origin is still poorly understood. Here, we investigate the electronic band structure evolution across the CDW transition using temperature-dependent angle-resolved photoemission spectroscopy. Our study reveals an orbital-selective band hybridisation between the backfolded conduction and valence bands occurring at the CDW phase transition, which in turn leads to a significant electronic energy gain, underpinning the CDW transition. For the bulk compound, we show how this energy gain is almost completely suppressed due to the three-dimensionality of the electronic band structure, including via a $k_z$-dependent band inversion which switches the orbital character of the valence states. Our study thus sheds new light on how control of the electronic dimensionalilty can be used to trigger the emergence of new collective states in 2D materials.


title: Algorithmic Improvement and GPU Acceleration of the GenASM Algorithm

abstract: We improve on GenASM, a recent algorithm for genomic sequence alignment, by significantly reducing its memory footprint and bandwidth requirement. Our algorithmic improvements reduce the memory footprint by 24$\times$ and the number of memory accesses by 12$\times$. We efficiently parallelize the algorithm for GPUs, achieving a 4.1$\times$ speedup over a CPU implementation of the same algorithm, a 62$\times$ speedup over minimap2's CPU-based KSW2 and a 7.2$\times$ speedup over the CPU-based Edlib for long reads.


title: Semi-classical kinetic theory for massive spin-half fermions with leading-order spin effects

abstract: We consider the quantum kinetic-theory description for interacting massive spin-half fermions using the Wigner function formalism. We derive a general kinetic theory description assuming that the spin effects appear at the classical and quantum level. To track the effect of such different contributions we use the semi-classical expansion method to obtain the generalized dynamical equations including spin, analogous to classical Boltzmann equation. This approach can be used to obtain a collision kernel involving local as well as non-local collisions among the microscopic constituent of the system and eventually, a framework of spin hydrodynamics ensuring the conservation of the energy-momentum tensor and total angular momentum tensor.


title: Attacker Attribution of Audio Deepfakes

abstract: Deepfakes are synthetically generated media often devised with malicious intent. They have become increasingly more convincing with large training datasets advanced neural networks. These fakes are readily being misused for slander, misinformation and fraud. For this reason, intensive research for developing countermeasures is also expanding. However, recent work is almost exclusively limited to deepfake detection - predicting if audio is real or fake. This is despite the fact that attribution (who created which fake?) is an essential building block of a larger defense strategy, as practiced in the field of cybersecurity for a long time. This paper considers the problem of deepfake attacker attribution in the domain of audio. We present several methods for creating attacker signatures using low-level acoustic descriptors and machine learning embeddings. We show that speech signal features are inadequate for characterizing attacker signatures. However, we also demonstrate that embeddings from a recurrent neural network can successfully characterize attacks from both known and unknown attackers. Our attack signature embeddings result in distinct clusters, both for seen and unseen audio deepfakes. We show that these embeddings can be used in downstream-tasks to high-effect, scoring 97.10% accuracy in attacker-id classification.


title: No scalar condensations outside reflecting stars with coupling terms from Ginzburg-Landau models

abstract: We consider static scalar fields coupled to the gradient where the coupling also appears in next-to-leading order Ginzburg-Landau models. We study condensation behaviors of scalar fields outside regular compact reflecting stars in the asymptotically flat background. For non-negative coupling parameters, we prove that the reflecting star cannot support coupled static scalar fields.


title: Killing Two Birds with One Stone:Efficient and Robust Training of Face Recognition CNNs by Partial FC

abstract: Learning discriminative deep feature embeddings by using million-scale in-the-wild datasets and margin-based softmax loss is the current state-of-the-art approach for face recognition. However, the memory and computing cost of the Fully Connected (FC) layer linearly scales up to the number of identities in the training set. Besides, the large-scale training data inevitably suffers from inter-class conflict and long-tailed distribution. In this paper, we propose a sparsely updating variant of the FC layer, named Partial FC (PFC). In each iteration, positive class centers and a random subset of negative class centers are selected to compute the margin-based softmax loss. All class centers are still maintained throughout the whole training process, but only a subset is selected and updated in each iteration. Therefore, the computing requirement, the probability of inter-class conflict, and the frequency of passive update on tail class centers, are dramatically reduced. Extensive experiments across different training data and backbones (e.g. CNN and ViT) confirm the effectiveness, robustness and efficiency of the proposed PFC. The source code is available at \https://github.com/deepinsight/insightface/tree/master/recognition.


title: Core Risk Minimization using Salient ImageNet

abstract: Deep neural networks can be unreliable in the real world especially when they heavily use spurious features for their predictions. Recently, Singla & Feizi (2022) introduced the Salient Imagenet dataset by annotating and localizing core and spurious features of ~52k samples from 232 classes of Imagenet. While this dataset is useful for evaluating the reliance of pretrained models on spurious features, its small size limits its usefulness for training models. In this work, we first introduce the Salient Imagenet-1M dataset with more than 1 million soft masks localizing core and spurious features for all 1000 Imagenet classes. Using this dataset, we first evaluate the reliance of several Imagenet pretrained models (42 total) on spurious features and observe that: (i) transformers are more sensitive to spurious features compared to Convnets, (ii) zero-shot CLIP transformers are highly susceptible to spurious features. Next, we introduce a new learning paradigm called Core Risk Minimization (CoRM) whose objective ensures that the model predicts a class using its core features. We evaluate different computational approaches for solving CoRM and achieve significantly higher (+12%) core accuracy (accuracy when non-core regions corrupted using noise) with no drop in clean accuracy compared to models trained via Empirical Risk Minimization.


title: Analytic theory for the tangential YORP produced by the asteroid regolith

abstract: The tangential YORP effect is a radiation pressure torque produced by asymmetric thermal emission by structures on the asteroid surface. As such structures, previous works considered boulders of different shapes lying on the surface of the asteroid. We study the tangential YORP produced by the rough interface of the asteroid's regolith. We create an approximate analytic theory of heat conduction on a slightly non-flat sinusoidal surface. We analyze the published data on the small-scale shape of the asteroid (162173) Ryugu and estimate its tangential YORP due to the surface roughness. We derive an analytic formula that expresses the TYORP of a sinusoidal surface in terms of its geometric and thermal properties. TYORP is maximal at the thermal parameter of the order of unity and for the shape irregularities of the order of the thermal wavelength. Application of this equation to Ryugu predicts TYORP, which is 5-70 times greater than its normal YORP effect. The contribution of the small-scale regolith roughness to the YORP effect of the asteroid can be comparable to the normal YORP and the tangential YORP produced by boulders. The same theory can describe roughness on the asteroid boulders, thus adding a new term to the previously considered TYORP created by boulders.


title: A Dataset for Speech Emotion Recognition in Greek Theatrical Plays

abstract: Machine learning methodologies can be adopted in cultural applications and propose new ways to distribute or even present the cultural content to the public. For instance, speech analytics can be adopted to automatically generate subtitles in theatrical plays, in order to (among other purposes) help people with hearing loss. Apart from a typical speech-to-text transcription with Automatic Speech Recognition (ASR), Speech Emotion Recognition (SER) can be used to automatically predict the underlying emotional content of speech dialogues in theatrical plays, and thus to provide a deeper understanding how the actors utter their lines. However, real-world datasets from theatrical plays are not available in the literature. In this work we present GreThE, the Greek Theatrical Emotion dataset, a new publicly available data collection for speech emotion recognition in Greek theatrical plays. The dataset contains utterances from various actors and plays, along with respective valence and arousal annotations. Towards this end, multiple annotators have been asked to provide their input for each speech recording and inter-annotator agreement is taken into account in the final ground truth generation. In addition, we discuss the results of some indicative experiments that have been conducted with machine and deep learning frameworks, using the dataset, along with some widely used databases in the field of speech emotion recognition.


title: The finite generation ideal for Daigle & Freudenberg's counterexample to Hilbert's fourteenth problem

abstract: We compute the finite generation ideal for Daigle and Freudenburg's counterexample to Hilbert's fourteenth problem. This ideal helps to understand how far the ring of invariants is from being finitely generated. Our calculations show that the finite generation ideal is the radical of an ideal generated by three infinite families of invariants. We show that these three families together with an additional invariant form a SAGBI-basis. We use the properties of our SAGBI-basis in our computation of the finite generation ideal.


title: Fast and stable schemes for non-linear osmosis filtering

abstract: We consider a non-linear variant of the transport-diffusion osmosis model for solving a variety of imaging problems such as shadow/soft-light removal and compact data representation. The non-linear behaviour is encoded in terms of a general scalar function g with suitable properties, which allows to balance the diffusion intensity on the different regions of the image while preventing smoothing artefacts. For the proposed model, conservation properties (intensity and non-negativity) are proved and a variational interpretation is showed for specific choices of g. Upon suitable spatial discretisation, both an explicit and a semi-implicit iterative scheme are considered, for which convergence restrictions and unconditional stability are proved, respectively. To validate the proposed modelling and the computational speed of the numerical schemes considered, we report several results and comparisons for the problem of shadow/light-spot removal and compact data representation, showing that artefact-free and computationally efficient results are obtained in comparison to standard linear and anisotropic models, and state-of-the art approaches.


title: Transport coefficients of quasi-particle models within a new relaxation time approximation of the Boltzmann equation

abstract: We investigate the transport properties of a kinetic theory model that is tuned to describe the thermodynamic properties of QCD at zero chemical potential using a new formulation of the relaxation time approximation. In contrast to previous approaches, the latter is constructed to preserve the fundamental properties of the collision term of the Boltzmann equation for any energy-dependence of the relaxation time. A novel choice of matching conditions is implemented to ensure that the background mean-field depends only on the temperature even when the system is out of equilibrium. We provide a consistent analysis of how the transport coefficients of relativistic Navier-Stokes theory vary with the energy dependence of the relaxation time. We also show that the entropy production of this theory is consistent with the second law of thermodynamics and verify that it is independent of the matching conditions employed. We used this fact to calculate the matching independent combination of transport coefficients.


title: New Proofs of Some Double Sum Rogers-Ramanujan Type Identities

abstract: Recently, Rosengren utilized an integral method to prove a number of conjectural identities found by Kanade and Russell. Using this integral method, we give new proofs to some double sum identities of Rogers-Ramanujan type. These identities were earlier proved by approaches such as combinatorial arguments or by using $q$-difference equations. Our proofs are based on streamlined calculations, which relate these double sum identities to some known Rogers-Ramanujan type identities with single sums. Moreover, we prove a conjectural identity of Andrews and Uncu which was earlier confirmed by Chern.


title: Flat-band ferromagnetism in a correlated topological insulator on a honeycomb lattice

abstract: We study the flat-band ferromagnetic phase of a spinfull and time-reversal symmetric Haldane-Hubbard model on a honeycomb lattice within a bosonization formalism for flat-band Z$_2$ topological insulators. Such a study extend our previous one [L. S. G. Leite and R. L. Doretto, Phys. Rev. B {\bf 104}, 155129 (2021)] concerning the flat-band ferromagnetic phase of a correlated Chern insulator described by a Haldane-Hubbard model. We consider the topological Hubbard model at $1/4$ filling of its corresponding noninteracting limit and in the nearly flat band limit of its lower free-electronic bands. We show that it is possible to define boson operators associated with two distinct spin-flip excitations, one that changes (mixed-lattice excitations) and a second one that preserves (same-lattice excitations) the index related with the two triangular sublattices. Within the bosonization scheme, the fermionic model is mapped into an effective interacting boson model, whose quadratic term is considered at the harmonic approximation in order to determine the spin-wave excitation spectrum. For both mixed and same-lattice excitations, we find that the spin-wave spectrum is gapped and has two branches, with an energy gap between the lower and the upper bands at the $K$ and $K'$ points of the first Brillouin zone. Such a behavior is distinct from the one of the corresponding correlated Chern insulator, whose spin-wave spectrum has a Goldstone mode at the center of the first Brillouin zone and Dirac points at $K$ and $K'$ points. We also find some evidences that the spin-wave bands for the same-lattice excitations might be topologically nontrivial even in the completely flat band limit.


title: Quantum compiling with a variational instruction set for accurate and fast quantum computing

abstract: The quantum instruction set (QIS) is defined as the quantum gates that are physically realizable by controlling the qubits in quantum hardware. Compiling quantum circuits into the product of the gates in a properly defined QIS is a fundamental step in quantum computing. We here propose the quantum variational instruction set (QuVIS) formed by flexibly designed multi-qubit gates for higher speed and accuracy of quantum computing. The controlling of qubits for realizing the gates in a QuVIS is variationally achieved using the fine-grained time optimization algorithm. Significant reductions in both the error accumulation and time cost are demonstrated in realizing the swaps of multiple qubits and quantum Fourier transformations, compared with the compiling by a standard QIS such as the quantum microinstruction set (QuMIS, formed by several one- and two-qubit gates including one-qubit rotations and controlled-NOT gates). With the same requirement on quantum hardware, the time cost for QuVIS is reduced to less than one half of that for QuMIS. Simultaneously, the error is suppressed algebraically as the depth of the compiled circuit is reduced. As a general compiling approach with high flexibility and efficiency, QuVIS can be defined for different quantum circuits and be adapted to the quantum hardware with different interactions.


title: Digraphs with all induced directed cycles of the same length are not $\vec{\chi}$-bounded

abstract: For $t \ge 2$, let us call a digraph $D$ \emph{t-chordal} if all induced directed cycles in $D$ have length equal to $t$. In a previous paper, we asked for which $t$ it is true that $t$-chordal graphs with bounded clique number have bounded dichromatic number. Recently, Aboulker, Bousquet, and de Verclos answered this in the negative for $t=3$, that is, they gave a construction of $3$-chordal digraphs with clique number at most $3$ and arbitrarily large dichromatic number. In this paper, we extend their result, giving for each $t \ge 3$ a construction of digraphs with clique number at most $3$ and arbitrarily large dichromatic number, thus answering our question in the negative. On the other hand, we show that a more restricted class, digraphs with no induced directed cycle of length less than $t$, and no induced directed $t$-vertex path, have bounded dichromatic number if their clique number is bounded. We also show the following complexity result: for fixed $t \ge 2$, the problem of determining whether a digraph is $t$-chordal is coNP-complete.


title: Subspace-based Representation and Learning for Phonotactic Spoken Language Recognition

abstract: Phonotactic constraints can be employed to distinguish languages by representing a speech utterance as a multinomial distribution or phone events. In the present study, we propose a new learning mechanism based on subspace-based representation, which can extract concealed phonotactic structures from utterances, for language verification and dialect/accent identification. The framework mainly involves two successive parts. The first part involves subspace construction. Specifically, it decodes each utterance into a sequence of vectors filled with phone-posteriors and transforms the vector sequence into a linear orthogonal subspace based on low-rank matrix factorization or dynamic linear modeling. The second part involves subspace learning based on kernel machines, such as support vector machines and the newly developed subspace-based neural networks (SNNs). The input layer of SNNs is specifically designed for the sample represented by subspaces. The topology ensures that the same output can be derived from identical subspaces by modifying the conventional feed-forward pass to fit the mathematical definition of subspace similarity. Evaluated on the "General LR" test of NIST LRE 2007, the proposed method achieved up to 52%, 46%, 56%, and 27% relative reductions in equal error rates over the sequence-based PPR-LM, PPR-VSM, and PPR-IVEC methods and the lattice-based PPR-LM method, respectively. Furthermore, on the dialect/accent identification task of NIST LRE 2009, the SNN-based system performed better than the aforementioned four baseline methods.


title: Understanding Code Snippets in Code Reviews: A Preliminary Study of the OpenStack Community

abstract: Code review is a mature practice for software quality assurance in software development with which reviewers check the code that has been committed by developers, and verify the quality of code. During the code review discussions, reviewers and developers might use code snippets to provide necessary information (e.g., suggestions or explanations). However, little is known about the intentions and impacts of code snippets in code reviews. To this end, we conducted a preliminary study to investigate the nature of code snippets and their purposes in code reviews. We manually collected and checked 10,790 review comments from the Nova and Neutron projects of the OpenStack community, and finally obtained 626 review comments that contain code snippets for further analysis. The results show that: (1) code snippets are not prevalently used in code reviews, and most of the code snippets are provided by reviewers. (2) We identified two high-level purposes of code snippets provided by reviewers (i.e., Suggestion and Citation) with six detailed purposes, among which, Improving Code Implementation is the most common purpose. (3) For the code snippets in code reviews with the aim of suggestion, around 68.1% was accepted by developers. The results highlight promising research directions on using code snippets in code reviews.


title: Disentangling speech from surroundings with neural embeddings

abstract: We present a method to separate speech signals from noisy environments in the embedding space of a neural audio codec. We introduce a new training procedure that allows our model to produce structured encodings of audio waveforms given by embedding vectors, where one part of the embedding vector represents the speech signal, and the rest represent the environment. We achieve this by partitioning the embeddings of different input waveforms and training the model to faithfully reconstruct audio from mixed partitions, thereby ensuring each partition encodes a separate audio attribute. As use cases, we demonstrate the separation of speech from background noise or from reverberation characteristics. Our method also allows for targeted adjustments of the audio output characteristics.


title: Cometary science with CUBES

abstract: The proposed CUBES spectrograph for ESO's Very Large Telescope will be an exceptionally powerful instrument for the study of comets. The gas coma of a comet contains a large number of emission features in the near-UV range covered by CUBES (305-400 nm), which are diagnostic of the composition of the ices in its nucleus and the chemistry in the coma. Production rates and relative ratios between different species reveal how much ice is present and inform models of the conditions in the early solar system. In particular, CUBES will lead to advances in detection of water from very faint comets, revealing how much ice may be hidden in the main asteroid belt, and in measuring isotopic and molecular composition ratios in a much wider range of comets than currently possible, provide constraints on their formation temperatures. CUBES will also be sensitive to emissions from gaseous metals (e.g., FeI and NiI), which have recently been identified in comets and offer an entirely new area of investigation to understand these enigmatic objects.


title: Learning a Structured Latent Space for Unsupervised Point Cloud Completion

abstract: Unsupervised point cloud completion aims at estimating the corresponding complete point cloud of a partial point cloud in an unpaired manner. It is a crucial but challenging problem since there is no paired partial-complete supervision that can be exploited directly. In this work, we propose a novel framework, which learns a unified and structured latent space that encoding both partial and complete point clouds. Specifically, we map a series of related partial point clouds into multiple complete shape and occlusion code pairs and fuse the codes to obtain their representations in the unified latent space. To enforce the learning of such a structured latent space, the proposed method adopts a series of constraints including structured ranking regularization, latent code swapping constraint, and distribution supervision on the related partial point clouds. By establishing such a unified and structured latent space, better partial-complete geometry consistency and shape completion accuracy can be achieved. Extensive experiments show that our proposed method consistently outperforms state-of-the-art unsupervised methods on both synthetic ShapeNet and real-world KITTI, ScanNet, and Matterport3D datasets.


title: Accretion and Outflows in Young Stars with CUBES

abstract: The science case on studies of accretion and outflows in low-mass ($<$1.5 $M_{\odot}$) young stellar objects (YSOs) with the new CUBES instrument is presented. We show the need for a high-sensitivity, near-ultraviolet (NUV) spectrograph like CUBES, with a resolving power at least four times that of X-Shooter and combined with UVES via a fibrelink for simultaneous observations. Simulations with the CUBES exposure time calculator and the end-to-end software show that a significant gain in signal-to -noise can be achieved compared to current instruments, for both the spectral continuum and emission lines, including for relatively embedded YSOs. Our simulations also show that the low-resolution mode of CUBES will be able to observe much fainter YSOs (V $\sim$22 mag) in the NUV than we can today, allowing us extend studies to YSOs with background-limited magnitudes. The performance of CUBES in terms of sensitivity in the NUV will provide important new insights into the evolution of circumstellar disks, by studying the accretion, jets/winds and photo-evaporation processes, down to the low-mass brown dwarf regime. CUBES will also open-up new science as it will be able to observe targets that are several magnitudes fainter than those reachable with current instruments, facilitating studies of YSOs at distances of $\sim$ kpc scale. This means a step-change in the field of low-mass star formation, as it will be possible to expand the science case from relatively local star-forming regions to a large swathe of distances within the Milky Way.


title: Molecular hydrogen in absorption at high redshifts. Science cases for CUBES

abstract: Absorption lines from molecular hydrogen ($\rm H_2$) in the spectra of background sources are a powerful probe of the physical conditions in intervening cold neutral medium. At high redshift, $z>2$, $\rm H_2$ lines are conveniently shifted in the optical domain, allowing the use of ground-based telescopes to perform high-resolution spectroscopy, which is essential for a proper analysis of the cold gas. We describe recent observational progress, based on the development of efficient pre-selection techniques in low-resolution spectroscopic surveys such as the Sloan Digital Sky Survey (SDSS). The next generation of spectrographs with high blue-throughput, such as CUBES, will certainly significantly boost the efficiency and outcome of follow-up observations. In this paper, we discuss high priority science cases for CUBES, building on recent $\rm H_2$ observations at high-z: probing the physical conditions in the cold phase of regular galaxies and outflowing gas from active galactic nucleus.


title: The Master Equation in a Bounded Domain with Absorption

abstract: We analyze the Master Equation and the convergence problem within Mean Field Games theory considering a bounded domain with homogeneous Dirichlet conditions. This framework characterizes N-players differential games where each player's dynamic ends when touching the boundary, leading to two Dirichlet boundary conditions in the Master Equation. In the first part of the paper we analyze both the well-posedness of the Master Equation and the regularity of its solutions studying the global regularity at the boundary of solutions for a suitable class of parabolic equations. Such results are then exploited to consider the convergence problem of the Nash equilibria, towards the Mean Field Games system strategies, in the N-players system, also proving optimal trajectories convergence. Eventually, we apply our findings to solve a toy model related to an optimal liquidation scenario.


title: New Exact Plasma Equilibria with Axial and Helical Symmetry

abstract: Exact solutions to the static equilibrium magnetohydrodynamic equations are presented and discussed for both axially and helically reduced systems. For both symmetries, physical restrictions on the solutions are discussed and it is seen that there arise two different families of physical solutions corresponding to two distinct pressure profiles. One is suitable for atmospherically confined plasma whereas the other is suitable for plasma residing in a vacuum. For solutions in vacuum, the radial dependence is found to behave periodically for both axial and helical symmetries. For these physical solutions, only a truncated solution inside of some chosen domain can be considered. The magnetic field boundary can than be described by a current sheet. In the last part of the paper, these static equilibrium solutions are transformed into solutions with non-zero fluid velocity.


title: Advanced testing of low, medium and high ECS CMIP6 GCM simulations versus ERA5-T2m

abstract: The equilibrium climate sensitivity (ECS) of the CMIP6 global circulation models (GCMs) varies from 1.83 {\deg}C to 5.67 {\deg}C. Herein, 38 GCMs are grouped into three ECS classes (low, 1.80-3.00 {\deg}C; medium, 3.01-4.50 {\deg}C; high, 4.51-6.00 {\deg}C) and compared against the ERA5-T2m records from 1980-1990 to 2011-2021. We found that all models with ECS > 3.0 {\deg}C overestimate the observed global surface warming and that spatial t-statistics rejects the data-model agreement over 60% (using low-ECS GCMs) to 81% (using high-ECS GCMs) of the Earth's surface. Thus, the high and medium-ECS GCMs are unfit for prediction purposes. The low-ECS GCMs are not fully satisfactory yet, but they are found unalarming because by 2050 they predict a moderate warming ($\Delta T_{preindustrial\rightarrow2050}\lesssim2\:{^\circ}C$).


title: Discovering Governing Equations by Machine Learning implemented with Invariance

abstract: The partial differential equation (PDE) plays a significantly important role in many fields of science and engineering. The conventional case of the derivation of PDE mainly relies on first principles and empirical observation. However, the development of machine learning technology allows us to mine potential control equations from the massive amounts of stored data in a fresh way. Although there has been considerable progress in the data-driven discovery of PDE, the extant literature mostly focuses on the improvements of discovery methods, without substantial breakthroughs in the discovery process itself, including the principles for the construction of candidates and how to incorporate physical priors. In this paper, through rigorous derivation of formulas, novel physically enhanced machining learning discovery methods for control equations: GSNN (Galileo Symbolic Neural Network) and LSNN (Lorentz Symbolic Neural Network) are firstly proposed based on Galileo invariance and Lorentz invariance respectively, setting forth guidelines for building the candidates of discovering equations. The adoption of mandatory embedding of physical constraints is fundamentally different from PINN in the form of the loss function, thus ensuring that the designed Neural Network strictly obeys the physical prior of invariance and enhancing the interpretability of the network. By comparing the results with PDE-NET in numerical experiments of Burgers equation and Sine-Gordon equation, it shows that the method presented in this study has better accuracy, parsimony, and interpretability.


title: RGB-D Neural Radiance Fields: Local Sampling for Faster Training

abstract: Learning a 3D representation of a scene has been a challenging problem for decades in computer vision. Recent advances in implicit neural representation from images using neural radiance fields(NeRF) have shown promising results. Some of the limitations of previous NeRF based methods include longer training time, and inaccurate underlying geometry. The proposed method takes advantage of RGB-D data to reduce training time by leveraging depth sensing to improve local sampling. This paper proposes a depth-guided local sampling strategy and a smaller neural network architecture to achieve faster training time without compromising quality.


title: Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Review

abstract: The rapid development of diagnostic technologies in healthcare is leading to higher requirements for physicians to handle and integrate the heterogeneous, yet complementary data that are produced during routine practice. For instance, the personalized diagnosis and treatment planning for a single cancer patient relies on the various images (e.g., radiological, pathological, and camera images) and non-image data (e.g., clinical data and genomic data). However, such decision-making procedures can be subjective, qualitative, and have large inter-subject variabilities. With the recent advances in multi-modal deep learning technologies, an increasingly large number of efforts have been devoted to a key question: how do we extract and aggregate multi-modal information to ultimately provide more objective, quantitative computer-aided clinical decision making? This paper reviews the recent studies on dealing with such a question. Briefly, this review will include the (1) overview of current multi-modal learning workflows, (2) summarization of multi-modal fusion methods, (3) discussion of the performance, (4) applications in disease diagnosis and prognosis, and (5) challenges and future directions.


title: On Kernelized Multi-Armed Bandits with Constraints

abstract: We study a stochastic bandit problem with a general unknown reward function and a general unknown constraint function. Both functions can be non-linear (even non-convex) and are assumed to lie in a reproducing kernel Hilbert space (RKHS) with a bounded norm. This kernelized bandit setup strictly generalizes standard multi-armed bandits and linear bandits. In contrast to safety-type hard constraints studied in prior works, we consider soft constraints that may be violated in any round as long as the cumulative violations are small, which is motivated by various practical applications. Our ultimate goal is to study how to utilize the nature of soft constraints to attain a finer complexity-regret-constraint trade-off in the kernelized bandit setting. To this end, leveraging primal-dual optimization, we propose a general framework for both algorithm design and performance analysis. This framework builds upon a novel sufficient condition, which not only is satisfied under general exploration strategies, including \emph{upper confidence bound} (UCB), \emph{Thompson sampling} (TS), and new ones based on \emph{random exploration}, but also enables a unified analysis for showing both sublinear regret and sublinear or even zero constraint violation. We demonstrate the superior performance of our proposed algorithms via numerical experiments based on both synthetic and real-world datasets. Along the way, we also make the first detailed comparison between two popular methods for analyzing constrained bandits and Markov decision processes (MDPs) by discussing the key difference and some subtleties in the analysis, which could be of independent interest to the communities.


title: Heuristic-based Inter-training to Improve Few-shot Multi-perspective Dialog Summarization

abstract: Many organizations require their customer-care agents to manually summarize their conversations with customers. These summaries are vital for decision making purposes of the organizations. The perspective of the summary that is required to be created depends on the application of the summaries. With this work, we study the multi-perspective summarization of customer-care conversations between support agents and customers. We observe that there are different heuristics that are associated with summaries of different perspectives, and explore these heuristics to create weak-labeled data for intermediate training of the models before fine-tuning with scarce human annotated summaries. Most importantly, we show that our approach supports models to generate multi-perspective summaries with a very small amount of annotated data. For example, our approach achieves 94\% of the performance (Rouge-2) of a model trained with the original data, by training only with 7\% of the original data.


title: Earnings-22: A Practical Benchmark for Accents in the Wild

abstract: Modern automatic speech recognition (ASR) systems have achieved superhuman Word Error Rate (WER) on many common corpora despite lacking adequate performance on speech in the wild. Beyond that, there is a lack of real-world, accented corpora to properly benchmark academic and commercial models. To ensure this type of speech is represented in ASR benchmarking, we present Earnings-22, a 125 file, 119 hour corpus of English-language earnings calls gathered from global companies. We run a comparison across 4 commercial models showing the variation in performance when taking country of origin into consideration. Looking at hypothesis transcriptions, we explore errors common to all ASR systems tested. By examining Individual Word Error Rate (IWER), we find that key speech features impact model performance more for certain accents than others. Earnings-22 provides a free-to-use benchmark of real-world, accented audio to bridge academic and industrial research.


title: Demystifying Software Release Note Issues on GitHub

abstract: Release notes (RNs) summarize main changes between two consecutive software versions and serve as a central source of information when users upgrade software. While producing high quality RNs can be hard and poses a variety of challenges to developers, a comprehensive empirical understanding of these challenges is still lacking. In this paper, we bridge this knowledge gap by manually analyzing 1,731 latest GitHub issues to build a comprehensive taxonomy of RN issues with four dimensions: Content, Presentation, Accessibility, and Production. Among these issues, nearly half (48.47%) of them focus on Production; Content, Accessibility, and Presentation take 25.61%, 17.65%, and 8.27%, respectively. We find that: 1) RN producers are more likely to miss information than to include incorrect information, especially for breaking changes; 2) improper layout may bury important information and confuse users; 3) many users find RNs inaccessible due to link deterioration, lack of notification, and obfuscate RN locations; 4) automating and regulating RN production remains challenging despite the great needs of RN producers. Our taxonomy not only pictures a roadmap to improve RN production in practice but also reveals interesting future research directions for automating RN production.


title: Triple-junction solar cells with 39.5% terrestrial and 34.2% space efficiency enabled by thick quantum well superlattices

abstract: Multijunction solar cell design is guided by both the theoretical optimal bandgap combination as well as the realistic limitations to materials with these bandgaps. For instance, triple-junction III-V multijunction solar cells commonly use GaAs as a middle cell because of its near-perfect material quality, despite its bandgap being higher than optimal for the global spectrum. Here, we modify the GaAs bandgap using thick GaInAs/GaAsP strain-balanced quantum well (QW) solar cells with excellent voltage and absorption. These high-performance QWs are incorporated into a triple-junction inverted metamorphic multijunction device consisting of a GaInP top cell, GaInAs/GaAsP QW middle cell, and lattice-mismatched GaInAs bottom cell, each of which has been highly optimized. We demonstrate triple-junction efficiencies of 39.5% and 34.2% under the global and space spectra, respectively, which are higher than previous record six-junction devices.


title: Single pion production in electron-proton interactions

abstract: This paper presents an extension of the MK single pion production model \cite{MK, MK2} to high hadron invariant mass ($W$) and high momentum transfer to conform to the predictions of perturbative QCD due to quark-hadron duality. New form factors for several resonant interactions and non-resonant background in the electron-nucleon cross-sections are determined taking into account the experimental data and improved evaluation techniques. Fits to electron-proton scattering data are used to calculate the vector-current form factors, and to assign uncertainties to the constrained free parameters of the model. The %hadron currents results from this work can be used to determine the vector current in the corresponding neutrino-nucleon cross-sections, which are an important input for event generators in long baseline neutrino oscillation measurements.


title: Cross-Media Scientific Research Achievements Retrieval Based on Deep Language Model

abstract: Science and technology big data contain a lot of cross-media information.There are images and texts in the scientific paper.The s ingle modal search method cannot well meet the needs of scientific researchers.This paper proposes a cross-media scientific research achievements retrieval method based on deep language model (CARDL).It achieves a unified cross-media semantic representation by learning the semantic association between different modal data, and is applied to the generation of text semantic vector of scientific research achievements, and then cross-media retrieval is realized through semantic similarity matching between different modal data.Experimental results show that the proposed CARDL method achieves better cross-modal retrieval performance than existing methods. Key words science and technology big data ; cross-media retrieval; cross-media semantic association learning; deep language model; semantic similarity


title: Effects of transverse geometry on the thermal conductivity of Si and Ge nanowires

abstract: We explore the effects of geometry on the thermal conductivity (kappa) of silicon and germanium nanowires, with lengths between 10-120 nm and diameters up to 5-6 nm. To this end we perform molecular dynamics simulations with the LAMMPS software, using Tersoff interatomic potentials. We consider nanowires with polygonal cross section and we discuss the effect of the transverse geometry on the thermal conductivity. We also consider tubular (hollow) nanowires and core/shell combinations of Si/Ge and Ge/Si, and we compare the heat transport of the core/shell structure with that of the separated core and shell components.


title: Sparse Pose Graph Optimization in Cycle Space

abstract: The state-of-the-art modern pose-graph optimization (PGO) systems are vertex based. In this context the number of variables might be high, albeit the number of cycles in the graph (loop closures) is relatively low. For sparse problems particularly, the cycle space has a significantly smaller dimension than the number of vertices. By exploiting this observation, in this paper we propose an alternative solution to PGO, that directly exploits the cycle space. We characterize the topology of the graph as a cycle matrix, and re-parameterize the problem using relative poses, which are further constrained by a cycle basis of the graph. We show that by using a minimum cycle basis, the cycle-based approach has superior convergence properties against its vertex-based counterpart, in terms of convergence speed and convergence to the global minimum. For sparse graphs, our cycle-based approach is also more time efficient than the vertex-based. As an additional contribution of this work we present an effective algorithm to compute the minimum cycle basis. Albeit known in computer science, we believe that this algorithm is not familiar to the robotics community. All the claims are validated by experiments on both standard benchmarks and simulated datasets. To foster the reproduction of the results, we provide a complete open-source C++ implementation (Code: \url{https://bitbucket.org/FangBai/cycleBasedPGO) of our approach.


title: Angular Super-Resolution in Diffusion MRI with a 3D Recurrent Convolutional Autoencoder

abstract: High resolution diffusion MRI (dMRI) data is often constrained by limited scanning time in clinical settings, thus restricting the use of downstream analysis techniques that would otherwise be available. In this work we develop a 3D recurrent convolutional neural network (RCNN) capable of super-resolving dMRI volumes in the angular (q-space) domain. Our approach formulates the task of angular super-resolution as a patch-wise regression using a 3D autoencoder conditioned on target b-vectors. Within the network we use a convolutional long short term memory (ConvLSTM) cell to model the relationship between q-space samples. We compare model performance against a baseline spherical harmonic interpolation and a 1D variant of the model architecture. We show that the 3D model has the lowest error rates across different subsampling schemes and b-values. The relative performance of the 3D RCNN is greatest in the very low angular resolution domain. Code for this project is available at https://github.com/m-lyon/dMRI-RCNN.


title: Signature of primordial non-Gaussianity on 21-cm power spectrum from dark ages

abstract: We study the signature of primordial non-Gaussianity imprinted on the power spectrum of the 21-cm line differential brightness temperature during dark ages. Employing the perturbative treatment of gravitational clustering, we quantitatively estimate the effects of the non-Gaussian and one-loop corrections on the 21-cm power spectrum. The potential impact of the use of the 21-cm power spectrum for the constraint on local-type primordial non-Gaussianity is investigated based on the Fisher matrix analysis. Our results show that the 21-cm power spectrum for an array with a baseline of several tens of kilometers can constrain the primordial non-Gaussianity to a level severer than that from cosmic microwave background measurements and its constraining power is stronger than that of the 21-cm bispectrum, while in the ultimate situation the 21-cm bispectrum eventually becomes more powerful.


title: Theory of electronic resonances: Fundamental aspects and recent advances

abstract: Electronic resonances are states that are unstable towards loss of electrons. They play critical roles in high-energy environments across chemistry, physics, and biology but are also relevant to processes under ambient conditions that involve unbound electrons. This feature article focuses on complex-variable techniques such as complex scaling and complex absorbing potentials that afford a treatment of electronic resonances in terms of discrete square-integrable eigenstates of non-Hermitian Hamiltonians with complex energy. Fundamental aspects of these techniques as well their integration into molecular electronic-structure theory are discussed and an overview of some recent developments is given: analytic gradient theory for electronic resonances, the application of rank-reduction techniques and quantum embedding to them, as well as approaches for evaluating partial decay widths.


title: Photographic Visualization of Weather Forecasts with Generative Adversarial Networks

abstract: Outdoor webcam images are an information-dense yet accessible visualization of past and present weather conditions, and are consulted by meteorologists and the general public alike. Weather forecasts, however, are still communicated as text, pictograms or charts. We therefore introduce a novel method that uses photographic images to also visualize future weather conditions. This is challenging, because photographic visualizations of weather forecasts should look real, be free of obvious artifacts, and should match the predicted weather conditions. The transition from observation to forecast should be seamless, and there should be visual continuity between images for consecutive lead times. We use conditional Generative Adversarial Networks to synthesize such visualizations. The generator network, conditioned on the analysis and the forecasting state of the numerical weather prediction (NWP) model, transforms the present camera image into the future. The discriminator network judges whether a given image is the real image of the future, or whether it has been synthesized. Training the two networks against each other results in a visualization method that scores well on all four evaluation criteria. We present results for three camera sites across Switzerland that differ in climatology and terrain. We show that users find it challenging to distinguish real from generated images, performing not much better than if they guessed randomly. The generated images match the atmospheric, ground and illumination conditions of the COSMO-1 NWP model forecast in at least 89 % of the examined cases. Nowcasting sequences of generated images achieve a seamless transition from observation to forecast and attain visual continuity.


title: The complex of free factors of a free group

abstract: This paper corrects an error in a proof in the original version of the paper published in 1998 in the Oxford Quarterly. The main theorem remains the same: The geometric realization of the partially ordered set of proper free factors in a finitely generated free group of rank $n$ is homotopy equivalent to a wedge of spheres of dimension $n-2$.


title: Estimating Nonlinear Network Data Models with Fixed Effects

abstract: I introduce a new method for bias correction of dyadic models with agent-specific fixed-effects, including the dyadic link formation model with homophily and degree heterogeneity. The proposed approach uses a jackknife procedure to deal with the incidental parameters problem. The method can be applied to both directed and undirected networks, allows for non-binary outcome variables, and can be used to bias correct estimates of average effects and counterfactual outcomes. I also show how the jackknife can be used to bias-correct fixed effect averages over functions that depend on multiple nodes, e.g. triads or tetrads in the network. As an example, I implement specification tests for dependence across dyads, such as reciprocity or transitivity. Finally, I demonstrate the usefulness of the estimator in an application to a gravity model for import/export relationships across countries.


title: Beryllium abundances in turn-off stars of globular clusters with the CUBES spectrograph

abstract: Globular clusters host multiple stellar populations that display star-to-star variation of light elements that are affected by hot hydrogen burning (e.g., He, C, N, O). Several scenarios have been suggested to explain these variations. Most involve multiple star formation episodes, where later generations are born from material contaminated by the nucleosynthetic products of the previous stellar generation(s). One difficulty in the modelling of such scenarios is knowing the extent to which processed and pristine material are mixed. In this context, beryllium abundances measured in turn-off stars of different generations can provide new information. Beryllium originates from cosmic-ray spallation and can only be destroyed inside stars. Beryllium abundances can thus directly measure the degree of pollution of the material that formed stars in globular clusters. Turn-off stars in globular clusters are however faint and such studies are beyond the capabilities of current instrumentation. In this work, we show the progress that the CUBES spectrograph will bring to this area. Our simulations indicate that CUBES will enable the detection of variations of about 0.6 dex in the Be abundances between stars from different generations, in several nearby globular clusters with turn-off magnitude down to $V$ = 18 mag.


title: The effect of multiple features on the power spectrum in two-field inflation

abstract: We extend our previous work on the enhancement of the curvature spectrum during inflation to the two-field case. We identify the slow-roll parameter $\eta$ as the quantity that can trigger the rapid growth of perturbations. Its two components, $\eta_\parallel$ along the background trajectory and $\eta_\perp$ perpendicular to it, remain small during most of the evolution, apart from short intervals during which they take large, positive or negative, values. The typical reason for the appearance of strong features in $\eta_\parallel$ is sharp steps or inflection points in the inflaton potential, while $\eta_\perp$ grows large during sharp turns in field space. We focus on the additive effect of several features leading to the resonant growth of the curvature spectrum. Three or four features in the evolution of $\eta$ are sufficient in order to induce an enhancement of the power spectrum by six or seven orders of magnitude, which can lead to the significant production of primordial black holes and stochastic gravitational waves. A big part of our study focuses on understanding the evolution of the perturbations and the resulting spectra through analytic means. The presence of multiple features in the background evolution points to a more complex inflationary paradigm, which is also more natural in the multi-field case. The critical examination of this possibility is within the reach of experiment.


title: Spontaneous spinning of a dichloromethane drop on an aqueous surfactant solution

abstract: We report a series of experiments carried out with a dichloromethane drop deposited on the surface of an aqueous solution containing a surfactant, cetyltrimethylammonium bromide. After an induction stage during which the drop stays axisymmetric, oscillations occur along the contact line. These oscillations are succeeded by a spectacular spontaneous spinning of the drop. The latter quickly takes the form of a two-tip `rotor' and the spinning rate stabilizes at a constant value, no longer varying despite the gradual changes of the drop shape and size. The drop eventually disappears due to the continual dissolution and evaporation of dichloromethane. Schlieren visualizations and particle image velocimetry are used to establish a consistent scenario capable of explaining the evolution of the system. The Marangoni effect induced by the dissolution of dichloromethane in the drop vicinity is shown to be responsible for the observed dynamics. Arguments borrowed from dynamical systems theory and from an existing low-order model allow us to explain qualitatively why the system selects the spinning configuration. The geometry of the immersed part of the drop is shown to play a crucial role in this selection process, as well as in the regulation of the spinning rate.


title: Typical Error Exponents: A Dual Domain Derivation

abstract: This paper shows that the probability that the error exponent of a given code randomly generated from a pairwise independent ensemble being smaller than a lower bound on the typical random-coding exponent tends to zero as the codeword length tends to infinity. This lower bound is known to be tight for i.i.d. ensembles over the binary symmetric channel and for constant-composition codes over memoryless channels. Our results recover both as special cases and remain valid for arbitrary alphabets, arbitrary channels -- for example finite-state channels with memory -- and arbitrary pairwise-independent ensembles. We specialize our results to the i.i.d., constant-composition and cost-constrained ensembles over discrete memoryless channels and to ensembles over finite-state channels.


title: Hybrid helical state and superconducting diode effect in S/F/TI heterostructures

abstract: It is well-known that the ground state of homogeneous superconducting systems with spin-orbit coupling (SOC) in the presence of the Zeeman field is the so-called helical state, which is characterized by the phase modulation of the order parameter, but zero supercurrent density. In this work we investigate the realization of the helical state in a hybrid system with spatially separated superconductivity and exchange field by considering S/F bilayer on top of a 3D topological insulator. This system is characterized by strong spin-momentum locking and, consequently, provides the most favorable conditions for the helical state generation. The analysis is based on the microscopic theory in terms of the quasiclassical Green's functions. We demonstrate that in the bilayer the helical state survives if the exchange field has non-zero component perpendicular to the S/F interface even in spite of the fact that the superconducting order parameter and the exchange field are spatially separated. At the same time, in this spatially inhomogeneous situation the helical state is accompanied by the spontaneous currents distributed over the bilayer in such a way as to have zero average. Further, we show that this hybrid helical state gives rise to nonreciprocity in the system. We demonstrate the realization of the superconducting diode effect and show that the degree of nonreciprocity is very large in the considered system due to the strongest possible value of the spin-momentum locking.


title: Locality Matters: A Locality-Biased Linear Attention for Automatic Speech Recognition

abstract: Conformer has shown a great success in automatic speech recognition (ASR) on many public benchmarks. One of its crucial drawbacks is the quadratic time-space complexity with respect to the input sequence length, which prohibits the model to scale-up as well as process longer input audio sequences. To solve this issue, numerous linear attention methods have been proposed. However, these methods often have limited performance on ASR as they treat tokens equally in modeling, neglecting the fact that the neighbouring tokens are often more connected than the distanced tokens. In this paper, we take this fact into account and propose a new locality-biased linear attention for Conformer. It not only achieves higher accuracy than the vanilla Conformer, but also enjoys linear space-time computational complexity. To be specific, we replace the softmax attention with a locality-biased linear attention (LBLA) mechanism in Conformer blocks. The LBLA contains a kernel function to ensure the linear complexities and a cosine reweighing matrix to impose more weights on neighbouring tokens. Extensive experiments on the LibriSpeech corpus show that by introducing this locality bias to the Conformer, our method achieves a lower word error rate with more than 22% inference speed.


title: LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT

abstract: Self-supervised speech representation learning has shown promising results in various speech processing tasks. However, the pre-trained models, e.g., HuBERT, are storage-intensive Transformers, limiting their scope of applications under low-resource settings. To this end, we propose LightHuBERT, a once-for-all Transformer compression framework, to find the desired architectures automatically by pruning structured parameters. More precisely, we create a Transformer-based supernet that is nested with thousands of weight-sharing subnets and design a two-stage distillation strategy to leverage the contextualized latent representations from HuBERT. Experiments on automatic speech recognition (ASR) and the SUPERB benchmark show the proposed LightHuBERT enables over $10^9$ architectures concerning the embedding dimension, attention dimension, head number, feed-forward network ratio, and network depth. LightHuBERT outperforms the original HuBERT on ASR and five SUPERB tasks with the HuBERT size, achieves comparable performance to the teacher model in most tasks with a reduction of 29% parameters, and obtains a $3.5\times$ compression ratio in three SUPERB tasks, e.g., automatic speaker verification, keyword spotting, and intent classification, with a slight accuracy loss. The code and pre-trained models are available at https://github.com/mechanicalsea/lighthubert.


title: Galaxy And Mass Assembly (GAMA): Self-Organizing Map Application on Nearby Galaxies

abstract: Galaxy populations show bimodality in a variety of properties: stellar mass, colour, specific star-formation rate, size, and S\'ersic index. These parameters are our feature space. We use an existing sample of 7556 galaxies from the Galaxy and Mass Assembly (GAMA) survey, represented using five features and the K-means clustering technique, showed that the bimodalities are the manifestation of a more complex population structure, represented by between 2 and 6 clusters. Here we use Self Organizing Maps (SOM), an unsupervised learning technique which can be used to visualize similarity in a higher dimensional space using a 2D representation, to map these five-dimensional clusters in the feature space onto two-dimensional projections. To further analyze these clusters, using the SOM information, we agree with previous results that the sub-populations found in the feature space can be reasonably mapped onto three or five clusters. We explore where the "green valley" galaxies are mapped onto the SOM, indicating multiple interstitial populations within the green valley population. Finally, we use the projection of the SOM to verify whether morphological information provided by GalaxyZoo users, for example, if features are visible, can be mapped onto the SOM-generated map. Voting on whether galaxies are smooth, likely ellipticals, or "featured" can reasonably be separated but smaller morphological features (bar, spiral arms) can not. SOMs promise to be a useful tool to map and identify instructive sub-populations in multidimensional galaxy survey feature space, provided they are large enough.


title: Three-Dimensional Spectrum Occupancy Measurement using UAV: Performance Analysis and Algorithm Design

abstract: Spectrum sharing, as an approach to significantly improve spectrum efficiency in the era of 6th generation mobile networks (6G), has attracted extensive attention. Radio Environment Map (REM) based low-complexity spectrum sharing is widely studied where the spectrum occupancy measurement (SOM) is vital to construct REM. The SOM in three-dimensional (3D) space is becoming increasingly essential to support the spectrum sharing with space-air-ground integrated network being a great momentum of 6G. In this paper, we analyze the performance of 3D SOM to further study the tradeoff between accuracy and efficiency in 3D SOM. We discover that the error of 3D SOM is related with the area of the boundary surfaces of licensed networks, the number of discretized cubes, and the length of the edge of 3D space. Moreover, we design a fast and accurate 3D SOM algorithm that utilizes unmanned aerial vehicle (UAV) to measure the spectrum occupancy considering the path planning of UAV, which improves the measurement efficiency by requiring less measurement time and flight time of the UAV for satisfactory performance. The theoretical results obtained in this paper reveal the essential dependencies that describe the 3D SOM methodology, and the proposed algorithm is beneficial to improve the efficiency of 3D SOM. It is noted that the theoretical results and algorithm in this paper may provide a guideline for more areas such as spectrum monitoring, spectrum measurement, network measurement, planning, etc.


title: Dynamic Latency for CTC-Based Streaming Automatic Speech Recognition With Emformer

abstract: An inferior performance of the streaming automatic speech recognition models versus non-streaming model is frequently seen due to the absence of future context. In order to improve the performance of the streaming model and reduce the computational complexity, a frame-level model using efficient augment memory transformer block and dynamic latency training method is employed for streaming automatic speech recognition in this paper. The long-range history context is stored into the augment memory bank as a complement to the limited history context used in the encoder. Key and value are cached by a cache mechanism and reused for next chunk to reduce computation. Afterwards, a dynamic latency training method is proposed to obtain better performance and support low and high latency inference simultaneously. Our experiments are conducted on benchmark 960h LibriSpeech data set. With an average latency of 640ms, our model achieves a relative WER reduction of 6.0% on test-clean and 3.0% on test-other versus the truncate chunk-wise Transformer.


title: Integrating Lattice-Free MMI into End-to-End Speech Recognition

abstract: In automatic speech recognition (ASR) research, discriminative criteria have achieved superior performance in DNN-HMM systems. Given this success, the adoption of discriminative criteria is promising to boost the performance of end-to-end (E2E) ASR systems. With this motivation, previous works have introduced the minimum Bayesian risk (MBR, one of the discriminative criteria) into E2E ASR systems. However, the effectiveness and efficiency of the MBR-based methods are compromised: the MBR criterion is only used in system training, which creates a mismatch between training and decoding; the on-the-fly decoding process in MBR-based methods results in the need for pre-trained models and slow training speeds. To this end, novel algorithms are proposed in this work to integrate another widely used discriminative criterion, lattice-free maximum mutual information (LF-MMI), into E2E ASR systems not only in the training stage but also in the decoding process. The proposed LF-MMI training and decoding methods show their effectiveness on two widely used E2E frameworks: Attention-Based Encoder-Decoders (AEDs) and Neural Transducers (NTs). Compared with MBR-based methods, the proposed LF-MMI method: maintains the consistency between training and decoding; eschews the on-the-fly decoding process; trains from randomly initialized models with superior training efficiency. Experiments suggest that the LF-MMI method outperforms its MBR counterparts and consistently leads to statistically significant performance improvements on various frameworks and datasets from 30 hours to 14.3k hours. The proposed method achieves state-of-the-art (SOTA) results on Aishell-1 (CER 4.10%) and Aishell-2 (CER 5.02%) datasets. Code is released.


title: Learning Sparse Mixture Models

abstract: This work approximates high-dimensional density functions with an ANOVA-like sparse structure by the mixture of wrapped Gaussian and von Mises distributions. When the dimension $d$ is very large, it is complex and impossible to train the model parameters by the usually known learning algorithms due to the curse of dimensionality. Therefore, assuming that each component of the model depends on an a priori unknown much smaller number of variables than the space dimension $d,$ we first define an algorithm that determines the mixture model's set of active variables by the Kolmogorov-Smirnov and correlation test. Then restricting the learning procedure to the set of active variables, we iteratively determine the set of variable interactions of the marginal density function and simultaneously learn the parameters by the Kolmogorov and correlation coefficient statistic test and the proximal Expectation-Maximization algorithm. The learning procedure considerably reduces the algorithm's complexity for the input dimension $d$ and increases the model's accuracy for the given samples, as the numerical examples show.


title: QCD sum rule study for hidden-strange pentaquarks

abstract: Inspired by the LHCb's observations of hidden-charm $P_{c(s)}$ states, we study their hidden-strange analogues $P_s$ states in both $[udu][\bar ss]$ and $[uds][\bar su]$ configurations. We investigate the $P_s$ pentaquark states in $p\eta^\prime$, $p\phi$, $\Lambda K$, $\Sigma K$ and $\Sigma^\ast K^\ast$ structures with $J^P = \frac{1}{2}^-$ and $\Sigma ^\ast K$ and $\Sigma K^\ast$ with $J^P = \frac{3}{2}^-$, and calculate their masses in the framework of QCD sum rules. Our numerical results show that the extracted hadron masses for all the $p\eta^\prime$, $p\phi$, $\Lambda K$, $\Sigma K$ and $\Sigma^\ast K^\ast$ structures are much higher than $\Sigma K$ mass threshold and masses for $\Sigma ^\ast K$ and $\Sigma K^\ast$ also higher than threshold of corresponding hadron, so that no bound state exists in such channels, which is consistent with the experimental status to date.


title: Viscoplastic sessile drop coalescence

abstract: The evolution of the liquid bridge formed between two coalescing sessile yield-stress drops is studied experimentally. We find that the height of the bridge evolves similar to a viscous Newtonian fluid, $h_0\sim t$, before arresting at long time prior to minimizing its liquid/gas interfacial energy. We numerically solve for the final arrested profile shape and find it depends on the fluid's yield stress $\tau_y$ and coalescence angle $\alpha$, represented by the Bingham number $\tau_y h_{drop} / \sigma$ modified by the drop's height-width aspect ratio. We present a scaling argument for the bridge's temporal evolution using the length scale found from an analysis of the arrested shape as well as from the similarity solution derived for the bridge's evolution.


title: Exploring Body Texture from mmW Images for Person Recognition

abstract: Imaging using millimeter waves (mmWs) has many advantages including the ability to penetrate obscurants such as clothes and polymers. After having explored shape information retrieved from mmW images for person recognition, in this work we aim to gain some insight about the potential of using mmW texture information for the same task, considering not only the mmW face, but also mmW torso and mmW wholebody. We report experimental results using the mmW TNO database consisting of 50 individuals based on both hand-crafted and learned features from Alexnet and VGG-face pretrained Convolutional Neural Networks (CNN) models. First, we analyze the individual performance of three mmW body parts, concluding that: i) mmW torso region is more discriminative than mmW face and the whole body, ii) CNN features produce better results compared to hand-crafted features on mmW faces and the entire body, and iii) hand-crafted features slightly outperform CNN features on mmW torso. In the second part of this work, we analyze different multi-algorithmic and multi-modal techniques, including a novel CNN-based fusion technique, improving verification results to 2% EER and identification rank-1 results up to 99%. Comparative analyses with mmW body shape information and face recognition in the visible and NIR spectral bands are also reported.


title: Classification of Hyperspectral Images Using SVM with Shape-adaptive Reconstruction and Smoothed Total Variation

abstract: In this work, a novel algorithm called SVM with Shape-adaptive Reconstruction and Smoothed Total Variation (SaR-SVM-STV) is introduced to classify hyperspectral images, which makes full use of spatial and spectral information. The Shape-adaptive Reconstruction (SaR) is introduced to preprocess each pixel based on the Pearson Correlation between pixels in its shape-adaptive (SA) region. Support Vector Machines (SVMs) are trained to estimate the pixel-wise probability maps of each class. Then the Smoothed Total Variation (STV) model is applied to denoise and generate the final classification map. Experiments show that SaR-SVM-STV outperforms the SVM-STV method with a few training labels, demonstrating the significance of reconstructing hyperspectral images before classification.


title: Properties Preserved by Groupoid Equivalence

abstract: We show that groupoid equivalence preserves a number of groupoid properties such as properness or the property of being topologically principal.


title: Impact of COVID-19 on Astronomy: Two Years In

abstract: We study the impact of the COVID-19 pandemic on astronomy using public records of astronomical publications. We show that COVID-19 has had both positive and negative impacts on research in astronomy. We find that the overall output of the field, measured by the yearly paper count, has increased. This is mainly driven by boosted individual productivity seen across most countries, possibly the result of cultural and technological changes in the scientific community during COVID. However, a decreasing number of incoming new researchers is seen in most of the countries we studied, indicating larger barriers for new researchers to enter the field or for junior researchers to complete their first project during COVID. Unfortunately, the overall improvement in productivity seen in the field is not equally shared by female astronomers. By fraction, fewer papers are written by women and fewer women are among incoming new researchers in most countries. Even though female astronomers also became more productive during COVID, the level of improvement is smaller than for men. Pre-COVID, female astronomers in the Netherlands, Australia, Switzerland were equally as or even more productive than their male colleagues. During COVID, no single country's female astronomers were able to be more productive than their male colleagues on average.


title: On averaging and mixing for stochastic PDEs

abstract: We examine the convergence in the Krylov--Bogolyubov averaging for nonlinear stochastic perturbations of linear PDEs with pure imaginary spectrum and show that if the involved effective equation is mixing, then the convergence is uniform in time.


title: On Choquet integrals and Poincar\'e-Sobolev inequalities

abstract: We consider integral inequalities in the sense of Choquet with respect to the Hausdorff content $\mathcal{H}_\infty^{\delta}$. In particular, if $\Omega$ is a bounded John domain in $\mathbb{R}^n$, $n\geq 2$, and $0 <\delta \le n$, we prove that the corresponding $(\delta p/(\delta -p),p)$-Poincar\'e-Sobolev inequalities hold for all continuously differentiable functions defined on $\Omega$ whenever $\delta /n < p < \delta$. We prove also that the $(p,p)$-Poincar\'e inequality is valid for all $p>\delta /n$.


title: Microphysics of diffusive shock acceleration: impact on the spectrum of accelerated particles

abstract: Diffusive shock acceleration at collisionless shocks remains the most likely process for accelerating particles in a variety of astrophysical sources. While the standard prediction for strong shocks is that the spectrum of accelerated particles is universal, $f(p)\propto p^{-4}$, numerous phenomena affect this simple conclusion. In general, the non-linear dynamical reaction of accelerated particles leads to a concave spectrum, steeper than $p^{-4}$ at momenta below a few tens of GeV/c and harder than the standard prediction at high energies. However, the non-linear effects become important in the presence of magnetic field amplification, which in turn leads to higher values of the maximum momentum $p_{max}$. It was recently discovered that the self-generated perturbations that enhance particle scattering, when advected downstream, move in the same direction as the background plasma, so that the effective compression factor at the shock decreases and the spectrum becomes steeper. We investigate the implications of the excitation of the non-resonant streaming instability on these spectral deformations, the dependence of the spectral steepening on the shock velocity and the role played by the injection momentum.