title: Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systems

abstract: Recommender System (RS) is an important online application that affects billions of users every day. The mainstream RS ranking framework is composed of two parts: a Multi-Task Learning model (MTL) that predicts various user feedback, i.e., clicks, likes, sharings, and a Multi-Task Fusion model (MTF) that combines the multi-task outputs into one final ranking score with respect to user satisfaction. There has not been much research on the fusion model while it has great impact on the final recommendation as the last crucial process of the ranking. To optimize long-term user satisfaction rather than obtain instant returns greedily, we formulate MTF task as Markov Decision Process (MDP) within a recommendation session and propose a Batch Reinforcement Learning (RL) based Multi-Task Fusion framework (BatchRL-MTF) that includes a Batch RL framework and an online exploration. The former exploits Batch RL to learn an optimal recommendation policy from the fixed batch data offline for long-term user satisfaction, while the latter explores potential high-value actions online to break through the local optimal dilemma. With a comprehensive investigation on user behaviors, we model the user satisfaction reward with subtle heuristics from two aspects of user stickiness and user activeness. Finally, we conduct extensive experiments on a billion-sample level real-world dataset to show the effectiveness of our model. We propose a conservative offline policy estimator (Conservative-OPEstimator) to test our model offline. Furthermore, we take online experiments in a real recommendation environment to compare performance of different models. As one of few Batch RL researches applied in MTF task successfully, our model has also been deployed on a large-scale industrial short video platform, serving hundreds of millions of users.


title: The nonlocal Neumann problem

abstract: The classical local Neumann problem is well studied and solutions of this problem lie, in general, in a Sobolev space. In this work, we focus on nonlocal Neumann problems with measurable, nonnegative kernels, whose solutions require less regularity assumptions. For kernels of this kind we formulate and study the weak formulation of the nonlocal Neumann problem and we investigate a nonlocal counterpart of the Sobolev space $H^{1}$ as well as a resulting nonlocal trace space. We further establish, mainly for symmetric kernels, various existence results for the weak solution of the Neumann problem and we discuss related necessary conditions. Both, homogeneous and nonhomogeneous Neumann boundary conditions are considered. In addition to that, we present a new weak formulation of a Robin problem, where we reformulate the Robin problem into a regional problem.


title: Stabilization of singlet hole-doped state in infinite-layer nickelate superconductors

abstract: Motivated by the recent X-ray absorption spectroscopy (XAS) and resonant inelastic X-ray scattering (RIXS) experiments, we use a detailed impurity model to explore the nature of the parent compound and hole doped states of (La, Nd, Pr)NiO$_2$ by including the crystal field splitting, the Ni-$3d$ multiplet structure, and the hybridization between Ni-$3d$, O-$2p$, and Nd-$5d$ orbitals. For simplicity and stimulated by the recent electronic structure calculations, the latter are formally replaced with symmetric orbitals centered at the missing O sites in the Nd layer, forming a two-dimensional (2D) band strongly hybridizing with the Ni-$3d^9_{z^2}$ state. This hybridization pushes the main part of the $3d^9_{z^2}$ spectral function up in energy by several eV and stabilizes the singlet with considerable $d^9_{z^2}$ and other configurational components. For the parent compound, we find that states of Ni-$3d^9_{z^2}$ character spread over a large energy range in the spectra, and cannot and should not be represented by a single orbital energy, as suggested in other approximations. This is qualitatively consistent with the RIXS measurements showing a broad distribution of the Ni-$3d^9_{z^2}$ hole state, although the shape of the Ni-$3d^9_{z^2}$ related structure is much more complicated requiring reinterpretations of the RIXS data. For the hole-doped systems, we show that adding these additional ingredients can still result in the lowest-energy hole doped state having a singlet character.


title: An Agent-Based Fleet Management Model for First- and Last-Mile Services

abstract: With the growth of cars and car-sharing applications, commuters in many cities, particularly developing countries, are shifting away from public transport. These shifts have affected two key stakeholders: transit operators and first- and last-mile (FLM) services. Although most cities continue to invest heavily in bus and metro projects to make public transit attractive, ridership in these systems has often failed to reach targeted levels. FLM service providers also experience lower demand and revenues in the wake of shifts to other means of transport. Effective FLM options are required to prevent this phenomenon and make public transport attractive for commuters. One possible solution is to forge partnerships between public transport and FLM providers that offer competitive joint mobility options. Such solutions require prudent allocation of supply and optimised strategies for FLM operations and ride-sharing. To this end, we build an agent- and event-based simulation model which captures interactions between passengers and FLM services using statecharts, vehicle routing models, and other trip matching rules. An optimisation model for allocating FLM vehicles at different transit stations is proposed to reduce unserved requests. Using real-world metro transit demand data from Bengaluru, India, the effectiveness of our approach in improving FLM connectivity and quantifying the benefits of sharing trips is demonstrated.


title: Statistical Properties of the log-cosh Loss Function Used in Machine Learning

abstract: This paper analyzes a popular loss function used in machine learning called the log-cosh loss function. A number of papers have been published using this loss function but, to date, no statistical analysis has been presented in the literature. In this paper, we present the distribution function from which the log-cosh loss arises. We compare it to a similar distribution, called the Cauchy distribution, and carry out various statistical procedures that characterize its properties. In particular, we examine its associated pdf, cdf, likelihood function and Fisher information. Side-by-side we consider the Cauchy and Cosh distributions as well as the MLE of the location parameter with asymptotic bias, asymptotic variance, and confidence intervals. We also provide a comparison of robust estimators from several other loss functions, including the Huber loss function and the rank dispersion function. Further, we examine the use of the log-cosh function for quantile regression. In particular, we identify a quantile distribution function from which a maximum likelihood estimator for quantile regression can be derived. Finally, we compare a quantile M-estimator based on log-cosh with robust monotonicity against another approach to quantile regression based on convolutional smoothing.


title: Positively transitioned sentiment dialogue corpus for developing emotion-affective open-domain chatbots

abstract: In this paper, we describe a data enhancement method for developing Emily, an emotion-affective open-domain chatbot. The proposed method is based on explicitly modeling positively transitioned (PT) sentiment data from multi-turn dialogues. We construct a dialogue corpus with PT sentiment data and will release it for public use. By fine-tuning a pretrained dialogue model using the produced PT-enhanced dialogues, we are able to develop an emotion-affective open-domain chatbot exhibiting close-to-human performance in various emotion-affective metrics. We evaluate Emily against a few state-of-the-art (SOTA) open-domain chatbots and show the effectiveness of the proposed approach. The corpus is made publicly available.


title: Projected d-wave superconducting state: a fermionic projected entangled pair state study

abstract: We investigate the physics of projected d-wave pairing states using their fermionic projected entangled pair state (fPEPS) representation. First, we approximate a d-wave Bardeen-Cooper-Schrieffer state using the Gaussian fPEPS. Next, we translate the resulting state into fPEPS tensors and implement the Gutzwiller projection which removes double occupancy by modifying the local tensor elements. The tensor network representation of the projected d-wave pairing state allows us to evaluate physical quantities in the thermodynamic limit without employing the Gutzwiller approximation. Despite having very few variational parameters, such physically motivated tensor network states are shown to exhibit competitive energies for the doped t-J model. We expect that such construction offers useful initial states and guidance for variational tensor network calculations.


title: Analysis of Longitudinal Data with Missing Values in the Response and Covariates Using the Stochastic EM Algorithm

abstract: In longitudinal data a response variable is measured over time, or under different conditions, for a cohort of individuals. In many situations all intended measurements are not available which results in missing values. If the missing value is never followed by an observed measurement, this leads to dropout pattern. The missing values could be in the response variable, the covariates or in both. The missingness mechanism is termed non-random when the probability of missingness depends on the missing value and may be on the observed values. In this case the missing values should be considered in the analysis to avoid any potential bias. The aim of this article is to employ multiple imputations (MI) to handle missing values in covariates using. The selection model is used to model longitudinal data in the presence of non-random dropout. The stochastic EM algorithm (SEM) is developed to obtain the model parameter estimates in addition to the estimates of the dropout model. The SEM algorithm does not provide standard errors of the estimates. We developed a Monte Carlo method to obtain the standard errors. The proposed approach performance is evaluated through a simulation study. Also, the proposed approach is applied to a real data set.


title: The Impact of Data Corruption on Named Entity Recognition for Low-resourced Languages

abstract: Data availability and quality are major challenges in natural language processing for low-resourced languages. In particular, there is significantly less data available than for higher-resourced languages. This data is also often of low quality, rife with errors, invalid text or incorrect annotations. Many prior works focus on dealing with these problems, either by generating synthetic data, or filtering out low-quality parts of datasets. We instead investigate these factors more deeply, by systematically measuring the effect of data quantity and quality on the performance of pre-trained language models in a low-resourced setting. Our results show that having fewer completely-labelled sentences is significantly better than having more sentences with missing labels; and that models can perform remarkably well with only 10% of the training data. Importantly, these results are consistent across ten low-resource languages, English, and four pre-trained models.


title: FLASH Pilot Survey: Detections of associated 21 cm HI absorption in GAMA galaxies at 0.42 < z <1.00

abstract: We present the results of a search for associated 21 cm HI absorption at redshift 0.42 < z < 1.00 in radio-loud galaxies from three Galaxy And Mass Assembly (GAMA) survey fields. These observations were carried out as part of a pilot survey for the ASKAP First Large Absorption Survey in HI (FLASH). From a sample of 326 radio sources with 855.5 MHz peak flux density above 10 mJy we detected two associated HI absorption systems, in SDSS J090331+010847 at z= 0.522 and SDSS J113622+004852 at z= 0.563. Both galaxies are massive (stellar mass > 10$^{11}$ M$_{sun}$) and have optical spectra characteristic of luminous red galaxies,though SED fitting implies that SDSS J113622+004852 contains a dust-obscured starburst with SFR ~ 69 M$_{sun}$ yr$^{-1}$. The HI absorption lines have a high optical depth, with $\tau_{pk}$ of 1.77 $\pm$ 0.16 for SDSS J090331+010847 (the highest value for any z > 0.1 associated system found to date) and 0.14 $\pm$ 0.01 for SDSS J113622+004852. In the redshift range probed by our ASKAP observations, the detection rate for associated HI absorption lines (with $\tau_{pk}$ > 0.1 and at least 3$\sigma$ significance) is 2.9 (+9.7 -2.6) percent. Although the current sample is small, this rate is consistent with a trend seen in other studies for a lower detection rate of associated 21 cm HI absorption systems at higher redshift. We also searched for OH absorption lines at 0.67 < z < 1.34, but no detection was made in the 145 radio sources searched.


title: Study of stationary rigidly rotating anisotropic cylindrical fluids with new exact interior solutions of GR. 2. More about axial pressure

abstract: This article is the second in a series devoted to the study of spacetimes sourced by a stationary cylinder of fluid rigidly rotating around its symmetry axis and exhibiting an anisotropic pressure by using new exact interior solutions of General Relativity. The configurations have been specialized to three different cases where the pressure is on turn directed alongside each principal stress. The two first articles in the series display the analysis of the axial pressure case. Indeed, the first axial class published in Paper 1 is merely a special case. It is recalled here and its properties are revised and supplemented. Moreover, a fully general method aiming at constructing different classes of such solutions is displayed. This method described in the present paper, Paper 2, represents a key result of this work. It is exemplified and applied to two new classes of solutions depending on a single constant parameter. One of them, denoted Class A, is shown to verify every conditions needing to be satisfied by a fully achieved set of exact solutions: axisymmetry and regularity conditions, matching to an exterior vacuum, proper metric signature, weak and strong energy conditions. Other properties and general rules are exhibited, some shedding light on rather longstanding issues. Astrophysical and physical applications are suggested.


title: The ASTRI Mini-Array of Cherenkov Telescopes at the Observatorio del Teide

abstract: The ASTRI Mini-Array (MA) is an INAF project to build and operate a facility to study astronomical sources emitting at very high-energy in the TeV spectral band. The ASTRI MA consists of a group of nine innovative Imaging Atmospheric Cherenkov telescopes. The telescopes will be installed at the Teide Astronomical Observatory of the Instituto de Astrofisica de Canarias (IAC) in Tenerife (Canary Islands, Spain) on the basis of a host agreement with INAF. Thanks to its expected overall performance, better than those of current Cherenkov telescopes' arrays for energies above \sim 5 TeV and up to 100 TeV and beyond, the ASTRI MA will represent an important instrument to perform deep observations of the Galactic and extra-Galactic sky at these energies.


title: The coincidence of the Bruhat order and the secondary Bruhat order on $\mathcal{A}(n,k)$

abstract: Given a positive integer $n$ and a nonnegative integer $k$ with $k\leq n$, we denote by $\mathcal{A}(n,k)$ the class of all $n$-by-$n$ $(0,1)$-matrices with constant row and column sums $k$. In this paper, we show that the Bruhat order and the secondary Bruhat order coincide on $\mathcal{A}(n,k)$ if and only if either $0\leq n\leq 5$ or $k\in\{0,1,2,n-2,n-1,n\}$ with $n\geq 6$.


title: A Topological Loss Function: Image Denoising on a Low-Light Dataset

abstract: Although image denoising algorithms have attracted significant research attention, surprisingly few have been proposed for, or evaluated on, noise from imagery acquired under real low-light conditions. Moreover, noise characteristics are often assumed to be spatially invariant, leading to edges and textures being distorted after denoising. Here, we introduce a novel topological loss function which is based on persistent homology. The method performs in the space of image patches, where topological invariants are calculated and represented in persistent diagrams. The loss function is a combination of $\ell_1$ or $\ell_2$ losses with the new persistence-based topological loss. We compare its performance across popular denoising architectures and loss functions, training the networks on our new comprehensive dataset of natural images captured in low-light conditions -- BVI-LOWLIGHT. Analysis reveals that this approach outperforms existing methods, adapting well to complex structures and suppressing common artifacts.


title: A linear isotropic Cosserat shell model including terms up to $O(h^5)$. Existence and uniqueness

abstract: In this paper we derive the linear elastic Cosserat shell model incorporating effects up to order $O(h^5)$ in the shell thickness $h$ as a particular case of the recently introduced geometrically nonlinear elastic Cosserat shell model. The existence and uniqueness of the solution is proven in suitable admissible sets. To this end, inequalities of Korn-type for shells are established which allow to show coercivity in the Lax-Milgram theorem. We are also showing an existence and uniqueness result for a truncated $O(h^3)$ model. Main issue is the suitable treatment of the curved reference configuration of the shell. Some connections to the classical Koiter membrane-bending model are highlighted.


title: Adaptive Kernel Density Estimation proposal in gravitational wave data analysis

abstract: Markov Chain Monte Carlo approach is frequently used within Bayesian framework to sample the target posterior distribution. Its efficiency strongly depends on the proposal used to build the chain. The best jump proposal is the one that closely resembles the unknown target distribution, therefore we suggest an adaptive proposal based on Kernel Density Estimation (KDE). We group parameters of the model according to their correlation and build KDE based on the already accepted points for each group. We adapt the KDE-based proposal until it stabilizes. We argue that such a proposal could be helpful in applications where the data volume is increasing and in the hyper-model sampling. We tested it on several astrophysical datasets (IPTA and LISA) and have shown that in some cases KDE-based proposal also helps to reduce the autocorrelation length of the chains. The efficiency of this proposal is reduces in case of the strong correlations between a large group of parameters.


title: A Dichotomy for the dimension of SRB measure

abstract: We study dynamical systems generated by skew products: $$T: [0,1)\times\mathbb{R}\to [0,1)\times\mathbb{R} \quad\quad T(x,y)=(bx\mod1,\gamma y+\phi(x))$$ where integer $b\ge2$, $0<\gamma<1$ and $\phi$ is a real analytic $\mathbb{Z}$-periodic function. We prove the following dichotomy for the SRB measure $\omega$ for $T$: Either the support of $\omega$ is a graph of real analytic function, or the dimension of $\omega$ is equal to $\min\{2,1+\frac{\log b}{\log1/\gamma}\}$. Furthermore, given $b$ and $\phi$, the former alternative only happens for finitely many $\gamma$ unless $\phi$ is constant.


title: Novel slow-fast behaviour in an oscillator driven by a frequency-switching force

abstract: When an oscillator switches abruptly between different frequencies, there is some ambiguity in deciding how the system should be modelled at the switch. Here we describe two seemingly natural models of a switch in a simple periodically-forced harmonic oscillator, which disagree starkly in their predictions of its long time behaviour. Attempting to resolve the disagreement by `regularizing' the switch not only preserves the disagreement, but shows it increases with time. One of the models corresponds to a conventional `Filippov' description of a nonsmooth system, while the second exhibits a structure that irreversibly ages, developing a number of novel multi-scale behaviours that we believe have not been reported before. These include slow-fast staircases, novel mixed-mode oscillations, and a synchronized canard explosion. These features are proven to exist using asymptotic analysis, but as they involve a slow-fast time-scale separation that increases with time, they lie beyond the reach of numerical methods.


title: Pushchino multibeams pulsar search. First results

abstract: Since the discovery of pulsars, dozens of surveys have already been conducted with their searches. In the course of surveys in the sky, areas from thousands to tens of thousands of square degrees are explored. Despite repeated observations of the same areas, new pulsars are constantly being discovered. We present Pushchino Multibeam Pulsar Search (PUMPS), having a sensitivity that is an order of magnitude higher than the sensitivity of all previously made surveys on pulsar search. In PUMPS daily round-the-clock observations are carried out of the area located on declinations $-9^o < \delta < +42^o$. The survey is carried out on 96 beams of a Large Phased Array (LPA) at a frequency of 111 MHz. During the observation period of August 2014 - August 2022, the survey was repeated approximately 3,000 times. The expected sensitivity in the survey reaches up to 0.1 mJy. The paper considers some tasks that can be solved when processing the received data.


title: Adaptive Zeroth-Order Optimisation of Nonconvex Composite Objectives

abstract: In this paper, we propose and analyze algorithms for zeroth-order optimization of non-convex composite objectives, focusing on reducing the complexity dependence on dimensionality. This is achieved by exploiting the low dimensional structure of the decision set using the stochastic mirror descent method with an entropy alike function, which performs gradient descent in the space equipped with the maximum norm. To improve the gradient estimation, we replace the classic Gaussian smoothing method with a sampling method based on the Rademacher distribution and show that the mini-batch method copes with the non-Euclidean geometry. To avoid tuning hyperparameters, we analyze the adaptive stepsizes for the general stochastic mirror descent and show that the adaptive version of the proposed algorithm converges without requiring prior knowledge about the problem.


title: More Interpretable Graph Similarity Computation via Maximum Common Subgraph Inference

abstract: Graph similarity measurement, which computes the distance/similarity between two graphs, arises in various graph-related tasks. Recent learning-based methods lack interpretability, as they directly transform interaction information between two graphs into one hidden vector and then map it to similarity. To cope with this problem, this study proposes a more interpretable end-to-end paradigm for graph similarity learning, named Similarity Computation via Maximum Common Subgraph Inference (INFMCS). Our critical insight into INFMCS is the strong correlation between similarity score and Maximum Common Subgraph (MCS). We implicitly infer MCS to obtain the normalized MCS size, with the supervision information being only the similarity score during training. To capture more global information, we also stack some vanilla transformer encoder layers with graph convolution layers and propose a novel permutation-invariant node Positional Encoding. The entire model is quite simple yet effective. Comprehensive experiments demonstrate that INFMCS consistently outperforms state-of-the-art baselines for graph-graph classification and regression tasks. Ablation experiments verify the effectiveness of the proposed computation paradigm and other components. Also, visualization and statistics of results reveal the interpretability of INFMCS.


title: FERIA: Flat Envelope Model with Rotation and Infall under Angular Momentum Conservation

abstract: Radio observations of low-mass star formation in molecular spectral lines have rapidly progressed since the advent of Atacama Large Millimeter/submillimeter Array (ALMA). A gas distribution and its kinematics within a few 100s au scale around a Class 0-I protostar are spatially resolved, and the region where a protostellar disk is being formed is now revealed in detail. In such studies, it is essential to characterize the complex physical structure around a protostar consisting of an infalling envelope, a rotationally-supported disk, and an outflow. For this purpose, we have developed a general-purpose computer code `{\tt FERIA}' (Flat Envelope model with Rotation and Infall under Angular momentum conservation) generating the image cube data based on the infalling-rotating envelope model and the Keplerian disk model, both of which are often used in observational studies. In this paper, we present the description and the usage manual of {\tt FERIA} and summarize caveats in actual applications. This program outputs cube {\tt FITS} files, which can be used for direct comparison with observations. It can also be used to generate mock data for the machine/deep learnings. Examples of these applications are described and discussed to demonstrate how the model analyses work with actual observational data.


title: Clustering of large deviations in moving average processes: the short memory regime

abstract: We describe the cluster of large deviations events that arise when one such large deviations event occurs. We work in the framework of an infinite moving average process with a noise that has finite exponential moments.


title: Two-Factor Biometric Verification with ECG: Two Cancelable Approaches

abstract: Biometric authentication relies on an individual's physiological or behavioral traits to verify their identity before granting access permission to a system or device without remembering anything. Although electrocardiograms (ECGs) have been considered a biometric trait, an ECG biometric recognition system that operates in verification mode is rarely considered. This study proposes two two-factor cancelable biometric verification schemes that enable identity recognition using ECGs. Using bioconvolving and minimum average correlation energy biometric filters, revocable and irreversible templates can be constructed to avoid privacy invasion and security concerns associated with ECG biometric recognition. An interquartile range-based method is adopted to determine if an identity match exists, enabling identity verification under the influence of inter-beat variation. The experimental results indicated that the proposed schemes could achieve an equal error rate as low as 1% when the inter-beat variation was properly addressed.


title: Derivation of the Gross-Pitaevskii Theory for Interacting Fermions in a Trap

abstract: We study a dilute gas of interacting fermions at temperature $T=0$ and chemical potential $\mu \in \mathbb{R}$. The particles are trapped by an external potential, and they interact via a microscopic attractive two-body potential with a two-body bound state. We prove the emergence of the macroscopic Gross-Pitaevskii theory as first-order contribution to the BCS energy functional in the regime of vanishing micro-to-macro scale parameter.


title: Acceleration of an electron bunch with a non-Gaussian transverse profile in a quasilinear plasma wakefield

abstract: Beam-driven plasma wakefield accelerators typically use the external injection scheme to ensure controllable beam quality at injection. However, the externally injected witness bunch may exhibit a non-Gaussian transverse density distribution. Using particle-in-cell simulations, we show that the common beam quality factors, such as the normalized RMS emittance and beam radius, do not strongly depend on the initial transverse shapes of the witness beam. Nonetheless, a beam with a highly-peaked transverse spatial profile can achieve a higher fraction of the total beam charge in the core. The same effect can be seen when the witness beam's transverse momentum profile has a peaked non-Gaussian distribution. In addition, we find that an initially non-axisymmetric beam becomes symmetric due to the interaction with the plasma wakefield, and so it does not cause a detrimental effect for the beam acceleration.


title: Single crystal synthesis and low-lying electronic structure of V$_3$S$_4$

abstract: We report successful growth of millimeter-sized high quality single crystals of V$_3$S$_4$, a candidate topological semimetal belonging to a low-symmetry space group and consisting of only low atomic number elements. Using density functional theory calculations and angle-resolved photoemission spectroscopy, we show that the nonmagnetic phase of monoclinic V$_3$S$_4$ hosts type-II Dirac-like quasiparticles which opens a sizable gap due to spin orbit coupling, as well as theoretical multiple nodal lines that are eliminated also by spin orbit coupling. These results suggest that relativistic effects give rise to profound modifications of the topological properties even in compounds with low-weight elements.


title: On exact computation of Tukey depth central regions

abstract: The Tukey (or halfspace) depth extends nonparametric methods toward multivariate data. The multivariate analogues of the quantiles are the central regions of the Tukey depth, defined as sets of points in the $d$-dimensional space whose Tukey depth exceeds given thresholds $k$. We address the problem of fast and exact computation of those central regions. First, we analyse an efficient Algorithm A from Liu et al. (2019), and prove that it yields exact results in dimension $d=2$, or for a low threshold $k$ in arbitrary dimension. We provide examples where Algorithm A fails to recover the exact Tukey depth region for $d>2$, and propose a modification that is guaranteed to be exact. We express the problem of computing the exact central region in its dual formulation, and use that viewpoint to demonstrate that further substantial improvements to our algorithm are unlikely. An efficient C++ implementation of our exact algorithm is freely available in the R package TukeyRegion.


title: SBPF: Sensitiveness Based Pruning Framework For Convolutional Neural Network On Image Classification

abstract: Pruning techniques are used comprehensively to compress convolutional neural networks (CNNs) on image classification. However, the majority of pruning methods require a well pre-trained model to provide useful supporting parameters, such as C1-norm, BatchNorm value and gradient information, which may lead to inconsistency of filter evaluation if the parameters of the pre-trained model are not well optimized. Therefore, we propose a sensitiveness based method to evaluate the importance of each layer from the perspective of inference accuracy by adding extra damage for the original model. Because the performance of the accuracy is determined by the distribution of parameters across all layers rather than individual parameter, the sensitiveness based method will be robust to update of parameters. Namely, we can obtain similar importance evaluation of each convolutional layer between the imperfect-trained and fully trained models. For VGG-16 on CIFAR-10, even when the original model is only trained with 50 epochs, we can get same evaluation of layer importance as the results when the model is trained fully. Then we will remove filters proportional from each layer by the quantified sensitiveness. Our sensitiveness based pruning framework is verified efficiently on VGG-16, a customized Conv-4 and ResNet-18 with CIFAR-10, MNIST and CIFAR-100, respectively.


title: Long-term Causal Effects Estimation via Latent Surrogates Representation Learning

abstract: Estimating long-term causal effects based on short-term surrogates is a significant but challenging problem in many real-world applications, e.g., marketing and medicine. Despite its success in certain domains, most existing methods estimate causal effects in an idealistic and simplistic way - ignoring the causal structure among short-term outcomes and treating all of them as surrogates. However, such methods cannot be well applied to real-world scenarios, in which the partially observed surrogates are mixed with their proxies among short-term outcomes. To this end, we develop our flexible method, Laser, to estimate long-term causal effects in the more realistic situation that the surrogates are observed or have observed proxies.Given the indistinguishability between the surrogates and proxies, we utilize identifiable variational auto-encoder (iVAE) to recover the whole valid surrogates on all the surrogates candidates without the need of distinguishing the observed surrogates or the proxies of latent surrogates. With the help of the recovered surrogates, we further devise an unbiased estimation of long-term causal effects. Extensive experimental results on the real-world and semi-synthetic datasets demonstrate the effectiveness of our proposed method.


title: New bounds for the number of connected components of fewnomial hypersurfaces

abstract: We prove that the number of connected components of a smooth hypersurface in the positive orthant of $\mathbb{R}^n$ defined by a real polynomial with $d + k + 1$ monomials, where $d$ is the dimension of the affine span of the exponent vectors, is smaller than or equal to $8(d+1)^{k-1} 2^{k-1 \choose 2}$, improving the previously known bounds. We refine this bound for $k = 2$ by showing that a smooth hypersurface defined by a real polynomial with $d+3$ monomials in $n$ variables has at most $\lfloor(d-1)/2\rfloor + 3$ connected components in the positive orthant of $\mathbb{R}^n$. We present an explicit polynomial in $2$ variables with $5$ monomials which defines a curve with three connected components in the positive orthant, showing that our bound is sharp for $d = 2$ (and any $n$). Our results hold for polynomials with real exponent vectors.


title: Stronger Privacy Amplification by Shuffling for R\'enyi and Approximate Differential Privacy

abstract: The shuffle model of differential privacy has gained significant interest as an intermediate trust model between the standard local and central models [EFMRTT19; CSUZZ19]. A key result in this model is that randomly shuffling locally randomized data amplifies differential privacy guarantees. Such amplification implies substantially stronger privacy guarantees for systems in which data is contributed anonymously [BEMMRLRKTS17]. In this work, we improve the state of the art privacy amplification by shuffling results both theoretically and numerically. Our first contribution is the first asymptotically optimal analysis of the R\'enyi differential privacy parameters for the shuffled outputs of LDP randomizers. Our second contribution is a new analysis of privacy amplification by shuffling. This analysis improves on the techniques of [FMT20] and leads to tighter numerical bounds in all parameter settings.


title: Comparison of semi-supervised learning methods for High Content Screening quality control

abstract: Progress in automated microscopy and quantitative image analysis has promoted high-content screening (HCS) as an efficient drug discovery and research tool. While HCS offers to quantify complex cellular phenotypes from images at high throughput, this process can be obstructed by image aberrations such as out-of-focus image blur, fluorophore saturation, debris, a high level of noise, unexpected auto-fluorescence or empty images. While this issue has received moderate attention in the literature, overlooking these artefacts can seriously hamper downstream image processing tasks and hinder detection of subtle phenotypes. It is therefore of primary concern, and a prerequisite, to use quality control in HCS. In this work, we evaluate deep learning options that do not require extensive image annotations to provide a straightforward and easy to use semi-supervised learning solution to this issue. Concretely, we compared the efficacy of recent self-supervised and transfer learning approaches to provide a base encoder to a high throughput artefact image detector. The results of this study suggest that transfer learning methods should be preferred for this task as they not only performed best here but present the advantage of not requiring sensitive hyperparameter settings nor extensive additional training.


title: Robust Output Feedback Control Design in the Presence of Sporadic Measurements

abstract: Output feedback control design for linear time-invariant systems in the presence of sporadic measurements and exogenous perturbations is addressed. To cope with the sporadic availability of measurements of the output, a hybrid dynamic output feedback controller equipped with a holding device whose state is reset when a new measurement is available is designed. The closed-loop system, resulting from the interconnection of the controller and the plant, is augmented with a timer variable triggering the arrival of new measurements and its properties are analyzed using hybrid system tools. Building upon Lyapunov theory for hybrid systems, sufficient conditions for internal and L2 input-to-output stability are proposed. An LMI-based design methodology for the co-design of the gains of the controller and the parameters of the holding device is presented. The effectiveness of the proposed LMI-based design approach is showcased in a numerical example.


title: Statistical tests with multi-wavelength Kernel-phase analysis for the detection and characterization of planetary companions

abstract: Kernel phase is a method to interpret stellar point source images by considering their formation as the analytical result of an interferometric process. Using Fourier formalism, this method allows for observing planetary companions around nearby stars at separations down to half a telescope resolution element, typically 20\,mas for a 8\,m class telescope in H band. The Kernel-phase analysis has so far been mainly focused on working with a single monochromatic light image, recently providing theoretical contrast detection limits down to $10^{-4}$ at 200\,mas with JWST/NIRISS in the mid-infrared by using hypothesis testing theory. In this communication, we propose to extend this approach to data cubes provided by integral field spectrographs (IFS) on ground-based telescopes with adaptive optics to enhance the detection of planetary companions and explore the spectral characterization of their atmosphere by making use of the Kernel-phase multi-spectral information. Using ground-based IFS data cube with a spectral resolution R=20, we explore different statistical tests based on kernel phases at three wavelengths to estimate the detection limits for planetary companions. Our tests are first conducted with synthetic data before extending their use to real images from ground-based exoplanet imagers such as Subaru/SCExAO and VLT/SPHERE in the near future. Future applications to multi-wavelength data from space telescopes are also discussed for the observation of planetary companions with JWST.


title: A self-consistent model to link surface electronic band structure to the voltage dependence of hot electron induced molecular nanoprobe experiments

abstract: Understanding the ultra-fast transport properties of hot charge carriers is of significant importance both fundamentally and technically in applications like solar cells and transistors. However, direct measurement of charge transport at the relevant nanometre length scales is challenging with only a few experimental methods demonstrated to date. Here we report on molecular nanoprobe experiments on the Si(111)-7x7 at room temperature where charge injected from the tip of a scanning tunnelling microscope (STM) travels laterally across a surface and induces single adorbate toluene molecules to react over length scales of tens of nanometres. A simple model is developed for the fraction of the tunnelling current captured into each of the surface electronic bands with input from only high-resolution scanning tunnelling spectroscopy (STS) of the clean Si(111)-7x7 surface. This model is quantitatively linked to the voltage dependence of the molecular nanoprobe experiments through a single manipulation probability (i.e. fitting parameter) per state. This model fits the measured data and gives explanation to the measured voltage onsets, exponential increase in the measured manipulation probabilities and plateau at higher voltages. It also confirms an ultrafast relaxation to the bottom of a surface band for the injected charge after injection, but before the nonlocal spread across the surface.


title: On the uniqueness of $\Lambda$CDM-like evolution for homogeneous and isotropic cosmology in General Relativity

abstract: We address the question of the uniqueness of spatially flat $\Lambda$CDM-like evolution for FLRW cosmologies in General Relativity, i.e. whether any model other than the spatially flat $\Lambda$CDM can give rise to the same type of scale factor evolution. Firstly, we elaborate on what we exactly imply by a $\Lambda$CDM-like evolution or kinematic/cosmographic degeneracy with the $\Lambda$CDM model, using the lessons from the statefinder diagnostic. Then, we consider two models with interaction in the dark sector: coupled fluid-fluid model and coupled quintessence model. We enforce the \emph{kinematic} degeneracy with the spatially flat $\Lambda$CDM model via the cosmographic condition $j=1$ ($j$ being the jerk parameter), which in turn fixes the function of the interaction term that is a priori unspecified. We argue that in General Relativity this cosmographic condition is consistent only with spatial flatness. Employing a dynamical system approach, we show that the spatially flat coupled fluid-fluid interacting models kinematically degenerate with $\Lambda$CDM must necessarily be based on a phantom fluid, whereas the set of physically viable spatially flat coupled quintessence models with power law or exponential potential kinematically degenerate to $\Lambda$CDM is of measure zero. Our analysis establishes that coupled fluid-fluid models with non-phantom fluids or coupled quintessence models with power law and exponential potential can never reproduce a cosmological evolution similar to that of the $\Lambda$CDM. The astrophysical consequences of our findings are qualitatively discussed in light of observational cosmological tensions.


title: Implications of the QCD dynamics and a Super-Glashow astrophysical neutrino flux on the description of ultrahigh energy neutrino data

abstract: The number of events observed in neutrino telescopes depends on the neutrino fluxes in the Earth, their absorption while crossing the Earth and their interaction in the detector. In this paper, we investigate the impact of the QCD dynamics at high energies on the energy dependence of the average inelasticity and angular dependence of the absorption probability during the neutrino propagation through the Earth, as well in the determination of the properties of the incident astrophysical neutrino flux. Moreover, the number of events at the IceCube and IceCube - Gen2 are estimated considering different scenarios for the QCD dynamics and assuming the presence of a hypothetical Super - Glashow flux, which peaks for energies above the Glashow resonance.


title: UnderPressure: Deep Learning for Foot Contact Detection, Ground Reaction Force Estimation and Footskate Cleanup

abstract: Human motion synthesis and editing are essential to many applications like film post-production. However, they often introduce artefacts in motions, which can be detrimental to the perceived realism. In particular, footskating is a frequent and disturbing artefact requiring foot contacts knowledge to be cleaned up. Current approaches to obtain foot contact labels rely either on unreliable threshold-based heuristics or on tedious manual annotation. In this article, we address foot contact label detection from motion with a deep learning. To this end, we first publicly release UnderPressure, a novel motion capture database labelled with pressure insoles data serving as reliable knowledge of foot contact with the ground. Then, we design and train a deep neural network to estimate ground reaction forces exerted on the feet from motion data and then derive accurate foot contact labels. The evaluation of our model shows that we significantly outperform heuristic approaches based on height and velocity thresholds and that our approach is much more robust on motion sequences suffering from perturbations like noise or footskate. We further propose a fully automatic workflow for footskate cleanup: foot contact labels are first derived from estimated ground reaction forces. Then, footskate is removed by solving foot constraints through an optimisation-based inverse kinematics (IK) approach that ensures consistency with the estimated ground reaction forces. Beyond footskate cleanup, both the database and the method we propose could help to improve many approaches based on foot contact labels or ground reaction forces, including inverse dynamics problems like motion reconstruction and learning of deep motion models in motion synthesis or character animation. Our implementation, pre-trained model as well as links to database can be found at https://github.com/InterDigitalInc/UnderPressure.


title: Trace formula for the magnetic Laplacian at zero energy level

abstract: The paper is devoted to the trace formula for the magnetic Laplacian associated with a magnetic system on a compact manifold. This formula is a natural generalization of the semiclassical Gutzwiller trace formula and reduces to it in the case when the magnetic field form is exact. It differs somewhat from the Guillemin-Uribe trace formula studied in the author's previous work with I.A. Taimanov. Moreover, in contrast to that work, the focus is on the trace formula at the zero energy level, which is a critical energy level. The paper gives an overview of the main notions and results related to the trace formula at the zero energy level, describes various approaches to its proof, and gives concrete examples of its computation. In addition, a brief review of the Gutzwiller trace formula for regular and critical energy levels is given.


title: IDNP: Interest Dynamics Modeling using Generative Neural Processes for Sequential Recommendation

abstract: Recent sequential recommendation models rely increasingly on consecutive short-term user-item interaction sequences to model user interests. These approaches have, however, raised concerns about both short- and long-term interests. (1) {\it short-term}: interaction sequences may not result from a monolithic interest, but rather from several intertwined interests, even within a short period of time, resulting in their failures to model skip behaviors; (2) {\it long-term}: interaction sequences are primarily observed sparsely at discrete intervals, other than consecutively over the long run. This renders difficulty in inferring long-term interests, since only discrete interest representations can be derived, without taking into account interest dynamics across sequences. In this study, we address these concerns by learning (1) multi-scale representations of short-term interests; and (2) dynamics-aware representations of long-term interests. To this end, we present an \textbf{I}nterest \textbf{D}ynamics modeling framework using generative \textbf{N}eural \textbf{P}rocesses, coined IDNP, to model user interests from a functional perspective. IDNP learns a global interest function family to define each user's long-term interest as a function instantiation, manifesting interest dynamics through function continuity. Specifically, IDNP first encodes each user's short-term interactions into multi-scale representations, which are then summarized as user context. By combining latent global interest with user context, IDNP then reconstructs long-term user interest functions and predicts interactions at upcoming query timestep. Moreover, IDNP can model such interest functions even when interaction sequences are limited and non-consecutive. Extensive experiments on four real-world datasets demonstrate that our model outperforms state-of-the-arts on various evaluation metrics.


title: The first catalogue of spectroscopically confirmed red nuggets at z~0.7 from the VIPERS survey. Linking high-z red nuggets and local relics

abstract: 'Red nuggets' are a rare population of passive compact massive galaxies thought to be the first massive galaxies that formed in the Universe. First found at $z \sim 3$, they are even less abundant at lower redshifts, and it is believed that with time they mostly transformed through mergers into today's giant ellipticals. Those red nuggets which managed to escape this fate can serve as unique laboratories to study the early evolution of massive galaxies. In this paper, we aim to make use of the VIMOS Public Extragalactic Redshift Survey to build the largest up-to-date catalogue of spectroscopically confirmed red nuggets at the intermediate redshift $0.5<z<1.0$. Starting from a catalogue of nearly 90 000 VIPERS galaxies we select sources with stellar masses $M_{star} > 8\times10^{10}$ $\rm{M}_{\odot}$ and effective radii $R_\mathrm{e}<1.5$ kpc. Among them, we select red, passive galaxies with old stellar population based on colour--colour NUVrK diagram, star formation rate values, and verification of their optical spectra. Verifying the influence of the limit of the source compactness on the selection, we found that the sample size can vary even up to two orders of magnitude, depending on the chosen criterion. Using one of the most restrictive criteria with additional checks on their spectra and passiveness, we spectroscopically identified only 77 previously unknown red nuggets. The resultant catalogue of 77 red nuggets is the largest such catalogue built based on the uniform set of selection criteria above the local Universe. Number density calculated on the final sample of 77 VIPERS passive red nuggets per comoving Mpc$^3$ increases from 4.7$\times10^{-6}$ at $z \sim 0.61$ to $9.8 \times 10^{-6}$ at $z \sim 0.95$, which is higher than values estimated in the local Universe, and lower than the ones found at $z>2$. It fills the gap at intermediate redshift.


title: Nonequilibrium phases of ultracold bosons with cavity-induced dynamic gauge fields

abstract: Gauge fields are a central concept in fundamental theories of physics, and responsible for mediating long-range interactions between elementary particles. Recently, it has been proposed that dynamical gauge fields can be naturally engineered by photons in composite, neutral quantum gas--cavity systems using suitable atom-photon interactions. Here we comprehensively investigate nonequilibrium dynamical phases appearing in a two-leg bosonic lattice model with leg-dependent, dynamical complex tunnelings mediated by cavity-assisted two-photon Raman processes. The system constitutes a minimal dynamical flux-lattice model. We study fixed points of the equations of motion and their stability, the resultant dynamical phase diagram, and the corresponding phase transitions and bifurcations. Notably, the phase diagram features a plethora of nonequilibrium dynamical phases including limit-cycle and chaotic phases. In the end, we relate regular periodic dynamics (i.e., limit-cycle phases) of the system to time crystals.


title: Asymptotics of the conformal modulus of a nonsymmetric unbounded doubly-connected domain under stretching

abstract: We describe the asymptotic behavior of the conformal modulus of an unbounded doubly-connected domain, non-symmetric with respect to the coordinate axes, when stretched in the direction of the abscissa axis with coefficient $H\to +\infty$. Therefore, we give a partial answer to a problem, suggested by M.~Vourinen, for the case of an arbitrary unbounded domain.


title: Robotic Untangling of Herbs and Salads with Parallel Grippers

abstract: The picking of one or more objects from an unsorted pile continues to be non-trivial for robotic systems. This is especially so when the pile consists of a granular material (GM) containing individual items that tangle with one another, causing more to be picked out than desired. One of the key features of such tangle-prone GMs is the presence of protrusions extending out from the main body of items in the pile. This work characterises the role the latter play in causing mechanical entanglement and their impact on picking consistency. It reports experiments in which picking GMs with different protrusion lengths (PLs) results in up to 76% increase in picked mass variance, suggesting PL to be an informative feature in the design of picking strategies. Moreover, to counter this effect, it proposes a new spread-and-pick (SnP) approach that significantly reduces tangling, making picking more consistent. Compared to prior approaches that seek to pick from a tangle-free point in the pile, the proposed method results in a decrease in picking error (PE) of up to 51%, and shows good generalisation to previously unseen GMs.


title: Primordial black holes induced stochastic axion-photon oscillations in primordial magnetic field

abstract: Primordial black holes (PBHs) can be produced in the very early Universe due to the large density fluctuations. The cosmic background of axion-like particles (ALPs) could be non-thermally generated by PBHs. In this paper, we investigate the ALPs emitted by ultra-light PBHs with the mass range $10 \, {\rm g} \lesssim M_{\rm PBH} \lesssim 10^9 \, \rm g$, in which PBHs would have completely evaporated before the start of Big Bang Nucleosynthesis (BBN) and can therefore not be directly constrained. In this case, the minimal scenario that ALPs could interact only with photons is supposed. We study the stochastic oscillations between the ALPs and photons in the cosmic magnetic field in detail. The primordial magnetic field (PMF) can be modelled as the stochastic background field model with the completely non-homogeneous component of the cosmic plasma. Using the latest stringent limits on PMF, we show the numerical results of ALP-photon oscillation probability distributions with the homogeneous and stochastic magnetic field scenarios. The PBH-induced stochastic ALP-photon oscillations in the PMF may have the effects on some further phenomena, such as the cosmic microwave background (CMB), the cosmic X-ray background (CXB), and the extragalactic gamma-ray background (EGB).


title: Comparison principles for the linear and semiliniar time-fractional diffusion equations with the Robin boundary condition

abstract: The main objective of this paper is analysis of the initial-boundary value problems for the linear and semilinear time-fractional diffusion equations with a uniformly elliptic spatial differential operator of the second order and the Caputo type fractional derivative acting in the fractional Sobolev spaces. The boundary conditions are formulated in form of the homogeneous Neumann or Robin conditions. First we deal with the uniqueness and existence of the solutions to these initial-boundary value problems. Then we show a positivity property for the solutions and derive the corresponding comparison principles. In the case of the semilinear time-fractional diffusion equation, we also apply the monotonicity method by upper and lower solutions. As an application of our results, we present some a priori estimates for solutions to the semilinear time-fractional diffusion equations.


title: Uniform Lyndon interpolation for intuitionistic monotone modal logic

abstract: In this paper we show that the intuitionistic monotone modal logic $\mathsf{iM}$ has the uniform Lyndon interpolation property (ULIP). The logic $\mathsf{iM}$ is a non-normal modal logic on an intuitionistic basis, and the property ULIP is a strengthening of interpolation in which the interpolant depends only on the premise or the conclusion of an implication, respecting the polarities of the propositional variables. Our method to prove ULIP yields explicit uniform interpolants and makes use of a terminating sequent calculus for $\mathsf{iM}$ that we have developed for this purpose. As far as we know, the results that $\mathsf{iM}$ has ULIP and a terminating sequent calculus are the first of their kind for an intuitionistic non-normal modal logic. However, rather than proving these particular results, our aim is to show the flexibility of the constructive proof-theoretic method that we use for proving ULIP. It has been developed over the last few years and has been applied to substructural, intermediate, classical (non-)normal modal and intuitionistic normal modal logics. In light of these results, intuitionistic non-normal modal logics seem a natural next class to try to apply the method to, and we take the first step in that direction in this paper.


title: Using Sentence Embeddings and Semantic Similarity for Seeking Consensus when Assessing Trustworthy AI

abstract: Assessing the trustworthiness of artificial intelligence systems requires knowledge from many different disciplines. These disciplines do not necessarily share concepts between them and might use words with different meanings, or even use the same words differently. Additionally, experts from different disciplines might not be aware of specialized terms readily used in other disciplines. Therefore, a core challenge of the assessment process is to identify when experts from different disciplines talk about the same problem but use different terminologies. In other words, the problem is to group problem descriptions (a.k.a. issues) with the same semantic meaning but described using slightly different terminologies. In this work, we show how we employed recent advances in natural language processing, namely sentence embeddings and semantic textual similarity, to support this identification process and to bridge communication gaps in interdisciplinary teams of experts assessing the trustworthiness of an artificial intelligence system used in healthcare.


title: E2EG: End-to-End Node Classification Using Graph Topology and Text-based Node Attributes

abstract: Node classification utilizing text-based node attributes has many real-world applications, ranging from prediction of paper topics in academic citation graphs to classification of user characteristics in social media networks. State-of-the-art node classification frameworks, such as GIANT, use a two-stage pipeline: first embedding the text attributes of graph nodes then feeding the resulting embeddings into a node classification model. In this paper, we eliminate these two stages and develop an end-to-end node classification model that builds upon GIANT, called End-to-End-GIANT (E2EG). The tandem utilization of a main and an auxiliary classification objectives in our approach results in a more robust model, enabling the BERT backbone to be switched out for a distilled encoder with a 25% - 40% reduction in the number of parameters. Moreover, the model's end-to-end nature increases ease of use, as it avoids the need of chaining multiple models for node classification. Compared to a GIANT+MLP baseline on the ogbn-arxiv and ogbn-products datasets, E2EG obtains slightly better accuracy in the transductive setting (+0.5%), while reducing model training time by up to 40%. Our model is also applicable in the inductive setting, outperforming GIANT+MLP by up to +2.23%.


title: LAMDA-SSL: Semi-Supervised Learning in Python

abstract: LAMDA-SSL is open-sourced on GitHub and its detailed usage documentation is available at https://ygzwqzd.github.io/LAMDA-SSL/. This documentation introduces LAMDA-SSL in detail from various aspects and can be divided into four parts. The first part introduces the design idea, features and functions of LAMDA-SSL. The second part shows the usage of LAMDA-SSL by abundant examples in detail. The third part introduces all algorithms implemented by LAMDA-SSL to help users quickly understand and choose SSL algorithms. The fourth part shows the APIs of LAMDA-SSL. This detailed documentation greatly reduces the cost of familiarizing users with LAMDA-SSL toolkit and SSL algorithms.


title: Generative models-based data labeling for deep networks regression: application to seed maturity estimation from UAV multispectral images

abstract: Monitoring seed maturity is an increasing challenge in agriculture due to climate change and more restrictive practices. Seeds monitoring in the field is essential to optimize the farming process and to guarantee yield quality through high germination. Traditional methods are based on limited sampling in the field and analysis in laboratory. Moreover, they are time consuming and only allow monitoring sub-sections of the crop field. This leads to a lack of accuracy on the condition of the crop as a whole due to intra-field heterogeneities. Multispectral imagery by UAV allows uniform scan of fields and better capture of crop maturity information. On the other hand, deep learning methods have shown tremendous potential in estimating agronomic parameters, especially maturity. However, they require large labeled datasets. Although large sets of aerial images are available, labeling them with ground truth is a tedious, if not impossible task. In this paper, we propose a method for estimating parsley seed maturity using multispectral UAV imagery, with a new approach for automatic data labeling. This approach is based on parametric and non-parametric models to provide weak labels. We also consider the data acquisition protocol and the performance evaluation of the different steps of the method. Results show good performance, and the non-parametric kernel density estimator model can improve neural network generalization when used as a labeling method, leading to more robust and better performing deep neural models.


title: Six-loop anomalous dimension of the $\phi^Q$ operator in the $O(N)$ symmetric model

abstract: A technique of large-charge expansion provides a novel opportunity for calculation of critical dimensions of operators $\phi^Q$ with fixed charge $Q$. In the small-coupling regime the polynomial structure of the anomalous dimensions can be fixed from a number of direct perturbative calculations for a fixed $Q$. At the six-loop level one needs to include new diagrams that correspond to operators with five or more legs. The latter never appeared before in scalar-theory calculations. Here we show how to compute the anomalous dimension of the operator $\phi^{Q=5}$ at the six-loop order. In combination with results for operators with $Q<5$, which are extracted from the six-loop beta-functions for general scalar theory, and with predictions from the large-charge expansion, our calculation allows us to derive the answer for general-$Q$ anomalous dimensions. At the critical point resummation in three dimensions enables us to compare the critical exponents with results of Monte-Carlo simulations and large-$N$ predictions.


title: Res-Dense Net for 3D Covid Chest CT-scan classification

abstract: One of the most contentious areas of research in Medical Image Preprocessing is 3D CT-scan. With the rapid spread of COVID-19, the function of CT-scan in properly and swiftly diagnosing the disease has become critical. It has a positive impact on infection prevention. There are many tasks to diagnose the illness through CT-scan images, include COVID-19. In this paper, we propose a method that using a Stacking Deep Neural Network to detect the Covid 19 through the series of 3D CT-scans images . In our method, we experiment with two backbones are DenseNet 121 and ResNet 101. This method achieves a competitive performance on some evaluation metrics


title: Classification of electromagnetic interference induced image noise in an analog video link

abstract: With the ever-increasing electrification of the vehicle showing no sign of retreating, electronic systems deployed in automotive applications are subject to more stringent Electromagnetic Immunity compliance constraints than ever before, to ensure the proximity of nearby electronic systems will not affect their operation. The EMI compliance testing of an analog camera link requires video quality to be monitored and assessed to validate such compliance, which up to now, has been a manual task. Due to the nature of human interpretation, this is open to inconsistency. Here, we propose a solution using deep learning models that analyse, and grade video content derived from an EMI compliance test. These models are trained using a dataset built entirely from real test image data to ensure the accuracy of the resultant model(s) is maximised. Starting with the standard AlexNet, we propose four models to classify the EMI noise level


title: A detailed dynamical model for inclination-only dependent lunisolar resonances. Effect on the "eccentricity growth" mechanism

abstract: The focus of this paper is on inclination-only dependent lunisolar resonances, which shape the dynamics of a MEO (Medium Earth Orbit) object over secular time scales (i.e. several decades). Following the formalism of arXiv:2107.14507, we discuss an analytical model yielding the correct form of the separatrices of each one of the major lunisolar resonances in the "action" space $(i, e)$ (inclination, eccentricity) for any given semi-major axis $a$. We then highlight how our method is able to predict and explain the main structures found numerically in Fast Lyapunov Indicator (FLI) cartography. We focus on explaining the dependence of the FLI maps from the initial phase of the argument of perigee $\omega$ and of the longitude of the ascending node $\Omega$ of the object and of the moon $\Omega_L$. In addition, on the basis of our model, we discuss the role played by the $\Omega-\Omega_L$ and the $2 \Omega-\Omega_L$ resonances, which overlap with the inclination-only dependent ones as they sweep the region for increasing values of $a$, generating large domains of chaotic motion. Our results provide a framework useful in designing low-cost satellite deployment or space debris mitigation strategies, exploiting the natural dynamics of lunisolar resonances that increase an object's eccentricity up until it reaches a domain where friction leads to atmospheric re-entry.


title: EfficientNet for Brain-Lesion classification

abstract: In the development of technology, there are increasing cases of brain disease, there are more treatments proposed and achieved a positive result. However, with Brain-Lesion, the early diagnoses can improve the possibility for successful treatment and can help patients recuperate better. From this reason, Brain-Lesion is one of the controversial topics in medical images analysis nowadays. With the improvement of the architecture, there is a variety of methods that are proposed and achieve competitive scores. In this paper, we proposed a technique that uses efficient-net for 3D images, especially the Efficient-net B0 for Brain-Lesion classification task solution, and achieve the competitive score. Moreover, we also proposed the method to use Multiscale-EfficientNet to classify the slices of the MRI data


title: UAVs over mmWave/THz Cellular MEC Networks: A Comparative Study for Energy Efficiency

abstract: Cellular networks equipped with mobile edge computing (MEC) servers can be beneficial for unmanned aerial vehicles (UAVs) with limited onboard computation power and battery life-time. In this paper, we compare energy consumption of a UAV connected to cellular MEC servers in various possible scenarios such as onboard/MEC processing or parallel computation. Using detailed 3GPP-based modelings, we provide quantitative understanding of the most energy efficient approach and its relation with communication technologies, computation factors, and mobility parameters. Our findings show that, across the different frequencies from sub-6GHz to THz bands, the mmWave cellular MEC network is more energy efficient than UAV's onborad processing for a broader range of network densities. Secondly, while the UAV propulsion power consumption is non-decreasing function of velocity, the UAV movement cost yet can be optimized to further provide remarkable energy savings as compared to hovering. Finally, our results show that the most energy efficient approach can be obtained if mobility of UAV is combined with efficient parallel onboard-MEC processing.


title: Why the Many-Worlds Interpretation?

abstract: A brief (subjective) description of the state of the art of the many-worlds interpretation of quantum mechanics (MWI) is presented. It is argued that the MWI is the only interpretation which removes action at a distance and randomness from quantum theory. Limitations of the MWI regarding questions of probability which can be legitimately asked are specified. The ontological picture of the MWI as a theory of the universal wave function decomposed into a superposition of world wave functions, the important parts of which are defined in three-dimensional space, is presented from the point of view of our particular branch. Some speculations about misconceptions, which apparently prevent the MWI to be in the consensus, are mentioned.


title: RDA: Reciprocal Distribution Alignment for Robust Semi-supervised Learning

abstract: In this work, we propose Reciprocal Distribution Alignment (RDA) to address semi-supervised learning (SSL), which is a hyperparameter-free framework that is independent of confidence threshold and works with both the matched (conventionally) and the mismatched class distributions. Distribution mismatch is an often overlooked but more general SSL scenario where the labeled and the unlabeled data do not fall into the identical class distribution. This may lead to the model not exploiting the labeled data reliably and drastically degrade the performance of SSL methods, which could not be rescued by the traditional distribution alignment. In RDA, we enforce a reciprocal alignment on the distributions of the predictions from two classifiers predicting pseudo-labels and complementary labels on the unlabeled data. These two distributions, carrying complementary information, could be utilized to regularize each other without any prior of class distribution. Moreover, we theoretically show that RDA maximizes the input-output mutual information. Our approach achieves promising performance in SSL under a variety of scenarios of mismatched distributions, as well as the conventional matched SSL setting. Our code is available at: https://github.com/NJUyued/RDA4RobustSSL.


title: Cascade-based Echo Chamber Detection

abstract: Despite echo chambers in social media have been under considerable scrutiny, general models for their detection and analysis are missing. In this work, we aim to fill this gap by proposing a probabilistic generative model that explains social media footprints -- i.e., social network structure and propagations of information -- through a set of latent communities, characterized by a degree of echo-chamber behavior and by an opinion polarity. Specifically, echo chambers are modeled as communities that are permeable to pieces of information with similar ideological polarity, and impermeable to information of opposed leaning: this allows discriminating echo chambers from communities that lack a clear ideological alignment. To learn the model parameters we propose a scalable, stochastic adaptation of the Generalized Expectation Maximization algorithm, that optimizes the joint likelihood of observing social connections and information propagation. Experiments on synthetic data show that our algorithm is able to correctly reconstruct ground-truth latent communities with their degree of echo-chamber behavior and opinion polarity. Experiments on real-world data about polarized social and political debates, such as the Brexit referendum or the COVID-19 vaccine campaign, confirm the effectiveness of our proposal in detecting echo chambers. Finally, we show how our model can improve accuracy in auxiliary predictive tasks, such as stance detection and prediction of future propagations.


title: Model-Assisted Estimators under Nonresponse in Sample Surveys

abstract: In the presence of auxiliary information, model-assisted estimators use a working model that links the variable of interest and the auxiliary variables in order to improve the Horvitz-Thompson estimator. The resulting estimators are asymptotically design unbiased and asymptotically more efficient than the Horvitz-Thompson estimator under some regularity conditions and for a wide range of working models. In this work, we adapt model-assisted total estimators to missing at random data building on the idea of nonresponse weighting adjustment. We consider nonresponse as a second phase of the survey and reweight the units in model-assisted estimators using the inverse of estimated response probabilities in order to compensate for the nonrespondents. We develop the asymptotic properties and discuss calibration of the weights of our proposed estimators. We provide formulae for asymptotic variance and variance estimators. We conduct a simulation study that describes the behavior of the proposed estimators.


title: An Anchor-Free Detector for Continuous Speech Keyword Spotting

abstract: Continuous Speech Keyword Spotting (CSKWS) is a task to detect predefined keywords in a continuous speech. In this paper, we regard CSKWS as a one-dimensional object detection task and propose a novel anchor-free detector, named AF-KWS, to solve the problem. AF-KWS directly regresses the center locations and lengths of the keywords through a single-stage deep neural network. In particular, AF-KWS is tailored for this speech task as we introduce an auxiliary unknown class to exclude other words from non-speech or silent background. We have built two benchmark datasets named LibriTop-20 and continuous meeting analysis keywords (CMAK) dataset for CSKWS. Evaluations on these two datasets show that our proposed AF-KWS outperforms reference schemes by a large margin, and therefore provides a decent baseline for future research.


title: U(1)-symmetric Gaussian fermionic projected entangled paired states and their Gutzwiller projection

abstract: We develop a formalism for constructing particle-number-conserving Gaussian fermionic projected entangled pair states [U(1)-GfPEPS] and show that these states can describe ground states of band insulators and gapless fermions with band touching points. When using them as variational Ans\"{a}tze for two Dirac fermion systems ($\pi$-flux model on the square lattice and $[0,\pi]$-flux model on the kagome lattice), we find that the U(1)-GfPEPS, even with a relatively small bond dimension, can accurately approximate the Dirac Fermi sea ground states. By applying Gutzwiller projectors on top of these U(1)-GfPEPS, we obtain PEPS representation of U(1)-Dirac spin liquid states for spin-1/2 systems. With state-of-the-art tensor network numerics, the critical exponent in the spin-spin correlation function of the Gutzwiller-projected $\pi$-flux state is estimated to be $\eta \approx 1.7$.


title: Bottom-up Trust Registry in Self Sovereign Identity

abstract: Self sovereign identity is a form of decentralised credential management. During credential verification, data exchange only happens between the data owner and the verifier without passing through any third parties. While this approach offers a privacy-centric solution, it poses a challenge. How do verifiers trust that the credential is vouched by a trusted source? More specifically, how do verifiers know that the issuer has the reputation or is authorised to issue the credential? In this paper, we propose a trust registry design that handles the aspect of human trust in self sovereign identity. We also introduce an incentivisation mechanism for the trust registry in order to motivate each stakeholder to participate actively and honestly.


title: Vital node identification in hypergraphs via gravity model

abstract: Hypergraphs that can depict interactions beyond pairwise edges have emerged as an appropriate representation for modeling polyadic relations in complex systems. With the recent surge of interest in researching hypergraphs, the centrality problem has attracted abundant attention due to the challenge of how to utilize the higher-order structure for the definition of centrality metrics. In this paper, we propose a new centrality method (HGC) on the basis of the gravity model as well as a semi-local HGC (LHGC) which can achieve a balance between accuracy and computational complexity. Meanwhile, two comprehensive evaluation metrics, i.e., a complex contagion model in hypergraphs that mimics the group influence during the spreading process and network s-efficiency based on the higher-order distance between nodes, are first proposed to evaluate the effectiveness of our methods. The results show that our methods can filter out nodes that have fast spreading ability and are vital in terms of hypergraph connectivity.


title: Recycling an anechoic pre-trained speech separation deep neural network for binaural dereverberation of a single source

abstract: Reverberation results in reduced intelligibility for both normal and hearing-impaired listeners. This paper presents a novel psychoacoustic approach of dereverberation of a single speech source by recycling a pre-trained binaural anechoic speech separation neural network. As training the deep neural network (DNN) is a lengthy and computationally expensive process, the advantage of using a pre-trained separation network for dereverberation is that the network does not need to be retrained, saving both time and computational resources. The interaural cues of a reverberant source are given to this pretrained neural network to discriminate between the direct path signal and the reverberant speech. The results show an average improvement of 1.3% in signal intelligibility, 0.83 dB in SRMR (signal to reverberation energy ratio) and 0.16 points in perceptual evaluation of speech quality (PESQ) over other state-of-the-art signal processing dereverberation algorithms and 14% in intelligibility and 0.35 points in quality over orthogonal matching pursuit with spectral subtraction (OSS), a machine learning based dereverberation algorithm.


title: Causal Effect Identification in Uncertain Causal Networks

abstract: Causal identification is at the core of the causal inference literature, where complete algorithms have been proposed to identify causal queries of interest. The validity of these algorithms hinges on the restrictive assumption of having access to a correctly specified causal structure. In this work, we study the setting where a probabilistic model of the causal structure is available. Specifically, the edges in a causal graph exist with uncertainties which may, for example, represent degree of belief from domain experts. Alternatively, the uncertainty about an edge may reflect the confidence of a particular statistical test. The question that naturally arises in this setting is: Given such a probabilistic graph and a specific causal effect of interest, what is the subgraph which has the highest plausibility and for which the causal effect is identifiable? We show that answering this question reduces to solving an NP-complete combinatorial optimization problem which we call the edge ID problem. We propose efficient algorithms to approximate this problem and evaluate them against both real-world networks and randomly generated graphs.


title: Post-Newtonian effects on some characteristic timescales of transiting exoplanets

abstract: Some measurable characteristic timescales $\left\{t_\mathrm{trn}\right\}$ of transiting exoplanets are investigated in order to check preliminarily if their cumulative shifts over the years induced by the post-Newtonian (pN) gravitoelectric (Schwarzschild) and gravitomagnetic (Lense-Thirring) components of the stellar gravitational field are, at least in principle, measurable. Both the primary (planet in front of the star) and the secondary (planet behind the star) transits are considered along with their associated characteristic time intervals: the total transit duration $t_D$, the ingress/egress transit duration $\tau$, the full width at half maximum primary transit duration $t_H$, and also the time of conjunction $t_\mathrm{cj}$. For each of them, the net changes per orbit $\langle\Delta t_D\rangle,\,\langle\Delta\tau\rangle,\,\langle\Delta t_H\rangle,\,\langle\Delta t_\mathrm{cj}\rangle$ induced by the aforementioned pN accelerations are analytically obtained; also the Newtonian effect of the star's quadrupole mass moment $J_2^\star$ is worked out. They are calculated for a fictitious Sun-Jupiter system in an edge-on elliptical orbit, and the results are compared with the present-day experimental accuracies for the HD 286123 b exoplanet. Its pN gravitoelectric shift $\left\langle\Delta t_\mathrm{cj}^\mathrm{1pN}\right\rangle$ may become measurable, at least in principle, at a $\simeq 8\times 10^{-5}$ level of (formal) relative accuracy after about 30 years of continuous monitoring corresponding to about 1000 transits. Systematics like, e.g., confusing time standards, neglecting star spots, neglecting clouds, would likely deteriorate the actual accuracy. The method presented is general enough to be applied also to modified models of gravity.


title: Microswimmers near corrugated, periodic surfaces

abstract: We explore hydrodynamic interactions between microswimmers and corrugated, or rough, surfaces, as found often in biological systems and microfluidic devices. Using the Lorentz reciprocal theorem for viscous flows we derive exact expressions for the roughness-induced velocities up to first order in the surface-height fluctuations and provide solutions for the translational and angular velocities valid for arbitrary surface shapes. We apply our theoretical predictions to elucidate the impact of a periodic, wavy surface on the velocities of microswimmers modeled in terms of a superposition of Stokes singularities. Our findings, valid in the framework of a far-field analysis, show that the roughness-induced velocities vary non-monotonically with the wavelength of the surface. For wavelengths comparable to the swimmer-surface distance a pusher can experience a repulsive contribution due to the reflection of flow fields at the edge of a surface cavity, which decreases the overall attraction to the wall.


title: The Right Kind of Non-Determinism: Using Concurrency to Verify C Programs with Underspecified Semantics

abstract: We present a novel and well automatable approach to formal verification of C programs with underspecified semantics, i.e., a language semantics that leaves open the order of certain evaluations. First, we reduce this problem to non-determinism of concurrent systems, automatically extracting a distributed Active Object model from underspecified, sequential C code. This translation process provides a fully formal semantics for the considered C subset. In the extracted model every non-deterministic choice corresponds to one possible evaluation order. This step also automatically translates specifications in the ANSI/ISO C Specification Language (ACSL) into method contracts and object invariants for Active Objects. We then perform verification on the specified Active Objects model, using the Crowbar theorem prover, which verifies the extracted model with respect to the translated specification and ensures the original property of the C code for all possible evaluation orders. By using model extraction, we can use standard tools, without designing a new complex program logic to deal with underspecification. The case study used is highly underspecified and cannot be handled correctly by existing tools for C.


title: Session Fidelity for ElixirST: A Session-Based Type System for Elixir Modules

abstract: This paper builds on prior work investigating the adaptation of session types to provide behavioural information about Elixir modules. A type system called ElixirST has been constructed to statically determine whether functions in an Elixir module observe their endpoint specifications, expressed as session types; a corresponding tool automating this typechecking has also been constructed. In this paper we formally validate this type system. An LTS-based operational semantics for the language fragment supported by the type system is developed, modelling its runtime behaviour when invoked by the module client. This operational semantics is then used to prove session fidelity for ElixirST.


title: Branching Pomsets for Choreographies

abstract: Choreographic languages describe possible sequences of interactions among a set of agents. Typical models are based on languages or automata over sending and receiving actions. Pomsets provide a more compact alternative by using a partial order over these actions and by not making explicit the possible interleaving of concurrent actions. However, pomsets offer no compact representation of choices. For example, if an agent Alice can send one of two possible messages to Bob three times, one would need a set of 2 * 2 * 2 distinct pomsets to represent all possible branches of Alice's behaviour. This paper proposes an extension of pomsets, named branching pomsets, with a branching structure that can represent Alice's behaviour using 2 + 2 + 2 ordered actions. We encode choreographies as branching pomsets and show that the pomset semantics of the encoded choreographies are bisimilar to their operational semantics.


title: Elementary Lift and Single Element Coextension of A Binary Gammoid

abstract: Elementary lift is a generalized splitting operation. Splitting of a binary gammoid need not be a gammoid. This paper finds forbidden minors for a binary gammoid whose elementary lift is a binary gammoid. We also find forbidden minors for a binary gammoid whose single element coextension is a binary gammoid.


title: On Composing Communicating Systems

abstract: Communication is an essential element of modern software, yet programming and analysing communicating systems are difficult tasks. A reason for this difficulty is the lack of compositional mechanisms that preserve relevant communication properties. This problem has been recently addressed for the well-known model of communicating systems, that is sets of components consisting of finite-state machines capable of exchanging messages. The main idea of this approach is to take two systems, select a participant from each of them, and derive from those participants a pair of coupled gateways connecting the two systems. More precisely, a message directed to one of the gateways is forwarded to the gateway in the other system, which sends it to the other system. It has been shown that, under some suitable compatibility conditions between gateways, this composition mechanism preserves deadlock freedom for asynchronous as well as symmetric synchronous communications (where sender and receiver play the same part in determining which message to exchange). This paper considers the case of asymmetric synchronous communications where senders decide independently which message should be exchanged. We show here that preservation of lock freedom requires sequentiality of gateways, while this is not needed for preservation of either deadlock freedom or strong lock freedom.


title: Lang-n-Send Extended: Sending Regular Expressions to Monitors

abstract: In prior work, Cimini has presented Lang-n-Send, a pi-calculus with language definitions. In this paper, we present an extension of this calculus called Lang-n-Send+m. First, we revise Lang-n-Send to work with transition system specifications rather than its language specifications. This revision allows the use of negative premises in deduction rules. Next, we extend Lang-n-Send with monitors and with the ability of sending and receiving regular expressions, which then can be used in the context of larger regular expressions to monitor the execution of programs. We present a reduction semantics for Lang-n-Send+m, and we offer examples that demonstrate the scenarios that our calculus captures.


title: Magnetic properties of moir\'e quantum dot arrays

abstract: We investigate magnetic properties of quantum dot arrays of moir\'e triangular superlattices. Starting from a reciprocal space model, we use the projection technique to obtain maximally localized Wannier functions and determine generalized Hubbard model parameters. The many-body Hamiltonian is solved using the exact diagonalization method as a function of the number of electrons in differently shaped quantum dots arrays. Finite spin polarization is observed within a wide range of filling factors for small twist angles and sufficiently strong interactions in most of the studied structures. The prospect for a magnetization controlled by applying a displacement field is presented. In the vicinity of half-filling, signatures of Nagaoka ferromagnetism in moir\'e materials are seen, which we demonstrate by comparing results with the corresponding on-site Hubbard model.


title: Fisher Matrix Based Fault Detection for PMUs Data in Power Grids

abstract: Abnormal event detection is critical in the safe operation of power system. In this paper, using the data collected from phasor measurement units (PMUs), two methods based on Fisher random matrix are proposed to detect faults in power grids. Firstly, the fault detection matrix is constructed and the event detection problem is reformatted as a two-sample covariance matrices test problem. Secondly, the central limit theorem for the linear spectral statistic of the Fisher matrix is derived and a test statistic for testing faults is proposed. To save computing resources, the screening step of fault interval based on the test statistic is designed to check the existence of faults. Then two point-by-point methods are proposed to determine the time of the fault in the interval. One method detects faults by checking whether the largest sample eigenvalue falls outside the supporting set of limiting spectral distribution of the standard Fisher matrix, which can detect the faults with higher accuracy. The other method tests the faults based on the statistic proposed, which has a faster detection speed. Compared with existing works, the simulation results illustrate that two methods proposed in this paper cost less computational time and provide a higher degree of accuracy.


title: A Means-End Account of Explainable Artificial Intelligence

abstract: Explainable artificial intelligence (XAI) seeks to produce explanations for those machine learning methods which are deemed opaque. However, there is considerable disagreement about what this means and how to achieve it. Authors disagree on what should be explained (topic), to whom something should be explained (stakeholder), how something should be explained (instrument), and why something should be explained (goal). In this paper, I employ insights from means-end epistemology to structure the field. According to means-end epistemology, different means ought to be rationally adopted to achieve different epistemic ends. Applied to XAI, different topics, stakeholders, and goals thus require different instruments. I call this the means-end account of XAI. The means-end account has a descriptive and a normative component: on the one hand, I show how the specific means-end relations give rise to a taxonomy of existing contributions to the field of XAI; on the other hand, I argue that the suitability of XAI methods can be assessed by analyzing whether they are prescribed by a given topic, stakeholder, and goal.


title: Efficient Out-of-Distribution Detection of Melanoma with Wavelet-based Normalizing Flows

abstract: Melanoma is a serious form of skin cancer with high mortality rate at later stages. Fortunately, when detected early, the prognosis of melanoma is promising and malignant melanoma incidence rates are relatively low. As a result, datasets are heavily imbalanced which complicates training current state-of-the-art supervised classification AI models. We propose to use generative models to learn the benign data distribution and detect Out-of-Distribution (OOD) malignant images through density estimation. Normalizing Flows (NFs) are ideal candidates for OOD detection due to their ability to compute exact likelihoods. Nevertheless, their inductive biases towards apparent graphical features rather than semantic context hamper accurate OOD detection. In this work, we aim at using these biases with domain-level knowledge of melanoma, to improve likelihood-based OOD detection of malignant images. Our encouraging results demonstrate potential for OOD detection of melanoma using NFs. We achieve a 9% increase in Area Under Curve of the Receiver Operating Characteristics by using wavelet-based NFs. This model requires significantly less parameters for inference making it more applicable on edge devices. The proposed methodology can aid medical experts with diagnosis of skin-cancer patients and continuously increase survival rates. Furthermore, this research paves the way for other areas in oncology with similar data imbalance issues.


title: Right amenability in semigroups of formal power series

abstract: Let $k$ be an algebraically closed field of characteristic zero, and $k[[z]]$ the ring of formal power series over $k$. We provide several characterizations of right amenable finitely generated subsemigroups of $z^2k[[z]]$ with the semigroup operation $\circ $ being composition. In particular, we show that a subsemigroup $S=\langle Q_1,Q_2,\dots, Q_k\rangle$ of $z^2k[[z]]$ is right amenable if and only if there exists an invertible element $\beta$ of $zk[[z]]$ such that $\beta^{-1}\circ Q_i \circ \beta =\omega_i z^{d_i},$ $1\leq i \leq k,$ for some integers $d_i$, $1\leq i \leq k,$ and roots of unity $\omega_i,$ $1\leq i \leq k.$


title: ASR Error Correction with Constrained Decoding on Operation Prediction

abstract: Error correction techniques remain effective to refine outputs from automatic speech recognition (ASR) models. Existing end-to-end error correction methods based on an encoder-decoder architecture process all tokens in the decoding phase, creating undesirable latency. In this paper, we propose an ASR error correction method utilizing the predictions of correction operations. More specifically, we construct a predictor between the encoder and the decoder to learn if a token should be kept ("K"), deleted ("D"), or changed ("C") to restrict decoding to only part of the input sequence embeddings (the "C" tokens) for fast inference. Experiments on three public datasets demonstrate the effectiveness of the proposed approach in reducing the latency of the decoding process in ASR correction. It enhances the inference speed by at least three times (3.4 and 5.7 times) while maintaining the same level of accuracy (with WER reductions of 0.53% and 1.69% respectively) for our two proposed models compared to a solid encoder-decoder baseline. In the meantime, we produce and release a benchmark dataset contributing to the ASR error correction community to foster research along this line.


title: Spatial Scales and Time Variation of Solar Subsurface Convection

abstract: Spectral analysis of the spatial structure of solar subphotospheric convection is carried out for subsurface flow maps constructed using the time--distance helioseismological technique. The source data are obtained from the Helioseismic and Magnetic Imager (HMI) onboard Solar Dynamics Observatory (SDO) from 2010 May to 2020 September. A spherical-harmonic transform is applied to the horizontal-velocity-divergence field at depths from 0 to 19~Mm. The range of flow scales is fairly broad in shallow layers and narrows as the depth increases. The horizontal flow scales rapidly increase with depth, from supergranulation to giant-cell values, and indicate the existence of large-scale convective motions in the near-surface shear layer. The results can naturally be interpreted in terms of a superposition of differently scaled flows localized in different depth intervals. There is some tendency toward the emergence of meridionally elongated (banana-shaped) convection structures in the deep layers. The total power of convective flows is anticorrelated with the sunspot-number variation over the solar activity cycle in shallow subsurface layers and positively correlated at larger depths, which is suggestive of the depth redistribution of the convective-flow energy due to the action of magnetic fields.


title: Pressure-Independent Through-Plane Electrical Conductivity Measurements of Highly Filled Conductive Polymer Composites

abstract: Highly filled conductive polymer composites (CPCs) are widely used in applications such as bipolar plate materials for polymer electrolyte membrane fuel cells and redox flow batteries, electromagnetic interference shielding and sensors due to their useful electrical properties. A common method for determining through-plane electrical conductivities $\left(\sigma_{\rm tp} \right)$ of such highly filled CPCs applies a conductive carbon paper between electrodes and sample with application of external pressure to improve electrical contact. We show the pressure-dependence of the measured $\sigma_{\rm tp}$ can be eliminated by using a liquid metal such as the gallium-indium eutectic alloy (EGaIn) as contact material. Results indicate that EGaIn reduces contact resistances and cause three to five times larger $\sigma_{\rm tp}$ compared to measurements with carbon paper contacts and pressures up to 20 bar.