title: Foldings of KLR algebras

abstract: Let ${\mathbf U}^-_q$ be the negative half of the quantum group associated to a Kac-Moody algebra ${\mathfrak g}$, and $\underline{\mathbf U}^-_q$ the quantum group obtained by a folding of ${\mathfrak g}$. Let ${\mathbf A} = {\mathbf Z}[q,q^{-1}]$. McNamara showed that $\underline{\mathbf U}^-_q$ is categorified over a certain extenion ring $\widetilde{\mathbf A}$ of ${\mathbf A}$, by uing the folding theory of KLR algebras. He posed a question whether $\widetilde{\mathbf A}$ coincides with ${\mathbf A}$ or not. In this paper, we give an affirmative answer for this problem.


title: The effect of "fear" on two species competition

abstract: Non-consumptive effects such as fear of depredation, can strongly influence predator-prey dynamics. These effects have not been as well studied in the case of purely competitive systems, despite ecological and social motivations for the same. In this work we consider the classic two species ODE and PDE Lokta-Volterra competition models, where \emph{one} of the competitors is "fearful" of the other. We find that the presence of fear can have several interesting dynamical effects on the classical scenarios of weak and strong competition, and competitive exclusion. Notably, for fear levels in certain regimes, we show bi-stability between interior equilibrium and boundary equilibrium is possible - contrary to the classical strong competition situation where bi-stability is only possible between boundary equilibrium. Furthermore, in the spatially explicit setting, the effects of several spatially heterogeneous fear functions are investigated. In particular, we show that under certain $\mathbb{L}^{1}$ restrictions on the fear function, a weak competition type situation can change to competitive exclusion. Applications of these results to ecological as well as sociopolitical settings are discussed, that connect to the "landscape of fear" (LOF) concept in ecology.


title: The role of Pop III stars and early black holes in the 21cm signal from Cosmic Dawn

abstract: Modeling the 21cm global signal from the Cosmic Dawn is challenging due to the many poorly constrained physical processes that come into play. We address this problem using the semi-analytical code "Cosmic Archaeology Tool" (CAT). CAT follows the evolution of dark matter halos tracking their merger history and provides an ab initio description of their baryonic evolution, starting from the formation of the first (Pop III) stars and black holes (BHs) in mini-halos at z > 20. The model is anchored to observations of galaxies and AGN at z < 6 and predicts a reionization history consistent with constraints. In this work we compute the evolution of the mean global 21cm signal between $4\leq z \leq 40$ based on the rate of formation and emission properties of stars and accreting black holes. We obtain an absorption profile with a maximum depth $\delta {\rm T_b} = -95$ mK at $z \sim 26.5$ (54 MHz). This feature is quickly suppressed turning into an emission signal at $z = 20$ due to the contribution of accreting BHs that efficiently heat the IGM at $z < 27$. The high-$z$ absorption feature is caused by the early coupling between the spin and kinetic temperature of the IGM induced by Pop III star formation episodes in mini-halos. Once we account for an additional radio background from early BHs, we are able to reproduce the timing and the depth of the EDGES signal only if we consider a smaller X-ray background from accreting BHs, but not the shape.


title: On eigenvalue problems involving the critical Hardy potential and Sobolev type inequalities with logarithmic weights in two dimensions

abstract: We consider the two-dimensional eigenvalue problem for the Laplacian with the Neumann boundary condition involving the critical Hardy potential. We prove the existence of the second eigenfunction and study its asymptotic behavior around the origin. A key tool is the Sobolev type inequality with a logarithmic weight, which is shown in this paper as an application of the weighted nonlinear potential theory.


title: Global well-posedness of the partially damped 2D MHD equations via a direct normal mode method for the anisotropic linear operator

abstract: We prove the global well-posedness of the 2D incompressible non-resistive MHD equations with a velocity damping term near the non-zero constant background magnetic field. To this end, we newly design a normal mode method of effectively leveraging the anisotropy of the linear propagator that encodes both the partially dissipative nature of the non-resistive MHD system and the stabilizing mechanism of the underlying magnetic field. Isolating new key quantities and estimating them with themselves in an entangling way via the eigenvalue analysis based on Duhamel's formulation, we establish the global well-posedness for any initial data $(v_0,B_0)$ that is sufficiently small in a space rougher than $H^{4}\cap L^1$. This improves the recent work in SIAM J. Math. Anal. 47, 2630-2656 (2015) where the similar result was obtained provided that $(v_0,B_0)$ was small enough in a space strictly embedded in $H^{20}\cap W^{6,1}$.


title: Global analyses of nuclear PDFs with heavy-quark and neutrino data

abstract: We discuss the two most recent global analyses of nuclear parton distribution functions within the nCTEQ approach. LHC data on $W/Z$-boson, single-inclusive hadron and heavy quark/quarkonium production are shown to not only significantly reduce the gluon uncertainty down to $x\geq10^{-5}$, but to also influence the strange quark density. The latter is further constrained by neutrino deep-inelastic scattering and charm dimuon production data, whose consistency with neutral-current experiments is also re-evaluated.


title: Rank and rigidity of locally nilpotent derivations of affine fibrations

abstract: In this exposition, we propose a notion of rank and rigidity of locally nilpotent derivations of affine fibrations. We show that the concept is analogous to the perception of rank and rigidity of locally nilpotent derivations of polynomial algebras. Our results characterize locally nilpotent derivations of $\mathbb{A}^3$-fibrations having slice by classifying the fixed point free locally nilpotent derivations in terms of their ranks.


title: Nonlinear Analysis in p-Vector Spaces for Singe-Valued 1-Set Contractive Mappings

abstract: The goal of this paper is to develop some fundamental and important nonlinear analysis for single-valued mappings under the framework of p-vector spaces, in particular, for locally p-convex spaces for p in (0, 1]. More precisely, based on the fixed point theorem of single-valued continuous condensing mapping in locally p-convex spaces as the starting point, we first establish best approximation results for (single-valued) continuous condensing mappings which are then used to develop new results for three classes of nonlinear mappings consisting of 1) condensing; 2) 1-set contractive; and 3) semiclosed 1-set contractive mappings in locally p-convex spaces. Next they are used to establish general principle for nonlinear alternative, Leray - Schauder alternative, fixed points for non-self mappings with different boundary conditions for nonlinear mappings from locally p-convex spaces, to nonexpansive mappings in uniformly convex Banach spaces, or locally convex spaces with Opial condition. The results given by this paper not only include the corresponding ones in the existing literature as special cases, but also expected to be useful tools for the development of new theory in nonlinear functional analysis and applications to the study of related nonlinear problems arising from practice under the general framework of p-vector spaces for p in (0, 1]. Finally, the work presented by this paper focuses on the development of nonlinear analysis for single-valued (instead of set-valued) mappings for locally p-convex spaces, essentially, is indeed the continuation of the associated work given recently by Yuan [134] therein, the attention is given to the study of nonlinear analysis for set-valued mappings in locally p-convex spaces for p in (0, 1].


title: Projective Freeness and Stable Rank of Algebras of Complex-valued BV Functions

abstract: The paper investigates the algebraic properties of Banach algebras of complex-valued functions of bounded variation on a finite interval. It is proved that such algebras have Bass stable rank one and are projective free if they do not contain nontrivial idempotents. These properties are derived from a new result on the vanishing of the second \v{C}ech cohomology group of the polynomially convex hull of a continuum of a finite linear measure.


title: Quantitative symmetry in a mixed Serrin-type problem for a constrained torsional rigidity

abstract: We consider a mixed boundary value problem in a domain $\Omega$ contained in a half-ball $B_+$ and having a portion $\bar{T}$ of its boundary in common with the curved part of $\partial B_+$. The problem has to do with some sort of constrained torsional rigidity. In this situation, the relevant solution $u$ satisfies a Steklov condition on $T$ and a homogeneous Dirichlet condition on $\Sigma = \partial\Omega \setminus \bar{T} \subset B_+$. We provide an integral identity that relates (a symmetric function of) the second derivatives of the solution in $\Omega$ to its normal derivative $u_\nu$ on $\Sigma$. A first significant consequence of this identity is a rigidity result under a quite weak overdetermining integral condition for $u_\nu$ on $\Sigma$: in fact, it turns out that $\Sigma$ must be a spherical cap that meets $T$ orthogonally. This result returns the one obtained by J. Guo and C. Xia under the stronger pointwise condition that the values of $u_\nu$ be constant on $\Sigma$. A second important consequence is a set of stability bounds, which quantitatively measure how $\Sigma$ is far uniformly from being a spherical cap, if $u_\nu$ deviates from a constant in the norm $L^1(\Sigma)$.


title: Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models

abstract: Pre-trained language models (LMs), such as BERT (Devlin et al., 2018) and its variants, have led to significant improvements on various NLP tasks in past years. However, a theoretical framework for studying their relationships is still missing. In this paper, we fill this gap by investigating the linear dependency between pre-trained LMs. The linear dependency of LMs is defined analogously to the linear dependency of vectors. We propose Language Model Decomposition (LMD) to represent a LM using a linear combination of other LMs as basis, and derive the closed-form solution. A goodness-of-fit metric for LMD similar to the coefficient of determination is defined and used to measure the linear dependency of a set of LMs. In experiments, we find that BERT and eleven (11) BERT-like LMs are 91% linearly dependent. This observation suggests that current state-of-the-art (SOTA) LMs are highly "correlated". To further advance SOTA we need more diverse and novel LMs that are less dependent on existing LMs.


title: Differentiable Self-Adaptive Learning Rate

abstract: Learning rate adaptation is a popular topic in machine learning. Gradient Descent trains neural nerwork with a fixed learning rate. Learning rate adaptation is proposed to accelerate the training process through adjusting the step size in the training session. Famous works include Momentum, Adam and Hypergradient. Hypergradient is the most special one. Hypergradient achieved adaptation by calculating the derivative of learning rate with respect to cost function and utilizing gradient descent for learning rate. However, Hypergradient is still not perfect. In practice, Hypergradient fail to decrease training loss after learning rate adaptation with a large probability. Apart from that, evidence has been found that Hypergradient are not suitable for dealing with large datesets in the form of minibatch training. Most unfortunately, Hypergradient always fails to get a good accuracy on the validation dataset although it could reduce training loss to a very tiny value. To solve Hypergradient's problems, we propose a novel adaptation algorithm, where learning rate is parameter specific and internal structured. We conduct extensive experiments on multiple network models and datasets compared with various benchmark optimizers. It is shown that our algorithm can achieve faster and higher qualified convergence than those state-of-art optimizers.


title: Improving Aspect Sentiment Quad Prediction via Template-Order Data Augmentation

abstract: Recently, aspect sentiment quad prediction (ASQP) has become a popular task in the field of aspect-level sentiment analysis. Previous work utilizes a predefined template to paraphrase the original sentence into a structure target sequence, which can be easily decoded as quadruplets of the form (aspect category, aspect term, opinion term, sentiment polarity). The template involves the four elements in a fixed order. However, we observe that this solution contradicts with the order-free property of the ASQP task, since there is no need to fix the template order as long as the quadruplet is extracted correctly. Inspired by the observation, we study the effects of template orders and find that some orders help the generative model achieve better performance. It is hypothesized that different orders provide various views of the quadruplet. Therefore, we propose a simple but effective method to identify the most proper orders, and further combine multiple proper templates as data augmentation to improve the ASQP task. Specifically, we use the pre-trained language model to select the orders with minimal entropy. By fine-tuning the pre-trained language model with these template orders, our approach improves the performance of quad prediction, and outperforms state-of-the-art methods significantly in low-resource settings.


title: Comparing Spectroscopy Measurements in the Prediction of in Vitro Dissolution Profile using Artificial Neural Networks

abstract: Dissolution testing is part of the target product quality that is essential in approving new products in the pharmaceutical industry. The prediction of the dissolution profile based on spectroscopic data is an alternative to the current destructive and time-consuming method. Raman and near-infrared (NIR) spectroscopies are two fast and complementary methods that provide information on the tablets' physical and chemical properties and can help predict their dissolution profiles. This work aims to compare the information collected by these spectroscopy methods to support the decision of which measurements should be used so that the accuracy requirement of the industry is met. Artificial neural network models were created, in which the spectroscopy data and the measured compression curves were used as an input individually and in different combinations in order to estimate the dissolution profiles. Results showed that using only the NIR transmission method along with the compression force data or the Raman and NIR reflection methods, the dissolution profile was estimated within the acceptance limits of the f2 similarity factor. Adding further spectroscopy measurements increased the prediction accuracy.


title: Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning

abstract: Multiple pre-training objectives fill the vacancy of the understanding capability of single-objective language modeling, which serves the ultimate purpose of pre-trained language models (PrLMs), generalizing well on a mass of scenarios. However, learning multiple training objectives in a single model is challenging due to the unknown relative significance as well as the potential contrariety between them. Empirical studies have shown that the current objective sampling in an ad-hoc manual setting makes the learned language representation barely converge to the desired optimum. Thus, we propose \textit{MOMETAS}, a novel adaptive sampler based on meta-learning, which learns the latent sampling pattern on arbitrary pre-training objectives. Such a design is lightweight with negligible additional training overhead. To validate our approach, we adopt five objectives and conduct continual pre-training with BERT-base and BERT-large models, where MOMETAS demonstrates universal performance gain over other rule-based sampling strategies on 14 natural language processing tasks.


title: Secure and Efficient Multi-Signature Schemes for Fabric: An Enterprise Blockchain Platform

abstract: Digital signature is a major component of transactions on Blockchain platforms, especially in enterprise Blockchain platforms, where multiple signatures from a set of peers need to be produced to endorse a transaction. However, such process is often complex and time-consuming. Multi-signature, which can improve transaction efficiency by having a set of signers cooperate to produce a joint signature, has attracted extensive attentions. In this work, we propose two multi-signature schemes, GMS and AGMS, which are proved to be more secure and efficient than state-of-the-art multi-signature schemes. Besides, we implement the proposed schemes in a real Enterprise Blockchain platform, Fabric. Experiment results show that the proposed AGMS scheme helps achieve the goal of high transaction efficiency, low storage complexity, as well as high robustness against rogue-key attacks and k-sum problem attacks.


title: Self-similar Cosmological Solutions in Symmetric Teleparallel theory: Friedmann-Lema\^itre-Robertson-Walker spacetimes

abstract: The existence of self-similar solutions is discussed in symmetric teleparallel $f(Q)$-theory for a Friedmann-Lema\^itre-Robertson-Walker background geometry with zero and non-zero spatial curvature. For the four distinct families of connections which describe the specific cosmology in symmetric teleparallel gravity, the functional form of $f(Q)$ is reconstructed. Finally, to see if the analogy with General Relativity holds, we discuss the relation of the self-similar solutions with the asymptotic behaviour of more general $f(Q)$ functions.


title: The modified K\"ahler-Ricci flow, II

abstract: We improve the understanding of both finite time and infinite time singularities of the modified K\"ahler-Ricci flow as initiated by the second author of this paper in [26]. This is done by relating the modified K\"ahler-Ricci flow with the recent studies on the classic K\"ahler-Ricci flow and the degenerate complex Monge-Amp\`ere equation.


title: Backward error analysis of the Lanczos bidiagonalization with reorthogonalization

abstract: The $k$-step Lanczos bidiagonalization reduces a matrix $A\in\mathbb{R}^{m\times n}$ into a bidiagonal form $B_k\in\mathbb{R}^{(k+1)\times k}$ while generates two orthonormal matrices $U_{k+1}\in\mathbb{R}^{m\times (k+1)}$ and $V_{k+1}\in\mathbb{R}^{n\times {(k+1)}}$. However, any practical implementation of the algorithm suffers from loss of orthogonality of $U_{k+1}$ and $V_{k+1}$ due to the presence of rounding errors, and several reorthogonalization strategies are proposed to maintain some level of orthogonality. In this paper, by writing various reorthogonalization strategies in a general form we make a backward error analysis of the Lanczos bidiagonalization with reorthogonalization (LBRO). Our results show that the computed $B_k$ by the $k$-step LBRO of $A$ with starting vector $b$ is the exact one generated by the $k$-step Lanczos bidiagonalization of $A+E$ with starting vector $b+\delta_{b}$ (denoted by LB($A+E,b+\delta_{b}$)), where the 2-norm of perturbation vector/matrix $\delta_{b}$ and $E$ depend on the roundoff unit and orthogonality levels of $U_{k+1}$ and $V_{k+1}$. The results also show that the 2-norm of $U_{k+1}-\bar{U}_{k+1}$ and $V_{k+1}-\bar{V}_{k+1}$ are controlled by the orthogonality levels of $U_{k+1}$ and $V_{k+1}$, respectively, where $\bar{U}_{k+1}$ and $\bar{V}_{k+1}$ are the two orthonormal matrices generated by the $k$-step LB($A+E,b+\delta_{b}$) in exact arithmetic. Thus the $k$-step LBRO is mixed forward-backward stable as long as the orthogonality of $U_{k+1}$ and $V_{k+1}$ are good enough. We use this result to investigate the backward stability of LBRO based SVD computation algorithm and LSQR algorithm. Numerical experiments are made to confirm our results.


title: Evaluation Metrics for Object Detection for Autonomous Systems

abstract: This paper studies the evaluation of learning-based object detection models in conjunction with model-checking of formal specifications defined on an abstract model of an autonomous system and its environment. In particular, we define two metrics -- \emph{proposition-labeled} and \emph{class-labeled} confusion matrices -- for evaluating object detection, and we incorporate these metrics to compute the satisfaction probability of system-level safety requirements. While confusion matrices have been effective for comparative evaluation of classification and object detection models, our framework fills two key gaps. First, we relate the performance of object detection to formal requirements defined over downstream high-level planning tasks. In particular, we provide empirical results that show that the choice of a good object detection algorithm, with respect to formal requirements on the overall system, significantly depends on the downstream planning and control design. Secondly, unlike the traditional confusion matrix, our metrics account for variations in performance with respect to the distance between the ego and the object being detected. We demonstrate this framework on a car-pedestrian example by computing the satisfaction probabilities for safety requirements formalized in Linear Temporal Logic (LTL).


title: Saturation level of turbulence in collapsing gas clouds

abstract: We investigate the physical mechanism that decides the saturation level of turbulence in collapsing gas clouds. We perform a suite of high-resolution numerical simulations following the collapse of turbulent gas clouds with various effective polytropic exponents $\gamma_{\rm eff}$, initial Mach numbers $\mathcal{M}_0$, and initial turbulent seeds. Equating the energy injection rate by gravitational contraction and the dissipation rate of turbulence, we obtain an analytic expression of the saturation level of turbulence, and compare it with the numerical results. Consequently, the numerical results are well described by the analytic model, given that the turbulent driving scale in collapsing gas clouds is one-third of Jeans length of collapsing core. These results indicate that the strength of turbulence at the first core formation in the early universe/present-day star-formation process can be estimated solely by $\gamma_{\rm eff}$.


title: Dense but Efficient VideoQA for Intricate Compositional Reasoning

abstract: It is well known that most of the conventional video question answering (VideoQA) datasets consist of easy questions requiring simple reasoning processes. However, long videos inevitably contain complex and compositional semantic structures along with the spatio-temporal axis, which requires a model to understand the compositional structures inherent in the videos. In this paper, we suggest a new compositional VideoQA method based on transformer architecture with a deformable attention mechanism to address the complex VideoQA tasks. The deformable attentions are introduced to sample a subset of informative visual features from the dense visual feature map to cover a temporally long range of frames efficiently. Furthermore, the dependency structure within the complex question sentences is also combined with the language embeddings to readily understand the relations among question words. Extensive experiments and ablation studies show that the suggested dense but efficient model outperforms other baselines.


title: Existence and regularity of pullback attractors for a non-autonomous diffusion equation with delay and nonlocal diffusion in time-dependent spaces

abstract: In this paper, we study the asymptotic behavior of solution to a non-autonomous diffusion equations with delay containing some hereditary characteristics and nonlocal diffusion in time-dependent space $C_{\mathcal{H}_{t}(\Omega)}$. When the nonlinear function $f$ satisfies the polynomial growth of arbitrary order $p-1$ $(p \ge 2)$ and the external force $h \in L_{l o c}^{2}\left(\mathbb{R} ; H^{-1}(\Omega)\right)$, we establish the existence and regularity of the time-dependent pullback attractors.


title: CFAR based NOMP for Line Spectral Estimation and Detection

abstract: The line spectrum estimation problem is considered in this paper. We propose a CFAR-based Newtonized OMP (NOMP-CFAR) method which can maintain a desired false alarm rate without the knowledge of the noise variance. The NOMP-CFAR consists of two steps, namely, an initialization step and a detection step. In the initialization step, NOMP is employed to obtain candidate sinusoidal components. In the detection step, CFAR detector is applied to detect each candidate frequency, and remove the most unlikely frequency component. Then, the Newton refinements are used to refine the remaining parameters. The relationship between the false alarm rate and the required threshold is established. By comparing with the NOMP, NOMP-CFAR has only $1$ dB performance loss in additive white Gaussian noise scenario with false alarm probability $10^{-2}$ and detection probability $0.8$ without knowledge of noise variance. For varied noise variance scenario, NOMP-CFAR still preserves its CFAR property, while NOMP violates the CFAR. Besides, real experiments are also conducted to demonstrate the detection performance of NOMP-CFAR, compared to CFAR and NOMP.


title: Manifolds admitting special generic maps and their nice generalized multisections

abstract: We show that manifolds admitting special generic maps also admit nice generalized multisections. Special generic maps are natural generalized versions of Morse functions with exactly two singular points on closed manifolds, characterizing spheres whose dimensions are not $4$ topologically and the $4$-dimensional unit sphere, and canonical projections of unit spheres. They are shown to restrict the differentiable structures of spheres etc. and topologies of more general manifolds strongly by Saeki, Sakuma etc., followed by Nishioka, Wrazidlo etc. and followed by the author. Some elementary or important manifolds also admit such maps. (Generalized) multisections of manifolds are nice decompositions of (compact) manifolds, generalizing so-called Heegaard splittings of $3$-dimensional manifolds. PL manifolds have been shown to have (generalized) multisections enjoying certain properties by Rubinstein and Tillmann.


title: Synthesizing Reactive Test Environments for Autonomous Systems: Testing Reach-Avoid Specifications with Multi-Commodity Flows

abstract: We study automated test generation for verifying discrete decision-making modules in autonomous systems. We utilize linear temporal logic to encode the requirements on the system under test in the system specification and the behavior that we want to observe during the test is given as the test specification which is unknown to the system. First, we use the specifications and their corresponding non-deterministic B\"uchi automata to generate the specification product automaton. Second, a virtual product graph representing the high-level interaction between the system and the test environment is constructed modeling the product automaton encoding the system, the test environment, and specifications. The main result of this paper is an optimization problem, framed as a multi-commodity network flow problem, that solves for constraints on the virtual product graph which can then be projected to the test environment. Therefore, the result of the optimization problem is reactive test synthesis that ensures that the system meets the test specifications along with satisfying the system specifications. This framework is illustrated in simulation on grid world examples, and demonstrated on hardware with the Unitree A1 quadruped, wherein dynamic locomotion behaviors are verified in the context of reactive test environments.


title: A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss

abstract: For readability assessment, traditional methods mainly employ machine learning classifiers with hundreds of linguistic features. Although the deep learning model has become the prominent approach for almost all NLP tasks, it is less explored for readability assessment. In this paper, we propose a BERT-based model with feature projection and length-balanced loss (BERT-FP-LBL) for readability assessment. Specially, we present a new difficulty knowledge guided semi-supervised method to extract topic features to complement the traditional linguistic features. From the linguistic features, we employ projection filtering to extract orthogonal features to supplement BERT representations. Furthermore, we design a new length-balanced loss to handle the greatly varying length distribution of data. Our model achieves state-of-the-art performances on two English benchmark datasets and one dataset of Chinese textbooks, and also achieves the near-perfect accuracy of 99\% on one English dataset. Moreover, our proposed model obtains comparable results with human experts in consistency test.


title: Fries: Fast and Consistent Runtime Reconfiguration in Dataflow Systems with Transactional Guarantees (Extended Version)

abstract: A computing job in a big data system can take a long time to run, especially for pipelined executions on data streams. Developers often need to change the computing logic of the job such as fixing a loophole in an operator or changing the machine learning model in an operator with a cheaper model to handle a sudden increase of the data-ingestion rate. Recently many systems have started supporting runtime reconfigurations to allow this type of change on the fly without killing and restarting the execution. While the delay in reconfiguration is critical to performance, existing systems use epochs to do runtime reconfigurations, which can cause a long delay. In this paper we develop a new technique called Fries that leverages the emerging availability of fast control messages in many systems, since these messages can be sent without being blocked by data messages. We formally define consistency in runtime reconfigurations, and develop a Fries scheduler with consistency guarantees. The technique not only works for different classes of dataflows, but also works for parallel executions and supports fault tolerance. Our extensive experimental evaluation on clusters show the advantages of this technique compared to epoch-based schedulers.


title: A review of neutrino decoupling from the early universe to the current universe

abstract: We review the distortions of spectra of relic neutrinos due to the interactions with electrons, positrons, and neutrinos in the early universe. We solve integro-differential kinetic equations for the neutrino density matrix, including vacuum three-flavor neutrino oscillations, oscillations in electron and positron background, a collision term and finite temperature corrections to electron mass and electromagnetic plasma up to the next-to-leading order $\mathcal{O}(e^3)$. After that, we estimate the effects of the spectral distortions in neutrino decoupling on the number density and energy density of the Cosmic Neutrino Background (C$\nu$B) in the current universe, and discuss the implications of these effects on the capture rates in direct detection of the C$\nu$B on tritium, with emphasis on the PTOLEMY-type experiment. In addition, we find a precise value of the effective number of neutrinos, $N_{\rm eff}=3.044$. However, QED corrections to weak interaction rates at order $\mathcal{O}(e^2 G_F^2)$ and forward scattering of neutrinos via their self-interactions have not been precisely taken into account in the whole literature so far. Recent studies suggest that these neglections might induce uncertainties of $\pm(10^{-3} - 10^{-4})$ in $N_{\rm eff}$.


title: Homology cobordism, smooth concordance, and the figure eight knot

abstract: The $0$-surgeries of two knots $K_1$ and $K_2$ are homology cobordant rel meridians if there exists a $\mathbb{Z}$-homology cobordism $X$ between them such that the two knot meridians are in the same homology class in $H_{1}(X,\mathbb{Z})$. In this paper, we give a pair of rationally slice knots which are not smoothly concordant but whose $0$-surgeries are homology cobordant rel meridians. One knot in the pair is the figure eight knot, which has concordance order two; all previous examples of such pairs of knots are infinite order.


title: Multi-Objective Recommender Systems: Survey and Challenges

abstract: Recommender systems can be characterized as software solutions that provide users convenient access to relevant content. Traditionally, recommender systems research predominantly focuses on developing machine learning algorithms that aim to predict which content is relevant for individual users. In real-world applications, however, optimizing the accuracy of such relevance predictions as a single objective in many cases is not sufficient. Instead, multiple and often competing objectives have to be considered, leading to a need for more research in multi-objective recommender systems. We can differentiate between several types of such competing goals, including (i) competing recommendation quality objectives at the individual and aggregate level, (ii) competing objectives of different involved stakeholders, (iii) long-term vs. short-term objectives, (iv) objectives at the user interface level, and (v) system level objectives. In this paper we review these types of multi-objective recommendation settings and outline open challenges in this area.


title: Time-Variable Jet Ejections from RW Aur A, RY Tau and DG Tau

abstract: We present Gemini-NIFS, VLT-SINFONI and Keck-OSIRIS observations of near-infrared [Fe II] emission associated with the well-studied jets from three active T Tauri stars; RW Aur A, RY Tau and DG Tau taken from 2012-2021. We primarily covered the redshifted jet from RW Aur A, and the blueshifted jets from RY Tau and DG Tau, to investigate long-term time variabilities potentially related to the activities of mass accretion and/or the stellar magnetic fields. All of these jets consist of several moving knots with tangential velocities of 70-240 km s-1, ejected from the star with different velocities and at irregular time intervals. Via comparison with literature, we identify significant differences in tangential velocities for the DG Tau jet between 1985-2008 and 2008-2021. The sizes of the individual knots appear to increase with time, and in turn, their peak brightnesses in the 1.644-micron emission decreased up to a factor of ~30 during the epochs of our observations. A variety of the decay timescales measured in the [Fe II] 1.644 micron emission can be attributed to different pre-shock conditions if the moving knots are unresolved shocks. However, our data do not exclude the possibility that these knots are due to non-uniform density/temperature distributions with another heating mechanism, or in some cases due to stationary shocks without proper motions. Spatially resolved observations of these knots with significantly higher angular resolutions are necessary to better understand their physical nature.


title: Latency Aware Semi-synchronous Client Selection and Model Aggregation for Wireless Federated Learning

abstract: Federated learning (FL) is a collaborative machine learning framework that requires different clients (e.g., Internet of Things devices) to participate in the machine learning model training process by training and uploading their local models to an FL server in each global iteration. Upon receiving the local models from all the clients, the FL server generates a global model by aggregating the received local models. This traditional FL process may suffer from the straggler problem in heterogeneous client settings, where the FL server has to wait for slow clients to upload their local models in each global iteration, thus increasing the overall training time. One of the solutions is to set up a deadline and only the clients that can upload their local models before the deadline would be selected in the FL process. This solution may lead to a slow convergence rate and global model overfitting issues due to the limited client selection. In this paper, we propose the Latency awarE Semi-synchronous client Selection and mOdel aggregation for federated learNing (LESSON) method that allows all the clients to participate in the whole FL process but with different frequencies. That is, faster clients would be scheduled to upload their models more frequently than slow clients, thus resolving the straggler problem and accelerating the convergence speed, while avoiding model overfitting. Also, LESSON is capable of adjusting the tradeoff between the model accuracy and convergence rate by varying the deadline. Extensive simulations have been conducted to compare the performance of LESSON with the other two baseline methods, i.e., FedAvg and FedCS. The simulation results demonstrate that LESSON achieves faster convergence speed than FedAvg and FedCS, and higher model accuracy than FedCS.


title: Competing ferromagnetic superconducting states in europium-based iron pnictides

abstract: In europium-based iron pnictides superconducting Fe-planes can be influenced by a Zeeman field originated from the neighboring Eu-planes. The field tends to induce spin-density waves with a ferromagnetic average which coexists with the superconducting order by forming complementary patterns of the superconducting and magnetic order parameters in a Fulde-Ferrell-Larkin-Ovchinnikov phase and a two-dimensional textured-superconducting phase. The hard gap around the Fermi energy disappears in these fragile inhomogeneous superconducting states, which features, instead, V-shaped spin-resolved local density of states. The inhomogeneous states are also competing with either a homogeneous superconducting or a homogeneous ferromagnetic state, manifesting the intertwining influences of the magnetic orders in Fe and Eu planes, the spin-density wave band structure, and the superconducting pairing order.


title: Single-shot high-resolution identification of discrete frequency modes of single-photon-level optical pulses

abstract: Frequency-multiplexed quantum communication usually requires a single-shot identification of the frequency mode of a single photon . In this paper, we propose a scheme that can identify the frequency mode with high-resolution even for spontaneously emitted photons whose generation time is unknown, by combining the time-to-space and frequency-to-time mode mapping. We also demonstrate the mapping of the frequency mode (100 MHz intervals) to the temporal mode (435 ns intervals) for weak coherent pulses using atomic frequency combs. This frequency interval is close to the minimum frequency mode interval of the atomic frequency comb quantum memory with Pr3+ ion-doped Y2SiO5 crystal, and the proposed scheme has the potential to maximize the frequency multiplexing of the quantum repeater scheme with the memory.


title: Two-stage training method for Japanese electrolaryngeal speech enhancement based on sequence-to-sequence voice conversion

abstract: Sequence-to-sequence (seq2seq) voice conversion (VC) models have greater potential in converting electrolaryngeal (EL) speech to normal speech (EL2SP) compared to conventional VC models. However, EL2SP based on seq2seq VC requires a sufficiently large amount of parallel data for the model training and it suffers from significant performance degradation when the amount of training data is insufficient. To address this issue, we suggest a novel, two-stage strategy to optimize the performance on EL2SP based on seq2seq VC when a small amount of the parallel dataset is available. In contrast to utilizing high-quality data augmentations in previous studies, we first combine a large amount of imperfect synthetic parallel data of EL and normal speech, with the original dataset into VC training. Then, a second stage training is conducted with the original parallel dataset only. The results show that the proposed method progressively improves the performance of EL2SP based on seq2seq VC.


title: Wall-crossing for K-theoretic quasimap invariants I

abstract: We study K-theoretic GLSM invariants with one-dimensional gauge group and introduce elliptic central charges that depend on an elliptic cohomology class called an elliptic brane and a choice of level structure. These central charges have an integral representation related to an interpolation problem for the elliptic brane and satisfy natural q-difference equations. Integral representaions lead to the wall crossing statement for the central charges in two different phases of the GLSM. We explain how the orbifold structure leads to differences between wall crossing of the usual (K-theoretic) and elliptic central charges.


title: Extremal polygonal chains with respect to the Kirchhoff index

abstract: The Kirchhoff index is defined as the sum of resistance distances between all pairs of vertices in a graph. This index is a critical parameter for measuring graph structures. In this paper, we characterize polygonal chains with the minimum Kirchhoff index, and characterize even (odd) polygonal chains with the maximum Kirchhoff index, which extends the results of \cite{45}, \cite{14} and \cite{2,13,44} to a more general case.


title: LAVA: Label-efficient Visual Learning and Adaptation

abstract: We present LAVA, a simple yet effective method for multi-domain visual transfer learning with limited data. LAVA builds on a few recent innovations to enable adapting to partially labelled datasets with class and domain shifts. First, LAVA learns self-supervised visual representations on the source dataset and ground them using class label semantics to overcome transfer collapse problems associated with supervised pretraining. Secondly, LAVA maximises the gains from unlabelled target data via a novel method which uses multi-crop augmentations to obtain highly robust pseudo-labels. By combining these ingredients, LAVA achieves a new state-of-the-art on ImageNet semi-supervised protocol, as well as on 7 out of 10 datasets in multi-domain few-shot learning on the Meta-dataset. Code and models are made available.


title: Gaussian-Bernoulli RBMs Without Tears

abstract: We revisit the challenging problem of training Gaussian-Bernoulli restricted Boltzmann machines (GRBMs), introducing two innovations. We propose a novel Gibbs-Langevin sampling algorithm that outperforms existing methods like Gibbs sampling. We propose a modified contrastive divergence (CD) algorithm so that one can generate images with GRBMs starting from noise. This enables direct comparison of GRBMs with deep generative models, improving evaluation protocols in the RBM literature. Moreover, we show that modified CD and gradient clipping are enough to robustly train GRBMs with large learning rates, thus removing the necessity of various tricks in the literature. Experiments on Gaussian Mixtures, MNIST, FashionMNIST, and CelebA show GRBMs can generate good samples, despite their single-hidden-layer architecture. Our code is released at: \url{https://github.com/lrjconan/GRBM}.


title: Statistics and spectral analysis of turbulent duct flows with flexible and rigid polymer solutions

abstract: We present an experimental investigation of turbulent drag reduction with flexible and rigid polymer solutions. The flexible polymer is partially hydrolyzed polyacrylamide (HPAM) and the rigid polymer is xanthan gum (XG). The experiments are carried out at low drag reduction ($\%DR < 40$), high drag reduction ($\%DR > 40$) and maximum drag reduction (where the velocity profile $U^+$ roughly matches Virk's asymptote). We compare velocity profiles, streamwise and wall-normal Reynolds stresses and power spectra of streamwise velocity fluctuations measured by Laser Doppler Anemometry (LDA). Our results show that the effects of both XG and HPAM polymers on turbulence are similar, provided that the Reynolds numbers and $\%DR$ are also similar. At high levels of $\%DR$, the power spectral densities of streamwise velocity fluctuations of both XG and HPAM flows show a power-law decay near $-3$ instead of $-5/3$ in the inertial range. A slope of the power spectra of $-3$ was recently interpreted as evidence of elasto-inertial turbulence (EIT) in polymer jets. At relatively low concentrations, we observe that flexible polymer solutions are more effective at reducing drag, while XG only reaches MDR at very high concentrations. Thus, we hypothesize that the formation of polymer aggregates with higher concentrations contributes to increase viscoelasticity, and thus $\%DR$, with XG and other rigid polymer solutions.


title: Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checking

abstract: Chinese Spell Checking (CSC) aims to detect and correct Chinese spelling errors. Recent researches start from the pretrained knowledge of language models and take multimodal information into CSC models to improve the performance. However, they overlook the rich knowledge in the dictionary, the reference book where one can learn how one character should be pronounced, written, and used. In this paper, we propose the LEAD framework, which renders the CSC model to learn heterogeneous knowledge from the dictionary in terms of phonetics, vision, and meaning. LEAD first constructs positive and negative samples according to the knowledge of character phonetics, glyphs, and definitions in the dictionary. Then a unified contrastive learning-based training scheme is employed to refine the representations of the CSC models. Extensive experiments and detailed analyses on the SIGHAN benchmark datasets demonstrate the effectiveness of our proposed methods.


title: Efficient Bi-Level Optimization for Recommendation Denoising

abstract: The acquisition of explicit user feedback (e.g., ratings) in real-world recommender systems is often hindered by the need for active user involvement. To mitigate this issue, implicit feedback (e.g., clicks) generated during user browsing is exploited as a viable substitute. However, implicit feedback possesses a high degree of noise, which significantly undermines recommendation quality. While many methods have been proposed to address this issue by assigning varying weights to implicit feedback, two shortcomings persist: (1) the weight calculation in these methods is iteration-independent, without considering the influence of weights in previous iterations, and (2) the weight calculation often relies on prior knowledge, which may not always be readily available or universally applicable. To overcome these two limitations, we model recommendation denoising as a bi-level optimization problem. The inner optimization aims to derive an effective model for the recommendation, as well as guiding the weight determination, thereby eliminating the need for prior knowledge. The outer optimization leverages gradients of the inner optimization and adjusts the weights in a manner considering the impact of previous weights. To efficiently solve this bi-level optimization problem, we employ a weight generator to avoid the storage of weights and a one-step gradient-matching-based loss to significantly reduce computational time. The experimental results on three benchmark datasets demonstrate that our proposed approach outperforms both state-of-the-art general and denoising recommendation models. The code is available at https://github.com/CoderWZW/BOD.


title: Jet-Flavour Tagging at FCC-ee

abstract: Jet-flavour identification algorithms are of paramount importance to maximise the physics potential of the Future Circular Collider (FCC). Out of the extensive FCC-ee physics program, flavour tagging is crucial for the Higgs physics program, given the dominance of hadronic decays of the Higgs boson. Highly efficient discrimination of $b$-, $c$-, $s$-, and gluon jets allows access to novel decay modes that cannot be identified at the LHC, adding quantitatively new dimensions to the Higgs physics programme. This contribution presents new jet flavour identification algorithms based on advanced machine-learning techniques that exploit particle-level information. Beyond an excellent performance of $b$- and $c$-quark tagging, they are also able to discriminate jets from strange quark hadronisation, opening the way to improve the sensitivity of the Higgs to strange quark coupling. The impact of different detector design assumptions on the flavour tagging performance is assessed using one of the baseline detector concepts for FCC-ee, IDEA.


title: Two-Sided Impact of Water on the Relaxation of Inner-Valence Vacancies of Biologically Relevant Molecules

abstract: After ionization of an inner-valence electron of molecules, the resulting cation-radicals store substantial internal energy which, if sufficient, can trigger ejection of an additional electron in an Auger decay usually followed by molecule fragmentation. In the environment, intermolecular Coulombic decay (ICD) and electron-transfer mediated decay (ETMD) are also operative, resulting in one or two electrons being ejected from a neighbor, thus preventing the fragmentation of the initially ionized molecule. These relaxation processes are investigated theoretically for prototypical heterocycle-water complexes of imidazole, pyrrole, and pyridine. It is found that the hydrogen-bonding site of the water molecule critically influences the nature and energetics of the electronic states involved, opening or closing certain relaxation processes of the inner-valence ionized system. Our results indicate that the relaxation mechanisms of biologically relevant systems with inner-valence vacancies on their carbon atoms can strongly depend on the presence of the electron-density donating or accepting neighbor, either water or another biomolecule.


title: Detecting the oscillation and propagation of the nascent dynamic solar wind structure at 2.6 solar radii using VLBI radio telescopes

abstract: Probing the solar corona is crucial to study the coronal heating and solar wind acceleration. However, the transient and inhomogeneous solar wind flows carry large-amplitude inherent Alfven waves and turbulence, which make detection more difficult. We report the oscillation and propagation of the solar wind at 2.6 solar radii (Rs) by observation of China Tianwen and ESA Mars Express with radio telescopes. The observations were carried out on Oct.9 2021, when one coronal mass ejection (CME) passed across the ray paths of the telescope beams. We obtain the frequency fluctuations (FF) of the spacecraft signals from each individual telescope. Firstly, we visually identify the drift of the frequency spikes at a high spatial resolution of thousands of kilometers along the projected baselines. They are used as traces to estimate the solar wind velocity. Then we perform the cross-correlation analysis on the time series of FF from different telescopes. The velocity variations of solar wind structure along radial and tangential directions during the CME passage are obtained. The oscillation of tangential velocity confirms the detection of streamer wave. Moreover, at the tail of the CME, we detect the propagation of an accelerating fast field-aligned density structure indicating the presence of magnetohydrodynamic waves. This study confirm that the ground station-pairs are able to form particular spatial projection baselines with high resolution and sensitivity to study the detailed propagation of the nascent dynamic solar wind structure.


title: Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping

abstract: Fine-tuning over large pretrained language models (PLMs) has established many state-of-the-art results. Despite its superior performance, such fine-tuning can be unstable, resulting in significant variance in performance and potential risks for practical applications. Previous works have attributed such instability to the catastrophic forgetting problem in the top layers of PLMs, which indicates iteratively that fine-tuning layers in a top-down manner is a promising solution. In this paper, we first point out that this method does not always work out due to the different convergence speeds of different layers/modules. Inspired by this observation, we propose a simple component-wise gradient norm clipping method to adjust the convergence speed for different components. Experiment results demonstrate that our method achieves consistent improvements in terms of generalization performance, convergence speed, and training stability. The codebase can be found at https://github.com/yangalan123/FineTuningStability.


title: Boson-peak vibrational modes in glasses feature hybridized phononic and quasilocalized excitations

abstract: A hallmark of structural glasses and other disordered solids is the emergence of excess low-frequency vibrations, on top of the Debye spectrum $D_{\rm Debye}(\omega)$ of phonons ($\omega$ denotes the vibrational frequency), which exist in any solid whose Hamiltonian is translationally invariant. These excess vibrations -- a signature of which is a THz peak in the reduced density of states $D(\omega)/D_{\rm Debye}(\omega)$, known as the boson peak -- have resisted a complete theoretical understanding for decades. Here, we provide direct numerical evidence that vibrations near the boson peak consist of hybridizations of phonons with many quasilocalized excitations, the latter were recently shown to generically populate the low-frequency tail of the vibrational spectra of structural glasses quenched from a melt and of disordered crystals. Our results suggest that quasilocalized excitations exist up to and in the vicinity of the boson-peak frequency, and hence constitute fundamental building blocks of the excess vibrational modes in glasses.


title: Constant-roll Inflation in Brane Induced Gravity Cosmology

abstract: In this article we study a constant-roll inflationary model in the context of the DGP brane-world cosmology caused by a quintessence scalar field. We determine an analytical solution for the Friedman equation coupled to the equation of motion of the scaler field. The evolution of the primordial scalar and tensor perturbations is also studied. To check the viability of the model we use numerical approaches and plot some figures. Our results for the scalar spectral index and the tensor to scaler ratio show good consistency with observations for given values of model parameters.


title: Single-spacecraft techniques for shock parameters estimation: A systematic approach

abstract: Spacecraft missions provide the unique opportunity to study the properties of collisionless shocks utilising in situ measurements. In the past years, several diagnostics have been developed to address key shock parameters using time series of magnetic field (and plasma) data collected by a single spacecraft crossing a shock front. A critical aspect of such diagnostics is the averaging process involved in the evaluation of upstream-downstream quantities. In this work, we discuss several of these techniques, with a particular focus on the shock obliquity (defined as the angle between the upstream magnetic field and the shock normal vector) estimation. We introduce a systematic variation of the upstream/downstream averaging windows, yielding to an ensemble of shock parameters, a useful tool to address the robustness of their estimation. This approach is first tested with a synthetic shock, compliant with the Rankine-Hugoniot jump conditions for a shock, including the presence of noise and disturbances. We then employ self-consistent, hybrid kinetic shock simulations to apply the diagnostics to virtual spacecraft crossing the shock front at various stages of its evolution, highlighting the role of shock-induced fluctuations in the parameters estimation. This approach has the strong advantage of retaining some important properties of collisionless shock while being able to set a known, nominal set of shock parameters. Finally, two recent observations of interplanetary shocks from the Solar Orbiter spacecraft are presented, and the approach is also tested on an interplanetary shock measured by the four spacecraft of the Magnetospheric Multiscale (MMS) mission. All the Python software developed and used for the diagnostics (SerPyShock) is made available for the public, including an example of parameter estimation for a shock wave recently observed in-situ by the Solar Orbiter spacecraft.


title: Language Detoxification with Attribute-Discriminative Latent Space

abstract: Transformer-based Language Models (LMs) have achieved impressive results on natural language understanding tasks, but they can also generate toxic text such as insults, threats, and profanity, limiting their real-world applications. To overcome this issue, a few text generation approaches aim to detoxify toxic texts using additional LMs or perturbations. However, previous methods require excessive memory, computations, and time which are serious bottlenecks in their real-world application. To address such limitations, we propose an effective yet efficient method for language detoxification using an attribute-discriminative latent space. Specifically, we project the latent space of an original Transformer LM onto a discriminative latent space that well-separates texts by their attributes using a projection block and an attribute discriminator. This allows the LM to control the text generation to be non-toxic with minimal memory and computation overhead. We validate our model, Attribute-Discriminative Language Model (ADLM) on detoxified language and dialogue generation tasks, on which our method significantly outperforms baselines both in performance and efficiency.


title: Content-adaptive Encoder Preset Prediction for Adaptive Live Streaming

abstract: In live streaming applications, a fixed set of bitrate-resolution pairs (known as bitrate ladder) is generally used to avoid additional pre-processing run-time to analyze the complexity of every video content and determine the optimized bitrate ladder. Furthermore, live encoders use the fastest available preset for encoding to ensure the minimum possible latency in streaming. For live encoders, it is expected that the encoding speed is equal to the video framerate. An optimized encoding preset may result in (i) increased Quality of Experience (QoE) and (ii) improved CPU utilization while encoding. In this light, this paper introduces a Content-Adaptive encoder Preset prediction Scheme (CAPS) for adaptive live video streaming applications. In this scheme, the encoder preset is determined using Discrete Cosine Transform (DCT)-energy-based low-complexity spatial and temporal features for every video segment, the number of CPU threads allocated for each encoding instance, and the target encoding speed. Experimental results show that CAPS yields an overall quality improvement of 0.83 dB PSNR and 3.81 VMAF with the same bitrate, compared to the fastest preset encoding of the HTTP Live Streaming (HLS) bitrate ladder using x265 HEVC open-source encoder. This is achieved by maintaining the desired encoding speed and reducing CPU idle time.


title: Performance Evaluation of Serverless Edge Computing for Machine Learning Applications

abstract: Next generation technologies such as smart healthcare, self-driving cars, and smart cities require new approaches to deal with the network traffic generated by the Internet of Things (IoT) devices, as well as efficient programming models to deploy machine learning techniques. Serverless edge computing is an emerging computing paradigm from the integration of two recent technologies, edge computing and serverless computing, that can possibly address these challenges. However, there is little work to explore the capability and performance of such a technology. In this paper, a comprehensive performance analysis of a serverless edge computing system using popular open-source frameworks, namely, Kubeless, OpenFaaS, Fission, and funcX is presented. The experiments considered different programming languages, workloads, and the number of concurrent users. The machine learning workloads have been used to evaluate the performance of the system under different working conditions to provide insights into the best practices. The evaluation results revealed some of the current challenges in serverless edge computing and open research opportunities in this emerging technology for machine learning applications.


title: Revision Transformers: Instructing Language Models to Change their Values

abstract: Current transformer language models (LM) are large-scale models with billions of parameters. They have been shown to provide high performances on a variety of tasks but are also prone to shortcut learning and bias. Addressing such incorrect model behavior via parameter adjustments is very costly. This is particularly problematic for updating dynamic concepts, such as moral values, which vary culturally or interpersonally. In this work, we question the current common practice of storing all information in the model parameters and propose the Revision Transformer (RiT) to facilitate easy model updating. The specific combination of a large-scale pre-trained LM that inherently but also diffusely encodes world knowledge with a clear-structured revision engine makes it possible to update the model's knowledge with little effort and the help of user interaction. We exemplify RiT on a moral dataset and simulate user feedback demonstrating strong performance in model revision even with small data. This way, users can easily design a model regarding their preferences, paving the way for more transparent AI models.


title: Exponential asymptotics and the generation of free-surface flows by submerged line vortices

abstract: There has been significant recent interest in the study of water waves coupled with non-zero vorticity. We derive analytical approximations for the exponentially-small free-surface waves generated in two-dimensions by one or several submerged point vortices when driven at low Froude numbers. The vortices are fixed in place, and a boundary-integral formulation in the arclength along the surface allows the study of nonlinear waves and strong point vortices. We demonstrate that for a single point vortex, techniques in exponential asymptotics prescribe the formation of waves in connection with the presence of Stokes lines originating from the vortex. When multiple point vortices are placed within the fluid, trapped waves may occur, which are confined to lie between the vortices. We also demonstrate that for the two-vortex problem, the phenomenon of trapped waves occurs for a countably infinite set of values of the Froude number. This work will form a basis for other asymptotic investigations of wave-structure interactions where vorticity plays a key role in the formation of surface waves.


title: Elements of the Stochastic Calculus for a Class of Boltzmann type processes and Application to Regularity of Densities

abstract: For a class of piecewise deterministic Markov processes we introduce a stochastic calculus which is a certain non-Gaussian counterpart to the classical Malliavin calculus. As an application we investigate the regularity of densities of $N$-particle Boltzmann type processes at time $t>0$.


title: WebtoonMe: A Data-Centric Approach for Full-Body Portrait Stylization

abstract: Full-body portrait stylization, which aims to translate portrait photography into a cartoon style, has drawn attention recently. However, most methods have focused only on converting face regions, restraining the feasibility of use in real-world applications. A recently proposed two-stage method expands the rendering area to full bodies, but the outputs are less plausible and fail to achieve quality robustness of non-face regions. Furthermore, they cannot reflect diverse skin tones. In this study, we propose a data-centric solution to build a production-level full-body portrait stylization system. Based on the two-stage scheme, we construct a novel and advanced dataset preparation paradigm that can effectively resolve the aforementioned problems. Experiments reveal that with our pipeline, high-quality portrait stylization can be achieved without additional losses or architectural changes.


title: A Non-Interior-Point Continuation Method for the Optimal Control Problem with Equilibrium Constraints

abstract: In this study, we focus on the numerical solution method for the optimal control problem with equilibrium constraints (OCPEC).It is extremely challenging to solve OCPEC owing to the absence of constraint regularity and strictly feasible interior points. To solve OCPEC efficiently, we first relax the discretized OCPEC to recover the constraint regularity and then map its Karush--Kuhn--Tucker (KKT) conditions into a perturbed system of equations. Subsequently, we propose a novel two-stage solution method, called the non-interior-point continuation method, to solve the perturbed system. In the first stage, a non-interior-point method, which solves the perturbed system using the Newton method and globalizes convergence using a dedicated merit function, is employed. In the second stage, a predictor-corrector continuation method is utilized to track the solution trajectory as a function of the perturbed parameter, starting at the solution obtained in the first stage. The proposed method regularizes the KKT matrix and does not enforce iterates to remain in the feasible interior, which mitigates the numerical difficulties of solving OCPEC. Convergence properties are analyzed under certain assumptions. Numerical experiments demonstrate that the proposed method can accurately track the solution trajectory while demanding significantly less computation time compared to the interior-point method.


title: Spectroscopic Confirmation of Two X-ray Diffuse and Massive Galaxy Clusters at Low Redshift

abstract: We present MMT spectroscopic observations of two massive galaxy cluster candidates at redshift $z\sim0.07$ that show extended and diffuse X-ray emission in the ROSAT All Sky Survey (RASS) images. The targets were selected from a previous catalog of 303 newly-identified cluster candidates with the similar properties using the intra-cluster medium emission. Using the new MMT Hectospec data and SDSS archival spectra, we identify a number of member galaxies for the two targets and confirm that they are galaxy clusters at $z=0.079$ and 0.067, respectively. The size of the two clusters, calculated from the distribution of the member galaxies, is roughly 2 Mpc in radius. We estimate cluster masses using three methods based on their galaxy number overdensities, galaxy velocity dispersions, and X-ray emission. The overdensity-based masses are $(6\sim8) \rm \times10^{14}\ M_\odot$, comparable to the masses of large clusters at low redshift. The masses derived from velocity dispersions are significantly lower, likely due to their diffuse and low concentration features. Our result suggests the existence of a population of large clusters with very diffuse X-ray emission that have been missed by most previous searches using the RASS images. If most of the 303 candidates in the previous catalog are confirmed to be real clusters, this may help to reduce the discrepancy of cosmological results between the CMB and galaxy cluster measurements.


title: Comparison of Varied 2D Mapping Approaches by Using Practice-Oriented Evaluation Criteria

abstract: A key aspect of the precision of a mobile robots localization is the quality and aptness of the map it is using. A variety of mapping approaches are available that can be employed to create such maps with varying degrees of effort, hardware requirements and quality of the resulting maps. To create a better understanding of the applicability of these different approaches to specific applications, this paper evaluates and compares three different mapping approaches based on simultaneous localization and mapping, terrestrial laser scanning as well as publicly accessible building contours.


title: Order Parameter Engineering for Random Systems

abstract: The chemical short-range order (CSRO) in the crystalline materials influences the properties and its effect is particularly important in the context of the multicomponent materials. We propose a scheme for CSRO parameter or $\mathrm{\Delta-}$parameter in terms of number of like and unlike bonds in the multicomponent systems. The OPERA or $\bf{O}$rder $\bf{P}$arameter $\bf{E}$ngineering for $\bf{RA}$ndom Systems scheme for both semi-canonical as well as canonical ensemble is proposed. The proposed framework provides a high-throughput scheme for exploration of the CSRO in terms of the $\mathrm{\Delta-}$parameter. We demonstrate the applicability of the $\mathrm{\Delta-}$parameter for describing the CSRO in multicomponent alloys and oxides (FCC-CoCrNi, BCC-MoNbTaW and (CoCuMgNiZn)O). We show that the $\mathrm{\Delta-}$parameter not only inherits the merit of Warren-Cowley order parameter, but it also addresses its limitations. The $\mathrm{\Delta-}$parameter being a scalar quantity can represent the chemical order and OPERA framework can deal with both semi-canonical and canonical ensemble


title: The Devil in Linear Transformer

abstract: Linear transformers aim to reduce the quadratic space-time complexity of vanilla transformers. However, they usually suffer from degraded performances on various tasks and corpus. In this paper, we examine existing kernel-based linear transformers and identify two key issues that lead to such performance gaps: 1) unbounded gradients in the attention computation adversely impact the convergence of linear transformer models; 2) attention dilution which trivially distributes attention scores over long sequences while neglecting neighbouring structures. To address these issues, we first identify that the scaling of attention matrices is the devil in unbounded gradients, which turns out unnecessary in linear attention as we show theoretically and empirically. To this end, we propose a new linear attention that replaces the scaling operation with a normalization to stabilize gradients. For the issue of attention dilution, we leverage a diagonal attention to confine attention to only neighbouring tokens in early layers. Benefiting from the stable gradients and improved attention, our new linear transformer model, transNormer, demonstrates superior performance on text classification and language modeling tasks, as well as on the challenging Long-Range Arena benchmark, surpassing vanilla transformer and existing linear variants by a clear margin while being significantly more space-time efficient. The code is available at https://github.com/OpenNLPLab/Transnormer .


title: BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining

abstract: Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general language domain, i.e., BERT (and its variants) and GPT (and its variants), the first one has been extensively studied in the biomedical domain, such as BioBERT and PubMedBERT. While they have achieved great success on a variety of discriminative downstream biomedical tasks, the lack of generation ability constrains their application scope. In this paper, we propose BioGPT, a domain-specific generative Transformer language model pre-trained on large scale biomedical literature. We evaluate BioGPT on six biomedical NLP tasks and demonstrate that our model outperforms previous models on most tasks. Especially, we get 44.98%, 38.42% and 40.76% F1 score on BC5CDR, KD-DTI and DDI end-to-end relation extraction tasks respectively, and 78.2% accuracy on PubMedQA, creating a new record. Our case study on text generation further demonstrates the advantage of BioGPT on biomedical literature to generate fluent descriptions for biomedical terms. Code is available at https://github.com/microsoft/BioGPT.


title: First Simultaneous K$^-$p $\rightarrow (\Sigma^0/\Lambda) \, \pi^0$ Cross Sections Measurements at 98 MeV/c

abstract: We report the first simultaneous and independent measurements of the K$^{-}$p $\rightarrow \Sigma^0 \, \pi^{0}$ and K$^{-}$p $\rightarrow \Lambda \, \pi^{0}$ cross sections around 100 MeV/c kaon momentum. The kaon beam delivered by the DA$\Phi$NE collider was exploited to detect K$^-$ absorptions on Hydrogen atoms, populating the gas mixture of the KLOE drift chamber. The precision of the measurements ($\sigma_{K^- p \rightarrow \Sigma^0 \pi^0} = 42.8 \pm 1.5 (stat.) ^{+2.4}_{-2.0}(syst.) \ \mathrm{mb}$ and $\sigma_{K^- p \rightarrow \Lambda \pi^0} = 31.0 \pm 0.5 (stat.) ^{+1.2}_{-1.2}(syst.) \ \mathrm{mb}\,$) is the highest yet obtained in the low kaon momentum regime.


title: Entity-to-Text based Data Augmentation for various Named Entity Recognition Tasks

abstract: Data augmentation techniques have been used to alleviate the problem of scarce labeled data in various NER tasks (flat, nested, and discontinuous NER tasks). Existing augmentation techniques either manipulate the words in the original text that break the semantic coherence of the text, or exploit generative models that ignore preserving entities in the original text, which impedes the use of augmentation techniques on nested and discontinuous NER tasks. In this work, we propose a novel Entity-to-Text based data augmentation technique named EnTDA to add, delete, replace or swap entities in the entity list of the original texts, and adopt these augmented entity lists to generate semantically coherent and entity preserving texts for various NER tasks. Furthermore, we introduce a diversity beam search to increase the diversity during the text generation process. Experiments on thirteen NER datasets across three tasks (flat, nested, and discontinuous NER tasks) and two settings (full data and low resource settings) show that EnTDA could bring more performance improvements compared to the baseline augmentation techniques.


title: Rarefied gas flow past a liquid droplet: interplay between internal and external flows

abstract: Experimental and theoretical studies on millimetre-sized droplets suggest that at low Reynolds number the difference between the drag force on a circulating water droplet and that on a rigid sphere is very small (less than 1 %) (LeClair et al., J. Atmos. Sci., vol. 29, 1972, pp. 728-740). While the drag force on a spherical liquid droplet at high viscosity ratios (of the liquid to the gas), is approximately the same as that on a rigid sphere of the same size, the other quantities of interest (e.g. the temperature) in the case of a rarefied gas flow over a liquid droplet differ from the same quantities in the case of a rarefied gas flow over a rigid sphere. The goal of this article is to study the effects of internal motion within a spherical microdroplet/nanodroplet -- such that its diameter is comparable to the mean free path of the surrounding gas -- on the drag force and its overall dynamics. To this end, the problem of a slow rarefied gas flowing over an incompressible liquid droplet is investigated analytically by considering the internal motion of the liquid inside the droplet and also by accounting for kinetic effects in the gas. Detailed results for different values of the Knudsen number, the ratio of the thermal conductivities and the ratio of viscosities are presented for the pressure and temperature profiles inside and outside the liquid droplet. The results for the drag force obtained in the present work are in good agreement with the theoretical and experimental results existing in the literature.


title: An approximation scheme and non-Hermitian re-normalization for description of atom-field system evolution

abstract: Interactions between a source of light and atoms are ubiquitous in nature. The study of them is interesting on the fundamental level as well as for applications. They are in the core of Quantum Information Processing tasks and in Quantum Thermodynamics protocols. However, even for two-level atom interacting with field in rotating wave approximation there exists no exact solution. This touches as basic problem in quantum field theory, where we can only calculate the transitions in the time asymptotic limits (i.e. minus and plus infinity), while we are not able to trace the evolution. In this paper we want to get more insight into the time evolution of a total system of a two-level atom and a continuous-mode quantum field. We propose an approximation, which we are able to apply systematically to each order of Dyson expansion, resulting in greatly simplified formula for the evolution of the combined system at any time. Our tools include a proposed novel, {\it non-Hermitian} re-normalization method. As a sanity check, by applying our framework, we derive the known optical Bloch equations.


title: Observation of a $J/\psi\Lambda$ resonance consistent with a strange pentaquark candidate in $B^-\to J/\psi\Lambda\bar{p}$ decays

abstract: An amplitude analysis of $B^-\to J/\psi\Lambda\bar{p}$ decays is performed using about 4400 signal candidates selected on a data sample of $pp$ collisions recorded at center-of-mass energies of 7, 8 and 13 TeV with the LHCb detector, corresponding to an integrated luminosity of 9 fb$^{-1}$. A narrow resonance in the $J/\psi\Lambda$ system, consistent with a pentaquark candidate with strangeness, is observed with high significance. The mass and the width of this new state are measured to be $4338.2\pm 0.7\pm 0.4$MeV and ${7.0\pm1.2\pm1.3}$MeV, where the first uncertainty is statistical and the second systematic. The spin is determined to be $1/2$ and negative parity is preferred. Due to the small $Q$-value of the reaction, the most precise single measurement of the $B^-$ mass to date, $5279.44\pm0.05\pm0.07$MeV, is obtained.


title: On Galois-Gauss sums and the square root of the inverse different

abstract: We discuss a possible generalisation of a conjecture of Bley, Burns and Hahn concerning the relation between the second Adams-operator twisted Galois-Gauss sums of weakly ramified Artin characters and the square root of the inverse different of finite, odd degree, Galois extensions of number fields, to the setting of all finite Galois extensions of number fields for which a square root of the inverse different exists. We also extend the key methods and results of Bley, Burns and Hahn to this more general setting and, by combining these methods with a recent result of Agboola, Burns, Caputo and the present author concerning Artin root numbers of twisted irreducible symplectic characters, we provide new insight into a conjecture of Erez concerning the Galois structure of the square root of the inverse different.


title: Pole inflation and primordial black holes formation in Starobinsky-like supergravity

abstract: We extend the Cecotti-Kallosh model of Starobinsky inflation in supergravity by adding a holomorphic function to the superpotential in order to generate a large peak in the power spectrum of scalar (curvature) perturbations. In our approach, the singular non-canonical kinetic terms are largely responsible for inflation (as an attractor solution), whereas the superpotential is engineered to generate a production of primordial black holes. We study the cases with (i) a linear holomorphic function, (ii) a quadratic holomorphic function, and (iii) an exponential holomorphic function, as regards the dependence of inflation and primordial black holes production upon parameters of those functions and initial conditions, as well as verify viability of inflation with our superpotentials. We find that an efficient production of primordial black holes consistent with CMB measurements is only possible in the second (ii) case. We calculate the masses of the produced primordial black holes and find that they are below the Hawking (black hole) evaporation limit, so that they cannot be part of the current dark matter in our Universe.


title: Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generation

abstract: Symbolic music generation aims to generate music scores automatically. A recent trend is to use Transformer or its variants in music generation, which is, however, suboptimal, because the full attention cannot efficiently model the typically long music sequences (e.g., over 10,000 tokens), and the existing models have shortcomings in generating musical repetition structures. In this paper, we propose Museformer, a Transformer with a novel fine- and coarse-grained attention for music generation. Specifically, with the fine-grained attention, a token of a specific bar directly attends to all the tokens of the bars that are most relevant to music structures (e.g., the previous 1st, 2nd, 4th and 8th bars, selected via similarity statistics); with the coarse-grained attention, a token only attends to the summarization of the other bars rather than each token of them so as to reduce the computational cost. The advantages are two-fold. First, it can capture both music structure-related correlations via the fine-grained attention, and other contextual information via the coarse-grained attention. Second, it is efficient and can model over 3X longer music sequences compared to its full-attention counterpart. Both objective and subjective experimental results demonstrate its ability to generate long music sequences with high quality and better structures.


title: MuGER$^2$: Multi-Granularity Evidence Retrieval and Reasoning for Hybrid Question Answering

abstract: Hybrid question answering (HQA) aims to answer questions over heterogeneous data, including tables and passages linked to table cells. The heterogeneous data can provide different granularity evidence to HQA models, e.t., column, row, cell, and link. Conventional HQA models usually retrieve coarse- or fine-grained evidence to reason the answer. Through comparison, we find that coarse-grained evidence is easier to retrieve but contributes less to the reasoner, while fine-grained evidence is the opposite. To preserve the advantage and eliminate the disadvantage of different granularity evidence, we propose MuGER$^2$, a Multi-Granularity Evidence Retrieval and Reasoning approach. In evidence retrieval, a unified retriever is designed to learn the multi-granularity evidence from the heterogeneous data. In answer reasoning, an evidence selector is proposed to navigate the fine-grained evidence for the answer reader based on the learned multi-granularity evidence. Experiment results on the HybridQA dataset show that MuGER$^2$ significantly boosts the HQA performance. Further ablation analysis verifies the effectiveness of both the retrieval and reasoning designs.


title: Using deep convolutional neural networks to classify poisonous and edible mushrooms found in China

abstract: Because of their abundance of amino acids, polysaccharides, and many other nutrients that benefit human beings, mushrooms are deservedly popular as dietary cuisine both worldwide and in China. However, if people eat poisonous fungi by mistake, they may suffer from nausea, vomiting, mental disorder, acute anemia, or even death. Each year in China, there are around 8000 people became sick, and 70 died as a result of eating toxic mushrooms by mistake. It is counted that there are thousands of kinds of mushrooms among which only around 900 types are edible, thus without specialized knowledge, the probability of eating toxic mushrooms by mistake is very high. Most people deem that the only characteristic of poisonous mushrooms is a bright colour, however, some kinds of them do not correspond to this trait. In order to prevent people from eating these poisonous mushrooms, we propose to use deep learning methods to indicate whether a mushroom is toxic through analyzing hundreds of edible and toxic mushrooms smartphone pictures. We crowdsource a mushroom image dataset that contains 250 images of poisonous mushrooms and 200 images of edible mushrooms. The Convolutional Neural Network (CNN) is a specialized type of artificial neural networks that use a mathematical operation called convolution in place of general matrix multiplication in at least one of their layers, which can generate a relatively precise result by analyzing a huge amount of images, and thus is very suitable for our research. The experimental results demonstrate that the proposed model has high credibility and can provide a decision-making basis for the selection of edible fungi, so as to reduce the morbidity and mortality caused by eating poisonous mushrooms. We also open source our hand collected mushroom image dataset so that peer researchers can also deploy their own model to advance poisonous mushroom identification.


title: Temporal Action Segmentation: An Analysis of Modern Techniques

abstract: Temporal action segmentation (TAS) in videos aims at densely identifying video frames in minutes-long videos with multiple action classes. As a long-range video understanding task, researchers have developed an extended collection of methods and examined their performance using various benchmarks. Despite the rapid growth of TAS techniques in recent years, no systematic survey has been conducted in these sectors. This survey analyzes and summarizes the most significant contributions and trends. In particular, we first examine the task definition, common benchmarks, types of supervision, and prevalent evaluation measures. In addition, we systematically investigate two essential techniques of this topic, i.e., frame representation and temporal modeling, which have been studied extensively in the literature. We then conduct a thorough review of existing TAS works categorized by their levels of supervision and conclude our survey by identifying and emphasizing several research gaps. In addition, we have curated a list of TAS resources, which is available at https://github.com/nus-cvml/awesome-temporal-action-segmentation.


title: On the odderon mechanism for transverse single spin asymmetry in the Wandzura-Wilczek approximation

abstract: We compute the transverse single spin asymmetry in forward $p^\uparrow p \to hX$ and $p^\uparrow A \to hX$ collisions from the odderon mechanism originally suggested by Kovchegov and Sievert [1]. Working in the hybrid approach of the Color Glass Condensate effective theory we firstly identify the relevant collinear parton distribution function (PDF) of the transversely polarized proton $p^\uparrow$ as the intrinsic twist-3 $g_T(x)$ distribution. We further argue that the complete polarized cross section also contains contributions from the kinematical and the dynamical twist-3 PDFs, in addition to the intrinsic twist-3 PDF. By restricting to the Wandzura-Wilczek approximation, where the dynamical twist-3 PDFs are dropped, we find that the odderon contribution to the polarized cross section for inclusive hadron production is exactly zero at the next-to-leading order in the strong coupling.


title: Stating Comparison Score Uncertainty and Verification Decision Confidence Towards Transparent Face Recognition

abstract: Face Recognition (FR) is increasingly used in critical verification decisions and thus, there is a need for assessing the trustworthiness of such decisions. The confidence of a decision is often based on the overall performance of the model or on the image quality. We propose to propagate model uncertainties to scores and decisions in an effort to increase the transparency of verification decisions. This work presents two contributions. First, we propose an approach to estimate the uncertainty of face comparison scores. Second, we introduce a confidence measure of the system's decision to provide insights into the verification decision. The suitability of the comparison scores uncertainties and the verification decision confidences have been experimentally proven on three face recognition models on two datasets.


title: Improving the spin-down limits of the continuous gravitational waves emitted from rotating triaxial pulsars

abstract: The spin-down limit of the continuous gravitational wave strain from pulsars assumed to be triaxial stars rotating about a principal moment of inertia axis depends upon the value of the intrinsic spin frequency derivative of the pulsar, among other parameters. In order to get more accurate intrinsic spin frequency derivative values, dynamical effects contributing to the measured spin frequency derivative values must be estimated via more realistic approaches. In this work, we calculated improved values for the spin-down limit of the continuous gravitational wave strain (assuming that pulsars are triaxial stars rotating about a principal moment of inertia axis) for a set of 237 pulsars for which a targeted search for continuous gravitational waves was recently carried out by the LIGO-Virgo-KAGRA (LVK) Collaboration. We used `GalDynPsr', a Python-based public package, to calculate more realistic values for the intrinsic spin frequency derivatives and, consequently, we get more realistic values of the spin-down limit. The realistic values that we obtain for the intrinsic spin frequency derivatives can also provide a valuable contribution to improving the sensitivity of searches for continuous gravitational waves from known pulsars.


title: Ionisation of inner T Tauri star discs: effects of in-situ energetic particles produced by strong magnetic reconnection events

abstract: Magnetic reconnection is one of the major particle acceleration processes in space and astrophysical plasmas. Low-energy supra-thermal particles emitted by magnetic reconnection are a source of ionisation for circumstellar discs, influencing their chemical, thermal and dynamical evolution. The aim of this work is to propose a first investigation to evaluate how energetic particles can propagate in the circumstellar disc of a T Tauri star and how they affect the ionisation rate of the disc plasma. To that end, we have collected experimental and theoretical cross sections for the production of H$^+$, H$_2^+$ and He$^+$ by electrons and protons. Starting from theoretical injection spectra of protons and electrons emitted during magnetic reconnection events, we have calculated the propagated spectra in the circumstellar disc considering the relevant energy loss processes. We have considered fluxes of energetic particles with different spectral indices and different disc magnetic configurations, generated at different positions from the star considering the physical properties of the flares as deduced from the observations obtained by the Chandra Orion Ultra Deep point source catalogue. We have then computed the ionisation rates for a disc whose structure has been calculated with the radiation thermo-chemical code {\tt ProDiMo}. We find that energetic particles are potentially a very strong source of local ionisation with ionisation rates exceeding by several orders of magnitude the contribution due to X-rays, stellar energetic particles and radioactivity in the inner disc.


title: Dynamics-based entanglement witnesses for non-Gaussian states of harmonic oscillators

abstract: We introduce a family of entanglement witnesses for continuous variable systems, which rely on the sole assumption that their dynamics is that of coupled harmonic oscillators at the time of the test. Entanglement is inferred from the Tsirelson nonclassicality test on one of the normal modes, without any knowledge about the state of the other mode. In each round, the protocol requires measuring only the sign of one coordinate (e.g. position) at one among several times. This dynamic-based entanglement witness is more akin to a Bell inequality than to an uncertainty relation: in particular, it does not admit false positives from classical theory. Our criterion detects non-Gaussian states, some of which are missed by other criteria.


title: Leveraging a New Spanish Corpus for Multilingual and Crosslingual Metaphor Detection

abstract: The lack of wide coverage datasets annotated with everyday metaphorical expressions for languages other than English is striking. This means that most research on supervised metaphor detection has been published only for that language. In order to address this issue, this work presents the first corpus annotated with naturally occurring metaphors in Spanish large enough to develop systems to perform metaphor detection. The presented dataset, CoMeta, includes texts from various domains, namely, news, political discourse, Wikipedia and reviews. In order to label CoMeta, we apply the MIPVU method, the guidelines most commonly used to systematically annotate metaphor on real data. We use our newly created dataset to provide competitive baselines by fine-tuning several multilingual and monolingual state-of-the-art large language models. Furthermore, by leveraging the existing VUAM English data in addition to CoMeta, we present the, to the best of our knowledge, first cross-lingual experiments on supervised metaphor detection. Finally, we perform a detailed error analysis that explores the seemingly high transfer of everyday metaphor across these two languages and datasets.


title: Stability for the Helmholtz equation in deterministic and random periodic structures

abstract: Stability results for the Helmholtz equations in both deterministic and random periodic structures are proved in this paper. Under the assumption of excluding resonances, by a variational method and Fourier analysis in the energy space, the stability estimate for the Helmholtz equation in a deterministic periodic structure is established. For the stochastic case, by introducing a variable transform, the variational formulation of the scattering problem in a random domain is reduced to that in a definite domain with random medium. Combining the stability result for the deteministic case with regularity and stochastic regularity of the scattering surface, Pettis measurability theorem and Bochner's Theorem further yield the stability result for the scattering problem by random periodic structures. Both stability estimates are explicit with respect to the wavenumber.


title: Adaptive Neural Network Ensemble Using Frequency Distribution

abstract: Neural network (NN) ensembles can reduce large prediction variance of NN and improve prediction accuracy. For highly nonlinear problems with insufficient data set, the prediction accuracy of NN models becomes unstable, resulting in a decrease in the accuracy of ensembles. Therefore, this study proposes a frequency distribution-based ensemble that identifies core prediction values, which are expected to be concentrated near the true prediction value. The frequency distribution-based ensemble classifies core prediction values supported by multiple prediction values by conducting statistical analysis with a frequency distribution, which is based on various prediction values obtained from a given prediction point. The frequency distribution-based ensemble can improve predictive performance by excluding prediction values with low accuracy and coping with the uncertainty of the most frequent value. An adaptive sampling strategy that sequentially adds samples based on the core prediction variance calculated as the variance of the core prediction values is proposed to improve the predictive performance of the frequency distribution-based ensemble efficiently. Results of various case studies show that the prediction accuracy of the frequency distribution-based ensemble is higher than that of Kriging and other existing ensemble methods. In addition, the proposed adaptive sampling strategy effectively improves the predictive performance of the frequency distribution-based ensemble compared with the previously developed space-filling and prediction variance-based strategies.


title: Reply to `Comment on "Absence versus Presence of Dissipative Quantum Phase Transition in Josephson Junctions"'

abstract: We reply to the comments on our previous paper Physical Review Letters, Vol. 129, 087001 (2022), raised by Th\'eo S\'epulcre, Serge Florens, and Izak Snyman in arXiv:2210.00742.

categories: cond-mat.mes-hall cond-mat.stat-mech cond-mat.supr-con quant-ph


title: CPL: Counterfactual Prompt Learning for Vision and Language Models

abstract: Prompt tuning is a new few-shot transfer learning technique that only tunes the learnable prompt for pre-trained vision and language models such as CLIP. However, existing prompt tuning methods tend to learn spurious or entangled representations, which leads to poor generalization to unseen concepts. Towards non-spurious and efficient prompt learning from limited examples, this paper presents a novel \underline{\textbf{C}}ounterfactual \underline{\textbf{P}}rompt \underline{\textbf{L}}earning (CPL) method for vision and language models, which simultaneously employs counterfactual generation and contrastive learning in a joint optimization framework. Particularly, CPL constructs counterfactual by identifying minimal non-spurious feature change between semantically-similar positive and negative samples that causes concept change, and learns more generalizable prompt representation from both factual and counterfactual examples via contrastive learning. Extensive experiments demonstrate that CPL can obtain superior few-shot performance on different vision and language tasks than previous prompt tuning methods on CLIP. On image classification, we achieve 3.55\% average relative improvement on unseen classes across seven datasets; on image-text retrieval and visual question answering, we gain up to 4.09\% and 25.08\% relative improvements across three few-shot scenarios on unseen test sets respectively.