title: Towards Zero-Shot Knowledge Distillation for Natural Language Processing

abstract: Knowledge Distillation (KD) is a common knowledge transfer algorithm used for model compression across a variety of deep learning based natural language processing (NLP) solutions. In its regular manifestations, KD requires access to the teacher's training data for knowledge transfer to the student network. However, privacy concerns, data regulations and proprietary reasons may prevent access to such data. We present, to the best of our knowledge, the first work on Zero-Shot Knowledge Distillation for NLP, where the student learns from the much larger teacher without any task specific data. Our solution combines out of domain data and adversarial training to learn the teacher's output distribution. We investigate six tasks from the GLUE benchmark and demonstrate that we can achieve between 75% and 92% of the teacher's classification score (accuracy or F1) while compressing the model 30 times.


title: Long time asymptotic behavior for the derivative Schr\"odinger equation with nonzero boundary conditions

abstract: In this paper, we apply $\overline\partial$ steepest descent method to study the Cauchy problem for the derivative nonlinear Schr\"odinger equation with nonzero boundary conditions \begin{align} &iq_{t}+q_{xx}+i\sigma(|q|^2q)_{x}=0,\\ & (x,0) = q_0(x), \quad\lim_{x\to\pm\infty} q_0(x) = q_\pm,\end{align} where $|q_\pm|=1$. Based on the spectral analysis of the Lax pair, we express the solution of the derivative nonlinear Schr\"odinger equation in terms of solutions of a Riemann-Hilbert problem.In a fixed space-time solitonic region $-3<x/t<-1$, we compute the long time asymptotic expansion of the solution $q(x,t)$,which implies soliton resolution conjecture and can be characterized with an $N(\Lambda)$-soliton whose parameters are modulated bya sum of localized soliton-soliton interactions as one moves through the region; the residual error order $\mathcal{O}( t^{-3/4})$ from a $\overline\partial$ equation.


title: Incremental Embedding Learning via Zero-Shot Translation

abstract: Modern deep learning methods have achieved great success in machine learning and computer vision fields by learning a set of pre-defined datasets. Howerver, these methods perform unsatisfactorily when applied into real-world situations. The reason of this phenomenon is that learning new tasks leads the trained model quickly forget the knowledge of old tasks, which is referred to as catastrophic forgetting. Current state-of-the-art incremental learning methods tackle catastrophic forgetting problem in traditional classification networks and ignore the problem existing in embedding networks, which are the basic networks for image retrieval, face recognition, zero-shot learning, etc. Different from traditional incremental classification networks, the semantic gap between the embedding spaces of two adjacent tasks is the main challenge for embedding networks under incremental learning setting. Thus, we propose a novel class-incremental method for embedding network, named as zero-shot translation class-incremental method (ZSTCI), which leverages zero-shot translation to estimate and compensate the semantic gap without any exemplars. Then, we try to learn a unified representation for two adjacent tasks in sequential learning process, which captures the relationships of previous classes and current classes precisely. In addition, ZSTCI can easily be combined with existing regularization-based incremental learning methods to further improve performance of embedding networks. We conduct extensive experiments on CUB-200-2011 and CIFAR100, and the experiment results prove the effectiveness of our method. The code of our method has been released.


title: Maximum-Likelihood Quantum State Tomography by Soft-Bayes

abstract: Quantum state tomography (QST), the task of estimating an unknown quantum state given measurement outcomes, is essential to building reliable quantum computing devices. Whereas computing the maximum-likelihood (ML) estimate corresponds to solving a finite-sum convex optimization problem, the objective function is not smooth nor Lipschitz, so most existing convex optimization methods lack sample complexity guarantees; moreover, both the sample size and dimension grow exponentially with the number of qubits in a QST experiment, so a desired algorithm should be highly scalable with respect to the dimension and sample size, just like stochastic gradient descent. In this paper, we propose a stochastic first-order algorithm that computes an $\varepsilon$-approximate ML estimate in $O( ( D \log D ) / \varepsilon ^ 2 )$ iterations with $O( D^3 )$ per-iteration time complexity, where $D$ denotes the dimension of the unknown quantum state and $\varepsilon$ denotes the optimization error. Our algorithm is an extension of Soft-Bayes to the quantum setup.


title: Lipschitz Regularity in Vectorial Linear Transmission Problems

abstract: We consider vector-valued solutions to a linear transmission problem, and we prove that Lipschitz-regularity on one phase is transmitted to the next phase. More exactly, given a solution $u:B_1\subset \mathbb{R}^n \to \mathbb{R}^m$ to the elliptic system \begin{equation*} \mbox{div} ((A + (B-A)\chi_D )\nabla u) = 0 \quad \text{in }B_1, \end{equation*} where $A$ and $B$ are Dini continuous, uniformly elliptic matrices, we prove that if $\nabla u \in L^{\infty} (D)$ then $u$ is Lipschitz in $B_{1/2}$. A similar result is also derived for the parabolic counterpart of this problem.


title: Topological effects of phonons in GaN and AlxGa1-xN: A potential perspective for tuning phonon transport

abstract: Tuning thermal transport in semiconductor nanostructures is of great significance for thermal management in information and power electronics. With excellent transport properties, such as ballistic transport, immunity to point defects and disorders, and forbidden backscattering, topological phonon surface states show remarkable potential in addressing this issue. Herein, topological phonon analyses are performed on hexagonal wurtzite GaN to check the topological characteristics of phonons. And other nitrides of the same family, i.e., AlN and AlGaN alloy, are also calculated from a topological phonon phase transition perspective. With the aid of first-principle calculations and topological phonon theory, Weyl phonon states, which host surfaces states without backscattering, are investigated for all these materials. The results show that there is no nontrivial topological phonon state in GaN. However, by introducing Al atoms, i.e., in wurtzite type AlN and AlGaN, more than one Weyl phonon point is found, confirmed by obvious topological characteristics, including non-zero integer topological charges, source/sink in Berry curvature distributions, surface local density of states and surface arcs. As AlN and AlGaN are typical materials in AlGaN/GaN heterostructure based electronics, the existence of topological phonon states in them will benefit thermal management by facilitating the design of one-way interfacial phonon transport without backscattering.


title: Universal scaling of work statistics for quantum quenches

abstract: In this paper, we systematically study the work statistics for quantum phase transition. For a quantum system approached by an anisotropic conformal field theory near the critical point, the driving protocols is divided into three different regimes for different quench rates, which reflects the competition between the frozen time and the quench time scale. In each regime, we find universal scaling behaviors in work statistics (after renormalization). It is shown that the critical exponents are determined by the space-time dimension $d$, the dynamical critical exponent $z$, the correlation-length exponent $\nu$, and the power-law protocols. These universal scalings in nonequilibrium process may be found in quantum phase transition by measuring the Loschmidt echo or the Ramsey interferometry.


title: Expander spanning subgraphs with large girth

abstract: We conjecture that finite graphs with positive Cheeger constant admit a spanning subgraph with positive Cheeger constant and girth proportional to the diameter. We prove this conjecture for regular expander graphs with large expansion. Our proof relies on the Local Lemma.


title: Patch-wise++ Perturbation for Adversarial Targeted Attacks

abstract: Although great progress has been made on adversarial attacks for deep neural networks (DNNs), their transferability is still unsatisfactory, especially for targeted attacks. There are two problems behind that have been long overlooked: 1) the conventional setting of $T$ iterations with the step size of $\epsilon/T$ to comply with the $\epsilon$-constraint. In this case, most of the pixels are allowed to add very small noise, much less than $\epsilon$; and 2) usually manipulating pixel-wise noise. However, features of a pixel extracted by DNNs are influenced by its surrounding regions, and different DNNs generally focus on different discriminative regions in recognition. To tackle these issues, our previous work proposes a patch-wise iterative method (PIM) aimed at crafting adversarial examples with high transferability. Specifically, we introduce an amplification factor to the step size in each iteration, and one pixel's overall gradient overflowing the $\epsilon$-constraint is properly assigned to its surrounding regions by a project kernel. But targeted attacks aim to push the adversarial examples into the territory of a specific class, and the amplification factor may lead to underfitting. Thus, we introduce the temperature and propose a patch-wise++ iterative method (PIM++) to further improve transferability without significantly sacrificing the performance of the white-box attack. Our method can be generally integrated to any gradient-based attack methods. Compared with the current state-of-the-art attack methods, we significantly improve the success rate by 33.1\% for defense models and 31.4\% for normally trained models on average.


title: Continual Learning in Task-Oriented Dialogue Systems

abstract: Continual learning in task-oriented dialogue systems can allow us to add new domains and functionalities through time without incurring the high cost of a whole system retraining. In this paper, we propose a continual learning benchmark for task-oriented dialogue systems with 37 domains to be learned continuously in four settings, such as intent recognition, state tracking, natural language generation, and end-to-end. Moreover, we implement and compare multiple existing continual learning baselines, and we propose a simple yet effective architectural method based on residual adapters. Our experiments demonstrate that the proposed architectural method and a simple replay-based strategy perform comparably well but they both achieve inferior performance to the multi-task learning baseline, in where all the data are shown at once, showing that continual learning in task-oriented dialogue systems is a challenging task. Furthermore, we reveal several trade-offs between different continual learning methods in term of parameter usage and memory size, which are important in the design of a task-oriented dialogue system. The proposed benchmark is released together with several baselines to promote more research in this direction.


title: Flexible model composition in machine learning and its implementation in MLJ

abstract: A graph-based protocol called `learning networks' which combine assorted machine learning models into meta-models is described. Learning networks are shown to overcome several limitations of model composition as implemented in the dominant machine learning platforms. After illustrating the protocol in simple examples, a concise syntax for specifying a learning network, implemented in the MLJ framework, is presented. Using the syntax, it is shown that learning networks are are sufficiently flexible to include Wolpert's model stacking, with out-of-sample predictions for the base learners.


title: On the robustness of bound states in the continuum in waveguides with lateral leakage channels

abstract: Bound states in the continuum (BICs) are trapped or guided modes with frequencies in radiation continua. They are associated with high-quality-factor resonances that give rise to strong local field enhancement and rapid variations in scattering spectra, and have found many valuable applications. A guided mode of an optical waveguide can also be a BIC, if there is a lateral structure supporting compatible waves propagating in the lateral direction, i.e., there is a channel for lateral leakage. A BIC is typically destroyed (becomes a resonant or a leaky mode) if the structure is slightly perturbed, but some BICs are robust with respect to a large family of perturbations. In this paper, we show (analytically and numerically) that a typical BIC in optical waveguides with a left-right mirror symmetry and a single lateral leakage channel is robust with respect to any structural perturbation that preserves the left-right mirror symmetry. Our study improves the theoretical understanding on BICs and can be useful when applications of BICs in optical waveguides are explored.


title: Moments of polynomials with random multiplicative coefficients

abstract: For $X(n)$ a Rademacher or Steinhaus random multiplicative function, we consider the random polynomials $$ P_N(\theta) = \frac1{\sqrt{N}} \sum_{n\leq N} X(n) e(n\theta), $$ and show that the $2k$-th moments on the unit circle $$ \int_0^1 \big| P_N(\theta) \big|^{2k}\, d\theta $$ tend to Gaussian moments in the sense of mean-square convergence, uniformly for $k \ll (\log N / \log \log N)^{1/3}$, but that in contrast to the case of i.i.d. coefficients, this behavior does not persist for $k$ much larger. We use these estimates to (i) give a proof of an almost sure Salem-Zygmund type central limit theorem for $P_N(\theta)$, previously obtained in unpublished work of Harper by different methods, and (ii) show that asymptotically almost surely $$ (\log N)^{1/6 - \varepsilon} \ll \max_\theta |P_N(\theta)| \ll \exp((\log N)^{1/2+\varepsilon}), $$ for all $\varepsilon > 0$.


title: Some identities for the generalized Fibonacci polynomials by the Q(x) matrix

abstract: In this note, we obtain some identities for the generalized Fibonacci polynomial by using the Q(x) matrix. These identities including the Cassini identity and Honsberger formula can be applied to some polynomial sequences, such as Fibonacci polynomials, Lucas polynomials, Pell polynomials, Pell-Lucas polynomials, Fermat polynomials, Fermat-Lucas polynomials, and so on.


title: On clean, weakly clean, and feebly clean commutative group rings

abstract: A ring $R$ is said to be clean if each element of $R$ can be written as the sum of a unit and an idempotent. $R$ is said to be weakly clean if each element of $R$ is either a sum or a difference of a unit and an idempotent, and $R$ is said to be feebly clean if every element $r$ can be written as $r=u+e_1-e_2$, where $u$ is a unit and $e_1,e_2$ are orthogonal idempotents. Clearly clean rings are weakly clean rings and both of them are feebly clean. In a recent article (J. Algebra Appl. 17 (2018), 1850111(5 pages)), McGoven characterized when the group ring $\mathbb Z_{(p)}[C_q]$ is weakly clean and feebly clean, where $p, q$ are distinct primes. In this paper, we consider a more general setting. Let $K$ be an algebraic number field, $\mathcal O_K$ its ring of integers, $\mathfrak p\subset \mathcal O$ a nonzero prime ideal, and $\mathcal O_{\mathfrak p}$ the localization of $\mathcal O$ at $\mathfrak p$. We investigate when the group ring $\mathcal O_{\mathfrak p}[G]$ is weakly clean and feebly clean, where $G$ is a finite abelian group, and establish an explicit characterization for such a group ring to be weakly clean and feebly clean for the case when $K=\mathbb Q(\zeta_n)$ is a cyclotomic field or $K=\mathbb Q(\sqrt{d})$ is a quadratic field.


title: Symmetry criteria for Hochschild extensions

abstract: We give two sufficient and necessary conditions for a Hochschild extension of a finite dimensional algebra by its dual bimodule and a Hochschild 2-cocycle to be a symmetric algebra.


title: Towards Understanding Asynchronous Advantage Actor-critic: Convergence and Linear Speedup

abstract: Asynchronous and parallel implementation of standard reinforcement learning (RL) algorithms is a key enabler of the tremendous success of modern RL. Among many asynchronous RL algorithms, arguably the most popular and effective one is the asynchronous advantage actor-critic (A3C) algorithm. Although A3C is becoming the workhorse of RL, its theoretical properties are still not well-understood, including its non-asymptotic analysis and the performance gain of parallelism (a.k.a. linear speedup). This paper revisits the A3C algorithm and establishes its non-asymptotic convergence guarantees. Under both i.i.d. and Markovian sampling, we establish the local convergence guarantee for A3C in the general policy approximation case and the global convergence guarantee in softmax policy parameterization. Under i.i.d. sampling, A3C obtains sample complexity of $\mathcal{O}(\epsilon^{-2.5}/N)$ per worker to achieve $\epsilon$ accuracy, where $N$ is the number of workers. Compared to the best-known sample complexity of $\mathcal{O}(\epsilon^{-2.5})$ for two-timescale AC, A3C achieves \emph{linear speedup}, which justifies the advantage of parallelism and asynchrony in AC algorithms theoretically for the first time. Numerical tests on synthetic environment, OpenAI Gym environments and Atari games have been provided to verify our theoretical analysis.


title: Dynamics of quantum Fisher information in a squeezed thermal bath

abstract: In this paper, the dynamics of quantum Fisher information of a qubit interacting with a squeezed thermal environment are studied. The optimal initial state of the qubit, the temperature of the environment, and the interaction time, which maximize quantum Fisher information are obtained. Based on the ohmicity of the environment, we compare the dynamics of quantum Fisher information in ohmic, sub-ohmic, and super-ohmic regimes of the environment. Moreover, it is shown that the precise estimation of parameters is robust against squeezing.


title: Effect of axion-like particles on the spectrum of the extragalactic gamma-ray background

abstract: Axion-like particles (ALPs) provide a feasible explanation for the observed lower TeV opacity of the Universe. If the anomaly TeV transparency is caused by ALPs, then the fluxes of distant extragalactic sources will be enhanced at photon energies beyond TeV, resulting in an enhancement of the observed extragalactic gamma-ray background (EGB) spectrum. In this work, we have investigated the ALP modulation on the EGB spectrum at TeV energies. Our results show that in the most optimistic case, the existence of ALPs can cause the EGB spectrum to greatly deviate from the prediction of a pure extragalactic-background-light (EBL) absorption scenario. The deviation occurs at approximately $\gtrsim$1 TeV, and the current EGB measurements by Fermi-LAT cannot identify such an effect. We also find that most of the sensitive ALP parameters have been ruled out by existing constraints, leaving only a small region of unrestricted parameters that can be probed using the EGB effect investigated in this work. Observations from forthcoming very-high-energy instruments like LHAASO and CTA may be beneficial for the study of this effect.


title: On the radius of spatial analyticity for the Klein-Gordon-Schr\"{o}dinger system

abstract: In this paper, we study the persistence of spatial analyticity for the solutions to the Klein-Gordon-Schr\"{o}dinger system, which describes a physical system of a nucleon field interacting with a neutral meson field, with analytic initial data. Unlike the case of a single nonlinear dispersive equation, not much is known about nonlinear dispersive systems as it is harder to show the spatial analyticity of coupled equations simultaneously. The only results known so far are rather recent ones for the Dirac-Klein-Gordon system which governs the physical system when the nucleon is described by Dirac spinor fields in the case of relativistic fields. In contrast, we aim here to study the Klein-Gordon-Schr\"{o}dinger system that works in the non-relativistic regime. It is shown that the radius of spatial analyticity of the solutions at later times obeys an algebraic lower bound as time goes to infinity.


title: Neural Machine Translation: A Review of Methods, Resources, and Tools

abstract: Machine translation (MT) is an important sub-field of natural language processing that aims to translate natural languages using computers. In recent years, end-to-end neural machine translation (NMT) has achieved great success and has become the new mainstream method in practical MT systems. In this article, we first provide a broad review of the methods for NMT and focus on methods relating to architectures, decoding, and data augmentation. Then we summarize the resources and tools that are useful for researchers. Finally, we conclude with a discussion of possible future research directions.


title: AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding

abstract: Advances in English language representation enabled a more sample-efficient pre-training task by Efficiently Learning an Encoder that Classifies Token Replacements Accurately (ELECTRA). Which, instead of training a model to recover masked tokens, it trains a discriminator model to distinguish true input tokens from corrupted tokens that were replaced by a generator network. On the other hand, current Arabic language representation approaches rely only on pretraining via masked language modeling. In this paper, we develop an Arabic language representation model, which we name AraELECTRA. Our model is pretrained using the replaced token detection objective on large Arabic text corpora. We evaluate our model on multiple Arabic NLP tasks, including reading comprehension, sentiment analysis, and named-entity recognition and we show that AraELECTRA outperforms current state-of-the-art Arabic language representation models, given the same pretraining data and with even a smaller model size.


title: Minimization of the sum under product constraints

abstract: We systematically explore a class of constrained optimization problems with linear objective function and constraints that are linear combinations of logarithms of the optimization variables. Such problems can be viewed as a generalization of the inequality between the arithmetic and geometric means. The existence and uniqueness of the minimizer is proved under natural assumptions in the general case. We study in detail special subclasses where the set of constraints is described in combinatorial terms (oriented graphs, rooted trees). In particular, given a directed, strongly connected graph, we seek to minimize the total of all arc values under cyclic product constraints. We obtain some estimates and asymptotics for the minimum in problems with given (large) number of variables. Also in this context we revisit an asymptotical result known as J. Shallit's minimization problem. The material is presented in the form of a problem book. Along with problems that constitute main theoretical threads, there are many exercises, some mini-paradoxes, and a touch of numerical methods.


title: Design Knowledge Representation with Technology Semantic Network

abstract: Engineers often need to discover and learn designs from unfamiliar domains for inspiration or other particular uses. However, the complexity of the technical design descriptions and the unfamiliarity to the domain make it hard for engineers to comprehend the function, behavior, and structure of a design. To help engineers quickly understand a complex technical design description new to them, one approach is to represent it as a network graph of the design-related entities and their relations as an abstract summary of the design. While graph or network visualizations are widely adopted in the engineering design literature, the challenge remains in retrieving the design entities and deriving their relations. In this paper, we propose a network mapping method that is powered by Technology Semantic Network (TechNet). Through a case study, we showcase how TechNet's unique characteristic of being trained on a large technology-related data source advantages itself over common-sense knowledge bases, such as WordNet and ConceptNet, for design knowledge representation.


title: Linear-Quadratic regulators for internal boundary control of lane-free automated vehicle traffic

abstract: Lane-free vehicle movement has been recently proposed for connected automated vehicles (CAV) due to various potential advantages. One such advantage stems from the fact that incremental changes of the road width in lane-free traffic lead to corresponding incremental changes of the traffic flow capacity. Based on this property, the concept of internal boundary control was recently introduced to flexibly share the total road width and capacity among the two traffic directions of a highway in real-time, in response to the prevailing traffic conditions, so as to maximize the cross-road (both directions) infrastructure utilization. Feedback-based Linear-Quadratic regulators with or without Integral action (LQI and LQ regulators) are appropriately developed in this paper to efficiently address the internal boundary control problem. Simulation investigations, involving a realistic highway stretch and different demand scenarios, demonstrate that the proposed simple regulators are robust and similarly efficient as an open-loop nonlinear constrained optimal control solution, while circumventing the need for accurate modelling and external demand prediction


title: AraGPT2: Pre-Trained Transformer for Arabic Language Generation

abstract: Recently, pre-trained transformer-based architectures have proven to be very efficient at language modeling and understanding, given that they are trained on a large enough corpus. Applications in language generation for Arabic are still lagging in comparison to other NLP advances primarily due to the lack of advanced Arabic language generation models. In this paper, we develop the first advanced Arabic language generation model, AraGPT2, trained from scratch on a large Arabic corpus of internet text and news articles. Our largest model, AraGPT2-mega, has 1.46 billion parameters, which makes it the largest Arabic language model available. The Mega model was evaluated and showed success on different tasks including synthetic news generation, and zero-shot question answering. For text generation, our best model achieves a perplexity of 29.8 on held-out Wikipedia articles. A study conducted with human evaluators showed the significant success of AraGPT2-mega in generating news articles that are difficult to distinguish from articles written by humans. We thus develop and release an automatic discriminator model with a 98% percent accuracy in detecting model-generated text. The models are also publicly available, hoping to encourage new research directions and applications for Arabic NLP.


title: Holographic model of exciton condensation in double monolayer Dirac semimetal

abstract: In this paper we consider holographic model of exciton condensation in double monolayer Dirac semimetal. Excitons is a bound states of an electron and a hole. Being Bose particles, excitons can form a Bose-Einstein condensate. We study formation of two types of condensates. In first case both the electron and the hole forming the exciton are in the same layer (intralayer condensate), in the second case the electron and the hole are in different layers (interlayer condensate). We study how the condensates depend on the distance between layers and the mass of the quasiparticles in presence of a strong magnetic field. In order to take into account possible strong Coulomb interaction between electrons we use holographic appoach. The holographic model consists of two $D5$ branes embedded into anti de Sitter space. The condensates are described by geometric configuration of the branes. We show that the distance between layers at which interlayer condensate disappears decreases with quasiparticle mass.


title: Automatic Historical Feature Generation through Tree-based Method in Ads Prediction

abstract: Historical features are important in ads click-through rate (CTR) prediction, because they account for past engagements between users and ads. In this paper, we study how to efficiently construct historical features through counting features. The key challenge of such problem lies in how to automatically identify counting keys. We propose a tree-based method for counting key selection. The intuition is that a decision tree naturally provides various combinations of features, which could be used as counting key candidate. In order to select personalized counting features, we train one decision tree model per user, and the counting keys are selected across different users with a frequency-based importance measure. To validate the effectiveness of proposed solution, we conduct large scale experiments on Twitter video advertising data. In both online learning and offline training settings, the automatically identified counting features outperform the manually curated counting features.


title: Creating Localized Majorana Zero Modes in Quantum Anomalous Hall Insulator/Superconductor Heterostructures with a Scissor

abstract: In this work, we demonstrate that making a cut (a narrow vacuum regime) in the bulk of a quantum anomalous Hall insulator (QAHI) creates a topologically protected single helical channel with counter-propagating electron modes, and inducing superconductivity on the helical channel through proximity effect will create Majorana zero energy modes (MZMs) at the ends of the cut. In this geometry, there is no need for the proximity gap to overcome the bulk insulating gap of the QAHI to create MZMs as in the two-dimensional QAHI/superconductor (QAHI/SC) heterostructures. Therefore, the topological regime with MZMs is greatly enlarged. Furthermore, due to the presence of a single helical channel, the generation of low energy in-gap bound states caused by multiple conducting channels is avoided such that the MZMs can be well separated from other in-gap excitations in energy. This simple but practical approach allows the creation of a large number of MZMs in devices with complicated geometry such as hexons for measurement-based topological quantum computation. We further demonstrate how braiding of MZMs can be performed by controlling the coupling strength between the counter-propagating electron modes.


title: Fast WordPiece Tokenization

abstract: Tokenization is a fundamental preprocessing step for almost all NLP tasks. In this paper, we propose efficient algorithms for the WordPiece tokenization used in BERT, from single-word tokenization to general text (e.g., sentence) tokenization. When tokenizing a single word, WordPiece uses a longest-match-first strategy, known as maximum matching. The best known algorithms so far are O(n^2) (where n is the input length) or O(nm) (where m is the maximum vocabulary token length). We propose a novel algorithm whose tokenization complexity is strictly O(n). Our method is inspired by the Aho-Corasick algorithm. We introduce additional linkages on top of the trie built from the vocabulary, allowing smart transitions when the trie matching cannot continue. For general text, we further propose an algorithm that combines pre-tokenization (splitting the text into words) and our linear-time WordPiece method into a single pass. Experimental results show that our method is 8.2x faster than HuggingFace Tokenizers and 5.1x faster than TensorFlow Text on average for general text tokenization.


title: BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining

abstract: In this paper, we propose BANG, a new pretraining model to Bridge the gap between Autoregressive (AR) and Non-autoregressive (NAR) Generation. AR and NAR generation can be uniformly regarded as to what extent previous tokens can be attended, and BANG bridges AR and NAR generation by designing a novel model structure for large-scale pretraining. The pretrained BANG model can simultaneously support AR, NAR and semi-NAR generation to meet different requirements. Experiments on question generation (SQuAD 1.1), summarization (XSum) and dialogue generation (PersonaChat) show that BANG improves NAR and semi-NAR performance significantly as well as attaining comparable performance with strong AR pretrained models. Compared with the semi-NAR strong baselines, BANG achieves absolute improvements of 14.01 and 5.24 in the overall scores of SQuAD 1.1 and XSum, respectively. In addition, BANG achieves absolute improvements of 10.73, 6.39 and 5.90 in the overall scores of SQuAD, XSUM and PersonaChat respectively compared with the strong NAR baselines.


title: Asymptotics of sums of regression residuals under multiple ordering of regressors

abstract: We prove theorems about the Gaussian asymptotics of an empirical bridge built from linear model regressors with multiple regressor ordering. We study the testing of the hypothesis of a linear model for the components of a random vector: one of the components is a linear combination of the others up to an error that does not depend on the other components of the random vector. The results of observations of independent copies of a random vector are sequentially ordered in ascending order of several of its components. The result is a sequence of vectors of higher dimension, consisting of induced order statistics (concomitants) corresponding to different orderings. For this sequence of vectors, without the assumption of a linear model for the components, we prove a lemma of weak convergence of the distributions of an appropriately centered and normalized process to a centered Gaussian process with almost surely continuous trajectories. Assuming a linear relationship of the components, standard least squares estimates are used to compute regression residuals -- the differences between response values and the predicted ones by the linear model. We prove a theorem of weak convergence of the process of regression residuals under the necessary normalization to a centered Gaussian process.


title: An Optimal Mass Transport Method for Random Genetic Drift

abstract: We propose and analyze an optimal mass transport method for a random genetic drift problem driven by a Moran process under weak-selection. The continuum limit, formulated as a reaction-advection-diffusion equation known as the Kimura equation, inherits degenerate diffusion from the discrete stochastic process that conveys to the blow-up into Dirac-delta singularities hence brings great challenges to both the analytical and numerical studies. The proposed numerical method can quantitatively capture to the fullest possible extent the development of Dirac-delta singularities for genetic segregation on one hand, and preserves several sets of biologically relevant and computationally favored properties of the random genetic drift on the other. Moreover, the numerical scheme exponentially converges to the unique numerical stationary state in time at a rate independent of the mesh size up to a mesh error. Numerical evidence is given to illustrate and support these properties, and to demonstrate the spatio-temporal dynamics of random generic drift.


title: Almost blenders and parablenders

abstract: A blender for a surface endomorphism is a hyperbolic basic set for which the union of the local unstable manifolds contains robustly an open set. Introduced by Bonatti and D{\'i}az in the 90s, blenders turned out to have many powerful applications to differentiable dynamics. In particular, a generalization in terms of jets, called parablenders, allowed Berger to prove the existence of generic families displaying robustly infinitely many sinks. In this paper, we introduce analogous notions in a measurable point of view. We define an almost blender as a hyperbolic basic set for which a prevalent perturbation has a local unstable set having positive Lebesgue measure. Almost parablenders are defined similarly in terms of jets. We study families of endomorphisms of R2 leaving invariant the continuation of a hyperbolic basic set. When some inequality involving the entropy and the maximal contraction along stable manifolds is satisfied, we obtain an almost blender or parablender. This answers partially a conjecture of Berger. The proof is based on thermodynamic formalism: following works of Mihailescu, Simon, Solomyak and Urba{\'n}ski, we study families of fiberwise unipotent skew-products and we give conditions under which these maps have limit sets of positive measure inside their fibers.


title: Generalizations of parabolic Higgs bundles, real structures and integrability

abstract: We introduce a notion of quasi-antisymmetric Higgs $G$-bundles over curves with marked points. They are endowed with additional structures, which replace the parabolic structures at marked points in the parabolic Higgs bundles. The latter means that the coadjoint orbits are attached to the marked points. The moduli spaces of parabolic Higgs bundles are the phase spaces of complex completely integrable systems. In our case the coadjoint orbits are replaced by the cotangent bundles over some special symmetric spaces in such a way that the moduli space of the modified Higgs bundles are still phase spaces of complex completely integrable systems. We show that the moduli space of the parabolic Higgs bundles is the symplectic quotient of the moduli space of the quasi-antisymmetric Higgs bundle with respect to the action of product of Cartan subgroups. Also, by changing the symmetric spaces we introduce quasi-compact and quasi-normal Higgs bundles. Then the fixed point sets of real involutions acting on their moduli spaces are the phase spaces of real completely integrable systems. Several examples are given including integrable extensions of the ${\rm SL}(2)$ Euler-Arnold top, two-body elliptic Calogero-Moser system and the rational ${\rm SL}(2)$ Gaudin system together with its real reductions.


title: Area minimizing surfaces in homotopy classes in metric spaces

abstract: We introduce and study a notion of relative 1-homotopy type for Sobolev maps from a surface to a metric space spanning a given collection of Jordan curves. We use this to establish the existence and local H\"older regularity of area minimizing surfaces in a given relative 1-homotopy class in proper geodesic metric spaces admitting a local quadratic isoperimetric inequality. If the underlying space has trivial second homotopy group then relatively 1-homotopic maps are relatively homotopic. We also obtain an analog for closed surfaces in a given 1-homotopy class. Our theorems generalize and strengthen results of Lemaire, Jost, Schoen-Yau, and Sacks-Uhlenbeck.


title: Colonoscopy Polyp Detection: Domain Adaptation From Medical Report Images to Real-time Videos

abstract: Automatic colorectal polyp detection in colonoscopy video is a fundamental task, which has received a lot of attention. Manually annotating polyp region in a large scale video dataset is time-consuming and expensive, which limits the development of deep learning techniques. A compromise is to train the target model by using labeled images and infer on colonoscopy videos. However, there are several issues between the image-based training and video-based inference, including domain differences, lack of positive samples, and temporal smoothness. To address these issues, we propose an Image-video-joint polyp detection network (Ivy-Net) to address the domain gap between colonoscopy images from historical medical reports and real-time videos. In our Ivy-Net, a modified mixup is utilized to generate training data by combining the positive images and negative video frames at the pixel level, which could learn the domain adaptive representations and augment the positive samples. Simultaneously, a temporal coherence regularization (TCR) is proposed to introduce the smooth constraint on feature-level in adjacent frames and improve polyp detection by unlabeled colonoscopy videos. For evaluation, a new large colonoscopy polyp dataset is collected, which contains 3056 images from historical medical reports of 889 positive patients and 7.5-hour videos of 69 patients (28 positive). The experiments on the collected dataset demonstrate that our Ivy-Net achieves the state-of-the-art result on colonoscopy video.


title: Understanding Teachers' Professional Development Through their Interactions with Resources: a Multilingual Project

abstract: The Documentational Approach To Didactics (DAD) aims to study teachers' professional development through their interactions with their resources for/from teaching. It has been introduced in the French community of didactics of mathematics in 2007, then extended at an international level. It has been introduced as an entry in the Encyclopedia of Mathematics Education in 2020. The DAD-Multilingual project (2020-2021) is dedicated to gather and confront the translations of this entry towards 14 languages. The project main goals are: making available -- for students as well as for researchers - a presentation of DAD in various languages; deepening the DAD concepts themselves in thinking their possible instantiations in different languages; questioning the translation processes; and questioning the notion of resource itself, resource for/from teaching. The lecture presents this project, and draws some lessons from its first steps.


title: Optimal Software Architecture From Initial Requirements: An End-to-End Approach

abstract: A software architect turns system requirements into a suitable software architecture through an architecture optimization process. However, how should the architect decide which quality improvement to prioritize, e.g., security or reliability? In software product line, should a small improvement in multiple products be preferred over a large improvement in a single product? Existing architecture optimization methods handle various steps in the process, but none of them systematically guides the architect in generating an optimal architecture from the initial requirements. In this work we present an end-to-end approach for generating an optimal software architecture for a single software product and an optimal family of architectures for a family of products. We report on a case-study of applying our approach to optimize five industry-grade products in a real-life product line architecture, where 359 possible combinations of ten different quality efforts were prioritized.


title: HopRetriever: Retrieve Hops over Wikipedia to Answer Complex Questions

abstract: Collecting supporting evidence from large corpora of text (e.g., Wikipedia) is of great challenge for open-domain Question Answering (QA). Especially, for multi-hop open-domain QA, scattered evidence pieces are required to be gathered together to support the answer extraction. In this paper, we propose a new retrieval target, hop, to collect the hidden reasoning evidence from Wikipedia for complex question answering. Specifically, the hop in this paper is defined as the combination of a hyperlink and the corresponding outbound link document. The hyperlink is encoded as the mention embedding which models the structured knowledge of how the outbound link entity is mentioned in the textual context, and the corresponding outbound link document is encoded as the document embedding representing the unstructured knowledge within it. Accordingly, we build HopRetriever which retrieves hops over Wikipedia to answer complex questions. Experiments on the HotpotQA dataset demonstrate that HopRetriever outperforms previously published evidence retrieval methods by large margins. Moreover, our approach also yields quantifiable interpretations of the evidence collection process.


title: Interplay between chiral dynamics and repulsive interactions

abstract: We investigate fluctuations of the net-baryon number density in hot hadronic matter. We discuss the interplay between chiral dynamics and repulsive interactions and their influence on the properties of these fluctuations near the chiral crossover. The chiral dynamics is modeled by the parity doublet Lagrangian that incorporates the attractive and repulsive interactions mediated via the exchange of scalar and vector mesons, respectively. The mean-field approximation is employed to account for chiral criticality. We focus on the properties and systematics of the cumulants of the net-baryon number density up to the sixth order. It is shown that the higher-order cumulants exhibit a substantial suppression in the vicinity of the chiral phase transition due to the presence of repulsive interactions. We find, however, that the characteristic properties of cumulants near the chiral crossover observed in lattice QCD results are entirely linked to the critical chiral dynamics and, in general, cannot be reproduced in phenomenological models, which account only for effective repulsive interactions via excluded-volume corrections or van-der-Waals type interactions. Consequently, a description of the higher-order cumulants of the net-baryon density in the chiral crossover requires a self-consistent treatment of the chiral in-medium effects and repulsive interactions.


title: Rydberg atom-ion collisions in cold environments

abstract: Low-energy collisions of Rydberg atom-ion systems are investigated theoretically. We present the parameter space associated with suitable approaches for the dynamics of Rydberg atom-ion collisions, i.e. quantum-, Langevin and classical exchange regimes, showing that for the lowest reachable temperatures a classical treatment is appropriate. A quasi-classical trajectory method is used to study charge exchange cross sections for Li$^*$-Li$^+$ and Li$^*$-Cs$^+$ at collision energies down to $1\,$K. For cold collisions we find the charge exchange cross section deviating from the $n^4$ geometric scaling. Furthermore, for low-energy collisions, we find both an influence of the ionic core-repulsion as well as variations for two different models used for describing the electron-core potential.


title: xERTE: Explainable Reasoning on Temporal Knowledge Graphs for Forecasting Future Links

abstract: Modeling time-evolving knowledge graphs (KGs) has recently gained increasing interest. Here, graph representation learning has become the dominant paradigm for link prediction on temporal KGs. However, the embedding-based approaches largely operate in a black-box fashion, lacking the ability to interpret their predictions. This paper provides a link forecasting framework that reasons over query-relevant subgraphs of temporal KGs and jointly models the structural dependencies and the temporal dynamics. Especially, we propose a temporal relational attention mechanism and a novel reverse representation update scheme to guide the extraction of an enclosing subgraph around the query. The subgraph is expanded by an iterative sampling of temporal neighbors and by attention propagation. Our approach provides human-understandable evidence explaining the forecast. We evaluate our model on four benchmark temporal knowledge graphs for the link forecasting task. While being more explainable, our model obtains a relative improvement of up to 20% on Hits@1 compared to the previous best KG forecasting method. We also conduct a survey with 53 respondents, and the results show that the evidence extracted by the model for link forecasting is aligned with human understanding.


title: Parity-time-symmetric vector rational rogue wave solutions in any n-component nonlinear Schr\"odinger models

abstract: The extreme events are investigated for an $n$-component nonlinear Schr\"odinger ($n$-NLS) system in the focusing Kerr-like nonlinear media, which appears in many physical fields. We report and discuss the novel multi-parametric families of vector rational rogue wave (RW) solutions featuring the parity-time (PT) symmetry, which are characterized by non-identical boundary conditions for the components, and consistent with the degeneracy of $n$ branches of Benjamin-Feir instability. Explicit examples of PT-symmetric vector RWs are presented. Some parameter constraints can make some components generate the RWs with high amplitudes due to many-body resonant interactions.Effect of a non-integrable deformation of the model on the excitation of vector RWs is also discussed. These results will be useful to design the RW experiments in multi-component physical systems.

categories: nlin.SI math-ph math.AP math.MP nlin.PS physics.optics


title: On algebraic integers which are 2-Salem elements in positive characteristic

abstract: Bateman and Duquette have initiated the study of Salem elements in positive characteristic. This work extends their results to 2-Salem elements whose minimal polynomials are of the type $Y^n + \lambda_{n-1}Y^{n-1} + \ldots+\lambda_1Y + \lambda_0 \in \mathbb{F}_q[X][Y ]$ where $n \geq2, \lambda_0\neq 0$ and $\deg \lambda_{n-1} < \deg \lambda_{n-2} = \max_{i\neq n-2}\deg(\lambda_i)$. This work provides an analogue of their results for 2-Salem elements whose minimal polynomials meet certain requirements.


title: On the Origins of Tension--Compression Asymmetry in Crystals and Implications for Cyclic Behavior

abstract: Most of crystalline materials exhibit a hysteresis on their deformation curve when mechanically loaded in alternating directions. This Bauschinger effect is the signature of mechanisms existing at the atomic scale and controlling the materials damage and ultimately their failure. Here, three-dimensional simulations of dislocation dynamics and statistical analyses of the microstructure evolution reveal two original elementary mechanisms. An asymmetry in the dislocation network junctions arising from the stress driven curvatures and the partial reversibility of plastic avalanches give an explanation to the traction-compression asymmetry observed in FCC single-crystals. These mechanisms are then connected in a physically justified way to larger-scale representations using a dislocation density based theory. Parameter-free predictions of the Bauschinger effect and strain hardening during cyclic deformation in different materials and over a range of loading directions and different plastic strain amplitudes are found to be in excellent agreement with experiments. This work brings invaluable mechanistic insights for the interpretation of experiments and for the design of structural components to consolidate their service life under cyclic load.


title: Life insurance policies with cash flows subject to random interest rate changes

abstract: The main purpose of this work is to derive a partial differential equation for the reserves of life insurance liabilities subject to stochastic interest rates where the benefits and premiums depend directly on changes in the interest rate curve. In particular, we allow the payment streams to depend on the performance of an overnight technical interest rate, making them stochastic as well. This opens up for considering new types of contracts based on the performance of the insurer's returns on their own investments. We provide explicit solutions for the reserves when the premiums and benefits vary according to interest rate levels or averages under the Vasicek model and conduct some simulations computing reserve surfaces numerically. We also give an example of a reinsurance treaty taking over pension payments when the insurer's average returns fall under some specified threshold.


title: Dynamics of weighted shifts on directed trees

abstract: We study the dynamical behaviour of weighted shifts defined on sequence spaces of a directed tree. In particular, we characterize their boundedness as well as when they are hypercyclic, weakly mixing and mixing.


title: Discovering Dialog Structure Graph for Open-Domain Dialog Generation

abstract: Learning interpretable dialog structure from human-human dialogs yields basic insights into the structure of conversation, and also provides background knowledge to facilitate dialog generation. In this paper, we conduct unsupervised discovery of dialog structure from chitchat corpora, and then leverage it to facilitate dialog generation in downstream systems. To this end, we present a Discrete Variational Auto-Encoder with Graph Neural Network (DVAE-GNN), to discover a unified human-readable dialog structure. The structure is a two-layer directed graph that contains session-level semantics in the upper-layer vertices, utterance-level semantics in the lower-layer vertices, and edges among these semantic vertices. In particular, we integrate GNN into DVAE to fine-tune utterance-level semantics for more effective recognition of session-level semantic vertex. Furthermore, to alleviate the difficulty of discovering a large number of utterance-level semantics, we design a coupling mechanism that binds each utterance-level semantic vertex with a distinct phrase to provide prior semantics. Experimental results on two benchmark corpora confirm that DVAE-GNN can discover meaningful dialog structure, and the use of dialog structure graph as background knowledge can facilitate a graph grounded conversational system to conduct coherent multi-turn dialog generation.


title: Deep Graph Generators: A Survey

abstract: Deep generative models have achieved great success in areas such as image, speech, and natural language processing in the past few years. Thanks to the advances in graph-based deep learning, and in particular graph representation learning, deep graph generation methods have recently emerged with new applications ranging from discovering novel molecular structures to modeling social networks. This paper conducts a comprehensive survey on deep learning-based graph generation approaches and classifies them into five broad categories, namely, autoregressive, autoencoder-based, RL-based, adversarial, and flow-based graph generators, providing the readers a detailed description of the methods in each class. We also present publicly available source codes, commonly used datasets, and the most widely utilized evaluation metrics. Finally, we highlight the existing challenges and discuss future research directions.


title: Vehicular Network Slicing for Reliable Access and Deadline-Constrained Data Offloading: A Multi-Agent On-Device Learning Approach

abstract: Efficient data offloading plays a pivotal role in computational-intensive platforms as data rate over wireless channels is fundamentally limited. On top of that, high mobility adds an extra burden in vehicular edge networks (VENs), bolstering the desire for efficient user-centric solutions. Therefore, unlike the legacy inflexible network-centric approach, this paper exploits a software-defined flexible, open, and programmable networking platform for an efficient user-centric, fast, reliable, and deadline-constrained offloading solution in VENs. In the proposed model, each active vehicle user (VU) is served from multiple low-powered access points (APs) by creating a noble virtual cell (VC). A joint node association, power allocation, and distributed resource allocation problem is formulated. As centralized learning is not practical in many real-world problems, following the distributed nature of autonomous VUs, each VU is considered an edge learning agent. To that end, considering practical location-aware node associations, a joint radio and power resource allocation non-cooperative stochastic game is formulated. Leveraging reinforcement learning's (RL) efficacy, a multi-agent RL (MARL) solution is proposed where the edge learners aim to learn the Nash equilibrium (NE) strategies to solve the game efficiently. Besides, real-world map data, with a practical microscopic mobility model, are used for the simulation. Results suggest that the proposed user-centric approach can deliver remarkable performances in VENs. Moreover, the proposed MARL solution delivers near-optimal performances with approximately 3% collision probabilities in case of distributed random access in the uplink.


title: Signatures of the finite-temperature mirror symmetry breaking in the $S$=1/2 Shastry-Sutherland model

abstract: We investigate the finite-temperature properties of the $S$=1/2 Shastry-Sutherland Heisenberg model using a quantum typicality method. In the intermediate plaquette state region, we naturally expect to realize the finite-temperature phase transition associated with breaking the mirror symmetry of this model. We reveal some signatures of the spontaneous phase transition within a two-point correlation level at moderate temperatures since the constructed typical state can sense the existence of the degenerated excited states depending on the initial random state. We also confirm that the local mirror order parameter shows the intriguing recovering phenomenon of the mirror symmetry in very low-temperatures, which could be understood from the nature of the ground and excited states of the finite-size systems. We expect that this recovering feature disappears; instead, a saturated behavior appears in the local mirror order parameter in the thermodynamic limit. We discuss the relationship to the recent experimental results on ${\rm SrCu_2(BO_3)_2}$ under high pressures.


title: XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders

abstract: Multilingual machine translation enables a single model to translate between different languages. Most existing multilingual machine translation systems adopt a randomly initialized Transformer backbone. In this work, inspired by the recent success of language model pre-training, we present XLM-T, which initializes the model with an off-the-shelf pretrained cross-lingual Transformer encoder and fine-tunes it with multilingual parallel data. This simple method achieves significant improvements on a WMT dataset with 10 language pairs and the OPUS-100 corpus with 94 pairs. Surprisingly, the method is also effective even upon the strong baseline with back-translation. Moreover, extensive analysis of XLM-T on unsupervised syntactic parsing, word alignment, and multilingual classification explains its effectiveness for machine translation. The code will be at https://aka.ms/xlm-t.


title: Autonomous Maintenance in IoT Networks via AoI-driven Deep Reinforcement Learning

abstract: Internet of Things (IoT) with its growing number of deployed devices and applications raises significant challenges for network maintenance procedures. In this work, we formulate a problem of autonomous maintenance in IoT networks as a Partially Observable Markov Decision Process. Subsequently, we utilize Deep Reinforcement Learning algorithms (DRL) to train agents that decide if a maintenance procedure is in order or not and, in the former case, the proper type of maintenance needed. To avoid wasting the scarce resources of IoT networks we utilize the Age of Information (AoI) metric as a reward signal for the training of the smart agents. AoI captures the freshness of the sensory data which are transmitted by the IoT sensors as part of their normal service provision. Numerical results indicate that AoI integrates enough information about the past and present states of the system to be successfully used in the training of smart agents for the autonomous maintenance of the network.


title: Coexistence of superconductivity and spin-splitting fields in superconductor/ferromagnetic insulator bilayers of arbitrary thickness

abstract: Ferromagnetic insulators can induce a strong exchange field in an adjacent superconductor via the magnetic proximity effect. This manifests as spin-splitting of the BCS density of states of the superconductor, an important ingredient for numerous superconducting spintronics applications and the realization of Majorana fermions. A crucial parameter that determines the magnitude of the induced spin-splitting in FI/S bilayers is the thickness of the S layer $d$: In very thin samples, the superconductivity is suppressed by the strong magnetism. By contrast, in very thick samples, the spin splitting is absent at distances away from the interface. In this work, we calculate the density of states and critical field of FI/S bilayers of arbitrary thickness. From here, we determine the range of parameters of interest for applications, where the exchange field and superconductivity coexist. We compare our theory with the tunneling spectroscopy measurements in several EuS/Al/AlO$_x$/Al samples. If the Al film in contact with the EuS is thinner than a certain critical value, we do not observe superconductivity, whereas, in thicker samples, we find evidence of a first-order phase transition induced by an external field. The complete transition is preceded by a regime in which normal and superconducting regions coexist. We attribute this mixed phase to inhomogeneities of the Al film thickness and the presence of superparamagnetic grains at the EuS/Al interface with different switching fields. Our results demonstrate on the one hand, the important role of the S layer thickness, which is particularly relevant for the fabrication of high-quality samples suitable for applications. On the other hand, the agreement between theory and experiment demonstrates the accuracy of our theory, which, originally developed for homogeneous situations, is generalized to highly inhomogeneous systems.


title: Nonreversible MCMC from conditional invertible transforms: a complete recipe with convergence guarantees

abstract: Markov Chain Monte Carlo (MCMC) is a class of algorithms to sample complex and high-dimensional probability distributions. The Metropolis-Hastings (MH) algorithm, the workhorse of MCMC, provides a simple recipe to construct reversible Markov kernels. Reversibility is a tractable property that implies a less tractable but essential property here, invariance. Reversibility is however not necessarily desirable when considering performance. This has prompted recent interest in designing kernels breaking this property. At the same time, an active stream of research has focused on the design of novel versions of the MH kernel, some nonreversible, relying on the use of complex invertible deterministic transforms. While standard implementations of the MH kernel are well understood, the aforementioned developments have not received the same systematic treatment to ensure their validity. This paper fills the gap by developing general tools to ensure that a class of nonreversible Markov kernels, possibly relying on complex transforms, has the desired invariance property and leads to convergent algorithms. This leads to a set of simple and practically verifiable conditions.


title: Feynman-Kac formula for perturbations of order $\leq 1$ and noncommutative geometry

abstract: Let $Q$ be a differential operator of order $\leq 1$ on a complex metric vector bundle $\mathscr{E}\to \mathscr{M}$ with metric connection $\nabla$ over a possibly noncompact Riemannian manifold $\mathscr{M}$. Under very mild regularity assumptions on $Q$ that guarantee that $\nabla^{\dagger}\nabla/2+Q$ generates a holomorphic semigroup $\mathrm{e}^{-zH^{\nabla}_{Q}}$ in $\Gamma_{L^2}(\mathscr{M},\mathscr{E})$ (where $z$ runs through a complex sector which contains $[0,\infty)$), we prove an explicit Feynman-Kac type formula for $\mathrm{e}^{-tH^{\nabla}_{Q}}$, $t>0$, generalizing the standard self-adjoint theory where $Q$ is a self-adjoint zeroth order operator. For compact $\mathscr{M}$'s we combine this formula with Berezin integration to derive a Feynman-Kac type formula for an operator trace of the form $$ \mathrm{Tr}\left(\widetilde{V}\int^t_0\mathrm{e}^{-sH^{\nabla}_{V}}P\mathrm{e}^{-(t-s)H^{\nabla}_{V}}\mathrm{d} s\right), $$ where $V,\widetilde{V}$ are of zeroth order and $P$ is of order $\leq 1$. These formulae are then used to obtain a probabilistic representations of the lower order terms of the equivariant Chern character (a differential graded extension of the JLO-cocycle) of a compact even-dimensional Riemannian spin manifold, which in combination with cyclic homology play a crucial role in the context of the Duistermaat-Heckmann localization formula on the loop space of such a manifold.


title: Cooling under applied stress rejuvenates amorphous alloys and enhances their ductility

abstract: The effect of tensile stress applied during cooling of binary glasses on the potential energy states and mechanical properties is investigated using molecular dynamics simulations. We study the three-dimensional binary mixture that was first annealed near the glass transition temperature and then rapidly cooled under tension into the glass phase. It is found that at larger values of the applied stress, the liquid glass former freezes under higher strain and its potential energy is enhanced. For a fixed cooling rate, the maximum tensile stress that can be applied during cooling is reduced upon increasing initial temperature above the glass transition point. We also show that the amorphous structure of rejuvenated glasses is characterized by an increase in the number of contacts between smaller type atoms. Furthermore, the results of tensile tests demonstrate that the elastic modulus and the peak value of the stress overshoot are reduced in glasses prepared at larger applied stresses and higher initial temperatures, thus indicating enhanced ductility. These findings might be useful for the development of processing and fabrication methods to improve plasticity of bulk metallic glasses.


title: Bibliometric analysis of world scientific production in Chemical Engineering during 2000-2011. Part 1: Analysis of total scientific production

abstract: A comprehensive bibliometric analysis of Chemical Engineering area has been carried out through the analysis of the scientific production covered in Web of Science during the period 2000-2011. Three complementary studies have been carried out. Part 1 analyzes total scientific production in the area. An important displacement of the scientific production to the Far East has occurred, mainly by the increase in publications from China (the world most productive country since 2008) but also from countries such as India and Iran. Although the share of publications from Europe, and especially from North America, have been decreased significantly, United States is still the country with the highest number of articles among the 1,000 most cited (31.5%), followed by Germany (8.4%) and China (7.5%). Switzerland, Italy, Netherlands, Singapore and Spain outstands as the countries with the highest number of cites per article and year and average impact factors of their publications. The international collaboration in the area is considerably high, especially within European countries (>40% publications are in international collaboration). The scientific production of the area is concentrated in a few journals (top 10 journals publishing around 30% publications and top 25 journals, around 50%) and publishers (Elsevier, Wiley-Blackwell, Taylor & Francis and the American Chemical Society). The countries with the highest number of institutions among the top 100 most productive are China and United States (12 each), followed by France (9), Japan (7) and United Kingdom (7). The top five institutions were from France, China, India, United States and Russia.


title: Study of charmonium-like and fully-charm tetraquark spectroscopy

abstract: The masses of tetraquark states of all $qc\bar q \bar c$ and $cc\bar c \bar c$ quark configurations are evaluated in a constituent quark model, where the Cornell-like potential and one-gluon exchange spin-spin coupling are employed. All model parameters are predetermined by comparing the theoretical and experimental masses of light, charmed and bottom mesons. The theoretical predictions of the charmoniumlike tetraquarks are compared with the observed $XYZ$ states, and one tentative assignment is suggested. The work suggests that the $X(6900)$ observed by LHCb is likely to be the first radial excited fully-charm tetraquark state with $J^{PC} = 1^{+-}$ in the $\bar 3_c \otimes 3_c$ configuration, and the ground and second radial excited states of fully-charm tetraquark are around $6494$ and $7253$ MeV respectively.


title: Evolution of Subsurface Zonal and Meridional Flows in Solar Cycle 24 from Helioseismological Data

abstract: The results of determinations of the azimuthal and meridional velocities by time-distance helioseismology from Helioseismic and Magnetic Imager (HMI) onboard Solar Dynamics Observatory (SDO) from May 2010 to September 2020 at latitudes from -60{\deg} to +60{\deg} and depths to about 19 Mm below the photosphere are used to analyze spatiotemporal variations of the solar differential rotation and meridional circulation. The pattern of torsional oscillations, or latitudinal belts of alternating `fast' and `slow' zonal flows migrating from high latitudes towards the equator, is found to extend in the time--latitude diagrams over the whole time interval. The oscillation period is comparable with a doubled solar-activity-cycle and can be described as an extended solar cycle. The zonal-velocity variations are related to the solar-activity level, the local-velocity increases corresponding to the sunspot-number increases and being localized at latitudes where the strongest magnetic fields are recorded. The dramatic growth of the zonal velocities in 2018 appears to be a precursor of the beginning of activity Cycle 25. The strong symmetrization of the zonal-velocity field by 2020 can be considered another precursor. The general pattern of poleward meridional flows is modulated by latitudinal variations that are similar to the extended-solar-cycle behavior of the zonal flows. During the activity maximum, these variations are superposed with a higher harmonic corresponding to meridional flows converging to the spot-formation latitudes. Our results indicate that variations of both the zonal and meridional flows exhibit the extended solar-cycle behavior, which is an intrinsic feature of the solar dynamo.


title: Bibliometric analysis of the world scientific production in Chemical Engineering during 2000-2011. Part 2: Analysis of the 1,000 most cited publications

abstract: A comprehensive bibliometric analysis of the scientific production of Chemical Engineering area has been carried out using the Web of Science database for the period 2000-2011 through three complementary studies. Part 2 demonstrated a displacement of the most cited publications to the Far East, especially due to China, however, this displacement is less important to that observed for total scientific production (Part 1). United States is still the country with the highest number of articles among the 1,000 most cited (31.5%), largely above what expected from their number of publications, followed by Germany (8.4%) and China (7.5%). The international collaboration, at least globally, seems not being an important issue for producing highly cited papers. In fact, only two from the top 25 most cited papers were international collaborations (8%). Furthermore, a large share of reviews among the 1,000 most cited papers (65%) has been observed. Although the number of institutions with more publications among the most cited in the area are from United States, the two institutions with the highest cited papers are CNRS (France) and CSIC (Spain). The most cited papers are highly concentrated in a few journals: around half of the most cited papers were published in five journals. Generally, the most cited papers are published in journals with high impact factors, however, there is also a significant number of highly cited papers published in journals with low or not having impact factor.


title: Phase diagram of the repulsive Blume-Emery-Griffiths model in the presence of external magnetic field on a complete graph

abstract: For the repulsive Blume-Emery-Griffiths model the phase diagram in the space of three fields, temperature (T), crystal field ($\Delta$), and magnetic field (H), is computed on a complete graph, in the canonical and microcanonical ensembles. For weak strength of the biquadratic interaction (K), there exists a tricritical point in the phase diagram where three critical lines meet. As K decreases below a threshold value(which is ensemble dependent), new multicritical points like the critical end point and bicritical end point arise in the (T,$\Delta$) plane. For K>-1, we observe that the two critical lines in the H plane and the multicritical points are different in the two ensembles. At K=-1, the two critical lines in the H plane disappear and as K decreases further, there is no phase transition in the H plane. Exactly at K=-1 the two ensembles become equivalent. Beyond that for all K<-1, there are no multicritical points and there is no ensemble inequivalence in the phase diagram. We also study the transition lines in the H plane for positive K i.e. for attractive biquadratic interaction. We find that the transition lines in the H plane are not monotonic in temperature for large positive K.


title: Bibliometric analysis of the world scientific production in Chemical Engineering during 2000-2011. Part 3: Analysis of research trends and hot topics

abstract: A comprehensive bibliometric analysis of the scientific production of Chemical Engineering area has been carried out using the Web of Science database for the period 2000-2011 through three complementary studies. Part 3 has analyzed the distribution of words in article titles, keyword plus and author keywords of both total scientific production and the 1,000 most cited publications. The main areas of Chemical Engineering have been identified; they are mainly related to chemical reaction engineering such as catalysis, reactors, kinetics, and unit operations such as adsorption. Furthermore, a total of ten hotspots in the area have been identified: hydrogen as a new energy vector, wastewater treatments, carbon dioxide (capture and sequestration), photocatalysis, nanoparticles, biodiesel, nanotubes, ionic liquids, advanced oxidation processes, membranes, fuel cells and the use of biomass as raw material (e.g. bioethanol, energy production, etc.). Results obtained suggest thematic areas and research trends can be easier analyzed through the most cited publications, decreasing significantly the time necessary for these analyses. Words in article title, keyword plus and author keywords are complementary, however, author keywords are suggested as the source of most useful data. Compared to other strategies, the author keywords are more valuable for identifying research areas and trends, and the total number of words to be analyzed is lower. Whatever the case, authors recommend a revision of the results obtained by experts in the area to avoid inaccurate results and get the most meaningful information.


title: Families of Legendrians and Lagrangians with unbounded spectral norm

abstract: Viterbo has conjectured that any Lagrangian in the unit co-disc bundle of a torus which is Hamiltonian isotopic to the zero-section satisfies a uniform bound on its spectral norm; a recent result by Shelukhin showed that this is indeed the case. The modest goal of this note is to explore two natural generalisations of the above geometric setting in which the bound of the spectral norm fails: first, passing to Legendrian isotopies in the contactisation of the unit co-disc bundle (Hamiltonian isotopies lift to Legendrian isotopies) and, second, considering Hamiltonian isotopies but after modifying the co-disc bundle by attaching a critical Weinstein one-handle.


title: Pure Gauss-Bonnet NUT black hole with and without non-central singularity

abstract: It is known that NUT solution has many interesting features and pathologies like being non-singular and having closed timelike curves. It turns out that in higher dimensions horizon topology cannot be spherical but it has instead to be product of $2$-spheres so as to retain radial symmetry of spacetime. In this letter we wish to present a new solution of pure Gauss-Bonnet $\Lambda$-vacuum equation describing a black hole with NUT charge. It has three interesting cases: (a) black hole with both event and cosmological horizons with singularity being hidden behind the former, (b) a regular spacetime free of both horizon and singularity, and (c) black hole with event horizon without singularity and cosmological horizon. Singularity here is always non-centric at $r \neq 0$.


title: Thermodynamics of Many Black Holes

abstract: We discuss the thermodynamics of an array of collinear black holes which may be accelerating. We prove a general First Law, including variations in the tensions of strings linking and accelerating the black holes. We analyse the implications of the First Law in a number of instructive cases, including that of the C-metric, and relate our findings to the previously obtained thermodynamics of slowly accelerating black holes in anti-de Sitter spacetime. The concept of thermodynamic length is found to be robust and a Christoudoulou-Ruffini formula for the C-metric is shown.


title: UNKs Everywhere: Adapting Multilingual Language Models to New Scripts

abstract: Massively multilingual language models such as multilingual BERT offer state-of-the-art cross-lingual transfer performance on a range of NLP tasks. However, due to limited capacity and large differences in pretraining data sizes, there is a profound performance gap between resource-rich and resource-poor target languages. The ultimate challenge is dealing with under-resourced languages not covered at all by the models and written in scripts unseen during pretraining. In this work, we propose a series of novel data-efficient methods that enable quick and effective adaptation of pretrained multilingual models to such low-resource languages and unseen scripts. Relying on matrix factorization, our methods capitalize on the existing latent knowledge about multiple languages already available in the pretrained model's embedding matrix. Furthermore, we show that learning of the new dedicated embedding matrix in the target language can be improved by leveraging a small number of vocabulary items (i.e., the so-called lexically overlapping tokens) shared between mBERT's and target language vocabulary. Our adaptation techniques offer substantial performance gains for languages with unseen scripts. We also demonstrate that they can yield improvements for low-resource languages written in scripts covered by the pretrained model.


title: Mixed network calculus

abstract: We show how to combine higgsed topological vertices introduced in our previous work with conventional refined topological vertices. We demonstrate that the extended formalism describes very general interacting D5-NS5-D3 brane systems. In particular, we introduce new types of intertwining operators of Ding-Iohara-Miki algebra between different types of Fock representations corresponding to the crossings of NS5 and D5 branes. As a byproduct we obtain an algebraic description of the Hanany-Witten brane creation effect, give an efficient recipe to compute the brane factors in 3d N=2 and N=4 quiver gauge theories and demonstrate how 3d S-duality appears in our setup.


title: Exploiting Shared Knowledge from Non-COVID Lesions for Annotation-Efficient COVID-19 CT Lung Infection Segmentation

abstract: The novel Coronavirus disease (COVID-19) is a highly contagious virus and has spread all over the world, posing an extremely serious threat to all countries. Automatic lung infection segmentation from computed tomography (CT) plays an important role in the quantitative analysis of COVID-19. However, the major challenge lies in the inadequacy of annotated COVID-19 datasets. Currently, there are several public non-COVID lung lesion segmentation datasets, providing the potential for generalizing useful information to the related COVID-19 segmentation task. In this paper, we propose a novel relation-driven collaborative learning model to exploit shared knowledge from non-COVID lesions for annotation-efficient COVID-19 CT lung infection segmentation. The model consists of a general encoder to capture general lung lesion features based on multiple non-COVID lesions, and a target encoder to focus on task-specific features based on COVID-19 infections. Features extracted from the two parallel encoders are concatenated for the subsequent decoder part. We develop a collaborative learning scheme to regularize feature-level relation consistency of given input and encourage the model to learn more general and discriminative representation of COVID-19 infections. Extensive experiments demonstrate that trained with limited COVID-19 data, exploiting shared knowledge from non-COVID lesions can further improve state-of-the-art performance with up to 3.0% in dice similarity coefficient and 4.2% in normalized surface dice. Our proposed method promotes new insights into annotation-efficient deep learning for COVID-19 infection segmentation and illustrates strong potential for real-world applications in the global fight against COVID-19 in the absence of sufficient high-quality annotations.


title: Searching a Raw Video Database using Natural Language Queries

abstract: The number of videos being produced and consequently stored in databases for video streaming platforms has been increasing exponentially over time. This vast database should be easily index-able to find the requisite clip or video to match the given search specification, preferably in the form of a textual query. This work aims to provide an end-to-end pipeline to search a video database with a voice query from the end user. The pipeline makes use of Recurrent Neural Networks in combination with Convolutional Neural Networks to generate captions of the video clips present in the database.


title: Robust Asymmetric Learning in POMDPs

abstract: Policies for partially observed Markov decision processes can be efficiently learned by imitating policies for the corresponding fully observed Markov decision processes. Unfortunately, existing approaches for this kind of imitation learning have a serious flaw: the expert does not know what the trainee cannot see, and so may encourage actions that are sub-optimal, even unsafe, under partial information. We derive an objective to instead train the expert to maximize the expected reward of the imitating agent policy, and use it to construct an efficient algorithm, adaptive asymmetric DAgger (A2D), that jointly trains the expert and the agent. We show that A2D produces an expert policy that the agent can safely imitate, in turn outperforming policies learned by imitating a fixed expert.


title: Tunneling of multi-Weyl semimetals through a potential barrier under the influence of magnetic fields

abstract: We investigate the tunneling of the quasiparticles arising in multi-Weyl semimetals through a barrier consisting of both electrostatic and vector potentials, existing uniformly in a finite region along the transmission axis. The dispersion of a multi-Weyl semimetal is linear in one direction (say, $k_z$), and proportional to $k_\perp^J$ in the plane perpendicular to it (where $k_\perp =\sqrt{k_x^2+k_y^2}$). Hence, we study the cases when the barrier is perpendicular to $k_z$ and $k_x$, respectively. For comparison, we also state the corresponding results for the Weyl semimetal.


title: EFT for Soft Drop Double Differential Cross Section

abstract: We develop a factorization framework to compute the double differential cross section in soft drop groomed jet mass and groomed jet radius. We describe the effective theories in the large, intermediate, and small groomed jet radius regions defined by the interplay of the jet mass and the groomed jet radius measurement. As an application we present the NLL$'$ results for the perturbative moments that are related to the coefficients $C_1$ and $C_2$ that specify the leading hadronization corrections up to three universal parameters. We compare our results with Monte Carlo simulations and a calculation using the coherent branching method.


title: Microscopic-Macroscopic Approach for Ground-State Energies Based on the Gogny Force with the Wigner-Kirkwood Averaging Scheme

abstract: In the previous paper I \cite{bhagwat20} we have shown that self-consistent Extended Thomas-Fermi (ETF) potentials and densities associated with a given finite-range interaction can be parametrized by generalized Fermi distributions. As a next step, a comprehensive calculation of ground-state properties of a large number of spherical and deformed even-even nuclei is carried out in the present work using the Gogny D1S force within the ETF scheme. The parametrized ETF potentials and densities of paper I are used to calculate the smooth part of the energy and the shell corrections within the Wigner-Kirkwood semiclassical averaging scheme. It is shown that the shell corrections thus obtained, along with a simple liquid drop prescription, yield a good description of ground-state masses and potential energy surfaces for nuclei spanning the entire periodic table.


title: On the importance of functions in data modeling

abstract: In this paper we argue that representing entity properties by tuple attributes, as evangelized in most set-oriented data models, is a controversial method conflicting with the principle of tuple immutability. As a principled solution to this problem of tuple immutability on one hand and the need to modify tuple attributes on the other hand, we propose to use mathematical functions for representing entity properties. In this approach, immutable tuples are intended for representing the existence of entities while mutable functions (mappings between sets) are used for representing entity properties. In this model, called the concept-oriented model (COM), functions are made first-class elements along with sets, and both functions and sets are used to represent and process data in a simpler and more natural way in comparison to purely set-oriented models.


title: A free-group valued invariant of free knots

abstract: The aim of the present paper is to construct series of invariants of free knots (flat virtual knots, virtual knots) valued in free groups (and also free products of cyclic groups). (Some minor mistakes are corrected)


title: Reverberation Mapping of Changing-look Active Galactic Nucleus NGC 3516

abstract: The changes of broad emission lines should be a crucial issue to understanding the physical properties of changing-look active galactic nucleus (CL-AGN). Here, we present the results of an intensive and homogeneous 6-month long reverberation mapping (RM) monitoring campaign during a low-activity state of the CL-AGN Seyfert galaxy NGC 3516. Photometric and spectroscopic monitoring was carried out during 2018--2019 with the Lijiang 2.4 m telescope. The sampling is 2 days in most nights, and the average sampling is $\sim$3 days. The rest frame time lags of H$\alpha$ and H$\beta$ are $\tau_{\rm{H}\alpha}=7.56^{+4.42}_{-2.10}$ days and $\tau_{\rm{H}\beta}=7.50^{+2.05}_{-0.77}$ days, respectively. From a RMS H$\beta$ line dispersion of $\sigma_{\rm{line}} = 1713.3 \pm 46.7$ $\rm{km}$ $\rm{s^{-1}}$ and a virial factor of $f_{\sigma}$ = 5.5, the central black hole mass of NGC 3516 is estimated to be $M_{\rm{BH}}= 2.4^{+0.7}_{-0.3} \times 10^{7} M_{\odot}$, which is in agreement with previous estimates. The velocity-resolved delays show that the time lags increase towards negative velocity for both H$\alpha$ and H$\beta$. The velocity-resolved RM of H$\alpha$ is done for the first time. These RM results are consistent with other observations before the spectral type change, indicating a basically constant BLR structure during the changing-look process. The CL model of changes of accretion rate seems to be favored by long-term H$\beta$ variability and RM observations of NGC 3516.


title: Coreference Reasoning in Machine Reading Comprehension

abstract: Coreference resolution is essential for natural language understanding and has been long studied in NLP. In recent years, as the format of Question Answering (QA) became a standard for machine reading comprehension (MRC), there have been data collection efforts, e.g., Dasigi et al. (2019), that attempt to evaluate the ability of MRC models to reason about coreference. However, as we show, coreference reasoning in MRC is a greater challenge than earlier thought; MRC datasets do not reflect the natural distribution and, consequently, the challenges of coreference reasoning. Specifically, success on these datasets does not reflect a model's proficiency in coreference reasoning. We propose a methodology for creating MRC datasets that better reflect the challenges of coreference reasoning and use it to create a sample evaluation set. The results on our dataset show that state-of-the-art models still struggle with these phenomena. Furthermore, we develop an effective way to use naturally occurring coreference phenomena from existing coreference resolution datasets when training MRC models. This allows us to show an improvement in the coreference reasoning abilities of state-of-the-art models. The code and the resulting dataset are available at https://github.com/UKPLab/coref-reasoning-in-qa.


title: Self-consistent conversion of a one-component bulk viscous fluid to particles

abstract: Comparison of heavy-ion experiments to fluid dynamics simulations requires the conversion of the fluid to particles. Extending the approach in Molnar & Wolff, PRC 95, 024903 (2017), this work presents self-consistent bulk viscous corrections from kinetic theory for a one-component system with isotropic $2\to 2$ interactions. The phase space corrections are contrasted to the Grad ansatz and also to corrections obtained from the relaxation time approximation. In addition, the bulk viscosity of the system is calculated and compared with the Grad result, as well as the $\zeta \propto (1 - 3 c_s^2)^2 \eta$ relation between shear and bulk viscosity near the conformal limit. The possible influence of various bulk correction choices on differential elliptic flow $v_2(p_T)$ in heavy-ion collisions is also estimated.


title: A Deep Retinal Image Quality Assessment Network with Salient Structure Priors

abstract: Retinal image quality assessment is an essential prerequisite for diagnosis of retinal diseases. Its goal is to identify retinal images in which anatomic structures and lesions attracting ophthalmologists' attention most are exhibited clearly and definitely while reject poor quality fundus images. Motivated by this, we mimic the way that ophthalmologists assess the quality of retinal images and propose a method termed SalStructuIQA. First, two salient structures for automated retinal quality assessment. One is the large-size salient structures including optic disc region and exudates in large-size. The other is the tiny-size salient structures which mainly include vessels. Then we incorporate the proposed two salient structure priors with deep convolutional neural network (CNN) to shift the focus of CNN to salient structures. Accordingly, we develop two CNN architectures: Dual-branch SalStructIQA and Single-branch SalStructIQA. Dual-branch SalStructIQA contains two CNN branches and one is guided by large-size salient structures while the other is guided by tiny-size salient structures. Single-branch SalStructIQA contains one CNN branch, which is guided by the concatenation of salient structures in both large-size and tiny-size. Experimental results on Eye-Quality dataset show that our proposed Dual-branch SalStructIQA outperforms the state-of-the-art methods for retinal image quality assessment and Single-branch SalStructIQA is much light-weight comparing with state-of-the-art deep retinal image quality assessment methods and still achieves competitive performances.


title: The R-matrix bootstrap for the 2d O(N) bosonic model with a boundary

abstract: The S-matrix bootstrap is extended to a 1+1d theory with $O(N)$ symmetry and a boundary in what we call the R-matrix bootstrap since the quantity of interest is the reflection matrix (R-matrix). Given a bulk S-matrix, the space of allowed R-matrices is an infinite dimensional convex space from which we plot a two dimensional section given by a convex domain on a 2d plane. In certain cases, at the boundary of the domain, we find vertices corresponding to integrable R-matrices with no free parameters. In other cases, when there is a one-parameter family of integrable R-matrices, the whole boundary represents integrable theories. We also consider R-matrices which are analytic in an extended region beyond the physical cuts, thus forbidding poles (resonances) in that region. In certain models, this drastically reduces the allowed space of R-matrices leading to new vertices that again correspond to integrable theories. We also work out the dual problem, in particular in the case of extended analyticity, the dual function has cuts on the physical line whenever unitarity is saturated. For the periodic Yang-Baxter solution that has zero transmission, we computed the R-matrix initially using the bootstrap and then derived its previously unknown analytic form.


title: $\eta $-pairing ground states in the non-Hermitian Hubbard model

abstract: The introduction of non-Hermiticity has greatly enriched the research field of traditional condensed matter physics, and eventually led to a series of discoveries of exotic phenomena. We investigate the effect of non-Hermitian imaginary hoppings on the attractive Hubbard model. The exact bound-pair solution shows that the electron-electron correlation suppresses the non-Hermiticity, resulting in off-diagonal long-range order (ODLRO) ground state. In a large negative $U $ limit, the ODLRO ground state corresponds to $\eta $-spin ferromagnetic states. We also study the system with mixed hopping configuration. The numerical result indicates the existence of the transition from normal to $\eta $-pairing ground states by increasing the imaginary hopping strength. Our results provide a promising approach for the non-Hermitian strongly correlated system.


title: Deficiency indices and discreteness property of block Jacobi matrices and Dirac operators with point interactions

abstract: The paper concerns with infinite symmetric block Jacobi matrices $\bf J$ with $p\times p$-matrix entries. We present new conditions for general block Jacobi matrices to be selfadjoint and have discrete spectrum. In our previous papers there was established a close relation between a class of such matrices and symmetric $2p\times 2p$ Dirac operators $\mathrm{\bf D}_{X,\alpha}$ with point interactions in $L^2(\Bbb R; \Bbb C^{2p})$. In particular, their deficiency indices are related by $n_\pm(\mathrm{\bf D}_{X,\alpha})= n_\pm({\bf J}_{X,\alpha})$. For block Jacobi matrices of this class we present several conditions ensuring equality $n_\pm({\bf J}_{X,\alpha})=k$ with any $k \le p$. Applications to matrix Schrodinger and Dirac operators with point interactions are given. It is worth mentioning that a connection between Dirac and Jacobi operators is employed here in both directions for the first time. In particular, to prove the equality $n_\pm({\bf J}_{X,\alpha})=p$ for ${\bf J}_{X,\alpha}$ we first establish it for Dirac operator $\mathrm{\bf D}_{X,\alpha}$.


title: Blade Envelopes Part II: Multiple Objectives and Inverse Design

abstract: Blade envelopes offer a set of data-driven tolerance guidelines for manufactured components based on aerodynamic analysis. In Part I of this two-part paper, a workflow for the formulation of blade envelopes is described and demonstrated. In Part II, this workflow is extended to accommodate multiple objectives. This allows engineers to prescribe manufacturing guidelines that take into account multiple performance criteria. The quality of a manufactured blade can be correlated with features derived from the distribution of primal flow quantities over the surface. We show that these distributions can be accounted for in the blade envelope using vector-valued models derived from discrete surface flow measurements. Our methods result in a set of variables that allows flexible and independent control over multiple flow characteristics and performance metrics, similar in spirit to inverse design methods. The augmentations to the blade envelope workflow presented in this paper are demonstrated on the LS89 turbine blade, focusing on the control of loss, mass flow and the isentropic Mach number distribution. Finally, we demonstrate how blade envelopes can be used to visualize invariant designs by producing a 3D render of the envelope using 3D modelling software.


title: Unconstrained Massless Higher Spin Supermultiplet in AdS$_4$

abstract: We consider unconstrained formulation of the higher spin gauge theory in anti de Sitter (AdS) spacetime, given by actions [1, 2], and provide on-shell supersymmetry transformations for the $\mathcal{N}=1$ unconstrained massless higher spin supermultiplet in four-dimensional AdS$_4$. Such an irreducible supermultiplet $(\Phi_1, \Phi_2 \,; \Psi_1,\Psi_2)$ contains a pair of bosonic fields, with opposite parity, which are generating functions (infinite collection of totally symmetric real tensor fields of all integer rank $s= 0, 1, \ldots, \infty$), as well as two fermionic fields, which have opposite signs of the AdS radius, that are spinorial generating functions (infinite tower of totally symmetric Majorana spinor-tensor fields of all half-integer spin $s={\scriptstyle \frac{1}{2}}, {\scriptstyle \frac{3}{2}}, \ldots, \infty$).


title: An hp-hierarchical framework for the finite element exterior calculus

abstract: The problem of solving partial differential equations (PDEs) on manifolds can be considered to be one of the most general problem formulations encountered in computational multi-physics. The required covariant forms of balance laws as well as the corresponding covariant forms of the constitutive closing relations are naturally expressed using the bundle-valued exterior calculus of differential forms or related algebraic concepts. It can be argued that the appropriate solution method to such PDE problems is given by the finite element exterior calculus (FEEC). The aim of this essay is the exposition of a simple, efficiently-implementable framework for general hp-adaptivity applicable to the FEEC on higher-dimensional manifolds. A problem-independent spectral error-indicator is developed which estimates the error and the spectral decay of polynomial coefficients. The spectral decay rate is taken as an admissibility indicator on the polynomial order distribution. Finally, by elementary computational examples, it is attempted to demonstrate the power of the method as an engineering tool.