title: Topological Magnus responses in two and three dimensional systems

abstract: Recently, time-reversal symmetric but inversion broken systems with non-trivial Berry curvature in the presence of a built-in electric field have been proposed to exhibit a new type of linear Hall effect in ballistic regime, namely, the Magnus Hall effect. The transverse current here is caused by the Magnus velocity that is proportional to the built-in electric field allowing us to examine the Magnus Hall conductivity and Magnus Nernst conductivity with chemical potential. Starting with two-dimensional (2D) topological systems, we find that warping induced asymmetry in both the Fermi surface and Berry curvature can in general enhance the Magnus Hall response for monolayer graphene and surface states of topological insulator. Interestingly, strain can change the Fermi surface character substantially that further results in distinct behavior of Magnus transport coefficients as we observe in bilayer graphene. Going beyond 2D systems, we also investigate the Magnus Hall and Nernst responses in three-dimensional multi-Weyl semimetals (mWSMs). Remarkably, Magnus responses can only survive for the tilted WSMs, and therefore can be measured as a tool to distinguish between the untilted and tilted WSMs in experiments. In addition, we find that the Magnus Hall responses get suppressed with increasing the non-linearity associated with the band touching around multi-Weyl node.


title: Post-spontaneous-symmetry-breaking power-laws after a very strong earthquake: Indication for the preparation of a new strong earthquake or not?

abstract: It has recently been found that the evolution of the preparation of a strong earthquake (EQ), as it is monitored through fracture-induced electromagnetic emissions (EME) in the MHz band, presents striking similarity with the evolution of a thermal system as temperature drops, since distinct steps of the evolution of the phenomenon of spontaneous symmetry breaking (SSB) can be identified. Here, the study of fracture-induced EME in the MHz band in analogy to thermal systems is extended to the phase of local fracture structures that follow after the SSB (and the occurrence of the main EQ). By comparing fracture-induced MHz EME associated with the strongest EQs (Mw=6.9) that occurred in Greece during the last twenty years with the 3D Ising model, a way to distinguish whether a possible identification of post-SSB power-laws immediately after a very strong EQ is a sign for the preparation of a new strong EQ or not is provided. In the suggested approach, the time series analysis method known as the method of critical fluctuations is used, enhanced by the autocorrelation function, while the role of the latter proves to be decisive.


title: Zero-Shot Learning on 3D Point Cloud Objects and Beyond

abstract: Zero-shot learning, the task of learning to recognize new classes not seen during training, has received considerable attention in the case of 2D image classification. However, despite the increasing ubiquity of 3D sensors, the corresponding 3D point cloud classification problem has not been meaningfully explored and introduces new challenges. In this paper, we identify some of the challenges and apply 2D Zero-Shot Learning (ZSL) methods in the 3D domain to analyze the performance of existing models. Then, we propose a novel approach to address the issues specific to 3D ZSL. We first present an inductive ZSL process and then extend it to the transductive ZSL and Generalized ZSL (GZSL) settings for 3D point cloud classification. To this end, a novel loss function is developed that simultaneously aligns seen semantics with point cloud features and takes advantage of unlabeled test data to address some known issues (e.g., the problems of domain adaptation, hubness, and data bias). While designed for the particularities of 3D point cloud classification, the method is shown to also be applicable to the more common use-case of 2D image classification. An extensive set of experiments is carried out, establishing state-of-the-art for ZSL and GZSL on synthetic (ModelNet40, ModelNet10, McGill) and real (ScanObjectNN) 3D point cloud datasets.


title: Erosion and accretion by cratering impacts on rocky and icy bodies

abstract: During planet formation, numerous small impacting bodies result in cratering impacts on large target bodies. A fraction of the target surface is eroded, while a fraction of the impactor material accretes onto the surface. These fractions depend upon the impact velocities, the impact angles, and the escape velocities of the target. This study uses smoothed particle hydrodynamics simulations to model cratering impacts onto a planar icy target for which gravity is the dominant force and material strength is neglected. By evaluating numerical results, scaling laws are derived for the escape mass of the target material and the accretion mass of the impactor material onto the target surface. Together with recently derived results for rocky bodies in a companion study, a conclusion is formulated that typical cratering impacts on terrestrial planets, except for those on Mercury, led to a net accretion, while those on the moons of giant planets, e.g., Rhea and Europa, led to a net erosion. Our newly derived scaling laws would be useful for predicting the erosion of the target body and the accretion of the impactor for a variety of cratering impacts that would occur on large rocky and icy planetary bodies during planet formation and collisional evolution from ancient times to today.


title: Optical equations for null strings

abstract: An optical equation for null strings is derived. The equation is similar to Sachs' optical equations for null geodesic congruences. The string optical equation is given in terms of a single complex scalar function $Z$, which is a combination of spin coefficients at the string trajectory. Real and imaginary parts of $Z$ determine expansion and rotation of strings. Trajectories of strings can be represented by diagrams in a complex $Z$-plane. Such diagrams allow one to draw some universal features of null strings in different backgrounds. For example, in asymptotically flat space-times $Z$ vanishes as future null infinity is approached, that is, gradually shapes of strings are "freezing out". Outgoing gravitational radiation and flows of matter leave ripples on the strings. These effects are encoded in subleading terms of $Z$. String diagrams are demonstrated for rotating and expanding strings in a flat space-time and in cosmological models.


title: The Volterra type equations related to the non-Debye relaxation

abstract: We investigate a possibility to describe the non-Debye relaxation processes using the Volterra-type equations with kernels given by the Prabhakar functions with the upper parameter $\nu$ being negative. Proposed integro-differential equations mimic the fading memory effects and are explicitly solved using the umbral calculus and the Laplace transform methods. Both approaches lead to the same results valid for admissible domain of the parameters $\alpha$, $\mu$ and $\nu$ characterizing the Prabhakar function. For the special case $\alpha\in (0,1]$, $\mu=0$ and $\nu=-1$ we recover the Cole-Cole model, in general having a residual polarization. We also show that our scheme gives results equivalent to those obtained using the stochastic approach to relaxation phenomena merged with integral equations involving kernels given by the Prabhakar functions with the positive upper parameter.


title: Adiabatic approximation for the motion of Ginzburg-Landau vortex filament

abstract: In this paper, we consider the concentration property of solutions to the dispersive Ginzburg-Landau (or Gross-Pitaevskii) equation in three dimensions. On a spatial domain, it has long been conjectured that such a solution concentrates near some curve evolving according to the binormal curvature flow, and conversely, that a curve moving this way can be realized in a suitable sense by some solution to the dispersive Ginzburg-Landau equation. Some partial results are known with rather strong symmetry assumptions. Our main theorems here provide affirmative answer to both conjectures under certain small curvature assumption. The results are valid for small but fixed material parameter in the equation, in contrast to the general practice to take this parameter to its zero limit. The advantage is that we can retain precise description of the vortex filament structure. The results hold on a long but finite time interval, depending on the curvature assumption.


title: Feedback stabilization of forming processes

abstract: We are interested in the control of forming processes for nonlinear material models. To develop an online control we derive a novel feedback law and prove a stabilization result. The derivation of the feedback control law is based on a Laypunov analysis of the time-dependent viscoplastic material models. The derivation uses the structure of the underlying partial differential equation for the design of the feedback control. Analytically, exponential decay of the time evolution of perturbations to desired stress--strain states is shown. We test the new control law numerically by coupling it to a finite element simulation of a deformation process.


title: Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa

abstract: Aspect-based Sentiment Analysis (ABSA), aiming at predicting the polarities for aspects, is a fine-grained task in the field of sentiment analysis. Previous work showed syntactic information, e.g. dependency trees, can effectively improve the ABSA performance. Recently, pre-trained models (PTMs) also have shown their effectiveness on ABSA. Therefore, the question naturally arises whether PTMs contain sufficient syntactic information for ABSA so that we can obtain a good ABSA model only based on PTMs. In this paper, we firstly compare the induced trees from PTMs and the dependency parsing trees on several popular models for the ABSA task, showing that the induced tree from fine-tuned RoBERTa (FT-RoBERTa) outperforms the parser-provided tree. The further analysis experiments reveal that the FT-RoBERTa Induced Tree is more sentiment-word-oriented and could benefit the ABSA task. The experiments also show that the pure RoBERTa-based model can outperform or approximate to the previous SOTA performances on six datasets across four languages since it implicitly incorporates the task-oriented syntactic information.


title: AutoGL: A Library for Automated Graph Learning

abstract: Recent years have witnessed an upsurge in research interests and applications of machine learning on graphs. However, manually designing the optimal machine learning algorithms for different graph datasets and tasks is inflexible, labor-intensive, and requires expert knowledge, limiting its adaptivity and applicability. Automated machine learning (AutoML) on graphs, aiming to automatically design the optimal machine learning algorithm for a given graph dataset and task, has received considerable attention. However, none of the existing libraries can fully support AutoML on graphs. To fill this gap, we present Automated Graph Learning (AutoGL), the first dedicated library for automated machine learning on graphs. AutoGL is open-source, easy to use, and flexible to be extended. Specifically, we propose a three-layer architecture, consisting of backends to interface with devices, a complete automated graph learning pipeline, and supported graph applications. The automated machine learning pipeline further contains five functional modules: auto feature engineering, neural architecture search, hyper-parameter optimization, model training, and auto ensemble, covering the majority of existing AutoML methods on graphs. For each module, we provide numerous state-of-the-art methods and flexible base classes and APIs, which allow easy usage and customization. We further provide experimental results to showcase the usage of our AutoGL library. We also present AutoGL-light, a lightweight version of AutoGL to facilitate customizing pipelines and enriching applications, as well as benchmarks for graph neural architecture search. The codes of AutoGL are publicly available at https://github.com/THUMNLab/AutoGL.


title: Vanishing Estimates for Liouville equation with quantized singularities

abstract: In this article we continue with the research initiated in our previous work on singular Liouville equations with quantized singularity. The main goal of this article is to prove that as long as the bubbling solutions violate the spherical Harnack inequality near a singular source, the first derivatives of coefficient functions must tend to zero.


title: NorDial: A Preliminary Corpus of Written Norwegian Dialect Use

abstract: Norway has a large amount of dialectal variation, as well as a general tolerance to its use in the public sphere. There are, however, few available resources to study this variation and its change over time and in more informal areas, \eg on social media. In this paper, we propose a first step to creating a corpus of dialectal variation of written Norwegian. We collect a small corpus of tweets and manually annotate them as Bokm{\aa}l, Nynorsk, any dialect, or a mix. We further perform preliminary experiments with state-of-the-art models, as well as an analysis of the data to expand this corpus in the future. Finally, we make the annotations and models available for future work.


title: On Probabilistic Termination of Functional Programs with Continuous Distributions

abstract: We study termination of higher-order probabilistic functional programs with recursion, stochastic conditioning and sampling from continuous distributions. Reasoning about the termination probability of programs with continuous distributions is hard, because the enumeration of terminating executions cannot provide any non-trivial bounds. We present a new operational semantics based on traces of intervals, which is sound and complete with respect to the standard sampling-based semantics, in which (countable) enumeration can provide arbitrarily tight lower bounds. Consequently we obtain the first proof that deciding almost-sure termination (AST) for programs with continuous distributions is $\Pi^0_2$-complete. We also provide a compositional representation of our semantics in terms of an intersection type system. In the second part, we present a method of proving AST for non-affine programs, i.e., recursive programs that can, during the evaluation of the recursive body, make multiple recursive calls (of a first-order function) from distinct call sites. Unlike in a deterministic language, the number of recursion call sites has direct consequences on the termination probability. Our framework supports a proof system that can verify AST for programs that are well beyond the scope of existing methods. We have constructed prototype implementations of our method of computing lower bounds of termination probability, and AST verification.


title: Integrating Information Theory and Adversarial Learning for Cross-modal Retrieval

abstract: Accurately matching visual and textual data in cross-modal retrieval has been widely studied in the multimedia community. To address these challenges posited by the heterogeneity gap and the semantic gap, we propose integrating Shannon information theory and adversarial learning. In terms of the heterogeneity gap, we integrate modality classification and information entropy maximization adversarially. For this purpose, a modality classifier (as a discriminator) is built to distinguish the text and image modalities according to their different statistical properties. This discriminator uses its output probabilities to compute Shannon information entropy, which measures the uncertainty of the modality classification it performs. Moreover, feature encoders (as a generator) project uni-modal features into a commonly shared space and attempt to fool the discriminator by maximizing its output information entropy. Thus, maximizing information entropy gradually reduces the distribution discrepancy of cross-modal features, thereby achieving a domain confusion state where the discriminator cannot classify two modalities confidently. To reduce the semantic gap, Kullback-Leibler (KL) divergence and bi-directional triplet loss are used to associate the intra- and inter-modality similarity between features in the shared space. Furthermore, a regularization term based on KL-divergence with temperature scaling is used to calibrate the biased label classifier caused by the data imbalance issue. Extensive experiments with four deep models on four benchmarks are conducted to demonstrate the effectiveness of the proposed approach.


title: Long-range dependent completely correlated mixed fractional Brownian motion

abstract: In this paper we introduce the long-range dependent completely correlated mixed fractional Brownian motion (ccmfBm). This is a process that is driven by a mixture of Brownian motion (Bm) and a long-range dependent completely correlated fractional Brownian motion (fBm, ccfBm) that is constructed from the Brownian motion via the Molchan--Golosov representation. Thus, there is a single Bm driving the mixed process. In the short time-scales the ccmfBm behaves like the Bm (it has Brownian H\"older index and quadratic variation). However, in the long time-scales it behaves like the fBm (it has long-range dependence governed by the fBm's Hurst index). We provide a transfer principle for the ccmfBm and use it to construct the Cameron--Martin--Girsanov--Hitsuda theorem and prediction formulas. Finally, we illustrate the ccmfBm by simulations.


title: The DKU System Description for The Interspeech 2021 Auto-KWS Challenge

abstract: This paper introduces the system submitted by the DKU-SMIIP team for the Auto-KWS 2021 Challenge. Our implementation consists of a two-stage keyword spotting system based on query-by-example spoken term detection and a speaker verification system. We employ two different detection algorithms in our proposed keyword spotting system. The first stage adopts subsequence dynamic time warping for template matching based on frame-level language-independent bottleneck feature and phoneme posterior probability. We use a sliding window template matching algorithm based on acoustic word embeddings to further verify the detection from the first stage. As a result, our KWS system achieves an average score of 0.61 on the feedback dataset, which outperforms the baseline1 system by 0.25.


title: Suspension homotopy of $6$-manifolds

abstract: For a simply connected closed orientable manifold of dimension $6$, we show its homotopy decomposition after double suspension. This allows us to determine its $K$- and $KO$-groups easily. Moreover, for a special case we refine the decomposition to show the rigidity property of the manifold after double suspension.


title: Construction of inflationary scenarios with the Gauss-Bonnet term and nonminimal coupling

abstract: Inflationary models with a scalar field nonminimally coupled both with the Ricci scalar and with the Gauss-Bonnet term are studied. We propose the way of generalization of inflationary scenarios with the Gauss-Bonnet term and a scalar field minimally coupled with the Ricci scalar to the corresponding scenarios with a scalar field nonminimally coupled with the Ricci scalar. Using the effective potential, we construct a set of models with the same values of the scalar spectral index $n_s$ and the amplitude of the scalar perturbations $A_s$ and different values of the tensor-to-scalar ratio $r$.


title: Simple Majority Consensus in Networks with Unreliable Communication

abstract: In this work, we analyze the performance of a simple majority-rule protocol solving a fundamental coordination problem in distributed systems - \emph{binary majority consensus}, in the presence of probabilistic message loss. Using probabilistic analysis for a large scale, fully-connected, network of $2n$ agents, we prove that the Simple Majority Protocol (SMP) reaches consensus in only three communication rounds with probability approaching $1$ as $n$ grows to infinity. Moreover, if the difference between the numbers of agents that hold different opinions grows at a rate of $\sqrt{n}$, then the SMP with only two communication rounds attains consensus on the majority opinion of the network, and if this difference grows faster than $\sqrt{n}$, then the SMP reaches consensus on the majority opinion of the network in a single round, with probability converging to $1$ exponentially fast as $n \rightarrow \infty$. We also provide some converse results, showing that these requirements are not only sufficient, but also necessary.


title: Grand Canonical Evolution for the Kac Model

abstract: We study a model of random colliding particles interacting with an infinite reservoir at fixed temperature and chemical potential. Interaction between the particles is modeled via a Kac master equation \cite{kac}. Moreover, particles can leave the system toward the reservoir or enter the system from the reservoir. The system admits a unique steady state given by the Grand Canonical Ensemble at temperature $T=\beta^{-1}$ and chemical potential $\chi$. We show that any initial state converges exponentially fast to equilibrium by computing the spectral gap of the generator in a suitable $L^2$ space and by showing exponential decrease of the relative entropy with respect to the steady state. We also show propagation of chaos and thus the validity of a Boltzmann-Kac type equation for the particle density in the infinite system limit.


title: Unsupervised Learning of Explainable Parse Trees for Improved Generalisation

abstract: Recursive neural networks (RvNN) have been shown useful for learning sentence representations and helped achieve competitive performance on several natural language inference tasks. However, recent RvNN-based models fail to learn simple grammar and meaningful semantics in their intermediate tree representation. In this work, we propose an attention mechanism over Tree-LSTMs to learn more meaningful and explainable parse tree structures. We also demonstrate the superior performance of our proposed model on natural language inference, semantic relatedness, and sentiment analysis tasks and compare them with other state-of-the-art RvNN based methods. Further, we present a detailed qualitative and quantitative analysis of the learned parse trees and show that the discovered linguistic structures are more explainable, semantically meaningful, and grammatically correct than recent approaches. The source code of the paper is available at https://github.com/atul04/Explainable-Latent-Structures-Using-Attention.


title: ALT-MAS: A Data-Efficient Framework for Active Testing of Machine Learning Algorithms

abstract: Machine learning models are being used extensively in many important areas, but there is no guarantee a model will always perform well or as its developers intended. Understanding the correctness of a model is crucial to prevent potential failures that may have significant detrimental impact in critical application areas. In this paper, we propose a novel framework to efficiently test a machine learning model using only a small amount of labeled test data. The idea is to estimate the metrics of interest for a model-under-test using Bayesian neural network (BNN). We develop a novel data augmentation method helping to train the BNN to achieve high accuracy. We also devise a theoretic information based sampling strategy to sample data points so as to achieve accurate estimations for the metrics of interest. Finally, we conduct an extensive set of experiments to test various machine learning models for different types of metrics. Our experiments show that the metrics estimations by our method are significantly better than existing baselines.


title: Saddlepoints in Unsupervised Least Squares

abstract: This paper sheds light on the risk landscape of unsupervised least squares in the context of deep auto-encoding neural nets. We formally establish an equivalence between unsupervised least squares and principal manifolds. This link provides insight into the risk landscape of auto--encoding under the mean squared error, in particular all non-trivial critical points are saddlepoints. Finding saddlepoints is in itself difficult, overcomplete auto-encoding poses the additional challenge that the saddlepoints are degenerate. Within this context we discuss regularization of auto-encoders, in particular bottleneck, denoising and contraction auto-encoding and propose a new optimization strategy that can be framed as particular form of contractive regularization.


title: A characterization of the bidisc by a subgroup of its automorphism group

abstract: We make a connection between the structure of the bidisc and a distinguished subgroup of its automorphism group. The automorphism group of the bidisc, as we know, is of dimension six and acts transitively. We observe that it contains a subgroup that is isomorphic to the automorphism group of the open unit disc and this subgroup partitions the bidisc into a complex curve and a family of strongly pseudo-convex hypersurfaces that are non-spherical as CR-manifolds. Our work reverses this process and shows that any $2$-dimensional Kobayashi-hyperbolic manifold whose automorphism group (which is known, from the general theory, to be a Lie group) has a $3$-dimensional subgroup that is non-solvable (as a Lie group) and that acts on the manifold to produce a collection of orbits possessing essentially the characteristics of the concretely known collection of orbits mentioned above, is biholomorphic to the bidisc. The distinguished subgroup is interesting in its own right. It turns out that if we consider any subdomain of the bidisc that is a union of a proper sub-collection of the collection of orbits mentioned above, then the automorphism group of this subdomain can be expressed very simply in terms of this distinguished subgroup.


title: Learning the CSI Denoising and Feedback Without Supervision

abstract: In this work, we develop a joint denoising and feedback strategy for channel state information in frequency division duplex systems. In such systems, the biggest challenge is the overhead incurred when the mobile terminal has to send the downlink channel state information or corresponding partial information to the base station, where the complete estimates can subsequently be restored. To this end, we propose a novel learning-based framework for denoising and compression of channel estimates. Unlike existing studies, we extend a recently proposed approach and show that based solely on noisy uplink data available at the base station, it is possible to learn an autoencoder neural network that generalizes to downlink data. Subsequently, half of the autoencoder can be offloaded to the mobile terminals to generate channel feedback there as efficiently as possible, without any training effort at the terminals or corresponding transfer of training data. Numerical simulations demonstrate the excellent performance of the proposed method.


title: Multiple Run Ensemble Learning with Low-Dimensional Knowledge Graph Embeddings

abstract: Among the top approaches of recent years, link prediction using knowledge graph embedding (KGE) models has gained significant attention for knowledge graph completion. Various embedding models have been proposed so far, among which, some recent KGE models obtain state-of-the-art performance on link prediction tasks by using embeddings with a high dimension (e.g. 1000) which accelerate the costs of training and evaluation considering the large scale of KGs. In this paper, we propose a simple but effective performance boosting strategy for KGE models by using multiple low dimensions in different repetition rounds of the same model. For example, instead of training a model one time with a large embedding size of 1200, we repeat the training of the model 6 times in parallel with an embedding size of 200 and then combine the 6 separate models for testing while the overall numbers of adjustable parameters are same (6*200=1200) and the total memory footprint remains the same. We show that our approach enables different models to better cope with their expressiveness issues on modeling various graph patterns such as symmetric, 1-n, n-1 and n-n. In order to justify our findings, we conduct experiments on various KGE models. Experimental results on standard benchmark datasets, namely FB15K, FB15K-237 and WN18RR, show that multiple low-dimensional models of the same kind outperform the corresponding single high-dimensional models on link prediction in a certain range and have advantages in training efficiency by using parallel training while the overall numbers of adjustable parameters are same.


title: The neutron cross section of the hydrogen liquids: substantial improvements and perspectives

abstract: The design of moderators and cold sources of neutrons is a key point in research-reactor physics, requiring extensive knowledge of the scattering properties of very important light molecular liquids such as methane, hydrogen and their deuterated counterparts. Inelastic scattering measurements constitute the basic source of such information but are difficult to perform, the more so when high accuracy is required, and additional experimental information is scarce. The need of data covering as large as possible portions of the kinematic Q-E plane thus pushes towards the use of computable models, validated by testing them, mainly, against integral quantities (either known from theory or measured) such as spectral moments and total cross section data. A few recent experiments demonstrated that, at least for the self contribution, which dominates in the incoherent scattering case of hydrogen, accurate calculations can be performed by means of quantum simulations of the velocity autocorrelation function. This method is shown here to be by far superior to the use of standard analytical models devised, although rather cleverly, for generic classical samples. The neutron dynamic structure factor (and consequently the well-known S({\alpha},{\beta}) of parahydrogen and deuterium, suitable for use in packages like NJOY, are given and shown to agree very well with total cross section measurements and expected quantum properties.


title: Short-Term Behavior of a Geothermal Energy Storage: Modeling and Theoretical Results

abstract: This paper investigates numerical methods for simulations of the short-term behavior of a geothermal energy storage. Such simulations are needed for the optimal control and management of residential heating systems equipped with an underground thermal storage. There a given volume under or aside of a building is filled with soil and insulated to the surrounding ground. The thermal energy is stored by raising the temperature of the soil inside the storage. It is charged and discharged via pipe heat exchangers filled with a moving fluid. Simulations of geothermal energy storages aim to determine how much energy can be stored in or taken from the storage within a given short period of time. The latter depends on the dynamics of the spatial temperature distribution in the storage which is governed by a linear heat equation with convection and appropriate boundary and interface conditions. We consider semi- and full discretization of that PDE using finite difference schemes and study associated stability problems. Numerical results based on the derived methods are presented in the companion paper [17].


title: Flavor Specific $U(1)_{B_q-L_\mu}$ Gauge Model for Muon $g-2$ and $b \to s \bar \mu \mu$ Anomalies

abstract: The muon $(g-2)_\mu$ and $b\to s \bar \mu \mu$ induced $B$ anomalies as hints of new physics beyond the standard model (SM) have attracted much attention. These two anomalies indicate that there may exist new interaction specifically related to muon. A lot of theoretical ideas have been proposed to explain these anomalies. Gauged flavor specific $U(1)_{B_q-L_\mu}$ is among the promising ones. The new gauge boson $Z'$ from $U(1)_{B_q-L_\mu}$ interacts with muon and provides necessary ingredient to solve the $(g-2)_\mu$ anomaly. The $Z'$-quark coupling can generate flavor changing interactions after diagonalization of quark mass matrix between weak eigen-state and mass eigen-state basis. We revisit challenges for such models attempting to explain the $(g-2)_\mu$ and $B$ anomalies separately or simultaneously. We find although for $U(1)_{B_q-L_\mu}$ models there is still parameter space to provide solutions for separately explaining the $(g-2)_\mu$ and $B$ anomalies, there exists no parameter space for such models to solve both the anomalies simultaneously, after taking into account existing constraints from $\tau \to \mu \gamma$, $\tau \to 3 \mu$, neutrino trident and $B_s - \bar B_s$ data. Among them leptonic processes restrict $Z^\prime$ mass to be less than a few hundred MeV if required to solve the $(g-2)_\mu$ anomaly, which causes conflict between data from $B_s - \bar B_s$, $D^0 - \bar D^0$ mixing and also hadron decays with $Z^\prime$ in the final states. The effects of $U(1)_Y$ and $U(1)_{B_q-L_\mu}$ kinetic mixing on these anomalies are also studied. We find that neither can these effects do much to bring the two anomalies together to be solved simultaneously.


title: Evaluation and Control of Opinion Polarization and Disagreement: A Review

abstract: With the recent advances of networking technology, connections among people are unprecedentedly enhanced. People with different ideologies and backgrounds interact with each other, and there may exist severe opinion polarization and disagreement in the social network. There have been a lot of reviews on modeling opinion formation. However, less attention has been paid to opinion polarization and disagreement. In this work, we review recent advances in opinion polarization and disagreement and pay attention to how they are evaluated and controlled. In literature, three metrics: polarization, disagreement, and polarization-disagreement index (PDI) are usually adopted, and there is a tradeoff between polarization and disagreement. Different strategies have been proposed in literature which can significantly control opinion polarization and disagreement based on these metrics. This review is of crucial importance to summarize works on opinion polarization and disagreement, and to the better understanding and control of them.


title: Operator spaces with the WEP, the OLLP and the Gurarii property

abstract: We construct non-exact operator spaces satisfying the Weak Expectation Property (WEP) and the Operator space version of the Local Lifting Property (OLLP). These examples should be compared with the example we recently gave of a $C^*$-algebra with WEP and LLP. The construction produces several new analogues among operator spaces of the Gurarii space, extending Oikhberg's previous work. Each of our "Gurarii operator spaces" is associated to a class of finite dimensional operator spaces (with suitable properties). In each case we show the space exists and is unique up to completely isometric isomorphism.


title: Electrochemistry of thin films with operando grazing incidence X-ray scattering: bypassing electrolyte scattering for high fidelity time resolved studies

abstract: Electroactive polymer thin films undergo repeated reversible structural change during operation in electrochemical applications. While synchrotron X-ray scattering is powerful for the characterization of stand-alone and ex-situ organic thin films, in situ structural characterization has been underutilized--in large part due to complications arising from supporting electrolyte scattering. This has greatly hampered the development of application relevant structure property relationships. Therefore, we have developed a new methodology for in situ and operando X-ray characterization that separates the incident and scattered X-ray beam path from the electrolyte. As a proof of concept, we demonstrate the in situ structural changes of weakly-scattering, organic mixed ionic-electronic conductor thin films in an aqueous electrolyte environment, enabling access to previously unexplored changes in the pi-pi peak and diffuse scatter in situ, while capturing the solvent swollen thin film structure which was inaccessible in previous ex situ studies. These in situ measurements improve the sensitivity to structural changes, capturing minute changes not possible ex situ, and have multimodal potential such as combined Raman measurements that also serve to validate the true in situ/operando conditions of the cell. Finally, we examine new directions enabled by this operando cell design and compare state of the art measurements.


title: The structure of online social networks modulates the rate of lexical change

abstract: New words are regularly introduced to communities, yet not all of these words persist in a community's lexicon. Among the many factors contributing to lexical change, we focus on the understudied effect of social networks. We conduct a large-scale analysis of over 80k neologisms in 4420 online communities across a decade. Using Poisson regression and survival analysis, our study demonstrates that the community's network structure plays a significant role in lexical change. Apart from overall size, properties including dense connections, the lack of local clusters and more external contacts promote lexical innovation and retention. Unlike offline communities, these topic-based communities do not experience strong lexical levelling despite increased contact but accommodate more niche words. Our work provides support for the sociolinguistic hypothesis that lexical change is partially shaped by the structure of the underlying network but also uncovers findings specific to online communities.


title: Electron acceleration driven by the lower-hybrid-drift instability: an extended quasilinear model

abstract: Density inhomogeneities are ubiquitous in space and astrophysical plasmas, in particular at contact boundaries between different media. They often correspond to regions that exhibits strong dynamics on a wide range of spatial and temporal scales. Indeed, density inhomogeneities are a source of free energy that can drive various instabilities such as, for instance, the lower-hybrid-drift instability which in turn transfers energy to the particles through wave-particle interactions and eventually heat the plasma. We aim at quantifying the efficiency of the lower-hybrid-drift instability to accelerate and/or heat electrons parallel to the ambient magnetic field. We combine two complementary methods: full-kinetic and quasilinear models. We report self-consistent evidence of electron acceleration driven by the development of the lower-hybrid-drift instability using 3D-3V full-kinetic numerical simulations. The efficiency of the observed acceleration cannot be explained by standard quasilinear theory. For this reason, we develop an extended quasilinear model able to quantitatively predict the interaction between lower-hybrid fluctuations and electrons on long time scales, now in agreement with full-kinetic simulations results. Finally, we apply this new, extended quasilinear model to a specific inhomogeneous space plasma boundary: the magnetopause of Mercury, and we discuss our quantitative predictions of electron acceleration in support to future BepiColombo observations.


title: Secure Cognitive Radio Communication via Intelligent Reflecting Surface

abstract: In this paper, an intelligent reflecting surface (IRS) assisted spectrum sharing underlay cognitive radio (CR) wiretap channel (WTC) is studied, and we aim at enhancing the secrecy rate of secondary user in this channel subject to total power constraint at secondary transmitter (ST), interference power constraint (IPC) at primary receiver (PR) as well as unit modulus constraint at IRS. Due to extra IPC and eavesdropper (Eve) are considered, all the existing solutions for enhancing secrecy rate of IRS-assisted non-CR WTC as well as enhancing transmission rate in IRS-assisted CR channel without eavesdropper fail in this work. Therefore, we propose new numerical solutions to optimize the secrecy rate of this channel under full primary, secondary users' channel state information (CSI) and three different cases of Eve's CSI: full CSI, imperfect CSI with bounded estimation error, and no CSI. Simulation results show that our proposed solutions for the IRS-assisted design greatly enhance the secrecy performance compared with the existing numerical solutions with and without IRS under full and imperfect Eve's CSI. And positive secrecy rate can be achieved by our proposed AN aided approach given most channel realizations under no Eve's CSI case so that secure communication also can be guaranteed. All of the proposed AO algorithms are guaranteed to monotonic convergence.


title: The effects of non-helical component of hypermagnetic field on the evolution of the matter-antimatter asymmetry, vorticity, and hypermagnetic field

abstract: We study the evolution of the matter-antimatter asymmetry ({\eta}), the vorticity, and the hypermagnetic field in the symmetric phase of the early Universe, and in the temperature range 100 GeV < T < 10 TeV. We assume a configuration for the hypermagnetic field which includes both helical and non-helical (Bz) components. Consequently, the hypermagnetic field and the fluid vorticity can directly affect each other, the manifestations of which we explore in three scenarios. In the first scenario, we show that in the presence of a small vorticity and a large {\eta}eR, helicity can be generated and amplified for an initially strong Bz. The generation of the helical seed is due to the chiral vortical effect (CVE) and/or the advection term, while its growth is mainly due to the chiral magnetic effect (CME) which leads to the production of the baryon asymmetry, as well. The vorticity saturates to a nonzero value which depends on Bz, even in the presence of the viscosity, due to the back-reaction of Bz on the plasma. Increasing the initial vorticity, makes the values of the helicity, {\eta}s, and vorticity reach their saturation curves sooner, but does not change their final values at the onset of the electroweak phase transition. The second scenario is similar to the first except we assume that all initial {\eta}s are zero. We find that much higher initial vorticity is required for the generation process. In the third scenario, we show that in the presence of only a strong hypermagnetic field, {\eta}s and vorticity can be generated and amplified. Increasing the initial helicity, increases the final {\eta}s and vorticity. We find that although the presence of a nonzero initial Bz is necessary in all three scenarios, its increase only increases the final values of vorticity.


title: One Ring to Rule Them All: a simple solution to multi-view 3D-Reconstruction of shapes with unknown BRDF via a small Recurrent ResNet

abstract: This paper proposes a simple method which solves an open problem of multi-view 3D-Reconstruction for objects with unknown and generic surface materials, imaged by a freely moving camera and a freely moving point light source. The object can have arbitrary (e.g. non-Lambertian), spatially-varying (or everywhere different) surface reflectances (svBRDF). Our solution consists of two smallsized neural networks (dubbed the 'Shape-Net' and 'BRDFNet'), each having about 1,000 neurons, used to parameterize the unknown shape and unknown svBRDF, respectively. Key to our method is a special network design (namely, a ResNet with a global feedback or 'ring' connection), which has a provable guarantee for finding a valid diffeomorphic shape parameterization. Despite the underlying problem is highly non-convex hence impractical to solve by traditional optimization techniques, our method converges reliably to high quality solutions, even without initialization. Extensive experiments demonstrate the superiority of our method, and it naturally enables a wide range of special-effect applications including novel-view-synthesis, relighting, material retouching, and shape exchange without additional coding effort. We encourage the reader to view our demo video for better visualizations.


title: Temporal Consistency Two-Stream CNN for Human Motion Prediction

abstract: Fusion is critical for a two-stream network. In this paper, we propose a novel temporal fusion (TF) module to fuse the two-stream joints' information to predict human motion, including a temporal concatenation and a reinforcement trajectory spatial-temporal (TST) block, specifically designed to keep prediction temporal consistency. In particular, the temporal concatenation keeps the temporal consistency of preliminary predictions from two streams. Meanwhile, the TST block improves the spatial-temporal feature coupling. However, the TF module can increase the temporal continuities between the first predicted pose and the given poses and between each predicted pose. The fusion is based on a two-stream network that consists of a dynamic velocity stream (V-Stream) and a static position stream (P-Stream) because we found that the joints' velocity information improves the short-term prediction, while the joints' position information is better at long-term prediction, and they are complementary in motion prediction. Finally, our approach achieves impressive results on three benchmark datasets, including H3.6M, CMU-Mocap, and 3DPW in both short-term and long-term predictions, confirming its effectiveness and efficiency.


title: Hamiltonian paths and cycles in some 4-uniform hypergraphs

abstract: In 1999, Katona and Kierstead conjectured that if a $k$-uniform hypergraph $\cal H$ on $n$ vertices has minimum co-degree $\lfloor \frac{n-k+3}{2}\rfloor$, i.e., each set of $k-1$ vertices is contained in at least $\lfloor \frac{n-k+3}{2}\rfloor$ edges, then it has a Hamiltonian cycle. R\"{o}dl, Ruci\'{n}ski and Szemer\'{e}di in 2011 proved that the conjecture is true when $k=3$ and $n$ is large. We show that this Katona-Kierstead conjecture holds if $k=4$, $n$ is large, and $V({\cal H})$ has a partition $A$, $B$ such that $|A|=\lceil n/2\rceil$, $|\{e\in E({\cal H}):|e \cap A|=2\}| <\epsilon n^4$ for a fixed small constant $\epsilon>0$.


title: Estimating articulatory movements in speech production with transformer networks

abstract: We estimate articulatory movements in speech production from different modalities - acoustics and phonemes. Acoustic-to articulatory inversion (AAI) is a sequence-to-sequence task. On the other hand, phoneme to articulatory (PTA) motion estimation faces a key challenge in reliably aligning the text and the articulatory movements. To address this challenge, we explore the use of a transformer architecture - FastSpeech, with explicit duration modelling to learn hard alignments between the phonemes and articulatory movements. We also train a transformer model on AAI. We use correlation coefficient (CC) and root mean squared error (rMSE) to assess the estimation performance in comparison to existing methods on both tasks. We observe 154%, 11.8% & 4.8% relative improvement in CC with subject-dependent, pooled and fine-tuning strategies, respectively, for PTA estimation. Additionally, on the AAI task, we obtain 1.5%, 3% and 3.1% relative gain in CC on the same setups compared to the state-of-the-art baseline. We further present the computational benefits of having transformer architecture as representation blocks.


title: TedNet: A Pytorch Toolkit for Tensor Decomposition Networks

abstract: Tensor Decomposition Networks (TDNs) prevail for their inherent compact architectures. To give more researchers a flexible way to exploit TDNs, we present a Pytorch toolkit named TedNet. TedNet implements 5 kinds of tensor decomposition(i.e., CANDECOMP/PARAFAC (CP), Block-Term Tucker (BTT), Tucker-2, Tensor Train (TT) and Tensor Ring (TR) on traditional deep neural layers, the convolutional layer and the fully-connected layer. By utilizing the basic layers, it is simple to construct a variety of TDNs. TedNet is available at https://github.com/tnbar/tednet.


title: Fickian yet non-Gaussian diffusion in two-dimensional Yukawa liquids

abstract: We investigate Fickian diffusion in two-dimensional (2D) Yukawa liquids using molecular dynamics simulations. We compute the self-van Hove correlation function $G_s(r,t)$, and the self-intermediate scattering function $F_s(k,t)$ and compare these functions with those obtained from mean-squared displacement MSD using the Gaussian approximation. According to this approximation, a linear MSD with time implies a Gaussian behavior for $G_s(r,t)$ and $F_s(k,t)$ at all times. Surprisingly, we find that these functions deviate from Gaussian at intermediate time scales, indicating the failure of the Gaussian approximation. Furthermore, we quantify these deviations by the non-Gaussian parameter, and we find that the deviations increase with decreasing the temperature of the liquid. The origin of the non-Gaussian behavior may be the heterogeneous dynamics of dust particles observed in 2D Yukawa liquids.


title: Dynamics and Stress Relaxation of Bidisperse Polymer Melts with Unentangled and Moderately Entangled Chains

abstract: Polydispersity is inevitable in industrially produced polymers. Established theories of polymer dynamics and rheology, however, were mostly built on monodisperse linear polymers. Dynamics of polydisperse polymers is yet to be fully explored -- especially how chains of different lengths affect the dynamics of one another in a mixture. This study explored the dynamics of bidisperse polymer melts using molecular dynamics and a bead-spring chain model. Binary mixtures between a moderately entangled long-chain species and an unentangled or marginally entangled short-chain species were investigated. We found that adding short chains can significantly accelerate the dynamics of the long chains by substantially lessening their extent of entanglement. Meanwhile, although introducing long chains also hinders the motion of the short chains, it does not qualitatively alter the nature of their dynamics -- unentangled short chains still follow classical Rouse dynamics even in a matrix containing entangled chains. Detailed Rouse mode analysis was used to reveal the effects of entanglement at chain segments of different scales. Stress relaxation following a step shear strain was also studied and semi-empirical mixing rules that predict the linear viscoelasticity of polydisperse polymers based on that of monodisperse systems were evaluated with simulation results.


title: CovNet: Covariance Networks for Functional Data on Multidimensional Domains

abstract: Covariance estimation is ubiquitous in functional data analysis. Yet, the case of functional observations over multidimensional domains introduces computational and statistical challenges, rendering the standard methods effectively inapplicable. To address this problem, we introduce "Covariance Networks" (CovNet) as a modeling and estimation tool. The CovNet model is "universal" - it can be used to approximate any covariance up to desired precision. Moreover, the model can be fitted efficiently to the data and its neural network architecture allows us to employ modern computational tools in the implementation. The CovNet model also admits a closed-form eigendecomposition, which can be computed efficiently, without constructing the covariance itself. This facilitates easy storage and subsequent manipulation of a covariance in the context of the CovNet. We establish consistency of the proposed estimator and derive its rate of convergence. The usefulness of the proposed method is demonstrated by means of an extensive simulation study and an application to resting state fMRI data.


title: WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia

abstract: Cross-document event coreference resolution is a foundational task for NLP applications involving multi-text processing. However, existing corpora for this task are scarce and relatively small, while annotating only modest-size clusters of documents belonging to the same topic. To complement these resources and enhance future research, we present Wikipedia Event Coreference (WEC), an efficient methodology for gathering a large-scale dataset for cross-document event coreference from Wikipedia, where coreference links are not restricted within predefined topics. We apply this methodology to the English Wikipedia and extract our large-scale WEC-Eng dataset. Notably, our dataset creation method is generic and can be applied with relatively little effort to other Wikipedia languages. To set baseline results, we develop an algorithm that adapts components of state-of-the-art models for within-document coreference resolution to the cross-document setting. Our model is suitably efficient and outperforms previously published state-of-the-art results for the task.


title: Robust Image Watermarking in Wavelet Domain using GBT-DWT-SVD and Whale Optimization Algorithm

abstract: As digital content can be copied easily, Copyright infringement has become a concern nowadays. Providing a solution to prevent the abuse of such contents is very necessary. One of the most common methods to solve this problem is watermarking. In this method, a logo belongs to the owner of the media is embedded in the media. So, they can prove the originality or ownership of the media content. Images are one of the most important digital media. Therefore, in this study, a method for digital image watermarking is proposed. The proposed method is based on Graph-based Transform (GBT), Singular Value Decomposition (SVD), and Discrete Wavelet Transform (DWT) which uses a Whale Optimization Algorithm (WOA) to find the best value for the embedding coefficient in the images as well as optimal blocks. The image is first transformed to a transform domain using the DWT and GBT, and then the watermark logo embedded onto the singular values of the cover image. The objective function defined for this task is based on the three parameters PSNR and NC, in the presence of image attacks. The results of the proposed algorithm on some known images show a high performance of this method compared to other similar methods.


title: A Kernel-free Boundary Integral Method for the Bidomain Equations

abstract: The bidomain equations have been widely used to mathematically model the electrical activity of the cardiac tissue. In this work, we present a potential theory-based Cartesian grid method which is referred as the kernel-free boundary integral (KFBI) method which works well on complex domains to efficiently simulate the linear diffusion part of the bidomain equation. After a proper temporal discretization, the KFBI method is applied to solve the resulting homogeneous Neumann boundary value problems with a second-order accuracy. According to the potential theory, the boundary integral equations reformulated from the boundary value problems can be solved iteratively with the simple Richardson iteration or the Krylov subspace iteration method. During the iteration, the boundary and volume integrals are evaluated by limiting the structured grid-based discrete solutions of the equivalent interface problems at quasi-uniform interface nodes without the need to know the analytical expression of Green's functions. In particular, the discrete linear system of the equivalent interface problem obtained from the standard finite difference schemes or the finite element schemes can be efficiently solved by fast elliptic solvers such as the fast Fourier transform based solvers or those based on geometric multigrid iterations after an appropriate modification at the irregular grid nodes. Numerical results for solving the FitzHugh-Nagumo bidomain equations in both two- and three-dimensional spaces are presented to demonstrate the numerical performance of the KFBI method such as the second-order accuracy and the propagation and scroll wave of the voltage simulated on the real human left ventricle model.


title: New Insights on Reducing Abrupt Representation Change in Online Continual Learning

abstract: In the online continual learning paradigm, agents must learn from a changing distribution while respecting memory and compute constraints. Experience Replay (ER), where a small subset of past data is stored and replayed alongside new data, has emerged as a simple and effective learning strategy. In this work, we focus on the change in representations of observed data that arises when previously unobserved classes appear in the incoming data stream, and new classes must be distinguished from previous ones. We shed new light on this question by showing that applying ER causes the newly added classes' representations to overlap significantly with the previous classes, leading to highly disruptive parameter updates. Based on this empirical analysis, we propose a new method which mitigates this issue by shielding the learned representations from drastic adaptation to accommodate new classes. We show that using an asymmetric update rule pushes new classes to adapt to the older ones (rather than the reverse), which is more effective especially at task boundaries, where much of the forgetting typically occurs. Empirical results show significant gains over strong baselines on standard continual learning benchmarks.


title: On performance of PBFT for IoT-applications with constrained devices

abstract: Cyber-physical systems and the Internet of things (IoT) is becoming an integral part of the digital society. The use of IoT services improves human life in many ways. Protection against cyber threats is an important aspect of the functioning of IoT devices. Malicious activities lead to confidential data leakages and incorrect performance of devices are becoming critical. Therefore, development of effective solutions that can protect both IoT devices data and data exchange networks turns in to a real challenge. This study provides a critical analysis of the feasibility of using blockchain technology to protect constrained IoT devices data, justifies the choice of Practical Byzantine Fault Tolerance (PBFT) consensus algorithm for implementation on such devices, and simulates the main distributed ledger scenarios using PBFT. The simulation results demonstrate the efficiency of the blockchain technology for constrained devices and make it possible to evaluate the applicability limits of the chosen consensus algorithm.


title: The Second Law of Quantum Complexity and the Entanglement Wormhole

abstract: This work is originally a Cambridge Part III essay paper. Quantum complexity arises as an alternative measure to the Fubini metric between two quantum states. Given two states and a set of allowed gates, it is defined as the least complex unitary operator capable of transforming one state into the other. Starting with K qubits evolving through a k-local Hamiltonian, it is possible to draw an analogy between the quantum system and an auxiliary classical system. Using the definition of complexity to define a metric for the classical system, it is possible to relate its entropy with the quantum complexity of the K qubits, defining the Second Law of Quantum Complexity. The law states that, if it is not already saturated, the quantum complexity of a system will increase with an overwhelming probability towards its maximum value. In the context of AdS/CFT duality and the ER=EPR conjecture, the growth of the volume of the Einstein Rosen bridge interior is proportional to the quantum complexity of the instantaneous state of the conformal field theory. Therefore, the interior of the wormhole connecting two entangled CFT will grow as a natural consequence of the complexification of the boundary state.


title: Blind Primed Supervised (BLIPS) Learning for MR Image Reconstruction

abstract: This paper examines a combined supervised-unsupervised framework involving dictionary-based blind learning and deep supervised learning for MR image reconstruction from under-sampled k-space data. A major focus of the work is to investigate the possible synergy of learned features in traditional shallow reconstruction using adaptive sparsity-based priors and deep prior-based reconstruction. Specifically, we propose a framework that uses an unrolled network to refine a blind dictionary learning-based reconstruction. We compare the proposed method with strictly supervised deep learning-based reconstruction approaches on several datasets of varying sizes and anatomies. We also compare the proposed method to alternative approaches for combining dictionary-based methods with supervised learning in MR image reconstruction. The improvements yielded by the proposed framework suggest that the blind dictionary-based approach preserves fine image details that the supervised approach can iteratively refine, suggesting that the features learned using the two methods are complementary


title: Jet performance at the Circular electron-positron Collider

abstract: Jet reconstruction is critical for the precision measurement of Higgs boson properties and the electroweak observables at the CEPC. We analyze the jet energy and angular responses of benchmark 2- and 4-jet processes with fully simulated samples with the CEPC baseline detector geometry. We observe a relative resolution of 3.5$\%$ and 1$\%$ on the jet energy and angular measurement for jets in the detector barrel region ($|cos{\theta}| < 0.6$) with energy greater than 60 GeV. Meanwhile, the jet energy/angular scale can be controlled within 0.5/0.01$\%$. The differential dependences of the jet response on the jet direction and energy are extracted. We also analyze the impact on the jet responses induced by different jet clustering algorithms and matching criteria, which yields a relative difference of up to 8$\%$.


title: Social Virtual Reality: Ethical Considerations and Future Directions for An Emerging Research Space

abstract: The boom of commercial social virtual reality (VR) platforms in recent years has signaled the growth and wide-spread adoption of consumer VR. Social VR platforms draw aspects from traditional 2D virtual worlds where users engage in various immersive experiences, interactive activities, and choices in avatar-based representation. However, social VR also demonstrates specific nuances that extend traditional 2D virtual worlds and other online social spaces, such as full/partial body tracked avatars, experiencing mundane everyday activities in a new way (e.g., sleeping), and an immersive means to explore new and complex identities. The growing popularity has signaled interest and investment from top technology companies who each have their own social VR platforms. Thus far, social VR has become an emerging research space, mainly focusing on design strategies, communication and interaction modalities, nuanced activities, self-presentation, harassment, privacy, and self-disclosure. These recent works suggest that many questions still remain in social VR scholarship regarding how to ethically conduct research on these sites and which research areas require additional attention. Therefore, in this paper, we provide an overview of modern Social VR, critically review current scholarship in the area, raise ethical considerations for conducting research on these sites, and highlight unexplored areas.


title: Deformable Capsules for Object Detection

abstract: In this study, we introduce a new family of capsule networks, deformable capsules (DeformCaps), to address a very important problem in computer vision: object detection. We propose two new algorithms associated with our DeformCaps: a novel capsule structure (SplitCaps), and a novel dynamic routing algorithm (SE-Routing), which balance computational efficiency with the need for modeling a large number of objects and classes, which have never been achieved with capsule networks before. We demonstrate that the proposed methods allow capsules to efficiently scale-up to large-scale computer vision tasks for the first time, and create the first-ever capsule network for object detection in the literature. Our proposed architecture is a one-stage detection framework and obtains results on MS COCO which are on-par with state-of-the-art one-stage CNN-based methods, while producing fewer false positive detections, generalizing to unusual poses/viewpoints of objects.


title: Rotational diode: Clockwise/counterclockwise asymmetry in conducting and mechanical properties of rotating (semi)conductors

abstract: We argue that certain materials exhibit asymmetry of their mechanical and conducting properties with respect to clockwise/counterclockwise rotation. We show that a cylinder made of a suitably chosen semiconductor coated in a metallic film and placed in the magnetic-field background can serve as a "rotational diode" which conducts electricity only at a specific range of angular frequencies. The critical angular frequency and the direction of rotation can be tuned with the magnetic field's strength. Mechanically, the rotational diode possesses different moments of inertia when rotated in clockwise and counterclockwise directions. These effects emerge as a particularity of the Fermi-Dirac statistics of electrons in rotating conductors.


title: Mission Design for the TAIJI misson and Structure Formation in Early Universe

abstract: Gravitational wave detection in space promises to open a new window in astronomy to study the strong field dynamics of gravitational physics in astrophysics and cosmology. The present article is an extract of a report on a feasibility study of gravitational wave detection in space, commissioned by the National Space Science Center, Chinese Academy of Sciences almost a decade ago. The objective of the study was to explore various possible mission options to detect gravitational waves in space alternative to that of the (e)LISA mission concept and look into the requirements on the technological fronts. On the basis of relative merits and balance between science and technological feasibility, a set of representative mission options were studied and in the end a mission design was recommended as the starting point for research and development in the Chinese Academy of Sciences. The mission design was eventually adopted by the current TAIJI mission as the baseline parameters for the project. Subject to technological constraints, the baseline parameters of the TAIJI mission were designed in such a way to optimise the capability of a spaceborne gravitational wave detector to probe high redshift light seed, intermediate mass black holes and thereby shed important light on the structure formation in early Universe.


title: Time-Dependent Atomistic Simulations of the CP29 Light-Harvesting Complex

abstract: Light harvesting as the first step in photosynthesis is of prime importance for life on earth. For a theoretical description of photochemical processes during light harvesting, spectral densities are key quantities. They serve as input functions for modeling the excitation energy transfer dynamics and spectroscopic properties. Herein, a recently developed procedure is applied to determine the spectral densities of the pigments in the minor antenna complex CP29 of photosystem II which has recently gained attention because of its active role in non-photochemical quenching processes in higher plants. To this end, the density functional based tight binding (DFTB) method has been employed to enable simulation of the ground state dynamics in a quantum-mechanics/molecular mechanics (QM/MM) scheme for each chlorophyll pigment. Subsequently, the time-dependent extension of the long-range corrected DFTB approach has been used to obtain the excitation energy fluctuations along the ground-state trajectories also in a QM/MM setting. From these results the spectral densities have been determined and compared for different force fields and to spectral densities from other light-harvesting complexes. In addition, the excitation energy transfer in the CP29 complex has been studied using ensemble-average wave packet dynamics.


title: A Hybrid Parallelization Approach for Distributed and Scalable Deep Learning

abstract: Recently, Deep Neural Networks (DNNs) have recorded great success in handling medical and other complex classification tasks. However, as the sizes of a DNN model and the available dataset increase, the training process becomes more complex and computationally intensive, which usually takes a longer time to complete. In this work, we have proposed a generic full end-to-end hybrid parallelization approach combining both model and data parallelism for efficiently distributed and scalable training of DNN models. We have also proposed a Genetic Algorithm based heuristic resources allocation mechanism (GABRA) for optimal distribution of partitions on the available GPUs for computing performance optimization. We have applied our proposed approach to a real use case based on 3D Residual Attention Deep Neural Network (3D-ResAttNet) for efficient Alzheimer Disease (AD) diagnosis on multiple GPUs. The experimental evaluation shows that the proposed approach is efficient and scalable, which achieves almost linear speedup with little or no differences in accuracy performance when compared with the existing non-parallel DNN models.


title: GR-RNN: Global-Context Residual Recurrent Neural Networks for Writer Identification

abstract: This paper presents an end-to-end neural network system to identify writers through handwritten word images, which jointly integrates global-context information and a sequence of local fragment-based features. The global-context information is extracted from the tail of the neural network by a global average pooling step. The sequence of local and fragment-based features is extracted from a low-level deep feature map which contains subtle information about the handwriting style. The spatial relationship between the sequence of fragments is modeled by the recurrent neural network (RNN) to strengthen the discriminative ability of the local fragment features. We leverage the complementary information between the global-context and local fragments, resulting in the proposed global-context residual recurrent neural network (GR-RNN) method. The proposed method is evaluated on four public data sets and experimental results demonstrate that it can provide state-of-the-art performance. In addition, the neural networks trained on gray-scale images provide better results than neural networks trained on binarized and contour images, indicating that texture information plays an important role for writer identification. The source code will be available: \url{https://github.com/shengfly/writer-identification}.


title: Guided Incremental Local Densification for Accelerated Sampling-based Motion Planning

abstract: Sampling-based motion planners rely on incremental densification to discover progressively shorter paths. After computing feasible path $\xi$ between start $x_s$ and goal $x_t$, the Informed Set (IS) prunes the configuration space $\mathcal{C}$ by conservatively eliminating points that cannot yield shorter paths. Densification via sampling from this Informed Set retains asymptotic optimality of sampling from the entire configuration space. For path length $c(\xi)$ and Euclidean heuristic $h$, $IS = \{ x | x \in \mathcal{C}, h(x_s, x) + h(x, x_t) \leq c(\xi) \}$. Relying on the heuristic can render the IS especially conservative in high dimensions or complex environments. Furthermore, the IS only shrinks when shorter paths are discovered. Thus, the computational effort from each iteration of densification and planning is wasted if it fails to yield a shorter path, despite improving the cost-to-come for vertices in the search tree. Our key insight is that even in such a failure, shorter paths to vertices in the search tree (rather than just the goal) can immediately improve the planner's sampling strategy. Guided Incremental Local Densification (GuILD) leverages this information to sample from Local Subsets of the IS. We show that GuILD significantly outperforms uniform sampling of the Informed Set in simulated $\mathbb{R}^2$, $SE(2)$ environments and manipulation tasks in $\mathbb{R}^7$.


title: Reduced variance analysis of molecular dynamics simulations by linear combination of estimators

abstract: Building upon recent developments of force-based estimators with a reduced variance for the computation of densities, radial distribution functions or local transport properties from molecular simulations, we show that the variance can be further reduced by considering optimal linear combinations of such estimators. This control variates approach, well known in Statistics and already used in other branches of computational Physics, has been comparatively much less exploited in molecular simulations. We illustrate this idea on the radial distribution function and the one-dimensional density of a bulk and confined Lennard-Jones fluid, where the optimal combination of estimators is determined for each distance or position, respectively. In addition to reducing the variance everywhere at virtually no additional cost, this approach cures an artefact of the initial force-based estimators, namely small but non-zero values of the quantities in regions where they should vanish. Beyond the examples considered here, the present work highlights more generally the underexplored potential of control variates to estimate observables from molecular simulations.


title: Solvable dilation model of $\cal PT$-symmetric systems

abstract: The dilation method is a practical way to experimentally simulate non-Hermitian, especially $\cal PT$-symmetric quantum systems. However, the time-dependent dilation problem cannot be explicitly solved in general. In this paper, we present a simple yet non-trivial exactly solvable dilation problem with two dimensional time-dependent $\cal PT$-symmetric Hamiltonian. Our system is initially set in the unbroken $\cal PT$-symmetric phase and later goes across the so-called exceptional point and enters the broken $\cal PT$-symmetric phase. For this system, the dilated Hamiltonian and the evolution of $\cal PT$-symmetric system are analytically worked out. Our result clearly showed that the exceptional points do not have much physical relevance in a \textit{time-dependent} system.


title: ODT FLOW: A Scalable Platform for Extracting, Analyzing, and Sharing Multi-source Multi-scale Human Mobility

abstract: In response to the soaring needs of human mobility data, especially during disaster events such as the COVID-19 pandemic, and the associated big data challenges, we develop a scalable online platform for extracting, analyzing, and sharing multi-source multi-scale human mobility flows. Within the platform, an origin-destination-time (ODT) data model is proposed to work with scalable query engines to handle heterogenous mobility data in large volumes with extensive spatial coverage, which allows for efficient extraction, query, and aggregation of billion-level origin-destination (OD) flows in parallel at the server-side. An interactive spatial web portal, ODT Flow Explorer, is developed to allow users to explore multi-source mobility datasets with user-defined spatiotemporal scales. To promote reproducibility and replicability, we further develop ODT Flow REST APIs that provide researchers with the flexibility to access the data programmatically via workflows, codes, and programs. Demonstrations are provided to illustrate the potential of the APIs integrating with scientific workflows and with the Jupyter Notebook environment. We believe the platform coupled with the derived multi-scale mobility data can assist human mobility monitoring and analysis during disaster events such as the ongoing COVID-19 pandemic and benefit both scientific communities and the general public in understanding human mobility dynamics.


title: A Phase Transition Phenomenon for Ruin Probabilities in a Network of Agents and Objects

abstract: The classical Cram\'er-Lundberg risk process models the ruin probability of an insurance company experiencing an incoming cash flow - the premium income, and an outgoing cash flow - the claims. From a system's viewpoint, the web of insurance agents and risk objects can be represented by a bipartite network. In such a bipartite network setting, it has been shown that joint ruin of a group of agents may be avoided even if individual agents would experience ruin in the classical Cram\'er-Lundberg model. This paper describes and examines a phase transition phenomenon for these ruin probabilities.


title: Archimedean zeta integrals for $GL(3)\times GL(2)$

abstract: In this article, we give explicit formulas of archimedean Whittaker functions on $GL(3)$ and $GL(2)$. Moreover, we apply those to the calculation of archimedean zeta integrals for $GL(3)\times GL(2)$, and show that the zeta integral for appropriate Whittaker functions is equal to the associated $L$-factors.


title: Learn Goal-Conditioned Policy with Intrinsic Motivation for Deep Reinforcement Learning

abstract: It is of significance for an agent to learn a widely applicable and general-purpose policy that can achieve diverse goals including images and text descriptions. Considering such perceptually-specific goals, the frontier of deep reinforcement learning research is to learn a goal-conditioned policy without hand-crafted rewards. To learn this kind of policy, recent works usually take as the reward the non-parametric distance to a given goal in an explicit embedding space. From a different viewpoint, we propose a novel unsupervised learning approach named goal-conditioned policy with intrinsic motivation (GPIM), which jointly learns both an abstract-level policy and a goal-conditioned policy. The abstract-level policy is conditioned on a latent variable to optimize a discriminator and discovers diverse states that are further rendered into perceptually-specific goals for the goal-conditioned policy. The learned discriminator serves as an intrinsic reward function for the goal-conditioned policy to imitate the trajectory induced by the abstract-level policy. Experiments on various robotic tasks demonstrate the effectiveness and efficiency of our proposed GPIM method which substantially outperforms prior techniques.


title: USACv20: robust essential, fundamental and homography matrix estimation

abstract: We review the most recent RANSAC-like hypothesize-and-verify robust estimators. The best performing ones are combined to create a state-of-the-art version of the Universal Sample Consensus (USAC) algorithm. A recent objective is to implement a modular and optimized framework, making future RANSAC modules easy to be included. The proposed method, USACv20, is tested on eight publicly available real-world datasets, estimating homographies, fundamental and essential matrices. On average, USACv20 leads to the most geometrically accurate models and it is the fastest in comparison to the state-of-the-art robust estimators. All reported properties improved performance of original USAC algorithm significantly. The pipeline will be made available after publication.


title: The logarithmic Sobolev inequality for a submanifold in manifold with nonnegative sectional curvature

abstract: We prove a sharp logarithmic Sobolev inequality which holds for compact submanifolds without boundary in Riemannian manifold with nonnegative sectional curvature of arbitrary dimension and codimension, while the ambient manifold needs to have a specific Euclid-like property. Like the Michael-Simon Sobolev inequality, this inequality includes a term involving the mean curvature. This extends a recent result of S. Brendle with Euclidean setting.


title: Print Error Detection using Convolutional Neural Networks

abstract: This paper discusses the need of an automated system for detecting print errors and the efficacy of Convolutional Neural Networks in such an application. We recognise the need of a dataset containing print error samples and propose a way to generate one artificially. We discuss the algorithms to generate such data along with the limitaions and advantages of such an apporach. Our final trained network gives a remarkable accuracy of 99.83\% in testing. We further evaluate how such efficiency was achieved and what modifications can be tested to further the results.


title: Dynamic Modeling of User Preferences for Stable Recommendations

abstract: In domains where users tend to develop long-term preferences that do not change too frequently, the stability of recommendations is an important factor of the perceived quality of a recommender system. In such cases, unstable recommendations may lead to poor personalization experience and distrust, driving users away from a recommendation service. We propose an incremental learning scheme that mitigates such problems through the dynamic modeling approach. It incorporates a generalized matrix form of a partial differential equation integrator that yields a dynamic low-rank approximation of time-dependent matrices representing user preferences. The scheme allows extending the famous PureSVD approach to time-aware settings and significantly improves its stability without sacrificing the accuracy in standard top-$n$ recommendations tasks.


title: Rank-R FNN: A Tensor-Based Learning Model for High-Order Data Classification

abstract: An increasing number of emerging applications in data science and engineering are based on multidimensional and structurally rich data. The irregularities, however, of high-dimensional data often compromise the effectiveness of standard machine learning algorithms. We hereby propose the Rank-R Feedforward Neural Network (FNN), a tensor-based nonlinear learning model that imposes Canonical/Polyadic decomposition on its parameters, thereby offering two core advantages compared to typical machine learning methods. First, it handles inputs as multilinear arrays, bypassing the need for vectorization, and can thus fully exploit the structural information along every data dimension. Moreover, the number of the model's trainable parameters is substantially reduced, making it very efficient for small sample setting problems. We establish the universal approximation and learnability properties of Rank-R FNN, and we validate its performance on real-world hyperspectral datasets. Experimental evaluations show that Rank-R FNN is a computationally inexpensive alternative of ordinary FNN that achieves state-of-the-art performance on higher-order tensor data.


title: Learning representations with end-to-end models for improved remaining useful life prognostics

abstract: The remaining Useful Life (RUL) of equipment is defined as the duration between the current time and its failure. An accurate and reliable prognostic of the remaining useful life provides decision-makers with valuable information to adopt an appropriate maintenance strategy to maximize equipment utilization and avoid costly breakdowns. In this work, we propose an end-to-end deep learning model based on multi-layer perceptron and long short-term memory layers (LSTM) to predict the RUL. After normalization of all data, inputs are fed directly to an MLP layers for feature learning, then to an LSTM layer to capture temporal dependencies, and finally to other MLP layers for RUL prognostic. The proposed architecture is tested on the NASA commercial modular aero-propulsion system simulation (C-MAPSS) dataset. Despite its simplicity with respect to other recently proposed models, the model developed outperforms them with a significant decrease in the competition score and in the root mean square error score between the predicted and the gold value of the RUL. In this paper, we will discuss how the proposed end-to-end model is able to achieve such good results and compare it to other deep learning and state-of-the-art methods.


title: Research on Optimization Method of Multi-scale Fish Target Fast Detection Network

abstract: The fish target detection algorithm lacks a good quality data set, and the algorithm achieves real-time detection with lower power consumption on embedded devices, and it is difficult to balance the calculation speed and identification ability. To this end, this paper collected and annotated a data set named "Aquarium Fish" of 84 fishes containing 10042 images, and based on this data set, proposed a multi-scale input fast fish target detection network (BTP-yoloV3) and its optimization method. The experiment uses Depthwise convolution to redesign the backbone of the yoloV4 network, which reduces the amount of calculation by 94.1%, and the test accuracy is 92.34%. Then, the training model is enhanced with MixUp, CutMix, and mosaic to increase the test accuracy by 1.27%; Finally, use the mish, swish, and ELU activation functions to increase the test accuracy by 0.76%. As a result, the accuracy of testing the network with 2000 fish images reached 94.37%, and the computational complexity of the network BFLOPS was only 5.47. Comparing the YoloV3~4, MobileNetV2-yoloV3, and YoloV3-tiny networks of migration learning on this data set. The results show that BTP-Yolov3 has smaller model parameters, faster calculation speed, and lower energy consumption during operation while ensuring the calculation accuracy. It provides a certain reference value for the practical application of neural network.


title: On q-Horn hypergeometric functions $\mathbf{H}_6$ and $\mathbf{H}_7$

abstract: The aim of this work is to construct various interesting properties for basic Horn functions $\mathbf{H}_6$ and $\mathbf{H}_7$ under conditions on the denominator parameters, such as several $q$-contiguous function relations, $q$-differential relations, and $q$-differential equations. Special cases of our main results are also demonstrated.


title: Fabrication-aware Design for Furniture with Planar Pieces

abstract: We propose a computational design tool to enable casual end-users to easily design, fabricate, and assemble flat-pack furniture with guaranteed manufacturability. Using our system, users select parameterized components from a library and constrain their dimensions. Then they abstractly specify connections among components to define the furniture. Once fabrication specifications (e.g. materials) designated, the mechanical implementation of the furniture is automatically handled by leveraging encoded domain expertise. Afterwards, the system outputs 3D models for visualization and mechanical drawings for fabrication. We demonstrate the validity of our approach by designing, fabricating, and assembling a variety of flat-pack (scaled) furniture on demand.


title: Hausdorff approximations and volume of tubes of singular algebraic sets

abstract: We prove bounds for the volume of neighborhoods of algebraic sets, in the euclidean space or the sphere, in terms of the degree of the defining polynomials, the number of variables and the dimension of the algebraic set, without any smoothness assumption. This generalizes previous work of Lotz on smooth complete intersections in the euclidean space and of B\"urgisser, Cucker and Lotz on hypersurfaces in the sphere, and gives a complete solution to Problem 17 in the book titled "Condition" by B\"urgisser and Cucker.


title: Concentration Inequalities for Ultra Log-Concave Distributions

abstract: We establish concentration inequalities in the class of ultra log-concave distributions. In particular, we show that ultra log-concave distributions satisfy Poisson concentration bounds. As an application, we derive concentration bounds for the intrinsic volumes of a convex body, which generalizes and improves a result of Lotz, McCoy, Nourdin, Peccati, and Tropp (2019).


title: NeMo Inverse Text Normalization: From Development To Production

abstract: Inverse text normalization (ITN) converts spoken-domain automatic speech recognition (ASR) output into written-domain text to improve the readability of the ASR output. Many state-of-the-art ITN systems use hand-written weighted finite-state transducer(WFST) grammars since this task has extremely low tolerance to unrecoverable errors. We introduce an open-source Python WFST-based library for ITN which enables a seamless path from development to production. We describe the specification of ITN grammar rules for English, but the library can be adapted for other languages. It can also be used for written-to-spoken text normalization. We evaluate the NeMo ITN library using a modified version of the Google Text normalization dataset.


title: Convex co-compact groups with one dimensional boundary faces

abstract: In this paper we consider convex co-compact subgroups of the projective linear group. We prove that such a group is relatively hyperbolic with respect to a collection of virtually Abelian subgroups of rank two if and only if each open face in the ideal boundary has dimension at most one. We also introduce the "coarse Hilbert dimension" of a subset of a convex set and use it to characterize when a naive convex co-compact subgroup is word hyperbolic or relatively hyperbolic with respect to a collection of virtually Abelian subgroups of rank two.


title: Tree species, crown cover, and age as determinants of the vertical distribution of airborne LiDAR returns

abstract: Light detection and ranging (LiDAR) provides information on the vertical structure of forest stands enabling detailed and extensive ecosystem study. The vertical structure is often summarized by scalar features and data-reduction techniques that limit the interpretation of results. Instead, we quantified the influence of three variables, species, crown cover, and age, on the vertical distribution of airborne LiDAR returns from forest stands. We studied 5,428 regular, even-aged stands in Quebec (Canada) with five dominant species: balsam fir (Abies balsamea (L.) Mill.), paper birch (Betula papyrifera Marsh), black spruce (Picea mariana (Mill.) BSP), white spruce (Picea glauca Moench) and aspen (Populus tremuloides Michx.). We modeled the vertical distribution against the three variables using a functional general linear model and a novel nonparametric graphical test of significance. Results indicate that LiDAR returns from aspen stands had the most uniform vertical distribution. Balsam fir and white birch distributions were similar and centered at around 50% of the stand height, and black spruce and white spruce distributions were skewed to below 30% of stand height (p<0.001). Increased crown cover concentrated the distributions around 50% of stand height. Increasing age gradually shifted the distributions higher in the stand for stands younger than 70-years, before plateauing and slowly declining at 90-120 years. Results suggest that the vertical distributions of LiDAR returns depend on the three variables studied.


title: Singularities Almost Always Scatter: Regularity Results for Non-scattering Inhomogeneities

abstract: In this paper we examine necessary conditions for an inhomogeneity to be non-scattering, or equivalently, by negation, sufficient conditions for it to be scattering. These conditions are formulated in terms of the regularity of the boundary of the inhomogeneity. We examine broad classes of incident waves in both two and three dimensions. Our analysis is greatly influenced by the analysis carried out by Williams [28] in order to establish that a domain, which does not possess the Pompeiu Property, has a real analytic boundary. That analysis, as well as ours, relies crucially on classical free boundary regularity results due to Kinderlehrer and Nirenberg [18], and Caffarelli [6].


title: Application of Quantum Machine Learning using the Quantum Kernel Algorithm on High Energy Physics Analysis at the LHC

abstract: Quantum machine learning could possibly become a valuable alternative to classical machine learning for applications in High Energy Physics by offering computational speed-ups. In this study, we employ a support vector machine with a quantum kernel estimator (QSVM-Kernel method) to a recent LHC flagship physics analysis: $t\bar{t}H$ (Higgs boson production in association with a top quark pair). In our quantum simulation study using up to 20 qubits and up to 50000 events, the QSVM-Kernel method performs as well as its classical counterparts in three different platforms from Google Tensorflow Quantum, IBM Quantum and Amazon Braket. Additionally, using 15 qubits and 100 events, the application of the QSVM-Kernel method on the IBM superconducting quantum hardware approaches the performance of a noiseless quantum simulator. Our study confirms that the QSVM-Kernel method can use the large dimensionality of the quantum Hilbert space to replace the classical feature space in realistic physics datasets.


title: Towards SocialVR: Evaluating a Novel Technology for Watching Videos Together

abstract: Social VR enables people to interact over distance with others in real-time. It allows remote people, typically represented as avatars, to communicate and perform activities together in a join shared virtual environment, extending the capabilities of traditional social platforms like Facebook and Netflix. This paper explores the benefits and drawbacks provided by a lightweight and low-cost Social VR platform (SocialVR), in which users are captured by several cameras and reconstructed in real-time. In particular, the paper contributes with (1) the design and evaluation of an experimental protocol for Social VR experiences; (2) the report of a production workflow for this new type of media experiences; and (3) the results of experiments with both end-users (N=15 pairs) and professionals (N=25) to evaluate the potential of the SocialVR platform. Results from the questionnaires and semi-structured interviews show that end-users rated positively towards the experiences provided by the SocialVR platform, which enabled them to sense emotions and communicate effortlessly. End-users perceived the photo-realistic experience of SocialVR similar to face-to-face scenarios and appreciated this new creative medium. From a commercial perspective, professionals confirmed the potential of this communication medium and encourage further research for the adoption of the platform in the commercial landscape


title: Matter perturbations in Einstein dark energy model

abstract: We consider the growth rate of matter perturbations in the Einstein dark energy theory. The theory consists of the Einstien-Hilbert Lagrangian plus the trace of the energy momentum tensor, coupled non-minimally to a dynamical vector field. We will show that the theory has three fixed points corresponding to the dust, radiation and de Sitter universes. Due to the present of trace of the energy-momentum tensor in the Lagrangian, the fixed points occurs in different locations compared to $\Lambda$CDM theory. We will analyze the theory with and without cosmological constant. We will fit the model parameters using two independent data sets corresponding to the Hubble parameter $H$ and also $f\sigma_8$. The theory is then shown to be consistent with observational data.


title: Achieving Model Robustness through Discrete Adversarial Training

abstract: Discrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the purpose of evaluating model robustness, their utility for improving robustness has been limited to offline augmentation only. Concretely, given a trained model, attacks are used to generate perturbed (adversarial) examples, and the model is re-trained exactly once. In this work, we address this gap and leverage discrete attacks for online augmentation, where adversarial examples are generated at every training step, adapting to the changing nature of the model. We propose (i) a new discrete attack, based on best-first search, and (ii) random sampling attacks that unlike prior work are not based on expensive search-based procedures. Surprisingly, we find that random sampling leads to impressive gains in robustness, outperforming the commonly-used offline augmentation, while leading to a speedup at training time of ~10x. Furthermore, online augmentation with search-based attacks justifies the higher training cost, significantly improving robustness on three datasets. Last, we show that our new attack substantially improves robustness compared to prior methods.


title: On the trace embedding and its applications to evolution equations

abstract: In this paper we consider traces at initial times for functions with mixed time-space smoothness. Such results are often needed in the theory of evolution equations. Our result extends and unifies many previous results. Our main improvement is that we can allow general interpolation couples. The abstract results are applied to regularity problems for fractional evolution equations and stochastic evolution equation, where uniform trace estimates on the half-line are shown.


title: Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modeling

abstract: Neural topic models can augment or replace bag-of-words inputs with the learned representations of deep pre-trained transformer-based word prediction models. One added benefit when using representations from multilingual models is that they facilitate zero-shot polylingual topic modeling. However, while it has been widely observed that pre-trained embeddings should be fine-tuned to a given task, it is not immediately clear what supervision should look like for an unsupervised task such as topic modeling. Thus, we propose several methods for fine-tuning encoders to improve both monolingual and zero-shot polylingual neural topic modeling. We consider fine-tuning on auxiliary tasks, constructing a new topic classification task, integrating the topic classification objective directly into topic model training, and continued pre-training. We find that fine-tuning encoder representations on topic classification and integrating the topic classification task directly into topic modeling improves topic quality, and that fine-tuning encoder representations on any task is the most important factor for facilitating cross-lingual transfer.