title: Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Context

abstract: Documents are often used for knowledge sharing and preservation in business and science, within which are tables that capture most of the critical data. Unfortunately, most documents are stored and distributed as PDF or scanned images, which fail to preserve logical table structure. Recent vision-based deep learning approaches have been proposed to address this gap, but most still cannot achieve state-of-the-art results. We present Global Table Extractor (GTE), a vision-guided systematic framework for joint table detection and cell structured recognition, which could be built on top of any object detection model. With GTE-Table, we invent a new penalty based on the natural cell containment constraint of tables to train our table network aided by cell location predictions. GTE-Cell is a new hierarchical cell detection network that leverages table styles. Further, we design a method to automatically label table and cell structure in existing documents to cheaply create a large corpus of training and test data. We use this to enhance PubTabNet with cell labels and create FinTabNet, real-world and complex scientific and financial datasets with detailed table structure annotations to help train and test structure recognition. Our framework surpasses previous state-of-the-art results on the ICDAR 2013 and ICDAR 2019 table competition in both table detection and cell structure recognition with a significant 5.8% improvement in the full table extraction system. Further experiments demonstrate a greater than 45% improvement in cell structure recognition when compared to a vanilla RetinaNet object detection model in our new out-of-domain FinTabNet.


title: Multiple scattering theory for strong scattering heterogeneous elastic continua with triaxial inhomogeneities: theoretical fundamentals and applications

abstract: The geometry of mesoscopic inhomogeneities plays an important role in determining the macroscopic propagation behaviors of elastic waves in a heterogeneous medium. Nonequiaxed inhomogeneities can lead to anisotropic wave velocity and attenuation. Developing an accurate scattering theory to describe the quantitative relation between the microstructure features and wave propagation parameters is of fundamental importance for seismology and ultrasonic nondestructive characterization. This work presents a multiple scattering theory for strongly scattering elastic media with general triaxial heterogeneities. A closed analytical expression of the shape dependent singularity of the anisotropic Green tensor for the homogeneous reference medium is derived by introducing a proper nonorthogonal ellipsoidal coordinate. Renormalized Dyson equation for the coherent wave field is then derived with the help of Feynman diagram technique and the first order smoothing approximation. The exact dispersion curves and the inverse Q-factors of coherent waves in several representative medium models for the heterogeneous lithosphere are calculated numerically. Numerical results for smallscale heterogeneities with the aspect ratio varying from 1 to 7 show satisfactory agreement with those obtained from real earthquakes. The results for velocity dispersion give rise to a novel explanation to the formation mechanism of different seismic phases. The new model has potential applications in seismology and ultrasonic microstructure characterization.


title: Spin-Lasers: Spintronics Beyond Magnetoresistance

abstract: Introducing spin-polarized carriers in semiconductor lasers reveals an alternative path to realize room-temperature spintronic applications, beyond the usual magnetoresistive effects. Through carrier recombination, the angular momentum of the spin-polarized carriers is transferred to photons, thus leading to the circularly polarized emitted light. The intuition for the operation of such spin-lasers can be obtained from simple bucket and harmonic oscillator models, elucidating their steady-state and dynamic response, respectively. These lasers extend the functionalities of spintronic devices and exceed the performance of conventional (spin-unpolarized) lasers, including an order of magnitude faster modulation frequency. Surprisingly, this ultrafast operation relies on a short carrier spin relaxation time and a large anisotropy of the refractive index, both viewed as detrimental in spintronics and conventional lasers. Spin-lasers provide a platform to test novel concepts in spin devices and offer progress connected to the advances in more traditional areas of spintronics.


title: Integrated Time Series Summarization and Prediction Algorithm and its Application to COVID-19 Data Mining

abstract: This paper proposes a simple method to extract from a set of multiple related time series a compressed representation for each time series based on statistics for the entire set of all time series. This is achieved by a hierarchical algorithm that first generates an alphabet of shapelets based on the segmentation of centroids for clustered data, before labels of these shapelets are assigned to the segmentation of each single time series via nearest neighbor search using unconstrained dynamic time warping as distance measure to deal with non-uniform time series lenghts. Thereby, a sequence of labels is assigned for each time series. Completion of the last label sequence permits prediction of individual time series. Proposed method is evaluated on two global COVID-19 datasets, first, for the number of daily net cases (daily new infections minus daily recoveries), and, second, for the number of daily deaths attributed to COVID-19 as of April 27, 2020. The first dataset involves 249 time series for different countries, each of length 96. The second dataset involves 264 time series, each of length 96. Based on detected anomalies in available data a decentralized exit strategy from lockdowns is advocated.


title: Strong subalgebras and the Constraint Satisfaction Problem

abstract: In 2007 it was conjectured that the Constraint Satisfaction Problem (CSP) over a constraint language $\Gamma$ is tractable if and only if $\Gamma$ is preserved by a weak near-unanimity (WNU) operation. After many efforts and partial results, this conjecture was independently proved by Andrei Bulatov and the author in 2017. In this paper we consider one of two main ingredients of my proof, that is, strong subalgebras that allow us to reduce domains of the variables iteratively. To explain how this idea works we show the algebraic properties of strong subalgebras and provide self-contained proof of two important facts about the complexity of the CSP. First, we prove that if a constraint language is not preserved by a WNU operation then the corresponding CSP is NP-hard. Second, we characterize all constraint languages that can be solved by local consistency checking. Additionally, we characterize all idempotent algebras not having a WNU term of a concrete arity $n$, not having a WNU term, having WNU terms of all arities greater than 2. Most of the results presented in the paper are not new, but I believe this paper can help to understand my approach to CSP and the new self-contained proof of known facts will be also useful.


title: Discussion of digital gaming's impact on players' well-being during the COVID-19 lockdown

abstract: This research discusses how to utilise digital gaming to support the well-being of its users and sustain their physical and mental health during the COVID-19 lockdown in which people's activities are limited. The published academic literature that is written in English and available for access on online databases was reviewed to develop key take-aways and a framework for discussing how to enhance people's well-being in the COVID-19 lockdown. Interaction with other players in virtual communities has been found to have a positive influence on the mental health of those suffering from a lack of societal connection. A framework for further research has also been developed that focuses on the critical situation of the COVID-19 lockdown,as this is an urgent topic with a huge impact on our health.Some gaming service providers have been proactive in redesigning game programming to be suitable for the lockdown situation, and this enables players to enjoy physical activities even at home.


title: A Generic Framework and Library for Exploration of Small Multiples through Interactive Piling

abstract: Small multiples are miniature representations of visual information used generically across many domains. Handling large numbers of small multiples imposes challenges on many analytic tasks like inspection, comparison, navigation, or annotation. To address these challenges, we developed a framework and implemented a library called Piling.js for designing interactive piling interfaces. Based on the piling metaphor, such interfaces afford flexible organization, exploration, and comparison of large numbers of small multiples by interactively aggregating visual objects into piles. Based on a systematic analysis of previous work, we present a structured design space to guide the design of visual piling interfaces. To enable designers to efficiently build their own visual piling interfaces, Piling.js provides a declarative interface to avoid having to write low-level code and implements common aspects of the design space. An accompanying GUI additionally supports the dynamic configuration of the piling interface. We demonstrate the expressiveness of Piling.js with examples from machine learning, immunofluorescence microscopy, genomics, and public health.


title: Learning from Noisy Labels with Noise Modeling Network

abstract: Multi-label image classification has generated significant interest in recent years and the performance of such systems often suffers from the not so infrequent occurrence of incorrect or missing labels in the training data. In this paper, we extend the state-of the-art of training classifiers to jointly deal with both forms of errorful data. We accomplish this by modeling noisy and missing labels in multi-label images with a new Noise Modeling Network (NMN) that follows our convolutional neural network (CNN), integrates with it, forming an end-to-end deep learning system, which can jointly learn the noise distribution and CNN parameters. The NMN learns the distribution of noise patterns directly from the noisy data without the need for any clean training data. The NMN can model label noise that depends only on the true label or is also dependent on the image features. We show that the integrated NMN/CNN learning system consistently improves the classification performance, for different levels of label noise, on the MSR-COCO dataset and MSR-VTT dataset. We also show that noise performance improvements are obtained when multiple instance learning methods are used.


title: Simultaneous Non-Gaussian Component Analysis (SING) for Data Integration in Neuroimaging

abstract: As advances in technology allow the acquisition of complementary information, it is increasingly common for scientific studies to collect multiple datasets. Large-scale neuroimaging studies often include multiple modalities (e.g., task functional MRI, resting-state fMRI, diffusion MRI, and/or structural MRI), with the aim to understand the relationships between datasets. In this study, we seek to understand whether regions of the brain activated in a working memory task relate to resting-state correlations. In neuroimaging, a popular approach uses principal component analysis for dimension reduction prior to canonical correlation analysis with joint independent component analysis, but this may discard biological features with low variance and/or spuriously associate structure unique to a dataset with joint structure. We introduce Simultaneous Non-Gaussian component analysis (SING) in which dimension reduction and feature extraction are achieved simultaneously, and shared information is captured via subject scores. We apply our method to a working memory task and resting-state correlations from the Human Connectome Project. We find joint structure as evident from joint scores whose loadings highlight resting-state correlations involving regions associated with working memory. Moreover, some of the subject scores are related to fluid intelligence.


title: Equilibrium states for natural extensions of non-uniformly expanding local homeomorphisms

abstract: We examine uniqueness of equilibrium states for the natural extension of a topologically exact, non-uniformly expanding, local homeomorphism with a H\"older continuous potential function. We do this by applying general techniques developed by Climenhaga and Thompson, and show there is a natural condition on decompositions that guarantees that a unique equilibrium state exists. We then show how to apply these results to partially hyperbolic attractors.


title: Electrostatic interactions in water: nonlocal electrostatic approach

abstract: Can we avoid molecular dynamics simulations to estimate the electrostatic interaction between charged objects separated by a nanometric distance in water? To answer this question, we develop a continuous model for the dielectric properties of water based on a functional of the polarization. A phenomenological Landau-Ginzburg Hamiltonian for the electrostatic energy of water is parameterized to capture the dipolar correlations in the fluid at the nanometric scale. We show that in this framework, the effective interactions of simple objects such as point charges are analytically tractable. In particular, the derivation of the interaction energy between a solvated charge and a surface can be reduced to a system of linear equations of electrostatic potentials and analytically solved. This approach could thus give access in few calculation lines to data that necessitate long and costly simulations.


title: The Center of the Partition Algebra

abstract: In this paper we show that the center of the partition algebra $\mathcal{A}_{2k}(\delta)$, in the semisimple case, is given by the subalgebra of supersymmetric polynomials in the normalised Jucys-Murphy elements. For the non-semisimple case, such a subalgebra is shown to be central, and in particular it is large enough to recognise the block structure of $\mathcal{A}_{2k}(\delta)$. This allows one to give an alternative description for when two simple $\mathcal{A}_{2k}(\delta)$-modules belong to the same block.


title: Sums Of K-potent Matrices

abstract: We study sums of $k$-potent matrices. We show the conditions by which a complex matrix $A$ can be expressed as a sums of $k$-potent matrices. Also we obtain conditions by which a complex matrix $A$ can be expressed as a sum of finite order elements. This generalize some results obtain by Wu. Also we study the sum of $k$-potent matrices in $\mathcal{M}_{\mathcal{C}f}(F)$ with $F$ be a field and proof that any matrix in this space can be expressed as a sum of $14$ $(k+1)$-potent matrices preserving the result obtain by Slowik.


title: Multipolar Particles in Helically Symmetric Spacetimes

abstract: We consider a binary system of spinning compact objects with internal structure, moving along an exactly circular orbit, and modelled within the multipolar gravitational skeleton formalism, up to quadrupolar order. We prove that the worldline of each multipolar particle is an integral curve of the helical Killing vector field, and that the 4-velocity, 4-momentum, spin tensor and quadrupole tensor of each particle are Lie-dragged along those worldlines. The geometrical framework developed in this paper paves the way to an extension of the first law of compact-object binary mechanics up to quadrupolar order.


title: It is Time for New Perspectives on How to Fight Bloat in GP

abstract: The present and future of evolutionary algorithms depends on the proper use of modern parallel and distributed computing infrastructures. Although still sequential approaches dominate the landscape, available multi-core, many-core and distributed systems will make users and researchers to more frequently deploy parallel version of the algorithms. In such a scenario, new possibilities arise regarding the time saved when parallel evaluation of individuals are performed. And this time saving is particularly relevant in Genetic Programming. This paper studies how evaluation time influences not only time to solution in parallel/distributed systems, but may also affect size evolution of individuals in the population, and eventually will reduce the bloat phenomenon GP features. This paper considers time and space as two sides of a single coin when devising a more natural method for fighting bloat. This new perspective allows us to understand that new methods for bloat control can be derived, and the first of such a method is described and tested. Experimental data confirms the strength of the approach: using computing time as a measure of individuals' complexity allows to control the growth in size of genetic programming individuals.


title: Nonunitary Scaling Theory of Non-Hermitian Localization

abstract: Non-Hermiticity can destroy Anderson localization and lead to delocalization even in one dimension. However, the unified understanding of the non-Hermitian delocalization has yet to be established. Here, we develop a scaling theory of localization in non-Hermitian systems. We reveal that non-Hermiticity introduces a new scale and breaks down the one-parameter scaling, which is the central assumption of the conventional scaling theory of localization. Instead, we identify the origin of the unconventional non-Hermitian delocalization as the two-parameter scaling. Furthermore, we establish the threefold universality of non-Hermitian localization based on reciprocity; reciprocity forbids the delocalization without internal degrees of freedom, whereas symplectic reciprocity results in a new type of symmetry-protected delocalization.

categories: cond-mat.dis-nn cond-mat.mes-hall physics.optics quant-ph


title: Rejoinder for the discussion of the paper "A novel algorithmic approach to Bayesian Logic Regression"

abstract: In this rejoinder we summarize the comments, questions and remarks on the paper "A novel algorithmic approach to Bayesian Logic Regression" from the discussants. We then respond to those comments, questions and remarks, provide several extensions of the original model and give a tutorial on our R-package EMJMCMC (http://aliaksah.github.io/EMJMCMC2016/)


title: Nanostructured optical waveguide with a highly confined mode

abstract: We propose a transmission line working at telecom wavelengths with cross section as small as ${\lambda}^2/39$, which is 1.6 times smaller than that of optimized silicon waveguide. The proposed line can be implemented as a subwavelength fiber with plasmonic cladding. This considerable decrease in the line cross section is achieved by utilizing a plasmonic quasi-antisymmetric mode. The required plasmonic cladding is rather thin, therefore, losses are moderate and could be compensated by using amplifying core materials. Such a transmission line can find applications in densely integrated optical systems.


title: Kink dynamics and quantum simulation of supersymmetric lattice Hamiltonians

abstract: We propose a quantum simulation of a supersymmetric lattice model using atoms trapped in a 1D configuration and interacting through a Rydberg dressed potential. The elementary excitations in the model are kinks or (in a sector with one extra particle) their superpartners - the skinks. The two are connected by supersymmetry and display identical quantum dynamics. We provide an analytical description of the kink/skink quench dynamics and propose a protocol to prepare and detect these excitations in the quantum simulator. We make a detailed analysis, based on numerical simulation, of the Rydberg atom simulator and show that it accurately tracks the dynamics of the supersymmetric model.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech cond-mat.str-el hep-th


title: Characterizing spreading dynamics of subsampled systems with non-stationary external input

abstract: Many systems with propagation dynamics, such as spike propagation in neural networks and spreading of infectious diseases, can be approximated by autoregressive models. The estimation of model parameters can be complicated by the experimental limitation that one observes only a fraction of the system (subsampling) and potentially time-dependent parameters, leading to incorrect estimates. We show analytically how to overcome the subsampling bias when estimating the propagation rate for systems with certain non-stationary external input. This approach is readily applicable to trial-based experimental setups and seasonal fluctuations, as demonstrated on spike recordings from monkey prefrontal cortex and spreading of norovirus and measles.


title: Thiophene-Tetrathia-Annulene monolayer (TTA-2D): A new 2D semiconductor material with indirect bandgap

abstract: We propose a new 2D semiconductor material (TTA-2D) based on the molecular structure of Thiophene-Tetrathia-Annulene (TTA). The TTA-2D structural, electronic, and optical properties were investigated using \textit{ab initio} methods. Our results show that TTA-2D is a small indirect bandgap semiconductor ($0.6$ eV). A semiconductor-metal transition can be induced by applying a uniaxial strain. Our results also show that TTA-2D is thermally stable up to $T=1000$ K. TTA-2D absorbs in a large spectral range, from infrared to ultraviolet regions. Values of refractive index and reflectivity show that TTA-2D reflects only $10\%$ of the incident light in the visible region. These results suggest that TTA-2D is a promising material for solar cell applications.


title: Constraint-Based Causal Discovery using Partial Ancestral Graphs in the presence of Cycles

abstract: While feedback loops are known to play important roles in many complex systems, their existence is ignored in a large part of the causal discovery literature, as systems are typically assumed to be acyclic from the outset. When applying causal discovery algorithms designed for the acyclic setting on data generated by a system that involves feedback, one would not expect to obtain correct results. In this work, we show that -- surprisingly -- the output of the Fast Causal Inference (FCI) algorithm is correct if it is applied to observational data generated by a system that involves feedback. More specifically, we prove that for observational data generated by a simple and $\sigma$-faithful Structural Causal Model (SCM), FCI is sound and complete, and can be used to consistently estimate (i) the presence and absence of causal relations, (ii) the presence and absence of direct causal relations, (iii) the absence of confounders, and (iv) the absence of specific cycles in the causal graph of the SCM. We extend these results to constraint-based causal discovery algorithms that exploit certain forms of background knowledge, including the causally sufficient setting (e.g., the PC algorithm) and the Joint Causal Inference setting (e.g., the FCI-JCI algorithm).


title: Neural Lyapunov Control

abstract: We propose new methods for learning control policies and neural network Lyapunov functions for nonlinear control problems, with provable guarantee of stability. The framework consists of a learner that attempts to find the control and Lyapunov functions, and a falsifier that finds counterexamples to quickly guide the learner towards solutions. The procedure terminates when no counterexample is found by the falsifier, in which case the controlled nonlinear system is provably stable. The approach significantly simplifies the process of Lyapunov control design, provides end-to-end correctness guarantee, and can obtain much larger regions of attraction than existing methods such as LQR and SOS/SDP. We show experiments on how the new methods obtain high-quality solutions for challenging control problems.


title: Multivariate Discrimination in Quantum Target Detection

abstract: We describe a simple multivariate technique of likelihood ratios for improved discrimination of signal and background in multi-dimensional quantum target detection. The technique combines two independent variables, time difference and summed energy, of a photon pair from the spontaneous parametric down-conversion source into an optimal discriminant. The discriminant performance was studied in experimental data and in Monte-Carlo modelling with clear improvement shown compared to previous techniques. As novel detectors become available, we expect this type of multivariate analysis to become increasingly important in multi-dimensional quantum optics.


title: A Controllable Model of Grounded Response Generation

abstract: Current end-to-end neural conversation models inherently lack the flexibility to impose semantic control in the response generation process, often resulting in uninteresting responses. Attempts to boost informativeness alone come at the expense of factual accuracy, as attested by pretrained language models' propensity to "hallucinate" facts. While this may be mitigated by access to background knowledge, there is scant guarantee of relevance and informativeness in generated responses. We propose a framework that we call controllable grounded response generation (CGRG), in which lexical control phrases are either provided by a user or automatically extracted by a control phrase predictor from dialogue context and grounding knowledge. Quantitative and qualitative results show that, using this framework, a transformer based model with a novel inductive attention mechanism, trained on a conversation-like Reddit dataset, outperforms strong generation baselines.


title: Multi-Dimensional Gender Bias Classification

abstract: Machine learning models are trained to find patterns in data. NLP models can inadvertently learn socially undesirable patterns when training on gender biased text. In this work, we propose a general framework that decomposes gender bias in text along several pragmatic and semantic dimensions: bias from the gender of the person being spoken about, bias from the gender of the person being spoken to, and bias from the gender of the speaker. Using this fine-grained framework, we automatically annotate eight large scale datasets with gender information. In addition, we collect a novel, crowdsourced evaluation benchmark of utterance-level gender rewrites. Distinguishing between gender bias along multiple dimensions is important, as it enables us to train finer-grained gender bias classifiers. We show our classifiers prove valuable for a variety of important applications, such as controlling for gender bias in generative models, detecting gender bias in arbitrary text, and shed light on offensive language in terms of genderedness.


title: A Dual-Dimer Method for Training Physics-Constrained Neural Networks with Minimax Architecture

abstract: Data sparsity is a common issue to train machine learning tools such as neural networks for engineering and scientific applications, where experiments and simulations are expensive. Recently physics-constrained neural networks (PCNNs) were developed to reduce the required amount of training data. However, the weights of different losses from data and physical constraints are adjusted empirically in PCNNs. In this paper, a new physics-constrained neural network with the minimax architecture (PCNN-MM) is proposed so that the weights of different losses can be adjusted systematically. The training of the PCNN-MM is searching the high-order saddle points of the objective function. A novel saddle point search algorithm called Dual-Dimer method is developed. It is demonstrated that the Dual-Dimer method is computationally more efficient than the gradient descent ascent method for nonconvex-nonconcave functions and provides additional eigenvalue information to verify search results. A heat transfer example also shows that the convergence of PCNN-MMs is faster than that of traditional PCNNs.


title: Robust Deep Learning as Optimal Control: Insights and Convergence Guarantees

abstract: The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This mechanism can be formulated as a min-max optimization problem, where the adversary seeks to maximize the loss function using an iterative first-order algorithm while the learner attempts to minimize it. However, finding adversarial examples in this way causes excessive computational overhead during training. By interpreting the min-max problem as an optimal control problem, it has recently been shown that one can exploit the compositional structure of neural networks in the optimization problem to improve the training time significantly. In this paper, we provide the first convergence analysis of this adversarial training algorithm by combining techniques from robust optimal control and inexact oracle methods in optimization. Our analysis sheds light on how the hyperparameters of the algorithm affect the its stability and convergence. We support our insights with experiments on a robust classification problem.


title: Strauss and Lions type theorems for the fractional Sobolev spaces with variable exponent and applications to nonlocal Kirchhoff-Choquard problem

abstract: This paper deals with Strauss and Lions-type theorems for fractional Sobolev spaces with variable exponent $W^{s,p(.),\tilde{p}(.,.)}(\Omega)$, when $p$ and $\tilde{p}$ satisfies some conditions. As application, we study the existence of solutions for a class of Kirchhoff-Choquard problem in $\mathbb{R}^N$.


title: Quantum and Classical Data Transmission through Completely Depolarising Channels in a Superposition of Cyclic Orders

abstract: Completely depolarising channels are often regarded as the prototype of physical processes that are useless for communication: any message that passes through them along a well-defined trajectory is completely erased. When two such channels are used in a quantum superposition of two alternative orders, they become able to transmit some amount of classical information, but still no quantum information can pass through them. Here we show that the ability to place N completely depolarising channels in a superposition of N alternative causal orders enables a high-fidelity, heralded transmission of quantum information with error vanishing as 1/N. This phenomenon highlights a fundamental difference with the N = 2 case, where completely depolarising channels are unable to transmit quantum data, even when placed in a superposition of causal orders. The ability to place quantum channels in a superposition of orders also leads to an increase of the classical communication capacity with N, which we rigorously prove by deriving an exact single-letter expression. Our results highlight the more complex patterns of correlations arising from multiple causal orders, which are similar to the more complex patterns of entanglement arising in multipartite quantum systems.


title: Probing Contextual Language Models for Common Ground with Visual Representations

abstract: The success of large-scale contextual language models has attracted great interest in probing what is encoded in their representations. In this work, we consider a new question: to what extent contextual representations of concrete nouns are aligned with corresponding visual representations? We design a probing model that evaluates how effective are text-only representations in distinguishing between matching and non-matching visual representations. Our findings show that language representations alone provide a strong signal for retrieving image patches from the correct object categories. Moreover, they are effective in retrieving specific instances of image patches; textual context plays an important role in this process. Visually grounded language models slightly outperform text-only language models in instance retrieval, but greatly under-perform humans. We hope our analyses inspire future research in understanding and improving the visual capabilities of language models.


title: The stochastic telegraph equation limit of the stochastic higher spin six vertex model

abstract: In this paper, we prove that the stochastic telegraph equation arises as a scaling limit of the stochastic higher spin six vertex (SHS6V) model with general spin $I/2, J/2$. This extends results of Borodin and Gorin which focused on the $I=J=1$ six vertex case and demonstrates the universality of the stochastic telegraph equation in this context. We also provide a functional extension of the central limit theorem obtained in [Borodin and Gorin 2019, Theorem 6.1]. The main idea is to generalize the four point relation established in [Borodin and Gorin 2019, Theorem 3.1], using fusion.


title: Hydrodynamic correlation functions of chiral active fluids

abstract: The success of spectroscopy to characterise equilibrium fluids, for example the heat capacity ratio, suggests a parallel approach for active fluids. Here, we start from a hydrodynamic description of chiral active fluids composed of spinning constituents and derive their low-frequency, long-wavelength response functions using the Kadanoff-Martin formalism. We find that the presence of odd (equivalently, Hall) viscosity leads to mixed density-vorticity response even at linear order. Such response, prohibited in time-reversal-invariant fluids, is a large-scale manifestation of the microscopic breaking of time-reversal symmetry. Our work suggests possible experimental probes that can measure anomalous transport coefficients in active fluids through dynamic light scattering.


title: The Kodaira dimensions of $\overline{\mathcal{M}}_{22}$ and $\overline{\mathcal{M}}_{23}$

abstract: We prove that the moduli spaces of curves of genus 22 and 23 are of general type. To do this, we calculate certain virtual divisor classes of small slope associated to linear series of rank 6 with quadric relations. We then develop new tropical methods for studying linear series and independence of quadrics and show that these virtual classes are represented by effective divisors.


title: Hydrogen trapping at surface and subsurface vacancies of low-index surfaces of Pd

abstract: Hydrogen segregation to vacancies in the surface and subsurface layers of (111) and (100) surfaces of Pd is studied in the density functional theory (DFT) approach. Adsorption energies and configurations of various clusters of H atoms at the vacancies are calculated. The adsorption energy varies for different sites in the vacancies with the distance to the surface from -0.26 eV (close to that of the bulk clusters) to -0.62 eV. Enhanced binding is found for the sites above the pores produced by vacancies in the subsurface layer. For the (111) surface vacancy the most favorable for segregation are tetrahedral lattice sites, while for (100) octa-sites have higher binding energy. Lattice relaxation effects are minor for the (111) surface but noticeably enhanced for the (100) surface. Hydrogen segregation to surface layer vacancies is accompanied with minimal charge transfer, which shows itself in cluster configurations. At high surface coverage the reduction of the cluster formation energy due to the H segregation should result in strongly enlarged concentration of the subsurface vacancy clusters, while the surface remains undamaged due to the prevailing surface adsorption.


title: Minimally Supervised Categorization of Text with Metadata

abstract: Document categorization, which aims to assign a topic label to each document, plays a fundamental role in a wide variety of applications. Despite the success of existing studies in conventional supervised document classification, they are less concerned with two real problems: (1) the presence of metadata: in many domains, text is accompanied by various additional information such as authors and tags. Such metadata serve as compelling topic indicators and should be leveraged into the categorization framework; (2) label scarcity: labeled training samples are expensive to obtain in some cases, where categorization needs to be performed using only a small set of annotated data. In recognition of these two challenges, we propose MetaCat, a minimally supervised framework to categorize text with metadata. Specifically, we develop a generative process describing the relationships between words, documents, labels, and metadata. Guided by the generative model, we embed text and metadata into the same semantic space to encode heterogeneous signals. Then, based on the same generative process, we synthesize training samples to address the bottleneck of label scarcity. We conduct a thorough evaluation on a wide range of datasets. Experimental results prove the effectiveness of MetaCat over many competitive baselines.


title: Alleviating the Inconsistency Problem of Applying Graph Neural Network to Fraud Detection

abstract: The graph-based model can help to detect suspicious fraud online. Owing to the development of Graph Neural Networks~(GNNs), prior research work has proposed many GNN-based fraud detection frameworks based on either homogeneous graphs or heterogeneous graphs. These work follow the existing GNN framework by aggregating the neighboring information to learn the node embedding, which lays on the assumption that the neighbors share similar context, features, and relations. However, the inconsistency problem is hardly investigated, i.e., the context inconsistency, feature inconsistency, and relation inconsistency. In this paper, we introduce these inconsistencies and design a new GNN framework, $\mathsf{GraphConsis}$, to tackle the inconsistency problem: (1) for the context inconsistency, we propose to combine the context embeddings with node features, (2) for the feature inconsistency, we design a consistency score to filter the inconsistent neighbors and generate corresponding sampling probability, and (3) for the relation inconsistency, we learn a relation attention weights associated with the sampled nodes. Empirical analysis on four datasets indicates the inconsistency problem is crucial in a fraud detection task. The extensive experiments prove the effectiveness of $\mathsf{GraphConsis}$. We also released a GNN-based fraud detection toolbox with implementations of SOTA models. The code is available at https://github.com/safe-graph/DGFraud.


title: Predicting Declension Class from Form and Meaning

abstract: The noun lexica of many natural languages are divided into several declension classes with characteristic morphological properties. Class membership is far from deterministic, but the phonological form of a noun and/or its meaning can often provide imperfect clues. Here, we investigate the strength of those clues. More specifically, we operationalize this by measuring how much information, in bits, we can glean about declension class from knowing the form and/or meaning of nouns. We know that form and meaning are often also indicative of grammatical gender---which, as we quantitatively verify, can itself share information with declension class---so we also control for gender. We find for two Indo-European languages (Czech and German) that form and meaning respectively share significant amounts of information with class (and contribute additional information above and beyond gender). The three-way interaction between class, form, and meaning (given gender) is also significant. Our study is important for two reasons: First, we introduce a new method that provides additional quantitative support for a classic linguistic finding that form and meaning are relevant for the classification of nouns into declensions. Secondly, we show not only that individual declensions classes vary in the strength of their clues within a language, but also that these variations themselves vary across languages.


title: An ACE/CRIS-observation-based Galactic Cosmic Rays heavy nuclei spectra model II

abstract: An observation-based Galactic Cosmic Ray (GCR) spectral model for heavy nuclei is developed. Zhao and Qin (J. Geophys. Res. Space Phys.118, 1837(2013)) proposed an empirical elemental GCR spectra model for nuclear charge 5-28 over the energy range from 30 to 500 MeV/nuc, which is proved to be successful in predicting yearly averaged GCR heavy nuclei spectra.Based on the latest highly statistically precise measurements from ACE/CRIS,a further elemental GCR model with monthly averaged spectra is presented. The model can reproduce the past and predict the futureGCR intensity monthly by correlating model parameters with thecontinuous sunspot number (SSN) record. The effects of solar activity on GCR modulation are considered separately for odd and even solar cycles. Compared with other comprehensive GCR models, our modeling results are satisfyingly consistent with the GCR spectral measurements from ACE/SIS and IMP-8, and have comparable prediction accuracy as the Badhwar & O'Neill 2014 model.A detailed error analysis is also provided.Finally, the GCR carbon and iron nuclei fluxes for the subsequent two solar cycles (SC 25 and 26) are predicted and they show a potential trend in reduced flux amplitude, which is suspected to be relevant to possible weak solar cycles.


title: Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?

abstract: While pretrained models such as BERT have shown large gains across natural language understanding tasks, their performance can be improved by further training the model on a data-rich intermediate task, before fine-tuning it on a target task. However, it is still poorly understood when and why intermediate-task training is beneficial for a given target task. To investigate this, we perform a large-scale study on the pretrained RoBERTa model with 110 intermediate-target task combinations. We further evaluate all trained models with 25 probing tasks meant to reveal the specific skills that drive transfer. We observe that intermediate tasks requiring high-level inference and reasoning abilities tend to work best. We also observe that target task performance is strongly correlated with higher-level abilities such as coreference resolution. However, we fail to observe more granular correlations between probing and target task performance, highlighting the need for further work on broad-coverage probing benchmarks. We also observe evidence that the forgetting of knowledge learned during pretraining may limit our analysis, highlighting the need for further work on transfer learning methods in these settings.


title: A Narrowband Spintronic Terahertz Emitter based on Magnetoelastic Heterostructures

abstract: Narrowband terahertz (THz) radiation is crucial for high-resolution spectral identification, but a narrowband THz source driven by femtosecond (fs) laser has remained scarce. Here, it is computationally predicted that a metal/dielectric/magnetoelastic heterostructure enables converting a fs laser pulse into a multi-cycle THz pulse with a narrow linewidth down to ~1.5 GHz, which is in contrast with the single-cycle, broadband THz pulse from the existing fs-laser-excited emitters. It is shown that such narrowband THz pulse originates from the excitation and long-distance transport of THz spin waves in the magnetoelastic film, which can be enabled by a short strain pulse obtained from fs laser irradiation of the metal film when the thicknesses of the metal and magnetoelastic films both fall into a specific range. These results therefore reveal an approach to achieving optical generation of narrowband THz pulse based on heterostructure design, which also has implications in the design of THz magnonic devices.


title: KLEJ: Comprehensive Benchmark for Polish Language Understanding

abstract: In recent years, a series of Transformer-based models unlocked major improvements in general natural language understanding (NLU) tasks. Such a fast pace of research would not be possible without general NLU benchmarks, which allow for a fair comparison of the proposed methods. However, such benchmarks are available only for a handful of languages. To alleviate this issue, we introduce a comprehensive multi-task benchmark for the Polish language understanding, accompanied by an online leaderboard. It consists of a diverse set of tasks, adopted from existing datasets for named entity recognition, question-answering, textual entailment, and others. We also introduce a new sentiment analysis task for the e-commerce domain, named Allegro Reviews (AR). To ensure a common evaluation scheme and promote models that generalize to different NLU tasks, the benchmark includes datasets from varying domains and applications. Additionally, we release HerBERT, a Transformer-based model trained specifically for the Polish language, which has the best average performance and obtains the best results for three out of nine tasks. Finally, we provide an extensive evaluation, including several standard baselines and recently proposed, multilingual Transformer-based models.


title: Evaluating and Aggregating Feature-based Model Explanations

abstract: A feature-based model explanation denotes how much each input feature contributes to a model's output for a given data point. As the number of proposed explanation functions grows, we lack quantitative evaluation criteria to help practitioners know when to use which explanation function. This paper proposes quantitative evaluation criteria for feature-based explanations: low sensitivity, high faithfulness, and low complexity. We devise a framework for aggregating explanation functions. We develop a procedure for learning an aggregate explanation function with lower complexity and then derive a new aggregate Shapley value explanation function that minimizes sensitivity.


title: Photospheric Polarization Signatures From Long Gamma Ray Burst Simulations

abstract: A comprehensive understanding of Gamma Ray Bursts (GRBs) has been elusive due to the variety of questions surrounding the radiation mechanism at play in these events. Polarization measurements of GRBs can heavily constrain the relevant radiation mechanisms and the structure of the GRB jet; however, there is a limited number of theoretical predictions that observed GRB polarizations can be compared against. Here, we conduct radiative transfer calculations of a set of two dimensional relativistic hydrodynamic long GRB (LGRB) jet simulations, of a constant and a variable jet, using the Monte Carlo Radiation Transport (MCRaT) code. MCRaT has been enhanced by the inclusion of polarization; it has been first verified by reproducing a variety of results in the literature and then used to obtain the time integrated and resolved polarization degrees and angles of the synthetic LGRBs. While the obtained time-integrated polarization degrees {($\lesssim 1$\%)} are consistent with the constraints from the POLAR experiment, they are lower than other theoretical studies due to the lack of strong gradients in the model jet profiles that we use. The time resolved results suggests that GRBs with wide jets observed on axis will have small polarization degrees ($\lesssim 2\%$) and {constant polarization angles}, during the brightest portion of the light curve. GRBs observed off axis will have larger polarization degrees and polarization angles that change with the temporal structure of radiating shells in the outflow. We then place our results in the context of GRB prompt emission models and future LEAP and POLAR-2 GRB polarimetry detections.


title: From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers

abstract: Massively multilingual transformers pretrained with language modeling objectives (e.g., mBERT, XLM-R) have become a de facto default transfer paradigm for zero-shot cross-lingual transfer in NLP, offering unmatched transfer performance. Current downstream evaluations, however, verify their efficacy predominantly in transfer settings involving languages with sufficient amounts of pretraining data, and with lexically and typologically close languages. In this work, we analyze their limitations and show that cross-lingual transfer via massively multilingual transformers, much like transfer via cross-lingual word embeddings, is substantially less effective in resource-lean scenarios and for distant languages. Our experiments, encompassing three lower-level tasks (POS tagging, dependency parsing, NER), as well as two high-level semantic tasks (NLI, QA), empirically correlate transfer performance with linguistic similarity between the source and target languages, but also with the size of pretraining corpora of target languages. We also demonstrate a surprising effectiveness of inexpensive few-shot transfer (i.e., fine-tuning on a few target-language instances after fine-tuning in the source) across the board. This suggests that additional research efforts should be invested to reach beyond the limiting zero-shot conditions.


title: General formulas for adiabatic invariants in nearly-periodic Hamiltonian systems

abstract: While it is well-known that every nearly-periodic Hamiltonian system possesses an adiabatic invariant, extant methods for computing terms in the adiabatic invariant series are inefficient. The most popular method involves the heavy intermediate calculation of a non-unique near-identity coordinate transformation, even though the adiabatic invariant itself is a uniquely-defined scalar. A less well-known method, developed by S. Omohundro, avoids calculating intermediate sequences of coordinate transformations but is also inefficient as it involves its own sequence of complex intermediate calculations. In order to improve the efficiency of future calculations of adiabatic invariants, we derive generally-applicable, readily computable formulas for the first several terms in the adiabatic invariant series. To demonstrate the utility of these formulas, we apply them to charged particle dynamics in a strong magnetic field and magnetic field-line dynamics when the field lines are nearly closed.


title: Using Noisy Self-Reports to Predict Twitter User Demographics

abstract: Computational social science studies often contextualize content analysis within standard demographics. Since demographics are unavailable on many social media platforms (e.g. Twitter) numerous studies have inferred demographics automatically. Despite many studies presenting proof of concept inference of race and ethnicity, training of practical systems remains elusive since there are few annotated datasets. Existing datasets are small, inaccurate, or fail to cover the four most common racial and ethnic groups in the United States. We present a method to identify self-reports of race and ethnicity from Twitter profile descriptions. Despite errors inherent in automated supervision, we produce models with good performance when measured on gold standard self-report survey data. The result is a reproducible method for creating large-scale training resources for race and ethnicity.


title: We Need to Talk About Random Splits

abstract: Gorman and Bedrick (2019) argued for using random splits rather than standard splits in NLP experiments. We argue that random splits, like standard splits, lead to overly optimistic performance estimates. We can also split data in biased or adversarial ways, e.g., training on short sentences and evaluating on long ones. Biased sampling has been used in domain adaptation to simulate real-world drift; this is known as the covariate shift assumption. In NLP, however, even worst-case splits, maximizing bias, often under-estimate the error observed on new samples of in-domain data, i.e., the data that models should minimally generalize to at test time. This invalidates the covariate shift assumption. Instead of using multiple random splits, future benchmarks should ideally include multiple, independent test sets instead; if infeasible, we argue that multiple biased splits leads to more realistic performance estimates than multiple random splits.


title: Explainable Link Prediction for Emerging Entities in Knowledge Graphs

abstract: Despite their large-scale coverage, cross-domain knowledge graphs invariably suffer from inherent incompleteness and sparsity. Link prediction can alleviate this by inferring a target entity, given a source entity and a query relation. Recent embedding-based approaches operate in an uninterpretable latent semantic vector space of entities and relations, while path-based approaches operate in the symbolic space, making the inference process explainable. However, these approaches typically consider static snapshots of the knowledge graphs, severely restricting their applicability for evolving knowledge graphs with newly emerging entities. To overcome this issue, we propose an inductive representation learning framework that is able to learn representations of previously unseen entities. Our method finds reasoning paths between source and target entities, thereby making the link prediction for unseen entities interpretable and providing support evidence for the inferred link.


title: Computing Absolute Free Energy with Deep Generative Models

abstract: Fast and accurate evaluation of free energy has broad applications from drug design to material engineering. Computing the absolute free energy is of particular interest since it allows the assessment of the relative stability between states without the use of intermediates. In this letter, we introduce a general framework for calculating the absolute free energy of a state. A key step of the calculation is the definition of a reference state with tractable deep generative models using locally sampled configurations. The absolute free energy of this reference state is zero by design. The free energy for the state of interest can then be determined as the difference from the reference. We applied this approach to both discrete and continuous systems and demonstrated its effectiveness. It was found that the Bennett acceptance ratio method provides more accurate and efficient free energy estimations than approximate expressions based on work. We anticipate the method presented here to be a valuable strategy for computing free energy differences.

categories: cond-mat.stat-mech cs.LG physics.chem-ph physics.comp-ph


title: Thermodynamics of collisional models for Brownian particles: General properties and efficiency

abstract: We introduce the idea of {\it collisional models} for Brownian particles, in which a particle is sequentially placed in contact with distinct thermal environments and external forces. Thermodynamic properties are exactly obtained, irrespective the number of reservoirs involved. In the presence of external forces, entropy production presents a bilinear form in which Onsager coefficients are exactly calculated. Analysis of Brownian engines based on sequential thermal switchings is proposed and considerations about their efficiencies are investigated taking into account distinct external forces protocols. Our results shed light to a new (and alternative) route for obtaining efficient thermal engines based on finite times Brownian machines.

categories: cond-mat.stat-mech cond-mat.mes-hall cond-mat.other cond-mat.soft


title: An Algebraic Approach to Projective Uniqueness with an Application to Order Polytopes

abstract: A combinatorial polytope $P$ is said to be projectively unique if it has a single realization up to projective transformations. Projective uniqueness is a geometrically compelling property but is difficult to verify. In this paper, we merge two approaches to projective uniqueness in the literature. One is primarily geometric and is due to McMullen, who showed that certain natural operations on polytopes preserve projective uniqueness. The other is more algebraic and is due to Gouveia, Macchia, Thomas, and Wiebe. They use certain ideals associated to a polytope to verify a property called graphicality that implies projective uniqueness. In this paper, we show that that McMullen's operations preserve not only projective uniquness but also graphicality. As an application, we show that large families of order polytopes are graphic and thus projectively unique.


title: Energy mu-Calculus: Symbolic Fixed-Point Algorithms for omega-Regular Energy Games

abstract: $\omega$-regular energy games, which are weighted two-player turn-based games with the quantitative objective to keep the energy levels non-negative, have been used in the context of verification and synthesis. The logic of modal $\mu$-calculus, when applied over game graphs with $\omega$-regular winning conditions, allows defining symbolic algorithms in the form of fixed-point formulas for computing the sets of winning states. In this paper, we introduce energy $\mu$-calculus, a multi-valued extension of the $\mu$-calculus that serves as a symbolic framework for solving $\omega$-regular energy games. Energy $\mu$-calculus enables the seamless reuse of existing, well-known symbolic $\mu$-calculus algorithms for $\omega$-regular games, to solve their corresponding energy augmented variants. We define the syntax and semantics of energy $\mu$-calculus over symbolic representations of the game graphs, and show how to use it to solve the decision and the minimum credit problems for $\omega$-regular energy games, for both bounded and unbounded energy level accumulations.


title: Spatial Dependency Parsing for Semi-Structured Document Information Extraction

abstract: Information Extraction (IE) for semi-structured document images is often approached as a sequence tagging problem by classifying each recognized input token into one of the IOB (Inside, Outside, and Beginning) categories. However, such problem setup has two inherent limitations that (1) it cannot easily handle complex spatial relationships and (2) it is not suitable for highly structured information, which are nevertheless frequently observed in real-world document images. To tackle these issues, we first formulate the IE task as spatial dependency parsing problem that focuses on the relationship among text tokens in the documents. Under this setup, we then propose SPADE (SPAtial DEpendency parser) that models highly complex spatial relationships and an arbitrary number of information layers in the documents in an end-to-end manner. We evaluate it on various kinds of documents such as receipts, name cards, forms, and invoices, and show that it achieves a similar or better performance compared to strong baselines including BERT-based IOB taggger.


title: On Absolute Equivalence and Linearization I

abstract: In this paper, we study the absolute equivalence between Pfaffian systems with a degree 1 independence condition and obtain structural results, particularly for systems of corank 3. We apply these results to understanding dynamic feedback linearization of control systems with 2 inputs.


title: Syntactic Question Abstraction and Retrieval for Data-Scarce Semantic Parsing

abstract: Deep learning approaches to semantic parsing require a large amount of labeled data, but annotating complex logical forms is costly. Here, we propose Syntactic Question Abstraction and Retrieval (SQAR), a method to build a neural semantic parser that translates a natural language (NL) query to a SQL logical form (LF) with less than 1,000 annotated examples. SQAR first retrieves a logical pattern from the train data by computing the similarity between NL queries and then grounds a lexical information on the retrieved pattern in order to generate the final LF. We validate SQAR by training models using various small subsets of WikiSQL train data achieving up to 4.9% higher LF accuracy compared to the previous state-of-the-art models on WikiSQL test set. We also show that by using query-similarity to retrieve logical pattern, SQAR can leverage a paraphrasing dataset achieving up to 5.9% higher LF accuracy compared to the case where SQAR is trained by using only WikiSQL data. In contrast to a simple pattern classification approach, SQAR can generate unseen logical patterns upon the addition of new examples without re-training the model. We also discuss an ideal way to create cost efficient and robust train datasets when the data distribution can be approximated under a data-hungry setting.


title: Most simple extensions of $\mathsf{FL_e}$ are undecidable

abstract: All known structural extensions of the substructural logic $\mathsf{FL_e}$, Full Lambek calculus with exchange/commutativity, (corresponding to subvarieties of commutative residuated lattices axiomatized by $\{\vee, \cdot, 1\}$-equations) have decidable theoremhood; in particular all the ones defined by knotted axioms enjoy strong decidability properties (such as the finite embeddability property). We provide infinitely many such extensions that have undecidable theoremhood, by encoding machines with undecidable halting problem. An even bigger class of extensions is shown to have undecidable deducibility problem (the corresponding varieties of residuated lattices have undecidable word problem); actually with very few exceptions, such as the knotted axioms and the other prespinal axioms, we prove that undecidability is ubiquitous. Known undecidability results for non-commutative extensions use an encoding that fails in the presence of commutativity, so and-branching counter machines are employed. Even these machines provide encodings that fail to capture proper extensions of commutativity, therefore we introduce a new variant that works on an exponential scale. The correctness of the encoding is established by employing the theory of residuated frames.


title: Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering

abstract: Existing work on augmenting question answering (QA) models with external knowledge (e.g., knowledge graphs) either struggle to model multi-hop relations efficiently, or lack transparency into the model's prediction rationale. In this paper, we propose a novel knowledge-aware approach that equips pre-trained language models (PTLMs) with a multi-hop relational reasoning module, named multi-hop graph relation network (MHGRN). It performs multi-hop, multi-relational reasoning over subgraphs extracted from external knowledge graphs. The proposed reasoning module unifies path-based reasoning methods and graph neural networks to achieve better interpretability and scalability. We also empirically show its effectiveness and scalability on CommonsenseQA and OpenbookQA datasets, and interpret its behaviors with case studies.


title: Optically pumped spin polarization as a probe of many-body thermalization

abstract: The interplay between disorder and transport is a problem central to the understanding of a broad range of physical processes, most notably the ability of a system to reach thermal equilibrium. Disorder and many body interactions are known to compete, with the dominance of one or the other giving rise to fundamentally different dynamical phases. Here we investigate the spin diffusion dynamics of 13C in diamond, which we dynamically polarize at room temperature via optical spin pumping of engineered color centers. We focus on low-abundance, strongly hyperfine-coupled nuclei, whose role in the polarization transport we expose through the integrated impact of variable radio-frequency excitation on the observable bulk 13C magnetic resonance signal. Unexpectedly, we find good thermal contact throughout the nuclear spin bath, virtually independent of the hyperfine coupling strength, which we attribute to effective carbon-carbon interactions mediated by the electronic spin ensemble. In particular, observations across the full range of hyperfine couplings indicate the nuclear spin diffusion constant takes values up to two orders of magnitude greater than that expected from homo-nuclear spin couplings. Our results open intriguing opportunities to study the onset of thermalization in a system by controlling the internal interactions within the bath.


title: Small scale quantum ergodicity in cat maps. II. Quasimodes that are not equidistributed at the logarithmical scales

abstract: In this series, we investigate quantum ergodicity at small scales for linear hyperbolic maps of the torus ("cat maps'"). In Part II of the series, we construct quasimodes that are quantum ergodic but are not equidistributed at the logarithmical scales.


title: Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimates

abstract: Many applications of computational social science aim to infer causal conclusions from non-experimental data. Such observational data often contains confounders, variables that influence both potential causes and potential effects. Unmeasured or latent confounders can bias causal estimates, and this has motivated interest in measuring potential confounders from observed text. For example, an individual's entire history of social media posts or the content of a news article could provide a rich measurement of multiple confounders. Yet, methods and applications for this problem are scattered across different communities and evaluation practices are inconsistent. This review is the first to gather and categorize these examples and provide a guide to data-processing and evaluation decisions. Despite increased attention on adjusting for confounding using text, there are still many open problems, which we highlight in this paper.


title: A solution of polynomial equations

abstract: We present a method for the solution of polynomial equations. We do not intend to present one more method among several others, because today there are many excellent methods. Our main aim is educational. Here we attempt to present a method with elementary tools in order to be understood and useful by students and educators. For this reason, we provide a self contained approach. Our method is a variation of the well known method of resultant, that has its origin back to Euler. Our goal, in the present paper, is in the spirit of calculus and secondary school mathematics. An extensive discussion of the theory of zeros of polynomials and extremal problems for polynomials the reader can find in the books 10 and 13 in our references.


title: Global bifurcation for monotone fronts of elliptic equations

abstract: In this paper, we present two results on global continuation of monotone front-type solutions to elliptic PDEs posed on infinite cylinders. This is done under quite general assumptions, and in particular applies even to fully nonlinear equations as well as quasilinear problems with transmission boundary conditions. Our approach is rooted in the analytic global bifurcation theory of Dancer and Buffoni--Toland, but extending it to unbounded domains requires contending with new potential limiting behavior relating to loss of compactness. We obtain an exhaustive set of alternatives for the global behavior of the solution curve that is sharp, with each possibility having a direct analogue in the bifurcation theory of second-order ODEs. As a major application of the general theory, we construct global families of internal hydrodynamic bores. These are traveling front solutions of the full two-phase Euler equation in two dimensions. The fluids are confined to a channel that is bounded above and below by rigid walls, with incompressible and irrotational flow in each layer. Small-amplitude fronts for this system have been obtained by several authors. We give the first large-amplitude result in the form of continuous curves of elevation and depression bores. Following the elevation curve to its extreme, we find waves whose interfaces either overturn (develop a vertical tangent) or become exceptionally singular in that the flow in both layers degenerates at a single point on the boundary. For the curve of depression waves, we prove that either the interface overturns or it comes into contact with the upper wall.


title: An Information Bottleneck Approach for Controlling Conciseness in Rationale Extraction

abstract: Decisions of complex language understanding models can be rationalized by limiting their inputs to a relevant subsequence of the original text. A rationale should be as concise as possible without significantly degrading task performance, but this balance can be difficult to achieve in practice. In this paper, we show that it is possible to better manage this trade-off by optimizing a bound on the Information Bottleneck (IB) objective. Our fully unsupervised approach jointly learns an explainer that predicts sparse binary masks over sentences, and an end-task predictor that considers only the extracted rationale. Using IB, we derive a learning objective that allows direct control of mask sparsity levels through a tunable sparse prior. Experiments on ERASER benchmark tasks demonstrate significant gains over norm-minimization techniques for both task performance and agreement with human rationales. Furthermore, we find that in the semi-supervised setting, a modest amount of gold rationales (25% of training examples) closes the gap with a model that uses the full input.


title: A Transformer-based Approach for Source Code Summarization

abstract: Generating a readable summary that describes the functionality of a program is known as source code summarization. In this task, learning code representation by modeling the pairwise relationship between code tokens to capture their long-range dependencies is crucial. To learn code representation for summarization, we explore the Transformer model that uses a self-attention mechanism and has shown to be effective in capturing long-range dependencies. In this work, we show that despite the approach is simple, it outperforms the state-of-the-art techniques by a significant margin. We perform extensive analysis and ablation studies that reveal several important findings, e.g., the absolute encoding of source code tokens' position hinders, while relative encoding significantly improves the summarization performance. We have made our code publicly available to facilitate future research.


title: Improved Fast Randomized Iteration Approach to Full Configuration Interaction

abstract: We present three modifications to our recently introduced fast randomized iteration method for full configuration interaction (FCI-FRI) and investigate their effects on the method's performance for Ne, H$_2$O, and N$_2$. The initiator approximation, originally developed for full configuration interaction quantum Monte Carlo, significantly reduces statistical error in FCI-FRI when few samples are used in compression operations, enabling its application to larger chemical systems. The semi-stochastic extension, which involves exactly preserving a fixed subset of elements in each compression, improves statistical efficiency in some cases but reduces it in others. We also developed a new approach to sampling excitations that yields consistent improvements in statistical efficiency and reductions in computational cost. We discuss possible strategies based on our findings for improving the performance of stochastic quantum chemistry methods more generally.


title: Local electronic transport across probe/ionic conductor interface in scanning probe microscopy

abstract: Charge carrier transport through the probe-sample junction can have substantial consequences for outcomes of electrical and electromechanical atomic-force-microscopy (AFM) measurements. For understanding physical processes under the probe, we carried out conductive-AFM (C-AFM) measurements of local current-voltage (I-V) curves as well as their derivatives on samples of a mixed ionic-electronic conductor Li1-xMn2O4 and developed an analytical framework for the data analysis. The implemented approach discriminates between contributions of a highly resistive sample surface layer and bulk with the account of ion redistribution in the field of the probe. It was found that with increasing probe voltage, the conductance mechanism in the surface layer transforms from Pool-Frenkel to space-charge-limited current. The surface layer significantly alters the ion dynamics in the sample bulk under the probe, which leads, in particular, to a decrease of the effective electromechanical AFM signal associated with the ionic motion in the sample. The framework can be applied for the analysis of mechanisms of electronic transport across the probe/sample interface as well as the role of the charge transport in the electric field distribution, mechanical, and other responses in AFM measurements of a broad spectrum of conducting materials.


title: Jacks of All Trades, Masters Of None: Addressing Distributional Shift and Obtrusiveness via Transparent Patch Attacks

abstract: We focus on the development of effective adversarial patch attacks and -- for the first time -- jointly address the antagonistic objectives of attack success and obtrusiveness via the design of novel semi-transparent patches. This work is motivated by our pursuit of a systematic performance analysis of patch attack robustness with regard to geometric transformations. Specifically, we first elucidate a) key factors underpinning patch attack success and b) the impact of distributional shift between training and testing/deployment when cast under the Expectation over Transformation (EoT) formalism. By focusing our analysis on three principal classes of transformations (rotation, scale, and location), our findings provide quantifiable insights into the design of effective patch attacks and demonstrate that scale, among all factors, significantly impacts patch attack success. Working from these findings, we then focus on addressing how to overcome the principal limitations of scale for the deployment of attacks in real physical settings: namely the obtrusiveness of large patches. Our strategy is to turn to the novel design of irregularly-shaped, semi-transparent partial patches which we construct via a new optimization process that jointly addresses the antagonistic goals of mitigating obtrusiveness and maximizing effectiveness. Our study -- we hope -- will help encourage more focus in the community on the issues of obtrusiveness, scale, and success in patch attacks.


title: On Solving SAR Imaging Inverse Problems Using Non-Convex Regularization with a Cauchy-based Penalty

abstract: Synthetic aperture radar (SAR) imagery can provide useful information in a multitude of applications, including climate change, environmental monitoring, meteorology, high dimensional mapping, ship monitoring, or planetary exploration. In this paper, we investigate solutions to a number of inverse problems encountered in SAR imaging. We propose a convex proximal splitting method for the optimization of a cost function that includes a non-convex Cauchy-based penalty. The convergence of the overall cost function optimization is ensured through careful selection of model parameters within a forward-backward (FB) algorithm. The performance of the proposed penalty function is evaluated by solving three standard SAR imaging inverse problems, including super-resolution, image formation, and despeckling, as well as ship wake detection for maritime applications. The proposed method is compared to several methods employing classical penalty functions such as total variation ($TV$) and $L_1$ norms, and to the generalized minimax-concave (GMC) penalty. We show that the proposed Cauchy-based penalty function leads to better image reconstruction results when compared to the reference penalty functions for all SAR imaging inverse problems in this paper.


title: On the Design of Co-operating Blockchains for IoT

abstract: Enabling blockchain technology into IoT can help to achieve a proper distributed consensus based IoT system that overcomes disadvantages of today's centralized infrastructures, such as, among others, high cloud server maintenance costs, weakness for supporting time-critical IoT applications, security and trust issues. However, meeting requirements posed by IoT in blockchain domain is not an easy endeavour. [1] proposes Hybrid-IoT, as a step towards decentralizing IoT with the help of blockchain technology. Hybrid-IoT consists of multiple PoW sub-blockchains to achieve distributed consensus among IoT devices and an inter-connector framework, to execute transactions between sub-blockchains. In this paper, we take the first step towards designing an inter-connector for multiple blockchains for IoT that is specifically tailored for the Hybrid-IoT architecture. We also provide a detailed security discussion, in order to identify threats and we provide discussion on how to cope with threats.


title: Blind Estimation of Eigenvector Centrality from Graph Signals: Beyond Low-pass Filtering

abstract: This paper characterizes the difficulty of estimating a network's eigenvector centrality only from data on the nodes, i.e., with no information about the topology of the network. We model this nodal data as graph signals generated by passing white noise through generic (not necessarily low-pass) graph filters. Leveraging the spectral properties of graph filters, we estimate the eigenvectors of the adjacency matrix of the underlying network. To this end, a simple selection algorithm is proposed, which chooses the correct eigenvector of the signal covariance matrix with minimal assumptions on the underlying graph filter. We then present a theoretical characterization of the asymptotic and non-asymptotic performance of this algorithm, thus providing a sample complexity bound for the centrality estimation and revealing key elements driving this complexity. Finally, we illustrate the developed insights through a set of numerical experiments on different random graph models.


title: GenericsKB: A Knowledge Base of Generic Statements

abstract: We present a new resource for the NLP community, namely a large (3.5M+ sentence) knowledge base of *generic statements*, e.g., "Trees remove carbon dioxide from the atmosphere", collected from multiple corpora. This is the first large resource to contain *naturally occurring* generic sentences, as opposed to extracted or crowdsourced triples, and thus is rich in high-quality, general, semantically complete statements. All GenericsKB sentences are annotated with their topical term, surrounding context (sentences), and a (learned) confidence. We also release GenericsKB-Best (1M+ sentences), containing the best-quality generics in GenericsKB augmented with selected, synthesized generics from WordNet and ConceptNet. In tests on two existing datasets requiring multihop reasoning (OBQA and QASC), we find using GenericsKB can result in higher scores and better explanations than using a much larger corpus. This demonstrates that GenericsKB can be a useful resource for NLP applications, as well as providing data for linguistic studies of generics and their semantics. GenericsKB is available at https://allenai.org/data/genericskb.


title: On Faithfulness and Factuality in Abstractive Summarization

abstract: It is well known that the standard likelihood training and approximate decoding objectives in neural text generation models lead to less human-like responses for open-ended tasks such as language modeling and story generation. In this paper we have analyzed limitations of these models for abstractive document summarization and found that these models are highly prone to hallucinate content that is unfaithful to the input document. We conducted a large scale human evaluation of several neural abstractive summarization systems to better understand the types of hallucinations they produce. Our human annotators found substantial amounts of hallucinated content in all model generated summaries. However, our analysis does show that pretrained models are better summarizers not only in terms of raw metrics, i.e., ROUGE, but also in generating faithful and factual summaries as evaluated by humans. Furthermore, we show that textual entailment measures better correlate with faithfulness than standard metrics, potentially leading the way to automatic evaluation metrics as well as training and decoding criteria.


title: Estimation of COVID-19 spread curves integrating global data and borrowing information

abstract: Currently, novel coronavirus disease 2019 (COVID-19) is a big threat to global health. The rapid spread of the virus has created pandemic, and countries all over the world are struggling with a surge in COVID-19 infected cases. There are no drugs or other therapeutics approved by the US Food and Drug Administration to prevent or treat COVID-19: information on the disease is very limited and scattered even if it exists. This motivates the use of data integration, combining data from diverse sources and eliciting useful information with a unified view of them. In this paper, we propose a Bayesian hierarchical model that integrates global data for real-time prediction of infection trajectory for multiple countries. Because the proposed model takes advantage of borrowing information across multiple countries, it outperforms an existing individual country-based model. As fully Bayesian way has been adopted, the model provides a powerful predictive tool endowed with uncertainty quantification. Additionally, a joint variable selection technique has been integrated into the proposed modeling scheme, which aimed to identify possible country-level risk factors for severe disease due to COVID-19.


title: Benchmarking Multimodal Regex Synthesis with Complex Structures

abstract: Existing datasets for regular expression (regex) generation from natural language are limited in complexity; compared to regex tasks that users post on StackOverflow, the regexes in these datasets are simple, and the language used to describe them is not diverse. We introduce StructuredRegex, a new regex synthesis dataset differing from prior ones in three aspects. First, to obtain structurally complex and realistic regexes, we generate the regexes using a probabilistic grammar with pre-defined macros observed from real-world StackOverflow posts. Second, to obtain linguistically diverse natural language descriptions, we show crowdworkers abstract depictions of the underlying regex and ask them to describe the pattern they see, rather than having them paraphrase synthetic language. Third, we augment each regex example with a collection of strings that are and are not matched by the ground truth regex, similar to how real users give examples. Our quantitative and qualitative analysis demonstrates the advantages of StructuredRegex over prior datasets. Further experimental results using various multimodal synthesis techniques highlight the challenge presented by our dataset, including non-local constraints and multi-modal inputs.


title: Complex social contagion induces bistability on multiplex networks

abstract: Social reinforcement mechanism, which characterizes the promoting effects when exposing to multiple sources in social contagion process, is ubiquitous in information-technology ecosystem and has aroused great attention in recent years. While the impacts of social reinforcement on single-layer networks are well-documented, extension to multilayer networks is needed to study how reinforcement from different social circles influences the spreading dynamics. To this end, we incorporate multilayer social reinforcement into ignorant-spreader-ignorant (SIS) model on multiplex networks. Our theoretical analysis combines pairwise method and mean-field theory and agrees well with large-scale simulations. Surprisingly, we find this complex social contagion mechanism triggers the emergence of bistability phenomena, where extinction and outbreak states coexist. In particular, the hysteresis loop of stationary prevalence occurs in this bistable region, explaining why the fight towards the spread of rumors is protracted and difficult in modern society. Further, we show that the final state of bistable regions depends on the initial density of adopters, the critical value of which decreases as the contagion transmissibility or the multilayer reinforcement increases. In particular, we highlight two possible conditions for the outbreak of social contagion: to possess large contagion transmissibility, or to possess large initial density of adopters with strong multilayer reinforcement. Our results unveil the non-negligible power of social reinforcement on multiplex networks, which sheds lights on designing efficient strategies in spreading behaviors such as marketing and promoting innovations.


title: Accumulation set of critical points of the multipliers in the quadratic family

abstract: A parameter $c_0\in\mathbb C$ in the family of quadratic polynomials $f_c(z)=z^2+c$ is a critical point of a period $n$ multiplier, if the map $f_{c_0}$ has a periodic orbit of period $n$, whose multiplier, viewed as a locally analytic function of $c$, has a vanishing derivative at $c=c_0$. We study the accumulation set $\mathcal X$ of the critical points of the multipliers, as $n\to\infty$. This study complements the equidistribution result for the critical points of the multipliers that was previously obtained by the authors. In particular, in the current paper we prove that the accumulation set $\mathcal X$ is bounded, path connected and contains the Mandelbrot set as a proper subset. We also provide a necessary and sufficient condition for a parameter outside of the Mandelbrot set to be contained in the accumulation set $\mathcal X$ and show that this condition is satisfied for an open set of parameters. Our condition is similar in flavor to one of the conditions that define the Mandelbrot set. As an application, we get that the function that sends $c$ to the Hausdorff dimension of $f_c$, does not have critical points outside of the accumulation set $\mathcal X$.


title: Two repelling random walks on $\mathbb Z$

abstract: We consider two interacting random walks on $\mathbb{Z}$ such that the transition probability of one walk in one direction decreases exponentially with the number of transitions of the other walk in that direction. The joint process may thus be seen as two random walks reinforced to repel each other. The strength of the repulsion is further modulated in our model by a parameter $\beta \geq 0$. When $\beta = 0$ both processes are independent symmetric random walks on $\mathbb{Z}$, and hence recurrent. We show that both random walks are further recurrent if $\beta \in (0,1]$. We also show that these processes are transient and diverge in opposite directions if $\beta > 2$. The case $\beta \in (1,2]$ remains widely open. Our results are obtained by considering the dynamical system approach to stochastic approximations.


title: Data-Driven Modeling Reveals the Impact of Stay-at-Home Orders on Human Mobility during the COVID-19 Pandemic in the U.S

abstract: One approach to delay the spread of the novel coronavirus (COVID-19) is to reduce human travel by imposing travel restriction policies. It is yet unclear how effective those policies are on suppressing the mobility trend due to the lack of ground truth and large-scale dataset describing human mobility during the pandemic. This study uses real-world location-based service data collected from anonymized mobile devices to uncover mobility changes during COVID-19 and under the 'Stay-at-home' state orders in the U.S. The study measures human mobility with two important metrics: daily average number of trips per person and daily average person-miles traveled. The data-driven analysis and modeling attribute less than 5% of the reduction in the number of trips and person-miles traveled to the effect of the policy. The models developed in the study exhibit high prediction accuracy and can be applied to inform epidemics modeling with empirically verified mobility trends and to support time-sensitive decision-making processes.


title: Revealing electronic state-switching at conical intersections in alkyl iodides by ultrafast XUV transient absorption spectroscopy

abstract: Conical intersections between electronic states often dictate the chemistry of photoexcited molecules. Recently developed sources of ultrashort extreme ultraviolet (XUV) pulses tuned to element-specific transitions in molecules allow for the unambiguous detection of electronic state-switching at a conical intersection. Here, the fragmentation of photoexcited iso-propyl iodide and tert-butyl iodide molecules (i-C$_{3}$H$_{7}$I and t-C$_{4}$H$_{9}$I) through a conical intersection between $^{3}$Q$_{0}$/$^{1}$Q$_{1}$ spin-orbit states is revealed by ultrafast XUV transient absorption measuring iodine 4d core-to-valence transitions. The electronic state-sensitivity of the technique allows for a complete mapping of molecular dissociation from photoexcitation to photoproducts. In both molecules, the sub-100 fs transfer of a photoexcited wave packet from the $^{3}$Q$_{0}$ state into the $^{1}$Q$_{1}$ state at the conical intersection is captured. The results show how differences in the electronic state-switching of the wave packet in i-C$_{3}$H$_{7}$I and t-C$_{4}$H$_{9}$I directly lead to differences in the photoproduct branching ratio of the two systems.


title: Contrastive Self-Supervised Learning for Commonsense Reasoning

abstract: We propose a self-supervised method to solve Pronoun Disambiguation and Winograd Schema Challenge problems. Our approach exploits the characteristic structure of training corpora related to so-called "trigger" words, which are responsible for flipping the answer in pronoun disambiguation. We achieve such commonsense reasoning by constructing pair-wise contrastive auxiliary predictions. To this end, we leverage a mutual exclusive loss regularized by a contrastive margin. Our architecture is based on the recently introduced transformer networks, BERT, that exhibits strong performance on many NLP benchmarks. Empirical results show that our method alleviates the limitation of current supervised approaches for commonsense reasoning. This study opens up avenues for exploiting inexpensive self-supervision to achieve performance gain in commonsense reasoning tasks.


title: Stochastic Neighbor Embedding of Multimodal Relational Data for Image-Text Simultaneous Visualization

abstract: Multimodal relational data analysis has become of increasing importance in recent years, for exploring across different domains of data, such as images and their text tags obtained from social networking services (e.g., Flickr). A variety of data analysis methods have been developed for visualization; to give an example, t-Stochastic Neighbor Embedding (t-SNE) computes low-dimensional feature vectors so that their similarities keep those of the observed data vectors. However, t-SNE is designed only for a single domain of data but not for multimodal data; this paper aims at visualizing multimodal relational data consisting of data vectors in multiple domains with relations across these vectors. By extending t-SNE, we herein propose Multimodal Relational Stochastic Neighbor Embedding (MR-SNE), that (1) first computes augmented relations, where we observe the relations across domains and compute those within each of domains via the observed data vectors, and (2) jointly embeds the augmented relations to a low-dimensional space. Through visualization of Flickr and Animal with Attributes 2 datasets, proposed MR-SNE is compared with other graph embedding-based approaches; MR-SNE demonstrates the promising performance.


title: Pairs of disjoint matchings and related classes of graphs

abstract: For a finite graph $G$, we study the maximum $2$-edge colorable subgraph problem and a related ratio $\frac{\mu(G)}{\nu(G)}$, where $\nu(G)$ is the matching number of $G$, and $\mu(G)$ is the size of the largest matching in any pair $(H,H')$ of disjoint matchings maximizing $|H| + |H'|$ (equivalently, forming a maximum $2$-edge colorable subgraph). Previously, it was shown that $\frac{4}{5} \le \frac{\mu(G)}{\nu(G)} \le 1$, and the class of graphs achieving $\frac{4}{5}$ was completely characterized. We show here that any rational number between $\frac{4}{5}$ and $1$ can be achieved by a connected graph. Furthermore, we prove that every graph with ratio less than $1$ must admit special subgraphs.


title: DagoBERT: Generating Derivational Morphology with a Pretrained Language Model

abstract: Can pretrained language models (PLMs) generate derivationally complex words? We present the first study investigating this question, taking BERT as the example PLM. We examine BERT's derivational capabilities in different settings, ranging from using the unmodified pretrained model to full finetuning. Our best model, DagoBERT (Derivationally and generatively optimized BERT), clearly outperforms the previous state of the art in derivation generation (DG). Furthermore, our experiments show that the input segmentation crucially impacts BERT's derivational knowledge, suggesting that the performance of PLMs could be further improved if a morphologically informed vocabulary of units were used.


title: PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data

abstract: In comparison with person re-identification (ReID), which has been widely studied in the research community, vehicle ReID has received less attention. Vehicle ReID is challenging due to 1) high intra-class variability (caused by the dependency of shape and appearance on viewpoint), and 2) small inter-class variability (caused by the similarity in shape and appearance between vehicles produced by different manufacturers). To address these challenges, we propose a Pose-Aware Multi-Task Re-Identification (PAMTRI) framework. This approach includes two innovations compared with previous methods. First, it overcomes viewpoint-dependency by explicitly reasoning about vehicle pose and shape via keypoints, heatmaps and segments from pose estimation. Second, it jointly classifies semantic vehicle attributes (colors and types) while performing ReID, through multi-task learning with the embedded pose representations. Since manually labeling images with detailed pose and attribute information is prohibitive, we create a large-scale highly randomized synthetic dataset with automatically annotated vehicle attributes for training. Extensive experiments validate the effectiveness of each proposed component, showing that PAMTRI achieves significant improvement over state-of-the-art on two mainstream vehicle ReID benchmarks: VeRi and CityFlow-ReID. Code and models are available at https://github.com/NVlabs/PAMTRI.


title: Dirac quasinormal modes of power-Maxwell charged black holes in Rastall gravity

abstract: In this paper, we study the quasinormal modes of the massless Dirac field for charged black holes in Rastall gravity. The spherically symmetric black hole solutions in question are characterized by the presence of a power-Maxwell field, surrounded by the quintessence fluid. The calculations are carried out by employing the WKB approximations up to the thirteenth order, as well as the matrix method. The temporal evolution of the quasinormal modes is investigated by using the finite difference method. Through numerical simulations, the properties of the quasinormal frequencies are analyzed, including those for the extremal black holes. Among others, we explore the case of a second type of extremal black holes regarding the Nariai solution, where the cosmical and event horizon coincide. The results obtained by the WKB approaches are found to be mostly consistent with those by the matrix method. It is demonstrated that the black hole solutions for Rastall gravity in asymptotically flat spacetimes are equivalent to those in Einstein gravity, featured by different asymptotical spacetime properties. As one of its possible consequences, we also investigate the behavior of the late-time tails of quasinormal models in the present model. It is found that the asymptotical behavior of the late-time tails of quasinormal modes in Rastall theory is governed by the asymptotical properties of the spacetimes of their counterparts in Einstein gravity.


title: Opportunistic Decoding with Timely Correction for Simultaneous Translation

abstract: Simultaneous translation has many important application scenarios and attracts much attention from both academia and industry recently. Most existing frameworks, however, have difficulties in balancing between the translation quality and latency, i.e., the decoding policy is usually either too aggressive or too conservative. We propose an opportunistic decoding technique with timely correction ability, which always (over-)generates a certain mount of extra words at each step to keep the audience on track with the latest information. At the same time, it also corrects, in a timely fashion, the mistakes in the former overgenerated words when observing more source context to ensure high translation quality. Experiments show our technique achieves substantial reduction in latency and up to +3.1 increase in BLEU, with revision rate under 8% in Chinese-to-English and English-to-Chinese translation.


title: On a conjecture of Huang--Lian--Yau--Yu

abstract: We verify a formula on the solution rank of the tautological system arising from ample complete intersections in a projective homogeneous space of a semisimple group conjectured by Huang--Lian--Yau--Yu arXiv:1801.01194. As an application, we prove the existence of the rank one point for such a system, where mirror symmetry is expected.


title: A hierarchy of coupled mode and envelope models for bi-directional microresonators with Kerr nonlinearity

abstract: We consider interaction of counter-propagating waves in a bi-directionally pumped ring microresonator with Kerr nonlinearity. We introduce a hierarchy of the mode expansions and envelope functions evolving on different time scales set by the cavity linewidth and nonlinearity, dispersion, and repetition rate, and provide a detailed derivation of the corresponding hierarchy of the coupled mode and of the Lugiato-Lefever-like equations. An effect of the washout of the repetition rate frequencies from the equations governing dynamics of the counter-propagating waves is elaborated in details.