title: Interactive Video Stylization Using Few-Shot Patch-Based Training

abstract: In this paper, we present a learning-based method to the keyframe-based video stylization that allows an artist to propagate the style from a few selected keyframes to the rest of the sequence. Its key advantage is that the resulting stylization is semantically meaningful, i.e., specific parts of moving objects are stylized according to the artist's intention. In contrast to previous style transfer techniques, our approach does not require any lengthy pre-training process nor a large training dataset. We demonstrate how to train an appearance translation network from scratch using only a few stylized exemplars while implicitly preserving temporal consistency. This leads to a video stylization framework that supports real-time inference, parallel processing, and random access to an arbitrary output frame. It can also merge the content from multiple keyframes without the need to perform an explicit blending operation. We demonstrate its practical utility in various interactive scenarios, where the user paints over a selected keyframe and sees her style transferred to an existing recorded sequence or a live video stream.


title: Upper Bounds on the average eccentricity of Graphs of Girth $6$ and $(C_4$, $C_5)$-free Graphs

abstract: Let $G$ be a finite, connected graph. The eccentricity of a vertex $v$ of $G$ is the distance from $v$ to a vertex farthest from $v$. The average eccentricity of $G$ is the arithmetic mean of the eccentricities of the vertices of $G$. We show that the average eccentricity of a connected graph $G$ of girth at least six is at most $\frac{9}{2} \lceil \frac{n}{2\delta^2 - 2\delta+2} \rceil + 7$, where $n$ is the order of $G$ and $\delta$ its minimum degree. We construct graphs that show that whenever $\delta-1$ is a prime power, then this bound is sharp apart from an additive constant. For graphs containing a vertex of large degree we give an improved bound. We further show that if the girth condition on $G$ is relaxed to $G$ having neither a $4$-cycle nor a $5$-cycle as a subgraph, then similar and only slightly weaker bounds hold.


title: Detecting Deep-Fake Videos from Appearance and Behavior

abstract: Synthetically-generated audios and videos -- so-called deep fakes -- continue to capture the imagination of the computer-graphics and computer-vision communities. At the same time, the democratization of access to technology that can create sophisticated manipulated video of anybody saying anything continues to be of concern because of its power to disrupt democratic elections, commit small to large-scale fraud, fuel dis-information campaigns, and create non-consensual pornography. We describe a biometric-based forensic technique for detecting face-swap deep fakes. This technique combines a static biometric based on facial recognition with a temporal, behavioral biometric based on facial expressions and head movements, where the behavioral embedding is learned using a CNN with a metric-learning objective function. We show the efficacy of this approach across several large-scale video datasets, as well as in-the-wild deep fakes.


title: Rethinking Class-Discrimination Based CNN Channel Pruning

abstract: Channel pruning has received ever-increasing focus on network compression. In particular, class-discrimination based channel pruning has made major headway, as it fits seamlessly with the classification objective of CNNs and provides good explainability. Prior works singly propose and evaluate their discriminant functions, while further study on the effectiveness of the adopted metrics is absent. To this end, we initiate the first study on the effectiveness of a broad range of discriminant functions on channel pruning. Conventional single-variate binary-class statistics like Student's T-Test are also included in our study via an intuitive generalization. The winning metric of our study has a greater ability to select informative channels over other state-of-the-art methods, which is substantiated by our qualitative and quantitative analysis. Moreover, we develop a FLOP-normalized sensitivity analysis scheme to automate the structural pruning procedure. On CIFAR-10, CIFAR-100, and ILSVRC-2012 datasets, our pruned models achieve higher accuracy with less inference cost compared to state-of-the-art results. For example, on ILSVRC-2012, our 44.3% FLOPs-pruned ResNet-50 has only a 0.3% top-1 accuracy drop, which significantly outperforms the state of the art.


title: The Interaction of Type Ia Supernovae with Planetary Nebulae: the Case of Kepler's Supernova Remnant

abstract: One of the key methods for determining the unknown nature of Type Ia supernovae (SNe Ia) is the search for traces of interaction between the SN ejecta and the circumstellar structures at the resulting supernova remnants (SNRs Ia). So far, the observables that we receive from well-studied SNRs Ia cannot be explained self-consistently by any model presented in the literature. In this study, we suggest that the circumstellar medium (CSM) being observed to surround several SNRs Ia was mainly shaped by planetary nebulae (PNe) that originated from one or both progenitor stars. Performing two-dimensional hydrodynamic simulations, we show that the ambient medium shaped by PNe can account for several properties of the CSM that have been found to surround SNe Ia and their remnants. Finally, we model Kepler's SNR considering that the SN explosion occurred inside a bipolar PN. Our simulations show good agreement with the observed morphological and kinematic properties of Kepler's SNR. In particular, our model reproduces the current expansion parameter of Kepler's SNR, the partial interaction of the remnant with a dense CSM at its northern region and finally the existence of two opposite protrusions (`ears') at the equatorial plane of the SNR.


title: Coordination and Communication of Autonomous Subsystems in Cyber Physical Systems: A Mechanism Learning Approach

abstract: In the control of many autonomous subsystems, such as autonomous vehicles or UAV networks, a centralized control may be hindered by the prohibitive complexity, limited communication bandwidth, or private information of subsystems. Therefore, it is desirable for the control center to coordinate the controls of subsystems by designing mechanisms such as pricing, which makes the local optimizations of subsystem dynamics also maximize the reward of the total system, namely the social welfare. The economics framework of mechanism design is employed for the coordination of the autonomous subsystems. To address the challenge of dynamics, which are not considered in conventional economics mechanism design, and the complexity of private information, the approaches of geometrization and machine learning are employed, by endowing different geometric structures to the problem. The theoretical framework is applied in the context of urban aerial mobility, where the numerical simulations show the validity of the proposed framework.


title: Balancing Personal Privacy and Public Safety during COVID-19: The Case of South Korea

abstract: There has been vigorous debate on how different countries responded to the COVID-19 pandemic. To secure public safety, South Korea actively used personal information at the risk of personal privacy whereas France encouraged voluntary cooperation at the risk of public safety. In this article, after a brief comparison of contextual differences with France, we focus on South Korea's approaches to epidemiological investigations. To evaluate the issues pertaining to personal privacy and public health, we examine the usage patterns of original data, de-identification data, and encrypted data. Our specific proposal discusses the COVID index, which considers collective infection, outbreak intensity, availability of medical infrastructure, and the death rate. Finally, we summarize the findings and lessons for future research and the policy implications.


title: Lyman-alpha transmission properties of the intergalactic medium in the CoDaII simulation

abstract: The decline in abundance of Lyman-$\alpha$ (Ly$\alpha$) emitting galaxies at $z \gtrsim 6$ is a powerful and commonly used probe to constrain the progress of cosmic reionization. We use the CoDaII simulation, which is a radiation hydrodynamic simulation featuring a box of $\sim 94$ comoving Mpc side length, to compute the Ly$\alpha$ transmission properties of the intergalactic medium (IGM) at $z\sim 5.8$ to $7$. Our results mainly confirm previous studies, i.e., we find a declining Ly$\alpha$ transmission with redshift and a large sightline-to-sightline variation. However, motivated by the recent discovery of blue Ly$\alpha$ peaks at high redshift, we also analyze the IGM transmission on the blue side, which shows a rapid decline at $z\gtrsim 6$ of the blue transmission. This low transmission can be attributed not only to the presence of neutral regions but also to the residual neutral hydrogen within ionized regions, for which a density even as low as $n_{\rm HI}\sim 10^{-9}\,\mathrm{cm}^{-3}$ (sometimes combined with kinematic effects) leads to a significantly reduced visibility. Still, we find that $\sim 1\%$ of sightlines towards $M_{\mathrm{1600AB}}\sim -21$ galaxies at $z\sim 7$ are transparent enough to allow a transmission of a blue Ly$\alpha$ peak. We discuss our results in the context of the interpretation of observations.


title: Towards optimal doubly robust estimation of heterogeneous causal effects

abstract: Heterogeneous effect estimation plays a crucial role in causal inference, with applications across medicine and social science. Many methods for estimating conditional average treatment effects (CATEs) have been proposed in recent years, but there are important theoretical gaps in understanding if and when such methods are optimal. This is especially true when the CATE has nontrivial structure (e.g., smoothness or sparsity). Our work contributes in several main ways. First, we study a two-stage doubly robust CATE estimator and give a generic model-free error bound, which, despite its generality, yields sharper results than those in the current literature. We apply the bound to derive error rates in nonparametric models with smoothness or sparsity, and give sufficient conditions for oracle efficiency. Underlying our error bound is a general oracle inequality for regression with estimated or imputed outcomes, which is of independent interest; this is the second main contribution. The third contribution is aimed at understanding the fundamental statistical limits of CATE estimation. To that end, we propose and study a local polynomial adaptation of double-residual regression. We show that this estimator can be oracle efficient under even weaker conditions, if used with a specialized form of sample splitting and careful choices of tuning parameters. These are the weakest conditions currently found in the literature, and we conjecture that they are minimal in a minimax sense. We go on to give error bounds in the non-trivial regime where oracle rates cannot be achieved. Some finite-sample properties are explored with simulations.


title: Eligibility of EFT approach to search for tqg FCNC phenomenon

abstract: The Effective Field Theory (EFT) approach is widely used in the search for possible deviations from the predictions of the Standard Model. Such an approximation of possible BSM physics is valid up to a certain levels of energy scale and accuracy. In this article, we investigate potential limitation of the EFT approach related to unitarity to describe possible contributions of flavor changing neutral currents (FCNC) involving the top quark. The numerical and analytical calculations of the FCNC processes used in the EFT approach demonstrate the constant asymptotic behavior of the total cross section with increasing energy. It is shown that the EFT approach for studying the possible contribution of FCNC does not violate the restrictions following from perturbative unitarity, the asymptotic behavior of the cross section does not exceed the Froissart bound, and the approach itself can be used to set the corresponding experimental limits for FCNC couplings or Wilson coefficients at present and future colliders.


title: Cosmicflows 4: The Calibration of Optical and Infrared Tully-Fisher Relations

abstract: This study is a part of the Cosmicflows-4 project with the aim of measuring the distances of more than ~10,000 spiral galaxies in the local universe up to ~15,000 km/s. New HI linewidth information has come primarily from the Arecibo Legacy Fast ALFA Survey. Photometry of our sample galaxies has been carried out in optical (SDSS u, g, r, i, z) and infrared (WISE W1 and W2) bands. Inclinations have been determined using an online graphical interface accessible to a collaboration of citizen scientists. Galaxy distances are measured based on the correlation between the rotation rate of spirals and their absolute luminosity, known as the Tully-Fisher Relation (TFR). In this study, we present the calibration of the TFR using a subsample of ~600 spirals located in 20 galaxy clusters. Correlations among such observables as color, surface brightness, and relative HI content are explored in an attempt to reduce the scatter about the TFR with the goal of obtaining more accurate distances. A preliminary determination of the Hubble constant from the distances and velocities of the calibrator clusters is H0=76.0+-1.1(stat.)+-2.3(sys.) km/s/Mpc.


title: Posterior Calibrated Training on Sentence Classification Tasks

abstract: Most classification models work by first predicting a posterior probability distribution over all classes and then selecting that class with the largest estimated probability. In many settings however, the quality of posterior probability itself (e.g., 65% chance having diabetes), gives more reliable information than the final predicted class alone. When these methods are shown to be poorly calibrated, most fixes to date have relied on posterior calibration, which rescales the predicted probabilities but often has little impact on final classifications. Here we propose an end-to-end training procedure called posterior calibrated (PosCal) training that directly optimizes the objective while minimizing the difference between the predicted and empirical posterior probabilities.We show that PosCal not only helps reduce the calibration error but also improve task performance by penalizing drops in performance of both objectives. Our PosCal achieves about 2.5% of task performance gain and 16.1% of calibration error reduction on GLUE (Wang et al., 2018) compared to the baseline. We achieved the comparable task performance with 13.2% calibration error reduction on xSLUE (Kang and Hovy, 2019), but not outperforming the two-stage calibration baseline. PosCal training can be easily extendable to any types of classification tasks as a form of regularization term. Also, PosCal has the advantage that it incrementally tracks needed statistics for the calibration objective during the training process, making efficient use of large training sets.


title: Reduced-Dimensional Reinforcement Learning Control using Singular Perturbation Approximations

abstract: We present a set of model-free, reduced-dimensional reinforcement learning (RL) based optimal control designs for linear time-invariant singularly perturbed (SP) systems. We first present a state-feedback and output-feedback based RL control design for a generic SP system with unknown state and input matrices. We take advantage of the underlying time-scale separation property of the plant to learn a linear quadratic regulator (LQR) for only its slow dynamics, thereby saving a significant amount of learning time compared to the conventional full-dimensional RL controller. We analyze the sub-optimality of the design using SP approximation theorems and provide sufficient conditions for closed-loop stability. Thereafter, we extend both designs to clustered multi-agent consensus networks, where the SP property reflects through clustering. We develop both centralized and cluster-wise block-decentralized RL controllers for such networks, in reduced dimensions. We demonstrate the details of the implementation of these controllers using simulations of relevant numerical examples and compare them with conventional RL designs to show the computational benefits of our approach.


title: Wavelet-based estimation in a semiparametric regression model

abstract: In this paper, we introduce a wavelet-based method for estimating the EDR space in Li's semiparametric regression model for achieving dimension reduction. This method is obtained by using linear wavelet estimators of the density and regression functions that are involved in the covariance matrix of conditional expectation whose spectral analysis gives the EDR directions. Then, consistency of the proposed estimators is proved. A simulation study that allow one to evaluate the performance of the proposal with comparison to existing methods is presented.


title: Zero-shot Neural Passage Retrieval via Domain-targeted Synthetic Question Generation

abstract: A major obstacle to the wide-spread adoption of neural retrieval models is that they require large supervised training sets to surpass traditional term-based techniques, which are constructed from raw corpora. In this paper, we propose an approach to zero-shot learning for passage retrieval that uses synthetic question generation to close this gap. The question generation system is trained on general domain data, but is applied to documents in the targeted domain. This allows us to create arbitrarily large, yet noisy, question-passage relevance pairs that are domain specific. Furthermore, when this is coupled with a simple hybrid term-neural model, first-stage retrieval performance can be improved further. Empirically, we show that this is an effective strategy for building neural passage retrieval models in the absence of large training corpora. Depending on the domain, this technique can even approach the accuracy of supervised models.


title: Large deviation principle for moment map estimation

abstract: We consider a family of positive operator valued measures associated with representations of compact connected Lie groups. For many independent copies of a single state and a tensor power representation we show that the observed probability distributions converge to the value of the moment map. For invertible states we prove that the measures satisfy the large deviation principle with an explicitly given rate function.


title: Touch? Speech? or Touch and Speech? Investigating Multimodal Interaction for Visual Network Exploration and Analysis

abstract: Interaction plays a vital role during visual network exploration as users need to engage with both elements in the view (e.g., nodes, links) and interface controls (e.g., sliders, dropdown menus). Particularly as the size and complexity of a network grow, interactive displays supporting multimodal input (e.g., touch, speech, pen, gaze) exhibit the potential to facilitate fluid interaction during visual network exploration and analysis. While multimodal interaction with network visualization seems like a promising idea, many open questions remain. For instance, do users actually prefer multimodal input over unimodal input, and if so, why? Does it enable them to interact more naturally, or does having multiple modes of input confuse users? To answer such questions, we conducted a qualitative user study in the context of a network visualization tool, comparing speech- and touch-based unimodal interfaces to a multimodal interface combining the two. Our results confirm that participants strongly prefer multimodal input over unimodal input attributing their preference to: 1) the freedom of expression, 2) the complementary nature of speech and touch, and 3) integrated interactions afforded by the combination of the two modalities. We also describe the interaction patterns participants employed to perform common network visualization operations and highlight themes for future multimodal network visualization systems to consider.


title: Kernel of Trace Operator of Sobolev Spaces on Lipschitz Domain

abstract: We are going to show that on bounded Lipschitz domain $D$: both $C_{c}^{\infty}(D)$, the set of smooth functions on $D$ with compact support, and $C_{0}^{\infty}(D)$, the set of smooth functions on $D$ with (extension) zero boundary, are dense in $W^{1,p}\left(D\right)$, $p\in[1,\infty)$. A proof can be found in Ne\v{c}as's monograph \cite{key-2}, Theorem 4.10, {\S}2.4.3. Our main result in this note is that: we find another proof by showing that both closures is the same as kernel of trace operator $T:\,W^{1,p}(D)\rightarrow L^{p}(\partial D)$ via some change of variables formulas from Evans and Gariepy's textbook \cite{key-4} for Lipschitz coordinate transformation, to extend the proof of Theorem 2 in {\S}5.5 of Evans' widespread PDE textbook \cite{key-3}, from $\mathcal{C}^{1}$ to Lipschitz domain.


title: Counterfactual Off-Policy Training for Neural Response Generation

abstract: Open-domain dialogue generation suffers from the data insufficiency problem due to the vast size of potential responses. In this paper, we propose to explore potential responses by counterfactual reasoning. Given an observed response, the counterfactual reasoning model automatically infers the outcome of an alternative policy that could have been taken. The resulting counterfactual response synthesized in hindsight is of higher quality than the response synthesized from scratch. Training on the counterfactual responses under the adversarial learning framework helps to explore the high-reward area of the potential response space. An empirical study on the DailyDialog dataset shows that our approach significantly outperforms the HRED model as well as the conventional adversarial learning approaches.


title: On the Origin of Optical Radiation during the Impulsive Phase of Flares on dMe Stars. I. Discussion of Gas Dynamic Models

abstract: In connection with a published critique, the author justifies the use of a motionless homogeneous plane layer of pure hydrogen plasma that is near local thermodynamic equilibrium (LTE) for analyzing the characteristics of the radiation from a chromospheric condensation of thickness $\Delta{}z_m=10\text{ km}$ in a gas dynamic model of stellar flares. It is shown that the shock-wave model of flares proposed by Belova and Bychkov, as opposed to the model of Kostyuk and Pikelner, has irremovable internal defects owing to exclusion of the interaction between a thermal wave (temperature jump) and a non-stationary radiative shock. In particular, this model (a) does not make it possible to increase the geometric thickness of a chromospheric condensation owing to divergence of the fronts of the thermal and shock waves during impulsive heating, (b) cannot provide heating of the chromospheres of red dwarfs over significant distances, and (c) predicts $\mathrm{H}_\alpha$ line profiles in conflict with observational data. It is argued that: (a) the shock-wave model by Belova and Bychkov represents a development of the kinematic model of solar flares (Nakagawa et al.) and its application to dMe stars, specifically: a study of the radiative response of the chromosphere of a red dwarf to impulsive heating in the simplest gas dynamic statement of the problem (a thermal wave is excluded, a stationary approach is used); (b) in terms of the Kostyuk and Pikelner model, the regions behind the stationary shock fronts do not correspond to a chromospheric condensation with time-varying thickness but to zones in which the plasma relaxes to a state of thermal equilibrium. It is emphasized that the separation of the Kostyuk and Pikelner model into "thermal" and "shock-wave" components is fundamentally impossible.


title: Four-generated direct powers of partition lattices and authentication

abstract: For an integer $n\geq 5$, H. Strietz (1975) and L. Z\'adori (1986) proved that the lattice Part$(n)$ of all partitions of $\{1,2,\dots,n\}$ is four-generated. Developing L. Z\'adori's particularly elegant construction further, we prove that even the $k$-th direct power Part$(n)^k$ of Part$(n)$ is four-generated for many but only finitely many exponents $k$. E.g., Part$(n)^k$ is four-generated for every $k\leq 3\cdot 10^{89}$, and it has a four element generating set that is not an antichain for every $k\leq 1.4\cdot 10^{34}$. In connection with these results, we outline a protocol how to use these lattices in authentication and secret key cryptography.


title: Towards Electrical-Current Control of Quantum States in Spin-Orbit-Coupled Matter

abstract: Novel materials, which often exhibit surprising or even revolutionary physical properties, are necessary for critical advances in technologies. Simultaneous control of structural and physical properties via a small electrical current is of great significance both fundamentally and technologically. Recent studies demonstrate that a combination of strong spin-orbit interactions and a distorted crystal structure in magnetic Mott insulators is sufficient to attain this long-desired goal. In this Topical Review, we highlight underlying properties of this class of materials and present two representative antiferromagnetic Mott insulators, namely, 4d-electron based Ca2RuO4 and 5d-electron based Sr2IrO4, as model systems. In essence, a small, applied electrical current engages with the lattice, critically reducing structural distortions, which in turn readily suppresses the antiferromagnetic and insulating state and subsequently results in emergent new states. While details may vary in different materials, at the heart of these phenomena are current-reduced lattice distortions, which, via spin-orbit interactions, dictate physical properties. Electrical current, which joins magnetic field, electric field, pressure, light, etc. as a new external stimulus, provides a new, key dimension for materials research, and also pose a series of intriguing questions that may provide the impetus for advancing our understanding of spin-orbit-coupled matter. This Topical Review provides a brief introduction, a few hopefully informative examples and some general remarks. It is by no means an exhaustive report of the current state of studies on this topic.


title: Reflected fractional Brownian motion in one and higher dimensions

abstract: Fractional Brownian motion (FBM), a non-Markovian self-similar Gaussian stochastic process with long-ranged correlations, represents a widely applied, paradigmatic mathematical model of anomalous diffusion. We report the results of large-scale computer simulations of FBM in one, two, and three dimensions in the presence of reflecting boundaries that confine the motion to finite regions in space. Generalizing earlier results for finite and semi-infinite one-dimensional intervals, we observe that the interplay between the long-time correlations of FBM and the reflecting boundaries leads to striking deviations of the stationary probability density from the uniform density found for normal diffusion. Particles accumulate at the boundaries for superdiffusive FBM while their density is depleted at the boundaries for subdiffusion. Specifically, the probability density $P$ develops a power-law singularity, $P\sim r^\kappa$, as function of the distance $r$ from the wall. We determine the exponent $\kappa$ as function of the dimensionality, the confining geometry, and the anomalous diffusion exponent $\alpha$ of the FBM. We also discuss implications of our results, including an application to modeling serotonergic fiber density patterns in vertebrate brains.


title: Dispersion relations of Yukawa fluids at weak and moderate coupling

abstract: In this paper we compare different theoretical approaches to describe the dispersion of collective modes in Yukawa fluids when the inter-particle coupling is relatively weak, so that kinetic and potential contributions to the dispersion relation compete. Thorough comparison with the results from molecular dymamics simulation allows us to conclude that in the regime investigated the best description is provided by the sum of the generalized excess bulk modulus and the Bohm-Gross kinetic term.


title: Asking without Telling: Exploring Latent Ontologies in Contextual Representations

abstract: The success of pretrained contextual encoders, such as ELMo and BERT, has brought a great deal of interest in what these models learn: do they, without explicit supervision, learn to encode meaningful notions of linguistic structure? If so, how is this structure encoded? To investigate this, we introduce latent subclass learning (LSL): a modification to existing classifier-based probing methods that induces a latent categorization (or ontology) of the probe's inputs. Without access to fine-grained gold labels, LSL extracts emergent structure from input representations in an interpretable and quantifiable form. In experiments, we find strong evidence of familiar categories, such as a notion of personhood in ELMo, as well as novel ontological distinctions, such as a preference for fine-grained semantic roles on core arguments. Our results provide unique new evidence of emergent structure in pretrained encoders, including departures from existing annotations which are inaccessible to earlier methods.


title: Instance-Based Learning of Span Representations: A Case Study through Named Entity Recognition

abstract: Interpretable rationales for model predictions play a critical role in practical applications. In this study, we develop models possessing interpretable inference process for structured prediction. Specifically, we present a method of instance-based learning that learns similarities between spans. At inference time, each span is assigned a class label based on its similar spans in the training set, where it is easy to understand how much each training instance contributes to the predictions. Through empirical analysis on named entity recognition, we demonstrate that our method enables to build models that have high interpretability without sacrificing performance.


title: LSND Constraints on the Higgs Portal

abstract: High-luminosity fixed target experiments provide impressive sensitivity to new light weakly coupled degrees of freedom. We revisit the minimal case of a scalar singlet $S$ coupled to the Standard Model through the Higgs portal, that decays visibly to leptons for scalar masses below the di-pion threshold. The dataset from the LSND experiment is found to impose the leading constraints within two mass windows between $m_S \sim 100$ and 350 MeV. In the process, we analyze a number of scalar production channels in the target, finding that proton bremsstrahlung provides the dominant channel at LSND beam energies.


title: A Supervised Word Alignment Method based on Cross-Language Span Prediction using Multilingual BERT

abstract: We present a novel supervised word alignment method based on cross-language span prediction. We first formalize a word alignment problem as a collection of independent predictions from a token in the source sentence to a span in the target sentence. As this is equivalent to a SQuAD v2.0 style question answering task, we then solve this problem by using multilingual BERT, which is fine-tuned on a manually created gold word alignment data. We greatly improved the word alignment accuracy by adding the context of the token to the question. In the experiments using five word alignment datasets among Chinese, Japanese, German, Romanian, French, and English, we show that the proposed method significantly outperformed previous supervised and unsupervised word alignment methods without using any bitexts for pretraining. For example, we achieved an F1 score of 86.7 for the Chinese-English data, which is 13.3 points higher than the previous state-of-the-art supervised methods.


title: Bilingual Text Extraction as Reading Comprehension

abstract: In this paper, we propose a method to extract bilingual texts automatically from noisy parallel corpora by framing the problem as a token-level span prediction, such as SQuAD-style Reading Comprehension. To extract a span of the target document that is a translation of a given source sentence (span), we use either QANet or multilingual BERT. QANet can be trained for a specific parallel corpus from scratch, while multilingual BERT can utilize pre-trained multilingual representations. For the span prediction method using QANet, we introduce a total optimization method using integer linear programming to achieve consistency in the predicted parallel spans. We conduct a parallel sentence extraction experiment using simulated noisy parallel corpora with two language pairs (En-Fr and En-Ja) and find that the proposed method using QANet achieves significantly better accuracy than a baseline method using two bi-directional RNN encoders, particularly for distant language pairs (En-Ja). We also conduct a sentence alignment experiment using En-Ja newspaper articles and find that the proposed method using multilingual BERT achieves significantly better accuracy than a baseline method using a bilingual dictionary and dynamic programming.


title: Knot Categorification from Mirror Symmetry, Part I: Coherent Sheaves

abstract: We derive two geometric approaches to categorification of quantum invariants of links associated to an arbitrary compact simple Lie group $^L{G}$. In part I, we describe the first approach, based on an equivariant derived category of coherent sheaves on ${\cal X}$, the moduli space of singular $G$-monopoles, where $G$ is related to $^LG$ by Langlands duality. In part II, we describe the second approach, based on the derived category of a Fukaya-Seidel category of a Calabi-Yau $Y$ with potential $W$. The two approaches are related by a version of mirror symmetry, which plays a crucial role in the story. In part III, we explain the string theory origin of these results, and the relation to an approach due to Witten.


title: An Empirical Study of Pre-trained Transformers for Arabic Information Extraction

abstract: Multilingual pre-trained Transformers, such as mBERT (Devlin et al., 2019) and XLM-RoBERTa (Conneau et al., 2020a), have been shown to enable the effective cross-lingual zero-shot transfer. However, their performance on Arabic information extraction (IE) tasks is not very well studied. In this paper, we pre-train a customized bilingual BERT, dubbed GigaBERT, that is designed specifically for Arabic NLP and English-to-Arabic zero-shot transfer learning. We study GigaBERT's effectiveness on zero-short transfer across four IE tasks: named entity recognition, part-of-speech tagging, argument role labeling, and relation extraction. Our best model significantly outperforms mBERT, XLM-RoBERTa, and AraBERT (Antoun et al., 2020) in both the supervised and zero-shot transfer settings. We have made our pre-trained models publicly available at https://github.com/lanwuwei/GigaBERT.


title: Prime alternating knots of minimal warping degree two

abstract: The warping degree of an oriented knot diagram is the minimal number of crossing changes which are required to obtain a monotone knot diagram from the diagram. The minimal warping degree of a knot is the minimal value of the warping degree for all oriented minimal diagrams of the knot. In this paper, all prime alternating knots with minimal warping degree two are determined.


title: One-Step Estimation With Scaled Proximal Methods

abstract: We study statistical estimators computed using iterative optimization methods that are not run until completion. Classical results on maximum likelihood estimators (MLEs) assert that a one-step estimator (OSE), in which a single Newton-Raphson iteration is performed from a starting point with certain properties, is asymptotically equivalent to the MLE. We further develop these early-stopping results by deriving properties of one-step estimators defined by a single iteration of scaled proximal methods. Our main results show the asymptotic equivalence of the likelihood-based estimator and various one-step estimators defined by scaled proximal methods. By interpreting OSEs as the last of a sequence of iterates, our results provide insight on scaling numerical tolerance with sample size. Our setting contains scaled proximal gradient descent applied to certain composite models as a special case, making our results applicable to many problems of practical interest. Additionally, our results provide support for the utility of the scaled Moreau envelope as a statistical smoother by interpreting scaled proximal descent as a quasi-Newton method applied to the scaled Moreau envelope.


title: Analysis of Spherical Monofractal and Multifractal Random Fields

abstract: The R\'enyi function plays an important role in the analysis of multifractal random fields. For random fields on the sphere, there are three models in the literature where the R\'enyi function is known explicitly. The theoretical part of the article presents multifractal random fields on the sphere and develops specific models where the R\'enyi function can be computed explicitly. Then these results are applied to the Cosmic Microwave Background Radiation data collected from the Planck mission. The main statistical model used to describe these data in the literature is isotropic Gaussian fields. We present numerical multifractality studies and methodology based on simulating random fields, computing the R\'enyi function and the multifractal spectrum for different scenarios and actual CMB data.


title: Exploiting Sentence Order in Document Alignment

abstract: We present a simple document alignment method that incorporates sentence order information in both candidate generation and candidate re-scoring. Our method results in 61% relative reduction in error compared to the best previously published result on the WMT16 document alignment shared task. Our method improves downstream MT performance on web-scraped Sinhala--English documents from ParaCrawl, outperforming the document alignment method used in the most recent ParaCrawl release. It also outperforms a comparable corpora method which uses the same multilingual embeddings, demonstrating that exploiting sentence order is beneficial even if the end goal is sentence-level bitext.


title: Simulated Multiple Reference Training Improves Low-Resource Machine Translation

abstract: Many valid translations exist for a given sentence, yet machine translation (MT) is trained with a single reference translation, exacerbating data sparsity in low-resource settings. We introduce Simulated Multiple Reference Training (SMRT), a novel MT training method that approximates the full space of possible translations by sampling a paraphrase of the reference sentence from a paraphraser and training the MT model to predict the paraphraser's distribution over possible tokens. We demonstrate the effectiveness of SMRT in low-resource settings when translating to English, with improvements of 1.2 to 7.0 BLEU. We also find SMRT is complementary to back-translation.


title: MobileDets: Searching for Object Detection Architectures for Mobile Accelerators

abstract: Inverted bottleneck layers, which are built upon depthwise convolutions, have been the predominant building blocks in state-of-the-art object detection models on mobile devices. In this work, we investigate the optimality of this design pattern over a broad range of mobile accelerators by revisiting the usefulness of regular convolutions. We discover that regular convolutions are a potent component to boost the latency-accuracy trade-off for object detection on accelerators, provided that they are placed strategically in the network via neural architecture search. By incorporating regular convolutions in the search space and directly optimizing the network architectures for object detection, we obtain a family of object detection models, MobileDets, that achieve state-of-the-art results across mobile accelerators. On the COCO object detection task, MobileDets outperform MobileNetV3+SSDLite by 1.7 mAP at comparable mobile CPU inference latencies. MobileDets also outperform MobileNetV2+SSDLite by 1.9 mAP on mobile CPUs, 3.7 mAP on Google EdgeTPU, 3.4 mAP on Qualcomm Hexagon DSP and 2.7 mAP on Nvidia Jetson GPU without increasing latency. Moreover, MobileDets are comparable with the state-of-the-art MnasFPN on mobile CPUs even without using the feature pyramid, and achieve better mAP scores on both EdgeTPUs and DSPs with up to 2x speedup. Code and models are available in the TensorFlow Object Detection API: https://github.com/tensorflow/models/tree/master/research/object_detection.


title: On the Connectivity of Token Graphs of Trees

abstract: Let $k$ and $n$ be integers such that $1\leq k \leq n-1$, and let $G$ be a simple graph of order $n$. The $k$-token graph $F_k(G)$ of $G$ is the graph whose vertices are the $k$-subsets of $V(G)$, where two vertices are adjacent in $F_k(G)$ whenever their symmetric difference is an edge of $G$. In this paper we show that if $G$ is a tree, then the connectivity of $F_k(G)$ is equal to the minimum degree of $F_k(G)$.


title: From Byzantine Replication to Blockchain: Consensus is only the Beginning

abstract: The popularization of blockchains leads to a resurgence of interest in Byzantine Fault-Tolerant (BFT) state machine replication protocols. However, much of the work on this topic focuses on the underlying consensus protocols, with emphasis on their lack of scalability, leaving other subtle limitations unaddressed. These limitations are related to the effects of maintaining a durable blockchain instead of a write-ahead log and the requirement for reconfiguring the set of replicas in a decentralized way. We demonstrate these limitations using a digital coin blockchain application and BFT-SMaRt, a popular BFT replication library. We show how they can be addressed both at a conceptual level, in a protocol-agnostic way, and by implementing SMaRtChain, a blockchain platform based on BFT-SMaRt. SMaRtChain improves the performance of our digital coin application by a factor of eight when compared with a naive implementation on top of BFT-SMaRt. Moreover, SMaRtChain achieves a throughput $8\times$ and $33\times$ better than Tendermint and Hyperledger Fabric, respectively, when ensuring strong durability on its blockchain.


title: Bias-corrected estimator for intrinsic dimension and differential entropy--a visual multiscale approach

abstract: Intrinsic dimension and differential entropy estimators are studied in this paper, including their systematic bias. A pragmatic approach for joint estimation and bias correction of these two fundamental measures is proposed. Shared steps on both estimators are highlighted, along with their useful consequences to data analysis. It is shown that both estimators can be complementary parts of a single approach, and that the simultaneous estimation of differential entropy and intrinsic dimension give meaning to each other, where estimates at different observation scales convey different perspectives of underlying manifolds. Experiments with synthetic and real datasets are presented to illustrate how to extract meaning from visual inspections, and how to compensate for biases.

categories: stat.ML cs.CV cs.IT cs.LG eess.SP math.IT


title: Estimates for a geometric flow for the Type IIB string

abstract: It is shown that bounds of all orders of derivative would follow from uniform bounds for the metric and the torsion 1-form, for a flow in non-K\"ahler geometry which can be interpreted as either a flow for the Type IIB string or the Anomaly flow with source term and zero slope parameter. A key ingredient in the proof is a formulation of this flow unifying it with the Ricci flow, which was recently found.


title: Stay Hungry, Stay Focused: Generating Informative and Specific Questions in Information-Seeking Conversations

abstract: We investigate the problem of generating informative questions in information-asymmetric conversations. Unlike previous work on question generation which largely assumes knowledge of what the answer might be, we are interested in the scenario where the questioner is not given the context from which answers are drawn, but must reason pragmatically about how to acquire new information, given the shared conversation history. We identify two core challenges: (1) formally defining the informativeness of potential questions, and (2) exploring the prohibitively large space of potential questions to find the good candidates. To generate pragmatic questions, we use reinforcement learning to optimize an informativeness metric we propose, combined with a reward function designed to promote more specific questions. We demonstrate that the resulting pragmatic questioner substantially improves the informativeness and specificity of questions generated over a baseline model, as evaluated by our metrics as well as humans.


title: Consistency of Spectral Clustering on Hierarchical Stochastic Block Models

abstract: We study the hierarchy of communities in real-world networks under a generic stochastic block model, in which the connection probabilities are structured in a binary tree. Under such model, a standard recursive bi-partitioning algorithm is dividing the network into two communities based on the Fiedler vector of the unnormalized graph Laplacian and repeating the split until a stopping rule indicates no further community structures. We prove the strong consistency of this method under a wide range of model parameters, which include sparse networks with node degrees as small as $O(\log n)$. In addition, unlike most of existing work, our theory covers multiscale networks where the connection probabilities may differ by orders of magnitude, which comprise an important class of models that are practically relevant but technically challenging to deal with. Finally we demonstrate the performance of our algorithm on synthetic data and real-world examples.


title: Hierarchical Encoders for Modeling and Interpreting Screenplays

abstract: While natural language understanding of long-form documents is still an open challenge, such documents often contain structural information that can inform the design of models for encoding them. Movie scripts are an example of such richly structured text - scripts are segmented into scenes, which are further decomposed into dialogue and descriptive components. In this work, we propose a neural architecture for encoding this structure, which performs robustly on a pair of multi-label tag classification datasets, without the need for handcrafted features. We add a layer of insight by augmenting an unsupervised "interpretability" module to the encoder, allowing for the extraction and visualization of narrative trajectories. Though this work specifically tackles screenplays, we discuss how the underlying approach can be generalized to a range of structured documents.


title: Virus Dynamics with Behavioral Responses

abstract: Motivated by epidemics such as COVID-19, we study the spread of a contagious disease when behavior responds to the disease's prevalence. We extend the SIR epidemiological model to include endogenous meeting rates. Individuals benefit from economic activity, but activity involves interactions with potentially infected individuals. The main focus is a theoretical analysis of contagion dynamics and behavioral responses to changes in risk. We obtain a simple condition for when public-health interventions or variants of a disease will have paradoxical effects on infection rates due to risk compensation. Behavioral responses are most likely to undermine public-health interventions near the peak of severe diseases.


title: Energy transfer mechanisms and resolvent analysis in the cylinder wake

abstract: Energy transfer mechanisms for vortex shedding behind a 2D cylinder at a Reynolds number of Re=100 are investigated. We first characterize the energy balances achieved by the true cylinder flow -- both for the flow as a whole and for each of its most energetic harmonic frequencies. It is found that viscous dissipation balances production when each is considered over the entire flow field and therefore that linear mechanisms achieve an energy balance on their own, thus respecting the Reynolds--Orr equation. Suitable energy conservation laws reveal that while nonlinear mechanisms neither produce nor consume energy overall, they nevertheless account for an important transfer of energy to higher frequencies. The energy balance for DNS is compared to that predicted by resolvent analysis. Although a suitable energy balance is achieved for each harmonic, resolvent analysis does not correctly model energy transfer between temporal frequencies. We further investigate the detailed roles of energy transfer from the viewpoint of nonlinear triadic interactions by considering a finite number of harmonic frequencies. It is shown that the nonlinearity plays a critical role in the redistribution of energy to higher harmonic frequencies. We observe not only an energy cascade from low frequencies to high frequencies, but also a considerable inverse cascade from high frequencies to low frequencies. The true nonlinear energy transfer mechanisms provide insight into closure models for improved resolvent-based predictions of harmonic modes in shear flows.


title: Text Segmentation by Cross Segment Attention

abstract: Document and discourse segmentation are two fundamental NLP tasks pertaining to breaking up text into constituents, which are commonly used to help downstream tasks such as information retrieval or text summarization. In this work, we propose three transformer-based architectures and provide comprehensive comparisons with previously proposed approaches on three standard datasets. We establish a new state-of-the-art, reducing in particular the error rates by a large margin in all cases. We further analyze model sizes and find that we can build models with many fewer parameters while keeping good performance, thus facilitating real-world applications.


title: Sensitivity kernels for inferring Lorentz stresses from normal-mode frequency splittings in the Sun

abstract: Departures from standard spherically symmetric solar models, in the form of perturbations such as global and local-scale flows and structural asphericities, result in the splitting of eigenfrequencies in the observed spectrum of solar oscillations. Drawing from prevalent ideas in normal-mode coupling theory in geophysical literature, we devise a procedure that enables the computation of sensitivity kernels for general Lorentz stress fields in the Sun. Mode coupling due to any perturbation requires careful consideration of self- and cross-coupling of multiplets. Invoking the isolated-multiplet approximation allows for limiting the treatment to purely self-coupling, requiring significantly less computational resources. We identify the presence of such isolated multiplets under the effect of Lorentz stresses in the Sun. Currently, solar missions allow precise measurements of self-coupling of multiplets via "$a$-coefficients" and the cross-spectral correlation signal which enables the estimation of the "structure coefficients". We demonstrate the forward problem for both self-coupling ($a$-coefficients) and cross-coupling (structure coefficients). In doing so, we plot the self-coupling kernels and estimate $a$-coefficients arising from a combination of deep-toroidal and surface-dipolar axisymmetric fields. We also compute the structure coefficients for an arbitrary general magnetic field (real and solenoidal) and plot the corresponding "splitting function", a convenient way to visualize the splitting of multiplets under 3D internal perturbations. The results discussed in this paper pave the way to formally pose an inverse problem, and infer solar internal magnetic fields.


title: Ultrahigh-Q AlGaAs-on-insulator microresonators for integrated nonlinear photonics

abstract: Aluminum gallium arsenide (AlGaAs) and related III-V semiconductors have excellent optoelectronic properties. They also possess strong material nonlinearity as well as high refractive indices. In view of these properties, AlGaAs is a promising candidate for integrated photonics, including both linear and nonlinear devices, passive and active devices, and associated applications. For integrated photonics low propagation loss is essential, particularly in nonlinear applications. However, achieving low-loss and high-confinement AlGaAs photonic integrated circuits poses a challenge. Here we show an effective reduction of surface-roughness-induced scattering loss in fully etched high-confinement AlGaAs-on-insulator nanowaveguides, by using a heterogeneous wafer-bonding approach and optimizing fabrication techniques. We demonstrate ultrahigh-quality AlGaAs microring resonators and realize quality factors up to 3.52E6 and finesses as high as 1.4E4. We also show ultra-efficient frequency comb generations in those resonators and achieve record-low threshold powers on the order of ~20 uW and ~120 uW for the resonators with 1 THz and 90 GHz free-spectral ranges, respectively. Our result paves the way for the implementation of AlGaAs as a novel integrated material platform specifically for nonlinear photonics, and opens a new window for chip-based efficiency-demanding practical applications.


title: Singular points of polarizations in the momentum space of photonic crystal slabs

abstract: Bound states in the continuum (BICs), circularly polarized states (C points) and degenerate states are all of three types of singular points of polarization in the momentum space. For photonic crystal slabs (PhCSs) with linearly polarized far fields, BICs were found to be the centers of polarization vortices and attracted more attention in the previous studies. Here, we theoretically demonstrate that the far fields of PhCSs can exhibit remarkably diverse polarizations due to the robust existences of C points in the continuum. Only a pair of C points with identical handedness and opposite topological charge can be annihilated together. Continuously fine tuning of the structure parameters of PhCSs without breaking their symmetry, a pair of C points with identical topological charge and opposite handedness are able to merge into a BIC, then the BIC splits into C points again. Interestingly, a Dirac-degenerate BIC with one half of topological charge is observed when two pairs of C points with identical topological charge from the upper and lower band, respectively, simultaneously merge at the Dirac-degenerate point. The law of topological charge conservation is verified to play an important role in the evolutions and interconversions between different types of polarization singularities. Our findings might shed light on the origin of singular points of polarization, could open a gateway towards the applications of them in the generation and manipulation of vector beams.


title: Physarum Powered Differentiable Linear Programming Layers and Applications

abstract: Consider a learning algorithm, which involves an internal call to an optimization routine such as a generalized eigenvalue problem, a cone programming problem or even sorting. Integrating such a method as a layer(s) within a trainable deep neural network (DNN) in an efficient and numerically stable way is not straightforward -- for instance, only recently, strategies have emerged for eigendecomposition and differentiable sorting. We propose an efficient and differentiable solver for general linear programming problems which can be used in a plug and play manner within DNNs as a layer. Our development is inspired by a fascinating but not widely used link between dynamics of slime mold (physarum) and optimization schemes such as steepest descent. We describe our development and show the use of our solver in a video segmentation task and meta-learning for few-shot learning. We review the existing results and provide a technical analysis describing its applicability for our use cases. Our solver performs comparably with a customized projected gradient descent method on the first task and outperforms the differentiable CVXPY-SCS solver on the second task. Experiments show that our solver converges quickly without the need for a feasible initial point. Our proposal is easy to implement and can easily serve as layers whenever a learning procedure needs a fast approximate solution to a LP, within a larger network.


title: Masking quantum information into a tripartite syste

abstract: Since masking of quantum information was introduced by Modi et al. in [PRL 120, 230501 (2018)], many discussions on this topic have been published. In this paper, we consider relationship between quantum multipartite maskers (QMMs) and quantum error-correcting codes (QECCs). We say that a subset $Q$ of pure states of a system $K$ can be masked by an operator $S$ into a multipartite system $\H^{(n)}$ if all of the image states $S|\psi\>$ of states $|\psi\>$ in $Q$ have the same marginal states on each subsystem. We call such an $S$ a QMM of $Q$. By establishing an expression of a QMM, we obtain a relationship between QMMs and QECCs, which reads that an isometry is a QMM of all pure states of a system if and only if its range is a QECC of any one-erasure channel. As an application, we prove that there is no an isometric universal masker from $\C^2$ into $\C^2\otimes\C^2\otimes\C^2$ and then the states of $\C^3$ can not be masked isometrically into $\C^2\otimes\C^2\otimes\C^2$. This gives a consummation to a main result and leads to a negative answer to an open question in [PRA 98, 062306 (2018)]. Another application is that arbitrary quantum states of $\C^d$ can be completely hidden in correlations between any two subsystems of the tripartite system $\C^{d+1}\otimes\C^{d+1}\otimes\C^{d+1}$, while arbitrary quantum states cannot be completely hidden in the correlations between subsystems of a bipartite system [PRL 98, 080502 (2007)].


title: RadixSpline: A Single-Pass Learned Index

abstract: Recent research has shown that learned models can outperform state-of-the-art index structures in size and lookup performance. While this is a very promising result, existing learned structures are often cumbersome to implement and are slow to build. In fact, most approaches that we are aware of require multiple training passes over the data. We introduce RadixSpline (RS), a learned index that can be built in a single pass over the data and is competitive with state-of-the-art learned index models, like RMI, in size and lookup performance. We evaluate RS using the SOSD benchmark and show that it achieves competitive results on all datasets, despite the fact that it only has two parameters.


title: Disk matrices and the proximal mapping for the numerical radius

abstract: Optimal matrices for problems involving the matrix numerical radius often have fields of values that are disks, a phenomenon associated with partial smoothness. Such matrices are highly structured: we experiment in particular with the proximal mapping for the radius, which often maps n-by-n random matrix inputs into a particular manifold of disk matrices that has real codimension 2n. The outputs, computed via semidefinite programming, also satisfy an unusual rank property at optimality.


title: TAVAT: Token-Aware Virtual Adversarial Training for Language Understanding

abstract: Gradient-based adversarial training is widely used in improving the robustness of neural networks, while it cannot be easily adapted to natural language processing tasks since the embedding space is discrete. In natural language processing fields, virtual adversarial training is introduced since texts are discrete and cannot be perturbed by gradients directly. Alternatively, virtual adversarial training, which generates perturbations on the embedding space, is introduced in NLP tasks. Despite its success, existing virtual adversarial training methods generate perturbations roughly constrained by Frobenius normalization balls. To craft fine-grained perturbations, we propose a Token-Aware Virtual Adversarial Training method. We introduce a token-level accumulated perturbation vocabulary to initialize the perturbations better and use a token-level normalization ball to constrain these perturbations pertinently. Experiments show that our method improves the performance of pre-trained models such as BERT and ALBERT in various tasks by a considerable margin. The proposed method improves the score of the GLUE benchmark from 78.3 to 80.9 using BERT model and it also enhances the performance of sequence labeling and text classification tasks.


title: High-Velocity Type Ia Supernova Has a Unique Host Environment

abstract: Ejecta velocity of type Ia supernovae (SNe Ia) is one powerful tool to differentiate between progenitor scenarios and explosion mechanisms. Here we revisit the relation between photospheric Si II 6355 velocities (Vsi) and host-galaxy properties with ~280 SNe Ia. A more stringent criterion on the phase of SN spectra is adopted to classify SNe Ia in terms of their photospheric velocities. We find significant trend that SNe Ia with faster Si II 6355 (high-Vsi SNe Ia) tend to explode in massive environments, whereas their slower counterparts can be found in both lower-mass and massive environments. This trend is further supported by the direct measurements on host gas-phase metallicities. We suggest this relation is likely caused by at least two populations of SNe Ia. Since stars of higher metallicity (at a given mass) generally form less massive white dwarfs (WDs), our results support some theoretical models that high-Vsi SNe Ia may originate from sub-Chandrasekhar class of explosions. Previous observations also showed some evidence that high-Vsi SNe Ia could be related to the single degenerate systems. However, we find high-Vsi SNe Ia do not come from particularly young populations. We conclude metallicity is likely the dominant factor in forming high-Vsi SNe Ia. This also implies their potential evolution with redshift and impact on the precision of SN Ia cosmology.


title: Explainable Deep Learning: A Field Guide for the Uninitiated

abstract: Deep neural networks (DNNs) have become a proven and indispensable machine learning tool. As a black-box model, it remains difficult to diagnose what aspects of the model's input drive the decisions of a DNN. In countless real-world domains, from legislation and law enforcement to healthcare, such diagnosis is essential to ensure that DNN decisions are driven by aspects appropriate in the context of its use. The development of methods and studies enabling the explanation of a DNN's decisions has thus blossomed into an active, broad area of research. A practitioner wanting to study explainable deep learning may be intimidated by the plethora of orthogonal directions the field has taken. This complexity is further exacerbated by competing definitions of what it means ``to explain'' the actions of a DNN and to evaluate an approach's ``ability to explain''. This article offers a field guide to explore the space of explainable deep learning aimed at those uninitiated in the field. The field guide: i) Introduces three simple dimensions defining the space of foundational methods that contribute to explainable deep learning, ii) discusses the evaluations for model explanations, iii) places explainability in the context of other related deep learning research areas, and iv) finally elaborates on user-oriented explanation designing and potential future directions on explainable deep learning. We hope the guide is used as an easy-to-digest starting point for those just embarking on research in this field.


title: WT5?! Training Text-to-Text Models to Explain their Predictions

abstract: Neural networks have recently achieved human-level performance on various challenging natural language processing (NLP) tasks, but it is notoriously difficult to understand why a neural network produced a particular prediction. In this paper, we leverage the text-to-text framework proposed by Raffel et al.(2019) to train language models to output a natural text explanation alongside their prediction. Crucially, this requires no modifications to the loss function or training and decoding procedures -- we simply train the model to output the explanation after generating the (natural text) prediction. We show that this approach not only obtains state-of-the-art results on explainability benchmarks, but also permits learning from a limited set of labeled explanations and transferring rationalization abilities across datasets. To facilitate reproducibility and future work, we release our code use to train the models.


title: DSAC: Distributional Soft Actor Critic for Risk-Sensitive Reinforcement Learning

abstract: In this paper, we present a new reinforcement learning (RL) algorithm called Distributional Soft Actor Critic (DSAC), which exploits the distributional information of accumulated rewards to achieve better performance. Seamlessly integrating SAC (which uses entropy to encourage exploration) with a principled distributional view of the underlying objective, DSAC takes into consideration the randomness in both action and rewards, and beats the state-of-the-art baselines in several continuous control benchmarks. Moreover, with the distributional information of rewards, we propose a unified framework for risk-sensitive learning, one that goes beyond maximizing only expected accumulated rewards. Under this framework we discuss three specific risk-related metrics: percentile, mean-variance and distorted expectation. Our extensive experiments demonstrate that with distribution modeling in RL, the agent performs better for both risk-averse and risk-seeking control tasks.


title: Extremism definitions in opinion dynamics models

abstract: There are several opinion dynamics models where extremism is defined as part of their characteristics. However, the way extremism is implemented in each model does not correspond to equivalent definitions. While some models focus on one aspect of the problem, others focus on different characteristics. This paper shows how each model only captures part of the problem and how Bayesian inspired opinion models can help put those differences in perspective. That discussion suggests new ways to introduce variables that can represent the problem of extremism better than we do today. Keywords: Extremism, Opinion dynamics, CODA, Sociophysics


title: Ocean surface radial velocity imaging in the AT-INSAR Velocity Bunching Model. A functional approach

abstract: This work is concerned with the estimation of radial velocities of sea surface elevations. The data, is a noisy along-track interferometric synthetic aperture radar (AT-INSAR) image. We assume the Velocity Bunching Model. This model relates the complex AT-INSAR image at a point in the image plane, with the radial velocity of a scatterer point in the sea surface. The relation is by means of a nonlinear integral operator mapping radial velocities into AT-INSAR images. Consequently, the estimation of radial velocities, amounts to the solution of nonlinear integral equations. Our proposal is to solve the latter by Newton's methods on function spaces, the optimize then discretize approach. We show that this continuous version is accurate, and faster than the classical discretize then optimize version. Also a physical comparison is carried out with the interferometric velocities.


title: Filtering before Iteratively Referring for Knowledge-Grounded Response Selection in Retrieval-Based Chatbots

abstract: The challenges of building knowledge-grounded retrieval-based chatbots lie in how to ground a conversation on its background knowledge and how to match response candidates with both context and knowledge simultaneously. This paper proposes a method named Filtering before Iteratively REferring (FIRE) for this task. In this method, a context filter and a knowledge filter are first built, which derive knowledge-aware context representations and context-aware knowledge representations respectively by global and bidirectional attention. Besides, the entries irrelevant to the conversation are discarded by the knowledge filter. After that, iteratively referring is performed between context and response representations as well as between knowledge and response representations, in order to collect deep matching features for scoring response candidates. Experimental results show that FIRE outperforms previous methods by margins larger than 2.8% and 4.1% on the PERSONA-CHAT dataset with original and revised personas respectively, and margins larger than 3.1% on the CMU_DoG dataset in terms of top-1 accuracy. We also show that FIRE is more interpretable by visualizing the knowledge grounding process.


title: Exponential mixing of frame flows for convex cocompact hyperbolic manifolds

abstract: The aim of this paper is to establish exponential mixing of frame flows for convex cocompact hyperbolic manifolds of arbitrary dimension with respect to the Bowen-Margulis-Sullivan measure. Some immediate applications include an asymptotic formula for matrix coefficients with an exponential error term as well as the exponential equidistribution of holonomy of closed geodesics. The main technical result is a spectral bound on transfer operators twisted by holonomy, which we obtain by building on Dolgopyat's method.


title: Salient Object Detection Combining a Self-attention Module and a Feature Pyramid Network

abstract: Salient object detection has achieved great improvement by using the Fully Convolution Network (FCN). However, the FCN-based U-shape architecture may cause the dilution problem in the high-level semantic information during the up-sample operations in the top-down pathway. Thus, it can weaken the ability of salient object localization and produce degraded boundaries. To this end, in order to overcome this limitation, we propose a novel pyramid self-attention module (PSAM) and the adoption of an independent feature-complementing strategy. In PSAM, self-attention layers are equipped after multi-scale pyramid features to capture richer high-level features and bring larger receptive fields to the model. In addition, a channel-wise attention module is also employed to reduce the redundant features of the FPN and provide refined results. Experimental analysis shows that the proposed PSAM effectively contributes to the whole model so that it outperforms state-of-the-art results over five challenging datasets. Finally, quantitative results show that PSAM generates clear and integral salient maps which can provide further help to other computer vision tasks, such as object detection and semantic segmentation.


title: Hybridizable Discontinuous Galerkin Methods for Helmholtz Equation with High Wave Number. Part I: Linear case

abstract: This paper addresses several aspects of the linear Hybridizable Discontinuous Galerkin Method (HDG) for the Helmholtz equation with impedance boundary condition at high frequency. First, error estimates with explicit dependence on the wave number $k$ for the HDG approximations to the exact solution $u$ and its negative gradient $\mathbf{q}=-\nabla u$ are derived. It is shown that $k\Vert u - u_h \Vert_{L^2(\Omega)} + \Vert \mathbf{q} -\mathbf{q}_h \Vert_{L^2(\Omega)} = O(k^2h^2+k^4h^3)$ under the conditions that $k^3h^2$ is sufficiently small and that the penalty parameter $\tau\eqsim k$, where $h$ is the mesh size. Note that the convergence order in $\mathbf{q}_h$ is full and the pollution error is $O(k^4h^3)$, which improve the existent results. Secondly, by using a standard postprocessing procedure from the HDG method for elliptic problems, a piecewise quadratic function $u_h^*$ is obtained so that $k\Vert u-u_h^*\Vert_{L^2(\Omega)}=O(k^3h^3+k^4h^3)$. Note that the postprocessing procedure improves only the interpolation error (from $O(k^2h^2)$ to $O(k^3h^3)$) but leaves the pollution error $O(k^4h^3)$ unchanged. Thirdly, dispersion analyses and extensive numerical tests show that the pollution effect can be eliminated completely in 1D case and reduced greatly in 2D case by selecting appropriate penalty parameters. The preasymptotic error analysis of the higher order HDG method for the Helmholtz equation with high wave number is studied in Part II.


title: Indirect Identification of Psychosocial Risks from Natural Language

abstract: During the perinatal period, psychosocial health risks, including depression and intimate partner violence, are associated with serious adverse health outcomes for parents and children. To appropriately intervene, healthcare professionals must first identify those at risk, yet stigma often prevents people from directly disclosing the information needed to prompt an assessment. We examine indirect methods of eliciting and analyzing information that could indicate psychosocial risks. Short diary entries by peripartum women exhibit thematic patterns, extracted by topic modeling, and emotional perspective, drawn from dictionary-informed sentiment features. Using these features, we use regularized regression to predict screening measures of depression and psychological aggression by an intimate partner. Journal text entries quantified through topic models and sentiment features show promise for depression prediction, with performance almost as good as closed-form questions. Text-based features were less useful for prediction of intimate partner violence, but moderately indirect multiple-choice questioning allowed for detection without explicit disclosure. Both methods may serve as an initial or complementary screening approach to detecting stigmatized risks.


title: User-Guided Aspect Classification for Domain-Specific Texts

abstract: Aspect classification, identifying aspects of text segments, facilitates numerous applications, such as sentiment analysis and review summarization. To alleviate the human effort on annotating massive texts, in this paper, we study the problem of classifying aspects based on only a few user-provided seed words for pre-defined aspects. The major challenge lies in how to handle the noisy misc aspect, which is designed for texts without any pre-defined aspects. Even domain experts have difficulties to nominate seed words for the misc aspect, making existing seed-driven text classification methods not applicable. We propose a novel framework, ARYA, which enables mutual enhancements between pre-defined aspects and the misc aspect via iterative classifier training and seed updating. Specifically, it trains a classifier for pre-defined aspects and then leverages it to induce the supervision for the misc aspect. The prediction results of the misc aspect are later utilized to filter out noisy seed words for pre-defined aspects. Experiments in two domains demonstrate the superior performance of our proposed framework, as well as the necessity and importance of properly modeling the misc aspect.


title: Thermodynamic properties and transport coefficients of QCD matter within the non-extensive Polyakov-Nambu-Jona-Lasinio model

abstract: We present a non-extensive version of the Polyakov-Nambu-Jona-Lasinio model which is based on the non-extentive statistical mechanics. This new statistics is characterized by a dimensionless non-extensivity parameter $q$ that accounts for all possible effects violating the assumptions of the Boltzmann-Gibbs statistics (when $q\rightarrow1$, it returns to the Boltzmann-Gibbs case). Using this q-Polyakov-Nambu-Jona-Lasinio model and including two different Polyakov-loop potentials, we discussed the influence of the parameter $q$ on chiral and deconfinement phase transition, various thermodynamic quantities and transport coefficients at finite temperature and zero quark chemical potential. We found that the Stefan-Boltzmann limit is actually related to the choice of statistics. For example, in the Tsallis statistics, the thermodynamic quantities $\frac{\epsilon}{T^{4}}$, $\frac{p}{T^{4}}$ and $\frac{s}{T^{3}}$ all increase with $q$, exceed their usual Stefan-Boltzmann limits and tend to a new $q$-related Tsallis limit at temperature high enough. Interestingly, however, due to a surprising cancellation, the high temperature limit of $c_{s}^{2}$ is still its SB limit $1/3$. In addition, we found some similarities between the non-extensive effect and the finite-size effect. For example, as $q$ increases (size decreases), the criticality of $\frac{c_{v}}{T^{3}}$ and $c_{s}^{2}$ gradually disappears. Besides, in order to better study the non-extensive effect, we defined a new susceptibility and calculated the response of thermodynamic quantities and transport coefficients to $q$. And found that their response patterns are different.


title: Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond

abstract: Conventional deformable registration methods aim at solving an optimization model carefully designed on image pairs and their computational costs are exceptionally high. In contrast, recent deep learning based approaches can provide fast deformation estimation. These heuristic network architectures are fully data-driven and thus lack explicit geometric constraints, e.g., topology-preserving, which are indispensable to generate plausible deformations. We design a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation in order to integrate advantages and avoid limitations of these two categories of approaches. Specifically, we introduce a generic optimization model to formulate diffeomorphic registration and develop a series of learnable architectures to obtain propagative updating in the coarse-to-fine feature space. Moreover, we propose a novel bilevel self-tuned training strategy, allowing efficient search of task-specific hyper-parameters. This training strategy increases the flexibility to various types of data while reduces computational and human burdens. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data. Extensive results demonstrate the state-of-the-art performance of the proposed method with diffeomorphic guarantee and extreme efficiency. We also apply our framework to challenging multi-modal image registration, and investigate how our registration to support the down-streaming tasks for medical image analysis including multi-modal fusion and image segmentation.


title: Deducing Flux from Single Point Temperature History when Relative Spatial Variation of Flux is Prescribed

abstract: Surface heat transfer in convective and radiative environments is sometimes measured by recording the surface temperature history in a transient experiment and interpreting this surface temperature with the aid of a suitable model for transient conduction within the substrate. The semi-infinite one-dimensional model is often adopted, and several well-developed techniques for application of this model to surface temperature data are available. However, when a spatial variation of heat flux exists across the surface, the application of the semi-infinite one-dimensional approach may not always be a reasonable approximation. In this paper we introduce a method for treatment of the measured surface temperature history that is more accurate than the semi-infinite one-dimensional approximation when substrate lateral conduction is significant and the relative spatial distribution of the flux is known a priori. This new method uses the so-called \textit{Neumann heat kernel}, which evolves a temperature over an insulated domain with unit energy initially deposited at a specified point. A useful impulse response function is formed by integrating this Neumann heat kernel against the spatial variation of flux over the surface of the domain. Neumann heat kernels are constructed for the solid box, cylinder, and sphere. By applying the heat kernel result for the sphere to the analysis of a convective experiment using hemispherical-nosed probes, we demonstrate how the theoretical results enhance the practical analysis of transient surface temperature measurements. The current approach is superior to former methods relying on semi-empirical approximations because the multi-dimensional heat conduction within the substrate is modelled with greater fidelity using the heat kernel analysis.


title: A Survey on Time-Sensitive Resource Allocation in the Cloud Continuum

abstract: Artificial Intelligence (AI) and Internet of Things (IoT) applications are rapidly growing in today's world where they are continuously connected to the internet and process, store and exchange information among the devices and the environment. The cloud and edge platform is very crucial to these applications due to their inherent compute-intensive and resource-constrained nature. One of the foremost challenges in cloud and edge resource allocation is the efficient management of computation and communication resources to meet the performance and latency guarantees of the applications. The heterogeneity of cloud resources (processors, memory, storage, bandwidth), variable cost structure and unpredictable workload patterns make the design of resource allocation techniques complex. Numerous research studies have been carried out to address this intricate problem. In this paper, the current state-of-the-art resource allocation techniques for the cloud continuum, in particular those that consider time-sensitive applications, are reviewed. Furthermore, we present the key challenges in the resource allocation problem for the cloud continuum, a taxonomy to classify the existing literature and the potential research gaps.


title: RikiNet: Reading Wikipedia Pages for Natural Question Answering

abstract: Reading long documents to answer open-domain questions remains challenging in natural language understanding. In this paper, we introduce a new model, called RikiNet, which reads Wikipedia pages for natural question answering. RikiNet contains a dynamic paragraph dual-attention reader and a multi-level cascaded answer predictor. The reader dynamically represents the document and question by utilizing a set of complementary attention mechanisms. The representations are then fed into the predictor to obtain the span of the short answer, the paragraph of the long answer, and the answer type in a cascaded manner. On the Natural Questions (NQ) dataset, a single RikiNet achieves 74.3 F1 and 57.9 F1 on long-answer and short-answer tasks. To our best knowledge, it is the first single model that outperforms the single human performance. Furthermore, an ensemble RikiNet obtains 76.1 F1 and 61.3 F1 on long-answer and short-answer tasks, achieving the best performance on the official NQ leaderboard


title: An Axiomatic Approach to Existence and Liveness for Differential Equations

abstract: This article presents an axiomatic approach for deductive verification of existence and liveness for ordinary differential equations (ODEs) with differential dynamic logic (dL). The approach yields proofs that the solution of a given ODE exists long enough to reach a given target region without leaving a given evolution domain. Numerous subtleties complicate the generalization of discrete liveness verification techniques, such as loop variants, to the continuous setting. For example, ODE solutions may blow up in finite time or their progress towards the goal may converge to zero. These subtleties are handled in dL by successively refining ODE liveness properties using ODE invariance properties which have a complete axiomatization. This approach is widely applicable: several liveness arguments from the literature are surveyed and derived as special instances of axiomatic refinement in dL. These derivations also correct several soundness errors in the surveyed literature, which further highlights the subtlety of ODE liveness reasoning and the utility of an axiomatic approach. An important special case of this approach deduces (global) existence properties of ODEs, which are a fundamental part of every ODE liveness argument. Thus, all generalizations of existence properties and their proofs immediately lead to corresponding generalizations of ODE liveness arguments. Overall, the resulting library of common refinement steps enables both the sound development and justification of new ODE existence and of liveness proof rules from dL axioms. These insights are put into practice through an implementation of ODE liveness proofs in the KeYmaera X theorem prover for hybrid systems.


title: Robust Automated Photometry Pipeline for Blurred Images

abstract: The primary task of the 1.26-m telescope jointly operated by the National Astronomical Observatory and Guangzhou University is photometric observations of the g, r, and i bands. A data processing pipeline system was set up with mature software packages, such as IRAF, SExtractor, and SCAMP, to process approximately 5 GB of observational data automatically every day. However, the success ratio was significantly reduced when processing blurred images owing to telescope tracking error; this, in turn, significantly constrained the output of the telescope. We propose a robust automated photometric pipeline (RAPP) software that can correctly process blurred images. Two key techniques are presented in detail: blurred star enhancement and robust image matching. A series of tests proved that RAPP not only achieves a photometric success ratio and precision comparable to those of IRAF but also significantly reduces the data processing load and improves the efficiency.


title: Secrecy Analysis of Ambient Backscatter NOMA Systems under I/Q Imbalance

abstract: We investigate the reliability and security of the ambient backscatter (AmBC) non-orthogonal multiple access (NOMA) systems, where the source aims to communication with two NOMA users in the presence of an eavesdropper. We consider a more practical case that nodes and backscatter device (BD) suffer from in-phase and quadrature-phase imbalance (IQI). More specifically, exact analytical expressions for the outage probability (OP) and the intercept probability (IP) are derived in closedform. Moreover, the asymptotic behaviors and corresponding diversity orders for the OP are discussed. Numerical results show that: 1) Although IQI reduces the reliability, it can enhance the security. 2) Compared with the traditional orthogonal multiple access (OMA) system, the AmBC-NOMA system can obtain better reliability when the signal-to-noise (SNR) ratio is low; 3) There are error floors for the OP because of the reflection coefficient \b{eta} .


title: Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing

abstract: We frame the task of machine translation evaluation as one of scoring machine translation output with a sequence-to-sequence paraphraser, conditioned on a human reference. We propose training the paraphraser as a multilingual NMT system, treating paraphrasing as a zero-shot translation task (e.g., Czech to Czech). This results in the paraphraser's output mode being centered around a copy of the input sequence, which represents the best case scenario where the MT system output matches a human reference. Our method is simple and intuitive, and does not require human judgements for training. Our single model (trained in 39 languages) outperforms or statistically ties with all prior metrics on the WMT 2019 segment-level shared metrics task in all languages (excluding Gujarati where the model had no training data). We also explore using our model for the task of quality estimation as a metric--conditioning on the source instead of the reference--and find that it significantly outperforms every submission to the WMT 2019 shared task on quality estimation in every language pair.


title: Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training

abstract: The natural language generation (NLG) module in a task-oriented dialogue system produces user-facing utterances conveying required information. Thus, it is critical for the generated response to be natural and fluent. We propose to integrate adversarial training to produce more human-like responses. The model uses Straight-Through Gumbel-Softmax estimator for gradient computation. We also propose a two-stage training scheme to boost performance. Empirical results show that the adversarial training can effectively improve the quality of language generation in both automatic and human evaluations. For example, in the RNN-LG Restaurant dataset, our model AdvNLG outperforms the previous state-of-the-art result by 3.6% in BLEU.


title: TRP: Trained Rank Pruning for Efficient Deep Neural Networks

abstract: To enable DNNs on edge devices like mobile phones, low-rank approximation has been widely adopted because of its solid theoretical rationale and efficient implementations. Several previous works attempted to directly approximate a pretrained model by low-rank decomposition; however, small approximation errors in parameters can ripple over a large prediction loss. As a result, performance usually drops significantly and a sophisticated effort on fine-tuning is required to recover accuracy. Apparently, it is not optimal to separate low-rank approximation from training. Unlike previous works, this paper integrates low rank approximation and regularization into the training process. We propose Trained Rank Pruning (TRP), which alternates between low rank approximation and training. TRP maintains the capacity of the original network while imposing low-rank constraints during training. A nuclear regularization optimized by stochastic sub-gradient descent is utilized to further promote low rank in TRP. The TRP trained network inherently has a low-rank structure, and is approximated with negligible performance loss, thus eliminating the fine-tuning process after low rank decomposition. The proposed method is comprehensively evaluated on CIFAR-10 and ImageNet, outperforming previous compression methods using low rank approximation.


title: Plan-Space State Embeddings for Improved Reinforcement Learning

abstract: Robot control problems are often structured with a policy function that maps state values into control values, but in many dynamic problems the observed state can have a difficult to characterize relationship with useful policy actions. In this paper we present a new method for learning state embeddings from plans or other forms of demonstrations such that the embedding space has a specified geometric relationship with the demonstrations. We present a novel variational framework for learning these embeddings that attempts to optimize trajectory linearity in the learned embedding space. We show how these embedding spaces can then be used as an augmentation to the robot state in reinforcement learning problems. We use kinodynamic planning to generate training trajectories for some example environments, and then train embedding spaces for these environments. We show empirically that observing a system in the learned embedding space improves the performance of policy gradient reinforcement learning algorithms, particularly by reducing the variance between training runs. Our technique is limited to environments where demonstration data is available, but places no limits on how that data is collected. Our embedding technique provides a way to transfer domain knowledge from existing technologies such as planning and control algorithms, into more flexible policy learning algorithms, by creating an abstract representation of the robot state with meaningful geometry.


title: Large-scale Regularity of Nearly Incompressible Elasticity in Stochastic Homogenization

abstract: In this paper, we systematically study the regularity theory of the linear system of nearly incompressible elasticity. In the setting of stochastic homogenization, we develop new techniques to establish the large-scale estimates of displacement and pressure, which are uniform in both the scale parameter and the incompressibility parameter. In particular, we obtain the boundary estimates in a new class of Lipschitz domains whose boundaries are smooth at large scales and bumpy at small scales.


title: APB2Face: Audio-guided face reenactment with auxiliary pose and blink signals

abstract: Audio-guided face reenactment aims at generating photorealistic faces using audio information while maintaining the same facial movement as when speaking to a real person. However, existing methods can not generate vivid face images or only reenact low-resolution faces, which limits the application value. To solve those problems, we propose a novel deep neural network named APB2Face, which consists of GeometryPredictor and FaceReenactor modules. GeometryPredictor uses extra head pose and blink state signals as well as audio to predict the latent landmark geometry information, while FaceReenactor inputs the face landmark image to reenact the photorealistic face. A new dataset AnnVI collected from YouTube is presented to support the approach, and experimental results indicate the superiority of our method than state-of-the-arts, whether in authenticity or controllability.


title: Is the Moon there if nobody looks: Bell Inequalities and Physical Reality

abstract: Various Bell inequalities are trivial algebraic properties satisfied by each line of particular data spreadsheets.It is surprising that their violation in some experiments, allows to speculate about the existence of nonlocal influences in Nature and to doubt the existence of the objective external physical reality. Such speculations are rooted in incorrect interpretations of quantum mechanics and in a failure of local realistic hidden variable models to reproduce quantum predictions for spin polarisation correlation experiments. These hidden variable models use counterfactual joint probability distributions of only pairwise measurable random variables to prove the inequalities. In real experiments Alice and Bob, using 4 incompatible pairs of experimental settings, estimate imperfect correlations between clicks, registered by their detectors. Clicks announce detection of photons and are coded by 1 or -1. Expectations of corresponding ,only pairwise measurable, random variables are estimated and compared with quantum predictions. These estimates violate significantly the inequalities. Since all these random variables cannot be jointly measured , a joint probability distribution of them does not exist and various Bell inequalities may not be derived. Thus it is not surprising that they are violated. Moreover,if contextual setting dependent parameters describing measuring instruments are correctly included in the description, then imperfect correlations between the clicks may be explained in a locally causal way. In this paper we review and rephrase several arguments proving that the violation of various Bell inequalities may neither justify the quantum nonlocality nor allow for doubt regarding the existence of atoms, electrons and other invisible elementary particles which are building blocks of the visible world around us including ourselves.


title: memeBot: Towards Automatic Image Meme Generation

abstract: Image memes have become a widespread tool used by people for interacting and exchanging ideas over social media, blogs, and open messengers. This work proposes to treat automatic image meme generation as a translation process, and further present an end to end neural and probabilistic approach to generate an image-based meme for any given sentence using an encoder-decoder architecture. For a given input sentence, an image meme is generated by combining a meme template image and a text caption where the meme template image is selected from a set of popular candidates using a selection module, and the meme caption is generated by an encoder-decoder model. An encoder is used to map the selected meme template and the input sentence into a meme embedding and a decoder is used to decode the meme caption from the meme embedding. The generated natural language meme caption is conditioned on the input sentence and the selected meme template. The model learns the dependencies between the meme captions and the meme template images and generates new memes using the learned dependencies. The quality of the generated captions and the generated memes is evaluated through both automated and human evaluation. An experiment is designed to score how well the generated memes can represent the tweets from Twitter conversations. Experiments on Twitter data show the efficacy of the model in generating memes for sentences in online social interaction.


title: Masking quantum information encoded in pure and mixed states

abstract: Masking of quantum information means that information is hidden from a subsystem and spread over a composite system. Modi et al. proved in [Phys. Rev. Lett. 120, 230501 (2018)] that this is true for some restricted sets of nonorthogonal quantum states and it is not possible for arbitrary quantum states. In this paper, we discuss the problem of masking quantum information encoded in pure and mixed states, respectively. Based on an established necessary and sufficient condition for a set of pure states to be masked by an operator, we find that there exists a set of four states that can not be masked, which implies that to mask unknown pure states is impossible. We construct a masker $S^\sharp$ and obtain its maximal maskable set, leading to an affirmative answer to a conjecture proposed in Modi's paper mentioned above. We also prove that an orthogonal (resp. linearly independent) subset of pure states can be masked by an isometry (resp. injection). Generalizing the case of pure states, we introduce the maskability of a set of mixed states and prove that a commuting subset of mixed states can be masked by an isometry $S^{\diamond}$ while it is impossible to mask all of mixed states by any operator. We also find the maximal maskable sets of mixed states of the isometries ${S^{\sharp}}$ and ${S^{\diamond}}$, respectively.