title: Casimir effect in Lorentz-violating scalar field theory: a local approach

abstract: We study the Casimir effect in the classical geometry of two parallel conductive plates, separated by a distance $L$, for a Lorentz-breaking extension of the scalar field theory. The Lorentz-violating part of the theory is characterized by the term $\lambda \left( u \cdot \partial \phi \right )^{2}$, where the parameter $\lambda$ and the background four-vector $u ^{\mu}$ codify Lorentz symmetry violation. We use Green's function techniques to study the local behavior of the vacuum stress-energy tensor in the region between the plates. Closed analytical expressions are obtained for the Casimir energy and pressure. We show that the energy density $\mathcal{E}_{C}$ (and hence the pressure) can be expressed in terms of the Lorentz-invariant energy density $\mathcal{E}_{0}$ as follows \begin{align} \mathcal{E}_{C} (L) = \sqrt{\frac{1-\lambda u_{n} ^{2}}{1 + \lambda u ^{2}}} \mathcal{E}_{0} (\tilde{L}) , \notag \end{align} where $\tilde{L} = L / \sqrt{1-\lambda u_{n} ^{2}}$ is a rescaled plate-to-plate separation and $u_{n}$ is the component of $\vec{{u}}$ along the normal to the plates. As usual, divergences of the local Casimir energy do not contribute to the pressure.


title: Neural Entity Summarization with Joint Encoding and Weak Supervision

abstract: In a large-scale knowledge graph (KG), an entity is often described by a large number of triple-structured facts. Many applications require abridged versions of entity descriptions, called entity summaries. Existing solutions to entity summarization are mainly unsupervised. In this paper, we present a supervised approach NEST that is based on our novel neural model to jointly encode graph structure and text in KGs and generate high-quality diversified summaries. Since it is costly to obtain manually labeled summaries for training, our supervision is weak as we train with programmatically labeled data which may contain noise but is free of manual work. Evaluation results show that our approach significantly outperforms the state of the art on two public benchmarks.


title: Enriching Documents with Compact, Representative, Relevant Knowledge Graphs

abstract: A prominent application of knowledge graph (KG) is document enrichment. Existing methods identify mentions of entities in a background KG and enrich documents with entity types and direct relations. We compute an entity relation subgraph (ERG) that can more expressively represent indirect relations among a set of mentioned entities. To find compact, representative, and relevant ERGs for effective enrichment, we propose an efficient best-first search algorithm to solve a new combinatorial optimization problem that achieves a trade-off between representativeness and compactness, and then we exploit ontological knowledge to rank ERGs by entity-based document-KG and intra-KG relevance. Extensive experiments and user studies show the promising performance of our approach.


title: Kink-Antikink Collisions and Multi-Bounce Resonance Windows in Higher-Order Field Theories

abstract: We study collisions of coherent structures in higher-order field-theoretic models, such as the $\phi^8$, $\phi^{10}$ and $\phi^{12}$ ones. The main distinguishing feature, of the example models considered herein, is that the collision arises due to the long-range interacting algebraic tails of these solitary waves. We extend the approach to suitably initialize the relevant kinks, in the additional presence of finite initial speed, in order to minimize the dispersive wave radiation potentially created by their slow spatial decay. We find that, when suitably initialized, these models still feature the multi-bounce resonance windows earlier found in models in which the kinks bear exponential tails, such as the $\phi^4$ and $\phi^6$ field theories among others. Also present is the self-similar structure of the associated windows with three- and more-bounce windows at the edges of two- and lower-bounce ones. Moreover, phenomenological, but highly accurate (and predictive) scaling relations are derived for the dependence of the time between consecutive collisions and, e.g., the difference in kinetic energy between the incoming one and the critical one for one-bounces. Such scalings are traced extensively over two-bounce collision windows throughout the three models, hinting at the possibility of an analytical theory in this direction.


title: Star formation and morphological properties of galaxies in the Pan-STARRS $3 \pi$ survey- I. A machine learning approach to galaxy and supernova classification

abstract: We present a classification of galaxies in the Pan-STARRS1 (PS1) 3$\pi$ survey based on their recent star formation history and morphology. Specifically, we train and test two Random Forest (RF) classifiers using photometric features (colors and moments) from the PS1 data release 2. Labels for the morphological classification are taken from Huertas-Company+2011, while labels for the star formation fraction (SFF) are from the Blanton+2005 catalog. We find that colors provide more predictive accuracy than photometric moments. We morphologically classify galaxies as either early- or late-type, and our RF model achieves a 78\% classification accuracy. Our second model classifies galaxies as having either a low-to-moderate or high SFF. This model achieves an 89\% classification accuracy. We apply both RF classifiers to the entire PS1 $3\pi$ dataset, allowing us to assign two scores to each PS1 source: $P_\mathrm{HSFF}$, which quantifies the probability of having a high SFF, and $P_\mathrm{spiral}$, which quantifies the probability of having a late-type morphology. Finally, as a proof of concept, we apply our classification framework to supernova (SN) host-galaxies from the Zwicky Transient Factory and the Lick Observatory Supernova Search samples. We show that by selecting on $P_\mathrm{HSFF}$ or $P_\mathrm{spiral}$ it is possible to significantly enhance or suppress the fraction of core-collapse SNe (or thermonuclear SNe) in the sample with respect to random guessing. This result demonstrates how contextual information can aid transient classifications at the time of first detection. In the current era of spectroscopically-starved time-domain astronomy, prompt automated classification is paramount.


title: Hidden scale invariance of intermittent turbulence in a shell model

abstract: It is known that scale invariance is broken in the developed hydrodynamic turbulence due to intermittency, substantiating complexity of turbulent flows. Here we challenge the concept of broken scale invariance by establishing a hidden self-similarity in intermittent turbulence. Using a simplified (shell) model, we derive a nonlinear spatiotemporal scaling symmetry of inviscid equations, which are reformulated in terms of intrinsic times introduced at different scales of motion. Numerical analysis persuasively confirms that this symmetry is restored in a statistical sense within the inertial interval. At the end, we discuss implications of this result for the Navier-Stokes system.


title: A Novel Structure of Advance Encryption Standard with 3-Dimensional Dynamic S-box and Key Generation Matrix

abstract: The study of sending and receiving secret messages is called cryptography. Generally, senders and receivers are unaware about the process of encryption and decryption. Hence, encryption plays an important role in data communication and data security. The meaning of encryption is not only to keep data confidential from unwanted access but also ensuring the data integrity through available way. As the capacity of breaking the security is increasing rapidly, so, the process that hides information is one of the most concerned topics. Advanced Encryption Standard is a popular, widely used and efficient encryption algorithm, which has been used since it was invented. This paper focuses on the AES key generation process and Substitution box. It modifies the conventional key generation technique and builds the dynamic 3-Dimensional S-box of Advance Encryption Standard. The proposed approach suggests 3-Dimensioanl Key Generation Matrix and S-box. As per shown this novel technique increases the amount of time it needs during encryption and decryption. The experimental result shows that it also enhances the strength of AES algorithm. The proposed approach illustrates the theoretical analysis and corresponding experimented results.


title: On the Merging of Domain-Specific Heterogeneous Ontologies using Wordnet and Web Pattern-based Queries

abstract: Ontologies form the basic interest in various computer science disciplines such as semantic web, information retrieval, database design, etc. They aim at providing a formal, explicit and shared conceptualization and understanding of common domains between different communities. In addition, they allow for concepts and their constraints of a specific domain to be explicitly defined. However, the distributed nature of ontology development and the differences in viewpoints of the ontology engineers have resulted in the so called "semantic heterogeneity" between ontologies. Semantic heterogeneity constitutes the major obstacle against achieving interoperability between ontologies. To overcome this obstacle, we present a multi-purpose framework which exploits the WordNet generic knowledge base for: i) Discovering and correcting the incorrect semantic relations between the concepts of the ontology in a specific domain. This step is a primary step of ontology merging. ii) Merging domain-specific ontologies through computing semantic relations between their concepts. iii) Handling the issue of missing concepts in WordNet through the acquisition of statistical information on the Web. And iv) Enriching WordNet with these missing concepts. An experimental instantiation of the framework and comparisons with state-of-the-art syntactic and semantic-based systems validate our proposal.


title: Why and when should you pool? Analyzing Pooling in Recurrent Architectures

abstract: Pooling-based recurrent neural architectures consistently outperform their counterparts without pooling. However, the reasons for their enhanced performance are largely unexamined. In this work, we examine three commonly used pooling techniques (mean-pooling, max-pooling, and attention), and propose max-attention, a novel variant that effectively captures interactions among predictive tokens in a sentence. We find that pooling-based architectures substantially differ from their non-pooling equivalents in their learning ability and positional biases--which elucidate their performance benefits. By analyzing the gradient propagation, we discover that pooling facilitates better gradient flow compared to BiLSTMs. Further, we expose how BiLSTMs are positionally biased towards tokens in the beginning and the end of a sequence. Pooling alleviates such biases. Consequently, we identify settings where pooling offers large benefits: (i) in low resource scenarios, and (ii) when important words lie towards the middle of the sentence. Among the pooling techniques studied, max-attention is the most effective, resulting in significant performance gains on several text classification tasks.


title: PipelineProfiler: A Visual Analytics Tool for the Exploration of AutoML Pipelines

abstract: In recent years, a wide variety of automated machine learning (AutoML) methods have been proposed to search and generate end-to-end learning pipelines. While these techniques facilitate the creation of models for real-world applications, given their black-box nature, the complexity of the underlying algorithms, and the large number of pipelines they derive, it is difficult for their developers to debug these systems. It is also challenging for machine learning experts to select an AutoML system that is well suited for a given problem or class of problems. In this paper, we present the PipelineProfiler, an interactive visualization tool that allows the exploration and comparison of the solution space of machine learning (ML) pipelines produced by AutoML systems. PipelineProfiler is integrated with Jupyter Notebook and can be used together with common data science tools to enable a rich set of analyses of the ML pipelines and provide insights about the algorithms that generated them. We demonstrate the utility of our tool through several use cases where PipelineProfiler is used to better understand and improve a real-world AutoML system. Furthermore, we validate our approach by presenting a detailed analysis of a think-aloud experiment with six data scientists who develop and evaluate AutoML tools.


title: Gromov Rigidity of Bi-Invariant Metrics on Lie Groups and Homogeneous Spaces

abstract: Gromov asked if the bi-invariant metrics on a compact Lie group are extremal compared to any other metrics. In this note, we prove that the bi-invariant metrics on a compact connected semi-simple Lie group $G$ are extremal (in fact rigid) in the sense of Gromov when compared to the left-invariant metrics. In fact the same result holds for a compact connected homogeneous manifold $G/H$ with $G$ compact connect and semi-simple.


title: Recurrent Interaction Network for Jointly Extracting Entities and Classifying Relations

abstract: The idea of using multi-task learning approaches to address the joint extraction of entity and relation is motivated by the relatedness between the entity recognition task and the relation classification task. Existing methods using multi-task learning techniques to address the problem learn interactions among the two tasks through a shared network, where the shared information is passed into the task-specific networks for prediction. However, such an approach hinders the model from learning explicit interactions between the two tasks to improve the performance on the individual tasks. As a solution, we design a multi-task learning model which we refer to as recurrent interaction network which allows the learning of interactions dynamically, to effectively model task-specific features for classification. Empirical studies on two real-world datasets confirm the superiority of the proposed model.


title: Attend to Medical Ontologies: Content Selection for Clinical Abstractive Summarization

abstract: Sequence-to-sequence (seq2seq) network is a well-established model for text summarization task. It can learn to produce readable content; however, it falls short in effectively identifying key regions of the source. In this paper, we approach the content selection problem for clinical abstractive summarization by augmenting salient ontological terms into the summarizer. Our experiments on two publicly available clinical data sets (107,372 reports of MIMIC-CXR, and 3,366 reports of OpenI) show that our model statistically significantly boosts state-of-the-art results in terms of Rouge metrics (with improvements: 2.9% RG-1, 2.5% RG-2, 1.9% RG-L), in the healthcare domain where any range of improvement impacts patients' welfare.


title: Train Tracks on Graphs of Groups and Outer Automorphisms of Hyperbolic Groups

abstract: Stallings remarked that an outer automorphism of a free group may be thought of as a subdivision of a graph followed by a sequence of folds. In this thesis, we prove that automorphisms of fundamental groups of graphs of groups satisfying this condition may be represented by irreducible train track maps in the sense of Bestvina-Handel (we allow collapsing invariant subgraphs). Of course, we construct relative train track maps as well. Along the way, we give a new exposition of the Bass-Serre theory of groups acting on trees, morphisms of graphs of groups, and foldings thereof. We produce normal forms for automorphisms of free products and extend an argument of Qing-Rafi to show that they are not quasi-geodesic. As an application, we answer affirmatively a question of Paulin: outer automorphisms of finitely-generated word hyperbolic groups satisfy a dynamical trichotomy generalizing the Nielsen-Thurston "periodic, reducible or pseudo-Anosov." At the end of the thesis we collect some open problems we find interesting.


title: Recurrent Neural Network Language Models Always Learn English-Like Relative Clause Attachment

abstract: A standard approach to evaluating language models analyzes how models assign probabilities to valid versus invalid syntactic constructions (i.e. is a grammatical sentence more probable than an ungrammatical sentence). Our work uses ambiguous relative clause attachment to extend such evaluations to cases of multiple simultaneous valid interpretations, where stark grammaticality differences are absent. We compare model performance in English and Spanish to show that non-linguistic biases in RNN LMs advantageously overlap with syntactic structure in English but not Spanish. Thus, English models may appear to acquire human-like syntactic preferences, while models trained on Spanish fail to acquire comparable human-like preferences. We conclude by relating these results to broader concerns about the relationship between comprehension (i.e. typical language model use cases) and production (which generates the training data for language models), suggesting that necessary linguistic biases are not present in the training signal at all.


title: Polar or nonpolar? That is not the question for perovskite solar cells

abstract: Perovskite solar cell (PSC) is one of the most promising next generation photovoltaic technologies, and there are considerable interests in the role of possible polarization of organic-inorganic halide perovskites (OIHPs) in photovoltaic conversion. The polarity of OIHPs, however, is still hotly debated. In this review, we examine recent literature on the polarity of OIHPs from both theoretical and experimental points of view, and argue that they can be both polar and nonpolar, depending on compositions, processing, and environments. Implications of OIHP polarity to photovoltaic conversion is also discussed, and effort in answering these questions continues to render us new insights. In the future, integrating local scanning probe with global macroscopic measurements in-situ will provide invaluable microscopic insight into the intriguing macroscopic phenomena, while synchrotron diffractions and scanning transmission electron microscopy on more stable samples may ultimately settle the debate.


title: Information-Collection in Robotic Process Monitoring: An Active Perception Approach

abstract: Active perception systems maximizing information gain to support both monitoring and decision making have seen considerable application in recent work. In this paper, we propose and demonstrate a method of acquiring and extrapolating information in an active sensory system through use of a Bayesian Filter. Our approach is motivated by manufacturing processes, where automated visual tracking of system states may aid in fault diagnosis, certification of parts and safety; in extreme cases, our approach may enable novel manufacturing processes relying on monitoring solutions beyond passive perception. We demonstrate how using a Bayesian Filter in active perception scenarios permits reasoning about future actions based on measured as well as unmeasured but propagated state elements, thereby increasing substantially the quality of information available to decision making algorithms used in control of overarching processes. We demonstrate use of our active perception system in physical experiments, where we use a time-varying Kalman Filter to resolve uncertainty for a representative system capturing in additive manufacturing.


title: Cutting Bamboo Down to Size

abstract: This paper studies the problem of programming a robotic panda gardener to keep a bamboo garden from obstructing the view of the lake by your house. The garden consists of $n$ bamboo stalks with known daily growth rates and the gardener can cut at most one bamboo per day. As a computer scientist, you found out that this problem has already been formalized in [G\k{a}sieniec et al., SOFSEM'17] as the Bamboo Garden Trimming (BGT) problem, where the goal is that of computing a perpetual schedule (i.e., the sequence of bamboos to cut) for the robotic gardener to follow in order to minimize the makespan, i.e., the maximum height ever reached by a bamboo. Two natural strategies are Reduce-Max and Reduce-Fastest(x). Reduce-Max trims the tallest bamboo of the day, while Reduce-Fastest(x) trims the fastest growing bamboo among the ones that are taller than $x$. It is known that Reduce-Max and Reduce-Fastest(x) achieve a makespan of $O(\log n)$ and $4$ for the best choice of $x=2$, respectively. We prove the first constant upper bound of $9$ for Reduce-Max and improve the one for Reduce-Fastest(x) to $\frac{3+\sqrt{5}}{2} < 2.62$ for $x=1+\frac{1}{\sqrt{5}}$. Another critical aspect stems from the fact that your robotic gardener has a limited amount of processing power and memory. It is then important for the algorithm to be able to quickly determine the next bamboo to cut while requiring at most linear space. We formalize this aspect as the problem of designing a Trimming Oracle data structure, and we provide three efficient Trimming Oracles implementing different perpetual schedules, including those produced by Reduce-Max and Reduce-Fastest(x).


title: Ground state energy functional with Hartree-Fock efficiency and chemical accuracy

abstract: We introduce the Deep Post-Hartree-Fock (DeePHF) method, a machine learning based scheme for constructing accurate and transferable models for the ground-state energy of electronic structure problems. DeePHF predicts the energy difference between results of highly accurate models such as the coupled cluster method and low accuracy models such as the the Hartree-Fock (HF) method, using the ground-state electronic orbitals as the input. It preserves all the symmetries of the original high accuracy model. The added computational cost is less than that of the reference HF or DFT and scales linearly with respect to system size. We examine the performance of DeePHF on organic molecular systems using publicly available datasets and obtain the state-of-art performance, particularly on large datasets.


title: Effects of Surfactant Solubility on the Hydrodynamics of a Viscous Drop in a DC Electric Field

abstract: The physico-chemistry of surfactants (amphiphilic surface active agents) is often used to control the dynamics of viscous drops and bubbles. Surfactant sorption kinetics has been shown to play a critical role in the deformation of drops in extensional and shear flows, yet to the best of our knowledge these kinetics effects on a viscous drop in an electric fieldhave not been accounted for. In this paper we numerically investigate the effects of sorption kinetics on a surfactant-covered viscous drop in an electric field. Over a range of electric conductivity and permittivity ratios between the interior and exterior fluids, we focus on the dependence of deformation and flow on the transfer parameter $J$, and Biot number $\text{Bi}$ that characterize the extent of surfactant exchange between the drop surface and the bulk. Our findings suggest solubility affects the electrohydrodynamics of a viscous drop in distinct ways as we identify parameter regions where (1) surfactant solubility may alter both the drop deformation and circulation of fluid around a drop, and (2) surfactant solubility affects mainly the flow and not the deformation.


title: Cross-lingual Entity Alignment with Incidental Supervision

abstract: Much research effort has been put to multilingual knowledge graph (KG) embedding methods to address the entity alignment task, which seeks to match entities in different languagespecific KGs that refer to the same real-world object. Such methods are often hindered by the insufficiency of seed alignment provided between KGs. Therefore, we propose an incidentally supervised model, JEANS , which jointly represents multilingual KGs and text corpora in a shared embedding scheme, and seeks to improve entity alignment with incidental supervision signals from text. JEANS first deploys an entity grounding process to combine each KG with the monolingual text corpus. Then, two learning processes are conducted: (i) an embedding learning process to encode the KG and text of each language in one embedding space, and (ii) a selflearning based alignment learning process to iteratively induce the matching of entities and that of lexemes between embeddings. Experiments on benchmark datasets show that JEANS leads to promising improvement on entity alignment with incidental supervision, and significantly outperforms state-of-the-art methods that solely rely on internal information of KGs.


title: Information Seeking in the Spirit of Learning: a Dataset for Conversational Curiosity

abstract: Open-ended human learning and information-seeking are increasingly mediated by digital assistants. However, such systems often ignore the user's pre-existing knowledge. Assuming a correlation between engagement and user responses such as "liking" messages or asking followup questions, we design a Wizard-of-Oz dialog task that tests the hypothesis that engagement increases when users are presented with facts related to what they know. Through crowd-sourcing of this experiment, we collect and release 14K dialogs (181K utterances) where users and assistants converse about geographic topics like geopolitical entities and locations. This dataset is annotated with pre-existing user knowledge, message-level dialog acts, grounding to Wikipedia, and user reactions to messages. Responses using a user's prior knowledge increase engagement. We incorporate this knowledge into a multi-task model that reproduces human assistant policies and improves over a BERT content model by 13 mean reciprocal rank points.


title: Boundaries of Flow Table Usage Reduction Algorithms Based on Elephant Flow Detection

abstract: The majority of Internet traffic is caused by a relatively small number of flows (so-called elephant flows). This phenomenon can be exploited to facilitate traffic engineering: resource-costly individual flow forwarding entries can be created only for elephants while serving mice over the shortest paths. Although this idea already appeared in proposed TE systems, it was not examined by itself. It remains unknown what extent of flow table occupancy and operations number reduction can be achieved or how to select thresholds or sampling rates to cover the desired fraction of traffic. In this paper, we use reproducible traffic models obtained from a 30-day-long campus trace covering 4 billion flows, to answer these questions. We establish theoretical boundaries for flow table usage reduction algorithms that classify flows since the first packet, after reaching a predefined counter threshold or detect elephants by sampling. An important finding is that simple packet sampling performs surprisingly well on realistic traffic, reducing the number of flow entries by a factor up to 400, still covering 80% of the traffic. We also provide an open-source software package allowing the replication of our experiments or the performing of similar evaluations for other algorithms or flow distributions.


title: Universal Adversarial Attacks with Natural Triggers for Text Classification

abstract: Recent work has demonstrated the vulnerability of modern text classifiers to universal adversarial attacks, which are input-agnostic sequences of words added to text processed by classifiers. Despite being successful, the word sequences produced in such attacks are often ungrammatical and can be easily distinguished from natural text. We develop adversarial attacks that appear closer to natural English phrases and yet confuse classification systems when added to benign inputs. We leverage an adversarially regularized autoencoder (ARAE) to generate triggers and propose a gradient-based search that aims to maximize the downstream classifier's prediction loss. Our attacks effectively reduce model accuracy on classification tasks while being less identifiable than prior models as per automatic detection metrics and human-subject studies. Our aim is to demonstrate that adversarial attacks can be made harder to detect than previously thought and to enable the development of appropriate defenses.


title: Selecting Informative Contexts Improves Language Model Finetuning

abstract: Language model fine-tuning is essential for modern natural language processing, but is computationally expensive and time-consuming. Further, the effectiveness of fine-tuning is limited by the inclusion of training examples that negatively affect performance. Here we present a general fine-tuning method that we call information gain filtration for improving the overall training efficiency and final performance of language model fine-tuning. We define the information gain of an example as the improvement on a test metric after training on that example. A secondary learner is then trained to approximate this quantity. During fine-tuning, this learner selects informative examples and skips uninformative ones. We show that our method has consistent improvement across datasets, fine-tuning tasks, and language model architectures. For example, we achieve a median perplexity of 54.0 on a books dataset compared to 57.3 for standard fine-tuning. We present statistical evidence that offers insight into the improvements of our method over standard fine-tuning. The generality of our method leads us to propose a new paradigm for language model fine-tuning -- we encourage researchers to release pretrained secondary learners on common corpora to promote efficient and effective fine-tuning, thereby improving the performance and reducing the overall energy footprint of language model fine-tuning.


title: Diverse electronic and magnetic properties of CrS2 enabling novel strain-controlled 2D lateral heterostructure spintronic devices

abstract: Lateral heterostructures of two-dimensional (2D) materials, integrating different phases or materials into a single piece of nanosheet, have attracted intensive research interests in the past few years for high-performance electronic and optoelectronic devices. It also holds promises to significantly improve the performance and enable new functions of spintronic devices. It is imperative to have a 2D material possessing diverse electronic and magnetic properties that are required in spintronics. In this work, using density functional theory calculations, we surveyed all IV, V and VI group transition metal dichalcogenides (TMDs) and discovered that CrS2 has the most diverse electronic and magnetic properties: antiferromagnetic (AFM) metallic 1T phase, nonmagnetic (NM) semiconductor 2H phase, and ferromagnetic (FM) semiconductor 1T_prime phase with a Curie temperature of ~1000 K. More interestingly, we found that a tensile or compressive strain could turn 1T_prime phase into a spin-up or spin-down half metal. Such a unique feature enables designing strain-controlled spintronic devices using a single piece of CrS2 crystal with improved energy efficiency, which remains a challenge in miniaturization of spintronic devices. In-depth analysis attributed the unique strain tunability to the interplay between strain-induced lattice deformation and different spatial orientation of the spin-up/spin-down electronic orbitals. A prototypical design of a simple spin-valve logic device operated by strain is also presented.


title: Extrapolation of Three-dimensional Magnetic Field Structure in Flare-productive Active Regions with Different Initial Conditions

abstract: The nonlinear force-free field (NLFFF) modeling has been extensively used as a tool to infer three-dimensional (3D) magnetic field structure. In this study, the dependency of the NLFFF calculation with respect to the initial guess of the 3D magnetic field is investigated. While major part of the previous studies used potential field as the initial guess in the NLFFF modeling, we adopt the linear force-free fields with different constant force-free alpha as the initial guesses. This method enables us to investigate how unique the magnetic field obtained by the NLFFF extrapolation with respect to the initial guess is. The dependence of the initial condition of the NLFFF extrapolation is smaller in the strong magnetic field region. Therefore, the magnetic field at the lower height ($< 10$ Mm) tends to be less affected by the initial condition (correlation coefficient C>0.9 with different initial condition), although the Lorentz force is concentrated at the lower height.


title: On the Benefits of Invariance in Neural Networks

abstract: Many real world data analysis problems exhibit invariant structure, and models that take advantage of this structure have shown impressive empirical performance, particularly in deep learning. While the literature contains a variety of methods to incorporate invariance into models, theoretical understanding is poor and there is no way to assess when one method should be preferred over another. In this work, we analyze the benefits and limitations of two widely used approaches in deep learning in the presence of invariance: data augmentation and feature averaging. We prove that training with data augmentation leads to better estimates of risk and gradients thereof, and we provide a PAC-Bayes generalization bound for models trained with data augmentation. We also show that compared to data augmentation, feature averaging reduces generalization error when used with convex losses, and tightens PAC-Bayes bounds. We provide empirical support of these theoretical results, including a demonstration of why generalization may not improve by training with data augmentation: the `learned invariance' fails outside of the training distribution.


title: On the treewidth of Hanoi graphs

abstract: The objective of the well-known Towers of Hanoi puzzle is to move a set of disks one at a time from one of a set of pegs to another, while keeping the disks sorted on each peg. We propose an adversarial variation in which the first player forbids a set of states in the puzzle, and the second player must then convert one randomly-selected state to another without passing through forbidden states. Analyzing this version raises the question of the treewidth of Hanoi graphs. We find this number exactly for three-peg puzzles and provide nearly-tight asymptotic bounds for larger numbers of pegs.


title: Generalization Error of Generalized Linear Models in High Dimensions

abstract: At the heart of machine learning lies the question of generalizability of learned rules over previously unseen data. While over-parameterized models based on neural networks are now ubiquitous in machine learning applications, our understanding of their generalization capabilities is incomplete. This task is made harder by the non-convexity of the underlying learning problems. We provide a general framework to characterize the asymptotic generalization error for single-layer neural networks (i.e., generalized linear models) with arbitrary non-linearities, making it applicable to regression as well as classification problems. This framework enables analyzing the effect of (i) over-parameterization and non-linearity during modeling; and (ii) choices of loss function, initialization, and regularizer during learning. Our model also captures mismatch between training and test distributions. As examples, we analyze a few special cases, namely linear regression and logistic regression. We are also able to rigorously and analytically explain the \emph{double descent} phenomenon in generalized linear models.


title: Sparse, Dense, and Attentional Representations for Text Retrieval

abstract: Dual encoders perform retrieval by encoding documents and queries into dense lowdimensional vectors, scoring each document by its inner product with the query. We investigate the capacity of this architecture relative to sparse bag-of-words models and attentional neural networks. Using both theoretical and empirical analysis, we establish connections between the encoding dimension, the margin between gold and lower-ranked documents, and the document length, suggesting limitations in the capacity of fixed-length encodings to support precise retrieval of long documents. Building on these insights, we propose a simple neural model that combines the efficiency of dual encoders with some of the expressiveness of more costly attentional architectures, and explore sparse-dense hybrids to capitalize on the precision of sparse retrieval. These models outperform strong alternatives in large-scale retrieval.


title: Light nuclei production in relativistic heavy ion collisions from the AMPT model

abstract: Based on an improved multiphase transport (AMPT) model, which gives a good description of proton production with a smooth quark matter to hadronic matter transition in relativistic heavy ion collisions, we study deuteron and triton production from the coalescence of nucleons at the kinetic freezeout of these collisions. For Au+Au collisions at center-of-mass energies $\sqrt{s_\text{NN}}$ from 7.7 GeV to 200 GeV available at the Relativistic Heavy Ion Collider (RHIC), we find that the yield ratio $N_\text{t}N_\text{p}/N_\text{d}^2$ of proton, deuteron\com{,} and triton is essentially a constant as a function of collision energy. Our result confirms the expectation that without a first-order quark to hadronic matter phase transition in the produced matter or its approach to the critical point of the QCD matter, this yield ratio does not show any non-monotonic behavior in its collision energy dependence.


title: High-throughput injection-acceleration of electron bunches from a linear accelerator to a laser wakefield accelerator

abstract: Plasma-based accelerators (PBAs) driven by either intense lasers (laser wakefield accelerators, LWFAs) or particle beams (plasma wakefield accelerators, PWFAs), can accelerate charged particles at extremely high gradients compared to conventional radio-frequency (RF) accelerators. In the past two decades, great strides have been made in this field, making PBA a candidate for next-generation light sources and colliders. However, these challenging applications necessarily require beams with good stability, high quality, controllable polarization and excellent reproducibility. To date, such beams are generated only by conventional RF accelerators. Therefore, it is important to demonstrate the injection and acceleration of beams first produced using a conventional RF accelerator, by a PBA. In some recent studies on LWFA staging and external injection-acceleration in PWFA only a very small fraction (from below 0.1% to few percent) of the injected charge (the coupling efficiency) was accelerated. For future colliders where beam energy will need to be boosted using multiple stages, the coupling efficiency per stage must approach 100%. Here we report the first demonstration of external injection from a photocathode-RF-gun-based conventional linear accelerator (LINAC) into a LWFA and subsequent acceleration without any significant loss of charge or degradation of quality, which is achieved by properly shaping and matching the beam into the plasma structure. This is an important step towards realizing a high-throughput, multi-stage, high-energy, hybrid conventional-plasma accelerator.


title: X-ray reflection spectroscopy with Kaluza-Klein black holes

abstract: Kaluza-Klein theory is a popular alternative theory of gravity, with both non-rotating and rotating black hole solutions known. This allows for the possibility that the theory could be observationally tested. We present a model which calculates the reflection spectrum of a black hole accretion disk system, where the black hole is described by a rotating solution of the Kaluza-Klein theory. We also use this model to analyze X-ray data from the stella-mass black hole in GRS 1915+105 and provide constraints on the free parameters of the Kaluza-Klein black holes.


title: The Regular Polygon Minimizes The Ratio of Plucker Coordinates on The Positive Grassmannian

abstract: For a point $x$ on the Positive Grassmannian of two-dimensional subspaces in $\mathbb{R}^n$, define the loss function $E(x)$ as the ratio of its largest and smallest Plucker coordinates. We solve the extremal problem of minimizing the loss function $E(x)$ over the Grassmannian. This minimax problem was posed by Berman, et al. in their paper on error-correcting codes over the real numbers.


title: PANDA: Policy-aware Location Privacy for Epidemic Surveillance

abstract: In this demonstration, we present a privacy-preserving epidemic surveillance system. Recently, many countries that suffer from coronavirus crises attempt to access citizen's location data to eliminate the outbreak. However, it raises privacy concerns and may open the doors to more invasive forms of surveillance in the name of public health. It also brings a challenge for privacy protection techniques: how can we leverage people's mobile data to help combat the pandemic without scarifying our location privacy. We demonstrate that we can have the best of the two worlds by implementing policy-based location privacy for epidemic surveillance. Specifically, we formalize the privacy policy using graphs in light of differential privacy, called policy graph. Our system has three primary functions for epidemic surveillance: location monitoring, epidemic analysis, and contact tracing. We provide an interactive tool allowing the attendees to explore and examine the usability of our system: (1) the utility of location monitor and disease transmission model estimation, (2) the procedure of contact tracing in our systems, and (3) the privacy-utility trade-offs w.r.t. different policy graphs. The attendees can find that it is possible to have the full functionality of epidemic surveillance while preserving location privacy.


title: Cross-Linguistic Syntactic Evaluation of Word Prediction Models

abstract: A range of studies have concluded that neural word prediction models can distinguish grammatical from ungrammatical sentences with high accuracy. However, these studies are based primarily on monolingual evidence from English. To investigate how these models' ability to learn syntax varies by language, we introduce CLAMS (Cross-Linguistic Assessment of Models on Syntax), a syntactic evaluation suite for monolingual and multilingual models. CLAMS includes subject-verb agreement challenge sets for English, French, German, Hebrew and Russian, generated from grammars we develop. We use CLAMS to evaluate LSTM language models as well as monolingual and multilingual BERT. Across languages, monolingual LSTMs achieved high accuracy on dependencies without attractors, and generally poor accuracy on agreement across object relative clauses. On other constructions, agreement accuracy was generally higher in languages with richer morphology. Multilingual models generally underperformed monolingual models. Multilingual BERT showed high syntactic accuracy on English, but noticeable deficiencies in other languages.


title: Reduction principle for functionals of strong-weak dependent vector random fields

abstract: We prove the reduction principle for asymptotics of functionals of vector random fields with weakly and strongly dependent components. These functionals can be used to construct new classes of random fields with skewed and heavy-tailed distributions. Contrary to the case of scalar long-range dependent random fields, it is shown that the asymptotic behaviour of such functionals is not necessarily determined by the terms at their Hermite rank. The results are illustrated by an application to the first Minkowski functional of the Student random fields. Some simulation studies based on the theoretical findings are also presented.


title: An Abstract Stabilization Method with Applications to Nonlinear Incompressible Elasticity

abstract: In this paper, we propose and analyze an abstract stabilized mixed finite element framework that can be applied to nonlinear incompressible elasticity problems. In the abstract stabilized framework, we prove that any mixed finite element method that satisfies the discrete inf-sup condition can be modified so that it is stable and optimal convergent as long as the mixed continuous problem is stable. Furthermore, we apply the abstract stabilized framework to nonlinear incompressible elasticity problems and present numerical experiments to verify the theoretical results.


title: Evaluating Neural Machine Comprehension Model Robustness to Noisy Inputs and Adversarial Attacks

abstract: We evaluate machine comprehension models' robustness to noise and adversarial attacks by performing novel perturbations at the character, word, and sentence level. We experiment with different amounts of perturbations to examine model confidence and misclassification rate, and contrast model performance in adversarial training with different embedding types on two benchmark datasets. We demonstrate improving model performance with ensembling. Finally, we analyze factors that effect model behavior under adversarial training and develop a model to predict model errors during adversarial attacks.


title: Bullseye Polytope: A Scalable Clean-Label Poisoning Attack with Improved Transferability

abstract: A recent source of concern for the security of neural networks is the emergence of clean-label dataset poisoning attacks, wherein correctly labeled poison samples are injected into the training dataset. While these poison samples look legitimate to the human observer, they contain malicious characteristics that trigger a targeted misclassification during inference. We propose a scalable and transferable clean-label poisoning attack against transfer learning, which creates poison images with their center close to the target image in the feature space. Our attack, Bullseye Polytope, improves the attack success rate of the current state-of-the-art by 26.75% in end-to-end transfer learning, while increasing attack speed by a factor of 12. We further extend Bullseye Polytope to a more practical attack model by including multiple images of the same object (e.g., from different angles) when crafting the poison samples. We demonstrate that this extension improves attack transferability by over 16% to unseen images (of the same object) without using extra poison samples.


title: KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

abstract: In the automatic evaluation of generative question answering (GenQA) systems, it is difficult to assess the correctness of generated answers due to the free-form of the answer. Especially, widely used n-gram similarity metrics often fail to discriminate the incorrect answers since they equally consider all of the tokens. To alleviate this problem, we propose KPQA-metric, a new metric for evaluating the correctness of GenQA. Specifically, our new metric assigns different weights to each token via keyphrase prediction, thereby judging whether a generated answer sentence captures the key meaning of the reference answer. To evaluate our metric, we create high-quality human judgments of correctness on two GenQA datasets. Using our human-evaluation datasets, we show that our proposed metric has a significantly higher correlation with human judgments than existing metrics. The code is available at https://github.com/hwanheelee1993/KPQA.


title: Monogamy inequality in terms of entanglement measures based on distance for pure multiqubit states

abstract: Using very general arguments, we prove that any entanglement measures based on distance must be maximal on pure states. Furthermore, we show that Bures measure of entanglement and geometric measure of entanglement satisfy the monogamy inequality on all pure multiqubit states. Finally, using the power of Bures measure of entanglement and geometric measure of entanglement, we present a class of tight monogamy relations for pure states of multiqubit systems.


title: Bounds for 2-Selmer ranks in terms of seminarrow class groups

abstract: Let $E$ be an elliptic curve over a number field $K$ defined by a monic irreducible cubic polynomial $F(x)$. When $E$ is \textit{nice} at all finite primes of $K$, we bound its $2$-Selmer rank in terms of the $2$-rank of a modified ideal class group of the field $L=K[x]/{(F(x))}$, which we call the \textit{semi-narrow class group} of $L$. We then provide several sufficient conditions for $E$ being nice at a finite prime. As an application, when $K$ is a real quadratic field, $E/K$ is semistable and the discriminant of $F$ is totally negative, then we frequently determine the $2$-Selmer rank of $E$ by computing the root number of $E$ and the $2$-rank of the narrow class group of $L$.


title: A shift-splitting preconditioner for asymmetric saddle point problems

abstract: In this paper, we execute the shift-splitting preconditioner for asymmetric saddle point problems with its (1,2) block's transposition unequal to its (2,1) block under the removed minus of its (2,1) block. The proposed preconditioner is stemmed from the shift splitting (SS) iteration method for solving asymmetric saddle point problems, which is convergent under suitable conditions. The relaxed version of the shift-splitting preconditioner is obtained as well. The spectral distributions of the related preconditioned matrices are given. Numerical experiments from the Stokes problem are offered to show the convergence performance of these two preconditioners.


title: From Equations to Distinctions: Two Interpretations of Effectful Computations

abstract: There are several ways to define program equivalence for functional programs with algebraic effects. We consider two complementing ways to specify behavioural equivalence. One way is to specify a set of axiomatic equations, and allow proof methods to show that two programs are equivalent. Another way is to specify an Eilenberg-Moore algebra, which generate tests that could distinguish programs. These two methods are said to complement each other if any two programs can be shown to be equivalent if and only if there is no test to distinguish them. In this paper, we study a generic method to formulate from a set of axiomatic equations an Eilenberg-Moore algebra which complements it. We will look at an additional condition which must be satisfied for this to work. We then apply this method to a handful of examples of effects, including probability and global store, and show they coincide with the usual algebras from the literature. We will moreover study whether or not it is possible to specify a set of unary Boolean modalities which could function as distinction-tests complementing the equational theory.


title: Combining predicate transformer semantics for effects: a case study in parsing regular languages

abstract: This paper describes how to verify a parser for regular expressions in a functional programming language using predicate transformer semantics for a variety of effects. Where our previous work in this area focused on the semantics for a single effect, parsing requires a combination of effects: non-determinism, general recursion and mutable state. Reasoning about such combinations of effects is notoriously difficult, yet our approach using predicate transformers enables the careful separation of program syntax, correctness proofs and termination proofs.


title: Multi-dimensional Arrays with Levels

abstract: We explore a data structure that generalises rectangular multi-dimensional arrays. The shape of an n-dimensional array is typically given by a tuple of n natural numbers. Each element in that tuple defines the length of the corresponding axis. If we treat this tuple as an array, the shape of that array is described by the single natural number n. A natural number itself can be also treated as an array with the shape described by the natural number 1 (or the element of any singleton set). This observation gives rise to the hierarchy of array types where the shape of an array of level l+1 is a level-l array of natural numbers. Such a hierarchy occurs naturally when treating arrays as containers, which makes it possible to define both rank- and level-polymorphic operations. The former can be found in most array languages, whereas the latter gives rise to partial selections on a large set of hyperplanes, which is often useful in practice. In this paper we present an Agda formalisation of arrays with levels. We show that the proposed formalism supports standard rank-polymorphic array operations, while type system gives static guarantees that indexing is within bounds. We generalise the notion of ranked operator so that it becomes applicable on arrays of arbitrary levels and we show why this may be useful in practice.


title: Efficient lambda encodings for Mendler-style coinductive types in Cedille

abstract: In the calculus of dependent lambda eliminations (CDLE), it is possible to define inductive datatypes via lambda encodings that feature constant-time destructors and a course-of-values induction scheme. This paper begins to address the missing derivations for the dual, coinductive types. Our derivation utilizes new methods within CDLE, as there are seemingly fundamental difficulties in adapting previous known approaches for deriving inductive types. The lambda encodings we present implementing coinductive types feature constant-time constructors and a course-of-values corecursion scheme. Coinductive type families are also supported, enabling proofs for many standard coinductive properties such as stream bisimulation. All work is mechanically verified by the Cedille tool, an implementation of CDLE.


title: HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training

abstract: We present HERO, a novel framework for large-scale video+language omni-representation learning. HERO encodes multimodal inputs in a hierarchical structure, where local context of a video frame is captured by a Cross-modal Transformer via multimodal fusion, and global video context is captured by a Temporal Transformer. In addition to standard Masked Language Modeling (MLM) and Masked Frame Modeling (MFM) objectives, we design two new pre-training tasks: (i) Video-Subtitle Matching (VSM), where the model predicts both global and local temporal alignment; and (ii) Frame Order Modeling (FOM), where the model predicts the right order of shuffled video frames. HERO is jointly trained on HowTo100M and large-scale TV datasets to gain deep understanding of complex social dynamics with multi-character interactions. Comprehensive experiments demonstrate that HERO achieves new state of the art on multiple benchmarks over Text-based Video/Video-moment Retrieval, Video Question Answering (QA), Video-and-language Inference and Video Captioning tasks across different domains. We also introduce two new challenging benchmarks How2QA and How2R for Video QA and Retrieval, collected from diverse video content over multimodalities.


title: Polarized Fock States for Polariton Photochemistry

abstract: We use the polarized Fock states to describe the coupled molecule-cavity hybrid system in quantum electrodynamics. The molecular permanent dipoles polarize the photon field by displacing its vector potential, leading to non-orthogonality between the Fock states of two different polarized photon fields. These polarized Fock states allow an intuitive understanding of several new phenomena that go beyond the prediction of the quantum Rabi model, and at the same time, offer numerical convenience to converge the results. We further exploit this non-orthogonality to generate multiple photons from a single electronic excitation (downconversion) and control the photochemical reactivity.


title: Interactive Geometry Modification of High Performance Finite Element Simulations

abstract: In the context of high performance finite element analysis, the cost of iteratively modifying a computational domain via re-meshing and restarting the analysis becomes time prohibitive as the size of simulations increases. In this paper, we demonstrate a new interactive simulation pipeline targeting high performance finite element simulations where the computational domain is modifiable in situ, that is, while the simulation is ongoing. This pipeline is designed to be modular so that it may interface with any existing finite element simulation framework. A server-client architecture is employed to manage simulation mesh data existing on a high performance computing resource while user-prescribed freeform geometric modifications take place on a separate workstation. We employ existing in situ visualization techniques to rapidly inform the user of simulation progression, enabling computational steering. By expressing the simulation domain in a reduced fashion on the client application, this pipeline manages highly refined finite element simulation domains on the server while maintaining good performance on the client application.


title: Topological delocalization in the completely disordered two-dimensional quantum walk

abstract: We investigate numerically and theoretically the effect of spatial disorder on two-dimensional split-step discrete-time quantum walks with two internal "coin" states. Spatial disorder can lead to Anderson localization, inhibiting the spread of quantum walks, putting them at a disadvantage against their diffusively spreading classical counterparts. We find that spatial disorder of the most general type, i.e., position-dependent Haar random coin operators, does not lead to Anderson localization but to a diffusive spread instead. This is a delocalization, which happens because disorder places the quantum walk to a critical point between different anomalous Floquet-Anderson insulating topological phases. We base this explanation on the relationship of this general quantum walk to a simpler case more studied in the literature and for which disorder-induced delocalization of a topological origin has been observed. We review topological delocalization for the simpler quantum walk, using time evolution of the wave functions and level spacing statistics. We apply scattering theory to two-dimensional quantum walks and thus calculate the topological invariants of disordered quantum walks, substantiating the topological interpretation of the delocalization and finding signatures of the delocalization in the finite-size scaling of transmission. We show criticality of the Haar random quantum walk by calculating the critical exponent $\eta$ in three different ways and find $\eta$ $\approx$ 0.52 as in the integer quantum Hall effect. Our results showcase how theoretical ideas and numerical tools from solid-state physics can help us understand spatially random quantum walks.


title: Kinetic theory with spin: From massive to massless fermions

abstract: We find that the recently developed kinetic theories with spin for massive and massless fermions are smoothly connected. By introducing a reference-frame vector, we decompose the dipole-moment tensor into electric and magnetic dipole moments. We show that the axial-vector component of the Wigner function contains a contribution from the transverse magnetic dipole moment which accounts for the transverse spin degree of freedom (DOF) and vanishes smoothly in the massless limit. As a result, the kinetic equations, describing four DOF for massive fermions, becomes smoothly the chiral kinetic equations describing two DOF in the massless limit. We also confirm the small-mass behavior of the Wigner function by explicit calculation using a Gaussian wave packet.


title: Multi-head Monotonic Chunkwise Attention For Online Speech Recognition

abstract: The attention mechanism of the Listen, Attend and Spell (LAS) model requires the whole input sequence to calculate the attention context and thus is not suitable for online speech recognition. To deal with this problem, we propose multi-head monotonic chunk-wise attention (MTH-MoChA), an improved version of MoChA. MTH-MoChA splits the input sequence into small chunks and computes multi-head attentions over the chunks. We also explore useful training strategies such as LSTM pooling, minimum world error rate training and SpecAugment to further improve the performance of MTH-MoChA. Experiments on AISHELL-1 data show that the proposed model, along with the training strategies, improve the character error rate (CER) of MoChA from 8.96% to 7.68% on test set. On another 18000 hours in-car speech data set, MTH-MoChA obtains 7.28% CER, which is significantly better than a state-of-the-art hybrid system.


title: TransOMCS: From Linguistic Graphs to Commonsense Knowledge

abstract: Commonsense knowledge acquisition is a key problem for artificial intelligence. Conventional methods of acquiring commonsense knowledge generally require laborious and costly human annotations, which are not feasible on a large scale. In this paper, we explore a practical way of mining commonsense knowledge from linguistic graphs, with the goal of transferring cheap knowledge obtained with linguistic patterns into expensive commonsense knowledge. The result is a conversion of ASER [Zhang et al., 2020], a large-scale selectional preference knowledge resource, into TransOMCS, of the same representation as ConceptNet [Liu and Singh, 2004] but two orders of magnitude larger. Experimental results demonstrate the transferability of linguistic knowledge to commonsense knowledge and the effectiveness of the proposed approach in terms of quantity, novelty, and quality. TransOMCS is publicly available at: https://github.com/HKUST-KnowComp/TransOMCS.


title: Generating Randomness from a Computable, Non-random Sequence of Qubits

abstract: Nies and Scholz introduced the notion of a state to describe an infinite sequence of qubits and defined quantum-Martin-Lof randomness for states, analogously to the well known concept of Martin-L\"of randomness for elements of Cantor space (the space of infinite sequences of bits). We formalize how 'measurement' of a state in a basis induces a probability measure on Cantor space. A state is 'measurement random' (mR) if the measure induced by it, under any computable basis, assigns probability one to the set of Martin-L\"of randoms. Equivalently, a state is mR if and only if measuring it in any computable basis yields a Martin-L\"of random with probability one. While quantum-Martin-L\"of random states are mR, the converse fails: there is a mR state, x which is not quantum-Martin-L\"of random. In fact, something stronger is true. While x is computable and can be easily constructed, measuring it in any computable basis yields an arithmetically random sequence with probability one. I.e., classical arithmetic randomness can be generated from a computable, non-quantum random sequence of qubits.


title: Why FHilb is Not an Interesting (Co)Differential Category

abstract: Differential categories provide an axiomatization of the basics of differentiation and categorical models of differential linear logic. As differentiation is an important tool throughout quantum mechanics and quantum information, it makes sense to study applications of the theory of differential categories to categorical quantum foundations. In categorical quantum foundations, compact closed categories (and therefore traced symmetric monoidal categories) are one of the main objects of study, in particular the category of finite-dimensional Hilbert spaces FHilb. In this paper, we will explain why the only differential category structure on FHilb is the trivial one. This follows from a sort of in-compatibility between the trace of FHilb and possible differential category structure. That said, there are interesting non-trivial examples of traced/compact closed differential categories, which we also discuss. The goal of this paper is to introduce differential categories to the broader categorical quantum foundation community and hopefully open the door to further work in combining these two fields. While the main result of this paper may seem somewhat "negative" in achieving this goal, we discuss interesting potential applications of differential categories to categorical quantum foundations.


title: Effectus of Quantum Probability on Relational Structures

abstract: The notion of effectus from categorical logic is relevant in the emerging field of categorical probability theory. In some cases, stochastic maps are represented by maps in the Kleisli category of some probability monad. Quantum homomorphisms from combinatorics and quantum information theory are the Kleisli maps of certain sort of quantum monad. We show that the Kleisli category of this quantum monad is an effectus. This gives rise to notions of quantum probabilistic reasoning as predicates, validity, conditioning, and channels.


title: Scott Continuity in Generalized Probabilistic Theories

abstract: Scott continuity is a concept from domain theory that had an unexpected previous life in the theory of von Neumann algebras. Scott-continuous states are known as normal states, and normal states are exactly the states coming from density matrices. Given this, and the usefulness of Scott continuity in domain theory, it is natural to ask whether this carries over to generalized probabilistic theories. We show that the answer is no - there are infinite-dimensional convex sets for which the set of Scott-continuous states on the corresponding set of 2-valued POVMs does not recover the original convex set, but is strictly larger. This shows the necessity of the use of topologies for state-effect duality in the general case, rather than purely order theoretic notions.


title: ROS: Resource-constrained Oracle Synthesis for Quantum Computers

abstract: We present a completely automatic synthesis framework for oracle functions, a central part in many quantum algorithms. The proposed framework for resource-constrained oracle synthesis (ROS) is a LUT-based hierarchical method in which every step is specifically tailored to address hardware resource constraints. ROS embeds a LUT mapper designed to simplify the successive synthesis steps, costing each LUT according to the resources used by its corresponding quantum circuit. In addition, the framework exploits a SAT-based quantum garbage management technique. Those two characteristics give ROS the ability to beat the state-of-the-art hierarchical method both in number of qubits and in number of operations. The efficiency of the framework is demonstrated by synthesizing quantum oracles for Grover's algorithm.


title: A framework for the analysis of supervised discrete event systems under attack

abstract: This paper focuses on the problem of cyber attacks for discrete event systems under supervisory control. In more detail, the goal of the supervisor, who has a partial observation of the system evolution, is that of preventing the system from reaching a set of unsafe states. An attacker may act in two different ways: he can corrupt the observation of the supervisor editing the sensor readings, and can enable events that are disabled by the supervisor. This is done with the aim of leading the plant to an unsafe state, and keeping the supervisor unaware of that before the unsafe state is reached. A special automaton, called attack structure is constructed as the parallel composition of two special structures. Such an automaton can be used by the attacker to select appropriate actions (if any) to reach the above goal, or equivalently by the supervisor, to validate its robustness with respect to such attacks.


title: Cohomology and the Algebraic Structure of Contextuality in Measurement Based Quantum Computation

abstract: Okay, Roberts, Bartlett and Raussendorf recently introduced a new cohomological approach to contextuality in measurement based quantum computation. We give an abstract description of their obstruction and the algebraic structure it exploits, using the sheaf theoretic framework of Abramsky and Brandenburger. At this level of generality we contrast their approach to the Cech cohomology obstruction of Abramsky, Mansfield and Barbosa and give a direct proof that Cech cohomology is at least as powerful.


title: The AVA-Kinetics Localized Human Actions Video Dataset

abstract: This paper describes the AVA-Kinetics localized human actions video dataset. The dataset is collected by annotating videos from the Kinetics-700 dataset using the AVA annotation protocol, and extending the original AVA dataset with these new AVA annotated Kinetics clips. The dataset contains over 230k clips annotated with the 80 AVA action classes for each of the humans in key-frames. We describe the annotation process and provide statistics about the new dataset. We also include a baseline evaluation using the Video Action Transformer Network on the AVA-Kinetics dataset, demonstrating improved performance for action classification on the AVA test set. The dataset can be downloaded from https://research.google.com/ava/


title: A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

abstract: In this article we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, one approach is to introduce an adjoint dynamical system to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. We prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.


title: Formal solutions and the first-order theory of acylindrically hyperbolic groups

abstract: We generalise Merzlyakov's theorem about the first-order theory of non-abelian free groups to all acylindrically hyperbolic groups. As a corollary, we deduce that if $G$ is an acylindrically hyperbolic group and $E(G)$ denotes the unique maximal finite normal subgroup of $G$, then $G$ and the HNN extension $G\dot{\ast}_{E(G)}$, which is simply the free product $G\ast\mathbb{Z}$ when $E(G)$ is trivial, have the same $\forall\exists$-theory. As a consequence, we prove the following conjecture, formulated by Casals-Ruiz, Garreta and de la Nuez Gonz\'alez: acylindrically hyperbolic groups have trivial positive theory. In particular, one recovers a result proved by Bestvina, Bromberg and Fujiwara, stating that, with only the obvious exceptions, verbal subgroups of acylindrically hyperbolic groups have infinite width.


title: A Ubiquitous Thermal Conductivity Formula for Liquids, Polymer Glass, and Amorphous Solids

abstract: The microscopic mechanism of thermal transport in liquids and amorphous solids has been an outstanding problem for a long time. There have been several different approaches to explain the thermal conductivities for these systems, for example, the Bridgman's formula for simple liquids, the concept of the minimum thermal conductivity for amorphous solids, and the thermal resistance network model for amorphous polymers. Here, we present a ubiquitous formula to explain the thermal conductivities of liquids and amorphous solids in a unified way. The calculated thermal conductivities using this formula without fitting parameters are in excellent agreement with the experimental data for these systems. Our formula is not only providing detailed implications on microscopic mechanisms of heat transfer in these systems, but also solves the discrepancies between existing formulae and experimental data.


title: Differentially Private Federated Learning with Laplacian Smoothing

abstract: Federated learning aims to protect data privacy by collaboratively learning a model without sharing private data among users. However, an adversary may still be able to infer the private training data by attacking the released model. Differential privacy provides a statistical protection against such attacks at the price of significantly degrading the accuracy or utility of the trained models. In this paper, we investigate a utility enhancement scheme based on Laplacian smoothing for differentially private federated learning (DP-Fed-LS), where the parameter aggregation with injected Gaussian noise is improved in statistical precision without losing privacy budget. Our key observation is that the aggregated gradients in federated learning often enjoy a type of smoothness, i.e. sparsity in the graph Fourier basis with polynomial decays of Fourier coefficients as frequency grows, which can be exploited by the Laplacian smoothing efficiently. Under a prescribed differential privacy budget, convergence error bounds with tight rates are provided for DP-Fed-LS with uniform subsampling of heterogeneous Non-IID data, revealing possible utility improvement of Laplacian smoothing in effective dimensionality and variance reduction, among others. Experiments over MNIST, SVHN, and Shakespeare datasets show that the proposed method can improve model accuracy with DP-guarantee and membership privacy under both uniform and Poisson subsampling mechanisms.


title: advligorts: The Advanced LIGO Real-Time Digital Control and Data Acquisition System

abstract: The Advanced LIGO detectors are sophisticated opto-mechanical devices. At the core of their operation is feedback control. The Advanced LIGO project developed a custom digital control and data acquisition system to handle the unique needs of this new breed of astronomical detector. The advligorts is the software component of this system. This highly modular and extensible system has enabled the unprecedented performance of the LIGO instruments, and has been a vital component in the direct detection of gravitational waves.


title: Automatic Catalog of RRLyrae from $\sim$ 14 million VVV Light Curves: How far can we go with traditional machine-learning?

abstract: The creation of a 3D map of the bulge using RRLyrae (RRL) is one of the main goals of the VVV(X) surveys. The overwhelming number of sources under analysis request the use of automatic procedures. In this context, previous works introduced the use of Machine Learning (ML) methods for the variable star classification. Our goal is the development and analysis of an automatic procedure, based on ML, for the identification of RRLs in the VVV Survey. This procedure will be use to generate reliable catalogs integrated over several tiles in the survey. After the reconstruction of light-curves, we extract a set of period and intensity-based features. We use for the first time a new subset of pseudo color features. We discuss all the appropriate steps needed to define our automatic pipeline: selection of quality measures; sampling procedures; classifier setup and model selection. As final result, we construct an ensemble classifier with an average Recall of 0.48 and average Precision of 0.86 over 15 tiles. We also make available our processed datasets and a catalog of candidate RRLs. Perhaps most interestingly, from a classification perspective based on photometric broad-band data, is that our results indicate that Color is an informative feature type of the RRL that should be considered for automatic classification methods via ML. We also argue that Recall and Precision in both tables and curves are high quality metrics for this highly imbalanced problem. Furthermore, we show for our VVV data-set that to have good estimates it is important to use the original distribution more than reduced samples with an artificial balance. Finally, we show that the use of ensemble classifiers helps resolve the crucial model selection step, and that most errors in the identification of RRLs are related to low quality observations of some sources or to the difficulty to resolve the RRL-C type given the date.


title: A Formal Causal Interpretation of the Case-Crossover Design

abstract: The case-crossover design (Maclure, 1991) is widely used in epidemiology and other fields to study causal effects of transient treatments on acute outcomes. However, its validity and causal interpretation have only been justified under informal conditions. Here, we place the design in a formal counterfactual framework for the first time. Doing so helps to clarify its assumptions and interpretation. In particular, when the treatment effect is non-null, we identify a previously unnoticed bias arising from common causes of the outcome at different person-times. We analytically characterize the direction and size of this bias and demonstrate its potential importance with a simulation. We also use our derivation of the limit of the case-crossover estimator to analyze its sensitivity to treatment effect heterogeneity, a violation of one of the informal criteria for validity. The upshot of this work for practitioners is that, while the case-crossover design can be useful for testing the causal null hypothesis in the presence of baseline confounders, extra caution is warranted when using the case-crossover design for point estimation of causal effects.


title: Theory of shift current in Anderson insulator

abstract: Shift current is a photovoltaic current in bulk noncentrosymmetric insulator. Studies on shift current have so far focused on the extended Bloch waves, such as in semiconductors and perovskites. In contrast, it is unknown whether the localized wavefunctions support the dc photocurrent. Here, we show theoretically that the dc shift current appears in a noncentrosymmetric disordered one-dimensional insulator with random potential. When the light illuminates the entire sample, the photocurrent forms in presence of the electron-phonon coupling. We find this photocurrent remains robustly even when the energy scale of random potential is larger than the bandwidth. On the other hand, the photocurrent decays exponentially when the excitation is local, or the relaxation is only due to the contact with the electrodes. These results open a route to design high-efficiency solar cells and photodetectors.


title: Pushing the limit of molecular dynamics with ab initio accuracy to 100 million atoms with machine learning

abstract: For 35 years, {\it ab initio} molecular dynamics (AIMD) has been the method of choice for modeling complex atomistic phenomena from first principles. However, most AIMD applications are limited by computational cost to systems with thousands of atoms at most. We report that a machine learning-based simulation protocol (Deep Potential Molecular Dynamics), while retaining {\it ab initio} accuracy, can simulate more than 1 nanosecond-long trajectory of over 100 million atoms per day, using a highly optimized code (GPU DeePMD-kit) on the Summit supercomputer. Our code can efficiently scale up to the entire Summit supercomputer, attaining $91$ PFLOPS in double precision ($45.5\%$ of the peak) and {$162$/$275$ PFLOPS in mixed-single/half precision}. The great accomplishment of this work is that it opens the door to simulating unprecedented size and time scales with {\it ab initio} accuracy. It also poses new challenges to the next-generation supercomputer for a better integration of machine learning and physical modeling.


title: Distributed Stochastic Non-Convex Optimization: Momentum-Based Variance Reduction

abstract: In this work, we propose a distributed algorithm for stochastic non-convex optimization. We consider a worker-server architecture where a set of $K$ worker nodes (WNs) in collaboration with a server node (SN) jointly aim to minimize a global, potentially non-convex objective function. The objective function is assumed to be the sum of local objective functions available at each WN, with each node having access to only the stochastic samples of its local objective function. In contrast to the existing approaches, we employ a momentum based "single loop" distributed algorithm which eliminates the need of computing large batch size gradients to achieve variance reduction. We propose two algorithms one with "adaptive" and the other with "non-adaptive" learning rates. We show that the proposed algorithms achieve the optimal computational complexity while attaining linear speedup with the number of WNs. Specifically, the algorithms reach an $\epsilon$-stationary point $x_a$ with $\mathbb{E}\| \nabla f(x_a) \| \leq \tilde{O}(K^{-1/3}T^{-1/2} + K^{-1/3}T^{-1/3})$ in $T$ iterations, thereby requiring $\tilde{O}(K^{-1} \epsilon^{-3})$ gradient computations at each WN. Moreover, our approach does not assume identical data distributions across WNs making the approach general enough for federated learning applications.


title: Deeply Cascaded U-Net for Multi-Task Image Processing

abstract: In current practice, many image processing tasks are done sequentially (e.g. denoising, dehazing, followed by semantic segmentation). In this paper, we propose a novel multi-task neural network architecture designed for combining sequential image processing tasks. We extend U-Net by additional decoding pathways for each individual task, and explore deep cascading of outputs and connectivity from one pathway to another. We demonstrate effectiveness of the proposed approach on denoising and semantic segmentation, as well as on progressive coarse-to-fine semantic segmentation, and achieve better performance than multiple individual or jointly-trained networks, with lower number of trainable parameters.


title: Strain self-accommodation during growth of 14H type long-period stacking ordered (LPSO) structures in Mg-Zn-Gd alloy

abstract: Cooperative growth of the structure units (SUs) in a 14H type long-period stacking ordered (LPSO) structure has been observed, and there is no obvious accumulation of transformation strain at the growth fronts. The atomic structures at this front are further characterized by Cs-corrected scanning transmission electron microscopy, and the partial dislocations associated SUs are uniquely defined based on the observations at different zone axes. It is found that the Burgers vectors of neighbouring partials are alternatively opposed so that the transformation strain is self-accommodated. Furthermore, this self-accommodation mechanism is rationalized by the elastic interaction energy for combinations of different partials.


title: Learning Compliance Adaptation in Contact-Rich Manipulation

abstract: Compliant robot behavior is crucial for the realization of contact-rich manipulation tasks. In such tasks, it is important to ensure a high stiffness and force tracking accuracy during normal task execution as well as rapid adaptation and complaint behavior to react to abnormal situations and changes. In this paper, we propose a novel approach for learning predictive models of force profiles required for contact-rich tasks. Such models allow detecting unexpected situations and facilitates better adaptive control. The approach combines an anomaly detection based on Bidirectional Gated Recurrent Units (Bi-GRU) and an adaptive force/impedance controller. We evaluated the approach in simulated and real world experiments on a humanoid robot.The results show that the approach allow simultaneous high tracking accuracy of desired motions and force profile as well as the adaptation to force perturbations due to physical human interaction.


title: Massless Limit of Transport Theory for Massive Fermions

abstract: We studied the $m=0$ limit of different components of Wigner functions for massive fermions. Comparing with the chiral kinetic theory, we separated the vanishing part and non-vanishing part for vector and axial vector components, up to the first order of $\hbar$. Then we discussed the possible physical meaning of the vanishing and non-vanishing parts, and their different behavior at thermal equilibrium.


title: Deepfake Forensics Using Recurrent Neural Networks

abstract: As of late an AI based free programming device has made it simple to make authentic face swaps in recordings that leaves barely any hints of control, in what are known as "deepfake" recordings. Situations where these genuine istic counterfeit recordings are utilized to make political pain, extort somebody or phony fear based oppression occasions are effectively imagined. This paper proposes a transient mindful pipeline to automat-ically recognize deepfake recordings. Our framework utilizes a convolutional neural system (CNN) to remove outline level highlights. These highlights are then used to prepare a repetitive neural net-work (RNN) that figures out how to characterize if a video has been sub-ject to control or not. We assess our technique against a huge arrangement of deepfake recordings gathered from different video sites. We show how our framework can accomplish aggressive outcomes in this assignment while utilizing a basic design.


title: Strict power concavity of a convolution

abstract: We give a sufficient condition for the strict parabolic power concavity of the convolution in space variable of a function defined on $\mathbb{R}^n \times (0,+\infty)$ and a function defined on $\mathbb{R}^n$. Since the strict parabolic power concavity of a function defined on $\mathbb{R}^n \times (0,+\infty)$ naturally implies the strict power concavity of a function defined on $\mathbb{R}^n$, our sufficient condition implies the strict power concavity of the convolution of two functions defined on $\mathbb{R}^n$. As applications, we show the strict parabolic power concavity and strict power concavity in space variable of the Gauss--Weierstass integral and the Poisson integral for the upper half-space.


title: The ring of modular forms of $\mathrm{O}(2,4;\mathbb{Z})$ with characters

abstract: We show that the ring of modular forms with characters for $\mathrm{O}(2,4;\mathbb{Z})$ is generated by forms of weights 4, 4, 6, 8, 10, 10, 12, and 30 with three relations of weights 8, 20, and 60. The proof is based on the study of a moduli space of K3 surfaces.


title: Self-duality triggered dynamical transition

abstract: A basic result about the dynamics of spinless quantum systems is that the Maryland model exhibits dynamical localization in any dimension. Here we implement mathematical spectral theory and numerical experiments to show that this result does not hold, when the 2-dimensional Maryland model is endowed with spin 1/2 -- hereafter dubbed spin-Maryland (SM) model. Instead, in a family of SM models, tuning the (effective) Planck constant drives dynamical localization{delocalization transitions of topological nature. These transitions are triggered by the self-duality, a symmetry generated by some transformation in the parameter -- the inverse Planck constant -- space. This provides significant insights to new dynamical phenomena such as what occur in the spinful quantum kicked rotor.

categories: cond-mat.mes-hall math-ph math.MP nlin.CD


title: Experimental demonstration of waveform-selective metasurface varying wireless communication characteristics at the same frequency band of 2.4 GHz

abstract: We report a waveform-selective metasurface that operates at 2.4 GHz band, i.e. one of ISM (Industrial, Scientific and Medical) bands. This structure gives us an additional degree of freedom to control electromagnetic waves and absorbs a particular waveform or pulse width of an incident wave at the same frequency band, while transmitting others. This unique capability is demonstrated using either ideal sinusoidal waves or Wi-Fi signals as a more practical waveform in wireless communications. Especially, this study shows how the waveform-selective metasurface interacts with realistic wireless communication signals from the viewpoint of communication characteristics, such as EVM (Error Vector Magnitude), BER (Bit Error Rate) and phase error. Thus, our study paves the way for extending the concept of waveform selectivity from a fundamental electromagnetic research field to a more realistic wireless communication field to, for instance, mitigate electromagnetic interference occurring at the same frequency band without significantly degrading communication characteristics.


title: Posterior Convergence of Nonparametric Binary and Poisson Regression Under Possible Misspecifications

abstract: In this article, we investigate posterior convergence of nonparametric binary and Poisson regression under possible model misspecification, assuming general stochastic process prior with appropriate properties. Our model setup and objective for binary regression is similar to that of Ghosal and Roy (2006) where the authors have used the approach of entropy bound and exponentially consistent tests with the sieve method to achieve consistency with respect to their Gaussian process prior. In contrast, for both binary and Poisson regression, using general stochastic process prior, our approach involves verification of asymptotic equipartition property along with the method of sieve, which is a manoeuvre of the general results of Shalizi (2009), useful even for misspecified models. Moreover, we will establish not only posterior consistency but also the rates at which the posterior probabilities converge, which turns out to be the Kullback-Leibler divergence rate. We also investgate the traditional posterior convergence rates. Interestingly, from subjective Bayesian viewpoint we will show that the posterior predictive distribution can accurately approximate the best possible predictive distribution in the sense that the Hellinger distance, as well as the total variation distance between the two distributions can tend to zero, in spite of misspecifications.


title: Quasiparticle lifetime of the repulsive Fermi polaron

abstract: We investigate the metastable repulsive branch of a mobile impurity coupled to a degenerate Fermi gas via short-range interactions. We show that the quasiparticle lifetime of this repulsive Fermi polaron can be experimentally probed by driving Rabi oscillations between weakly and strongly interacting impurity states. Using a time-dependent variational approach, we find that we can accurately model the impurity Rabi oscillations that were recently measured for repulsive Fermi polarons in both two and three dimensions. Crucially, our theoretical description does not include relaxation processes to the lower-lying attractive branch. Thus, the theory-experiment agreement demonstrates that the quasiparticle lifetime is determined by many-body dephasing within the upper repulsive branch rather than by the metastability of the upper branch itself. Our findings shed light on recent experimental observations of persistent repulsive correlations, and have important consequences for the nature and stability of the strongly repulsive Fermi gas.


title: Posterior Consistency of Bayesian Inverse Regression and Inverse Reference Distributions

abstract: We consider Bayesian inference in inverse regression problems where the objective is to infer about unobserved covariates from observed responses and covariates. We establish posterior consistency of such unobserved covariates in Bayesian inverse regression problemsunder appropriate priors in a leave-one-out cross-validation setup. We relate this to posterior consistency of inverse reference distributions (Bhattacharya (2013)) for assessing model adequacy. We illustrate our theory and methods with various examples of Bayesian inverse regression, along with adequate simulation experiments.


title: Aspects of relativistic heavy-ion collisions

abstract: The rapid thermalization of quarks and gluons in the initial stages of relativistic heavy-ion collisions is treated using analytic solutions of a nonlinear diffusion equation with schematic initial conditions, and for gluons with boundary conditions at the singularity. On a similarly short time scale of $t \le1$ fm/$c$, the stopping of baryons is accounted for through a QCD-inspired approach based on the parton distribution functions of valence quarks, and gluons. Charged-hadron production is considered phenomenologically using a linear relativistic diffusion model with two fragmentation sources, and a central gluonic source that rises with $\ln^3(s_{NN})$. The limiting-fragmentation conjecture that agrees with data at energies reached at the Relativistic Heavy Ion Collider (RHIC) is found to be consistent with Large Hadron Collider (LHC) data for Pb-Pb at $\sqrt{s_{NN}}= 2.76$ and $5.02$ TeV. Quarkonia are used as hard probes for the properties of the quark-gluon plasma (QGP) through a comparison of theoretical predictions with recent CMS, ALICE and LHCb data for Pb-Pb and p-Pb collisions.


title: Ly-alpha Radiative Transfer: Monte-Carlo Simulation of the Wouthuysen-Field Effect

abstract: A three-dimensional Monte Carlo Ly-alpha radiative transfer (RT) code, named LaRT, is developed to study the Ly-alpha RT and the Wouthuysen-Field (WF) effect. Using the code, we calculate the line profile of Ly-alpha radiation within the multiphase interstellar medium (ISM), with a particular emphasis on gas at low densities. We show that the WF effect is in action: the central portion of the line profile tends to approach a small slice of the Planck function with a color temperature equal to the kinetic temperature of the gas, even in a system with an optical thickness as low as tau_0~100-500. We also investigate the effects of the turbulent motion of the ISM on the emergent Ly-alpha spectrum and color temperature. The turbulent motion broadens, as generally expected, the emergent spectrum, but the color temperature is not affected by the turbulent motion in typical astrophysical environments. We utilize two multiphase ISM models, appropriate for the vicinity of the Sun, to calculate the 21-cm spin temperature of neutral hydrogen, including excitation via the Ly-alpha resonant scattering. The first ISM model is a simple clumpy model, while the second is a self-consistent magnetohydrodynamics simulation model using the TIGRESS framework. Ly-alpha photons originating from both H II regions and the collisionally cooling gas are taken into account. We find that the Ly-alpha radiation field is, in general, likely to be strong enough to bring the 21-cm spin temperature of the warm neutral medium close to the kinetic temperature. The escape fraction of Ly-alpha in our ISM models is estimated to be ~7-20%.


title: Biomedical Entity Representations with Synonym Marginalization

abstract: Biomedical named entities often play important roles in many biomedical text mining tools. However, due to the incompleteness of provided synonyms and numerous variations in their surface forms, normalization of biomedical entities is very challenging. In this paper, we focus on learning representations of biomedical entities solely based on the synonyms of entities. To learn from the incomplete synonyms, we use a model-based candidate selection and maximize the marginal likelihood of the synonyms present in top candidates. Our model-based candidates are iteratively updated to contain more difficult negative samples as our model evolves. In this way, we avoid the explicit pre-selection of negative samples from more than 400K candidates. On four biomedical entity normalization datasets having three different entity types (disease, chemical, adverse reaction), our model BioSyn consistently outperforms previous state-of-the-art models almost reaching the upper bound on each dataset.


title: First-passage times for random walks in the triangular array setting

abstract: In this paper we continue our study of exit times for random walks with independent but not necessarily identical distributed increments. Our paper "First-passage times for random walks with non-identically distributed increments" was devoted to the case when the random walk is constructed by a fixed sequence of independent random variables which satisfies the classical Lindeberg condition. Now we consider a more general situation when we have a triangular array of independent random variables. Our main assumption is that the entries of every row are uniformly bounded by a constant, which tends to zero as the number of the row increases.


title: Directly visualizing the momentum forbidden dark excitons and their dynamics in atomically thin semiconductors

abstract: Resolving the momentum degree of freedom of excitons - electron-hole pairs bound by the Coulomb attraction in a photoexcited semiconductor, has remained a largely elusive goal for decades. In atomically thin semiconductors, such a capability could probe the momentum forbidden dark excitons, which critically impact proposed opto-electronic technologies, but are not directly accessible via optical techniques. Here, we probe the momentum-state of excitons in a WSe2 monolayer by photoemitting their constituent electrons, and resolving them in time, momentum and energy. We obtain a direct visual of the momentum forbidden dark excitons, and study their properties, including their near-degeneracy with bright excitons and their formation pathways in the energy-momentum landscape. These dark excitons dominate the excited state distribution - a surprising finding that highlights their importance in atomically thin semiconductors.


title: TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questions

abstract: A critical part of reading is being able to understand the temporal relationships between events described in a passage of text, even when those relationships are not explicitly stated. However, current machine reading comprehension benchmarks have practically no questions that test temporal phenomena, so systems trained on these benchmarks have no capacity to answer questions such as "what happened before/after [some event]?" We introduce TORQUE, a new English reading comprehension benchmark built on 3.2k news snippets with 21k human-generated questions querying temporal relationships. Results show that RoBERTa-large achieves an exact-match score of 51% on the test set of TORQUE, about 30% behind human performance.