title: Language Model Prior for Low-Resource Neural Machine Translation

abstract: The scarcity of large parallel corpora is an important obstacle for neural machine translation. A common solution is to exploit the knowledge of language models (LM) trained on abundant monolingual data. In this work, we propose a novel approach to incorporate a LM as prior in a neural translation model (TM). Specifically, we add a regularization term, which pushes the output distributions of the TM to be probable under the LM prior, while avoiding wrong predictions when the TM "disagrees" with the LM. This objective relates to knowledge distillation, where the LM can be viewed as teaching the TM about the target language. The proposed approach does not compromise decoding speed, because the LM is used only at training time, unlike previous work that requires it during inference. We present an analysis of the effects that different methods have on the distributions of the TM. Results on two low-resource machine translation datasets show clear improvements even with limited monolingual data.


title: On the general dyadic grids in $\mathbb{R}^d$

abstract: Adjacent dyadic systems are pivotal in analysis and related fields to study continuous objects via collections of dyadic ones. In our prior work (joint with Jiang, Olson and Wei) we describe precise necessary and sufficient conditions for two dyadic systems on the real line to be adjacent. Here we extend this work to all dimensions, which turns out to have many surprising difficulties due to the fact that $d+1$, not $2^d$, grids is the optimal number in an adjacent dyadic system in $\mathbb{R}^d$. As a byproduct, we show that a collection of $d+1$ dyadic systems in $\mathbb{R}^d$ is adjacent if and only if the projection of any two of them onto any coordinate axis are adjacent on $\mathbb{R}$. The underlying geometric structures that arise in this higher dimensional generalization are interesting objects themselves, ripe for future study; these lead us to a compact, geometric description of our main result. We describe these structures, along with what adjacent dyadic (and $n$-adic, for any $n$) systems look like, from a variety of contexts, relating them to previous work, as well as illustrating a specific example.


title: Quantum dynamical characterization and simulation of topological phases with high-order band inversion surfaces

abstract: How to characterize topological quantum phases is a fundamental issue in the broad field of topological matter. From a dimension reduction approach, we propose the concept of high-order band inversion surfaces (BISs) which enable the optimal schemes to characterize equilibrium topological phases by far-from-equilibrium quantum dynamics, and further report the experimental simulation. We show that characterization of a d-dimensional (dD) topological phase can be reduced to lower-dimensional topological invariants in the high-order BISs, of which the nth-order BIS is a (d-n)D interface in momentum space. In quenching the system from trivial phase to topological regime, we unveil a high-order dynamical bulk-surface correspondence that the quantum dynamics exhibits nontrivial topological pattern in arbitrary nth-order BISs, which universally corresponds to and so characterizes the equilibrium topological phase of the post-quench Hamiltonian. This high-order dynamical bulk-surface correspondence provides new and optimal dynamical schemes with fundamental advantages to simulate and detect topological states, in which through the highest-order BISs that are of zero dimension, the detection of topological phase relies on only minimal measurements. We experimentally build up a quantum simulator with spin qubits to investigate a 3D chiral topological insulator through emulating each momentum one by one and measure the high-order dynamical bulk-surface correspondence, with the advantages of topological characterization via highest-order BISs being demonstrated.


title: The Complexity of Dynamic Data Race Prediction

abstract: Writing concurrent programs is notoriously hard due to scheduling non-determinism. The most common concurrency bugs are data races, which are accesses to a shared resource that can be executed concurrently. Dynamic data-race prediction is the most standard technique for detecting data races: given an observed, data-race-free trace $t$, the task is to determine whether $t$ can be reordered to a trace $t^*$ that exposes a data-race. Although the problem has received significant practical attention for over three decades, its complexity has remained elusive. In this work, we address this lacuna, identifying sources of intractability and conditions under which the problem is efficiently solvable. Given a trace $t$ of size $n$ over $k$ threads, our main results are as follows. First, we establish a general $O(k\cdot n^{2\cdot (k-1)})$ upper-bound, as well as an $O(n^k)$ upper-bound when certain parameters of $t$ are constant. In addition, we show that the problem is NP-hard and even W[1]-hard parameterized by $k$, and thus unlikely to be fixed-parameter tractable. Second, we study the problem over acyclic communication topologies, such as server-clients hierarchies. We establish an $O(k^2\cdot d\cdot n^2\cdot \log n)$ upper-bound, where $d$ is the number of shared variables accessed in $t$. In addition, we show that even for traces with $k=2$ threads, the problem has no $O(n^{2-\epsilon})$ algorithm under Orthogonal Vectors. Since any trace with 2 threads defines an acyclic topology, our upper-bound for this case is optimal wrt polynomial improvements for up to moderate values of $k$ and $d$. Finally, we study a distance-bounded version of the problem, where the task is to expose a data race by a witness trace that is similar to $t$. We develop an algorithm that works in $O(n)$ time when certain parameters of $t$ are constant.


title: Not so presto? Outcomes of sluggish prestin in outer hair cells

abstract: Prestin (SLC26A5), a protein essential for the sensitivity of the mammalian ear, was so named from \emph{presto}. The assumption was that this membrane protein supports fast movement of outer hair cells (OHCs) that matches the mammalian hearing range, up to 20 kHz in general and beyond, depending on the species. \emph{In vitro} data from isolated OHCs appeared to be consistent with such frequencies. However, some recent reports cast doubts on this assumption, suggesting that the intrinsic transition rates of this protein are much lower, about 3 kHz for guinea pigs, not covering the auditory frequency range of the animal. Recent \emph{in vivo} data also show that the amplitude of OHC motion rolls off well below the best frequency of the location. The present report examines whether or not these resent observations are compatible with the physiological function of OHCs by using simple piezoelectric models.


title: Perceptual reasoning based solution methodology for linguistic optimization problems

abstract: Decision making in real-life scenarios may often be modeled as an optimization problem. It requires the consideration of various attributes like human preferences and thinking, which constrain achieving the optimal value of the problem objectives. The value of the objectives may be maximized or minimized, depending on the situation. Numerous times, the values of these problem parameters are in linguistic form, as human beings naturally understand and express themselves using words. These problems are therefore termed as linguistic optimization problems (LOPs), and are of two types, namely single objective linguistic optimization problems (SOLOPs) and multi-objective linguistic optimization problems (MOLOPs). In these LOPs, the value of the objective function(s) may not be known at all points of the decision space, and therefore, the objective function(s) as well as problem constraints are linked by the if-then rules. Tsukamoto inference method has been used to solve these LOPs; however, it suffers from drawbacks. As, the use of linguistic information inevitably calls for the utilization of computing with words (CWW), and therefore, 2-tuple linguistic model based solution methodologies were proposed for LOPs. However, we found that 2-tuple linguistic model based solution methodologies represent the semantics of the linguistic information using a combination of type-1 fuzzy sets and ordinal term sets. As, the semantics of linguistic information are best modeled using the interval type-2 fuzzy sets, hence we propose solution methodologies for LOPs based on CWW approach of perceptual computing, in this paper. The perceptual computing based solution methodologies use a novel design of CWW engine, called the perceptual reasoning (PR). PR in the current form is suitable for solving SOLOPs and, hence, we have also extended it to the MOLOPs.


title: A strategy for finding people infected with SARS-CoV-2: optimizing pooled testing at low prevalence

abstract: Suppressing SARS-CoV-2 will likely require the rapid identification and isolation of infected individuals, on an ongoing basis. RT-PCR (reverse transcription polymerase chain reaction) tests are accurate but costly, making regular testing of every individual expensive. The costs are a challenge for all countries and particularly for developing countries. Cost reductions can be achieved by combining samples and testing them in groups. We propose an algorithm for grouping subsamples, prior to testing, based on the geometry of a hypercube. At low prevalence, this testing procedure uniquely identifies infected individuals in a small number of tests. We discuss the optimal group size and explain why, given the highly infectious nature of the disease, parallel searches are preferred. We report proof of concept experiments in which a positive sample was detected even when diluted a hundred-fold with negative samples. Using these methods, the costs of mass testing could be reduced by a factor of ten to a hundred or more. If infected individuals are quickly and effectively quarantined, the prevalence will fall and so will the costs of regularly testing everyone. Such a strategy provides a possible pathway to the longterm elimination of SARS-CoV-2. Field trials of our approach are now under way in Rwanda and initial data from these are reported here.


title: Quasinormal modes and greybody factors of the novel four dimensional Gauss-Bonnet black holes in asymptotically de Sitter space time: Scalar, Electromagnetic and Dirac perturbations

abstract: We find the low lying quasinormal mode frequencies of the recently proposed novel four dimensional Gauss-Bonnet de Sitter black holes for scalar, electromagnetic and Dirac field perturbations using the third order WKB approximation as well as Pad\'{e} approximation, as an improvement over WKB. We figure out the effect of the Gauss-Bonnet coupling $\alpha$ and the cosmological constant $\Lambda$ on the real and imaginary parts of the QNM frequencies. We also study the greybody factors and eikonal limits in the above background for all three different types of perturbations.


title: Generative Adversarial Networks in Digital Pathology: A Survey on Trends and Future Potential

abstract: Image analysis in the field of digital pathology has recently gained increased popularity. The use of high-quality whole slide scanners enables the fast acquisition of large amounts of image data, showing extensive context and microscopic detail at the same time. Simultaneously, novel machine learning algorithms have boosted the performance of image analysis approaches. In this paper, we focus on a particularly powerful class of architectures, called Generative Adversarial Networks (GANs), applied to histological image data. Besides improving performance, GANs also enable application scenarios in this field, which were previously intractable. However, GANs could exhibit a potential for introducing bias. Hereby, we summarize the recent state-of-the-art developments in a generalizing notation, present the main applications of GANs and give an outlook of some chosen promising approaches and their possible future applications. In addition, we identify currently unavailable methods with potential for future applications.


title: Two Successive Type II Radio Bursts Associated with B-class Flares and Slow CMEs

abstract: From 2018 Oct 12 to 13, three successive solar eruptions (E1--E3) with B-class flares and poor white light coronal mass ejections (CMEs) occurred from the same active region NOAA AR 12724. Interestingly, the first two eruptions are associated with Type II radio bursts but the third is not. Using the soft X-ray flux data, radio dynamic spectra and dual perspective EUV intensity images, we comparatively investigate the three events. Our results show that their relevant flares are weak (B2.1, B7.9 and B2.3) and short-lived (13, 9 and 14 minutes). The main eruption directions of E1 and E2 are along $\sim$45$^\circ$ north of their radial directions, while E3 primarily propagated along the radial direction. In the EUV channels, the early speeds of the first two CMEs have apparent speeds of $\sim$320 km s$^{-1}$ and $\sim$380 km s$^{-1}$, which could exceed their respective local Alfv$\acute{e}$n speeds of $\sim$300 km s$^{-1}$ and $\sim$350 km s$^{-1}$. However, the CME in the third eruption possesses a much lower speed of $\sim$160 km s$^{-1}$. These results suggest that the observed Type II radio bursts in the eruptions E1 and E2 are likely triggered by their associated CMEs and the direction of eruption and the ambient plasma and magnetic environments may take an important place in producing Type II radio burst or shock as well.


title: Adaptive Robust Kernels for Non-Linear Least Squares Problems

abstract: State estimation is a key ingredient in most robotic systems. Often, state estimation is performed using some form of least squares minimization. Basically, all error minimization procedures that work on real-world data use robust kernels as the standard way for dealing with outliers in the data. These kernels, however, are often hand-picked, sometimes in different combinations, and their parameters need to be tuned manually for a particular problem. In this paper, we propose the use of a generalized robust kernel family, which is automatically tuned based on the distribution of the residuals and includes the common m-estimators. We tested our adaptive kernel with two popular estimation problems in robotics, namely ICP and bundle adjustment. The experiments presented in this paper suggest that our approach provides higher robustness while avoiding a manual tuning of the kernel parameters.


title: PeerNomination: Relaxing Exactness for Increased Accuracy in Peer Selection

abstract: In peer selection agents must choose a subset of themselves for an award or a prize. As agents are self-interested, we want to design algorithms that are impartial, so that an individual agent cannot affect their own chance of being selected. This problem has broad application in resource allocation and mechanism design and has received substantial attention in the artificial intelligence literature. Here, we present a novel algorithm for impartial peer selection, PeerNomination, and provide a theoretical analysis of its accuracy. Our algorithm possesses various desirable features. In particular, it does not require an explicit partitioning of the agents, as previous algorithms in the literature. We show empirically that it achieves higher accuracy than the exiting algorithms over several metrics.


title: The resumption of sports competitions after COVID-19 lockdown: The case of the Spanish football league

abstract: In this work, we present a stochastic discrete-time SEIR (Susceptible-Exposed-Infectious-Recovered) model adapted to describe the propagation of COVID-19 during a football tournament. Specifically, we are concerned about the re-start of the Spanish national football league, La Liga, which is currently -May 2020- stopped with 11 fixtures remaining. Our model includes two additional states of an individual, confined and quarantined, which are reached when an individual presents COVID-19 symptoms or has undergone a virus test with a positive result. The model also accounts for the interaction dynamics of players, considering three different sources of infection: the player social circle, the contact with his/her team colleagues during training sessions, and the interaction with rivals during a match. Our results highlight the influence of the days between matches, the frequency of virus tests and their sensitivity on the number of players infected at the end of the season. Following our findings, we finally present a variety of strategies to minimize the probability that COVID-19 propagates in case the season of La Liga was re-started after the current lockdown.


title: The Information Bottleneck Problem and Its Applications in Machine Learning

abstract: Inference capabilities of machine learning (ML) systems skyrocketed in recent years, now playing a pivotal role in various aspect of society. The goal in statistical learning is to use data to obtain simple algorithms for predicting a random variable $Y$ from a correlated observation $X$. Since the dimension of $X$ is typically huge, computationally feasible solutions should summarize it into a lower-dimensional feature vector $T$, from which $Y$ is predicted. The algorithm will successfully make the prediction if $T$ is a good proxy of $Y$, despite the said dimensionality-reduction. A myriad of ML algorithms (mostly employing deep learning (DL)) for finding such representations $T$ based on real-world data are now available. While these methods are often effective in practice, their success is hindered by the lack of a comprehensive theory to explain it. The information bottleneck (IB) theory recently emerged as a bold information-theoretic paradigm for analyzing DL systems. Adopting mutual information as the figure of merit, it suggests that the best representation $T$ should be maximally informative about $Y$ while minimizing the mutual information with $X$. In this tutorial we survey the information-theoretic origins of this abstract principle, and its recent impact on DL. For the latter, we cover implications of the IB problem on DL theory, as well as practical algorithms inspired by it. Our goal is to provide a unified and cohesive description. A clear view of current knowledge is particularly important for further leveraging IB and other information-theoretic ideas to study DL models.


title: Memristors -- from In-memory computing, Deep Learning Acceleration, Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired Computing

abstract: Machine learning, particularly in the form of deep learning, has driven most of the recent fundamental developments in artificial intelligence. Deep learning is based on computational models that are, to a certain extent, bio-inspired, as they rely on networks of connected simple computing units operating in parallel. Deep learning has been successfully applied in areas such as object/pattern recognition, speech and natural language processing, self-driving vehicles, intelligent self-diagnostics tools, autonomous robots, knowledgeable personal assistants, and monitoring. These successes have been mostly supported by three factors: availability of vast amounts of data, continuous growth in computing power, and algorithmic innovations. The approaching demise of Moore's law, and the consequent expected modest improvements in computing power that can be achieved by scaling, raise the question of whether the described progress will be slowed or halted due to hardware limitations. This paper reviews the case for a novel beyond CMOS hardware technology, memristors, as a potential solution for the implementation of power-efficient in-memory computing, deep learning accelerators, and spiking neural networks. Central themes are the reliance on non-von-Neumann computing architectures and the need for developing tailored learning and inference algorithms. To argue that lessons from biology can be useful in providing directions for further progress in artificial intelligence, we briefly discuss an example based reservoir computing. We conclude the review by speculating on the big picture view of future neuromorphic and brain-inspired computing systems.


title: A computational insight of the improved nicotine binding with ACE2-SARS-CoV-2 complex with its clinical impact

abstract: Smokers being witnessed with the mild adverse clinical symptoms of SARS-CoV-2, the in-silico study is intended to explore the effect of nicotine binding to the soluble angiotensin converting enzyme II (ACE2) receptor with or without SARS-CoV-2 binding. Nicotine established a stable interaction with the conserved amino acid residues: Asp382, Gly405, His378 and Tyr385 through His401 of the soluble ACE2 that seals its interaction with the INS1. Also, nicotine binding has significantly reduced the affinity score of ACE2 with INS1 to -12.6 kcal/mol (versus -15.7 kcal/mol without nicotine) and the interface area to 1933.6 square Angstrom (versus 2057.3 square Angstrom without nicotine). Nicotine exhibited a higher binding affinity score with ACE2-SARS-CoV-2 complex with -6.33 kcal/mol (Vs -5.24 kcal/mol without SARS-CoV-2) and a lowered inhibitory contant value of 22.95 micromolar (Vs 151.69 micromolar without SARS-CoV). Eventhough ACE2 is not a potential receptor for nicotine binding in the healthy people, in COVID19 patients, it may exhibit better binding affinity with the ACE2 receptor. In overall, nicotines strong preference for ACE2-SARS-CoV-2 complex might drastically reduce the SARS-CoV-2 virulence by intervening the ACE2 conserved residues interaction with the spike (S1) protein of SARS-CoV-2.


title: Islands and Page Curves for Evaporating Black Holes in JT Gravity

abstract: The effect of a CFT shockwave on the entanglement structure of an eternal black hole in Jackiw-Teitelboim gravity, that is in thermal equilibrium with a thermal bath, is considered. The shockwave carries energy and entropy into the black hole and heats the black hole up leading to evaporation and the eventual recovery of equilibrium. We find an analytical description of the entire relaxational process within the semiclassical high temperature regime. If the shockwave is inserted around the Page time then several scenarios are possible depending on the parameters. The Page time can be delayed or hastened and there can be more than one transition. The final entropy saddle has a quantum extremal surface that generically starts inside the horizon but at some later time moves outside. In general, increased shockwave energy and slow evaporation rate favour the extremal surface to be inside the horizon. The shockwave also disrupts the scrambling properties of the black hole. The same analysis is then applied to a shockwave inserted into the extremal black hole with similar conclusions.


title: The pure BRST Einstein-Hilbert Lagrangian from the double-copy to cubic order

abstract: We construct the pure gravity Becchi-Rouet-Stora-Tyutin (BRST) Einstein-Hilbert Lagrangian, to cubic order, using the BRST convolution product of two Yang-Mills theories, in conjunction with the Bern-Carrasco-Johansson (BCJ) double-copy.


title: Data Enhanced Reaction Predictions in Chemical Space With Hammett's Equation

abstract: By separating the effect of substituents from chemical process variables, such as reaction mechanism, solvent, or temperature, the Hammett equation enables control of chemical reactivity throughout chemical space. We used global regression to optimize Hammett parameters $\rho$ and $\sigma$ in two datasets, experimental rate constants for benzylbromides reacting with thiols and the decomposition of ammonium salts, and a synthetic dataset consisting of computational activation energies of $\sim$ 1400 $S_N2$ reactions, with various nucleophiles and leaving groups (-H, -F, -Cl, -Br) and functional groups (-H, -NO$_2$, -CN, -NH$_3$, -CH$_3$). The original approach is generalized to predict potential energies of activation in non aromatic molecular scaffolds with multiple substituents. Individual substituents contribute additively to molecular $\sigma$ with a unique regression term, which quantifies the inductive effect. Moreover, the position dependence of the substituent can be replaced by a distance decaying factor for $S_N2$. Use of the Hammett equation as a base-line model for $\Delta$-Machine learning models of the activation energy in chemical space results in substantially improved learning curves for small training set sizes.


title: Elliptic curves with Galois-stable cyclic subgroups of order 4

abstract: Infinitely many elliptic curves over ${\bf Q}$ have a Galois-stable cyclic subgroup of order 4. Such subgroups come in pairs, which intersect in their subgroups of order 2. Let $N_i(X)$ denote the number of elliptic curves over ${\bf Q}$ with at least $i$ pairs of Galois-stable cyclic subgroups of order 4, and height at most $X$. In this article we show that $N_1(X) = c_{1,1}X^{1/3}+c_{1,2}X^{1/6}+O(X^{0.105})$. We also show, as $X\to \infty$, that $N_2(X)=c_{2,1}X^{1/6}+o(X^{1/12})$, the precise nature of the error term being related to the prime number theorem and the zeros of the Riemann zeta-function in the critical strip. Here, $c_{1,1}= 0.95740\ldots$, $c_{1,2}=- 0.87125\ldots$, and $c_{2,1}= 0.035515\ldots$ are calculable constants. Lastly, we show that $N_i(X)=0$ for $i > 2$ (the result being trivial for $i>3$ given that an elliptic curve has 6 cyclic subgroups of order 4).


title: An inverse problem to determine the shape of a human vocal tract

abstract: The inverse problem of determining the cross-sectional area of a human vocal tract during the utterance of a vowel is considered. The frequency-dependent boundary condition at the lips is expressed in terms of the acoustic impedance of a vibrating piston on an infinite plane baffle. The corresponding pressure at the lips is expressed in terms of the normalized impedance and a key quantity related to the so-called Jost function of an associated Schr\"odinger equation. Various input data sets are considered to solve the inverse problem, including the pressure at the lips, the absolute pressure at the lips, or the poles of the pressure at the lips. The solution to the inverse problem is obtained with the help of the Gel'fand-Levitan method for the associated Schr\"odinger equation.


title: SkipGNN: Predicting Molecular Interactions with Skip-Graph Networks

abstract: Molecular interaction networks are powerful resources for the discovery. They are increasingly used with machine learning methods to predict biologically meaningful interactions. While deep learning on graphs has dramatically advanced the prediction prowess, current graph neural network (GNN) methods are optimized for prediction on the basis of direct similarity between interacting nodes. In biological networks, however, similarity between nodes that do not directly interact has proved incredibly useful in the last decade across a variety of interaction networks. Here, we present SkipGNN, a graph neural network approach for the prediction of molecular interactions. SkipGNN predicts molecular interactions by not only aggregating information from direct interactions but also from second-order interactions, which we call skip similarity. In contrast to existing GNNs, SkipGNN receives neural messages from two-hop neighbors as well as immediate neighbors in the interaction network and non-linearly transforms the messages to obtain useful information for prediction. To inject skip similarity into a GNN, we construct a modified version of the original network, called the skip graph. We then develop an iterative fusion scheme that optimizes a GNN using both the skip graph and the original graph. Experiments on four interaction networks, including drug-drug, drug-target, protein-protein, and gene-disease interactions, show that SkipGNN achieves superior and robust performance, outperforming existing methods by up to 28.8\% of area under the precision recall curve (PR-AUC). Furthermore, we show that unlike popular GNNs, SkipGNN learns biologically meaningful embeddings and performs especially well on noisy, incomplete interaction networks.


title: Invertible Elements of the Misere Dicotic Universe

abstract: We present a characterization of the invertible elements of the misere dicotic universe.


title: Multiple-Depot Vehicle Scheduling Problem Heuristics

abstract: The Multiple-Depot Vehicle Scheduling Problem (MDVSP) is very important in the planning process of transport systems. It consists in assigning a set of trips to a set of vehicles in order to minimize a certain total cost. We introduce three fast and reliable heuristics for MDVSP based on a classical integer linear programming formulation and on graph theoretic methods of fixing the infeasible subtours gathered from an integer solution. Extensive experimentations using a large set of benchmark instances show that our heuristics are faster and give good or even better results compared with other existing heuristics.


title: Pain and Physical Activity Association in Critically Ill Patients

abstract: Critical care patients experience varying levels of pain during their stay in the intensive care unit, often requiring administration of analgesics and sedation. Such medications generally exacerbate the already sedentary physical activity profiles of critical care patients, contributing to delayed recovery. Thus, it is important not only to minimize pain levels, but also to optimize analgesic strategies in order to maximize mobility and activity of ICU patients. Currently, we lack an understanding of the relation between pain and physical activity on a granular level. In this study, we examined the relationship between nurse assessed pain scores and physical activity as measured using a wearable accelerometer device. We found that average, standard deviation, and maximum physical activity counts are significantly higher before high pain reports compared to before low pain reports during both daytime and nighttime, while percentage of time spent immobile was not significantly different between the two pain report groups. Clusters detected among patients using extracted physical activity features were significant in adjusted logistic regression analysis for prediction of pain report group.


title: Soft Affirmative Action and Minority Recruitment

abstract: We study search, evaluation, and selection of candidates of unknown quality for a position. We examine the effects of "soft" affirmative action policies increasing the relative percentage of minority candidates in the candidate pool. We show that, while meant to encourage minority hiring, such policies may backfire if the evaluation of minority candidates is noisier than that of non-minorities. This may occur even if minorities are at least as qualified and as valuable as non-minorities. The results provide a possible explanation for why certain soft affirmative action policies have proved counterproductive, even in the absence of (implicit) biases.


title: On Deep Instrumental Variables Estimate

abstract: The endogeneity issue is fundamentally important as many empirical applications may suffer from the omission of explanatory variables, measurement error, or simultaneous causality. Recently, \cite{hllt17} propose a "Deep Instrumental Variable (IV)" framework based on deep neural networks to address endogeneity, demonstrating superior performances than existing approaches. The aim of this paper is to theoretically understand the empirical success of the Deep IV. Specifically, we consider a two-stage estimator using deep neural networks in the linear instrumental variables model. By imposing a latent structural assumption on the reduced form equation between endogenous variables and instrumental variables, the first-stage estimator can automatically capture this latent structure and converge to the optimal instruments at the minimax optimal rate, which is free of the dimension of instrumental variables and thus mitigates the curse of dimensionality. Additionally, in comparison with classical methods, due to the faster convergence rate of the first-stage estimator, the second-stage estimator has {a smaller (second order) estimation error} and requires a weaker condition on the smoothness of the optimal instruments. Given that the depth and width of the employed deep neural network are well chosen, we further show that the second-stage estimator achieves the semiparametric efficiency bound. Simulation studies on synthetic data and application to automobile market data confirm our theory.


title: Parallel processor scheduling: formulation as multi-objective linguistic optimization and solution using Perceptual Reasoning based methodology

abstract: In the era of Industry 4.0, the focus is on the minimization of human element and maximizing the automation in almost all the industrial and manufacturing establishments. These establishments contain numerous processing systems, which can execute a number of tasks, in parallel with minimum number of human beings. This parallel execution of tasks is done in accordance to a scheduling policy. However, the minimization of human element beyond a certain point is difficult. In fact, the expertise and experience of a group of humans, called the experts, becomes imminent to design a fruitful scheduling policy. The aim of the scheduling policy is to achieve the optimal value of an objective, like production time, cost, etc. In real-life situations, there are more often than not, multiple objectives in any parallel processing scenario. Furthermore, the experts generally provide their opinions, about various scheduling criteria (pertaining to the scheduling policies) in linguistic terms or words. Word semantics are best modeled using fuzzy sets (FSs). Thus, all these factors have motivated us to model the parallel processing scenario as a multi-objective linguistic optimization problem (MOLOP) and use the novel perceptual reasoning (PR) based methodology for solving it. We have also compared the results of the PR based solution methodology with those obtained from the 2-tuple based solution methodology. PR based solution methodology offers three main advantages viz., it generates unique recommendations, here the linguistic recommendations match a codebook word, and also the word model comes before the word. 2-tuple based solution methodology fails to give all these advantages. Thus, we feel that our work is novel and will provide directions for the future research.


title: Multi-Photon, Multi-Dimensional Hyper-Entanglement using Higher-Order Radix qudits with Applications to Quantum Computing, QKD and Quantum Teleportation

abstract: Google recently announced that they had achieved quantum supremacy with 53 qubits (base-2 binaries or radix-2), corresponding to a computational state-space of dimension 253 (about 1016). Google claimed to perform computations that took 200 seconds on their quantum processor that would have taken 10,000 years to accomplish on a classical supercomputer [1]. However, achieving superposition and entanglement of 53 qubits is not an easy task given the environmental noise that decoheres the qubits. In this paper, we claim that one can potentially achieve a similar computational dimension with fewer qudits (not qubits) where each qudit is of a higher radix (greater than 2) using a photonics system (i.e. 16 qudits with radix-10). This paper is a collaborative development between industry and NxGen Partners to explore such an approach. There is a Raytheon technology that uses a Free-Space Optical (FSO) Fabry-Perot Etalon that eliminates the need for adaptive optics [2, 3]. The NxGen technology uses multiple Orbital Angular Momentum (OAM) modes as a new degree of freedom for quantum computing and a multi-dimensional QKD [4-7]. We also claim that the convergence of both broadband, secure communications, quantum computing and quantum teleportation is only possible in a photonics realization. Therefore, the use of photonic qudits allows the extension of security and capacity of the quantum teleportation beyond what was achieved by Chinese Micius quantum satellite [8]. Both the defense and commercial computing industries need such quantum computing systems. A new measure is introduced with computational state-space dimension, high-fidelity operations, high connectivity, large calibrated gate sets, and circuit rewriting toolchains. This new measure which we call quantum capacity is a practical way to measure and compare progress toward improved system structure of a universal quantum computer.


title: Model completeness for the differential field of transseries with exponentiation

abstract: Let $\mathbb{T}$ be the differential field of logarithmic-exponential transseries. We show that the expansion of $\mathbb{T}$ by its natural exponential function is model complete and locally o-minimal. We give an axiomatization of the theory of this expansion that is effective relative to the theory of the real exponential field. We adapt our results to show that the expansion of $\mathbb{T}$ by this exponential function and by its natural restricted sine and restricted cosine functions is also model complete and locally o-minimal.


title: A Call for More Rigor in Unsupervised Cross-lingual Learning

abstract: We review motivations, definition, approaches, and methodology for unsupervised cross-lingual learning and call for a more rigorous position in each of them. An existing rationale for such research is based on the lack of parallel data for many of the world's languages. However, we argue that a scenario without any parallel data and abundant monolingual data is unrealistic in practice. We also discuss different training signals that have been used in previous work, which depart from the pure unsupervised setting. We then describe common methodological issues in tuning and evaluation of unsupervised cross-lingual models and present best practices. Finally, we provide a unified outlook for different types of research in this area (i.e., cross-lingual word embeddings, deep multilingual pretraining, and unsupervised machine translation) and argue for comparable evaluation of these models.


title: Natural Language Premise Selection: Finding Supporting Statements for Mathematical Text

abstract: Mathematical text is written using a combination of words and mathematical expressions. This combination, along with a specific way of structuring sentences makes it challenging for state-of-art NLP tools to understand and reason on top of mathematical discourse. In this work, we propose a new NLP task, the natural premise selection, which is used to retrieve supporting definitions and supporting propositions that are useful for generating an informal mathematical proof for a particular statement. We also make available a dataset, NL-PS, which can be used to evaluate different approaches for the natural premise selection task. Using different baselines, we demonstrate the underlying interpretation challenges associated with the task.


title: Improving Semantic Segmentation via Self-Training

abstract: Deep learning usually achieves the best results with complete supervision. In the case of semantic segmentation, this means that large amounts of pixelwise annotations are required to learn accurate models. In this paper, we show that we can obtain state-of-the-art results using a semi-supervised approach, specifically a self-training paradigm. We first train a teacher model on labeled data, and then generate pseudo labels on a large set of unlabeled data. Our robust training framework can digest human-annotated and pseudo labels jointly and achieve top performances on Cityscapes, CamVid and KITTI datasets while requiring significantly less supervision. We also demonstrate the effectiveness of self-training on a challenging cross-domain generalization task, outperforming conventional finetuning method by a large margin. Lastly, to alleviate the computational burden caused by the large amount of pseudo labels, we propose a fast training schedule to accelerate the training of segmentation models by up to 2x without performance degradation.


title: Mutlitask Learning for Cross-Lingual Transfer of Semantic Dependencies

abstract: We describe a method for developing broad-coverage semantic dependency parsers for languages for which no semantically annotated resource is available. We leverage a multitask learning framework coupled with an annotation projection method. We transfer supervised semantic dependency parse annotations from a rich-resource language to a low-resource language through parallel data, and train a semantic parser on projected data. We make use of supervised syntactic parsing as an auxiliary task in a multitask learning framework, and show that with different multitask learning settings, we consistently improve over the single-task baseline. In the setting in which English is the source, and Czech is the target language, our best multitask model improves the labeled F1 score over the single-task baseline by 1.8 in the in-domain SemEval data (Oepen et al., 2015), as well as 2.5 in the out-of-domain test set. Moreover, we observe that syntactic and semantic dependency direction match is an important factor in improving the results.


title: Precision Spectroscopy of Nitrous Oxide Isotopocules with a Cross-Dispersed Spectrometer and Mid-Infrared Frequency Comb

abstract: As a potent greenhouse gas and ozone depleting agent, nitrous oxide (N$_2$O) plays a critical role in the global climate. Effective mitigation relies on understanding global sources and sinks which can be supported through isotopic analysis. We present a cross-dispersed spectrometer, coupled with a mid-infrared frequency comb, capable of simultaneously monitoring all singly substituted, stable isotopic variants of N$_2$O. Rigorous evaluation of the instrument lineshape function and data treatment are discussed. Laboratory characterization of the spectrometer demonstrates sub-GHz spectral resolution and an average precision of $7.4\times10^{-6}$ for fractional isotopic abundance retrievals in 1 s.


title: Data and Representation for Turkish Natural Language Inference

abstract: Large annotated datasets in NLP are overwhelmingly in English. This is an obstacle to progress in other languages. Unfortunately, obtaining new annotated resources for each task in each language would be prohibitively expensive. At the same time, commercial machine translation systems are now robust. Can we leverage these systems to translate English-language datasets automatically? In this paper, we offer a positive response for natural language inference (NLI) in Turkish. We translated two large English NLI datasets into Turkish and had a team of experts validate their translation quality and fidelity to the original labels. Using these datasets, we address core issues of representation for Turkish NLI. We find that in-language embeddings are essential and that morphological parsing can be avoided where the training set is large. Finally, we show that models trained on our machine-translated datasets are successful on human-translated evaluation sets. We share all code, models, and data publicly.


title: Topological Flat Bands and Correlated States in Twisted Monolayer-Bilayer Graphene

abstract: Monolayer graphene placed with a twist on top of AB-stacked bilayer graphene hosts topological flat bands in a wide range of twist angles. The dispersion of these bands and gaps between them can be efficiently controlled by a perpendicular electric field, which induces topological transitions accompanied by changes of the Chern numbers. In the regime where the applied electric field induces gaps between the flat bands, we find a relatively uniform distribution of the Berry curvature. Consequently, interaction-induced valley- and/or spin-polarized states at integer filling factors are energetically favorable. In particular, we predict a quantum anomalous Hall state at filling factor $\nu=1$ for a range of twist angles $1^\circ<\theta <1.4^\circ$. Furthermore, to characterize the response of the system to magnetic field, we computed the Hofstadter butterfly and the Wannier plot, which can be used to probe the dispersion and topology of the flat bands in this material.


title: Quantum reservoir computing with a single nonlinear oscillator

abstract: Realizing the promise of quantum information processing remains a daunting task, given the omnipresence of noise and error. Adapting noise-resilient classical computing modalities to quantum mechanics may be a viable path towards near-term applications in the noisy intermediate-scale quantum era. Here, we propose continuous variable quantum reservoir computing in a single nonlinear oscillator. Through numerical simulation of our model we demonstrate quantum-classical performance improvement, and identify its likely source: the nonlinearity of quantum measurement. Beyond quantum reservoir computing, this result may impact the interpretation of results across quantum machine learning. We study how the performance of our quantum reservoir depends on Hilbert space dimension, how it is impacted by injected noise, and briefly comment on its experimental implementation. Our results show that quantum reservoir computing in a single nonlinear oscillator is an attractive modality for quantum computing on near-term hardware.


title: Can surface-transfer doping and UV irradiation during annealing improve shallow implanted Nitrogen-Vacancy centers in diamond?

abstract: It has been reported that conversion yield and coherence time of ion-implanted NV centers improve if the Fermi level is raised or lowered during the annealing step following implantation. Here we investigate whether surface transfer doping and surface charging, by UV light, can be harnessed to induce this effect. We analyze the coherence times and the yield of NV centers created by ion implantation and annealing, applying various conditions during annealing. Specifically, we study coating the diamond with nickel, palladium or aluminum oxide, to induce positive surface transfer doping, as well as annealing under UV illumination to trigger vacancy charging. The metal coated diamonds display a two times higher formation yield than the other samples. The coherence time $T_2$ varies by less than a factor of two between the investigated samples. Both effects are weaker than previous reports, suggesting that stronger modifications of the band structure are necessary to find a pronounced effect. UV irradiation has no effect on yield and $T_2$ times.


title: PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking

abstract: We propose the task of outline-conditioned story generation: given an outline as a set of phrases that describe key characters and events to appear in a story, the task is to generate a coherent narrative that is consistent with the provided outline. This task is challenging as the input only provides a rough sketch of the plot, and thus, models need to generate a story by interweaving the key points provided in the outline. This requires the model to keep track of the dynamic states of the latent plot, conditioning on the input outline while generating the full story. We present PlotMachines, a neural narrative model that learns to transform an outline into a coherent story by tracking the dynamic plot states. In addition, we enrich PlotMachines with high-level discourse structure so that the model can learn different writing styles corresponding to different parts of the narrative. Comprehensive experiments over three fiction and non-fiction datasets demonstrate that large-scale language models, such as GPT-2 and Grover, despite their impressive generation performance, are not sufficient in generating coherent narratives for the given outline, and dynamic plot state tracking is important for composing narratives with tighter, more consistent plots.


title: Manifestation of strong correlations in transport in ultra-clean SiGe/Si/SiGe quantum wells

abstract: We observe that in a strongly interacting two-dimensional electron system in ultra-clean SiGe/Si/SiGe quantum wells, the resistivity on the metallic side near the metal-insulator transition increases with decreasing temperature, reaches a maximum at some temperature, and then decreases by more than one order of magnitude. We scale the resistivity data in line with expectations for the transport of strongly correlated Fermi systems and find a nearly perfect agreement with theory over a wide range of electron densities.


title: Learning to Ask Screening Questions for Job Postings

abstract: At LinkedIn, we want to create economic opportunity for everyone in the global workforce. A critical aspect of this goal is matching jobs with qualified applicants. To improve hiring efficiency and reduce the need to manually screening each applicant, we develop a new product where recruiters can ask screening questions online so that they can filter qualified candidates easily. To add screening questions to all $20$M active jobs at LinkedIn, we propose a new task that aims to automatically generate screening questions for a given job posting. To solve the task of generating screening questions, we develop a two-stage deep learning model called Job2Questions, where we apply a deep learning model to detect intent from the text description, and then rank the detected intents by their importance based on other contextual features. Since this is a new product with no historical data, we employ deep transfer learning to train complex models with limited training data. We launched the screening question product and our AI models to LinkedIn users and observed significant impact in the job marketplace. During our online A/B test, we observed $+53.10\%$ screening question suggestion acceptance rate, $+22.17\%$ job coverage, $+190\%$ recruiter-applicant interaction, and $+11$ Net Promoter Score. In sum, the deployed Job2Questions model helps recruiters to find qualified applicants and job seekers to find jobs they are qualified for.


title: Coreset Clustering on Small Quantum Computers

abstract: Many quantum algorithms for machine learning require access to classical data in superposition. However, for many natural data sets and algorithms, the overhead required to load the data set in superposition can erase any potential quantum speedup over classical algorithms. Recent work by Harrow introduces a new paradigm in hybrid quantum-classical computing to address this issue, relying on coresets to minimize the data loading overhead of quantum algorithms. We investigate using this paradigm to perform $k$-means clustering on near-term quantum computers, by casting it as a QAOA optimization instance over a small coreset. We compare the performance of this approach to classical $k$-means clustering both numerically and experimentally on IBM Q hardware. We are able to find data sets where coresets work well relative to random sampling and where QAOA could potentially outperform standard $k$-means on a coreset. However, finding data sets where both coresets and QAOA work well--which is necessary for a quantum advantage over $k$-means on the entire data set--appears to be challenging.


title: Local State Space Analysis to Assist Partial Order Reduction

abstract: This paper presents an approach to more efficient partial order reduction for model checking concurrent systems. This approach utilizes a compositional reachability analysis to generate over-approximate local state transition models for all processes in a concurrent system where an independence relation and other useful information can be extracted. The extracted independence relation, compared to what can be obtained by statically analyzing the system descriptions, is more precise and refined, therefore leads to more efficient partial order reduction. This approach is demonstrated on a set of concurrent system examples. Significantly higher reduction in state space has been observed in several cases compared to what can be obtained using SPIN.


title: Effects of immersed moonlets in the ring arc particles of Saturn

abstract: Ring arcs are the result of particles in corotation resonances with nearby satellites. Arcs are present in Saturn and Neptune systems, in Saturn they are also associated with small satellites immersed on them. The satellite Aegaeon is immersed in the G~ring arc, and the satellites Anthe and Methone are embedded in arcs named after them. Since most of the population of the arcs is formed by $\mu$m-sized particles the dissipative effects, such as the plasma drag and the solar radiation force, decrease the lifetime of the arcs. We analysed the effects of the immersed satellites on these arcs by computing the mass production rate and the perturbation caused by them in the arc particles. By comparing the lifetime of the particles and the mass production rate we concluded that Aegaeon, Anthe and Methone did not act as sources for their arcs. We took a step further by analysing a hypothetical scenario formed by an immersed moonlet of different sizes. As a result we found that regardless the size of the hypothetical moonlet (from about 0.10 km to 4.0 km) these moonlets will not act as a source. These arcs are temporary structures and they will disappear in a very short period of time.


title: Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

abstract: Following a navigation instruction such as 'Walk down the stairs and stop at the brown sofa' requires embodied AI agents to ground scene elements referenced via language (e.g. 'stairs') to visual content in the environment (pixels corresponding to 'stairs'). We ask the following question -- can we leverage abundant 'disembodied' web-scraped vision-and-language corpora (e.g. Conceptual Captions) to learn visual groundings (what do 'stairs' look like?) that improve performance on a relatively data-starved embodied perception task (Vision-and-Language Navigation)? Specifically, we develop VLN-BERT, a visiolinguistic transformer-based model for scoring the compatibility between an instruction ('...stop at the brown sofa') and a sequence of panoramic RGB images captured by the agent. We demonstrate that pretraining VLN-BERT on image-text pairs from the web before fine-tuning on embodied path-instruction data significantly improves performance on VLN -- outperforming the prior state-of-the-art in the fully-observed setting by 4 absolute percentage points on success rate. Ablations of our pretraining curriculum show each stage to be impactful -- with their combination resulting in further positive synergistic effects.


title: Fact or Fiction: Verifying Scientific Claims

abstract: We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that SUPPORTS or REFUTES a given scientific claim, and to identify rationales justifying each decision. To study this task, we construct SciFact, a dataset of 1.4K expert-written scientific claims paired with evidence-containing abstracts annotated with labels and rationales. We develop baseline models for SciFact, and demonstrate that simple domain adaptation techniques substantially improve performance compared to models trained on Wikipedia or political news. We show that our system is able to verify claims related to COVID-19 by identifying evidence from the CORD-19 corpus. Our experiments indicate that SciFact will provide a challenging testbed for the development of new systems designed to retrieve and reason over corpora containing specialized domain knowledge. Data and code for this new task are publicly available at https://github.com/allenai/scifact. A leaderboard and COVID-19 fact-checking demo are available at https://scifact.apps.allenai.org.


title: Investigating Transferability in Pretrained Language Models

abstract: How does language model pretraining help transfer learning? We consider a simple ablation technique for determining the impact of each pretrained layer on transfer task performance. This method, partial reinitialization, involves replacing different layers of a pretrained model with random weights, then finetuning the entire model on the transfer task and observing the change in performance. This technique reveals that in BERT, layers with high probing performance on downstream GLUE tasks are neither necessary nor sufficient for high accuracy on those tasks. Furthermore, the benefit of using pretrained parameters for a layer varies dramatically with finetuning dataset size: parameters that provide tremendous performance improvement when data is plentiful may provide negligible benefits in data-scarce settings. These results reveal the complexity of the transfer learning process, highlighting the limitations of methods that operate on frozen models or single data samples.


title: The Three Young Nuclear Super Star Clusters in NGC 5253

abstract: The blue compact dwarf galaxy NGC 5253 hosts a very young central starburst. The center contains intense radio thermal emission from a massive ultracompact H II region (or "supernebula") and two massive and very young super star clusters (SSCs), which are seen at optical and infrared wavelengths. The spatial correspondence between these three objects over an area of < 0.5 arcsec is very uncertain, and it is usually assumed that one of the optically-detected SSCs coincides with the supernebula. Using the Gaia Data Release 2 catalog, we improve the absolute astrometry of Hubble Space Telescope ultraviolet, optical and infrared images by a factor of ~10 and match them to the radio observations with an accuracy of 10-20 mas. We find that there are 3 SSCs at the center of NGC 5253. At optical wavelengths, the two SSCs lie either side of the supernebula, which coincides with a highly obscured region. In the infrared, all 3 SSCs are seen with the supernebula dominating at the longest wavelengths. We examine the properties of the SSCs, which have ages of ~ 1 Myr, are very compact (<0.6 pc) and separated by projected distances of only 1.5 and 5.8 pc. It seems likely that they will merge and may form the building blocks for nuclear star clusters.


title: Strictly nef Bundles

abstract: In this short note we will show that every homogeneous strictly nef vector bundle on a complex flag variety is ample. Following this, we consider whether ampleness of a bundle on an abelian variety can be tested on curves.


title: Multi-fixed point numerical conformal bootstrap: a case study with structured global symmetry

abstract: In large part, the future utility of modern numerical conformal bootstrap depends on its ability to accurately predict the existence of hitherto unknown non-trivial conformal field theories (CFTs). Here we investigate the extent to which this is possible in the case where the global symmetry group has a product structure. We do this by testing for signatures of fixed points using a mixed-correlator bootstrap calculation with a minimal set of input assumptions. This 'semi-blind' approach contrasts with other approaches for probing more complicated groups, which 'target' known theories with additional spectral assumptions or use the saturation of the single-correlator bootstrap bound as a starting point. As a case study, we select the space of CFTs with product-group symmetry $O(15)\otimes{O}(3)$ in $d=3$ dimensions. On the assumption that there is only one relevant scalar ($\ell=0$) singlet operator in the theory, we find a single 'allowed' region in our chosen space of scaling dimensions. The scaling dimensions corresponding to two known large-$N$ critical theories, the Heisenberg and the chiral ones, lie on or very near the boundary of this region. The large-$N$ antichiral point lies well outside the 'allowed' region, which is consistent with the expectation that the antichiral theory is unstable, and thus has an additional relevant scalar singlet operator. We also find a sharp kink in the boundary of the 'allowed' region at values of the scaling dimensions that do not correspond to the $(N,M)=(15,3)$ instance of any large-$N$-predicted $O(N) \otimes O(M)$ critical theory.

categories: hep-th cond-mat.stat-mech math-ph math.MP


title: Paraphrasing vs Coreferring: Two Sides of the Same Coin

abstract: We study the potential synergy between two different NLP tasks, both confronting predicate lexical variability: identifying predicate paraphrases, and event coreference resolution. First, we used annotations from an event coreference dataset as distant supervision to re-score heuristically-extracted predicate paraphrases. The new scoring gained more than 18 points in average precision upon their ranking by the original scoring method. Then, we used the same re-ranking features as additional inputs to a state-of-the-art event coreference resolution model, which yielded modest but consistent improvements to the model's performance. The results suggest a promising direction to leverage data and models for each of the tasks to the benefit of the other.


title: The Brute-Force Search for Planet Nine

abstract: A recent proposal for the detection of a hypothetical gravitating body 500 AU from the Sun (termed Planet 9) calls for a fleet of near-relativistic spacecraft, equipped with high-precision clocks, to be sent to a region where the object is suspected to be. We show that the technological constraints of such a mission can be relaxed somewhat, while improving the sensitivity: high-precision clocks can be avoided when the transverse displacement induced by Planet 9 is measurable with Earth-based, or near-Earth, telescopes. Furthermore, we note that in the absence of Planet 9, these spacecraft still yield useful data by mapping gravitational perturbations in the outer parts of the solar system.


title: Superconductivity in Weyl semimetals in a strong pseudomagnetic field

abstract: The superconducting s-wave state in Weyl semimetals in a strong strain-induced pseudomagnetic field is investigated in a model with local four-fermion interaction. It is found that only the inter-node pairing is possible in the lowest pseudo-Landau level approximation. Unlike the case of the lowest Landau level in a conventional magnetic field, the corresponding gap equation has only a trivial solution. Nevertheless, superconductivity can be induced via the proximity effect with a usual s-wave spin-singlet superconductor. Since a pseudomagnetic field is present necessarily at the surface of a Weyl semimetal, the proximity effect is strongly affected by the pseudomagnetic field. The analysis of such an effect showed that while no gap is opened in the spectrum, the degeneracy of energy levels is lifted. The unique character of the proximity effect in Weyl semimetals can be probed via the density of states, the spectral function, and the tunneling current. The density of states does not vanish at small energies and scales linearly with the pseudomagnetic field strength. This scaling is manifested also in the tunneling current.


title: Phase diagram and optimal control for n-tupling discrete time crystal

abstract: A remarkable consequence of spontaneously breaking the time translational symmetry in a system, is the emergence of time crystals. In periodically driven systems, discrete time crystals (DTC) can be realized which have a periodicity that is n times the driving period. However, all of the experimental observations have been performed for period-doubling and period-tripling discrete time crystals. Novel physics can arise by simulating many-body physics in the time domain, which would require a genuine realisation of the n-tupling DTC. A system of ultra-cold bosonic atoms bouncing resonantly on an oscillating mirror is one of the models that can realise large period DTC. The preparation of DTC demands control in creating the initial distribution of the ultra-cold bosonic atoms along with the mirror frequency. In this work, we demonstrate that such DTC is robust against perturbations to the initial distribution of atoms. We show how Bayesian methods can be used to enhance control in the preparation of the initial state as well as to efficiently calculate the phase diagram for such a model. Moreover, we examine the stability of DTCs by analyzing quantum many-body fluctuations and show that they do not reveal signatures of heating.

categories: cond-mat.quant-gas cond-mat.mes-hall physics.atom-ph quant-ph


title: Control, Generate, Augment: A Scalable Framework for Multi-Attribute Text Generation

abstract: We introduce CGA, a conditional VAE architecture, to control, generate, and augment text. CGA is able to generate natural English sentences controlling multiple semantic and syntactic attributes by combining adversarial learning with a context-aware loss and a cyclical word dropout routine. We demonstrate the value of the individual model components in an ablation study. The scalability of our approach is ensured through a single discriminator, independently of the number of attributes. We show high quality, diversity and attribute control in the generated sentences through a series of automatic and human assessments. As the main application of our work, we test the potential of this new NLG model in a data augmentation scenario. In a downstream NLP task, the sentences generated by our CGA model show significant improvements over a strong baseline, and a classification performance often comparable to adding same amount of additional real data.


title: Precise Tracking of Cosmic Muons using Time over Threshold property of NINO ASICs

abstract: This work reports a cost-effective, simple front-end readout and DAQ of a RPC-based muon scattering tomography system under construction. The Time-over-threshold property of NINO ASICs has been exploited to achieve precise tracking by extraction of position information. The use of a low-cost FPGA for event selection and TOT measurement has been demonstrated for a prototype RPC which has been triggered by a cosmic ray hodoscope of three plastic scintillators. The relation between input pulse width and TOT has been established by analyzing the waveforms of the RPC signals. The TOT profile at different working voltages has been obtained by the FPGA and it has been fitted with the Gaussian distribution. Its standard deviation represents an estimate of the tracking precision.


title: Compact object scalarization with general relativity as a cosmic attractor

abstract: We demonstrate that there are theories that exhibit spontaneous scalarization in the strong gravity regime while having General Relativity with a constant scalar as a cosmological attractor. We identify the minimal model that has this property and discuss its extensions.


title: Compound Secure Groupcast: Key Assignment for Selected Broadcasting

abstract: The compound secure groupcast problem is considered, where the key variables at $K$ receivers are designed so that a transmitter can securely groupcast a message to any $N$ out of the $K$ receivers through a noiseless broadcast channel. The metric is the information theoretic tradeoff between key storage $\alpha$, i.e., the number of bits of the key variable per message bit, and broadcast bandwidth $\beta$, i.e., the number of bits of the broadcast information per message bit. We have three main results. First, when broadcast bandwidth is minimized, i.e., when $\beta = 1$, we show that the minimum key storage is $\alpha = N$. Second, when key storage is minimized, i.e., when $\alpha = 1$, we show that broadcast bandwidth $\beta = \min(N, K-N+1)$ is achievable and is optimal (minimum) if $N=2$ or $K-1$. Third, when $N=2$, the optimal key storage and broadcast bandwidth tradeoff is characterized as $\alpha+\beta \geq 3, \alpha \geq 1, \beta \geq 1$.


title: Advancing Research on Unconscious Priming: When can Scientists Claim an Indirect Task Advantage?

abstract: Current literature holds that many cognitive functions can be performed outside consciousness. Evidence for this view comes from unconscious priming. In a typical experiment, visual stimuli are masked, such that participants are close to chance when directly asked to which of two categories the stimuli belong. This close-to-zero sensitivity is seen as evidence that participants cannot consciously report the category of the masked stimuli. Nevertheless, the category of the masked stimuli can indirectly affect responses to other stimuli (e.g., reaction times or brain activity). Priming is therefore seen as evidence that there is still some (albeit unconscious) sensitivity to the stimulus categories, thereby indicating processing outside consciousness. Although this "standard reasoning of unconscious priming" has been used in many studies, we show that it is flawed: Sensitivities are not calculated appropriately, hereby creating the wrong impression that priming indicated better sensitivity than the close-to-zero sensitivity of the direct discrimination. We describe the appropriate way to determine sensitivities, replicate the behavioral part of a landmark study, develop a method to estimate sensitivities for published studies from reported summary statistics, and use this method to reanalyze 15 highly influential studies. Results show that the interpretations of many studies need to be changed and that a community effort to reassess the vast literature on unconscious priming is needed. This process will allow scientists to learn more about the true boundary conditions of unconscious priming, thereby advancing the scientific understanding of consciousness.


title: Constraining LQG Graph with Light Surfaces: Properties of BH Thermodynamics for Mini-Super-Space, Semi-Classical Polymeric BH

abstract: This work discusses observational evidences of quantum effects on geometry in a black hole (BH) astrophysical context. We study properties of a family of loop quantum corrected regular BH solutions and their horizons, focusing on the geometry symmetries. We explore a recent model where the geometry is determined by a metric quantum modification outside the horizon: a regular static spherical solution of minisuperspace BH metric with Loop Quantum Gravity (LQG) corrections. The solutions are characterized by some polymeric functions and the emergence of a singularity in the limiting Schwarzschild geometry. We discuss particular metric solutions for similar properties of structures, the metric Killing bundles (metric bundles MBs), related to the BH horizons properties. A comparison with the Reissner-Nordstrom geometry and the Kerr geometry, similar for their respective MBs properties is done. The analysis provides a way to recognize these geometries and detect phenomenological evidence of LQG origin by the detection of stationary/static observers and the properties of lightlike orbits with the analysis of the conformal invariant MBs related to the (local) causal structure. This approach could be applied in other quantum corrected BH solutions constraining the characteristics of the underlining LQG-graph, as the minimal loop area, through photons detection. Light surfaces associated with a diversified range of BH phenomenology and grounding MB definition provide a research channel of possible astrophysical evidence. The BHs thermodynamic characteristics are studied, luminosity, surface gravity, and temperature. Ultimately the application of this method to this spherically symmetric approximate solution provides a way to clarify some formal aspects of MBs in the presence of static spherical symmetric spacetimes.


title: A Study in Improving BLEU Reference Coverage with Diverse Automatic Paraphrasing

abstract: We investigate a long-perceived shortcoming in the typical use of BLEU: its reliance on a single reference. Using modern neural paraphrasing techniques, we study whether automatically generating additional diverse references can provide better coverage of the space of valid translations and thereby improve its correlation with human judgments. Our experiments on the into-English language directions of the WMT19 metrics task (at both the system and sentence level) show that using paraphrased references does generally improve BLEU, and when it does, the more diverse the better. However, we also show that better results could be achieved if those paraphrases were to specifically target the parts of the space most relevant to the MT outputs being evaluated. Moreover, the gains remain slight even when human paraphrases are used, suggesting inherent limitations to BLEU's capacity to correctly exploit multiple references. Surprisingly, we also find that adequacy appears to be less important, as shown by the high results of a strong sampling approach, which even beats human paraphrases when used with sentence-level BLEU.


abstract: Learning from visual observations is a fundamental yet challenging problem in Reinforcement Learning (RL). Although algorithmic advances combined with convolutional neural networks have proved to be a recipe for success, current methods are still lacking on two fronts: (a) data-efficiency of learning and (b) generalization to new environments. To this end, we present Reinforcement Learning with Augmented Data (RAD), a simple plug-and-play module that can enhance most RL algorithms. We perform the first extensive study of general data augmentations for RL on both pixel-based and state-based inputs, and introduce two new data augmentations - random translate and random amplitude scale. We show that augmentations such as random translate, crop, color jitter, patch cutout, random convolutions, and amplitude scale can enable simple RL algorithms to outperform complex state-of-the-art methods across common benchmarks. RAD sets a new state-of-the-art in terms of data-efficiency and final performance on the DeepMind Control Suite benchmark for pixel-based control as well as OpenAI Gym benchmark for state-based control. We further demonstrate that RAD significantly improves test-time generalization over existing methods on several OpenAI ProcGen benchmarks. Our RAD module and training code are available at https://www.github.com/MishaLaskin/rad.


title: Majorana Zero Modes in Nanowires with Combined Triangular and Hexagonal Geometry

abstract: The effects of geometry on the hosting of Majorana zero modes are explored in core-shell nanowires with a hexagonal core and a triangular shell, and vice versa. The energy interval separating electronic states localized in the corners from states localized on the sides of the shell is shown to be larger for a triangular nanowire with a hexagonal core, than a triangular one. We build the topological phase diagram for both cases and compare them to earlier work on prismatic nanowires with the same core and shell geometry. We suggest that a dual core nanowire is needed to allow for a braiding operation of Majorana zero modes at the nanowire end plane.


title: How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking

abstract: Attribution methods assess the contribution of inputs to the model prediction. One way to do so is erasure: a subset of inputs is considered irrelevant if it can be removed without affecting the prediction. Though conceptually simple, erasure's objective is intractable and approximate search remains expensive with modern deep NLP models. Erasure is also susceptible to the hindsight bias: the fact that an input can be dropped does not mean that the model `knows' it can be dropped. The resulting pruning is over-aggressive and does not reflect how the model arrives at the prediction. To deal with these challenges, we introduce Differentiable Masking. DiffMask learns to mask-out subsets of the input while maintaining differentiability. The decision to include or disregard an input token is made with a simple model based on intermediate hidden layers of the analyzed model. First, this makes the approach efficient because we predict rather than search. Second, as with probing classifiers, this reveals what the network `knows' at the corresponding layers. This lets us not only plot attribution heatmaps but also analyze how decisions are formed across network layers. We use DiffMask to study BERT models on sentiment classification and question answering.


title: A more secure IPv6 neighborhood process

abstract: The process of neighborhood establishment in an IPv6 network is made out through the NDP (Neighbor Discovery Protocol). Using ICMPv6 messages (NS - Neighbor Solicitation and NA - Neighbor Advertisement) which contains the IP address to be resolved, is exposed during the exchange of messages, making communication vulnerable to various types of attacks. This paper presents a proposal for a safer neighborhood establishment using the DH and HMAC algorithms. Experiments were performed in virtualized environments with the objective of analyzing the efficiency of the modification proposed in the NDP.


title: Extreme statistics of anomalous subdiffusion following a fractional Fokker-Planck equation: Subdiffusion is faster than normal diffusion

abstract: Anomalous subdiffusion characterizes transport in diverse physical systems and is especially prevalent inside biological cells. In cell biology, the prevailing model for chemical activation rates has recently changed from the first passage time (FPT) of a single searcher to the FPT of the fastest searcher out of many searchers to reach a target, which is called an extreme statistic or extreme FPT. In this paper, we investigate extreme statistics of searchers which move by anomalous subdiffusion. We model subdiffusion by a fractional Fokker-Planck equation involving the Riemann-Liouville fractional derivative. We prove an explicit and very general formula for every moment of subdiffusive extreme FPTs and approximate their full probability distribution. While the mean FPT of a single subdiffusive searcher is infinite, the fastest subdiffusive searcher out of many subdiffusive searchers typically has a finite mean FPT. In fact, we prove the counterintuitive result that extreme FPTs of subdiffusion are faster than extreme FPTs of normal diffusion. Mathematically, we employ a stochastic representation involving a random time change of a standard Ito drift-diffusion according to the trajectory of the first crossing time inverse of a Levy subordinator. A key step in our analysis is generalizing Varadhan's formula from large deviation theory to the case of subdiffusion, which yields the short-time distribution of subdiffusion in terms of a certain geodesic distance.


title: Using Decision Diagrams to Compactly Represent the State Space for Explicit Model Checking

abstract: The enormous number of states reachable during explicit model checking is the main bottleneck for scalability. This paper presents approaches of using decision diagrams to represent very large state space compactly and efficiently. This is possible for asynchronous systems as two system states connected by a transition often share many same local portions. Using decision diagrams can significantly reduce memory demand by not using memory to store the redundant information among different states. This paper considers multi-value decision diagrams for this purpose. Additionally, a technique to reduce the runtime overhead of using these diagrams is also described. Experimental results and comparison with the state compression method as implemented in the model checker SPIN show that the approaches presented in this paper are memory efficient for storing large state space with acceptable runtime overhead.


title: Segatron: Segment-Aware Transformer for Language Modeling and Understanding

abstract: Transformers are powerful for sequence modeling. Nearly all state-of-the-art language models and pre-trained language models are based on the Transformer architecture. However, it distinguishes sequential tokens only with the token position index. We hypothesize that better contextual representations can be generated from the Transformer with richer positional information. To verify this, we propose a segment-aware Transformer (Segatron), by replacing the original token position encoding with a combined position encoding of paragraph, sentence, and token. We first introduce the segment-aware mechanism to Transformer-XL, which is a popular Transformer-based language model with memory extension and relative position encoding. We find that our method can further improve the Transformer-XL base model and large model, achieving 17.1 perplexity on the WikiText-103 dataset. We further investigate the pre-training masked language modeling task with Segatron. Experimental results show that BERT pre-trained with Segatron (SegaBERT) can outperform BERT with vanilla Transformer on various NLP tasks, and outperforms RoBERTa on zero-shot sentence representation learning.


title: Idempotent systems

abstract: In this paper we introduce the notion of an idempotent system. This linear algebraic object is motivated by the structure of an association scheme. We focus on a family of idempotent systems, said to be symmetric. A symmetric idempotent system is an abstraction of the primary module for the subconstituent algebra of a symmetric association scheme. We describe the symmetric idempotent systems in detail. We also consider a class of symmetric idempotent systems, said to be $P$-polynomial and $Q$-polynomial. In the topic of orthogonal polynomials there is an object called a Leonard system. We show that a Leonard system is essentially the same thing as a symmetric idempotent system that is $P$-polynomial and $Q$-polynomial.


title: BFN Springer Theory

abstract: Given a representation N of a reductive group G, Braverman-Finkelberg-Nakajima have defined a remarkable Poisson variety called the Coulomb branch. Their construction of this space was motivated by considerations from 3d gauge theories and symplectic duality. The coordinate ring of this Coulomb branch is defined as a convolution algebra, using a vector bundle over the affine Grassmannian of G. This vector bundle over the affine Grassmannian maps to the space of loops in the representation N. We study the fibres of this maps, which live in the affine Grassmannian. We use these BFN Springer fibres to construct modules for (quantized) Coulomb branch algebras. These modules naturally correspond to boundary conditions for the corresponding gauge theory. We use our construction to partially prove a conjecture of Baumann-Kamnitzer-Knutson and give evidence for conjectures of Hikita, Nakajima, and Kamnitzer-McBreen-Proudfoot. We also prove a relation between BFN Springer fibres and quasimap spaces.


title: A Matter of Framing: The Impact of Linguistic Formalism on Probing Results

abstract: Deep pre-trained contextualized encoders like BERT (Delvin et al., 2019) demonstrate remarkable performance on a range of downstream tasks. A recent line of research in probing investigates the linguistic knowledge implicitly learned by these models during pre-training. While most work in probing operates on the task level, linguistic tasks are rarely uniform and can be represented in a variety of formalisms. Any linguistics-based probing study thereby inevitably commits to the formalism used to annotate the underlying data. Can the choice of formalism affect probing results? To investigate, we conduct an in-depth cross-formalism layer probing study in role semantics. We find linguistically meaningful differences in the encoding of semantic role- and proto-role information by BERT depending on the formalism and demonstrate that layer probing can detect subtle differences between the implementations of the same linguistic formalism. Our results suggest that linguistic formalism is an important dimension in probing studies, along with the commonly used cross-task and cross-lingual experimental settings.


title: Exploration of Hamiltonian formulations of baroclinic hydrodynamics

abstract: A neutron star in a compact binary is expected to be well-approximated by a barotropic flow during the inspiral phase. During the merger phase, where tidal disruption and shock-heating occur, a baroclinic description is needed instead. In the barotropic case, a Hamiltonian formulation potentially offers unique benefits for numerical relativity simulations of the inspiral phase, including highly accurate conservation of circulation and superconvergence of the fluid variables, and is actively being explored. In this work, we investigate the viability of a Hamiltonian formulation in the baroclinic case. At odds with the barotropic case, this formulation is non-conservative, yet it can be treated well with approximate Riemann solver algorithms since the non-conservative terms vanish across genuinely nonlinear fields. Nonetheless, using numerical 1-dimensional shock tube tests we find that the weak solutions of the Hamiltonian system differ from the standard ones obtained by enforcing conservation of rest mass density, momentum density, and energy density across discontinuities. We also show that barotropic Hamiltonian formulations can admit shockwaves at fluid-vacuum interfaces, which may be related to the unstable behavior of stellar surfaces observed in past numerical tests. In light of the unphysical weak solutions, we expect that in future implementations of the Hamiltonian formulation of hydrodynamics in numerical relativity it will be necessary to use an explicitly barotropic formulation during the inspiral phase, and then switch to a robust baroclinic formulation prior to merger.


title: Don't Use English Dev: On the Zero-Shot Cross-Lingual Evaluation of Contextual Embeddings

abstract: Multilingual contextual embeddings have demonstrated state-of-the-art performance in zero-shot cross-lingual transfer learning, where multilingual BERT is fine-tuned on one source language and evaluated on a different target language. However, published results for mBERT zero-shot accuracy vary as much as 17 points on the MLDoc classification task across four papers. We show that the standard practice of using English dev accuracy for model selection in the zero-shot setting makes it difficult to obtain reproducible results on the MLDoc and XNLI tasks. English dev accuracy is often uncorrelated (or even anti-correlated) with target language accuracy, and zero-shot performance varies greatly at different points in the same fine-tuning run and between different fine-tuning runs. These reproducibility issues are also present for other tasks with different pre-trained embeddings (e.g., MLQA with XLM-R). We recommend providing oracle scores alongside zero-shot results: still fine-tune using English data, but choose a checkpoint with the target dev set. Reporting this upper bound makes results more consistent by avoiding arbitrarily bad checkpoints.


title: Conserved currents in the Palatini formulation of general relativity

abstract: We derive the expressions for the local, on-shell closed co-dimension 2 forms in the Palatini formulation of general relativity and explicitly show their on-shell equivalence to those of the metric formulation. When compared to other first order formulations, two subtleties have to be addressed during the construction: off-shell non-metricity and the fact that the transformation of the connection under infinitesimal diffeomorphisms involves second order derivatives of the associated vector fields.


title: Word Rotator's Distance

abstract: A key principle in assessing textual similarity is measuring the degree of semantic overlap between two texts by considering the word alignment. Such alignment-based approaches are intuitive and interpretable; however, they are empirically inferior to the simple cosine similarity between general-purpose sentence vectors. To address this issue, we focus on and demonstrate the fact that the norm of word vectors is a good proxy for word importance, and their angle is a good proxy for word similarity. Alignment-based approaches do not distinguish them, whereas sentence-vector approaches automatically use the norm as the word importance. Accordingly, we propose a method that first decouples word vectors into their norm and direction, and then computes alignment-based similarity using earth mover's distance (i.e., optimal transport cost), which we refer to as word rotator's distance. Besides, we find how to grow the norm and direction of word vectors (vector converter), which is a new systematic approach derived from sentence-vector estimation methods. On several textual similarity datasets, the combination of these simple proposed methods outperformed not only alignment-based approaches but also strong baselines. The source code is available at https://github.com/eumesy/wrd


title: CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization

abstract: Deep learning's great success motivates many practitioners and students to learn about this exciting technology. However, it is often challenging for beginners to take their first step due to the complexity of understanding and applying deep learning. We present CNN Explainer, an interactive visualization tool designed for non-experts to learn and examine convolutional neural networks (CNNs), a foundational deep learning model architecture. Our tool addresses key challenges that novices face while learning about CNNs, which we identify from interviews with instructors and a survey with past students. CNN Explainer tightly integrates a model overview that summarizes a CNN's structure, and on-demand, dynamic visual explanation views that help users understand the underlying components of CNNs. Through smooth transitions across levels of abstraction, our tool enables users to inspect the interplay between low-level mathematical operations and high-level model structures. A qualitative user study shows that CNN Explainer helps users more easily understand the inner workings of CNNs, and is engaging and enjoyable to use. We also derive design lessons from our study. Developed using modern web technologies, CNN Explainer runs locally in users' web browsers without the need for installation or specialized hardware, broadening the public's education access to modern deep learning techniques.


title: Solving Parabolic Moving Interface Problems with Dynamical Immersed Spaces on Unfitted Meshes: Fully Discrete Analysis

abstract: Immersed finite element (IFE) methods are a group of long-existing numerical methods for solving interface problems on unfitted meshes. A core argument of the methods is to avoid mesh regeneration procedure when solving moving interface problems. Despite the various applications in moving interface problems, a complete theoretical study on the convergence behavior is still missing. This research is devoted to close the gap between numerical experiments and theory. We present the first fully discrete analysis including the stability and optimal error estimates for a backward Euler IFE method for solving parabolic moving interface problems. Numerical results are also presented to validate the analysis.


title: Template Guided Text Generation for Task-Oriented Dialogue

abstract: Virtual assistants such as Google Assistant, Amazon Alexa, and Apple Siri enable users to interact with a large number of services and APIs on the web using natural language. In this work, we investigate two methods for Natural Language Generation (NLG) using a single domain-independent model across a large number of APIs. First, we propose a schema-guided approach which conditions the generation on a schema describing the API in natural language. Our second method investigates the use of a small number of templates, growing linearly in number of slots, to convey the semantics of the API. To generate utterances for an arbitrary slot combination, a few simple templates are first concatenated to give a semantically correct, but possibly incoherent and ungrammatical utterance. A pre-trained language model is subsequently employed to rewrite it into coherent, natural sounding text. Through automatic metrics and human evaluation, we show that our method improves over strong baselines, is robust to out-of-domain inputs and shows improved sample efficiency.


title: Trifectas for $T_N$ in 5d

abstract: The trinions $T_N$ are a class of 5d $\mathcal{N}=1$ superconformal field theories (SCFTs) realized as M-theory on $\mathbb{C}^3/\mathbb{Z}_N \times \mathbb{Z}_N$. We apply to $T_N$, as well as closely-related SCFTs that are obtained by mass deformations, a multitude of recently developed approaches to studying 5d SCFTs and their IR gauge theory descriptions. Thereby we provide a complete picture of the theories both on the Coulomb branch and Higgs branch, from various geometric points of view - toric and gluing of compact surfaces as well as combined fiber diagrams - to magnetic quivers and Hasse diagrams.


title: Lexical Semantic Recognition

abstract: In lexical semantics, full-sentence segmentation and segment labeling of various phenomena are generally treated separately, despite their interdependence. We hypothesize that a unified lexical semantic recognition task is an effective way to encapsulate previously disparate styles of annotation, including multiword expression identification / classification and supersense tagging. Using the STREUSLE corpus, we train a neural CRF sequence tagger and evaluate its performance along various axes of annotation. As the label set generalizes that of previous tasks (PARSEME, DiMSUM), we additionally evaluate how well the model generalizes to those test sets, finding that it approaches or surpasses existing models despite training only on STREUSLE. Our work also establishes baseline models and evaluation metrics for integrated and accurate modeling of lexical semantics, facilitating future work in this area.


title: From communication complexity to an entanglement spread area law in the ground state of gapped local Hamiltonians

abstract: In this work, we make a connection between two seemingly different problems. The first problem involves characterizing the properties of entanglement in the ground state of gapped local Hamiltonians, which is a central topic in quantum many-body physics. The second problem is on the quantum communication complexity of testing bipartite states with EPR assistance, a well-known question in quantum information theory. We construct a communication protocol for testing (or measuring) the ground state and use its communication complexity to reveal a new structural property for the ground state entanglement. This property, known as the entanglement spread, roughly measures the ratio between the largest and the smallest Schmidt coefficients across a cut in the ground state. Our main result shows that gapped ground states possess limited entanglement spread across any cut, exhibiting an "area law" behavior. Our result quite generally applies to any interaction graph with an improved bound for the special case of lattices. This entanglement spread area law includes interaction graphs constructed in [Aharonov et al., FOCS'14] that violate a generalized area law for the entanglement entropy. Our construction also provides evidence for a conjecture in physics by Li and Haldane on the entanglement spectrum of lattice Hamiltonians [Li and Haldane, PRL'08]. On the technical side, we use recent advances in Hamiltonian simulation algorithms along with quantum phase estimation to give a new construction for an approximate ground space projector (AGSP) over arbitrary interaction graphs.


title: Local quenches, bulk entanglement entropy and a unitary Page curve

abstract: Quantum corrections to the entanglement entropy of matter fields interacting with dynamical gravity have proven to be very important in the study of the black hole information problem. We consider a one-particle excited state of a massive scalar field infalling in a pure AdS$_3$ geometry and compute these corrections for bulk subregions anchored on the AdS boundary. In the dual CFT$_2$, the state is given by the insertion of a local primary operator and its evolution thereafter. We calculate the area and bulk entanglement entropy corrections at order $\mathcal{O}(N^0)$, both in AdS and its CFT dual. The two calculations match, thus providing a non-trivial check of the FLM formula in a dynamical setting. Further, we observe that the bulk entanglement entropy follows a Page curve. We explain the precise sense in which our setup can be interpreted as a simple model of black hole evaporation and comment on the implications for the information problem.


title: TLDR: Extreme Summarization of Scientific Documents

abstract: We introduce TLDR generation, a new form of extreme summarization, for scientific papers. TLDR generation involves high source compression and requires expert background knowledge and understanding of complex domain-specific language. To facilitate study on this task, we introduce SciTLDR, a new multi-target dataset of 5.4K TLDRs over 3.2K papers. SciTLDR contains both author-written and expert-derived TLDRs, where the latter are collected using a novel annotation protocol that produces high-quality summaries while minimizing annotation burden. We propose CATTS, a simple yet effective learning strategy for generating TLDRs that exploits titles as an auxiliary training signal. CATTS improves upon strong baselines under both automated metrics and human evaluations. Data and code are publicly available at https://github.com/allenai/scitldr.


title: Does Data Augmentation Improve Generalization in NLP?

abstract: Neural models often exploit superficial features to achieve good performance, rather than deriving more general features. Overcoming this tendency is a central challenge in areas such as representation learning and ML fairness. Recent work has proposed using data augmentation, i.e., generating training examples where the superficial features fail, as a means of encouraging models to prefer the stronger features. We design a series of toy learning problems to test the hypothesis that data augmentation leads models to unlearn weaker heuristics, but not to learn stronger features in their place. We find partial support for this hypothesis: Data augmentation often hurts before it helps, and it is less effective when the preferred strong feature is much more difficult to extract than the competing weak feature.