title: Decompositions with atoms and molecules for variable exponent Triebel-Lizorkin-Morrey spaces

abstract: We continue the study of the variable exponent Morreyfied Triebel-Lizorkin spaces introduced in a previous paper. Here we give characterizations by means of atoms and molecules. We also show that in some cases the number of zero moments needed for molecules, in order that an infinite linear combination of them (with coefficients in a natural sequence space) converges in the space of tempered distributions, is much smaller than what is usually required. We also establish a Sobolev type theorem for related sequence spaces, which might have independent interest.


title: Revealing exciton masses and dielectric properties of monolayer semiconductors with high magnetic fields

abstract: In semiconductor physics, many essential optoelectronic material parameters can be experimentally revealed via optical spectroscopy in sufficiently large magnetic fields. For monolayer transition-metal dichalcogenide semiconductors, this field scale is substantial --tens of teslas or more-- due to heavy carrier masses and huge exciton binding energies. Here we report absorption spectroscopy of monolayer MoS$_2$, MoSe$_2$, MoTe$_2$, and WS$_2$ in very high magnetic fields to 91~T. We follow the diamagnetic shifts and valley Zeeman splittings of not only the exciton's $1s$ ground state but also its excited $2s$, $3s$, ..., $ns$ Rydberg states. This provides a direct experimental measure of the effective (reduced) exciton masses and dielectric properties. Exciton binding energies, exciton radii, and free-particle bandgaps are also determined. The measured exciton masses are heavier than theoretically predicted, especially for Mo-based monolayers. These results provide essential and quantitative parameters for the rational design of opto-electronic van der Waals heterostructures incorporating 2D semiconductors.


title: ShapeMask: Learning to Segment Novel Objects by Refining Shape Priors

abstract: Instance segmentation aims to detect and segment individual objects in a scene. Most existing methods rely on precise mask annotations of every category. However, it is difficult and costly to segment objects in novel categories because a large number of mask annotations is required. We introduce ShapeMask, which learns the intermediate concept of object shape to address the problem of generalization in instance segmentation to novel categories. ShapeMask starts with a bounding box detection and gradually refines it by first estimating the shape of the detected object through a collection of shape priors. Next, ShapeMask refines the coarse shape into an instance level mask by learning instance embeddings. The shape priors provide a strong cue for object-like prediction, and the instance embeddings model the instance specific appearance information. ShapeMask significantly outperforms the state-of-the-art by 6.4 and 3.8 AP when learning across categories, and obtains competitive performance in the fully supervised setting. It is also robust to inaccurate detections, decreased model capacity, and small training data. Moreover, it runs efficiently with 150ms inference time and trains within 11 hours on TPUs. With a larger backbone model, ShapeMask increases the gap with state-of-the-art to 9.4 and 6.2 AP across categories. Code will be released.


title: An Unsupervised Autoregressive Model for Speech Representation Learning

abstract: This paper proposes a novel unsupervised autoregressive neural model for learning generic speech representations. In contrast to other speech representation learning methods that aim to remove noise or speaker variabilities, ours is designed to preserve information for a wide range of downstream tasks. In addition, the proposed model does not require any phonetic or word boundary labels, allowing the model to benefit from large quantities of unlabeled data. Speech representations learned by our model significantly improve performance on both phone classification and speaker verification over the surface features and other supervised and unsupervised approaches. Further analysis shows that different levels of speech information are captured by our model at different layers. In particular, the lower layers tend to be more discriminative for speakers, while the upper layers provide more phonetic content.


title: HOList: An Environment for Machine Learning of Higher-Order Theorem Proving

abstract: We present an environment, benchmark, and deep learning driven automated theorem prover for higher-order logic. Higher-order interactive theorem provers enable the formalization of arbitrary mathematical theories and thereby present an interesting, open-ended challenge for deep learning. We provide an open-source framework based on the HOL Light theorem prover that can be used as a reinforcement learning environment. HOL Light comes with a broad coverage of basic mathematical theorems on calculus and the formal proof of the Kepler conjecture, from which we derive a challenging benchmark for automated reasoning. We also present a deep reinforcement learning driven automated theorem prover, DeepHOL, with strong initial results on this benchmark.


title: Metallic-Line Stars Identified from Low Resolution Spectra of LAMOST DR5

abstract: LAMOST DR5 released more than 200,000 low resolution spectra of early-type stars with S/N>50. Searching for metallic-line (Am) stars in such a large database and study of their statistical properties are presented in this paper. Six machine learning algorithms were experimented with using known Am spectra, and both the empirical criteria method(Hou et al. 2015) and the MKCLASS package(Gray et al. 2016) were also investigated. Comparing their performance, the random forest (RF) algorithm won, not only because RF has high successful rate but also it can derives and ranks features. Then the RF was applied to the early type stars of DR5, and 15,269 Am candidates were picked out. Manual identification was conducted based on the spectral features derived from the RF algorithm and verified by experts. After manual identification, 9,372 Am stars and 1,131 Ap candidates were compiled into a catalog. Statistical studies were conducted including temperature distribution, space distribution, and infrared photometry. The spectral types of Am stars are mainly between F0 and A4 with a peak around A7, which is similar to previous works. With the Gaia distances, we calculated the vertical height Z from the Galactic plane for each Am star. The distribution of Z suggests that the incidence rate of Am stars shows a descending gradient with increasing jZj. On the other hand, Am stars do not show a noteworthy pattern in the infrared band. As wavelength gets longer, the infrared excess of Am stars decreases, until little or no excess in W1 and W2 bands.


title: Accelerating AGN jets to parsec scales using general relativistic MHD simulations

abstract: Accreting black holes produce collimated outflows, or jets, that traverse many orders of magnitude in distance, accelerate to relativistic velocities, and collimate into tight opening angles. Of these, perhaps the least understood is jet collimation due to the interaction with the ambient medium. In order to investigate this interaction, we carried out axisymmetric general relativistic magnetohydrodynamic simulations of jets produced by a large accretion disc, spanning over 5 orders of magnitude in time and distance, at an unprecedented resolution. Supported by such a disc, the jet attains a parabolic shape, similar to the M87 galaxy jet, and the product of the Lorentz factor and the jet half-opening angle, $\gamma\theta\ll 1$, similar to values found from very long baseline interferometry (VLBI) observations of active galactic nuclei (AGN) jets; this suggests extended discs in AGN. We find that the interaction between the jet and the ambient medium leads to the development of pinch instabilities, which produce significant radial and lateral variability across the jet by converting magnetic and kinetic energy into heat. Thus pinched regions in the jet can be detectable as radiating hotspots and may provide an ideal site for particle acceleration. Pinching also causes gas from the ambient medium to become squeezed between magnetic field lines in the jet, leading to enhanced mass-loading of the jet and potentially contributing to the spine-sheath structure observed in AGN outflows.


title: An Analysis of Attention over Clinical Notes for Predictive Tasks

abstract: The shift to electronic medical records (EMRs) has engendered research into machine learning and natural language technologies to analyze patient records, and to predict from these clinical outcomes of interest. Two observations motivate our aims here. First, unstructured notes contained within EMR often contain key information, and hence should be exploited by models. Second, while strong predictive performance is important, interpretability of models is perhaps equally so for applications in this domain. Together, these points suggest that neural models for EMR may benefit from incorporation of attention over notes, which one may hope will both yield performance gains and afford transparency in predictions. In this work we perform experiments to explore this question using two EMR corpora and four different predictive tasks, that: (i) inclusion of attention mechanisms is critical for neural encoder modules that operate over notes fields in order to yield competitive performance, but, (ii) unfortunately, while these boost predictive performance, it is decidedly less clear whether they provide meaningful support for predictions.


title: A new method of proving a priori bounds for superlinear elliptic PDE

abstract: We describe a new method of proving a priori bounds for positive supersolutions and solutions of superlinear elliptic PDE, based on global weak Harnack inequalities and a quantitative Hopf lemma. Novel results based on the method include: (i) equations without a boundary condition on the whole boundary; (ii) equations with nonlinearities which do not have precise growth at infinity; (iii) systems of inequalities with opposite sign.


title: Spatial CUSUM for Signal Region Detection

abstract: Detecting weak clustered signal in spatial data is important but challenging in applications such as medical image and epidemiology. A more efficient detection algorithm can provide more precise early warning, and effectively reduce the decision risk and cost. To date, many methods have been developed to detect signals with spatial structures. However, most of the existing methods are either too conservative for weak signals or computationally too intensive. In this paper, we consider a novel method named Spatial CUSUM (SCUSUM), which employs the idea of the CUSUM procedure and false discovery rate controlling. We develop theoretical properties of the method which indicates that asymptotically SCUSUM can reach high classification accuracy. In the simulation study, we demonstrate that SCUSUM is sensitive to weak spatial signals. This new method is applied to a real fMRI dataset as illustration, and more irregular weak spatial signals are detected in the images compared to some existing methods, including the conventional FDR, FDR$_L$ and scan statistics.


title: Towards quantum-limited coherent detection of terahertz waves in charge-neutral graphene

abstract: Spectacular advances in heterodyne astronomy with both the Herschel Space Observatory and Stratospheric Observatory for Far Infrared Astronomy (SOFIA) have been largely due to breakthroughs in detector technology. In order to exploit the full capacity of future THz telescope space missions (e.g. Origins Space Telescope), new concepts of THz coherent receivers are needed, providing larger bandwidths and imaging capabilities with multi-pixel focal plane heterodyne arrays. Here we show that graphene, uniformly doped to the Dirac point, enables highly sensitive and wideband coherent detection of THz signals. With material resistance dominated by quantum localization, and thermal relaxation governed by electron diffusion, proof-of-concept graphene bolometers demonstrate a gain bandwidth of 8 GHz and a mixer noise temperature of 475 K, limited by residual thermal background in our setup. An optimized device will result in a mixer noise temperature as low as 36 K, with the gain bandwidth exceeding 20 GHz, and a Local Oscillator power lower than 100 pW. In conjunction with the emerging quantum-limited amplifiers at the intermediate frequency, our approach promises quantum-limited sensing in the THz domain, potentially surpassing superconducting technologies, particularly for large heterodyne arrays.


title: Average Sensitivity of Graph Algorithms

abstract: In modern applications of graphs algorithms, where the graphs of interest are large and dynamic, it is unrealistic to assume that an input representation contains the full information of a graph being studied. Hence, it is desirable to use algorithms that, even when only a (large) subgraph is available, output solutions that are close to the solutions output when the whole graph is available. We formalize this idea by introducing the notion of average sensitivity of graph algorithms, which is the average earth mover's distance between the output distributions of an algorithm on a graph and its subgraph obtained by removing an edge, where the average is over the edges removed and the distance between two outputs is the Hamming distance. In this work, we initiate a systematic study of average sensitivity. After deriving basic properties of average sensitivity such as composition, we provide efficient approximation algorithms with low average sensitivities for concrete graph problems, including the minimum spanning forest problem, the global minimum cut problem, the minimum $s$-$t$ cut problem, and the maximum matching problem. In addition, we prove that the average sensitivity of our global minimum cut algorithm is almost optimal, by showing a nearly matching lower bound. We also show that every algorithm for the 2-coloring problem has average sensitivity linear in the number of vertices. One of the main ideas involved in designing our algorithms with low average sensitivity is the following fact; if the presence of a vertex or an edge in the solution output by an algorithm can be decided locally, then the algorithm has a low average sensitivity, allowing us to reuse the analyses of known sublinear-time algorithms and local computation algorithms (LCAs). Using this connection, we show that every LCA for 2-coloring has linear query complexity, thereby answering an open question.


title: Attention Distillation for Learning Video Representations

abstract: We address the challenging problem of learning motion representations using deep models for video recognition. To this end, we make use of attention modules that learn to highlight regions in the video and aggregate features for recognition. Specifically, we propose to leverage output attention maps as a vehicle to transfer the learned representation from a motion (flow) network to an RGB network. We systematically study the design of attention modules, and develop a novel method for attention distillation. Our method is evaluated on major action benchmarks, and consistently improves the performance of the baseline RGB network by a significant margin. Moreover, we demonstrate that our attention maps can leverage motion cues in learning to identify the location of actions in video frames. We believe our method provides a step towards learning motion-aware representations in deep models. Our project page is available at https://aptx4869lm.github.io/AttentionDistillation/


title: Velocity jump in the crack propagation induced on a semi-crystalline polymer sheet by constant-speed stretching

abstract: It has long been known for elastomers that the velocity of crack propagation jumps as a function of strain. On the other hand, such a jump has not been reported in the literature for polymers which do not exhibit a rubbery plateau in the storage-modulus plot. Here, we report observation of jumps in crack propagation for semi-crystalline polymer sheets without the rubbery plateau, as a result of pulling the sheets at a constant speed. We discuss the advantages of this crack-propagation test under constant-speed stretching and provide physical interpretation of the velocity jump observed for non-elastomer sheets on the basis of a recently proposed theory for the velocity jump in crack propagation.


title: New constructions of unexpected hypersurfaces in $\mathbb{P}^n$

abstract: In the paper we present new examples of unexpected varieties. The research on unexpected varieties started with a paper of Cook II, Harbourne, Migliore and Nagel and was continued in the paper of Harbourne, Migliore, Nagel and Teitler. Here we present three ways of producing unexpected varieties that expand on what was previously known. In the paper of Harbourne, Migliore, Nagel and Teitler, cones on varieties of codimension 2 were used to produce unexpected hypersurfaces. Here we show that cones on positive dimensional varieties of codimension 2 or more almost always give unexpected hypersurfaces. For non-cones, almost all previous work has been for unexpected hypersurfaces coming from finite sets of points. Here we construct unexpected surfaces coming from lines in $\mathbb{P}^3$, and we generalize the construction using birational transformations to obtain unexpected hypersurfaces in higher dimensions.


title: (Non-)amenability of the Fourier algebra in the cb-multiplier norm

abstract: In view of the reason for withdrawal, we can no longer maintain the claim that A(G) is not amenable in the cb-multiplier norm if G contains a closed subgroup isomorphic to the free group in two generators.


title: Point-to-line last passage percolation and the invariant measure of a system of reflecting Brownian motions

abstract: This paper proves an equality in law between the invariant measure of a reflected system of Brownian motions and a vector of point-to-line last passage percolation times in a discrete random environment. A consequence describes the distribution of the all-time supremum of Dyson Brownian motion with drift. A finite temperature version relates the point-to-line partition functions of two directed polymers, with an inverse-gamma and a Brownian environment, and generalises Dufresne's identity. Our proof introduces an interacting system of Brownian motions with an invariant measure given by a field of point-to-line log partition functions for the log-gamma polymer.


title: A Primer for Blockchain

abstract: Much has been written about the likely impact of blockchain technology. Early scholarship on this topic has focused on the legal and financial implications of virtual currencies which is based on blockchain technology. Rapid introduction and diffusion of technological changes throughout society, such as blockchain, continue to exceed the ability of law and regulation to keep pace. Will blockchain prove as disruptive to business models and entrenched societal institutions as: electricity, radio, television, or the internet? What beneficial aspects of the blockchain have been identified thus far and what future applications are probable? Should we expect blockchain technology to result in massive global changes? The primary goal of this article about blockchain is to present an all-encompassing basic explanation of: what it is; how it works; and what it's important. This article contributes to the scholarly literature and our understanding by providing a cogent description of this important technology and look at potential uses.


title: Rogers-Shepard Type Inequalities for Sections

abstract: In this paper we address the following question: given a measure $\mu$ on $\mathbb{R}^n$, does there exists a constant $C>0$ such that, for any $m$-dimensional subspace $H \subset \mathbb{R}^n$ and any convex body $K \subset \mathbb{R}^n$, the following sectional Rogers-Shephard type inequality holds: \[ \mu((K-K) \cap H) \leq C \sup_{y \in \mathbb{R}^n} \mu(K \cap (H+y))? \] We show that this inequality is affirmative in the class of measures with radially decreasing densities with the constant $C(n,m) = \binom{n+m}{m}$. We also prove marginal inequalities of the Rogers-Shephard type for $\left(\frac{1}{s}\right)$-concave, $0 \leq s < \infty$, and logarithmically concave functions.


title: Cross-Lingual Transfer of Semantic Roles: From Raw Text to Semantic Roles

abstract: We describe a transfer method based on annotation projection to develop a dependency-based semantic role labeling system for languages for which no supervised linguistic information other than parallel data is available. Unlike previous work that presumes the availability of supervised features such as lemmas, part-of-speech tags, and dependency parse trees, we only make use of word and character features. Our deep model considers using character-based representations as well as unsupervised stem embeddings to alleviate the need for supervised features. Our experiments outperform a state-of-the-art method that uses supervised lexico-syntactic features on 6 out of 7 languages in the Universal Proposition Bank.


title: MLSys: The New Frontier of Machine Learning Systems

abstract: Machine learning (ML) techniques are enjoying rapidly increasing adoption. However, designing and implementing the systems that support ML models in real-world deployments remains a significant obstacle, in large part due to the radically different development and deployment profile of modern ML methods, and the range of practical concerns that come with broader adoption. We propose to foster a new systems machine learning research community at the intersection of the traditional systems and ML communities, focused on topics such as hardware systems for ML, software systems for ML, and ML optimized for metrics beyond predictive accuracy. To do this, we describe a new conference, MLSys, that explicitly targets research at the intersection of systems and machine learning with a program committee split evenly between experts in systems and ML, and an explicit focus on topics at the intersection of the two.


title: Manifold-based isogeometric analysis basis functions with prescribed sharp features

abstract: We introduce manifold-based basis functions for isogeometric analysis of surfaces with arbitrary smoothness, prescribed $C^0$ continuous creases and boundaries. The utility of the manifold-based surface construction techniques in isogeometric analysis was demonstrated in Majeed and Cirak (CMAME, 2017). The respective basis functions are derived by combining differential-geometric manifold techniques with conformal parametrisations and the partition of unity method. The connectivity of a given unstructured quadrilateral control mesh in $\mathbb R^3$ is used to define a set of overlapping charts. Each vertex with its attached elements is assigned a corresponding conformally parametrised planar chart domain in $\mathbb R^2$, so that a quadrilateral element is present on four different charts. On the collection of unconnected chart domains, the partition of unity method is used for approximation. The transition functions required for navigating between the chart domains are composed out of conformal maps. The necessary smooth partition of unity, or blending, functions for the charts are assembled from tensor-product B-spline pieces and require in contrast to earlier constructions no normalisation. Creases are introduced across user tagged edges of the control mesh. Planar chart domains that include creased edges or are adjacent to the domain boundary require special local polynomial approximants. Three different types of chart domain geometries are necessary to consider boundaries and arbitrary number and arrangement of creases. The new chart domain geometries are chosen so that it becomes trivial to establish local polynomial approximants that are always $C^0$ continuous across tagged edges. The derived non-rational manifold-based basis functions are particularly well suited for isogeometric analysis of Kirchhoff-Love thin shells with kinks.


title: Is 'Unsupervised Learning' a Misconceived Term?

abstract: Is all of machine learning supervised to some degree? The field of machine learning has traditionally been categorized pedagogically into $supervised~vs~unsupervised~learning$; where supervised learning has typically referred to learning from labeled data, while unsupervised learning has typically referred to learning from unlabeled data. In this paper, we assert that all machine learning is in fact supervised to some degree, and that the scope of supervision is necessarily commensurate to the scope of learning potential. In particular, we argue that clustering algorithms such as k-means, and dimensionality reduction algorithms such as principal component analysis, variational autoencoders, and deep belief networks are each internally supervised by the data itself to learn their respective representations of its features. Furthermore, these algorithms are not capable of external inference until their respective outputs (clusters, principal components, or representation codes) have been identified and externally labeled in effect. As such, they do not suffice as examples of unsupervised learning. We propose that the categorization `supervised vs unsupervised learning' be dispensed with, and instead, learning algorithms be categorized as either $internally~or~externally~supervised$ (or both). We believe this change in perspective will yield new fundamental insights into the structure and character of data and of learning algorithms.


title: Pixels to Plans: Learning Non-Prehensile Manipulation by Imitating a Planner

abstract: We present a novel method enabling robots to quickly learn to manipulate objects by leveraging a motion planner to generate "expert" training trajectories from a small amount of human-labeled data. In contrast to the traditional sense-plan-act cycle, we propose a deep learning architecture and training regimen called PtPNet that can estimate effective end-effector trajectories for manipulation directly from a single RGB-D image of an object. Additionally, we present a data collection and augmentation pipeline that enables the automatic generation of large numbers (millions) of training image and trajectory examples with almost no human labeling effort. We demonstrate our approach in a non-prehensile tool-based manipulation task, specifically picking up shoes with a hook. In hardware experiments, PtPNet generates motion plans (open-loop trajectories) that reliably (89% success over 189 trials) pick up four very different shoes from a range of positions and orientations, and reliably picks up a shoe it has never seen before. Compared with a traditional sense-plan-act paradigm, our system has the advantages of operating on sparse information (single RGB-D frame), producing high-quality trajectories much faster than the "expert" planner (300ms versus several seconds), and generalizing effectively to previously unseen shoes.


title: Charm production in charged current deep inelastic scattering at HERA

abstract: Charm production in charged current deep inelastic scattering has been measured for the first time in $e^{\pm}p$ collisions, using data collected with the ZEUS detector at HERA, corresponding to an integrated luminosity of $358 pb^{-1}$. Results are presented separately for $e^{+}p$ and $e^{-}p$ scattering at a centre-of-mass energy of $\sqrt{s} = 318 GeV$ within a kinematic phase-space region of $200 GeV^{2}<Q^{2}<60000 GeV^{2}$ and $y<0.9$, where $Q^{2}$ is the squared four-momentum transfer and $y$ is the inelasticity. The measured cross sections of electroweak charm production are consistent with expectations from the Standard Model within the large statistical uncertainties.


title: Extracting Factual Min/Max Age Information from Clinical Trial Studies

abstract: Population age information is an essential characteristic of clinical trials. In this paper, we focus on extracting minimum and maximum (min/max) age values for the study samples from clinical research articles. Specifically, we investigate the use of a neural network model for question answering to address this information extraction task. The min/max age QA model is trained on the massive structured clinical study records from ClinicalTrials.gov. For each article, based on multiple min and max age values extracted from the QA model, we predict both actual min/max age values for the study samples and filter out non-factual age expressions. Our system improves the results over (i) a passage retrieval based IE system and (ii) a CRF-based system by a large margin when evaluated on an annotated dataset consisting of 50 research papers on smoking cessation.


title: ReNets: Toward Statically Optimal Self-Adjusting Networks

abstract: This paper studies the design of self-adjusting networks whose topology dynamically adapts to the workload, in an online and demand-aware manner. This problem is motivated by emerging optical technologies which allow to reconfigure the datacenter topology at runtime. Our main contribution is ReNet, a self-adjusting network which maintains a balance between the benefits and costs of reconfigurations. In particular, we show that ReNets are statically optimal for arbitrary sparse communication demands, i.e., perform at least as good as any fixed demand-aware network designed with a perfect knowledge of the future demand. Furthermore, ReNets provide compact and local routing, by leveraging ideas from self-adjusting datastructures.


title: Attack-Resilient Supervisory Control of Discrete-Event Systems: A Finite-State Transducer Approach

abstract: Resilience to sensor and actuator attacks is a major concern in the supervisory control of discrete events in cyber-physical systems (CPS). In this work, we propose a new framework to design supervisors for CPS under attacks using finite-state transducers (FSTs) to model the effects of the discrete events. FSTs can capture a general class of regular-rewriting attacks in which an attacker can nondeterministically rewrite sensing/actuation events according to a given regular relation. These include common insertion, deletion, event-wise replacement, and finite-memory replay attacks. We propose new theorems and algorithms with polynomial complexity to design resilient supervisors against these attacks. We also develop an open-source tool in Python based on the results and illustrate its applicability through a case study


title: A quantum Karhunen-Loeve expansion and quadratic-exponential functionals for linear quantum stochastic systems

abstract: This paper extends the Karhunen-Loeve representation from classical Gaussian random processes to quantum Wiener processes which model external bosonic fields for open quantum systems. The resulting expansion of the quantum Wiener process in the vacuum state is organised as a series of sinusoidal functions on a bounded time interval with statistically independent coefficients consisting of noncommuting position and momentum operators in a Gaussian quantum state. A similar representation is obtained for the solution of a linear quantum stochastic differential equation which governs the system variables of an open quantum harmonic oscillator. This expansion is applied to computing a quadratic-exponential functional arising as a performance criterion in the framework of risk-sensitive control for this class of open quantum systems.

categories: math.PR cs.SY math-ph math.MP math.OC quant-ph


title: Domain Authoring Assistant for Intelligent Virtual Agents

abstract: Developing intelligent virtual characters has attracted a lot of attention in the recent years. The process of creating such characters often involves a team of creative authors who describe different aspects of the characters in natural language, and planning experts that translate this description into a planning domain. This can be quite challenging as the team of creative authors should diligently define every aspect of the character especially if it contains complex human-like behavior. Also a team of engineers has to manually translate the natural language description of a character's personality into the planning domain knowledge. This can be extremely time and resource demanding and can be an obstacle to author's creativity. The goal of this paper is to introduce an authoring assistant tool to automate the process of domain generation from natural language description of virtual characters, thus bridging between the creative authoring team and the planning domain experts. Moreover, the proposed tool also identifies possible missing information in the domain description and iteratively makes suggestions to the author.


title: Pluricomplex Green functions on manifolds

abstract: In this paper we prove the basic facts for pluricomplex Green functions on manifolds. The main goal is to establish properties of complex manifolds that make them analogous to relatively compact or hyperconvex domains in Stein manifolds. The final version to appear in JGA.


title: Jointly primitive knots and surgeries between lens spaces

abstract: This paper describes a Dehn surgery approach to generating asymmetric hyperbolic manifolds with two distinct lens space fillings. Such manifolds were first identified in work of Dunfield-Hoffman-Licata as the result of a computer search of the SnapPy census, but the current work establishes a topological framework for constructing vastly many more such examples. We introduce the notion of a ``jointly primitive'' presentation of a knot and show that a refined version of this condition ``longitudinally jointly primitive'' is equivalent to being surgery dual to a $(1,2)$--knot in a lens space. This generalizes Berge's equivalence between having a doubly primitive presentation and being surgery dual to a $(1,1)$--knot in a lens space. Through surgery descriptions on a seven-component link in $S^3$, we provide several explicit multi-parameter infinite families of knots in lens spaces with longitudinal jointly primitive presentations and observe among them all the examples previously seen in Dunfield-Hoffman-Licata.


title: Search for Heavy Neutrinos in $\pi \to \mu\nu$ Decay

abstract: Heavy neutrinos were sought in pion decays $\pi^+ \rightarrow \mu^+ \nu$ by examining the observed muon energy spectrum for extra peaks in addition to the expected peak for a massless neutrino. No evidence for heavy neutrinos was observed. Upper limits were set on the neutrino mixing matrix $|U_{\mu i}|^2$ in the neutrino mass region of 15.7--33.8 MeV/c$^2$, improving on previous results by an order of magnitude.


title: Statistical analysis of C and S Main Belt Asteroids

abstract: In this paper we compare the observable properties of 962 numbered MBAs (Main Belt Asteroids) of Tholen/SMASSII C and S class, with diameter in the range 1-500 km, not belonging to families or binary systems. Above 20 km, the diameters distributions of C and S are similar while under 20 km there is a clear observative bias in favour of small S asteroids which prevents a direct comparison. There is a significant correlation between rotation frequency and diameter both for C and S: if the diameter decreases the rotation frequency tends to increase. There is also a significant correlation between the lightcurve amplitude and the diameter for both samples: if the diameter decreases the lightcurve amplitude tends to increase. For larger diameter the C amplitude tends to be systematically higher than S amplitude of about 0.1 magnitude, but the difference is not very significant. Between 48 and 200 km, the C asteroids have a rotation frequency distribution compatible with a Maxwellian. On the other side, for S asteroids, the compatibility with the Maxwellian concernes diameters greater than 33 km. Considering the rotational properties and the lightcurve amplitude it appears that there are no substantial differences between the samples of C and S asteroids taken into account, and this indicates a good homogeneity in the processes of collisional evolution.


title: Optimal Communication Rates and Combinatorial Properties for Common Randomness Generation

abstract: We study common randomness generation problems where $n$ players aim to generate same sequences of random coin flips where some subsets of the players share an independent common coin which can be tossed multiple times, and there is a publicly seen blackboard through which the players communicate with each other. We provide a tight representation of the optimal communication rates via linear programming, and more importantly, propose explicit algorithms for the optimal distributed simulation for a wide class of hypergraphs. In particular, the optimal communication rate in complete hypergraphs is still achievable in sparser hypergraphs containing a path-connected cycle-free cluster of topologically connected components. Some key steps in analyzing the upper bounds rely on two different definitions of connectivity in hypergraphs, which may be of independent interest.


title: Convex optimization for the densest subgraph and densest submatrix problems

abstract: We consider the densest $k$-subgraph problem, which seeks to identify the $k$-node subgraph of a given input graph with maximum number of edges. This problem is well-known to be NP-hard, by reduction to the maximum clique problem. We propose a new convex relaxation for the densest $k$-subgraph problem, based on a nuclear norm relaxation of a low-rank plus sparse decomposition of the adjacency matrices of $k$-node subgraphs to partially address this intractability. We establish that the densest $k$-subgraph can be recovered with high probability from the optimal solution of this convex relaxation if the input graph is randomly sampled from a distribution of random graphs constructed to contain an especially dense $k$-node subgraph with high probability. Specifically, the relaxation is exact when the edges of the input graph are added independently at random, with edges within a particular $k$-node subgraph added with higher probability than other edges in the graph. We provide a sufficient condition on the size of this subgraph $k$ and the expected density under which the optimal solution of the proposed relaxation recovers this $k$-node subgraph with high probability. Further, we propose a first-order method for solving this relaxation based on the alternating direction method of multipliers, and empirically confirm our predicted recovery thresholds using simulations involving randomly generated graphs, as well as graphs drawn from social and collaborative networks.


title: A Variational Auto-Encoder Model for Stochastic Point Processes

abstract: We propose a novel probabilistic generative model for action sequences. The model is termed the Action Point Process VAE (APP-VAE), a variational auto-encoder that can capture the distribution over the times and categories of action sequences. Modeling the variety of possible action sequences is a challenge, which we show can be addressed via the APP-VAE's use of latent representations and non-linear functions to parameterize distributions over which event is likely to occur next in a sequence and at what time. We empirically validate the efficacy of APP-VAE for modeling action sequences on the MultiTHUMOS and Breakfast datasets.


title: Random matrix approach to three-dimensional QCD with a Chern-Simons term

abstract: We propose a random matrix theory for QCD in three dimensions with a Chern-Simons term at level $k$ which spontaneously breaks the flavor symmetry according to U($2N_{\rm f}$) $\to $ U($N_{\rm f}+k$)$\times$U($N_{\rm f}-k$). This random matrix model is obtained by adding a complex part to the action for the $k=0$ random matrix model. We derive the pattern of spontaneous symmetry breaking from the analytical solution of the model. Additionally, we obtain explicit analytical results for the spectral density and the spectral correlation functions for the Dirac operator at finite matrix dimension, that become complex. In the microscopic domain where the matrix size tends to infinity, they are expected to be universal, and give an exact analytical prediction to the spectral properties of the Dirac operator in the presence of a Chern-Simons term. Here, we calculate the microscopic spectral density. It shows exponentially large (complex) oscillations which cancel the phase of the $k=0$ theory.


title: Robust Subspace Recovery with Adversarial Outliers

abstract: We study the problem of robust subspace recovery (RSR) in the presence of adversarial outliers. That is, we seek a subspace that contains a large portion of a dataset when some fraction of the data points are arbitrarily corrupted. We first examine a theoretical estimator that is intractable to calculate and use it to derive information-theoretic bounds of exact recovery. We then propose two tractable estimators: a variant of RANSAC and a simple relaxation of the theoretical estimator. The two estimators are fast to compute and achieve state-of-the-art theoretical performance in a noiseless RSR setting with adversarial outliers. The former estimator achieves better theoretical guarantees in the noiseless case, while the latter estimator is robust to small noise, and its guarantees significantly improve with non-adversarial models of outliers. We give a complete comparison of guarantees for the adversarial RSR problem, as well as a short discussion on the estimation of affine subspaces.


title: Synthesized Policies for Transfer and Adaptation across Tasks and Environments

abstract: The ability to transfer in reinforcement learning is key towards building an agent of general artificial intelligence. In this paper, we consider the problem of learning to simultaneously transfer across both environments (ENV) and tasks (TASK), probably more importantly, by learning from only sparse (ENV, TASK) pairs out of all the possible combinations. We propose a novel compositional neural network architecture which depicts a meta rule for composing policies from the environment and task embeddings. Notably, one of the main challenges is to learn the embeddings jointly with the meta rule. We further propose new training methods to disentangle the embeddings, making them both distinctive signatures of the environments and tasks and effective building blocks for composing the policies. Experiments on GridWorld and Thor, of which the agent takes as input an egocentric view, show that our approach gives rise to high success rates on all the (ENV, TASK) pairs after learning from only 40% of them.


title: Theory and limits of on-demand single photon sources using plasmonic resonators: a quantized quasinormal mode approach

abstract: Quantum emitters coupled to plasmonic resonators are known to allow enhanced broadband Purcell factors, and such systems have been recently suggested as possible candidates for on-demand single photon sources, with fast operation speeds. However, a true single photon source has strict requirements of high efficiency (brightness) and quantum indistinguishability of the emitted photons, which can be quantified through two-photon interference experiments. To help address this problem, we employ and extend a recently developed quantized quasinormal mode approach, which rigorously quantizes arbitrarily lossy open system modes, to compute the key parameters that accurately quantify the figures of merit for plasmon-based single photon sources. We also present a quantized input-output theory to quantify the radiative and nonradiative quantum efficiencies. We exemplify the theory using a nanoplasmonic dimer resonator made up of two gold nanorods, which yields large Purcell factors and good radiative output beta factors. Considering an optically pulsed excitation scheme, we explore the key roles of pulse duration and pure dephasing on the single photon properties, and show that ultrashort pulses (sub-ps) are generally required for such structures, even for low temperature operation. We also quantify the role of the nonradiative beta factor both for single photon and two-photon emission processes. Our general approach can be applied to a wide variety of plasmon systems, including metal-dielectrics, and cavity-waveguide systems, without recourse to phenomenological quantization schemes.


title: AMASS: Archive of Motion Capture as Surface Shapes

abstract: Large datasets are the cornerstone of recent advances in computer vision using deep learning. In contrast, existing human motion capture (mocap) datasets are small and the motions limited, hampering progress on learning models of human motion. While there are many different datasets available, they each use a different parameterization of the body, making it difficult to integrate them into a single meta dataset. To address this, we introduce AMASS, a large and varied database of human motion that unifies 15 different optical marker-based mocap datasets by representing them within a common framework and parameterization. We achieve this using a new method, MoSh++, that converts mocap data into realistic 3D human meshes represented by a rigged body model; here we use SMPL [doi:10.1145/2816795.2818013], which is widely used and provides a standard skeletal representation as well as a fully rigged surface mesh. The method works for arbitrary marker sets, while recovering soft-tissue dynamics and realistic hand motion. We evaluate MoSh++ and tune its hyperparameters using a new dataset of 4D body scans that are jointly recorded with marker-based mocap. The consistent representation of AMASS makes it readily useful for animation, visualization, and generating training data for deep learning. Our dataset is significantly richer than previous human motion collections, having more than 40 hours of motion data, spanning over 300 subjects, more than 11,000 motions, and will be publicly available to the research community.


title: Generate, Filter, and Rank: Grammaticality Classification for Production-Ready NLG Systems

abstract: Neural approaches to Natural Language Generation (NLG) have been promising for goal-oriented dialogue. One of the challenges of productionizing these approaches, however, is the ability to control response quality, and ensure that generated responses are acceptable. We propose the use of a generate, filter, and rank framework, in which candidate responses are first filtered to eliminate unacceptable responses, and then ranked to select the best response. While acceptability includes grammatical correctness and semantic correctness, we focus only on grammaticality classification in this paper, and show that existing datasets for grammatical error correction don't correctly capture the distribution of errors that data-driven generators are likely to make. We release a grammatical classification and semantic correctness classification dataset for the weather domain that consists of responses generated by 3 data-driven NLG systems. We then explore two supervised learning approaches (CNNs and GBDTs) for classifying grammaticality. Our experiments show that grammaticality classification is very sensitive to the distribution of errors in the data, and that these distributions vary significantly with both the source of the response as well as the domain. We show that it's possible to achieve high precision with reasonable recall on our dataset.


title: Prediction-Tracking-Segmentation

abstract: We introduce a prediction driven method for visual tracking and segmentation in videos. Instead of solely relying on matching with appearance cues for tracking, we build a predictive model which guides finding more accurate tracking regions efficiently. With the proposed prediction mechanism, we improve the model robustness against distractions and occlusions during tracking. We demonstrate significant improvements over state-of-the-art methods not only on visual tracking tasks (VOT 2016 and VOT 2018) but also on video segmentation datasets (DAVIS 2016 and DAVIS 2017).


title: Ion Acceleration in Laser Generated Mega Tesla Magnetic Vortex

abstract: Magnetic Vortex Acceleration (MVA) from near critical density targets is one of the promising schemes of laser-driven ion acceleration. 3D particle-in-cell simulations are used to explore a more extensive laser-target parameter space than previously reported on in the literature as well as to study the laser pulse coupling to the target, the structure of the fields, and the properties of the accelerated ion beam in the MVA scheme. The efficiency of acceleration depends on the coupling of the laser energy to the self-generated channel in the target. The accelerated proton beams demonstrate high level of collimation with achromatic angular divergence, and carry a significant amount of charge. For PW-class lasers, this acceleration regime provides favorable scaling of maximum ion energy with laser power for optimized interaction parameters. The mega Tesla-level magnetic fields generated by the laser-driven co-axial plasma structure in the target are prerequisite for accelerating protons to the energy of several hundred MeV.


title: Weakly Supervised Video Moment Retrieval From Text Queries

abstract: There have been a few recent methods proposed in text to video moment retrieval using natural language queries, but requiring full supervision during training. However, acquiring a large number of training videos with temporal boundary annotations for each text description is extremely time-consuming and often not scalable. In order to cope with this issue, in this work, we introduce the problem of learning from weak labels for the task of text to video moment retrieval. The weak nature of the supervision is because, during training, we only have access to the video-text pairs rather than the temporal extent of the video to which different text descriptions relate. We propose a joint visual-semantic embedding based framework that learns the notion of relevant segments from video using only video-level sentence descriptions. Specifically, our main idea is to utilize latent alignment between video frames and sentence descriptions using Text-Guided Attention (TGA). TGA is then used during the test phase to retrieve relevant moments. Experiments on two benchmark datasets demonstrate that our method achieves comparable performance to state-of-the-art fully supervised approaches.


title: Integrating PHY Security Into NDN-IoT Networks By Exploiting MEC: Authentication Efficiency, Robustness, and Accuracy Enhancement

abstract: Recent literature has demonstrated the improved data discovery and delivery efficiency gained through applying named data networking (NDN) to a variety of information-centric Internet of things (IoT) applications. However, from a data security perspective, the development of NDN-IoT raises several new authentication challenges. In particular, NDN-IoT authentication may require per-packet-level signatures, thus imposing intolerably high computational and time costs on the resource-poor IoT end devices. This paper proposes an effective solution by seamlessly integrating the lightweight and unforgeable physical-layer identity (PHY-ID) into the existing NDN signature scheme for the mobile edge computing (MEC)-enabled NDN-IoT networks. The PHY-ID generation exploits the inherent signal-level device-specific radio-frequency imperfections of IoT devices, including the in-phase/quadrature-phase imbalance, and thereby avoids adding any implementation complexity to the constrained IoT devices. We derive the offline maximum entropy-based quantization rule and propose an online two-step authentication scheme to improve the accuracy of the authentication decision making. Consequently, a cooperative MEC device can securely execute the costly signing task on behalf of the authenticated IoT device in an optimal manner. The evaluation results demonstrate 1) elevated authentication time efficiency, 2) robustness to several impersonation attacks including the replay attack and the computation-based spoofing attack, and 3) increased differentiation rate and correct authentication probability by applying our integration design in MEC-enabled NDN-IoT networks.


title: Facile and time-resolved chemical growth of nanoporous CaxCoO2 thin films for flexible and thermoelectric applications

abstract: CaxCoO2 thin films can be promising for widespread flexible thermoelectric applications in a wide temperature range from room-temperature self-powered wearable applications (by harvesting power from body heat) to energy harvesting from hot surfaces (e.g., hot pipes) if a cost-effective and facile growth technique is developed. Here, we demonstrate a time resolved, facile and ligand-free soft chemical method for the growth of nanoporous Ca0.35CoO2 thin films on sapphire and mica substrates from a water-based precursor ink, composed of in-situ prepared Ca2+-DMF and Co2+-DMF complexes. Mica serves as flexible substrate as well as sacrificial layer for film transfer. The grown films are oriented and can sustain bending stress until a bending radius of 15 mm. Despite the presence of nanopores, the power factor of Ca0.35CoO2 film is found to be as high as 0.50 x 10-4 Wm-1K-2 near room temperature. The present technique, being simple and fast to be potentially suitable for cost-effective industrial upscaling.


title: Can You Explain That? Lucid Explanations Help Human-AI Collaborative Image Retrieval

abstract: While there have been many proposals on making AI algorithms explainable, few have attempted to evaluate the impact of AI-generated explanations on human performance in conducting human-AI collaborative tasks. To bridge the gap, we propose a Twenty-Questions style collaborative image retrieval game, Explanation-assisted Guess Which (ExAG), as a method of evaluating the efficacy of explanations (visual evidence or textual justification) in the context of Visual Question Answering (VQA). In our proposed ExAG, a human user needs to guess a secret image picked by the VQA agent by asking natural language questions to it. We show that overall, when AI explains its answers, users succeed more often in guessing the secret image correctly. Notably, a few correct explanations can readily improve human performance when VQA answers are mostly incorrect as compared to no-explanation games. Furthermore, we also show that while explanations rated as "helpful" significantly improve human performance, "incorrect" and "unhelpful" explanations can degrade performance as compared to no-explanation games. Our experiments, therefore, demonstrate that ExAG is an effective means to evaluate the efficacy of AI-generated explanations on a human-AI collaborative task.


title: Draw-down Parisian ruin for spectrally negative L\'{e}vy process

abstract: In this paper we study the draw-down related Parisian ruin problem for spectrally negative L\'{e}vy risk processes. We introduce the draw-down Parisian ruin time and solve the corresponding two-sided exit time via excursion theory. We also obtain an expression of the potential measure for the process killed at the draw-down Parisian time. As applications, new results are obtained for spectrally negative L\'{e}vy risk process with dividend barrier and Parisian ruin.


title: The Sortability of Graphs and Matrices under Context Directed Swaps

abstract: The study of sorting permutations by block interchanges has recently been stimulated by a phenomenon observed in the genome maintenance of certain ciliate species. The result was the identification of a block interchange operation that applies only under certain constraints. Interestingly, this constrained block interchange operation can be generalized naturally to simple graphs and to an operation on square matrices. This more general context provides numerous techniques applicable to the original context. In this paper we consider the more general context, and obtain an enumeration, in closed form, of all simple graphs on n vertices that are ``sortable" by the graph analogue of the constrained version of block interchanges. We also obtain asymptotic results on the proportion of graphs on n vertices that are so sortable.


title: Jasper: An End-to-End Convolutional Neural Acoustic Model

abstract: In this paper, we report state-of-the-art results on LibriSpeech among end-to-end speech recognition models without any external training data. Our model, Jasper, uses only 1D convolutions, batch normalization, ReLU, dropout, and residual connections. To improve training, we further introduce a new layer-wise optimizer called NovoGrad. Through experiments, we demonstrate that the proposed deep architecture performs as well or better than more complex choices. Our deepest Jasper variant uses 54 convolutional layers. With this architecture, we achieve 2.95% WER using a beam-search decoder with an external neural language model and 3.86% WER with a greedy decoder on LibriSpeech test-clean. We also report competitive results on the Wall Street Journal and the Hub5'00 conversational evaluation datasets.


title: In the Wild Human Pose Estimation Using Explicit 2D Features and Intermediate 3D Representations

abstract: Convolutional Neural Network based approaches for monocular 3D human pose estimation usually require a large amount of training images with 3D pose annotations. While it is feasible to provide 2D joint annotations for large corpora of in-the-wild images with humans, providing accurate 3D annotations to such in-the-wild corpora is hardly feasible in practice. Most existing 3D labelled data sets are either synthetically created or feature in-studio images. 3D pose estimation algorithms trained on such data often have limited ability to generalize to real world scene diversity. We therefore propose a new deep learning based method for monocular 3D human pose estimation that shows high accuracy and generalizes better to in-the-wild scenes. It has a network architecture that comprises a new disentangled hidden space encoding of explicit 2D and 3D features, and uses supervision by a new learned projection model from predicted 3D pose. Our algorithm can be jointly trained on image data with 3D labels and image data with only 2D labels. It achieves state-of-the-art accuracy on challenging in-the-wild data.


title: Dynamics of a birth-death process based on combinatorial innovation

abstract: A feature of human creativity is the ability to take a subset of existing items (e.g. objects, ideas, or techniques) and combine them in various ways to give rise to new items, which, in turn, fuel further growth. Occasionally, some of these items may also disappear (extinction). We model this process by a simple stochastic birth--death model, with non-linear combinatorial terms in the growth coefficients to capture the propensity of subsets of items to give rise to new items. In its simplest form, this model involves just two parameters $(P, \alpha)$. This process exhibits a characteristic 'hockey-stick' behaviour: a long period of relatively little growth followed by a relatively sudden 'explosive' increase. We provide exact expressions for the mean and variance of this time to explosion and compare the results with simulations. We then generalise our results to allow for more general parameter assignments, and consider possible applications to data involving human productivity and creativity.


title: New high-entropy alloy superconductor Hf$_{21}$Nb$_{25}$Ti$_{15}$V$_{15}$Zr$_{24}$

abstract: High-entropy alloys are a new class of alloys, and attract much attention due to their unique properties. Since the discovery of a superconducting high-entropy alloy (HEA) in 2014, the materials research on HEA superconductor is a hot topic. We have found that Hf$_{21}$Nb$_{25}$Ti$_{15}$V$_{15}$Zr$_{24}$ body-centered-cubic (BCC) HEA is a new superconductor with the superconducting critical temperature Tc of 5.3 K. We briefly discussed the comparison of cocktail effect of Tc among BCC HEA superconductors.


title: The Information Complexity of Learning Tasks, their Structure and their Distance

abstract: We introduce an asymmetric distance in the space of learning tasks, and a framework to compute their complexity. These concepts are foundational for the practice of transfer learning, whereby a parametric model is pre-trained for a task, and then fine-tuned for another. The framework we develop is non-asymptotic, captures the finite nature of the training dataset, and allows distinguishing learning from memorization. It encompasses, as special cases, classical notions from Kolmogorov complexity, Shannon, and Fisher Information. However, unlike some of those frameworks, it can be applied to large-scale models and real-world datasets. Our framework is the first to measure complexity in a way that accounts for the effect of the optimization scheme, which is critical in Deep Learning.


title: Collaborative Learning with Limited Interaction: Tight Bounds for Distributed Exploration in Multi-Armed Bandits

abstract: Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the best arm collaboratively. We want to quantify the power of collaboration under limited interaction (or, communication steps), as interaction is expensive in many settings. We measure the running time of a distributed algorithm as the speedup over the best centralized algorithm where there is only one agent. We give almost tight round-speedup tradeoffs for this problem, along which we develop several new techniques for proving lower bounds on the number of communication steps under time or confidence constraints.


title: A Logic Simplification Approach for Very Large Scale Crosstalk Circuit Designs

abstract: Crosstalk computing, involving engineered interference between nanoscale metal lines, offers a fresh perspective to scaling through co-existence with CMOS. Through capacitive manipulations and innovative circuit style, not only primitive gates can be implemented, but custom logic cells such as an Adder, Subtractor can be implemented with huge gains. Our simulations show over 5x density and 2x power benefits over CMOS custom designs at 16nm [1]. This paper introduces the Crosstalk circuit style and a key method for large-scale circuit synthesis utilizing existing EDA tool flow. We propose to manipulate the CMOS synthesis flow by adding two extra steps: conversion of the gate-level netlist to Crosstalk implementation friendly netlist through logic simplification and Crosstalk gate mapping, and the inclusion of custom cell libraries for automated placement and layout. Our logic simplification approach first converts Cadence generated structured netlist to Boolean expressions and then uses the majority synthesis tool to obtain majority functions, which is further used to simplify functions for Crosstalk friendly implementations. We compare our approach of logic simplification to that of CMOS and majority logic-based approaches. Crosstalk circuits share some similarities to majority synthesis that are typically applied to Quantum Cellular Automata technology. However, our investigation shows that by closely following Crosstalk's core circuit styles, most benefits can be achieved. In the best case, our approach shows 36% density improvements over majority synthesis for MCNC benchmark.


title: Multi-Preference Actor Critic

abstract: Policy gradient algorithms typically combine discounted future rewards with an estimated value function, to compute the direction and magnitude of parameter updates. However, for most Reinforcement Learning tasks, humans can provide additional insight to constrain the policy learning. We introduce a general method to incorporate multiple different feedback channels into a single policy gradient loss. In our formulation, the Multi-Preference Actor Critic (M-PAC), these different types of feedback are implemented as constraints on the policy. We use a Lagrangian relaxation to satisfy these constraints using gradient descent while learning a policy that maximizes rewards. Experiments in Atari and Pendulum verify that constraints are being respected and can accelerate the learning process.


title: A General Framework for Information Extraction using Dynamic Span Graphs

abstract: We introduce a general framework for several information extraction tasks that share span representations using dynamically constructed span graphs. The graphs are constructed by selecting the most confident entity spans and linking these nodes with confidence-weighted relation types and coreferences. The dynamic span graph allows coreference and relation type confidences to propagate through the graph to iteratively refine the span representations. This is unlike previous multi-task frameworks for information extraction in which the only interaction between tasks is in the shared first-layer LSTM. Our framework significantly outperforms the state-of-the-art on multiple information extraction tasks across multiple datasets reflecting different domains. We further observe that the span enumeration approach is good at detecting nested span entities, with significant F1 score improvement on the ACE dataset.


title: Single-Carrier Index Modulation for IoT Uplink

abstract: For the Internet of Things (IoT), there might be a large number of devices to be connected to the Internet through wireless technologies. In general, IoT devices would have various constraints due to limited processing capability, memory, energy source, and so on, and it is desirable to employ efficient wireless transmission schemes, especially for uplink transmissions. For example, orthogonal frequency division multiplexing (OFDM) with index modulation (IM) or OFDM-IM can be considered for IoT devices due to its energy efficiency. In this paper, we study a different IM scheme for a single-carrier (SC) system, which is referred to as SCIM. While SCIM is similar to OFDM-IM in terms of energy efficiency, SCIM may be better suited for IoT uplink because it has a low peak-to-average power ratio (PAPR) and does not require inverse fast Fourier transform (FFT) at devices compared to OFDM-IM. We also consider precoding for SCIM and generalize it to multiple access channel so that multiple IoT devices can share the same radio resource block. To detect precoded SCIM signals, low-complexity detectors are derived. For a better performance, based on variational inference that is widely used in machine learning, we consider a detector that provides an approximate solution to an optimal detection.


title: Virtual Machines Embedding for Cloud PON AWGR and Server Based Data Centres

abstract: In this study, we investigate the embedding of various cloud applications in PON AWGR and Server Based Data Centres.


title: A Multiband Patch Antenna with Co-Located Phase Centers for High-Accuracy Inter-Node Ranging in Distributed Antenna Arrays

abstract: A unique three-band patch antenna for high accuracy ranging between nodes in open-loop coherent distributed antenna arrays is presented. Open-loop coherent distributed operations require accurate relative position knowledge between nodes to enable distributed beamforming operations. For the highest accuracy, the inter-node ranging will typically occur at frequencies higher than the frequency of the signal transmitted by the distributed array (the coherent action signal) to enable wider bandwidth signals to be used, however it is important that the inter-node ranging measure the distance between the antennas transmitting the coherent action signal. In this work, a three-band antenna is presented that is designed to support distributed beamforming at 1.88 GHz and high-accuracy ranging using a sparse, two-tone waveform operating near 9.5 and 10.5 GHz. The two-tone waveform is supported by a slotted patch antenna surrounded by a larger patch antenna supporting the 1.88 GHz array signal. The antennas are concentrically designed to ensure that the phase centers of the ranging antenna and the coherent action antenna are closely aligned. Simulated and measured performance shows phase center displacement of approximately lambda/10 relative to the coherent action signal, while maintaining S11 below -10 dB at each band.


title: A Multi-task Learning Approach for Named Entity Recognition using Local Detection

abstract: Named entity recognition (NER) systems that perform well require task-related and manually annotated datasets. However, they are expensive to develop, and are thus limited in size. As there already exists a large number of NER datasets that share a certain degree of relationship but differ in content, it is important to explore the question of whether such datasets can be combined as a simple method for improving NER performance. To investigate this, we developed a novel locally detecting multitask model using FFNNs. The model relies on encoding variable-length sequences of words into theoretically lossless and unique fixed-size representations. We applied this method to several well-known NER tasks and compared the results of our model to baseline models as well as other published results. As a result, we observed competitive performance in nearly all of the tasks.


title: Hot Streaks on Social Media

abstract: Measuring the impact and success of human performance is common in various disciplines, including art, science, and sports. Quantifying impact also plays a key role on social media, where impact is usually defined as the reach of a user's content as captured by metrics such as the number of views, likes, retweets, or shares. In this paper, we study entire careers of Twitter users to understand properties of impact. We show that user impact tends to have certain characteristics: First, impact is clustered in time, such that the most impactful tweets of a user appear close to each other. Second, users commonly have 'hot streaks' of impact, i.e., extended periods of high-impact tweets. Third, impact tends to gradually build up before, and fall off after, a user's most impactful tweet. We attempt to explain these characteristics using various properties measured on social media, including the user's network, content, activity, and experience, and find that changes in impact are associated with significant changes in these properties. Our findings open interesting avenues for future research on virality and influence on social media.


title: Measuring scheduling efficiency of RNNs for NLP applications

abstract: Recurrent neural networks (RNNs) have shown state of the art results for speech recognition, natural language processing, image captioning and video summarizing applications. Many of these applications run on low-power platforms, so their energy efficiency is extremely important. We observed that cache-oblivious RNN scheduling during inference typically results in 30-50x more data transferred on and off the CPU than the application's working set size. This can potentially impact its energy efficiency. This paper presents a new metric called Data Reuse Efficiency to gauge the RNN scheduling efficiency of a platform and shows the factors that influence the DRE value. Additionally, this paper discusses an optimization to improve reuse in RNNs and highlights the positive impact of this optimization on the total amount of memory read from or written to the memory controller (and, hence, the DRE value) during the execution of an RNN application for a mobile SoC.


title: Revealing Scenes by Inverting Structure from Motion Reconstructions

abstract: Many 3D vision systems localize cameras within a scene using 3D point clouds. Such point clouds are often obtained using structure from motion (SfM), after which the images are discarded to preserve privacy. In this paper, we show, for the first time, that such point clouds retain enough information to reveal scene appearance and compromise privacy. We present a privacy attack that reconstructs color images of the scene from the point cloud. Our method is based on a cascaded U-Net that takes as input, a 2D multichannel image of the points rendered from a specific viewpoint containing point depth and optionally color and SIFT descriptors and outputs a color image of the scene from that viewpoint. Unlike previous feature inversion methods, we deal with highly sparse and irregular 2D point distributions and inputs where many point attributes are missing, namely keypoint orientation and scale, the descriptor image source and the 3D point visibility. We evaluate our attack algorithm on public datasets and analyze the significance of the point cloud attributes. Finally, we show that novel views can also be generated thereby enabling compelling virtual tours of the underlying scene.


title: Generalizing Lieb's Concavity Theorem via Operator Interpolation

abstract: We introduce the notion of $k$-trace and use interpolation of operators to prove the joint concavity of the function $(A,B)\mapsto\text{Tr}_k\big[(B^\frac{qs}{2}K^*A^{ps}KB^\frac{qs}{2})^{\frac{1}{s}}\big]^\frac{1}{k}$, which generalizes Lieb's concavity theorem from trace to a class of homogeneous functions $\text{Tr}_k[\cdot]^\frac{1}{k}$. Here $\text{Tr}_k[A]$ denotes the $k_{\text{th}}$ elementary symmetric polynomial of the eigenvalues of $A$. This result gives an alternative proof for the concavity of $A\mapsto\text{Tr}_k\big[\exp(H+\log A)\big]^\frac{1}{k}$ that was obtained and used in a recent work to derive expectation estimates and tail bounds on partial spectral sums of random matrices.


title: Effective Context and Fragment Feature Usage for Named Entity Recognition

abstract: In this paper, we explore a new approach to named entity recognition (NER) with the goal of learning from context and fragment features more effectively, contributing to the improvement of overall recognition performance. We use the recent fixed-size ordinally forgetting encoding (FOFE) method to fully encode each sentence fragment and its left-right contexts into a fixed-size representation. Next, we organize the context and fragment features into groups, and feed each feature group to dedicated fully-connected layers. Finally, we merge each group's final dedicated layers and add a shared layer leading to a single output. The outcome of our experiments show that, given only tokenized text and trained word embeddings, our system outperforms our baseline models, and is competitive to the state-of-the-arts of various well-known NER tasks.


title: Deducing factoring methods through concrete material

abstract: We formulate and prove a criterion for reducibility of a quadratic polynomial over the integers. The main theorem was suggested by the teaching experience with the concrete material called "the polynomial box". Through the corollaries we relate our theorem and the use of concrete material with some well know factoring methods for quadratic polynomial with integer coeficients.


title: Opening the low-background and high-spectral-resolution domain with the ATHENA large X-ray observatory: Development of the Cryogenic AntiCoincidence Detector for the X-ray Integral Field Unit

abstract: ATHENA is a large-class ESA mission selected for launch in 2031. It is designed to address the science theme "The Hot and Energetic Universe", performing X-ray observations (0.2-12 keV) at the L2 Sun-Earth Lagrangian point. The X-IFU is one of the two instruments of the payload. It is a cryogenic spectrometer providing spatially resolved high-resolution spectroscopy. The core of the instrument is a large array of TES microcalorimeters, operated at a 50 mK thermal bath. The X-IFU performances would be strongly degraded by the particle background expected in the L2 environment, thus advanced reduction techniques have been adopted to reduce this contribution by a factor $\sim$50. This is needed to enable many core science objectives of the mission. Most of the background reduction ($\sim 80\%$) is achieved thanks to the Cryogenic AntiCoincidence detector (CryoAC), a 4 pixels TES microcalorimeter which will be placed less than 1 mm below the TES array. The CryoAC is a sort of instrument-inside-the-instrument, with independent cold and warm electronics and a dedicated data processing chain. To reach the required particle rejection efficiency ($\sim 98 \%$) it will have a wide energy band (from 20 keV to $\sim$ 1 MeV) and a low deadtime ($< \sim 2\%$), while respecting several constraints to ensure mechanical, thermal and electromagnetic compatibility with the TES array. Here I will report my PhD research activity, which has been focused on the development of the CryoAC Demonstration Model (DM), a single pixel detector requested by ESA before the mission adoption. The thesis is divided in two main parts. In the first one I will mainly present the astrophysical framework of my research, and in the second one I will focus on the experimental activities carried out towards the CryoAC DM development.


title: Convolutional Relational Machine for Group Activity Recognition

abstract: We present an end-to-end deep Convolutional Neural Network called Convolutional Relational Machine (CRM) for recognizing group activities that utilizes the information in spatial relations between individual persons in image or video. It learns to produce an intermediate spatial representation (activity map) based on individual and group activities. A multi-stage refinement component is responsible for decreasing the incorrect predictions in the activity map. Finally, an aggregation component uses the refined information to recognize group activities. Experimental results demonstrate the constructive contribution of the information extracted and represented in the form of the activity map. CRM shows advantages over state-of-the-art models on Volleyball and Collective Activity datasets.


title: Ship Wake Detection in SAR Images via Sparse Regularization

abstract: In order to analyse synthetic aperture radar (SAR) images of the sea surface, ship wake detection is essential for extracting information on the wake generating vessels. One possibility is to assume a linear model for wakes, in which case detection approaches are based on transforms such as Radon and Hough. These express the bright (dark) lines as peak (trough) points in the transform domain. In this paper, ship wake detection is posed as an inverse problem, which the associated cost function including a sparsity enforcing penalty, i.e. the generalized minimax concave (GMC) function. Despite being a non-convex regularizer, the GMC penalty enforces the overall cost function to be convex. The proposed solution is based on a Bayesian formulation, whereby the point estimates are recovered using maximum a posteriori (MAP) estimation. To quantify the performance of the proposed method, various types of SAR images are used, corresponding to TerraSAR-X, COSMO-SkyMed, Sentinel-1, and ALOS2. The performance of various priors in solving the proposed inverse problem is first studied by investigating the GMC along with the L1, Lp, nuclear and total variation (TV) norms. We show that the GMC achieves the best results and we subsequently study the merits of the corresponding method in comparison to two state-of-the-art approaches for ship wake detection. The results show that our proposed technique offers the best performance by achieving 80% success rate.


title: Gender Bias in Contextualized Word Embeddings

abstract: In this paper, we quantify, analyze and mitigate gender bias exhibited in ELMo's contextualized word vectors. First, we conduct several intrinsic analyses and find that (1) training data for ELMo contains significantly more male than female entities, (2) the trained ELMo embeddings systematically encode gender information and (3) ELMo unequally encodes gender information about male and female entities. Then, we show that a state-of-the-art coreference system that depends on ELMo inherits its bias and demonstrates significant bias on the WinoBias probing corpus. Finally, we explore two methods to mitigate such gender bias and show that the bias demonstrated on WinoBias can be eliminated.


title: Robustness of Regularity for the $3$D Convective Brinkman-Forchheimer Equations

abstract: We prove a robustness of regularity result for the $3$D convective Brinkman-Forchheimer equations $$ \partial_tu -\mu\Delta u + (u \cdot \nabla)u + \nabla p + \alpha u + \beta\abs{u}^{r - 1}u = f, $$ for the range of the absorption exponent $r \in [1, 3]$ (for $r > 3$ there exist global-in-time regular solutions), i.e. we show that strong solutions of these equations remain strong under small enough changes of the initial condition and forcing function. We provide a smallness condition which is similar to the robustness conditions given for the $3$D incompressible Navier-Stokes equations by Chernyshenko et al. (2007) and Dashti & Robinson (2008).


title: The matrix product approximation for the dynamic cavity method

abstract: Stochastic dynamics of classical degrees of freedom, defined on vertices of locally tree-like graphs, can be studied in the framework of the dynamic cavity method which is exact for tree graphs. Such models correspond for example to spin-glass systems, Boolean networks, neural networks, and other technical, biological, and social networks. The central objects in the cavity method are edge messages -- conditional probabilities of two vertex variable trajectories. In this paper, we discuss a rather pedagogical derivation for the dynamic cavity method, give a detailed account of the novel matrix product edge message (MPEM) algorithm for the solution of the dynamic cavity equation as introduced in Phys. Rev. E 97, 010104(R) (2018), and present optimizations and extensions. Matrix product approximations of the edge messages are constructed recursively in an iteration over time. Computation costs and precision can be tuned by controlling the matrix dimensions of the MPEM in truncations. Without truncations, the dynamics is exact. Data for Glauber-Ising dynamics shows a linear growth of computation costs in time. In contrast to Monte Carlo simulations, the approach has a much better error scaling. Hence, it gives for example access to low probability events and decaying observables like temporal correlations. We discuss optimized truncation schemes and an extension that allows to capture models which have a continuum time limit.


title: On the computational tractability of statistical estimation on amenable graphs

abstract: We consider the problem of estimating a vector of discrete variables $(\theta_1,\cdots,\theta_n)$, based on noisy observations $Y_{uv}$ of the pairs $(\theta_u,\theta_v)$ on the edges of a graph $G=([n],E)$. This setting comprises a broad family of statistical estimation problems, including group synchronization on graphs, community detection, and low-rank matrix estimation. A large body of theoretical work has established sharp thresholds for weak and exact recovery, and sharp characterizations of the optimal reconstruction accuracy in such models, focusing however on the special case of Erd\"os--R\'enyi-type random graphs. The single most important finding of this line of work is the ubiquity of an information-computation gap. Namely, for many models of interest, a large gap is found between the optimal accuracy achievable by any statistical method, and the optimal accuracy achieved by known polynomial-time algorithms. Moreover, this gap is generally believed to be robust to small amounts of additional side information revealed about the $\theta_i$'s. How does the structure of the graph $G$ affect this picture? Is the information-computation gap a general phenomenon or does it only apply to specific families of graphs? We prove that the picture is dramatically different for graph sequences converging to amenable graphs (including, for instance, $d$-dimensional grids). We consider a model in which an arbitrarily small fraction of the vertex labels is revealed, and show that a linear-time local algorithm can achieve reconstruction accuracy that is arbitrarily close to the information-theoretic optimum. We contrast this to the case of random graphs. Indeed, focusing on group synchronization on random regular graphs, we prove that the information-computation gap still persists even when a small amount of side information is revealed.

categories: math.PR cs.DS cs.IT math.IT math.ST stat.TH


title: Dissecting the Phase Space Snail Shell

abstract: The on-going vertical phase mixing, manifesting itself as a snail shell in the $Z-V_{Z}$ phase space, has been discovered with the Gaia DR2 data. To better understand the origin and properties of the phase mixing process, we study the vertical phase-mixing signatures in arches (including the classical ``moving groups'') of the $V_{R}-V_{\phi}$ phase space near the Solar circle. Interestingly, the phase space snail shell exists only in the arches with $|V_{\phi} - V_{\rm LSR}| \lesssim 30$ km/s, i.e., stars on dynamically ``colder'' orbits. The snail shell becomes much weaker and eventually disappears for increasingly larger radial action ($J_{R}$), quantifying the ``hotness'' of orbits. Thus one should pay closer attention to the colder orbits in future phase mixing studies. We also confirm that the Hercules stream has two branches (at fast and slow $V_{\phi}$), which may not be explained by a single mechanism, since only the fast branch shows the prominent snail shell feature. The hotter orbits may have phase-wrapped away already due to the much larger dynamical range in radial variation to facilitate faster phase mixing. To explain the lack of a well-defined snail shell in the hotter orbits, the disk should have been perturbed at least $500$ Myr ago. Our results offer more support to the recent satellite-disk encounter scenario than the internal bar buckling perturbation scenario as the origin of the phase space mixing. Origin of the more prominent snail shell in the $V_{\phi}$ color-coded phase space is also discussed.


title: Opacities for Photon Splitting and Pair Creation in Neutron Star Magnetospheres

abstract: Over the last four decades, persistent and flaring emission of magnetars observed by various telescopes has provided us with a suite of light curves and spectra in soft and hard X-rays, with no emission yet detected above around 1 MeV. Attenuation of such high-energy photons by magnetic pair creation and photon splitting is expected to be active in the magnetospheres of magnetars, possibly accounting for the paucity of gamma-rays in their signals. This paper explores polarization-dependent opacities for these two QED processes in static vacuum dipole magnetospheres of highly-magnetized neutron stars, calculating attenuation lengths and determining escape energies, which are the maximum photon energies for transparency out to infinity. The numerical trajectory integral analysis in flat and curved spacetimes provides upper bounds of a few MeV or less to the visible energies for magnetars for locales proximate to the stellar surface. Photon splitting opacity alone puts constraints on the possible emission locales in their magnetospheres: regions within field loops of maximum altitudes 2-4 stellar radii are not commensurate with maximum detected energies of around 250 keV. These constraints apply not only to magnetar flares but also to their quiescent hard X-ray tail emission. An exploration of photon splitting attenuation in the context of a resonant inverse Compton scattering model for the hard X-ray tails derives distinctive phase-resolved spectroscopic and polarimetric signatures, of significant interest for future MeV-band missions such as AMEGO and e-ASTROGAM.


title: Coherent Phonon Transport in Two-dimensional Graphene Superstructures

abstract: Coherent wave effects of thermal phonons hold promise of transformative opportunities in thermal transport control but remain largely unexplored due to the small wavelength of thermal phonons, typically below a few nanometers. This small length scale indicates that, instead of artificial phononic crystals, a more promising direction is to examine the coherent phonon effects in natural materials with hierarchical superstructures matching the thermal phonon wavelength. In this work, we use first-principles simulations to characterize the previously unstudied thermal properties of D-graphene and T-graphene, two-dimensional carbon allotropes based upon the traditional graphene structure but containing a secondary, in-plane periodicity. We find that despite very similar atomic structure and bonding strength, D-graphene and T-graphene possess significantly different thermal properties than that of pristine graphene. At room temperature, the calculated thermal conductivity of D-graphene and T-graphene is 600 Wm-1K-1 and 800 Wm-1K-1 compared to over 3000 Wm-1K-1 for graphene. We attribute these distinct properties to the presence of naturally occurring, low frequency optical phonon modes that display characteristics of phonon coherence and arise from a folding of the acoustic modes and the associated frequency gap opening, a phenomenon also found in superlattices where an out of plane periodicity is introduced. Furthermore, we observe significantly enhanced Umklapp scatterings in D- and T-graphene that largely suppress the hydrodynamic phonon transport in pristine graphene. Our study presents D-graphene and T-graphene as ideal model systems to explore the coherent phonon effects in 2D and demonstrates the potential of using coherent phonon effects to significantly modify thermal transport of 2D materials without making drastic changes to their fundamental compositions.


title: A Flexible, Parallel, Adaptive Geometric Multigrid method for FEM

abstract: We present the design and implementation details of a geometric multigrid method on adaptively refined meshes for massively parallel computations. The method uses local smoothing on the refined part of the mesh. Partitioning is achieved by using a space filling curve for the leaf mesh and distributing ancestors in the hierarchy based on the leaves. We present a model of the efficiency of mesh hierarchy distribution and compare its predictions to runtime measurements. The algorithm is implemented as part of the deal.II finite element library and as such available to the public.


title: Scalar field dark matter with a cosh potential, revisited

abstract: Dark matter models in which the constituent particle is an ultra-light boson have become part of the mainstream discussion in cosmology and astrophysics. At the classical level, the models are represented by the dynamics of a (real or complex) scalar field endowed with a potential that contains its self-interactions, and for this reason are generically known as scalar field dark matter models. Here, we revisit the properties of such a model with a cosh potential and compare it with other known examples in the literature. Within the cosmological context, the self-interaction in the potential induces a radiation-like behavior at early times of the scalar field density, which is followed by a proper matter-like behavior at the onset of rapid field oscillations around the minimum of the potential. The solutions are found by numerical means, and from them we obtain information about the cosmological observables up to the level of linear density perturbations. We also study the general properties of self-gravitating objects in the non-relativistic limit and determine the role in them of the self-interaction obtained from the cosh potential. An overall conclusion is that, for the range of values in its parameters allowed by different constraints, a cosh potential behaves almost indistinguishable from the simpler quadratic one, which also means that the two models suffer the same tight constraints from cosmological and astrophysical observations.


title: The KPZ Universality Class and Related Topics

abstract: These notes are based on a talk given at the 2018 Arizona School of Analysis and Mathematical Physics. We give a comprehensive introduction to the KPZ universality class, a conjectured class of stochastic process with local interactions related to random growth processes in $1+1$ dimensions. We describe some of the characteristic properties of the KPZ universality class such as scaling exponents and limiting statistics. In particular, we aim to extract the characteristic properties of the KPZ universality class by understanding the KPZ stochastic partial differential equation by a special discrete approximation given by the asymmetric simple exclusion process (ASEP). The connection with the ASEP is very important as the process enjoys a rich integrability structure that leads to many exact formulas.


title: A Visual Model for Web Applications Security Monitoring

abstract: This paper proposes a novel visual model for web applications security monitoring. Although an automated intrusion detection system can shield a web application from common attacks, it usually cannot detect more complicated break-ins. So, a human-assisted monitoring system is an indispensable complement, following the "Defense in depth" strategy. To support human operators working more effectively and efficiently, information visualization techniques are utilized in this model. A prototype implementation of this model is created and is used to test against a popular open source web application. Testing results prove the model's usefulness, at least in understanding the web application security structure.


title: Computer Vision Approach to Study Deformation of Materials

abstract: Characterization of the deformation of materials across different length scales has continuously attracted enormous attention from the mechanics and materials communities. In this study, the possibility of utilizing a computer vision algorithm to extract deformation information of materials has been explored, which greatly expands the use of computer vision approaches to studying mechanics of materials and potentially opens new dialogues between the two communities. The computer vision algorithm is first developed and tested on computationally deformed images, before evaluating experimentally collected images on speckle painted samples before and after deformation. Moreover, a virtual experiment has also shown the feasibility of mapping surface strain of a sample based on its natural pattern with significantly improved accuracy compared to DIC result, which provides new opportunities in experimentation and computer algorithms to study deformation mechanics of materials. Validation experiments include evaluating the performance of strain mapping using the computer vision approach in the uniaxial tensile test and three-point bending test, compared with extensometer reading and digital image correlation respectively.


title: Optimal Nash Equilibria for Bandwidth Allocation

abstract: In bandwidth allocation, competing agents wish to transmit data along paths of links in a network, and each agent's utility is equal to the minimum bandwidth she receives among all links in her desired path. Recent market mechanisms for this problem have either focused on only Nash welfare, or ignored strategic behavior. We propose a nonlinear variant of the classic trading post mechanism, and show that for almost the entire family of CES welfare functions (which includes maxmin welfare, Nash welfare, and utilitarian welfare), every Nash equilibrium of our mechanism is optimal. We also prove that fully strategyproof mechanisms for this problem are impossible in general, with the exception of maxmin welfare. More broadly, our work shows that even small modifications (such as allowing nonlinear constraints) can dramatically increase the power of market mechanisms like trading post.


title: Publicly Available Clinical BERT Embeddings

abstract: Contextual word embedding models such as ELMo (Peters et al., 2018) and BERT (Devlin et al., 2018) have dramatically improved performance for many natural language processing (NLP) tasks in recent months. However, these models have been minimally explored on specialty corpora, such as clinical text; moreover, in the clinical domain, no publicly-available pre-trained BERT models yet exist. In this work, we address this need by exploring and releasing BERT models for clinical text: one for generic clinical text and another for discharge summaries specifically. We demonstrate that using a domain-specific model yields performance improvements on three common clinical NLP tasks as compared to nonspecific embeddings. These domain-specific models are not as performant on two clinical de-identification tasks, and argue that this is a natural consequence of the differences between de-identified source text and synthetically non de-identified task text.


title: QED Phenomena in an Ultrastrong Magnetic Field. I. Electron-Photon Scattering, Pair Creation, and Annihilation

abstract: We evaluate several basic electrodynamic processes as modified by the presence of a very strong magnetic field, exceeding $B_{\rm Q} \equiv m^2/e = 4.4\times 10^{13}$ G. These results are needed to build models of dissipative phenomena outside magnetars and some other neutron stars. Differential and total cross sections and rates are presented for electron-photon scattering, the annihilation of an electron-positron pair into two photons, the inverse process of two-photon pair creation, and single-photon pair creation into the lowest Landau state. The relative importance of these interactions changes as the background magnetic field grows in strength. The particle phase space relevant for a given process may be restricted by single-photon pair creation, which also opens up efficient channels for pair multiplication, e.g. in combination with scattering. Our results are presented in the form of compact formulae that allow for relativistic electron (positron) motion, in the regime where Landau excitations can be neglected (corresponding to $10^3B_{\rm Q} \gg B \gg B_{\rm Q}$ for moderately relativistic motion along the magnetic field). Where a direct comparison is possible, our results are tested against earlier calculations, and a brief astrophysical context is provided. A companion paper considers electron-positron scattering, scattering of electrons and positrons by ions, and relativistic electron-ion bremsstrahlung.