title: Sharp Bounds for the Integrated Density of States of a Strongly Disordered 1D Anderson-Bernoulli Model

abstract: In this article we give upper and lower bounds for the integrated density of states (IDS) of the 1D discrete Anderson-Bernoulli model when the disorder is strong enough to separate the two spectral bands. These bounds are uniform on the disorder and hold over the whole spectrum. They show the existence of a sequence of energies in which the value of the IDS can be given explicitly and does not depend on the disorder parameter.


title: A Neural Network Approach Applied to Multi-Agent Optimal Control

abstract: We propose a neural network approach for solving high-dimensional optimal control problems. In particular, we focus on multi-agent control problems with obstacle and collision avoidance. These problems immediately become high-dimensional, even for moderate phase-space dimensions per agent. Our approach fuses the Pontryagin Maximum Principle and Hamilton-Jacobi-Bellman (HJB) approaches and parameterizes the value function with a neural network. Our approach yields controls in a feedback form for quick calculation and robustness to moderate disturbances to the system. We train our model using the objective function and optimality conditions of the control problem. Therefore, our training algorithm neither involves a data generation phase nor solutions from another algorithm. Our model uses empirically effective HJB penalizers for efficient training. By training on a distribution of initial states, we ensure the controls' optimality is achieved on a large portion of the state-space. Our approach is grid-free and scales efficiently to dimensions where grids become impractical or infeasible. We demonstrate our approach's effectiveness on a 150-dimensional multi-agent problem with obstacles.


title: Direct Numerical Simulations of the Swirling von Karman Flow Using a Semi-implicit Moving Immersed Boundary Method

abstract: We present a novel moving immersed boundary method (IBM) and employ it in direct numerical simulations (DNS) of the closed-vessel swirling von Karman flow in laminar and turbulent regimes. The IBM extends direct-forcing approaches by leveraging a time integration scheme, that embeds the immersed boundary forcing step within a semi-implicit iterative Crank-Nicolson scheme. The overall method is robust, stable, and yields excellent results in canonical cases with static and moving boundaries. The moving IBM allows us to reproduce the geometry and parameters of the swirling von Karman flow experiments in (F. Ravelet, A. Chiffaudel, and F. Daviaud, JFM 601, 339 (2008)) on a Cartesian grid. In these DNS, the flow is driven by two-counter rotating impellers fitted with curved inertial stirrers. We analyze the transition from laminar to turbulent flow by increasing the rotation rate of the counter-rotating impellers to attain the four Reynolds numbers 90, 360, 2000, and 4000. In the laminar regime at Reynolds number 90 and 360, we observe flow features similar to those reported in the experiments and in particular, the appearance of a symmetry-breaking instability at Reynolds number 360. We observe transitional turbulence at Reynolds number 2000. Fully developed turbulence is achieved at Reynolds number 4000. Non-dimensional torque computed from simulations matches correlations from experimental data. The low Reynolds number symmetries, lost with increasing Reynolds number, are recovered in the mean flow in the fully developed turbulent regime, where we observe two tori symmetrical about the mid-height plane. We note that turbulent fluctuations in the central region of the device remain anisotropic even at the highest Reynolds number 4000, suggesting that isotropization requires significantly higher Reynolds numbers.


title: International Coordination and Support for SmallSat-enabled Space Weather Activities

abstract: Advances in space weather science and small satellite (SmallSat) technology have proceeded in parallel over the past two decades, but better communication and coordination is needed among the respective worldwide communities contributing to this rapid progress. We identify six areas where improved international coordination is especially desirable, including: (1) orbital debris mitigation; (2) spectrum management; (3) export control regulations; (4) access to timely and low-cost launch opportunities; (5) inclusive data policies; and (6) education. We argue the need for internationally coordinated policies and programs to promote the use of SmallSats for space weather research and forecasting while realizing maximum scientific and technical advances through the integration of these two increasingly important endeavors.

categories: astro-ph.IM astro-ph.EP astro-ph.SR physics.space-ph


title: Diamond Message Set Groupcasting: From an Inner Bound for the DM Broadcast Channel to the Capacity Region of the Combination Network

abstract: Multiple groupcasting over the broadcast channel (BC) is studied. In particular, an inner bound is obtained for the $K$-receiver discrete memoryless (DM) BC for the diamond message set which consists of four groupcast messages: one desired by all receivers, one by all but two receivers, and two more desired by all but each one of those two receivers. The inner bound is based on rate-splitting and superposition coding and is given in explicit form herein as a union over coding distributions of four-dimensional polytopes. When specialized to the so-called combination network, which is a class of three-layer (two-hop) broadcast networks parameterized by $2^K-1$ finite-and-arbitrary-capacity noiseless links from the source node in the first layer to as many nodes of the second layer, our top-down approach from the DM BC to the combination network yields an explicit inner bound as a single polytope via the identification of a single coding distribution. This inner bound consists of inequalities which are then identified to be within the class of a plethora of (indeed, infinitely many) generalized cut-set outer bounds recently obtained by Salimi et al for broadcast networks. We hence establish the capacity region of the general $K$-user combination network for the diamond message set, and do so in explicit form. Such a result implies a certain strength of our inner bound for the DM BC in that it (a) produces a hitherto unknown capacity region when specialized to the combination network and (b) may capture many combinatorial aspects of the capacity region of the $K$-receiver DM BC itself (for the diamond message set). Moreover, we further extend that inner bound by adding binning to it and providing that inner bound also in explicit form as a union over coding distributions of four-dimensional polytopes in the message rates.


title: MUSE: Textual Attributes Guided Portrait Painting Generation

abstract: We propose a novel approach, MUSE, to illustrate textual attributes visually via portrait generation. MUSE takes a set of attributes written in text, in addition to facial features extracted from a photo of the subject as input. We propose 11 attribute types to represent inspirations from a subject's profile, emotion, story, and environment. We propose a novel stacked neural network architecture by extending an image-to-image generative model to accept textual attributes. Experiments show that our approach significantly outperforms several state-of-the-art methods without using textual attributes, with Inception Score score increased by 6% and Fr\'echet Inception Distance (FID) score decreased by 11%, respectively. We also propose a new attribute reconstruction metric to evaluate whether the generated portraits preserve the subject's attributes. Experiments show that our approach can accurately illustrate 78% textual attributes, which also help MUSE capture the subject in a more creative and expressive way.


title: Predicting Landsat Reflectance with Deep Generative Fusion

abstract: Public satellite missions are commonly bound to a trade-off between spatial and temporal resolution as no single sensor provides fine-grained acquisitions with frequent coverage. This hinders their potential to assist vegetation monitoring or humanitarian actions, which require detecting rapid and detailed terrestrial surface changes. In this work, we probe the potential of deep generative models to produce high-resolution optical imagery by fusing products with different spatial and temporal characteristics. We introduce a dataset of co-registered Moderate Resolution Imaging Spectroradiometer (MODIS) and Landsat surface reflectance time series and demonstrate the ability of our generative model to blend coarse daily reflectance information into low-paced finer acquisitions. We benchmark our proposed model against state-of-the-art reflectance fusion algorithms.


title: Pandemic Policymaking: Learning the Lower Dimensional Manifold of Congressional Responsiveness

abstract: A recent study leveraging text of pandemic-related policymaking from 1973--2020 explored whether pandemic policymaking has evolved, or whether we are witnessing a new, unique era of policymaking as it relates to large-scale crises like COVID-19. This research picks up on this approach over the same period of study and based on the same data, but excluding text. Instead, using high dimensional manifold learning, this study explores the latent structure of the pandemic policymaking space based only on bill-level characteristics. Results indicate the COVID-19 era of policymaking maps extremely closely onto prior periods of related policymaking. This suggests that there is less of an "evolutionary trend" in pandemic policymaking, where instead there is striking uniformity in Congressional policymaking related to these types of large-scale crises, despite being in a unique era of hyperpolarization, division, and ineffective governance.


title: Deep Reinforcement Learning for Navigation in AAA Video Games

abstract: In video games, non-player characters (NPCs) are used to enhance the players' experience in a variety of ways, e.g., as enemies, allies, or innocent bystanders. A crucial component of NPCs is navigation, which allows them to move from one point to another on the map. The most popular approach for NPC navigation in the video game industry is to use a navigation mesh (NavMesh), which is a graph representation of the map, with nodes and edges indicating traversable areas. Unfortunately, complex navigation abilities that extend the character's capacity for movement, e.g., grappling hooks, jetpacks, teleportation, or double-jumps, increases the complexity of the NavMesh, making it intractable in many practical scenarios. Game designers are thus constrained to only add abilities that can be handled by a NavMesh if they want to have NPC navigation. As an alternative, we propose to use Deep Reinforcement Learning (Deep RL) to learn how to navigate 3D maps using any navigation ability. We test our approach on complex 3D environments in the Unity game engine that are notably an order of magnitude larger than maps typically used in the Deep RL literature. One of these maps is directly modeled after a Ubisoft AAA game. We find that our approach performs surprisingly well, achieving at least $90\%$ success rate on all tested scenarios. A video of our results is available at https://youtu.be/WFIf9Wwlq8M.


title: Singular Sturm-Liouville Problems with Zero Potential (q=0) and Singular Slow Feature Analysis

abstract: A Sturm-Liouville problem ($\lambda wy=(ry')'+qy$) is singular if its domain is unbounded or if $r$ or $w$ vanish at the boundary. Then it is difficult to tell whether profound results from regular Sturm-Liouville theory apply. Existing criteria are often difficult to apply, e.g. because they are formulated in terms of the solution function. We study the special case that the potential $q$ is zero under Neumann boundary conditions and give simple and explicit criteria, solely in terms of the coefficient functions, to assess whether various properties of the regular case apply. Specifically, these properties are discreteness of the spectrum (BD), self-adjointness, oscillation ($i$th solution has $i$ zeros) and that the $i$th eigenvalue equals the SFA delta value (the total energy) of the $i$th solution. We further prove that stationary points of each solution strictly interlace with its zeros (in singular or regular case, regardless of the boundary condition, for zero potential or if $q < \lambda w$ everywhere). If $\frac{r}{w}$ is bounded and of bounded variation, the criterion simplifies to requiring $\frac{|w'|}{w} \to \infty$ at singular boundary points. This research is motivated by Slow Feature Analysis (SFA), a data processing algorithm that extracts the slowest uncorrelated signals from a high-dimensional input signal and has notable success in computer vision, computational neuroscience and blind source separation. From [Sprekeler et al., 2014] it is known that for an important class of scenarios (statistically independent input), an analytic formulation of SFA reduces to a Sturm-Liouville problem with zero potential and Neumann boundary conditions. So far, the mathematical SFA theory has only considered the regular case, except for a special case that is solved by Hermite Polynomials. This work generalizes SFA theory to the singular case, i.e. open-space scenarios.


title: A liberal type I error rate for studies in precision medicine

abstract: We introduce a new multiple type I error criterion for clinical trials with multiple populations. Such trials are of interest in precision medicine where the goal is to develop treatments that are targeted to specific sub-populations defined by genetic and/or clinical biomarkers. The new criterion is based on the observation that not all type I errors are relevant to all patients in the overall population. If disjoint sub-populations are considered, no multiplicity adjustment appears necessary, since a claim in one sub-population does not affect patients in the other ones. For intersecting sub-populations we suggest to control the average multiple type error rate, i.e. the probably that a randomly selected patient will be exposed to an inefficient treatment. We call this the population-wise error rate, exemplify it by a number of examples and illustrate how to control it with an adjustment of critical boundaries or adjusted p-values. We furthermore define corresponding simultaneous confidence intervals. We finally illustrate the power gain achieved by passing from family-wise to population-wise error rate control with two simple examples and a recently suggest multiple testing approach for umbrella trials.


title: An Analysis of Dataset Overlap on Winograd-Style Tasks

abstract: The Winograd Schema Challenge (WSC) and variants inspired by it have become important benchmarks for common-sense reasoning (CSR). Model performance on the WSC has quickly progressed from chance-level to near-human using neural language models trained on massive corpora. In this paper, we analyze the effects of varying degrees of overlap between these training corpora and the test instances in WSC-style tasks. We find that a large number of test instances overlap considerably with the corpora on which state-of-the-art models are (pre)trained, and that a significant drop in classification accuracy occurs when we evaluate models on instances with minimal overlap. Based on these results, we develop the KnowRef-60K dataset, which consists of over 60k pronoun disambiguation problems scraped from web data. KnowRef-60K is the largest corpus to date for WSC-style common-sense reasoning and exhibits a significantly lower proportion of overlaps with current pretraining corpora.


title: On compactness of classes of solutions of the Dirichlet problem with restrictions of the theoretics-set type

abstract: We have proved theorems on compact classes of homeomorphisms with hydrodynamic normalization that are solutions of the Beltrami equation, whose characteristics are compactly supported and satisfy certain constraints of the theoretical-set type. As a consequence, we obtained results on compact classes of solutions of corresponding Dirichlet problems considered in some Jordan domain.


title: From supernova to supernova remnant: comparison of thermonuclear explosion models

abstract: Progress in the three-dimensional modeling of supernovae (SN) prompts us to revisit the supernova remnant (SNR) phase. We continue our study of the imprint of a thermonuclear explosion on the SNR it produces, that we started with a delayed-detonation model of a Chandrasekhar-mass white dwarf. Here we compare two different types of explosion models, each with two variants: two delayed detonation models (N100ddt, N5ddt) and two pure deflagration models (N100def, N5def), where the N number parametrizes the ignition. The output of each SN simulation is used as input of a SNR simulation carried on until 500 yr after the explosion. While all SNR models become more spherical over time and overall display the theoretical structure expected for a young SNR, clear differences are visible amongst the models, depending on the geometry of the ignition and on the presence or not of detonation fronts. Compared to N100 models, N5 models have a strong dipole component, and produce asymmetric remnants. N5def produces a regular-looking, but offset remnant, while N5ddt produces a two-sided remnant. Pure deflagration models exhibit specific traits: a central over-density, because of the incomplete explosion, and a network of seam lines across the surface, boundaries between burning cells. Signatures from the SN dominate the morphology of the SNR up to 100 yr to 300 yr after the explosion, depending on the model, and are still measurable at 500 yr, which may provide a way of testing explosion models.


title: Deep Bayesian Nonparametric Factor Analysis

abstract: We propose a deep generative factor analysis model with beta process prior that can approximate complex non-factorial distributions over the latent codes. We outline a stochastic EM algorithm for scalable inference in a specific instantiation of this model and present some preliminary results.


title: Local Topological Markers in Odd Dimensions

abstract: Local topological markers have proven to be a valuable tool for investigating systems with topologically non-trivial bands. Due to their local nature, such markers can treat translationally invariant systems and spatially inhomogeneous systems on an equal footing. Among the most prevalent of these is the so-called Chern marker, which is available for systems in two spatial dimensions. In this paper, we describe how to generalize this marker to 1d and 3d systems, by showing that the relevant expressions accurately describe the phenomenon of topological pumping given by the first and second Chern numbers in 1d and 3d respectively. In addition to providing general derivations, we verify the markers by numerically considering model Hamiltonians. These results will open the door for future studies including the influence of disorder on topological pumping and topological phase transitions in odd-dimensional systems.


title: Towards One-Dollar Robots: An Integrated Design and Fabrication Strategy for Electromechanical Systems

abstract: To improve the accessibility of robotics, we propose a design and fabrication strategy to build low-cost electromechanical systems for robotic devices. Our method, based on origami-inspired cut-and-fold and E-textiles techniques, aims at minimizing the resources for robot creation. Specifically, we explore techniques to create robots with the resources restricted to single-layer sheets (e.g. polyester film) and conductive sewing threads. To demonstrate our strategy's feasibility, these techniques are successfully integrated into an electromechanical oscillator (about 0.40 USD), which can generate electrical oscillation under constant-current power and potentially be used as a simple robot controller in lieu of additional external electronics.


title: Summations of large logarithms by parton showers

abstract: We propose a method to examine how a parton shower sums large logarithms. In this method, one works with an appropriate integral transform of the distribution for the observable of interest. Then, one reformulates the parton shower so as to obtain the transformed distribution as an exponential for which one can compute the terms in the perturbative expansion of the exponent. We apply this general program to the thrust distribution in electron-positron annihilation, using several shower algorithms. Of the approaches that we use, the most generally applicable is to compute some of the perturbative coefficients in the exponent by numerical integration and to test whether they are consistent with next-to-leading-log summation of the thrust logarithms.


title: Charge carrier density noise in graphene: effect of localized/delocalized traps

abstract: Graphene-based devices show $1/f$ low-frequency noise in several electronic transport properties, such as mobility and charge carrier concentration. The recent outburst of experimental studies on graphene-based devices integrated into circuit quantum electrodynamics systems has rekindled the interest in low-frequency charge noise. We investigate charge carrier density noise in graphene within the McWorther model where noise is induced by electron traps in the substrate. We focus on the large doping regime and introduce a simple modelization of the effect of localized/delocalized traps in terms of single/double spin occupancy of trap states. We find that in both cases the charge carrier spectrum of graphene obeys the $1/f^\alpha$ power-law behavior where $\alpha$ is very close to the unity, and for each case we evaluate the deviation $\beta=1-\alpha$. The amplitude of the noise is found to depend on the trap energy distribution and on temperature. Single/double spin occupancy of trap states influences the temperature dependence of noise amplitude only to second order.


title: $\mathcal{N}=2$ consistent truncations from wrapped M5-branes

abstract: We discuss consistent truncations of eleven-dimensional supergravity on a six-dimensional manifold $M$, preserving minimal $\mathcal{N}=2$ supersymmetry in five dimensions. These are based on $G_S \subseteq USp(6)$ structures for the generalised $E_{6(6)}$ tangent bundle on $M$, such that the intrinsic torsion is a constant $G_S$ singlet. We spell out the algorithm defining the full bosonic truncation ansatz and then apply this formalism to consistent truncations that contain warped AdS$_5 \times_{\rm w}M$ solutions arising from M5-branes wrapped on a Riemann surface. The generalised $U(1)$ structure associated with the $\mathcal{N}=2$ solution of Maldacena-Nu\~nez leads to five-dimensional supergravity with four vector multiplets, one hypermultiplet and $SO(3)\times U(1)\times \mathbb{R}$ gauge group. The generalised structure associated with "BBBW" solutions yields two vector multiplets, one hypermultiplet and an abelian gauging. We argue that these are the most general consistent truncations on such backgrounds.


title: Learnings from Frontier Development Lab and SpaceML -- AI Accelerators for NASA and ESA

abstract: Research with AI and ML technologies lives in a variety of settings with often asynchronous goals and timelines: academic labs and government organizations pursue open-ended research focusing on discoveries with long-term value, while research in industry is driven by commercial pursuits and hence focuses on short-term timelines and return on investment. The journey from research to product is often tacit or ad hoc, resulting in technology transition failures, further exacerbated when research and development is interorganizational and interdisciplinary. Even more, much of the ability to produce results remains locked in the private repositories and know-how of the individual researcher, slowing the impact on future research by others and contributing to the ML community's challenges in reproducibility. With research organizations focused on an exploding array of fields, opportunities for the handover and maturation of interdisciplinary research reduce. With these tensions, we see an emerging need to measure the correctness, impact, and relevance of research during its development to enable better collaboration, improved reproducibility, faster progress, and more trusted outcomes. We perform a case study of the Frontier Development Lab (FDL), an AI accelerator under a public-private partnership from NASA and ESA. FDL research follows principled practices that are grounded in responsible development, conduct, and dissemination of AI research, enabling FDL to churn successful interdisciplinary and interorganizational research projects, measured through NASA's Technology Readiness Levels. We also take a look at the SpaceML Open Source Research Program, which helps accelerate and transition FDL's research to deployable projects with wide spread adoption amongst citizen scientists.


title: Summations by parton showers of large logarithms in electron-positron annihilation

abstract: In a companion publication, we have explored how to examine the summation of large logarithms in a parton shower. Here, we apply this general program to the thrust distribution in electron-positron annihilation, using several shower algorithms. The method is to work with an appropriate integral transform of the distribution for the observable of interest. Then, we reformulate the parton shower calculation so as to obtain the transformed distribution as an exponential for which we can compute the terms in the perturbative expansion of the exponent.


title: Graph Homomorphism Polynomials: Algorithms and Complexity

abstract: We study homomorphism polynomials, which are polynomials that enumerate all homomorphisms from a pattern graph $H$ to $n$-vertex graphs. These polynomials have received a lot of attention recently for their crucial role in several new algorithms for counting and detecting graph patterns, and also for obtaining natural polynomial families which are complete for algebraic complexity classes $\mathsf{VBP}$, $\mathsf{VP}$, and $\mathsf{VNP}$. We discover that, in the monotone setting, the formula complexity, the ABP complexity, and the circuit complexity of such polynomial families are exactly characterized by the treedepth, the pathwidth, and the treewidth of the pattern graph respectively. Furthermore, we establish a single, unified framework, using our characterization, to collect several known results that were obtained independently via different methods. For instance, we attain superpolynomial separations between circuits, ABPs, and formulas in the monotone setting, where the polynomial families separating the classes all correspond to well-studied combinatorial problems. Moreover, our proofs rediscover fine-grained separations between these models for constant-degree polynomials. The characterization additionally yields new space-time efficient algorithms for several pattern detection and counting problems.


title: After All, Only The Last Neuron Matters: Comparing Multi-modal Fusion Functions for Scene Graph Generation

abstract: From object segmentation to word vector representations, Scene Graph Generation (SGG) became a complex task built upon numerous research results. In this paper, we focus on the last module of this model: the fusion function. The role of this latter is to combine three hidden states. We perform an ablation test in order to compare different implementations. First, we reproduce the state-of-the-art results using SUM, and GATE functions. Then we expand the original solution by adding more model-agnostic functions: an adapted version of DIST and a mixture between MFB and GATE. On the basis of the state-of-the-art configuration, DIST performed the best Recall @ K, which makes it now part of the state-of-the-art.


title: A public code for astrometric microlensing with contour integration

abstract: We present the first public code for the calculation of the astrometric centroid shift occurring during microlensing events. The computation is based on the contour integration scheme and covers single and binary lensing of finite sources with arbitrary limb darkening profiles. This allows for general detailed investigations of the impact of finite source size in astrometric binary microlensing. The new code is embedded in version 3.0 of VBBinaryLensing, which offers a powerful computational tool for extensive studies of microlensing data from current surveys and future space missions.


title: Cosmic Wheels: From integrability to the Galois coaction

abstract: We argue that the description of Feynman loop integrals as integrable systems is intimately connected with their motivic properties and the action of the Cosmic Galois Group. We show how in the case of a family of fishnet graphs, coaction relations between graphs follow directly from iterative constructions of Q-functions in the Quantum Spectral Curve formalism. Using this observation we conjecture a "differential equation for numbers" that enter these periods.


title: Planning under Uncertainty to Goal Distributions

abstract: Goals for planning problems are typically conceived of as subsets of the state space. However, for many practical planning problems in robotics, we expect the robot to predict goals, e.g. from noisy sensors or by generalizing learned models to novel contexts. In these cases, sets with uncertainty naturally extend to probability distributions. While a few works have used probability distributions as goals for planning, surprisingly no systematic treatment of planning to goal distributions exists in the literature. This article serves to fill that gap. We argue that goal distributions are a more appropriate goal representation than deterministic sets for many robotics applications. We present a novel approach to planning under uncertainty to goal distributions, which we use to highlight several advantages of the goal distribution formulation. We build on previous results in the literature by formally framing our approach as an instance of planning as inference. We additionally derive reductions of several common planning objectives as special cases of our probabilistic planning framework. Our experiments demonstrate the flexibility of probability distributions as a goal representation on a variety of problems including planar navigation among obstacles, intercepting a moving target, rolling a ball to a target location, and a 7-DOF robot arm reaching to grasp an object.


title: Lifelong Learning Without a Task Oracle

abstract: Supervised deep neural networks are known to undergo a sharp decline in the accuracy of older tasks when new tasks are learned, termed "catastrophic forgetting". Many state-of-the-art solutions to continual learning rely on biasing and/or partitioning a model to accommodate successive tasks incrementally. However, these methods largely depend on the availability of a task-oracle to confer task identities to each test sample, without which the models are entirely unable to perform. To address this shortcoming, we propose and compare several candidate task-assigning mappers which require very little memory overhead: (1) Incremental unsupervised prototype assignment using either nearest means, Gaussian Mixture Models or fuzzy ART backbones; (2) Supervised incremental prototype assignment with fast fuzzy ARTMAP; (3) Shallow perceptron trained via a dynamic coreset. Our proposed model variants are trained either from pre-trained feature extractors or task-dependent feature embeddings of the main classifier network. We apply these pipeline variants to continual learning benchmarks, comprised of either sequences of several datasets or within one single dataset. Overall, these methods, despite their simplicity and compactness, perform very close to a ground truth oracle, especially in experiments of inter-dataset task assignment. Moreover, best-performing variants only impose an average cost of 1.7% parameter memory increase.


title: EstBERT: A Pretrained Language-Specific BERT for Estonian

abstract: This paper presents EstBERT, a large pretrained transformer-based language-specific BERT model for Estonian. Recent work has evaluated multilingual BERT models on Estonian tasks and found them to outperform the baselines. Still, based on existing studies on other languages, a language-specific BERT model is expected to improve over the multilingual ones. We first describe the EstBERT pretraining process and then present the results of the models based on finetuned EstBERT for multiple NLP tasks, including POS and morphological tagging, named entity recognition and text classification. The evaluation results show that the models based on EstBERT outperform multilingual BERT models on five tasks out of six, providing further evidence towards a view that training language-specific BERT models are still useful, even when multilingual models are available.


title: Benchmarking LF-MMI, CTC and RNN-T Criteria for Streaming ASR

abstract: In this work, to measure the accuracy and efficiency for a latency-controlled streaming automatic speech recognition (ASR) application, we perform comprehensive evaluations on three popular training criteria: LF-MMI, CTC and RNN-T. In transcribing social media videos of 7 languages with training data 3K-14K hours, we conduct large-scale controlled experimentation across each criterion using identical datasets and encoder model architecture. We find that RNN-T has consistent wins in ASR accuracy, while CTC models excel at inference efficiency. Moreover, we selectively examine various modeling strategies for different training criteria, including modeling units, encoder architectures, pre-training, etc. Given such large-scale real-world streaming ASR application, to our best knowledge, we present the first comprehensive benchmark on these three widely used training criteria across a great many languages.


title: An Adaptive Stable Space-Time FE Method for the Shallow Water Equations

abstract: We consider the finite element (FE) approximation of the shallow water equations (SWE) by considering discretizations in which both space and time are established using an unconditionally stable FE method. Particularly, we consider the automatic variationally stable FE (AVS-FE) method, a type of discontinuous Petrov-Galerkin (DPG) method. The philosophy of the DPG method allows us to break the test space and achieve unconditionally stable FE approximations as well as accurate a posteriori error estimators upon solution of a saddle point system of equations. The resulting error indicators allow us to employ mesh adaptive strategies and perform space-time mesh refinements, i.e., local time stepping. We derive a priori error estimates for the AVS-FE method and linearized SWE and perform numerical verifications to confirm corresponding asymptotic convergence behavior. In an effort to keep the computational cost low, we consider an alternative space-time approach in which the space-time domain is partitioned into finite sized space-time slices. Hence, we can perform adaptivity on each individual slice to preset error tolerances as needed for a particular application. Numerical verifications comparing the two alternatives indicate the space-time slices are superior for simulations over long times, whereas the solutions are indistinguishable for short times. Multiple numerical verifications show the adaptive mesh refinement capabilities of the AVS-FE method, as well the application of the method to commonly applied benchmarks for the SWE.


title: Topological insulator nanoribbon Josephson junctions: evidence for size effect in transport properties

abstract: We have used Bi$_2$Se$_3$ nanoribbons, grown by catalyst-free Physical Vapor Deposition to fabricate high quality Josephson junctions with Al superconducting electrodes. In our devices we observe a pronounced reduction of the Josephson critical current density $J_c$ by reducing the width of the junction, which in our case corresponds to the width of the nanoribbon. Because the topological surface states extend over the entire circumference of the nanoribbon, the superconducting transport associated to them is carried by modes on both the top and bottom surfaces of the nanoribbon. We show that the $J_c$ reduction as a function of the nanoribbons width can be accounted for by assuming that only the modes travelling on the top surface contribute to the Josephson transport as we derive by geometrical consideration. This finding is of a great relevance for topological quantum circuitry schemes, since it indicates that the Josephson current is mainly carried by the topological surface states.


title: Light mass window of lepton portal dark matter

abstract: We explore a novel possibility that dark matter has a light mass below 1GeV in a lepton portal dark matter model. There are Yukawa couplings involving dark matter, left-handed leptons and an extra scalar doublet in the model. In the light mass region, dark matter is thermally produced via its annihilation into neutrinos. In order to obtain the correct relic abundance and avoid collider bounds, a neutral scalar is required to be light while charged scalars need to be heavier than the electroweak scale. Such a mass spectrum is realized by adjusting quartic couplings in the scalar potential or introducing an extra singlet scalar. It turns out that the mass region of 10MeV-10GeV is almost free from experimental and observational constraints. We also point out that searches for extra neutrino flux from galactic dark matter annihilations with neutrino telescopes are the best way to test our model.


title: Privacy-Preserving XGBoost Inference

abstract: Although machine learning (ML) is widely used for predictive tasks, there are important scenarios in which ML cannot be used or at least cannot achieve its full potential. A major barrier to adoption is the sensitive nature of predictive queries. Individual users may lack sufficiently rich datasets to train accurate models locally but also be unwilling to send sensitive queries to commercial services that vend such models. One central goal of privacy-preserving machine learning (PPML) is to enable users to submit encrypted queries to a remote ML service, receive encrypted results, and decrypt them locally. We aim at developing practical solutions for real-world privacy-preserving ML inference problems. In this paper, we propose a privacy-preserving XGBoost prediction algorithm, which we have implemented and evaluated empirically on AWS SageMaker. Experimental results indicate that our algorithm is efficient enough to be used in real ML production environments.


title: Multifocal Terahertz Lens with Adjustable Focal Points

abstract: The conventional lens's tunability drawback always restricts their application compared to the metasurface lens (metalens). On the other side, reconfigurable metalenses offer the benefits of ultrathin thickness and capable of tunability. Therefore achieving reconfigurable functionalities in a single metasurface has attracted significant research interest for potential terahertz (THz) applications. In this paper, an adjustable metasurface is presented using Vanadium dioxide (VO2) to manipulate the electromagnetic waves and provide the full reflection phase. The phase-change metasurface is composed of a VO2 nanofilm, a silicon spacer, and a gold layer embedded in the structure's bottom. By employing the reconfigurable metasurface with the specific phase distribution, the incident beam can converge to determined points in any arbitrary manner, including the number of the focal points, focal points location, and power intensity ratio. Numerical simulations demonstrate that the proposed reconfigurable metasurface can concentrate power on one or more than one focal point in reflection modes as expected. Additionally, the VO2-based metasurface can control concentration width in a real-time manner using a novel proposed method. The simulation and theoretical results are in good agreement to verify the validity and feasibility of 2-bit metalens design, which has considerable potential in wireless high-speed communication and super-resolution imaging.


title: Radiogenic Heating and its Influence on Rocky Planet Dynamos and Habitability

abstract: The thermal evolution of rocky planets on geological timescales (Gyr) depends on the heat input from the long-lived radiogenic elements potassium, thorium, and uranium. Concentrations of the latter two in rocky planet mantles are likely to vary by up to an order of magnitude between different planetary systems because Th and U, like other heavy r-process elements, are produced by rare stellar processes. Here we discuss the effects of these variations on the thermal evolution of an Earth-size planet, using a 1D parameterized convection model. Assuming Th and U abundances consistent with geochemical models of the Bulk Silicate Earth based on chondritic meteorites, we find that Earth had just enough radiogenic heating to maintain a persistent dynamo. According to this model, Earth-like planets of stars with higher abundances of heavy r-process elements, indicated by the relative abundance of europium in their spectra, are likely to have lacked a dynamo for a significant fraction of their lifetimes, with potentially negative consequences for hosting a biosphere. Because the qualitative outcomes of our 1D model are strongly dependent on the treatment of viscosity, further investigations using fully 3D convection models are desirable.


title: Towards precision measurements of accreting black holes using X-ray reflection spectroscopy

abstract: Relativistic reflection features are commonly observed in the X-ray spectra of accreting black holes. In the presence of high quality data and with the correct astrophysical model, X-ray reflection spectroscopy can be quite a powerful tool to probe the strong gravity region, study the morphology of the accreting matter, measure black hole spins, and possibly test Einstein's theory of general relativity in the strong field regime. In the last decade, there has been significant progress in the development of the analysis of these features, thanks to more sophisticated astrophysical models and new observational facilities. Here we review the state-of-the-art in relativistic reflection modeling, listing assumptions and simplifications that may affect, at some level, the final measurements and may be investigated better in the future. We review black hole spin measurements and the most recent efforts to use X-ray reflection spectroscopy for testing fundamental physics.


title: A Broadband Signal Recycling Scheme for Approaching the Quantum Limit from Optical Losses

abstract: Quantum noise limits the sensitivity of laser interferometric gravitational-wave detectors. Given the state-of-the-art optics, the optical losses define the lower bound of the best possible quantum-limited detector sensitivity. In this work, we come up with a broadband signal recycling scheme which gives potential solution to approaching this lower bound by converting the signal recycling cavity to be a broadband signal amplifier using an active optomechanical filter. We will show the difference and advantage of such a scheme compared with the previous white light cavity scheme using the optomechanical filter in [Phys.Rev.Lett.115.211104 (2015)]. The drawback is that the new scheme is more susceptible to the thermal noise of the mechanical oscillator.


title: Estimating Total Correlation with Mutual Information Estimators

abstract: Total correlation (TC) is a fundamental concept in information theory that measures statistical dependency among multiple random variables. Recently, TC has shown noticeable effectiveness as a regularizer in many learning tasks, where the correlation among multiple latent embeddings requires to be jointly minimized or maximized. However, calculating precise TC values is challenging, especially when the closed-form distributions of embedding variables are unknown. In this paper, we introduce a unified framework to estimate total correlation values with sample-based mutual information (MI) estimators. More specifically, we discover a relation between TC and MI and propose two types of calculation paths (tree-like and line-like) to decompose TC into MI terms. With each MI term being bounded, the TC values can be successfully estimated. Further, we provide theoretical analyses concerning the statistical consistency of the proposed TC estimators. Experiments are presented on both synthetic and real-world scenarios, where our estimators demonstrate effectiveness in all TC estimation, minimization, and maximization tasks. The code is available at https://github.com/Linear95/TC-estimation.


title: Computational Design of Moir\'e Assemblies Aided by Artificial Intelligence

abstract: Two-dimensional (2D) layered materials, demonstrating significantly different properties from their bulk counterparts, offer a materials platform with potential applications from energy to information processing devices. Although some single- and few-layer forms of materials such as graphene and transition metal dichalcogenides have been realized and thoroughly studied, the space of arbitrarily layered assemblies is still mostly unexplored. The main goal of this work is to demonstrate precise control of layered materials' electronic properties through careful choice of the constituent layers, their stacking, and relative orientation. Physics-based and AI-driven approaches for the automated planning, execution, and analysis of electronic structure calculations are applied to layered assemblies based on prototype one-dimensional (1D) materials and realistic 2D materials. We find it is possible to routinely generate moir\'e band structures in 1D with desired electronic characteristics such as a band gap of any value within a large range, even with few layers and materials (here, four and six, respectively). We argue that this tunability extends to 2D materials by showing the essential physical ingredients are already evident in calculations of two-layer MoS$_2$ and multi-layer graphene moir\'e assemblies.


title: Modeling Trust in Human-Robot Interaction: A Survey

abstract: As the autonomy and capabilities of robotic systems increase, they are expected to play the role of teammates rather than tools and interact with human collaborators in a more realistic manner, creating a more human-like relationship. Given the impact of trust observed in human-robot interaction (HRI), appropriate trust in robotic collaborators is one of the leading factors influencing the performance of human-robot interaction. Team performance can be diminished if people do not trust robots appropriately by disusing or misusing them based on limited experience. Therefore, trust in HRI needs to be calibrated properly, rather than maximized, to let the formation of an appropriate level of trust in human collaborators. For trust calibration in HRI, trust needs to be modeled first. There are many reviews on factors affecting trust in HRI, however, as there are no reviews concentrated on different trust models, in this paper, we review different techniques and methods for trust modeling in HRI. We also present a list of potential directions for further research and some challenges that need to be addressed in future work on human-robot trust modeling.


title: Attentive Social Recommendation: Towards User And Item Diversities

abstract: Social recommendation system is to predict unobserved user-item rating values by taking advantage of user-user social relation and user-item ratings. However, user/item diversities in social recommendations are not well utilized in the literature. Especially, inter-factor (social and rating factors) relations and distinct rating values need taking into more consideration. In this paper, we propose an attentive social recommendation system (ASR) to address this issue from two aspects. First, in ASR, Rec-conv graph network layers are proposed to extract the social factor, user-rating and item-rated factors and then automatically assign contribution weights to aggregate these factors into the user/item embedding vectors. Second, a disentangling strategy is applied for diverse rating values. Extensive experiments on benchmarks demonstrate the effectiveness and advantages of our ASR.


title: Learning identifiable and interpretable latent models of high-dimensional neural activity using pi-VAE

abstract: The ability to record activities from hundreds of neurons simultaneously in the brain has placed an increasing demand for developing appropriate statistical techniques to analyze such data. Recently, deep generative models have been proposed to fit neural population responses. While these methods are flexible and expressive, the downside is that they can be difficult to interpret and identify. To address this problem, we propose a method that integrates key ingredients from latent models and traditional neural encoding models. Our method, pi-VAE, is inspired by recent progress on identifiable variational auto-encoder, which we adapt to make appropriate for neuroscience applications. Specifically, we propose to construct latent variable models of neural activity while simultaneously modeling the relation between the latent and task variables (non-neural variables, e.g. sensory, motor, and other externally observable states). The incorporation of task variables results in models that are not only more constrained, but also show qualitative improvements in interpretability and identifiability. We validate pi-VAE using synthetic data, and apply it to analyze neurophysiological datasets from rat hippocampus and macaque motor cortex. We demonstrate that pi-VAE not only fits the data better, but also provides unexpected novel insights into the structure of the neural codes.


title: Fundamental bounds on the precision of classical phase microscopes

abstract: A wide variety of imaging systems have been designed to measure phase variations, with applications from physics to biology and medicine. In this work, we theoretically compare the precision of phase estimations achievable with classical phase microscopy techniques, operated at the shot-noise limit. We show how the Cram\'{e}r-Rao bound is calculated for any linear optical system, including phase-contrast microscopy, phase-shifting holography, spatial light interference microscopy, and local optimization of wavefronts for phase imaging. Through these examples, we demonstrate how this general framework can be applied for the design and optimization of classical phase microscopes. Our results show that wavefront shaping is required to design phase microscopes with optimal phase precision.


title: Predictors and Predictands of Linear Response in Spatially Extended Systems

abstract: The goal of response theory, in each of its many statistical mechanical formulations, is to predict the perturbed response of a system from the knowledge of the unperturbed state and of the applied perturbation. A new recent angle on the problem focuses on providing a method to perform predictions of the change in one observable of the system by using the change in a second observable as a surrogate for the actual forcing. Such a viewpoint tries to address the very relevant problem of causal links within complex system when only incomplete information is available. We present here a method for quantifying and ranking the predictive ability of observables and use it to investigate the response of a paradigmatic spatially extended system, the Lorenz '96 model. We perturb locally the system and we then study to what extent a given local observable can predict the behaviour of a separate local observable. We show that this approach can reveal insights on the way a signal propagates inside the system. We also show that the procedure becomes more efficient if one considers multiple acting forcings and, correspondingly, multiple observables as predictors of the observable of interest.


title: Fairness-Oriented User Association in HetNets Using Bargaining Game Theory

abstract: In this paper, the user association and resource allocation problem is investigated for a two-tier HetNet consisting of one macro Base Station (BS) and a number of pico BSs. The effectiveness of user association to BSs is evaluated in terms of fairness and load distribution. In particular, the problem of determining a fair user association is formulated as a bargaining game so that for the Nash Bargaining Solution (NBS) abiding the fairness axioms provides an optimal and fair user association. The NBS also yields in a Pareto optimal solution and leads to a proportional fair solution in the proposed HetNet model. Additionally, we introduce a novel algorithmic solution in which a new Coalition Generation Algorithm (CGA), called SINR-based CGA, is considered in order to simplify the coalition generation phase. Our simulation results show the efficiency of the proposed user association scheme in terms of fairness and load distribution among BSs and users. In particular, we compare the performance of the proposed solution with that of the throughput-oriented scheme in terms of the max-sum-rate scheme and show that the proposed solution yields comparable average data rates and overall sum rate.


title: Sparse Longitudinal Representations of Electronic Health Record Data for the Early Detection of Chronic Kidney Disease in Diabetic Patients

abstract: Chronic kidney disease (CKD) is a gradual loss of renal function over time, and it increases the risk of mortality, decreased quality of life, as well as serious complications. The prevalence of CKD has been increasing in the last couple of decades, which is partly due to the increased prevalence of diabetes and hypertension. To accurately detect CKD in diabetic patients, we propose a novel framework to learn sparse longitudinal representations of patients' medical records. The proposed method is also compared with widely used baselines such as Aggregated Frequency Vector and Bag-of-Pattern in Sequences on real EHR data, and the experimental results indicate that the proposed model achieves higher predictive performance. Additionally, the learned representations are interpreted and visualized to bring clinical insights.


title: Self-Tuning Stochastic Optimization with Curvature-Aware Gradient Filtering

abstract: Standard first-order stochastic optimization algorithms base their updates solely on the average mini-batch gradient, and it has been shown that tracking additional quantities such as the curvature can help de-sensitize common hyperparameters. Based on this intuition, we explore the use of exact per-sample Hessian-vector products and gradients to construct optimizers that are self-tuning and hyperparameter-free. Based on a dynamics model of the gradient, we derive a process which leads to a curvature-corrected, noise-adaptive online gradient estimate. The smoothness of our updates makes it more amenable to simple step size selection schemes, which we also base off of our estimates quantities. We prove that our model-based procedure converges in the noisy quadratic setting. Though we do not see similar gains in deep learning tasks, we can match the performance of well-tuned optimizers and ultimately, this is an interesting step for constructing self-tuning optimizers.


title: Nonparametric Adaptive Bayesian Stochastic Control Under Model Uncertainty

abstract: In this paper we propose a new methodology for solving a discrete time stochastic Markovian control problem under model uncertainty. By utilizing the Dirichlet process, we model the unknown distribution of the underlying stochastic process as a random probability measure and achieve online learning in a Bayesian manner. Our approach integrates optimizing and dynamic learning. When dealing with model uncertainty, the nonparametric framework allows us to avoid model misspecification that usually occurs in other classical control methods. Then, we develop a numerical algorithm to handle the infinitely dimensional state space in this setup and utilizes Gaussian process surrogates to obtain a functional representation of the value function in the Bellman recursion. We also build separate surrogates for optimal control to eliminate repeated optimizations on out-of-sample paths and bring computational speed-ups. Finally, we demonstrate the financial advantages of the nonparametric Bayesian framework compared to parametric approaches such as strong robust and time consistent adaptive.


title: Instantaneous time mirrors and wave equations with time-singular coefficients

abstract: We study in this work the concept of instantaneous time mirrors that were recently introduced in the physics literature. Instantaneous time mirrors offer a new method for time reversal with a simplified experimental setup compared to classical techniques. At the mathematical level, instantaneous time mirrors are modeled by singularities in the time variable in the coefficients of a wave equation, and a prototype of such singularity is a Dirac delta. Our main goal in this work is to obtain refocusing estimates for the wavefield that quantify the quality of time reversal. This amounts to analyze the wave equation with Dirac-type singularities and develop a proper regularity theory as well as derive uniform estimates.


title: A Community Plan for Fusion Energy and Discovery Plasma Sciences

abstract: This document is the final report of the Community Planning Process (CPP) that describes a comprehensive plan to deliver fusion energy and to advance plasma science. The CPP was initiated by the executive committee of the American Physical Society Division of Plasma Physics (APS DPP) to help the Fusion Energy Sciences Advisory Committee (FESAC) fulfill a charge from the U.S. Department of Energy (DOE) to develop a strategic plan for the DOE Office of Fusion Energy Sciences (FES). In this charge, dated Nov 30, 2018, DOE Deputy Director for Science Dr. Stephen Binkley requested that FESAC "undertake a new long range strategic planning activity for the Fusion Energy Sciences (FES) program. The strategic planning activity to encompass the entire FES research portfolio (namely, burning plasma science and discovery plasma science) should identify and prioritize the research required to advance both the scientific foundation needed to develop a fusion energy source, as well as the broader FES mission to steward plasma science." The CPP represents the first phase in developing a long range strategic plan for FES, and will serve as the basis for the second phase activity conducted by FESAC. It is worth noting that enacting the full scope of the recommendations in the strategic plan in this document will require suitable partnerships with other offices and governmental agencies, as well as with private industry and international partners.


title: On $\xi$-process for DVCS-amplitude

abstract: In this note, we demonstrate in detail the $\xi$-process implementation applied to the deeply virtual Compton scattering amplitude to ensure both the QCD and QED gauge invariance. The presented details are also important for understanding of the contour gauge used in different processes.


title: The role of electron-electron collisions for magnetotransport at intermediate temperatures

abstract: We discuss galvanomagnetic and thermomagnetic effects in disordered electronic systems focusing on intermediate temperatures, for which electron-electron scattering and electron-impurity scattering occur at similar rates, while phonon-related effects can be neglected. In particular, we explore how electric and thermal currents driven either by an electric field or by a temperature gradient are affected by the interplay of momentum-dependent electron-impurity scattering, electron-electron scattering, and the presence of a magnetic field. We find that the electric resistance, the Seebeck coefficient and the Nernst coefficient are particularly sensitive to the momentum dependence of the electron-impurity scattering rate at intermediate temperatures. A sufficiently strong momentum dependence of the electron-impurity scattering rate can induce a sign change of the Seebeck coefficient. This sign change can be suppressed by a perpendicular magnetic field. The temperature and magnetic field dependence of the Seebeck coefficient can be used for measuring the magnitude of the electron-impurity and electron-electron scattering rates. The Nernst coefficient vanishes for momentum-independent electron-impurity scattering, but displays a maximum at finite temperatures once the momentum dependence is accounted for. By contrast, the Hall coefficient and the Righi-Leduc coefficient display only a weak dependence on the momentum dependence of the electron-impurity scattering at intermediate temperatures.


title: On the 2-colorability of random hypergraphs

abstract: A 2-coloring of a hypergraph is a mapping from its vertices to a set of two colors such that no edge is monochromatic. Let $H_k(n,m)$ be a random $k$-uniform hypergraph on $n$ vertices formed by picking $m$ edges uniformly, independently and with replacement. It is easy to show that if $r \geq r_c = 2^{k-1} \ln 2 - (\ln 2) /2$, then with high probability $H_k(n,m=rn)$ is not 2-colorable. We complement this observation by proving that if $r \leq r_c - 1$ then with high probability $H_k(n,m=rn)$ is 2-colorable.


title: On the hydrostatic approximation of compressible anisotropic Navier-Stokes equations -- rigorous justification

abstract: In this work, we obtain the hydrostatic approximation by taking the small aspect ratio limit to the Navier-Stokes equations. The aspect ratio (the ratio of the depth to horizontal width) is a geometrical constraint in general large scale geophysical motions that the vertical scale is significantly smaller than horizontal. We use the versatile relative entropy inequality to prove rigorously the limit from the compressible Navier-Stokes equations to the compressible Primitive Equations. This is the first work to use relative entropy inequality for proving hydrostatic approximation and derive the compressible Primitive Equations.


title: Machine learning methods for the detection of polar lows in satellite mosaics: major issues and their solutions

abstract: Polar mesocyclones (PMCs) and their intense subclass polar lows (PLs) are relatively small atmospheric vortices that form mostly over the ocean in high latitudes. PLs can strongly influence deep ocean water formation since they are associated with strong surface winds and heat fluxes. Detection and tracking of PLs are crucial for understanding the climatological dynamics of PLs and for the analysis of their impacts on other components of the climatic system. At the same time, visual tracking of PLs is a highly time-consuming procedure that requires expert knowledge and extensive examination of source data. There are known procedures involving deep convolutional neural networks (DCNNs) for the detection of large-scale atmospheric phenomena in reanalysis data that demonstrate a high quality of detection. However, one cannot apply these procedures to satellite data directly since, unlike reanalyses, satellite products register all the scales of atmospheric vortices. It is also known that DCNNs were originally designed to be scale-invariant. This leads to the problem of filtering the scale of detected phenomena. There are other problems to be solved, such as a low signal-to-noise ratio of satellite data and an unbalanced number of negative (without PLs) and positive (where a PL is presented) classes in a satellite dataset. In our study, we propose a deep learning approach for the detection of PLs and PMCs in remote sensing data, which addresses class imbalance and scale filtering problems. We also outline potential solutions for other problems, along with promising improvements to the presented approach.


title: ROIAL: Region of Interest Active Learning for Characterizing Exoskeleton Gait Preference Landscapes

abstract: Characterizing what types of exoskeleton gaits are comfortable for users, and understanding the science of walking more generally, require recovering a user's utility landscape. Learning these landscapes is challenging, as walking trajectories are defined by numerous gait parameters, data collection from human trials is expensive, and user safety and comfort must be ensured. This work proposes the Region of Interest Active Learning (ROIAL) framework, which actively learns each user's underlying utility function over a region of interest that ensures safety and comfort. ROIAL learns from ordinal and preference feedback, which are more reliable feedback mechanisms than absolute numerical scores. The algorithm's performance is evaluated both in simulation and experimentally for three non-disabled subjects walking inside of a lower-body exoskeleton. ROIAL learns Bayesian posteriors that predict each exoskeleton user's utility landscape across four exoskeleton gait parameters. The algorithm discovers both commonalities and discrepancies across users' gait preferences and identifies the gait parameters that most influenced user feedback. These results demonstrate the feasibility of recovering gait utility landscapes from limited human trials.


title: Bimanual Regrasping for Suture Needles using Reinforcement Learning for Rapid Motion Planning

abstract: Regrasping a suture needle is an important yet time-consuming process in suturing. To bring efficiency into regrasping, prior work either designs a task-specific mechanism or guides the gripper toward some specific pick-up point for proper grasping of a needle. Yet, these methods are usually not deployable when the working space is changed. Therefore, in this work, we present rapid trajectory generation for bimanual needle regrasping via reinforcement learning (RL). Demonstrations from a sampling-based motion planning algorithm is incorporated to speed up the learning. In addition, we propose the ego-centric state and action spaces for this bimanual planning problem, where the reference frames are on the end-effectors instead of some fixed frame. Thus, the learned policy can be directly applied to any feasible robot configuration. Our experiments in simulation show that the success rate of a single pass is 97%, and the planning time is 0.0212s on average, which outperforms other widely used motion planning algorithms. For the real-world experiments, the success rate is 73.3% if the needle pose is reconstructed from an RGB image, with a planning time of 0.0846s and a run time of 5.1454s. If the needle pose is known beforehand, the success rate becomes 90.5%, with a planning time of 0.0807s and a run time of 2.8801s.


title: Relative Bott-Samelson varieties

abstract: We prove that, defined with respect to versal flags, the product of two relative Bott-Samelson varieties over the flag bundle is a resolution of singularities of a relative Richardson variety. This result generalizes Brion's resolution of singularities of Richardson varieties to the relative setting. It reflects the phenomenon that the local geometry of a relative Richardson variety is completely governed by the two intersecting relative Schubert varieties, studied by Chan-Pflueger. We also prove an analogous theorem in the case of relative Grassmannian Richardson varieties, thereby furnishing a resolution of singularities for the Brill-Noether variety with imposed ramification on twice-marked elliptic curves.


title: Encoding Defensive Driving as a Dynamic Nash Game

abstract: Robots deployed in real-world environments should operate safely in a robust manner. In scenarios where an "ego" agent navigates in an environment with multiple other "non-ego" agents, two modes of safety are commonly proposed -- adversarial robustness and probabilistic constraint satisfaction. However, while the former is generally computationally intractable and leads to overconservative solutions, the latter typically relies on strong distributional assumptions and ignores strategic coupling between agents. To avoid these drawbacks, we present a novel formulation of robustness within the framework of general-sum dynamic game theory, modeled on defensive driving. More precisely, we prepend an adversarial phase to the ego agent's cost function. That is, we prepend a time interval during which other agents are assumed to be temporarily distracted, in order to render the ego agent's equilibrium trajectory robust against other agents' potentially dangerous behavior during this time. We demonstrate the effectiveness of our new formulation in encoding safety via multiple traffic scenarios.


title: StylePredict: Machine Theory of Mind for Human Driver Behavior From Trajectories

abstract: Studies have shown that autonomous vehicles (AVs) behave conservatively in a traffic environment composed of human drivers and do not adapt to local conditions and socio-cultural norms. It is known that socially aware AVs can be designed if there exist a mechanism to understand the behaviors of human drivers. We present a notion of Machine Theory of Mind (M-ToM) to infer the behaviors of human drivers by observing the trajectory of their vehicles. Our M-ToM approach, called StylePredict, is based on trajectory analysis of vehicles, which has been investigated in robotics and computer vision. StylePredict mimics human ToM to infer driver behaviors, or styles, using a computational mapping between the extracted trajectory of a vehicle in traffic and the driver behaviors using graph-theoretic techniques, including spectral analysis and centrality functions. We use StylePredict to analyze driver behavior in different cultures in the USA, China, India, and Singapore, based on traffic density, heterogeneity, and conformity to traffic rules and observe an inverse correlation between longitudinal (overspeeding) and lateral (overtaking, lane-changes) driving styles.


title: Optimizing Age of Information Through Aerial Reconfigurable Intelligent Surfaces: A Deep Reinforcement Learning Approach

abstract: We investigate the benefits of integrating unmanned aerial vehicles (UAVs) with reconfigurable intelligent surface (RIS) elements to passively relay information sampled by Internet of Things devices (IoTDs) to the base station (BS). In order to maintain the freshness of relayed information, an optimization problem with the objective of minimizing the expected sum Age-of-Information (AoI) is formulated to optimize the altitude of the UAV, the communication schedule, and phases-shift of RIS elements. In the absence of prior knowledge of the activation pattern of the IoTDs, proximal policy optimization algorithm is developed to solve this mixed-integer non-convex optimization problem. Numerical results show that our proposed algorithm outperforms all others in terms of AoI.


title: Predictive modeling of passive scalar transfer to a wall using stochastic one-dimensional turbulence

abstract: Passive scalars in turbulent channel flows are investigated as canonical problem for heat and mass transfer in turbulent boundary-layer flows. The one-dimensional turbulence model is used to numerically investigate the Schmidt and Reynolds number dependence of the scalar transfer to a wall due to fluctuating wall-normal transport. First, the model is calibrated for low-order velocity statistics. After that, we keep the model parameters fixed and investigate low-order passive scalar statistics for a relevant Schmidt and Reynolds number range. We show that the model consistently predicts the boundary layer structure and the scaling regimes, for which it is close to asymptotic one-dimensional theory.


title: On Iwase's manifolds

abstract: In ~\cite{Iw2} Iwase has constructed two 16-dimensional manifolds $M_2$ and $M_3$ with LS-category 3 which are counter-examples to Ganea's conjecture: ${\rm cat_{LS}} (M\times S^n)={\rm cat_{LS}} M+1$. We show that the manifold $M_3$ is a counter-example to the logarithmic law for the LS-category of the square of a manifold: ${\rm cat_{LS}}(M\times M)=2{\rm cat_{LS}} M$. Also, we construct a map of degree one $$f:N\to M_2\times M_3$$ which reduces Rudyak's conjecture to the question whether ${\rm cat_{LS}}(M_2\times M_3)\ge 5$. We show that ${\rm cat_{LS}}(M_2\times M_3)\ge 4$.


title: Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learning

abstract: Safe and efficient navigation through human crowds is an essential capability for mobile robots. Previous work on robot crowd navigation assumes that the dynamics of all agents are known and well-defined. In addition, the performance of previous methods deteriorates in partially observable environments and environments with dense crowds. To tackle these problems, we propose decentralized structural-Recurrent Neural Network (DS-RNN), a novel network that reasons about spatial and temporal relationships for robot decision making in crowd navigation. We train our network with model-free deep reinforcement learning without any expert supervision. We demonstrate that our model outperforms previous methods in challenging crowd navigation scenarios. We successfully transfer the policy learned in the simulator to a real-world TurtleBot 2i.


title: Lepton-mediated electroweak baryogenesis, gravitational waves and the $4\tau$ final state at the collider

abstract: An electroweak baryogenesis (EWBG) mechanism mediated by $\tau$ lepton transport is proposed. We extend the Standard Model with a real singlet scalar $S$ to trigger the strong first-order electroweak phase transition (SFOEWPT), and with a set of leptophilic dimension-5 operators to provide sufficient CP violating source. We demonstrate this model is able to generate the observed baryon asymmetry of the universe. This scenario is experimentally testable via either the SFOEWPT gravitational wave signals at the next-generation space-based detectors, or the $pp\to h^*\to SS\to 4\tau$ process (where $h^*$ is an off-shell Higgs) at the hadron colliders. A detailed collider simulation shows that a considerable fraction of parameter space can be probed at the HL-LHC, while almost the whole parameter space allowed by EWBG can be reached by the 27 TeV HE-LHC.


title: Bohr compactifications of groups and rings

abstract: We introduce and study model-theoretic connected components of rings as an analogue of model-theoretic connected components of definable groups. We develop their basic theory and use them to describe both the definable and classical Bohr compactifications of rings. We then use model-theoretic connected components to explicitly calculate Bohr compactifications of some classical matrix groups, such as the discrete Heisenberg group $UT_3(Z)$, the continuous Heisenberg group $UT_3(R)$, and, more generally, groups of upper unitriangular and invertible upper triangular matrices over unital rings.


title: Language Through a Prism: A Spectral Approach for Multiscale Language Representations

abstract: Language exhibits structure at different scales, ranging from subwords to words, sentences, paragraphs, and documents. To what extent do deep models capture information at these scales, and can we force them to better capture structure across this hierarchy? We approach this question by focusing on individual neurons, analyzing the behavior of their activations at different timescales. We show that signal processing provides a natural framework for separating structure across scales, enabling us to 1) disentangle scale-specific information in existing embeddings and 2) train models to learn more about particular scales. Concretely, we apply spectral filters to the activations of a neuron across an input, producing filtered embeddings that perform well on part of speech tagging (word-level), dialog speech acts classification (utterance-level), or topic classification (document-level), while performing poorly on the other tasks. We also present a prism layer for training models, which uses spectral filters to constrain different neurons to model structure at different scales. Our proposed BERT + Prism model can better predict masked tokens using long-range context and produces multiscale representations that perform better at utterance- and document-level tasks. Our methods are general and readily applicable to other domains besides language, such as images, audio, and video.


title: Attractors of direct products

abstract: For Milnor, statistical, and minimal attractors, we construct examples of smooth flows $\varphi$ on $S^2$ for which the attractor of the Cartesian square of $\varphi$ is smaller than the Cartesian square of the attractor of $\varphi$. In the example for the minimal attractors, the flow $\varphi$ also has a global physical measure such that its square does not coincide with the global physical measure of the square of $\varphi$.


title: Multi-Agent Active Search using Realistic Depth-Aware Noise Model

abstract: The active search for objects of interest in an unknown environment has many robotics applications including search and rescue, detecting gas leaks or locating animal poachers. Existing algorithms often prioritize the location accuracy of objects of interest while other practical issues such as the reliability of object detection as a function of distance and lines of sight remain largely ignored. Additionally, in many active search scenarios, communication infrastructure may be unreliable or unestablished, making centralized control of multiple agents impractical. We present an algorithm called Noise-Aware Thompson Sampling (NATS) that addresses these issues for multiple ground-based robots performing active search considering two sources of sensory information from monocular optical imagery and depth maps. By utilizing Thompson Sampling, NATS allows for decentralized coordination among multiple agents. NATS also considers object detection uncertainty from depth as well as environmental occlusions and operates while remaining agnostic of the number of objects of interest. Using simulation results, we show that NATS significantly outperforms existing methods such as information-greedy policies or exhaustive search. We demonstrate the real-world viability of NATS using a pseudo-realistic environment created in the Unreal Engine 4 game development platform with the AirSim plugin.


title: Reducing bias in difference-in-differences models using entropy balancing

abstract: This paper illustrates the use of entropy balancing in difference-in-differences analyses when pre-intervention outcome trends suggest a possible violation of the parallel trends assumption. We describe a set of assumptions under which weighting to balance intervention and comparison groups on pre-intervention outcome trends leads to consistent difference-in-differences estimates even when pre-intervention outcome trends are not parallel. Simulated results verify that entropy balancing of pre-intervention outcomes trends can remove bias when the parallel trends assumption is not directly satisfied, and thus may enable researchers to use difference-in-differences designs in a wider range of observational settings than previously acknowledged.


title: On Counting (Quantum-)Graph Homomorphisms in Finite Fields of Prime Order

abstract: We study the problem of counting the number of homomorphisms from an input graph $G$ to a fixed (quantum) graph $\bar{H}$ in any finite field of prime order $\mathbb{Z}_p$. The subproblem with graph $H$ was introduced by Faben and Jerrum [ToC'15] and its complexity is subject to a growing series of research articles, e.g. the work of Focke, Goldberg, Roth, and Zivn\'y [SIDMA'21] and the work of Bulatov and Kazeminia [STOC'22], subsequent to this article's conference version. Our contribution is threefold. First, we introduce the study of quantum graphs to the study of modular counting homomorphisms. We show that the complexity for a quantum graph $\bar{H}$ collapses to the complexity criteria found at dimension 1: graphs. Second, in order to prove cases of intractability we establish a further reduction to the study of bipartite graphs. Lastly, we establish a dichotomy for all bipartite ($K_{3,3}\backslash\{e\}$, ${domino}$)-free graphs by a thorough structural study incorporating both local and global arguments. This result subsumes all results on bipartite graphs known for all prime moduli and extends them significantly. Even for the subproblem with $p$ equal to $2$, this establishes new results.


title: Learning Efficient Constraint Graph Sampling for Robotic Sequential Manipulation

abstract: Efficient sampling from constraint manifolds, and thereby generating a diverse set of solutions for feasibility problems, is a fundamental challenge. We consider the case where a problem is factored, that is, the underlying nonlinear program is decomposed into differentiable equality and inequality constraints, each of which depends only on some variables. Such problems are at the core of efficient and robust sequential robot manipulation planning. Naive sequential conditional sampling of individual variables, as well as fully joint sampling of all variables at once (e.g., leveraging optimization methods), can be highly inefficient and non-robust. We propose a novel framework to learn how to break the overall problem into smaller sequential sampling problems. Specifically, we leverage Monte-Carlo Tree Search to learn assignment orders for the variable-subsets, in order to minimize the computation time to generate feasible full samples. This strategy allows us to efficiently compute a set of diverse valid robot configurations for mode-switches within sequential manipulation tasks, which are waypoints for subsequent trajectory optimization or sampling-based motion planning algorithms. We show that the learning method quickly converges to the best sampling strategy for a given problem, and outperforms user-defined orderings or fully joint optimization, while providing a higher sample diversity.


title: A Fast Linear Regression via SVD and Marginalization

abstract: We describe a numerical scheme for evaluating the posterior moments of Bayesian linear regression models with partial pooling of the coefficients. The principal analytical tool of the evaluation is a change of basis from coefficient space to the space of singular vectors of the matrix of predictors. After this change of basis and an analytical integration, we reduce the problem of finding moments of a density over k + m dimensions, to finding moments of an m-dimensional density, where k is the number of coefficients and k + m is the dimension of the posterior. Moments can then be computed using, for example, MCMC, the trapezoid rule, or adaptive Gaussian quadrature. An evaluation of the SVD of the matrix of predictors is the dominant computational cost and is performed once during the precomputation stage. We demonstrate numerical results of the algorithm. The scheme described in this paper generalizes naturally to multilevel and multi-group hierarchical regression models where normal-normal parameters appear.


title: RMITB at TREC COVID 2020

abstract: Search engine users rarely express an information need using the same query, and small differences in queries can lead to very different result sets. These user query variations have been exploited in past TREC CORE tracks to contribute diverse, highly-effective runs in offline evaluation campaigns with the goal of producing reusable test collections. In this paper, we document the query fusion runs submitted to the first and second round of TREC COVID, using ten queries per topic created by the first author. In our analysis, we focus primarily on the effects of having our second priority run omitted from the judgment pool. This run is of particular interest, as it surfaced a number of relevant documents that were not judged until later rounds of the task. If the additional judgments were included in the first round, the performance of this run increased by 35 rank positions when using RBP p=0.5, highlighting the importance of judgment depth and coverage in assessment tasks.


title: A Jordan Curve that cannot be Crossed by Rectifiable Arcs on a Set of Zero Length

abstract: We construct a Jordan curve $\Gamma \subset \mathbb{C}$ so that for any rectifiable arc $\sigma$ with endpoints in distinct complementary components of $\Gamma$, $H^1(\sigma \cap \Gamma) > 0$.


title: Adaptive Learning of Rank-One Models for Efficient Pairwise Sequence Alignment

abstract: Pairwise alignment of DNA sequencing data is a ubiquitous task in bioinformatics and typically represents a heavy computational burden. State-of-the-art approaches to speed up this task use hashing to identify short segments (k-mers) that are shared by pairs of reads, which can then be used to estimate alignment scores. However, when the number of reads is large, accurately estimating alignment scores for all pairs is still very costly. Moreover, in practice, one is only interested in identifying pairs of reads with large alignment scores. In this work, we propose a new approach to pairwise alignment estimation based on two key new ingredients. The first ingredient is to cast the problem of pairwise alignment estimation under a general framework of rank-one crowdsourcing models, where the workers' responses correspond to k-mer hash collisions. These models can be accurately solved via a spectral decomposition of the response matrix. The second ingredient is to utilise a multi-armed bandit algorithm to adaptively refine this spectral estimator only for read pairs that are likely to have large alignments. The resulting algorithm iteratively performs a spectral decomposition of the response matrix for adaptively chosen subsets of the read pairs.


title: Handling time-dependent exposures and confounders when estimating attributable fractions -- bridging the gap between multistate and counterfactual modeling

abstract: The population-attributable fraction (PAF) expresses the proportion of events that can be ascribed to a certain exposure in a certain population. It can be strongly time-dependent because either exposure incidence or excess risk may change over time. Competing events may moreover hinder the outcome of interest from being observed. Occurrence of either of these events may, in turn, prevent the exposure of interest. Estimation approaches therefore need to carefully account for the timing of events in such highly dynamic settings. The use of multistate models has been widely encouraged to eliminate preventable yet common types of time-dependent bias. Even so, it has been pointed out that proposed multistate modeling approaches for PAF estimation fail to fully eliminate such bias. In addition, assessing whether patients die from rather than with a certain exposure not only requires adequate modeling of the timing of events but also of their confounding factors. While proposed multistate modeling approaches for confounding adjustment may adequately accommodate baseline imbalances, unlike g-methods, these proposals are not generally equipped to handle time-dependent confounding. However, the connection between multistate modeling and g-methods (e.g. inverse probability of censoring weighting) for PAF estimation is not readily apparent. In this paper, we provide a weighting-based characterization of both approaches to illustrate this connection, to pinpoint current shortcomings of multistate modeling, and to enhance intuition into simple modifications to overcome these. R code is made available to foster the uptake of g-methods for PAF estimation.


title: Hypothesis testing with active information

abstract: We develop hypothesis testing for active information -the averaged quantity in the Kullback-Liebler divergence. To our knowledge, this is the first paper to derive exact probabilities of type-I errors for hypothesis testing in the area.


title: Taylor dispersion of elongated rods

abstract: Particles transported in fluid flows, such as cells, polymers, or nanorods, are rarely spherical. In this study, we numerically and theoretically investigate the dispersion of an initially localized patch of passive elongated Brownian particles constrained to one degree of rotational freedom in a two-dimensional Poiseuille flow, demonstrating that elongated particles exhibit an enhanced longitudinal dispersion. In a shear flow, the rods translate due to advection and diffusion and rotate due to rotational diffusion and their classical Jeffery's orbit. The magnitude of the enhanced dispersion depends on the particle's aspect ratio and the relative importance of its shear-induced rotational advection and rotational diffusivity. When rotational diffusion dominates, we recover the classical Taylor dispersion result for the longitudinal spreading rate using an orientationally averaged translational diffusivity for the rods. However, in the high-shear limit, the rods tend to align with the flow and ultimately disperse more due to their anisotropic diffusivities. Results from our Monte Carlo simulations of the particle dispersion are captured remarkably well by a simple theory inspired by Taylor's original work. For long times and large Peclet numbers, an effective one-dimensional transport equation is derived with integral expressions for the particles' longitudinal transport speed and dispersion coefficient. The enhanced dispersion coefficient can be collapsed along a single curve for particles of high aspect ratio, representing a simple correction factor that extends Taylor's original prediction to elongated particles.


title: Variations on least squares

abstract: Three methods of least squares are examined for fitting a line to points in the plane. Two well known methods are to minimize sums of squares of vertical or horizontal distances to the line. Less known is to minimize sums of squares of distances to the line. Concise proofs are given for each method using a combination of the first derivative test for functions of two variables and completing the square. The three methods are compared and the distances to the line method appears to be favourable in most circumstances. They generally draw different regression lines. The method of vertical displacements typically gives a slope of too small magnitude while the method of horizontal displacements typically gives a slope of too large magnitude. An inequality involving the three slopes is proved. Rotating all the data points in the same way with these two methods does not result in the regression line being rotated the same way. However, the distance to the line method is invariant under rotations.


title: Kinematics-Guided Reinforcement Learning for Object-Aware 3D Ego-Pose Estimation

abstract: We propose a method for incorporating object interaction and human body dynamics into the task of 3D ego-pose estimation using a head-mounted camera. We use a kinematics model of the human body to represent the entire range of human motion, and a dynamics model of the body to interact with objects inside a physics simulator. By bringing together object modeling, kinematics modeling, and dynamics modeling in a reinforcement learning (RL) framework, we enable object-aware 3D ego-pose estimation. We devise several representational innovations through the design of the state and action space to incorporate 3D scene context and improve pose estimation quality. We also construct a fine-tuning step to correct the drift and refine the estimated human-object interaction. This is the first work to estimate a physically valid 3D full-body interaction sequence with objects (e.g., chairs, boxes, obstacles) from egocentric videos. Experiments with both controlled and in-the-wild settings show that our method can successfully extract an object-conditioned 3D ego-pose sequence that is consistent with the laws of physics.


title: Answer Graph: Factorization Matters in Large Graphs

abstract: Our answer-graph method to evaluate SPARQL conjunctive queries (CQs) finds a factorized answer set first, an answer graph, and then finds the embedding tuples from this. This approach can reduce greatly the cost to evaluate CQs. This affords a second advantage: we can construct a cost-based planner. We present the answer-graph approach, and overview our prototype system, Wireframe. We then offer proof of concept via a micro-benchmark over the YAGO2s dataset with two prevalent shapes of queries, snowflake and diamond. We compare Wireframe's performance over these against PostgreSQL, Virtuoso, MonetDB, and Neo4J to illustrate the performance advantages of our answer-graph approach.


title: Pretraining Strategies, Waveform Model Choice, and Acoustic Configurations for Multi-Speaker End-to-End Speech Synthesis

abstract: We explore pretraining strategies including choice of base corpus with the aim of choosing the best strategy for zero-shot multi-speaker end-to-end synthesis. We also examine choice of neural vocoder for waveform synthesis, as well as acoustic configurations used for mel spectrograms and final audio output. We find that fine-tuning a multi-speaker model from found audiobook data that has passed a simple quality threshold can improve naturalness and similarity to unseen target speakers of synthetic speech. Additionally, we find that listeners can discern between a 16kHz and 24kHz sampling rate, and that WaveRNN produces output waveforms of a comparable quality to WaveNet, with a faster inference time.


title: Robots of the Lost Arc: Self-Supervised Learning to Dynamically Manipulate Fixed-Endpoint Cables

abstract: We explore how high-speed robot arm motions can dynamically manipulate cables to vault over obstacles, knock objects from pedestals, and weave between obstacles. In this paper, we propose a self-supervised learning framework that enables a UR5 robot to perform these three tasks. The framework finds a 3D apex point for the robot arm, which, together with a task-specific trajectory function, defines an arcing motion that dynamically manipulates the cable to perform tasks with varying obstacle and target locations. The trajectory function computes minimum-jerk motions that are constrained to remain within joint limits and to travel through the 3D apex point by repeatedly solving quadratic programs to find the shortest and fastest feasible motion. We experiment with 5 physical cables with different thickness and mass and compare performance against two baselines in which a human chooses the apex point. Results suggest that a baseline with a fixed apex across the three tasks achieves respective success rates of 51.7%, 36.7%, and 15.0%, and a baseline with human-specified, task-specific apex points achieves 66.7%, 56.7%, and 15.0% success rate respectively, while the robot using the learned apex point can achieve success rates of 81.7% in vaulting, 65.0% in knocking, and 60.0% in weaving. Code, data, and supplementary materials are available at https: //sites.google.com/berkeley.edu/dynrope/home.


title: CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detection

abstract: The perception system in autonomous vehicles is responsible for detecting and tracking the surrounding objects. This is usually done by taking advantage of several sensing modalities to increase robustness and accuracy, which makes sensor fusion a crucial part of the perception system. In this paper, we focus on the problem of radar and camera sensor fusion and propose a middle-fusion approach to exploit both radar and camera data for 3D object detection. Our approach, called CenterFusion, first uses a center point detection network to detect objects by identifying their center points on the image. It then solves the key data association problem using a novel frustum-based method to associate the radar detections to their corresponding object's center point. The associated radar detections are used to generate radar-based feature maps to complement the image features, and regress to object properties such as depth, rotation and velocity. We evaluate CenterFusion on the challenging nuScenes dataset, where it improves the overall nuScenes Detection Score (NDS) of the state-of-the-art camera-based algorithm by more than 12%. We further show that CenterFusion significantly improves the velocity estimation accuracy without using any additional temporal information. The code is available at https://github.com/mrnabati/CenterFusion .


title: Prediction and Observation of Intermodulation Sidebands from Anharmonic Phonons

abstract: A quantum Langevin model, similar to models used recently for optomechanics, was used to predict intermodulation phonon sidebands (IPS). Ab initio calculations of anharmonic phonons in rocksalt NaBr showed these spectral features as "many-body effects". Modern inelastic neutron scattering measurements on a crystal of NaBr at 300K revealed diffuse intensity at high phonon energy from a predicted upper IPS. The transverse optical (TO) part of the new features originates from phonon intermodulation between the transverse acoustic (TA) and TO phonons. The longitudinal optical (LO) spectral features originate from three-phonon coupling between the TA modes and the TO lattice modes. The partner lower IPS proves to be an "intrinsic localized mode". Interactions with the thermal bath broaden and redistribute the spectral weight of the IPS pair. These sidebands are a probe of anharmonicity and quantum noise, which originate from interactions between the phonons in NaBr.


title: Multi-document Summarization via Deep Learning Techniques: A Survey

abstract: Multi-document summarization (MDS) is an effective tool for information aggregation that generates an informative and concise summary from a cluster of topic-related documents. Our survey, the first of its kind, systematically overviews the recent deep learning based MDS models. We propose a novel taxonomy to summarize the design strategies of neural networks and conduct a comprehensive summary of the state-of-the-art. We highlight the differences between various objective functions that are rarely discussed in the existing literature. Finally, we propose several future directions pertaining to this new and exciting field.