title: Limit cycle enumeration in random vector fields

abstract: We study the number and distribution of the limit cycles of a planar vector field whose component functions are random polynomials. We prove a lower bound on the average number of limit cycles when the random polynomials are sampled from the Kostlan-Shub-Smale ensemble. Investigating a problem introduced by Brudnyi [Annals of Mathematics (2001)] we also consider a special local setting of counting limit cycles near a randomly perturbed center focus, and when the perturbation has i.i.d. coefficients, we prove a limit law showing that the number of limit cycles situated within a disk of radius less than unity converges almost surely to the number of real zeros of a logarithmically-correlated random univariate power series. We also consider infinitesimal perturbations where we obtain precise asymptotics on the global average count of limit cycles for a family of models. The proofs of these results use novel combinations of techniques from dynamical systems and random analytic functions.


title: Robust Inference for Mediated Effects in Partially Linear Models

abstract: We consider mediated effects of an exposure, X on an outcome, Y, via a mediator, M, under no unmeasured confounding assumptions in the setting where models for the conditional expectation of the mediator and outcome are partially linear. We propose G-estimators for the direct and indirect effect and demonstrate consistent asymptotic normality for indirect effects when models for the conditional means of M, or X and Y are correctly specified, and for direct effects, when models for the conditional means of Y, or X and M are correct. This marks an improvement, in this particular setting, over previous `triple' robust methods, which do not assume partially linear mean models. Testing of the no-mediation hypothesis is inherently problematic due to the composite nature of the test (either X has no effect on M or M no effect on Y), leading to low power when both effect sizes are small. We use Generalized Methods of Moments (GMM) results to construct a new score testing framework, which includes as special cases the no-mediation and the no-direct-effect hypotheses. The proposed tests rely on an orthogonal estimation strategy for estimating nuisance parameters. Simulations show that the GMM based tests perform better in terms of power and small sample performance compared with traditional tests in the partially linear setting, with drastic improvement under model misspecification. New methods are illustrated in a mediation analysis of data from the COPERS trial, a randomized trial investigating the effect of a non-pharmacological intervention of patients suffering from chronic pain. An accompanying R package implementing these methods can be found at github.com/ohines/plmed.


title: Virtual Hawking Radiation

abstract: We consider the effects of off-shell Hawking radiation on scattering processes involving black holes coupled to quantum fields. The focus here is to the case of gravitational scattering of a scalar field mediated by the exchange of virtual Hawking gravitons from a four-dimensional Schwarzschild black hole. Our result is obtained in the context of a worldline effective field theory for the black hole, and is valid in the semi-classical limit where the Schwarzschild radius $r_s$ is larger than the Planck length $1/m_{Pl}$. In addition, we assume that four-momentum exchange $q$ is smaller than $r_s^{-1}$ and that the incoming particle has energy larger then the black hole's Hawking temperature. The inelastic cross section we obtain is a new, leading order quantum gravity effect, arising at the same order in $q^2/m_{Pl}^2$ as the well understood one-loop graviton vacuum polarization corrections to gravitational scattering between massive particles.


title: Laser Pulse-Electron Beam Synergy: An Approach to Higher Electron Energy Gain in Laser Wakefield Accelerators

abstract: A new scheme for injection and acceleration of electrons in wakefield accelerators is suggested based on the co-action of a laser pulse and an electron beam. This synergy leads to stronger wakefield generation and higher energy gain in the bubble regime. The strong deformation of the whole bubble leads to electron self-injection at lower laser powers and lower plasma densities. To predict the practical ranges of electron beam and laser pulse parameters an interpretive model is proposed. The effects of altering the initial electron beam position on self-trapping of plasma electrons are studied. It is observed, a high quality (25 fs), high charge (340 pC ), 1 GeV electron bunch is produced by injection of a 280 pC electron beam in the decelerating phase of the 48 TW laser driven wakefield.


title: Molecular Latent Space Simulators

abstract: Small integration time steps limit molecular dynamics (MD) simulations to millisecond time scales. Markov state models (MSMs) and equation-free approaches learn low-dimensional kinetic models from MD simulation data by performing configurational or dynamical coarse-graining of the state space. The learned kinetic models enable the efficient generation of dynamical trajectories over vastly longer time scales than are accessible by MD, but the discretization of configurational space and/or absence of a means to reconstruct molecular configurations precludes the generation of continuous all-atom molecular trajectories. We propose latent space simulators (LSS) to learn kinetic models for continuous all-atom simulation trajectories by training three deep learning networks to (i) learn the slow collective variables of the molecular system, (ii) propagate the system dynamics within this slow latent space, and (iii) generatively reconstruct molecular configurations. We demonstrate the approach in an application to Trp-cage miniprotein to produce novel ultra-long synthetic folding trajectories that accurately reproduce all-atom molecular structure, thermodynamics, and kinetics at six orders of magnitude lower cost than MD. The dramatically lower cost of trajectory generation enables greatly improved sampling and greatly reduced statistical uncertainties in estimated thermodynamic averages and kinetic rates.


title: Learning Geocentric Object Pose in Oblique Monocular Images

abstract: An object's geocentric pose, defined as the height above ground and orientation with respect to gravity, is a powerful representation of real-world structure for object detection, segmentation, and localization tasks using RGBD images. For close-range vision tasks, height and orientation have been derived directly from stereo-computed depth and more recently from monocular depth predicted by deep networks. For long-range vision tasks such as Earth observation, depth cannot be reliably estimated with monocular images. Inspired by recent work in monocular height above ground prediction and optical flow prediction from static images, we develop an encoding of geocentric pose to address this challenge and train a deep network to compute the representation densely, supervised by publicly available airborne lidar. We exploit these attributes to rectify oblique images and remove observed object parallax to dramatically improve the accuracy of localization and to enable accurate alignment of multiple images taken from very different oblique viewpoints. We demonstrate the value of our approach by extending two large-scale public datasets for semantic segmentation in oblique satellite images. All of our data and code are publicly available.


title: From Spectrum Wavelet to Vertex Propagation: Graph Convolutional Networks Based on Taylor Approximation

abstract: Graph convolutional networks (GCN) have been recently utilized to extract the underlying structures of datasets with some labeled data and high-dimensional features. Existing GCNs mostly rely on a first-order Chebyshev approximation of graph wavelet-kernels. Such a generic propagation model does not always suit the various datasets and their features. This work revisits the fundamentals of graph wavelet and explores the utility of signal propagation in the vertex domain to approximate the spectral wavelet-kernels. We first derive the conditions for representing the graph wavelet-kernels via vertex propagation. We next propose alternative propagation models for GCN layers based on Taylor expansions. We further analyze the choices of detailed graph representations for TGCNs. Experiments on citation networks, multimedia datasets and synthetic graphs demonstrate the advantage of Taylor-based GCN (TGCN) in the node classification problems over the traditional GCN methods.


title: Horizon radiation reaction forces

abstract: Using Effective Field Theory (EFT) methods, we compute the effects of horizon dissipation on the gravitational interactions of relativistic binary black hole systems. We assume that the dynamics is perturbative, i.e it admits an expansion in powers of Newton's constant (post-Minkowskian, or PM, approximation). As applications, we compute corrections to the scattering angle in a black hole collision due to dissipative effects to leading PM order, as well as the post-Newtonian (PN) corrections to the equations of motion of binary black holes in non-relativistic orbits, which represents the leading order finite size effect in the equations of motion. The methods developed here are also applicable to the case of more general compact objects, eg. neutron stars, where the magnitude of the dissipative effects depends on non-gravitational physics (e.g, the equation of state for nuclear matter).


title: Context Graphs for Legal Reasoning and Argumentation

abstract: We propose a new, structured, logic-based framework for legal reasoning and argumentation: Instead of using a single, unstructured meaning space, theory graphs organize knowledge and inference into collections of modular meaning spaces organized by inheritance and interpretation. Context graphs extend theory graphs by attack relations and interpret theories as knowledge contexts of agents in argumentation. We introduce the context graph paradigm by modeling the well-studied case Popov v. Hayashi, concentrating on the role of analogical reasoning in context graphs.


title: Finite Quantum Gravity Amplitudes -- no strings attached

abstract: We study the gravity-mediated scattering of scalar fields based on a parameterisation of the Lorentzian quantum effective action. We demonstrate that the interplay of infinite towers of spin zero and spin two poles at imaginary squared momentum leads to scattering amplitudes that are compatible with unitarity bounds, causal, and scale-free at trans-Planckian energy. Our construction avoids introducing non-localities or the massive higher-spin particles that are characteristic in string theory.


title: Ultra-fast two-qubit ion gate using sequences of resonant pulses

abstract: We propose a new protocol to implement ultra-fast two-qubit phase gates with trapped ions using spin-dependent kicks induced by resonant transitions. By only optimizing the allocation of the arrival times in a pulse train sequence the gate is implemented in times faster than the trapping oscillation period $T<2\pi/\omega$. Such gates allow us to increase the number of gate operations that can be completed within the coherence time of the ion-qubits favoring the development of scalable quantum computers.


title: Lower Bound to the Entanglement Entropy of the XXZ Spin Ring

abstract: We study the free XXZ quantum spin model defined on a ring of size $L$ and show that the bipartite entanglement entropy of eigenstates belonging to the first energy band above the vacuum ground state satisfies a logarithmically corrected area law. Along the way, we show a Combes-Thomas estimate for fiber operators which can also be applied to discrete many-particle Schr\"odinger operators on more general translation-invariant graphs.


title: Tensor Estimation with Nearly Linear Samples Given Weak Side Information

abstract: Tensor completion exhibits an interesting computational-statistical gap in terms of the number of samples needed to perform tensor estimation. While there are only $\Theta(tn)$ degrees of freedom in a $t$-order tensor with $n^t$ entries, the best known polynomial time algorithm requires $O(n^{t/2})$ samples in order to guarantee consistent estimation. In this paper, we show that weak side information is sufficient to reduce the sample complexity to $O(n)$. The side information consists of a weight vector for each of the modes which is not orthogonal to any of the latent factors along that mode; this is significantly weaker than assuming noisy knowledge of the subspaces. We provide an algorithm that utilizes this side information to produce a consistent estimator with $O(n^{1+\kappa})$ samples for any small constant $\kappa > 0$.


title: Virtual Testbed for Monocular Visual Navigation of Small Unmanned Aircraft Systems

abstract: Monocular visual navigation methods have seen significant advances in the last decade, recently producing several real-time solutions for autonomously navigating small unmanned aircraft systems without relying on GPS. This is critical for military operations which may involve environments where GPS signals are degraded or denied. However, testing and comparing visual navigation algorithms remains a challenge since visual data is expensive to gather. Conducting flight tests in a virtual environment is an attractive solution prior to committing to outdoor testing. This work presents a virtual testbed for conducting simulated flight tests over real-world terrain and analyzing the real-time performance of visual navigation algorithms at 31 Hz. This tool was created to ultimately find a visual odometry algorithm appropriate for further GPS-denied navigation research on fixed-wing aircraft, even though all of the algorithms were designed for other modalities. This testbed was used to evaluate three current state-of-the-art, open-source monocular visual odometry algorithms on a fixed-wing platform: Direct Sparse Odometry, Semi-Direct Visual Odometry, and ORB-SLAM2 (with loop closures disabled).


title: Multilayer neutron stars with scalar mesons crossing term

abstract: It is shown that recently proposed RMF model with $\sigma$ and $\delta$ meson interaction agrees with the observational data and presents an interesting structure with phase transition in the outer part of neutron star core.


title: Keck Cosmic Web Imager (KCWI) Spectra of Globular Clusters and Ultra Compact Dwarfs in the Halo of M87

abstract: Using the Keck Cosmic Web Imager we obtain spectra of several globular clusters (GCs), ultra compact dwarfs (UCDs) and the inner halo starlight of M87, at a similar projected galactocentric radius of $\sim$5 kpc. This enables us, for the first time, to apply the same stellar population analysis to the GCs, UCDs and starlight consistently to derive ages, metallicities and alpha-element abundances in M87. We find evidence for a dual stellar population in the M87 halo light, i.e an $\sim$80\% component by mass which is old and metal-rich and a $\sim$20\% component which is old but metal-poor. Two red GCs share similar stellar populations to the halo light suggesting they may have formed contemporaneously with the dominant halo component. Three UCDs, and one blue GC, have similar stellar populations, with younger mean ages, lower metallicities and near solar alpha-element abundances. Combined with literature data, our findings are consistent with the scenario that UCDs are the remnant nucleus of a stripped galaxy. We further investigate the discrepancy in the literature for M87's kinematics at large radii, favouring a declining velocity dispersion profile. This work has highlighted the need for more self-consistent studies of galaxy halos.


title: Build2Vec: Building Representation in Vector Space

abstract: In this paper, we represent a methodology of a graph embeddings algorithm that is used to transform labeled property graphs obtained from a Building Information Model (BIM). Industrial Foundation Classes (IFC) is a standard schema for BIM, which is utilized to convert the building data into a graph representation. We used node2Vec with biased random walks to extract semantic similarities between different building components and represent them in a multi-dimensional vector space. A case study implementation is conducted on a net-zero-energy building located at the National University of Singapore (SDE4). This approach shows promising machine learning applications in capturing the semantic relations and similarities of different building objects, more specifically, spatial and spatio-temporal data.


title: Deep learning-based holographic polarization microscopy

abstract: Polarized light microscopy provides high contrast to birefringent specimen and is widely used as a diagnostic tool in pathology. However, polarization microscopy systems typically operate by analyzing images collected from two or more light paths in different states of polarization, which lead to relatively complex optical designs, high system costs or experienced technicians being required. Here, we present a deep learning-based holographic polarization microscope that is capable of obtaining quantitative birefringence retardance and orientation information of specimen from a phase recovered hologram, while only requiring the addition of one polarizer/analyzer pair to an existing holographic imaging system. Using a deep neural network, the reconstructed holographic images from a single state of polarization can be transformed into images equivalent to those captured using a single-shot computational polarized light microscope (SCPLM). Our analysis shows that a trained deep neural network can extract the birefringence information using both the sample specific morphological features as well as the holographic amplitude and phase distribution. To demonstrate the efficacy of this method, we tested it by imaging various birefringent samples including e.g., monosodium urate (MSU) and triamcinolone acetonide (TCA) crystals. Our method achieves similar results to SCPLM both qualitatively and quantitatively, and due to its simpler optical design and significantly larger field-of-view, this method has the potential to expand the access to polarization microscopy and its use for medical diagnosis in resource limited settings.

categories: physics.optics cs.CV eess.IV physics.app-ph


title: Scalable modeling of nonstationary covariance functions with non-folding B-spline deformation

abstract: We propose a method for nonstationary covariance function modeling, based on the spatial deformation method of Sampson and Guttorp [1992], but using a low-rank, scalable deformation function written as a linear combination of the tensor product of B-spline basis. This approach addresses two important weaknesses in current computational aspects. First, it allows one to constrain estimated 2D deformations to be non-folding (bijective) in 2D. This requirement of the model has, up to now,been addressed only by arbitrary levels of spatial smoothing. Second, basis functions with compact support enable the application to large datasets of spatial monitoring sites of environmental data. An application to rainfall data in southeastern Brazil illustrates the method


title: Generating Series for Networks of Chen-Fliess Series

abstract: Consider a set of single-input, single-output nonlinear systems whose input-output maps are described only in terms of convergent Chen-Fliess series without any assumption that finite dimensional state space models are available. It is shown that any additive or multiplicative interconnection of such systems always has a Chen-Fliess series representation that can be computed explicitly in terms of iterated formal Lie derivatives.


title: Review of the First Charged-Particle Transport Coefficient Comparison Workshop

abstract: We present the results of the first Charged-Particle Transport Coefficient Code Comparison Workshop, which was held in Albuquerque, NM October 4-6, 2016. In this first workshop, scientists from eight institutions and four countries gathered to compare calculations of transport coefficients including thermal and electrical conduction, electron-ion coupling, inter-ion diffusion, ion viscosity, and charged particle stopping powers. Here, we give general background on Coulomb coupling and computational expense, review where some transport coefficients appear in hydrodynamic equations, and present the submitted data. Large variations are found when either the relevant Coulomb coupling parameter is large or computational expense causes difficulties. Understanding the general accuracy and uncertainty associated with such transport coefficients is important for quantifying errors in hydrodynamic simulations of inertial confinement fusion and high-energy density experiments.


title: Efficient Generation of Mandelbrot Set using Message Passing Interface

abstract: With the increasing need for safer and reliable systems, Mandelbrot Set's use in the encryption world is evident to everyone. This document aims to provide an efficient method to generate this set using data parallelism. First Bernstein's conditions are used to ensure that the Data is parallelizable when generating the Mandelbrot Set. Then Amdhal's Law is used to calculate the theoretical speed up, to be used to compare three partition schemes. The three partition schemes discussed in this document are the Na\"ive Row Segmentation, the First Come First Served Row Segmentation and the Alternating Row Segmentation. The Message Parsing Interface (MPI) library in C is used for all of the communication. After testing all the implementation on MonARCH, the results demonstrate that the Na\"ive Row Segmentation approach did not perform as par. But the Alternating Row Segmentation approach performs better when the number of tasks are $< 16$, where as the First Come First Served approach performs better when the number of tasks is $\ge 16$.


title: Double-containment coil with enhanced winding mounting for transcranial magnetic stimulation with reduced acoustic noise

abstract: Objective: This work aims to reduce the acoustic noise level of transcranial magnetic stimulation (TMS) coils. TMS requires high currents (several thousand amperes) to be pulsed through the coil, which generates a loud acoustic impulse whose peak sound pressure level (SPL) can exceed 130 dB(Z). This sound poses a risk to hearing and elicits unwanted neural activation of auditory brain circuits. Methods: We propose a new double-containment coil with enhanced winding mounting (DCC), which utilizes acoustic impedance mismatch to contain and dissipate the impulsive sound within an air-tight outer casing. The coil winding is potted in a rigid block, which is mounted to the outer casing by its acoustic nodes that are subject to minimum vibration during the pulse. The rest of the winding block is isolated from the casing by an air gap, and sound is absorbed by foam within the casing. The casing thickness under the winding center is minimized to maximize the coil electric field output. Results: Compared to commercial figure-of-eight TMS coils, the DCC prototype has 10-33 dB(Z) lower SPL at matched stimulation strength, whilst providing 22% higher maximum stimulation strength than equally focal commercial coils. Conclusion: The DCC design greatly reduces the acoustic noise of TMS while increasing the achievable stimulation strength. Significance: The acoustic noise reduction from our coil design is comparable to that provided by typical hearing protection devices. This coil design approach can enhance hearing safety and reduce auditory co-activations in the brain and other detrimental effects of TMS sound.


title: A Semantic Web Framework for Automated Smart Assistants: COVID-19 Case Study

abstract: COVID-19 pandemic elucidated that knowledge systems will be instrumental in cases where accurate information needs to be communicated to a substantial group of people with different backgrounds and technological resources. However, several challenges and obstacles hold back the wide adoption of virtual assistants by public health departments and organizations. This paper presents the Instant Expert, an open-source semantic web framework to build and integrate voice-enabled smart assistants (i.e. chatbots) for any web platform regardless of the underlying domain and technology. The component allows non-technical domain experts to effortlessly incorporate an operational assistant with voice recognition capability into their websites. Instant Expert is capable of automatically parsing, processing, and modeling Frequently Asked Questions pages as an information resource as well as communicating with an external knowledge engine for ontology-powered inference and dynamic data utilization. The presented framework utilizes advanced web technologies to ensure reusability and reliability, and an inference engine for natural language understanding powered by deep learning and heuristic algorithms. A use case for creating an informatory assistant for COVID-19 based on the Centers for Disease Control and Prevention (CDC) data is presented to demonstrate the framework's usage and benefits.


title: Weakly-Supervised Segmentation for Disease Localization in Chest X-Ray Images

abstract: Deep Convolutional Neural Networks have proven effective in solving the task of semantic segmentation. However, their efficiency heavily relies on the pixel-level annotations that are expensive to get and often require domain expertise, especially in medical imaging. Weakly supervised semantic segmentation helps to overcome these issues and also provides explainable deep learning models. In this paper, we propose a novel approach to the semantic segmentation of medical chest X-ray images with only image-level class labels as supervision. We improve the disease localization accuracy by combining three approaches as consecutive steps. First, we generate pseudo segmentation labels of abnormal regions in the training images through a supervised classification model enhanced with a regularization procedure. The obtained activation maps are then post-processed and propagated into a second classification model-Inter-pixel Relation Network, which improves the boundaries between different object classes. Finally, the resulting pseudo-labels are used to train a proposed fully supervised segmentation model. We analyze the robustness of the presented method and test its performance on two distinct datasets: PASCAL VOC 2012 and SIIM-ACR Pneumothorax. We achieve significant results in the segmentation on both datasets using only image-level annotations. We show that this approach is applicable to chest X-rays for detecting an anomalous volume of air in the pleural space between the lung and the chest wall. Our code has been made publicly available.


title: The $R$-Process Alliance: Fourth Data Release from the Search for $r$-Process-Enhanced Stars in the Galactic Halo

abstract: This compilation is the fourth data release from the $R$-Process Alliance (RPA) search for $r$-process-enhanced stars, and the second release based on "snapshot" high-resolution ($R \sim 30,000$) spectra collected with the du Pont 2.5m Telescope. In this data release, we propose a new delineation between the $r$-I and $r$-II stellar classes at $\mathrm{[Eu/Fe]} = +0.7$, instead of the empirically chosen $\mathrm{[Eu/Fe]} = +1.0$ level previously in use, based on statistical tests of the complete set of RPA data released to date. We also statistically justify the minimum level of [Eu/Fe] for definition of the $r$-I stars, [Eu/Fe] $> +0.3$. Redefining the separation between $r$-I and $r$-II stars will aid in analysis of the possible progenitors of these two classes of stars and whether these signatures arise from separate astrophysical sources at all. Applying this redefinition to previous RPA data, the number of identified $r$-II and $r$-I stars changes to 51 and 121, respectively, from the initial set of data releases published thus far. In this data release, we identify 21 new $r$-II, 111 new $r$-I (plus three re-identified), and 7 new (plus one re-identified) limited-$r$ stars out of a total of 232 target stars, resulting in a total sample of 72 new $r$-II stars, 232 new $r$-I stars, and 42 new limited-$r$ stars identified by the RPA to date.


title: Legends: Folklore on Reddit

abstract: In this paper we introduce Reddit legends, a collection of venerated old posts that have become famous on Reddit. To establish the utility of Reddit legends for both computational science/HCI and folkloristics, we investigate two main questions: (1) whether they can be considered folklore, i.e. if they have consistent form, cultural significance, and undergo spontaneous transmission, and (2) whether they can be studied in a systematic manner. Through several subtasks, including the creation of a typology, an analysis of references to Reddit legends, and an examination of some of the textual characteristics of referencing behaviour, we show that Reddit legends can indeed be considered as folklore and that they are amendable to systematic text-based approaches. We discuss how these results will enable future analyses of folklore on Reddit, including tracking subreddit-wide and individual-user behaviour, and the relationship of this behaviour to other cultural markers.


title: Next-to-leading order Balitsky-Kovchegov equation beyond large $N_\mathrm{c}$

abstract: We calculate finite-$N_\mathrm{c}$ corrections to the next-to-leading order (NLO) Balitsky-Kovchegov (BK) equation. We find analytical expressions for the necessary correlators of six Wilson lines in terms of the two-point function using the Gaussian approximation. In a suitable basis, the problem reduces from the diagonalization of a six-by-six matrix to the diagonalization of a three-by-three matrix, which can easily be done analytically. We study numerically the effects of these finite-$N_\mathrm{c}$ corrections on the NLO BK equation. In general, we find that the finite-$N_\mathrm{c}$ corrections are smaller than the expected $1/N_\mathrm{c}^2 \sim 10\%$. The corrections may be large for individual correlators, but have less of an influence on the shape of the amplitude as a function of the dipole size. They have an even smaller effect on the evolution speed as a function of rapidity.


title: Is Rust Used Safely by Software Developers?

abstract: Rust, an emerging programming language with explosive growth, provides a robust type system that enables programmers to write memory-safe and data-race free code. To allow access to a machine's hardware and to support low-level performance optimizations, a second language, Unsafe Rust, is embedded in Rust. It contains support for operations that are difficult to statically check, such as C-style pointers for access to arbitrary memory locations and mutable global variables. When a program uses these features, the compiler is unable to statically guarantee the safety properties Rust promotes. In this work, we perform a large-scale empirical study to explore how software developers are using Unsafe Rust in real-world Rust libraries and applications. Our results indicate that software engineers use the keyword unsafe in less than 30% of Rust libraries, but more than half cannot be entirely statically checked by the Rust compiler because of Unsafe Rust hidden somewhere in a library's call chain. We conclude that although the use of the keyword unsafe is limited, the propagation of unsafeness offers a challenge to the claim of Rust as a memory-safe language. Furthermore, we recommend changes to the Rust compiler and to the central Rust repository's interface to help Rust software developers be aware of when their Rust code is unsafe.


title: Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey

abstract: As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper studies strategies to implement adversary robustly trained algorithms towards guaranteeing safety in machine learning algorithms. We provide a taxonomy to classify adversarial attacks and defenses, formulate the Robust Optimization problem in a min-max setting and divide it into 3 subcategories, namely: Adversarial (re)Training, Regularization Approach, and Certified Defenses. We survey the most recent and important results in adversarial example generation, defense mechanisms with adversarial (re)Training as their main defense against perturbations. We also survey mothods that add regularization terms that change the behavior of the gradient, making it harder for attackers to achieve their objective. Alternatively, we've surveyed methods which formally derive certificates of robustness by exactly solving the optimization problem or by approximations using upper or lower bounds. In addition, we discuss the challenges faced by most of the recent algorithms presenting future research perspectives.


title: Simulation and Analysis of Distributed Wireless Sensor Network using Message Passing Interface

abstract: Wireless Sensor Networks (WSN) are used by many industries from environment monitoring systems to NASA's space exploration programs, as it has allowed society to monitor and prevent problems before they occur with less cost and maintenance. This document aims to propose and analyze an efficient inter process communication (IPC) architecture using a nearest neighbor/grid based socket architecture. A parallelized version of the AES encryption algorithm is also used in order to increase the security of the WSN. First the proposed architecture is compared and contrasted against other well established architectures. Next, the benefits and drawbacks of the AES encryption algorithm is elucidated. The Message Parsing Interface (MPI) library in C is used for the communication while OpenMP is used for parallelizing the encryption algorithm. Next an analysis is performed on the results obtained from multiple simulations. Finally a conclusion is made that the grid based IPC architecture with AES parallel encryption helps WSNs maintain security in communication while being cost and power efficient to operate.


title: Lockdown effects on air quality in megacities during the first and second waves of COVID-19 pandemic

abstract: Air pollution is among the highest contributors to mortality worldwide, especially in urban areas. During spring 2020, many countries enacted social distancing measures in order to slow down the ongoing COVID-19 pandemic. A particularly drastic measure, the 'lockdown', urged people to stay at home and thereby prevent new COVID-19 infections during the first (2020) and second wave (2021) of the pandemic. In turn, it also reduced traffic and industrial activities. But how much did these lockdown measures improve air quality in large cities, and are there differences in how air quality was affected? Here, we analyse data from two megacities: London as an example for Europe and Delhi as an example for Asia. We consider data during first and second wave lockdowns and compare them to 2019 values. Overall, we find a reduction in almost all air pollutants with intriguing differences between the two cities except Delhi in 2021. In London, despite smaller average concentrations, we still observe high-pollutant states and an increased tendency towards extreme events (a higher kurtosis of the probability density during lockdown) during 2020 and low pollution levels during 2021. For Delhi, we observe a much stronger decrease of pollution concentrations, including high pollution states during 2020 and higher pollution levels in 2021. These results could help to design policies to improve long-term air quality in megacities.


title: An Early Warning Approach to Monitor COVID-19 Activity with Multiple Digital Traces in Near Real-Time

abstract: Non-pharmaceutical interventions (NPIs) have been crucial in curbing COVID-19 in the United States (US). Consequently, relaxing NPIs through a phased re-opening of the US amid still-high levels of COVID-19 susceptibility could lead to new epidemic waves. This calls for a COVID-19 early warning system. Here we evaluate multiple digital data streams as early warning indicators of increasing or decreasing state-level US COVID-19 activity between January and June 2020. We estimate the timing of sharp changes in each data stream using a simple Bayesian model that calculates in near real-time the probability of exponential growth or decay. Analysis of COVID-19-related activity on social network microblogs, Internet searches, point-of-care medical software, and a metapopulation mechanistic model, as well as fever anomalies captured by smart thermometer networks, shows exponential growth roughly 2-3 weeks prior to comparable growth in confirmed COVID-19 cases and 3-4 weeks prior to comparable growth in COVID-19 deaths across the US over the last 6 months. We further observe exponential decay in confirmed cases and deaths 5-6 weeks after implementation of NPIs, as measured by anonymized and aggregated human mobility data from mobile phones. Finally, we propose a combined indicator for exponential growth in multiple data streams that may aid in developing an early warning system for future COVID-19 outbreaks. These efforts represent an initial exploratory framework, and both continued study of the predictive power of digital indicators as well as further development of the statistical approach are needed.


title: Signature-Based Abduction for Expressive Description Logics -- Technical Report

abstract: Signature-based abduction aims at building hypotheses over a specified set of names, the signature, that explain an observation relative to some background knowledge. This type of abduction is useful for tasks such as diagnosis, where the vocabulary used for observed symptoms differs from the vocabulary expected to explain those symptoms. We present the first complete method solving signature-based abduction for observations expressed in the expressive description logic ALC, which can include TBox and ABox axioms, thereby solving the knowledge base abduction problem. The method is guaranteed to compute a finite and complete set of hypotheses, and is evaluated on a set of realistic knowledge bases.


title: In-Distribution Interpretability for Challenging Modalities

abstract: It is widely recognized that the predictions of deep neural networks are difficult to parse relative to simpler approaches. However, the development of methods to investigate the mode of operation of such models has advanced rapidly in the past few years. Recent work introduced an intuitive framework which utilizes generative models to improve on the meaningfulness of such explanations. In this work, we display the flexibility of this method to interpret diverse and challenging modalities: music and physical simulations of urban environments.


title: Bandit Linear Control

abstract: We consider the problem of controlling a known linear dynamical system under stochastic noise, adversarially chosen costs, and bandit feedback. Unlike the full feedback setting where the entire cost function is revealed after each decision, here only the cost incurred by the learner is observed. We present a new and efficient algorithm that, for strongly convex and smooth costs, obtains regret that grows with the square root of the time horizon $T$. We also give extensions of this result to general convex, possibly non-smooth costs, and to non-stochastic system noise. A key component of our algorithm is a new technique for addressing bandit optimization of loss functions with memory.


title: Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning

abstract: Spatial frequency domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single snapshot optical properties (SSOP), introduce artifacts and sacrifice accuracy. To avoid this tradeoff, we introduce OxyGAN: a data-driven, content-aware method to estimate tissue oxygenation directly from single structured light images using end-to-end generative adversarial networks. Conventional SFDI is used to obtain ground truth tissue oxygenation maps for ex vivo human esophagi, in vivo hands and feet, and an in vivo pig colon sample under 659 nm and 851 nm sinusoidal illumination. We benchmark OxyGAN by comparing to SSOP and to a two-step hybrid technique that uses a previously-developed deep learning model to predict optical properties followed by a physical model to calculate tissue oxygenation. When tested on human feet, a cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96.5%. When applied to sample types not included in the training set, such as human hands and pig colon, OxyGAN achieves a 93.0% accuracy, demonstrating robustness to various tissue types. On average, OxyGAN outperforms SSOP and a hybrid model in estimating tissue oxygenation by 24.9% and 24.7%, respectively. Lastly, we optimize OxyGAN inference so that oxygenation maps are computed ~10 times faster than previous work, enabling video-rate, 25Hz imaging. Due to its rapid acquisition and processing speed, OxyGAN has the potential to enable real-time, high-fidelity tissue oxygenation mapping that may be useful for many clinical applications.


title: A simple bipartite graph projection model for clustering in networks

abstract: Graph datasets are frequently constructed by a projection of a bipartite graph, where two nodes are connected in the projection if they share a common neighbor in the bipartite graph; for example, a coauthorship graph is a projection of an author-publication bipartite graph. Analyzing the structure of the projected graph is common, but we do not have a good understanding of the consequences of the projection on such analyses. Here, we propose and analyze a random graph model to study what properties we can expect from the projection step. Our model is based on a Chung-Lu random graph for constructing the bipartite representation, which enables us to rigorously analyze the projected graph. We show that common network properties such as sparsity, heavy-tailed degree distributions, local clustering at nodes, the inverse relationship between node degree, and global transitivity can be explained and analyzed through this simple model. We also develop a fast sampling algorithm for our model, which we show is provably optimal for certain input distributions. Numerical simulations where model parameters come from real-world datasets show that much of the clustering behavior in some datasets can just be explained by the projection step.


title: TeleVital: Enhancing the quality of contactless health assessment

abstract: In the midst of rising positive cases of COVID-19, the hospitals face a newfound difficulty to prioritize on their patients and accommodate them. Moreover, crowding of patients at hospitals pose a threat to the healthcare workers and other patients at the hospital. With that in mind, a non-contact method of measuring the necessary vitals such as heart rate, respiratory rate and SPO$_2$ will prove highly beneficial for the hospitals to tackle this issue. This paper discusses our approach in achieving the non-contact measurement of vitals with the sole help of a webcam and further our design of an e-hospital platform for doctors and patients to attend appointments virtually. The platform also provides the doctor with an option to provide with voice-based prescriptions or digital prescriptions, to simplify the daily, exhausting routine of a doctor.


title: OrchideaSOL: a dataset of extended instrumental techniques for computer-aided orchestration

abstract: This paper introduces OrchideaSOL, a free dataset of samples of extended instrumental playing techniques, designed to be used as default dataset for the Orchidea framework for target-based computer-aided orchestration. OrchideaSOL is a reduced and modified subset of Studio On Line, or SOL for short, a dataset developed at Ircam between 1996 and 1998. We motivate the reasons behind OrchideaSOL and describe the differences between the original SOL and our dataset. We will also show the work done in improving the dynamic ranges of orchestral families and other aspects of the data.


title: Cross-Layer Deanonymization Methods in the Lightning Protocol

abstract: Bitcoin (BTC) pseudonyms (layer 1) can effectively be deanonymized using heuristic clustering techniques. However, while performing transactions off-chain (layer 2) in the Lightning Network (LN) seems to enhance privacy, a systematic analysis of the anonymity and privacy leakages due to the interaction between the two layers is missing. We present clustering heuristics that group BTC addresses, based on their interaction with the LN, as well as LN nodes, based on shared naming and hosting information. We also present linking heuristics that link 45.97% of all LN nodes to 29.61% BTC addresses interacting with the LN. These links allow us to attribute information (e.g., aliases, IP addresses) to 21.19% of the BTC addresses contributing to their deanonymization. Further, these deanonymization results suggest that the security and privacy of LN payments are weaker than commonly believed, with LN users being at the mercy of as few as five actors that control 36 nodes and over 33% of the total capacity. Overall, this is the first paper to present a method for linking LN nodes with BTC addresses across layers and to discuss privacy and security implications.


title: A Statistical Overview on Data Privacy

abstract: The eruption of big data with the increasing collection and processing of vast volumes and variety of data have led to breakthrough discoveries and innovation in science, engineering, medicine, commerce, criminal justice, and national security that would not have been possible in the past. While there are many benefits to the collection and usage of big data, there are also growing concerns among the general public on what personal information is collected and how it is used. In addition to legal policies and regulations, technological tools and statistical strategies also exist to promote and safeguard individual privacy, while releasing and sharing useful population-level information. In this overview, I introduce some of these approaches, as well as the existing challenges and opportunities in statistical data privacy research and applications to better meet the practical needs of privacy protection and information sharing.


title: Almost sure global well-posedness for the energy supercritical NLS on the unit ball of $\mathbb{R}^3$

abstract: In this paper, we present two almost sure global well-posedness (GWP) results for the energy supercritical nonlinear Schr\"odinger equations (NLS) on the unit ball of $\Bbb R^3$ using two different approaches. First, for the NLS with algebraic nonlinearities with the subcritical initial data, we show the almost sure global well-posedness and the invariance of the underlying measures, and establish controls on the growth of Sobolev norms of the solutions. This global result is based on a deterministic local theory and a probabilistic globalization. Second, for the NLS with generic power nonlinearities with critical and supercritical initial conditions, we prove the almost sure global well-posedness, and the invariance of the measure under the solution flows. This global result is built on a compactness argument and the Skorokhod representation theorem.


title: NP-PROV: Neural Processes with Position-Relevant-Only Variances

abstract: Neural Processes (NPs) families encode distributions over functions to a latent representation, given context data, and decode posterior mean and variance at unknown locations. Since mean and variance are derived from the same latent space, they may fail on out-of-domain tasks where fluctuations in function values amplify the model uncertainty. We present a new member named Neural Processes with Position-Relevant-Only Variances (NP-PROV). NP-PROV hypothesizes that a target point close to a context point has small uncertainty, regardless of the function value at that position. The resulting approach derives mean and variance from a function-value-related space and a position-related-only latent space separately. Our evaluation on synthetic and real-world datasets reveals that NP-PROV can achieve state-of-the-art likelihood while retaining a bounded variance when drifts exist in the function value.


title: Stabilization of $866$ nm laser with Pound-Drever-Hall (PDH) technique for quantum manipulation of Ca+ ion in Paul trap

abstract: This article provides an introduction to one of the most efficient laser stabilization techniques - the Pound-Drever-Hall (PDH) method. The aim of the experiment is to build the PDH stabilization apparatus from scratch. I describe all the necessary theoretical treatment to formulate the technique and then describe it as I have experimentally implemented in the lab. All major sources of noise are discussed and noise tackling methods are implemented. All the equipments used are also described in detail for their principle and working.


title: Patterns of Primes and Composites from Divisibility Network of Natural Numbers

abstract: We present the pattern underlying some of the properties of natural numbers, using the framework of complex networks. The network used is a divisibility network in which each node has a fixed identity as one of the natural numbers and the connections among the nodes are made based on the divisibility pattern among the numbers. We derive analytical expressions for the centrality measures of this network in terms of the floor function and the divisor functions. We validate these measures with the help of standard methods which make use of the adjacency matrix of the network. Thus how the measures of the network relate to patterns in the behaviour of primes and composite numbers becomes apparent from our study.


title: Higher bifurcations for polynomial skew-products

abstract: We continue our investigation of the parameter space of families of polynomial skew products. Assuming that the base polynomial has a Julia set not totally disconnected and is neither a Chebyshev nor a power map, we prove that, near any bifurcation parameter, one can find parameters where $k$ critical points bifurcate \emph{independently}, with $k$ up to the dimension of the parameter space. This is a striking difference with respect to the one-dimensional case. The proof is based on a variant of the inclination lemma, applied to the postcritical set at a Misiurewicz parameter. By means of an analytical criterion for the non-vanishing of the self-intersections of the bifurcation current, we deduce the equality of the supports of the bifurcation current and the bifurcation measure for such families. Combined with results by Dujardin and Taflin, this also implies that the support of the bifurcation measure in these families has non-empty interior.As part of our proof we construct, in these families, subfamilies of codimension 1 where the bifurcation locus has non empty interior. This provides a new independent proof of the existence of holomorphic families of arbitrarily large dimension whose bifurcation locus has non empty interior. Finally, it shows that the Hausdorff dimension of the support of the bifurcation measure is maximal at any point of its support.


title: Requirements, Status, and Plans for Track Reconstruction at the sPHENIX Experiment

abstract: sPHENIX is a new experiment that is being constructed at the Relativistic Heavy Ion Collider at Brookhaven National Laboratory. The primary physics goals of sPHENIX are to measure jets, their substructure, and the upsilon resonances in $p$$+$$p$, $p$+Au and Au+Au collisions. To realize these goals, a tracking system composed of a time projection chamber and several silicon detectors will be used to identify tracks that correspond to jets and upsilon decays. However, the sPHENIX experiment will collect approximately 200 PB of data utilizing a finite-sized computing center; thus, performing track reconstruction in a timely manner is a challenge due to the large occupancy of heavy-ion collisions. The sPHENIX experiment, its track reconstruction, and the need for implementing faster track -fitting algorithms, such as that provided by the A Common Tracking Software package, into the sPHENIX software stack are discussed.

categories: physics.ins-det hep-ex nucl-ex physics.data-an


title: Robust and Accurate Authorship Attribution via Program Normalization

abstract: Source code attribution approaches have achieved remarkable accuracy thanks to the rapid advances in deep learning. However, recent studies shed light on their vulnerability to adversarial attacks. In particular, they can be easily deceived by adversaries who attempt to either create a forgery of another author or to mask the original author. To address these emerging issues, we formulate this security challenge into a general threat model, the $\textit{relational adversary}$, that allows an arbitrary number of the semantics-preserving transformations to be applied to an input in any problem space. Our theoretical investigation shows the conditions for robustness and the trade-off between robustness and accuracy in depth. Motivated by these insights, we present a novel learning framework, $\textit{normalize-and-predict}$ ($\textit{N&P}$), that in theory guarantees the robustness of any authorship-attribution approach. We conduct an extensive evaluation of $\textit{N&P}$ in defending two of the latest authorship-attribution approaches against state-of-the-art attack methods. Our evaluation demonstrates that $\textit{N&P}$ improves the accuracy on adversarial inputs by as much as 70% over the vanilla models. More importantly, $\textit{N&P}$ also increases robust accuracy to 45% higher than adversarial training while running over 40 times faster.


title: Existence of solutions for a fractional Choquard--type equation in $\mathbb{R}$ with critical exponential growth

abstract: In this paper we study the following class of fractional Choquard--type equations \[ (-\Delta)^{1/2}u + u=\Big( I_\mu \ast F(u)\Big)f(u), \quad x\in\mathbb{R}, \] where $(-\Delta)^{1/2}$ denotes the $1/2$--Laplacian operator, $I_{\mu}$ is the Riesz potential with $0<\mu<1$ and $F$ is the primitive function of $f$. We use Variational Methods and minimax estimates to study the existence of solutions when $f$ has critical exponential growth in the sense of Trudinger--Moser inequality.


title: Advances in Statistical Modeling of Spatial Extremes

abstract: The classical modeling of spatial extremes relies on asymptotic models (i.e., max-stable processes or $r$-Pareto processes) for block maxima or peaks over high thresholds, respectively. However, at finite levels, empirical evidence often suggests that such asymptotic models are too rigidly constrained, and that they do not adequately capture the frequent situation where more severe events tend to be spatially more localized. In other words, these asymptotic models have a strong tail dependence that persists at increasingly high levels, while data usually suggest that it should weaken instead. Another well-known limitation of classical spatial extremes models is that they are either computationally prohibitive to fit in high dimensions, or they need to be fitted using less efficient techniques. In this review paper, we describe recent progress in the modeling and inference for spatial extremes, focusing on new models that have more flexible tail structures that can bridge asymptotic dependence classes, and that are more easily amenable to likelihood-based inference for large datasets. In particular, we discuss various types of random scale constructions, as well as the conditional spatial extremes model, which have recently been getting increasing attention within the statistics of extremes community. We illustrate some of these new spatial models on two different environmental applications.


title: Achieving Multi-Tasking Robots in Multi-Robot Tasks

abstract: One simplifying assumption made in distributed robot systems is that the robots are single-tasking: each robot operates on a single task at any time. While such a sanguine assumption is innocent to make in situations with sufficient resources so that the robots can operate independently, it becomes impractical when they must share their capabilities. In this paper, we consider multi-tasking robots with multi-robot tasks. Given a set of tasks, each achievable by a coalition of robots, our approach allows the coalitions to overlap and task synergies to be exploited by reasoning about the physical constraints that can be synergistically satisfied for achieving the tasks. The key contribution of this work is a general and flexible framework to achieve this ability for multi-robot systems in resource-constrained situations to extend their capabilities. The proposed approach is built on the information invariant theory, which specifies the interactions between information requirements. In our work, we map physical constraints to information requirements, thereby allowing task synergies to be identified via the information invariant framework. We show that our algorithm is sound and complete under a problem setting with multi-tasking robots. Simulation results show its effectiveness under resource-constrained situations and in handling challenging situations in a multi-UAV simulator.


title: Emulation of Astrocyte Induced Neural Phase Synchrony in Spin-Orbit Torque Oscillator Neurons

abstract: Astrocytes play a central role in inducing concerted phase synchronized neural-wave patterns inside the brain. In this article, we demonstrate that injected radio-frequency signal in underlying heavy metal layer of spin-orbit torque oscillator neurons mimic the neuron phase synchronization effect realized by glial cells. Potential application of such phase coupling effects is illustrated in the context of a temporal "binding problem". We also present the design of a coupled neuron-synapse-astrocyte network enabled by compact neuromimetic devices by combining the concepts of local spike-timing dependent plasticity and astrocyte induced neural phase synchrony.


title: Allocation of Multi-Robot Tasks with Task Variants

abstract: Task allocation has been a well studied problem. In most prior problem formulations, it is assumed that each task is associated with a unique set of resource requirements. In the scope of multi-robot task allocation problem, these requirements can be satisfied by a coalition of robots. In this paper, we introduce a more general formulation of multi-robot task allocation problem that allows more than one option for specifying the set of task requirements--satisfying any one of the options will satisfy the task. We referred to this new problem as the multi-robot task allocation problem with task variants. First, we theoretically show that this extension fortunately does not impact the complexity class, which is still NP-complete. For solution methods, we adapt two previous greedy methods for the task allocation problem without task variants to solve this new problem and analyze their effectiveness. In particular, we "flatten" the new problem to the problem without task variants, modify the previous methods to solve the flattened problem, and prove that the bounds still hold. Finally, we thoroughly evaluate these two methods along with a random baseline to demonstrate their efficacy for the new problem.


title: Integrated quantitative PIXE analysis and EDX spectroscopy using a laser-driven particle source

abstract: Among the existing elemental characterization techniques, Particle Induced X-ray Emission (PIXE) and Energy Dispersive X-ray (EDX) spectroscopy are two of the most widely used in different scientific and technological fields. Here we present the first quantitative laser-driven PIXE and laser-driven EDX experimental investigation performed at the Centro de L\'aseres Pulsados in Salamanca. Thanks to their potential for compactness and portability, laser-driven particle sources are very appealing for materials science applications, especially for materials analysis techniques. We demonstrate the possibility to exploit the X-ray signal produced by the co-irradiation with both electrons and protons to identify the elements in the sample. We show that, using the proton beam only, we can successfully obtain quantitative information about the sample structure through laser-driven PIXE analysis. These results pave the way towards the development of a compact and multi-functional apparatus for the elemental analysis of materials based on a laser-driven particle source.


title: Self-supervised Deep Reconstruction of Mixed Strip-shredded Text Documents

abstract: The reconstruction of shredded documents consists of coherently arranging fragments of paper (shreds) to recover the original document(s). A great challenge in computational reconstruction is to properly evaluate the compatibility between the shreds. While traditional pixel-based approaches are not robust to real shredding, more sophisticated solutions compromise significantly time performance. The solution presented in this work extends our previous deep learning method for single-page reconstruction to a more realistic/complex scenario: the reconstruction of several mixed shredded documents at once. In our approach, the compatibility evaluation is modeled as a two-class (valid or invalid) pattern recognition problem. The model is trained in a self-supervised manner on samples extracted from simulated-shredded documents, which obviates manual annotation. Experimental results on three datasets -- including a new collection of 100 strip-shredded documents produced for this work -- have shown that the proposed method outperforms the competing ones on complex scenarios, achieving accuracy superior to 90%.


title: Possible octupole deformation of $^{208}$Pb and the ultracentral $v_2$ to $v_3$ puzzle

abstract: Recent measurements have established the sensitivity of ultracentral heavy-ion collisions to the deformation parameters of non-spherical nuclei. In the case of ${}^{ 129}$Xe collisions, a quadrupole deformation of the nuclear profile led to an enhancement of elliptic flow in the most central collisions. In ${}^{ 208}$Pb collisions a discrepancy exists in similar centralities, where either elliptic flow is over-predicted or triangular flow is under-predicted by hydrodynamic models; this is known as the $v_2$-to-$v_3$ puzzle in ultracentral collisions. Motivated by low-energy nuclear structure calculations, we consider the possibility that $^{208}$Pb nuclei could have a pear shape deformation (octupole), which has the effect of increasing triangular flow in central PbPb collisions. Using the recent data from ALICE and ATLAS, we revisit the $v_2$-to-$v_3$ puzzle in ultracentral collisions, including new constraints from recent measurements of the triangular cumulant ratio $v_3\left\{4\right\}/v_3\left\{2\right\}$ and comparing two different hydrodynamic models. We find that, while an octupole deformation would slightly improve the ratio between $v_2$ and $v_3$, it is at the expense of a significantly worse triangular flow cumulant ratio. In fact, the latter observable prefers no octupole deformation, with $\beta_3\lesssim 0.0375$ for ${}^{ 208}$Pb, and is therefore consistent with the expectation for a doubly-magic nucleus even at top collider energies. The $v_2$-to-$v_3$ puzzle remains a challenge for hydrodynamic models.


title: A non-iterative domain decomposition method for the interaction between a fluid and a thick structure

abstract: This work focuses on the development and analysis of a partitioned numerical method for moving domain, fluid-structure interaction problems. We model the fluid using incompressible Navier-Stokes equations, and the structure using linear elasticity equations. We assume that the structure is thick, i.e., described in the same dimension as the fluid. We propose a non-iterative, domain decomposition method where the fluid and the structure sub-problems are solved separately. The method is based on generalized Robin boundary conditions, which are used in both fluid and structure sub-problems. Using energy estimates, we show that the proposed method applied to a moving domain problem is unconditionally stable. We also analyze the convergence of the method and show $\mathcal{O}(\Delta t^\frac12)$ convergence in time and optimal convergence in space. Numerical examples are used to demonstrate the performance of the method. In particular, we explore the relation between the combination parameter used in the derivation of the generalized Robin boundary conditions and the accuracy of the scheme. We also compare the performance of the method to a monolithic solver.


title: Quasihyperbolic Metric Universal Covers

abstract: We present a simple analytical proof that the natural metric universal cover of a quasihyperbolic planar domain is a complete Hadamard metric space.


title: Energy transfer under natural incoherent light: Effects of asymmetry on efficiency

abstract: The non-equilibrium stationary coherences that form in donor-acceptor systems are investigated to determine their relationship to the efficiency of energy transfer to a neighboring reaction center. It is found that the effects of asymmetry in the dimer are generally detrimental to the transfer of energy. Four types of systems are examined, arising from combinations of localized trapping, delocalized (Forster) trapping, eigenstate dephasing and site basis dephasing. In the cases of site basis dephasing the interplay between the energy gap of the excited dimer states and the environment is shown to give rise to a turnover effect in the efficiency under weak dimer coupling conditions. Furthermore, the nature of the coherences and associated flux are interpreted in terms of pathway interference effects. In addition, regardless of the cases considered, the ratio of the real part and the imaginary part of the coherences in the energy-eigenbasis tends to a constant value in the steady state limit.


title: Convolutional Neural Network Training with Distributed K-FAC

abstract: Training neural networks with many processors can reduce time-to-solution; however, it is challenging to maintain convergence and efficiency at large scales. The Kronecker-factored Approximate Curvature (K-FAC) was recently proposed as an approximation of the Fisher Information Matrix that can be used in natural gradient optimizers. We investigate here a scalable K-FAC design and its applicability in convolutional neural network (CNN) training at scale. We study optimization techniques such as layer-wise distribution strategies, inverse-free second-order gradient evaluation, and dynamic K-FAC update decoupling to reduce training time while preserving convergence. We use residual neural networks (ResNet) applied to the CIFAR-10 and ImageNet-1k datasets to evaluate the correctness and scalability of our K-FAC gradient preconditioner. With ResNet-50 on the ImageNet-1k dataset, our distributed K-FAC implementation converges to the 75.9% MLPerf baseline in 18-25% less time than does the classic stochastic gradient descent (SGD) optimizer across scales on a GPU cluster.


title: The appearance of particle tracks in detectors

abstract: The phenomenon that a quantum particle propagating in a detector, such as a Wilson cloud chamber, leaves a track close to a classical trajectory is analyzed. We introduce an idealized quantum-mechanical model of a charged particle that is periodically illuminated by pulses of laser light resulting in repeated indirect measurements of the approximate position of the particle. For this model we present a mathematically rigorous analysis of the appearance of particle tracks, assuming that the Hamiltonian of the particle is quadratic in the position- and momentum operators, as for a freely moving particle or a harmonic oscillator.


title: Four-dimensional de Sitter space is a Glauber-Sudarshan state in string theory

abstract: We show that four-dimensional de Sitter space is a Glauber-Sudarshan state, i.e. a coherent state, over a supersymmetric solitonic background in full string theory. We argue that such a state is only realized in the presence of temporally varying degrees of freedom and including quantum corrections, with supersymmetry being broken spontaneously. On the other hand, fluctuations over the resulting de Sitter space is governed by the Agarwal-Tara state, which is a graviton (and flux)-added coherent state. Once de Sitter space is realized as a coherent state, and not as a vacuum, its ability to remain out of the swampland as well as issues regarding its (meta)stability, vacuum energy, and finite entropy appear to have clear resolutions.


title: Polar morphologies from first principles: PbTiO$_3$ films on SrTiO$_3$ substrates and the $p(2 \times \Lambda)$ surface reconstruction

abstract: Low dimensional structures comprised of ferroelectric (FE) PbTiO$_3$ (PTO) and quantum paraelectric SrTiO$_3$ (STO) are hosts to complex polarization textures such as polar waves, flux-closure domains and polar skyrmion phases. Density functional theory (DFT) simulations can provide insight into this order, but, are limited by the computational effort needed to simulate the thousands of required atoms. To relieve this issue, we use the novel multi-site support function (MSSF) method within DFT to reduce the solution time for the electronic groundstate whilst preserving high accuracy. Using MSSFs, we simulate thin PTO films on STO substrates with system sizes $>2000$ atoms. In the ultrathin limit, the polar wave texture with cylindrical chiral bubbles emerges as an intermediate phase between full flux closure domains and in-plane polarization. This is driven by an internal bias field born of the compositionally broken inversion symmetry in the [001] direction. Since the exact nature of this bias field depends sensitively on the film boundary conditions, this informs a new principle of design for manipulating chiral order on the nanoscale through the careful choice of substrate, surface termination or use of overlayers. Antiferrodistortive (AFD) order locally interacts with these polar textures giving rise to strong FE/AFD coupling at the PbO terminated surface driving a $p(2 \times \Lambda)$ surface reconstruction. This offers another pathway for the local control of ferroelectricity.


title: Trial of a search for a face-centered-cubic high-entropy alloy superconductor

abstract: With the aim of the discovery of face-centered-cubic (fcc) high-entropy alloy (HEA) superconductor, we have carried out materials research on Nb or Pb-containing multi-component alloys. Although the X-ray diffraction (XRD) patterns of some Nb-containing samples exhibited the dominant fcc phases, no superconducting signals were observed down to 3 K. Examination with an energy dispersive X-ray spectrometer revealed that all samples were multi-phase, but the existence of several new Nb-containing HEA phases was found in them. It was confirmed that the synthesis of Pb-containing an HEA or quaternary alloy would be difficult, probably due to the large differences in the crystal structure and atomic radius among constituent elements, low reaction temperature and the lack of a rapid cooling process in the synthesis. Despite the negative results in this research, some hints for an improved strategy for the search for an fcc HEA superconductor are provided. Moreover, our results are useful as fundamental data for future HEA predictions or for studies of phase relations in Nb or Pb-containing multi-component alloys based on the CALPHAD (calculation of phase diagram) method.


title: Second Order Accurate Hierarchical Approximate Factorization of Sparse SPD Matrices

abstract: We describe a second-order accurate approach to sparsifying the off-diagonal blocks in the hierarchical approximate factorizations of sparse symmetric positive definite matrices. The norm of the error made by the new approach depends quadratically, not linearly, on the error in the low-rank approximation of the given block. The analysis of the resulting two-level preconditioner shows that the preconditioner is second-order accurate as well. We incorporate the new approach into the recent Sparsified Nested Dissection algorithm [SIAM J. Matrix Anal. Appl., 41 (2020), pp. 715-746], and test it on a wide range of problems. The new approach halves the number of Conjugate Gradient iterations needed for convergence, with almost the same factorization complexity, improving the total runtimes of the algorithm. Our approach can be incorporated into other rank-structured methods for solving sparse linear systems.


title: Incremental Bayesian tensor learning for structural monitoring data imputation and response forecasting

abstract: There has been increased interest in missing sensor data imputation, which is ubiquitous in the field of structural health monitoring (SHM) due to discontinuous sensing caused by sensor malfunction. To address this fundamental issue, this paper presents an incremental Bayesian tensor learning method for reconstruction of spatiotemporal missing data in SHM and forecasting of structural response. In particular, a spatiotemporal tensor is first constructed followed by Bayesian tensor factorization that extracts latent features for missing data imputation. To enable structural response forecasting based on incomplete sensing data, the tensor decomposition is further integrated with vector autoregression in an incremental learning scheme. The performance of the proposed approach is validated on continuous field-sensing data (including strain and temperature records) of a concrete bridge, based on the assumption that strain time histories are highly correlated to temperature recordings. The results indicate that the proposed probabilistic tensor learning approach is accurate and robust even in the presence of large rates of random missing, structured missing and their combination. The effect of rank selection on the imputation and prediction performance is also investigated. The results show that a better estimation accuracy can be achieved with a higher rank for random missing whereas a lower rank for structured missing.

categories: cs.LG cs.NA math.NA physics.data-an stat.ML


title: Learning a Distributed Control Scheme for Demand Flexibility in Thermostatically Controlled Loads

abstract: Demand flexibility is increasingly important for power grids, in light of growing penetration of renewable generation. Careful coordination of thermostatically controlled loads (TCLs) can potentially modulate energy demand, decrease operating costs, and increase grid resiliency. However, it is challenging to control a heterogeneous population of TCLs: the control problem has a large state action space; each TCL has unique and complex dynamics; and multiple system-level objectives need to be optimized simultaneously. To address these challenges, we propose a distributed control solution, which consists of a central load aggregator that optimizes system-level objectives and building-level controllers that track the load profiles planned by the aggregator. To optimize our agents' policies, we draw inspirations from both reinforcement learning (RL) and model predictive control. Specifically, the aggregator is updated with an evolutionary strategy, which was recently demonstrated to be a competitive and scalable alternative to more sophisticated RL algorithms and enables policy updates independent of the building-level controllers. We evaluate our proposed approach across four climate zones in four nine-building clusters, using the newly-introduced CityLearn simulation environment. Our approach achieved an average reduction of 16.8% in the environment cost compared to the benchmark rule-based controller.


title: Age-Oriented Face Synthesis with Conditional Discriminator Pool and Adversarial Triplet Loss

abstract: The vanilla Generative Adversarial Networks (GAN) are commonly used to generate realistic images depicting aged and rejuvenated faces. However, the performance of such vanilla GANs in the age-oriented face synthesis task is often compromised by the mode collapse issue, which may result in the generation of faces with minimal variations and a poor synthesis accuracy. In addition, recent age-oriented face synthesis methods use the L1 or L2 constraint to preserve the identity information on synthesized faces, which implicitly limits the identity permanence capabilities when these constraints are associated with a trivial weighting factor. In this paper, we propose a method for the age-oriented face synthesis task that achieves a high synthesis accuracy with strong identity permanence capabilities. Specifically, to achieve a high synthesis accuracy, our method tackles the mode collapse issue with a novel Conditional Discriminator Pool (CDP), which consists of multiple discriminators, each targeting one particular age category. To achieve strong identity permanence capabilities, our method uses a novel Adversarial Triplet loss. This loss, which is based on the Triplet loss, adds a ranking operation to further pull the positive embedding towards the anchor embedding resulting in significantly reduced intra-class variances in the feature space. Through extensive experiments, we show that our proposed method outperforms state-of-the-art methods in terms of synthesis accuracy and identity permanence capabilities, qualitatively and quantitatively.


title: A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates

abstract: This work develops a new multifidelity ensemble Kalman filter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multifidelity extensions of the EnKF, where the uncertainty in coarser fidelities in the hierarchy of models represent control variates for the uncertainty in finer fidelities. Small ensembles of high fidelity model runs are complemented by larger ensembles of cheaper, lower fidelity runs, to obtain much improved analyses at only small additional computational costs. We investigate the use of reduced order models as coarse fidelity control variates in the MFEnKF, and provide analyses to quantify the improvements over the traditional ensemble Kalman filters. We apply these ideas to perform data assimilation with a quasi-geostrophic test problem, using direct numerical simulation and a corresponding POD-Galerkin reduced order model. Numerical results show that the two-fidelity MFEnKF provides better analyses than existing EnKF algorithms at comparable or reduced computational costs.


title: Feature Extraction on Synthetic Black Hole Images

abstract: The Event Horizon Telescope (EHT) recently released the first horizon-scale images of the black hole in M87. Combined with other astronomical data, these images constrain the mass and spin of the hole as well as the accretion rate and magnetic flux trapped on the hole. An important question for EHT is how well key parameters such as spin and trapped magnetic flux can be extracted from present and future EHT data alone. Here we explore parameter extraction using a neural network trained on high resolution synthetic images drawn from state-of-the-art simulations. We find that the neural network is able to recover spin and flux with high accuracy. We are particularly interested in interpreting the neural network output and understanding which features are used to identify, e.g., black hole spin. Using feature maps, we find that the network keys on low surface brightness features in particular.


title: Policy Improvement via Imitation of Multiple Oracles

abstract: Despite its promise, reinforcement learning's real-world adoption has been hampered by the need for costly exploration to learn a good policy. Imitation learning (IL) mitigates this shortcoming by using an oracle policy during training as a bootstrap to accelerate the learning process. However, in many practical situations, the learner has access to multiple suboptimal oracles, which may provide conflicting advice in a state. The existing IL literature provides a limited treatment of such scenarios. Whereas in the single-oracle case, the return of the oracle's policy provides an obvious benchmark for the learner to compete against, neither such a benchmark nor principled ways of outperforming it are known for the multi-oracle setting. In this paper, we propose the state-wise maximum of the oracle policies' values as a natural baseline to resolve conflicting advice from multiple oracles. Using a reduction of policy optimization to online learning, we introduce a novel IL algorithm MAMBA, which can provably learn a policy competitive with this benchmark. In particular, MAMBA optimizes policies by using a gradient estimator in the style of generalized advantage estimation (GAE). Our theoretical analysis shows that this design makes MAMBA robust and enables it to outperform the oracle policies by a larger margin than the IL state of the art, even in the single-oracle case. In an evaluation against standard policy gradient with GAE and AggreVaTe(D), we showcase MAMBA's ability to leverage demonstrations both from a single and from multiple weak oracles, and significantly speed up policy optimization.


title: Information Theoretic Lower Bounds for Feed-Forward Fully-Connected Deep Networks

abstract: In this paper, we study the sample complexity lower bounds for the exact recovery of parameters and for a positive excess risk of a feed-forward, fully-connected neural network for binary classification, using information-theoretic tools. We prove these lower bounds by the existence of a generative network characterized by a backwards data generating process, where the input is generated based on the binary output, and the network is parametrized by weight parameters for the hidden layers. The sample complexity lower bound for the exact recovery of parameters is $\Omega(d r \log(r) + p )$ and for a positive excess risk is $\Omega(r \log(r) + p )$, where $p$ is the dimension of the input, $r$ reflects the rank of the weight matrices and $d$ is the number of hidden layers. To the best of our knowledge, our results are the first information theoretic lower bounds.


title: Bayesian Multivariate Quantile Regression Using Dependent Dirichlet Process Prior

abstract: In this article, we consider a non-parametric Bayesian approach to multivariate quantile regression. The collection of related conditional distributions of a response vector Y given a univariate covariate X is modeled using a Dependent Dirichlet Process (DDP) prior. The DDP is used to introduce dependence across x. As the realizations from a Dirichlet process prior are almost surely discrete, we need to convolve it with a kernel. To model the error distribution as flexibly as possible, we use a countable mixture of multidimensional normal distributions as our kernel. For posterior computations, we use a truncated stick-breaking representation of the DDP. This approximation enables us to deal with only a finitely number of parameters. We use a Block Gibbs sampler for estimating the model parameters. We illustrate our method with simulation studies and real data applications. Finally, we provide a theoretical justification for the proposed method through posterior consistency. Our proposed procedure is new even when the response is univariate.


title: Deliberate Exploration Supports Navigation in Unfamiliar Worlds

abstract: To perform tasks well in a new domain, one must first know something about it. This paper reports on a robot controller for navigation through unfamiliar indoor worlds. Based on spatial affordances, it integrates planning with reactive heuristics. Before it addresses specific targets, however, the system deliberately explores for high-level connectivity and captures that data in a cognitive spatial model. Despite limited exploration time, planning in the resultant model is faster and better supports successful travel in a challenging, realistic space.


title: Learning Surrogates via Deep Embedding

abstract: This paper proposes a technique for training a neural network by minimizing a surrogate loss that approximates the target evaluation metric, which may be non-differentiable. The surrogate is learned via a deep embedding where the Euclidean distance between the prediction and the ground truth corresponds to the value of the evaluation metric. The effectiveness of the proposed technique is demonstrated in a post-tuning setup, where a trained model is tuned using the learned surrogate. Without a significant computational overhead and any bells and whistles, improvements are demonstrated on challenging and practical tasks of scene-text recognition and detection. In the recognition task, the model is tuned using a surrogate approximating the edit distance metric and achieves up to $39\%$ relative improvement in the total edit distance. In the detection task, the surrogate approximates the intersection over union metric for rotated bounding boxes and yields up to $4.25\%$ relative improvement in the $F_{1}$ score.


title: A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural Networks

abstract: Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to improve model performance, which is often more accessible and ubiquitous. Self-supervised pre-training for transfer learning is becoming an increasingly popular technique to improve state-of-the-art results using unlabeled data. It involves first pre-training a model on a large amount of unlabeled data, then adapting the model to target tasks of interest. In this review, we survey self-supervised learning methods and their applications within the sequential transfer learning framework. We provide an overview of the taxonomy for self-supervised learning and transfer learning, and highlight some prominent methods for designing pre-training tasks across different domains. Finally, we discuss recent trends and suggest areas for future investigation.


title: TiledSoilingNet: Tile-level Soiling Detection on Automotive Surround-view Cameras Using Coverage Metric

abstract: Automotive cameras, particularly surround-view cameras, tend to get soiled by mud, water, snow, etc. For higher levels of autonomous driving, it is necessary to have a soiling detection algorithm which will trigger an automatic cleaning system. Localized detection of soiling in an image is necessary to control the cleaning system. It is also necessary to enable partial functionality in unsoiled areas while reducing confidence in soiled areas. Although this can be solved using a semantic segmentation task, we explore a more efficient solution targeting deployment in low power embedded system. We propose a novel method to regress the area of each soiling type within a tile directly. We refer to this as coverage. The proposed approach is better than learning the dominant class in a tile as multiple soiling types occur within a tile commonly. It also has the advantage of dealing with coarse polygon annotation, which will cause the segmentation task. The proposed soiling coverage decoder is an order of magnitude faster than an equivalent segmentation decoder. We also integrated it into an object detection and semantic segmentation multi-task model using an asynchronous back-propagation algorithm. A portion of the dataset used will be released publicly as part of our WoodScape dataset to encourage further research.


title: Unlikely intersection problems for restricted lifts of p-th power

abstract: I define a morphism on $\mathbb{C}_p$ called a lift of $p$-th power if its natural restriction to the residue field of $\mathbb{C}_p$ is a $p$-th power of some morphism. This definition generalizes from the lift of Frobenius. In this paper the theory of perfectoid spaces is applied on the morphism to the Manin-Mumford conjecutre, the Mordell-Lang conjecture and the Tate-Volch conjecture.


title: Linear regression and its inference on noisy network-linked data

abstract: Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive assumptions on social effects and usually assume that networks are observed without errors. This paper proposes a regression model with nonparametric network effects. The model does not assume that the relational data or network structure is exactly observed and can be provably robust to network perturbations. Asymptotic inference framework is established under a general requirement of the network observational errors, and the robustness of this method is studied in the specific setting when the errors come from random network models. We discover a phase-transition phenomenon of the inference validity concerning the network density when no prior knowledge of the network model is available while also showing a significant improvement achieved by knowing the network model. Simulation studies are conducted to verify these theoretical results and demonstrate the advantage of the proposed method over existing work in terms of accuracy and computational efficiency under different data-generating models. The method is then applied to middle school students' network data to study the effectiveness of educational workshops in reducing school conflicts.


title: Tidal Currents Detected in Kraken Mare Straits from Cassini VIMS Sun Glitter Observations

abstract: We present Cassini VIMS observations of sun glitter -- wave-induced reflections from a liquid surface offset from a specular point -- on Kraken Mare. Sun glitter reveals rough sea surfaces around Kraken Mare, namely the coasts and narrow straits. The sun glitter observations indicate wave activity driven by the winds and tidal currents in Kraken Mare during northern summer. T104 Cassini VIMS observations show three sun glitter features in Bayta Fretum indicative of variegated wave fields. We cannot uniquely determine one source for the coastal Bayta waves, but we lean toward the interpretation of surface winds, because tidal currents should be too weak to generate capillary-gravity waves in Bayta Fretum. T105 and T110 observations reveal wave fields in the straits of Seldon Fretum, Lulworth Sinus, and Tunu Sinus that likely originate from the constriction of tidal currents. Coastlines of Bermoothes and Hufaidh Insulae adjoin rough sea surfaces, suggesting a complex interplay of wind-roughened seas and localized tidal currents. Bermoothes and Hufaidh Insulae may share characteristics of either the Torres Strait off Australia or the Aland region of Finland, summarized as an island-dense strait with shallow bathymetry that hosts complex surface circulation patterns. Hufaidh Insulae could host seafloor bedforms formed by tidal currents with an abundant sediment supply, similar to the Torres Strait. The coastlines of Hufaidh and Bermoothes Insulae likely host ria or flooded coastal inlets, suggesting the Insulae may be local peaks of primordial crust isolated by an episode of sea-level rise or tectonic uplift.


title: Fast DTW and Fuzzy Clustering for Scenario Generation in Power System Planning Problems

abstract: Power system planning problems become computationally intractable if one accounts for all uncertain operating scenarios. Consequently, one selects a subset of scenarios that are representative of likely/extreme operating conditions, e.g. heavy summer, heavy winter, light summer, and so on. However, such an approach may not be able to accurately capture the dependencies that exist between renewable generation (RG) and system load in RG-rich power systems. This paper proposes the use of fast dynamic time warping (FDTW) and fuzzy c-means++ (FCM++) clustering to account for key statistical properties of load and RG for scenario generation for power system planning problems. Case studies using a U.S. power network, and comparison with existing scenario generation techniques demonstrate the benefits of the proposed approach.


title: Query-Free Adversarial Transfer via Undertrained Surrogates

abstract: Deep neural networks are vulnerable to adversarial examples -- minor perturbations added to a model's input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks in a black-box setting by undertraining the surrogate model which the attacks are generated on. Using two datasets and five model architectures, we show that this method transfers well across architectures and outperforms state-of-the-art methods by a wide margin. We interpret the effectiveness of our approach as a function of reduced surrogate model loss function curvature and increased universal gradient characteristics, and show that our approach reduces the presence of local loss maxima which hinder transferability. Our results suggest that finding strong single surrogate models is a highly effective and simple method for generating transferable adversarial attacks, and that this method represents a valuable route for future study in this field.


title: Machinery Failure Approach and Spectral Analysis to study the Reaction Time Dynamics over Consecutive Visual Stimuli

abstract: The reaction times of individuals over consecutive visual stimuli have been studied using spectral analysis and a failure machinery approach. The used tools include the fast Fourier transform and a spectral entropy analysis. The results indicate that the reaction times produced by the independently responding individuals to visual stimuli appear to be correlated. The spectral analysis and the entropy of the spectrum yield that there are features of similarity in the response times of each participant and among them. Furthermore, the analysis of the mistakes made by the participants during the reaction time experiments concluded that they follow a behavior which is consistent with the MTBF (Mean Time Between Failures) model, widely used in industry for the predictive diagnosis of electrical machines and equipment.


title: Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval

abstract: Conducting text retrieval in a dense learned representation space has many intriguing advantages over sparse retrieval. Yet the effectiveness of dense retrieval (DR) often requires combination with sparse retrieval. In this paper, we identify that the main bottleneck is in the training mechanisms, where the negative instances used in training are not representative of the irrelevant documents in testing. This paper presents Approximate nearest neighbor Negative Contrastive Estimation (ANCE), a training mechanism that constructs negatives from an Approximate Nearest Neighbor (ANN) index of the corpus, which is parallelly updated with the learning process to select more realistic negative training instances. This fundamentally resolves the discrepancy between the data distribution used in the training and testing of DR. In our experiments, ANCE boosts the BERT-Siamese DR model to outperform all competitive dense and sparse retrieval baselines. It nearly matches the accuracy of sparse-retrieval-and-BERT-reranking using dot-product in the ANCE-learned representation space and provides almost 100x speed-up.


title: Automated Empathy Detection for Oncology Encounters

abstract: Empathy involves understanding other people's situation, perspective, and feelings. In clinical interactions, it helps clinicians establish rapport with a patient and support patient-centered care and decision making. Understanding physician communication through observation of audio-recorded encounters is largely carried out with manual annotation and analysis. However, manual annotation has a prohibitively high cost. In this paper, a multimodal system is proposed for the first time to automatically detect empathic interactions in recordings of real-world face-to-face oncology encounters that might accelerate manual processes. An automatic speech and language processing pipeline is employed to segment and diarize the audio as well as for transcription of speech into text. Lexical and acoustic features are derived to help detect both empathic opportunities offered by the patient, and the expressed empathy by the oncologist. We make the empathy predictions using Support Vector Machines (SVMs) and evaluate the performance on different combinations of features in terms of average precision (AP).


title: On Linear Identifiability of Learned Representations

abstract: Identifiability is a desirable property of a statistical model: it implies that the true model parameters may be estimated to any desired precision, given sufficient computational resources and data. We study identifiability in the context of representation learning: discovering nonlinear data representations that are optimal with respect to some downstream task. When parameterized as deep neural networks, such representation functions typically lack identifiability in parameter space, because they are overparameterized by design. In this paper, building on recent advances in nonlinear ICA, we aim to rehabilitate identifiability by showing that a large family of discriminative models are in fact identifiable in function space, up to a linear indeterminacy. Many models for representation learning in a wide variety of domains have been identifiable in this sense, including text, images and audio, state-of-the-art at time of publication. We derive sufficient conditions for linear identifiability and provide empirical support for the result on both simulated and real-world data.