title: Batch Exploration with Examples for Scalable Robotic Reinforcement Learning

abstract: Learning from diverse offline datasets is a promising path towards learning general purpose robotic agents. However, a core challenge in this paradigm lies in collecting large amounts of meaningful data, while not depending on a human in the loop for data collection. One way to address this challenge is through task-agnostic exploration, where an agent attempts to explore without a task-specific reward function, and collect data that can be useful for any downstream task. While these approaches have shown some promise in simple domains, they often struggle to explore the relevant regions of the state space in more challenging settings, such as vision based robotic manipulation. This challenge stems from an objective that encourages exploring everything in a potentially vast state space. To mitigate this challenge, we propose to focus exploration on the important parts of the state space using weak human supervision. Concretely, we propose an exploration technique, Batch Exploration with Examples (BEE), that explores relevant regions of the state-space, guided by a modest number of human provided images of important states. These human provided images only need to be collected once at the beginning of data collection and can be collected in a matter of minutes, allowing us to scalably collect diverse datasets, which can then be combined with any batch RL algorithm. We find that BEE is able to tackle challenging vision-based manipulation tasks both in simulation and on a real Franka robot, and observe that compared to task-agnostic and weakly-supervised exploration techniques, it (1) interacts more than twice as often with relevant objects, and (2) improves downstream task performance when used in conjunction with offline RL.


title: AdapterDrop: On the Efficiency of Adapters in Transformers

abstract: Massively pre-trained transformer models are computationally expensive to fine-tune, slow for inference, and have large storage requirements. Recent approaches tackle these shortcomings by training smaller models, dynamically reducing the model size, and by training light-weight adapters. In this paper, we propose AdapterDrop, removing adapters from lower transformer layers during training and inference, which incorporates concepts from all three directions. We show that AdapterDrop can dynamically reduce the computational overhead when performing inference over multiple tasks simultaneously, with minimal decrease in task performances. We further prune adapters from AdapterFusion, which improves the inference efficiency while maintaining the task performances entirely.


title: Effective shear and bulk viscosities for anisotropic flow

abstract: We evaluate the viscous damping of anisotropic flow in heavy-ion collisions for arbitrary temperature-dependent shear and bulk viscosities. We show that the damping is solely determined by effective shear and bulk viscosities, which are weighted averages over the temperature. We determine the relevant weights for nucleus-nucleus collisions at $\sqrt{s_{\rm NN}}=5.02$ TeV and 200 GeV, corresponding to the maximum LHC and RHIC energies, by running ideal and viscous hydrodynamic simulations. The effective shear viscosity is driven by temperatures below $210$ MeV at RHIC, and below $280$ MeV at the LHC, with the largest contributions coming from the lowest temperatures, just above freeze-out. The effective bulk viscosity is driven by somewhat higher temperatures, corresponding to earlier stages of the collision. We show that at a fixed collision energy, the effective viscosity is independent of centrality and system size, to the same extent as the mean transverse momentum of outgoing hadrons. The variation of viscous damping is determined by Reynolds number scaling.


title: Multi-spike solutions of a hybrid reaction-transport model

abstract: Numerical simulations of classical pattern forming reaction-diffusion systems indicate that they often operate in the strongly nonlinear regime, with the final steady-state consisting of a spatially repeating pattern of localized spikes. In activator-inhibitor systems such as the two-component Gierer-Meinhardt (GM) model, one can consider the singular limit $D_a\ll D_h$, where $D_a$ and $D_h$ are the diffusivities of the activator and inhibitor, respectively. Asymptotic analysis can then be used to analyze the existence and linear stability of multi-spike solutions. In this paper, we analyze multi-spike solutions in a hybrid reaction-transport model, consisting of a slowly diffusing activator and an actively transported inhibitor that switches at a rate $\alpha$ between right-moving and left-moving velocity states. This class of model was recently introduced to account for the formation and homeostatic regulation of synaptic puncta during larval development in {\em C. elegans}. We exploit the fact that that the hybrid model can be mapped onto the classical GM model in the fast switching limit $\alpha\rightarrow \infty$, which allows us to establish the existence of multi-spike solutions. Linearization about the multi-spike solution leads to a non-local eigenvalue problem that is used to derive stability conditions for the multi-spike solution for finite $\alpha$


title: Multivariate mean estimation with direction-dependent accuracy

abstract: We consider the problem of estimating the mean of a random vector based on $N$ independent, identically distributed observations. We prove the existence of an estimator that has a near-optimal error in all directions in which the variance of the one dimensional marginal of the random vector is not too small: with probability $1-\delta$, the procedure returns $\wh{\mu}_N$ which satisfies that for every direction $u \in S^{d-1}$, \[ \inr{\wh{\mu}_N - \mu, u}\le \frac{C}{\sqrt{N}} \left( \sigma(u)\sqrt{\log(1/\delta)} + \left(\E\|X-\EXP X\|_2^2\right)^{1/2} \right)~, \] where $\sigma^2(u) = \var(\inr{X,u})$ and $C$ is a constant. To achieve this, we require only slightly more than the existence of the covariance matrix, in the form of a certain moment-equivalence assumption. The proof relies on novel bounds for the ratio of empirical and true probabilities that hold uniformly over certain classes of random variables.


title: Fluctuations of subsystem entropies at late times

abstract: We study the fluctuations of subsystem entropies in closed quantum many-body systems after thermalization. Using a combination of analytics and numerics for both random quantum circuits and Hamiltonian dynamics, we find that the statistics of such entropy fluctuations is drastically different than in the classical setting. For instance, shortly after a system thermalizes, the probability of entropy fluctuations for a subregion is suppressed in the dimension of the Hilbert space of the complementary subregion. This suppression becomes increasingly stringent as a function of time, ultimately depending on the exponential of the Hilbert space dimension, until extremely late times when the amount of suppression saturates. We also use our results to estimate the total number of rare fluctuations at large timescales. We find that the "Boltzmann brain" paradox is largely ameliorated in quantum many-body systems, in contrast with the classical setting.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el hep-th


title: From 2d Droplets to 2d Yang-Mills

abstract: We establish a connection between time evolution of free Fermi droplets and partition function of \emph{generalised} \emph{q}-deformed Yang-Mills theories on Riemann surfaces. Classical phases of $(0+1)$ dimensional unitary matrix models can be characterised by free Fermi droplets in two dimensions. We quantise these droplets and find that the modes satisfy an abelian Kac-Moody algebra. The Hilbert spaces $\mathcal{H}_+$ and $\mathcal{H}_-$ associated with the upper and lower free Fermi surfaces of a droplet admit a Young diagram basis in which the phase space Hamiltonian is diagonal with eigenvalue, in the large $N$ limit, equal to the quadratic Casimir of $u(N)$. We establish an exact mapping between states in $\mathcal{H}_\pm$ and geometries of droplets. In particular, coherent states in $\mathcal{H}_\pm$ correspond to classical deformation of upper and lower Fermi surfaces. We prove that correlation between two coherent states in $\mathcal{H}_\pm$ is equal to the chiral and anti-chiral partition function of $2d$ Yang-Mills theory on a cylinder. Using the fact that the full Hilbert space $\mathcal{H}_+ \otimes \mathcal{H}_-$ admits a \emph{composite} basis, we show that correlation between two classical droplet geometries is equal to the full $U(N)$ Yang-Mills partition function on cylinder. We further establish a connection between higher point correlators in $\mathcal{H}_\pm$ and higher point correlators in $2d$ Yang-Mills on Riemann surface. There are special states in $\mathcal{H}_\pm$ whose transition amplitudes are equal to the partition function of $2d$ \emph{q}-deformed Yang-Mills and in general character expansion of Villain action. We emphasise that the \emph{q}-deformation in the Yang-Mills side is related to special deformation of droplet geometries without deforming the gauge group associated with the matrix model.


title: In Search of Robust Measures of Generalization

abstract: One of the principal scientific challenges in deep learning is explaining generalization, i.e., why the particular way the community now trains networks to achieve small training error also leads to small error on held-out data from the same population. It is widely appreciated that some worst-case theories -- such as those based on the VC dimension of the class of predictors induced by modern neural network architectures -- are unable to explain empirical performance. A large volume of work aims to close this gap, primarily by developing bounds on generalization error, optimization error, and excess risk. When evaluated empirically, however, most of these bounds are numerically vacuous. Focusing on generalization bounds, this work addresses the question of how to evaluate such bounds empirically. Jiang et al. (2020) recently described a large-scale empirical study aimed at uncovering potential causal relationships between bounds/measures and generalization. Building on their study, we highlight where their proposed methods can obscure failures and successes of generalization measures in explaining generalization. We argue that generalization measures should instead be evaluated within the framework of distributional robustness.


title: The Polynomial Method is Universal for Distribution-Free Correlational SQ Learning

abstract: We consider the problem of distribution-free learning for Boolean function classes in the PAC and agnostic models. Generalizing a beautiful work of Malach and Shalev-Shwartz (2022) that gave tight correlational SQ (CSQ) lower bounds for learning DNF formulas, we give new proofs that lower bounds on the threshold or approximate degree of any function class directly imply CSQ lower bounds for PAC or agnostic learning respectively. While such bounds implicitly follow by combining prior results by Feldman (2008, 2012) and Sherstov (2008, 2011), to our knowledge the precise statements we give had not appeared in this form before. Moreover, our proofs are simple and largely self-contained. These lower bounds match corresponding positive results using upper bounds on the threshold or approximate degree in the SQ model for PAC or agnostic learning, and in this sense these results show that the polynomial method is a universal, best-possible approach for distribution-free CSQ learning.


title: Neural-Symbolic Integration: A Compositional Perspective

abstract: Despite significant progress in the development of neural-symbolic frameworks, the question of how to integrate a neural and a symbolic system in a \emph{compositional} manner remains open. Our work seeks to fill this gap by treating these two systems as black boxes to be integrated as modules into a single architecture, without making assumptions on their internal structure and semantics. Instead, we expect only that each module exposes certain methods for accessing the functions that the module implements: the symbolic module exposes a deduction method for computing the function's output on a given input, and an abduction method for computing the function's inputs for a given output; the neural module exposes a deduction method for computing the function's output on a given input, and an induction method for updating the function given input-output training instances. We are, then, able to show that a symbolic module -- with any choice for syntax and semantics, as long as the deduction and abduction methods are exposed -- can be cleanly integrated with a neural module, and facilitate the latter's efficient training, achieving empirical performance that exceeds that of previous work.


title: Dual description of $\eta$-deformed OSP sigma models

abstract: We study the dual description of the $\eta$-deformed $OSP(N|2m)$ sigma model in the asymptotically free regime ($N>2m+2$). Compared to the case of classical Lie groups, for supergroups there are inequivalent $\eta$-deformations corresponding to different choices of simple roots. For a class of such deformations we propose the system of screening charges depending on a continuous parameter $b$, which defines the $\eta$-deformed $OSP(N|2m)$ sigma model in the limit $b\rightarrow\infty$ and a certain Toda QFT as $b\rightarrow0$. In the sigma model regime we show that the leading UV asymptotic of the $\eta$-deformed model coincides with a perturbed Gaussian theory. In the perturbative regime $b\rightarrow0$ we show that the tree-level two-particle scattering matrix matches the expansion of the trigonometric $OSP(N|2m)$ $S$-matrix.


title: $r$-cross $t$-intersecting families via necessary intersection points

abstract: Given integers $r\geq 2$ and $n,t\geq 1$ we call families $\mathcal{F}_1,\dots,\mathcal{F}_r\subseteq\mathscr{P}([n])$ $r$-cross $t$-intersecting if for all $F_i\in\mathcal{F}_i$, $i\in[r]$, we have $\vert\bigcap_{i\in[r]}F_i\vert\geq t$. We obtain a strong generalisation of the classic Hilton-Milner theorem on cross intersecting families. In particular, we determine the maximum of $\sum_{j\in [r]}\vert\mathcal{F}_j\vert$ for $r$-cross $t$-intersecting families in the cases when these are $k$-uniform families or arbitrary subfamilies of $\mathscr{P}([n])$. Only some special cases of these results had been proved before. We obtain the aforementioned theorems as instances of a more general result that considers measures of $r$-cross $t$-intersecting families. This also provides the maximum of $\sum_{j\in [r]}\vert\mathcal{F}_j\vert$ for families of possibly mixed uniformities $k_1,\ldots,k_r$.


title: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

abstract: While the Transformer architecture has become the de-facto standard for natural language processing tasks, its applications to computer vision remain limited. In vision, attention is either applied in conjunction with convolutional networks, or used to replace certain components of convolutional networks while keeping their overall structure in place. We show that this reliance on CNNs is not necessary and a pure transformer applied directly to sequences of image patches can perform very well on image classification tasks. When pre-trained on large amounts of data and transferred to multiple mid-sized or small image recognition benchmarks (ImageNet, CIFAR-100, VTAB, etc.), Vision Transformer (ViT) attains excellent results compared to state-of-the-art convolutional networks while requiring substantially fewer computational resources to train.


title: Scientific Claim Verification with VERT5ERINI

abstract: This work describes the adaptation of a pretrained sequence-to-sequence model to the task of scientific claim verification in the biomedical domain. We propose VERT5ERINI that exploits T5 for abstract retrieval, sentence selection and label prediction, which are three critical sub-tasks of claim verification. We evaluate our pipeline on SCIFACT, a newly curated dataset that requires models to not just predict the veracity of claims but also provide relevant sentences from a corpus of scientific literature that support this decision. Empirically, our pipeline outperforms a strong baseline in each of the three steps. Finally, we show VERT5ERINI's ability to generalize to two new datasets of COVID-19 claims using evidence from the ever-expanding CORD-19 corpus.


title: Brain-Inspired Learning on Neuromorphic Substrates

abstract: Neuromorphic hardware strives to emulate brain-like neural networks and thus holds the promise for scalable, low-power information processing on temporal data streams. Yet, to solve real-world problems, these networks need to be trained. However, training on neuromorphic substrates creates significant challenges due to the offline character and the required non-local computations of gradient-based learning algorithms. This article provides a mathematical framework for the design of practical online learning algorithms for neuromorphic substrates. Specifically, we show a direct connection between Real-Time Recurrent Learning (RTRL), an online algorithm for computing gradients in conventional Recurrent Neural Networks (RNNs), and biologically plausible learning rules for training Spiking Neural Networks (SNNs). Further, we motivate a sparse approximation based on block-diagonal Jacobians, which reduces the algorithm's computational complexity, diminishes the non-local information requirements, and empirically leads to good learning performance, thereby improving its applicability to neuromorphic substrates. In summary, our framework bridges the gap between synaptic plasticity and gradient-based approaches from deep learning and lays the foundations for powerful information processing on future neuromorphic hardware systems.


abstract: Different applications, such as environmental monitoring and military operations, demand the observation of predefined target locations, and an autonomous mobile robot can assist in these tasks. In this context, the Orienteering Problem (OP) is a well-known routing problem, in which the goal is to maximize the objective function by visiting the most rewarding locations, however, respecting a limited travel budget (e.g., length, time, energy). However, traditional formulations for routing problems generally neglect some environment peculiarities, such as obstacles or threatening zones. In this paper, we tackle the OP considering Dubins vehicles in the presence of a known deployed sensor field. We propose a novel multi-objective formulation called Minimal Exposure Dubins Orienteering Problem (MEDOP), whose main objectives are: (i) maximize the collected reward, and (ii) minimize the exposure of the agent, i.e., the probability of being detected. The solution is based on an evolutionary algorithm that iteratively varies the subset and sequence of locations to be visited, the orientations on each location, and the turning radius used to determine the paths. Results show that our approach can efficiently find a diverse set of solutions that simultaneously optimize both objectives.


title: Asymmetric Ramsey Properties of Random Graphs for Cliques and Cycles

abstract: We say that $G \to (F,H)$ if, in every edge colouring $c: E(G) \to \{1,2\}$, we can find either a $1$-coloured copy of $F$ or a $2$-coloured copy of $H$. The well-known Kohayakawa--Kreuter conjecture states that the threshold for the property $G(n,p) \to (F,H)$ is equal to $n^{-1/m_{2}(F,H)}$, where $m_{2}(F,H)$ is given by \[ m_{2}(F,H):= \max \left\{\dfrac{e(J)}{v(J)-2+1/m_2(H)} : J \subseteq F, e(J)\ge 1 \right\}. \] In this paper, we show the $0$-statement of the Kohayakawa--Kreuter conjecture for every pair of cycles and cliques.


title: mT5: A massively multilingual pre-trained text-to-text transformer

abstract: The recent "Text-to-Text Transfer Transformer" (T5) leveraged a unified text-to-text format and scale to attain state-of-the-art results on a wide variety of English-language NLP tasks. In this paper, we introduce mT5, a multilingual variant of T5 that was pre-trained on a new Common Crawl-based dataset covering 101 languages. We detail the design and modified training of mT5 and demonstrate its state-of-the-art performance on many multilingual benchmarks. We also describe a simple technique to prevent "accidental translation" in the zero-shot setting, where a generative model chooses to (partially) translate its prediction into the wrong language. All of the code and model checkpoints used in this work are publicly available.


title: Coded Data Rebalancing for Decentralized Distributed Databases

abstract: The performance of replication-based distributed databases is affected due to non-uniform storage across storage nodes (also called \textit{data skew}) and reduction in the replication factor during operation, particularly due to node additions or removals. Data rebalancing refers to the communication involved between the nodes in correcting this data skew, while maintaining the replication factor. For carefully designed distributed databases, transmitting coded symbols during the rebalancing phase has been recently shown to reduce the communication load of rebalancing. In this work, we look at balanced distributed databases with \textit{random placement}, in which each data segment is stored in a random subset of $r$ nodes in the system, where $r$ refers to the replication factor of the distributed database. We call these as decentralized databases. For a natural class of such decentralized databases, we propose rebalancing schemes for correcting data skew and the reduction in the replication factor arising due to a single node addition or removal. We give converse arguments which show that our proposed rebalancing schemes are optimal asymptotically in the size of the file.


title: UniCase -- Rethinking Casing in Language Models

abstract: In this paper, we introduce a new approach to dealing with the problem of case-sensitiveness in Language Modelling (LM). We propose simple architecture modification to the RoBERTa language model, accompanied by a new tokenization strategy, which we named Unified Case LM (UniCase). We tested our solution on the GLUE benchmark, which led to increased performance by 0.42 points. Moreover, we prove that the UniCase model works much better when we have to deal with text data, where all tokens are uppercased (+5.88 point).


title: Asymptotic properties of short-range interaction functionals

abstract: We describe a framework for extending the asymptotic behavior of a short-range interaction from the unit cube to general compact subsets of $ \mathbb R^d $. This framework allows us to give a unified treatment of asymptotics of hypersingular Riesz energies and optimal quantizers. We further obtain new results about the scale-invariant nearest neighbor interactions, such as the $ k $-nearest neighbor truncated Riesz energy. Our generalized approach has applications to methods for generating distributions with prescribed density: strongly-repulsive Riesz energies, centroidal Voronoi tessellations, and a popular meshing algorithm due to Persson and Strang.


title: Enhancing the Performance of Superconducting Nanowire-Based Detectors with High-Filling Factor by Using Variable Thickness

abstract: Current crowding at bends of superconducting nanowire single-photon detectors is one of the main factors limiting the performance of meander-style detectors with large filling factors. In this paper, we propose a new concept to reduce influence of the current crowding effect, a so-called variable thickness SNSPD, which is composed of two regions with different thicknesses. A larger thickness of bends in comparison to the thickness of straight nanowire sections locally reduces the current density and reduces the suppression of the critical current caused by the current crowding. This allows variable thickness SNSPD to have a higher critical current, an improved detection efficiency, and decreased dark count rate in comparison with a standard uniform thickness SNSPD with an identical geometry and film quality.


title: Limitations of Autoregressive Models and Their Alternatives

abstract: Standard autoregressive language models perform only polynomial-time computation to compute the probability of the next symbol. While this is attractive, it means they cannot model distributions whose next-symbol probability is hard to compute. Indeed, they cannot even model them well enough to solve associated easy decision problems for which an engineer might want to consult a language model. These limitations apply no matter how much computation and data are used to train the model, unless the model is given access to oracle parameters that grow superpolynomially in sequence length. Thus, simply training larger autoregressive language models is not a panacea for NLP. Alternatives include energy-based models (which give up efficient sampling) and latent-variable autoregressive models (which give up efficient scoring of a given string). Both are powerful enough to escape the above limitations.


title: Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environments

abstract: Deep reinforcement learning (RL) agents are able to learn contact-rich manipulation tasks by maximizing a reward signal, but require large amounts of experience, especially in environments with many obstacles that complicate exploration. In contrast, motion planners use explicit models of the agent and environment to plan collision-free paths to faraway goals, but suffer from inaccurate models in tasks that require contacts with the environment. To combine the benefits of both approaches, we propose motion planner augmented RL (MoPA-RL) which augments the action space of an RL agent with the long-horizon planning capabilities of motion planners. Based on the magnitude of the action, our approach smoothly transitions between directly executing the action and invoking a motion planner. We evaluate our approach on various simulated manipulation tasks and compare it to alternative action spaces in terms of learning efficiency and safety. The experiments demonstrate that MoPA-RL increases learning efficiency, leads to a faster exploration, and results in safer policies that avoid collisions with the environment. Videos and code are available at https://clvrai.com/mopa-rl .


title: Recent progress in laser spectroscopy of the actinides

abstract: The interest to perform laser spectroscopy in the heaviest elements arises from the strong impact of relativistic effects, electron correlations and quantum electrodynamics on their atomic structure. Once this atomic structure is well understood, laser spectroscopy also provides access to nuclear properties such as spins, mean square charge radii and electromagnetic moments in a nuclear-model independent way. This is of particular interest for the heaviest actinides around $N = 152$, a region of shell stabilized deformed nuclei. The experimental progress of laser spectroscopy in this region benefitted from continuous methodological and technical developments such as the introduction of buffer-gas-stopping techniques that enabled the access to ever more exotic nuclei far-off stability. The key challenges faced in this endeavor are small yields, nuclides with rather short half-lives and the need to search for atomic transitions in a wide spectral range guided by theoretical predictions. This paper describes the basics of the most common experimental methods and discusses selected recent results on the atomic and nuclear properties of the actinides up to nobelium where pioneering experiments were performed at the GSI Helmholtzzentrum f\"ur Schwerionenforschung in Darmstadt, Germany.


title: Fundamental limitations on distillation of quantum channel resources

abstract: Quantum channels underlie the dynamics of quantum systems, but in many practical settings it is the channels themselves that require processing. We establish universal limitations on the processing of both quantum states and channels, expressed in the form of no-go theorems and quantitative bounds for the manipulation of general quantum channel resources under the most general transformation protocols. Focusing on the class of distillation tasks -- which can be understood either as the purification of noisy channels into unitary ones, or the extraction of state-based resources from channels -- we develop fundamental restrictions on the error incurred in such transformations and comprehensive lower bounds for the overhead of any distillation protocol. In the asymptotic setting, our results yield broadly applicable bounds for rates of distillation. We demonstrate our results through applications to fault-tolerant quantum computation, where we obtain state-of-the-art lower bounds for the overhead cost of magic state distillation, as well as to quantum communication, where we recover a number of strong converse bounds for quantum channel capacity.


title: Few-Shot Adaptation of Generative Adversarial Networks

abstract: Generative Adversarial Networks (GANs) have shown remarkable performance in image synthesis tasks, but typically require a large number of training samples to achieve high-quality synthesis. This paper proposes a simple and effective method, Few-Shot GAN (FSGAN), for adapting GANs in few-shot settings (less than 100 images). FSGAN repurposes component analysis techniques and learns to adapt the singular values of the pre-trained weights while freezing the corresponding singular vectors. This provides a highly expressive parameter space for adaptation while constraining changes to the pretrained weights. We validate our method in a challenging few-shot setting of 5-100 images in the target domain. We show that our method has significant visual quality gains compared with existing GAN adaptation methods. We report qualitative and quantitative results showing the effectiveness of our method. We additionally highlight a problem for few-shot synthesis in the standard quantitative metric used by data-efficient image synthesis works. Code and additional results are available at http://e-271.github.io/few-shot-gan.


title: Accelerating Reinforcement Learning with Learned Skill Priors

abstract: Intelligent agents rely heavily on prior experience when learning a new task, yet most modern reinforcement learning (RL) approaches learn every task from scratch. One approach for leveraging prior knowledge is to transfer skills learned on prior tasks to the new task. However, as the amount of prior experience increases, the number of transferable skills grows too, making it challenging to explore the full set of available skills during downstream learning. Yet, intuitively, not all skills should be explored with equal probability; for example information about the current state can hint which skills are promising to explore. In this work, we propose to implement this intuition by learning a prior over skills. We propose a deep latent variable model that jointly learns an embedding space of skills and the skill prior from offline agent experience. We then extend common maximum-entropy RL approaches to use skill priors to guide downstream learning. We validate our approach, SPiRL (Skill-Prior RL), on complex navigation and robotic manipulation tasks and show that learned skill priors are essential for effective skill transfer from rich datasets. Videos and code are available at https://clvrai.com/spirl.


title: Automated Environmental Compliance Monitoring with IoT and Open Government Data

abstract: Negative environmental impacts on societies and ecosystems are frequently driven by human activity and amplified by increasing climatic variability. Properly managing these impacts relies on a government's ability to ensure environmental regulatory compliance in the face of increasing uncertainty. Water flow rates are the most widely used evaluation metric for river regulatory compliance. Specifically, compliance thresholds are set by calculating the minimum flow rates required by aquatic species such as fish. These are then designated as the minimum "environmental flows" (eflows) for each river. In this paper, we explore how IoT-generated open government data can be used to enhance the development of an automated IoT-based eflows compliance system. To reduce development and operational costs, the proposed solution relies on routinely collected river monitoring data. Our approach allows for any authority with similar data to rapidly develop, test and verify a scalable solution for eflow regulatory compliance monitoring and evaluation. Furthermore, we demonstrate a real-world application of our system using open government data from Estonia's national river monitoring network. The main novelty of this work is that the proposed IoT-based system provides a simple evaluation tool that re-purposes IoT-generated open government data to evaluate compliance and improve monitoring at a national scale. This work showcases a new paradigm of IoT-based solutions using open government data and provides a real-world example of how the solution can automatically evaluate environmental compliance in increasingly uncertain environments.


title: Prediction of Temperature and Rainfall in Bangladesh using Long Short Term Memory Recurrent Neural Networks

abstract: Temperature and rainfall have a significant impact on economic growth as well as the outbreak of seasonal diseases in a region. In spite of that inadequate studies have been carried out for analyzing the weather pattern of Bangladesh implementing the artificial neural network. Therefore, in this study, we are implementing a Long Short-term Memory (LSTM) model to forecast the month-wise temperature and rainfall by analyzing 115 years (1901-2015) of weather data of Bangladesh. The LSTM model has shown a mean error of -0.38oC in case of predicting the month-wise temperature for 2 years and -17.64mm in case of predicting the rainfall. This prediction model can help to understand the weather pattern changes as well as studying seasonal diseases of Bangladesh whose outbreaks are dependent on regional temperature and/or rainfall.


title: A Differentially Private Text Perturbation Method Using a Regularized Mahalanobis Metric

abstract: Balancing the privacy-utility tradeoff is a crucial requirement of many practical machine learning systems that deal with sensitive customer data. A popular approach for privacy-preserving text analysis is noise injection, in which text data is first mapped into a continuous embedding space, perturbed by sampling a spherical noise from an appropriate distribution, and then projected back to the discrete vocabulary space. While this allows the perturbation to admit the required metric differential privacy, often the utility of downstream tasks modeled on this perturbed data is low because the spherical noise does not account for the variability in the density around different words in the embedding space. In particular, words in a sparse region are likely unchanged even when the noise scale is large. %Using the global sensitivity of the mechanism can potentially add too much noise to the words in the dense regions of the embedding space, causing a high utility loss, whereas using local sensitivity can leak information through the scale of the noise added. In this paper, we propose a text perturbation mechanism based on a carefully designed regularized variant of the Mahalanobis metric to overcome this problem. For any given noise scale, this metric adds an elliptical noise to account for the covariance structure in the embedding space. This heterogeneity in the noise scale along different directions helps ensure that the words in the sparse region have sufficient likelihood of replacement without sacrificing the overall utility. We provide a text-perturbation algorithm based on this metric and formally prove its privacy guarantees. Additionally, we empirically show that our mechanism improves the privacy statistics to achieve the same level of utility as compared to the state-of-the-art Laplace mechanism.


title: Black Hole Spin in X-ray Binaries: Giving Uncertainties an $f$

abstract: The two established techniques for measuring black hole spin in X-ray binaries often yield conflicting results, which must be resolved before either method may be deemed robust. In practice, black hole spin measurements based on fitting the accretion disc continuum effectively do not marginalize over the colour correction factor $f_{\mathrm{col}}$. This factor parametrizes spectral hardening of the disc continuum by the disc atmosphere, whose true properties are poorly constrained. We incorporate reasonable systematic uncertainties in $f_{\mathrm{col}}$ into the eight (non-maximal) black hole spin measurements vetted by the disc continuum fitting community. In most cases, an $f_{\mathrm{col}}$ uncertainty of $\pm$0.2-0.3 dominates the black hole spin error budget. We go on to demonstrate that plausible departures in $f_{\mathrm{col}}$ values from those adopted by the disc continuum fitting practitioners can bring the discrepant black hole spins into agreement with those from iron line modeling. Systematic uncertainties in $f_{\mathrm{col}}$, such as the effects of strong magnetization, should be better understood before dismissing their potentially dominant impact on the black hole spin error budget.


title: A semi-supervised Machine Learning search for never-seen Gravitational-Wave sources

abstract: By now, tens of gravitational-wave (GW) events have been detected by the LIGO and Virgo detectors. These GWs have all been emitted by compact binary coalescence, for which we have excellent predictive models. However, there might be other sources for which we do not have reliable models. Some are expected to exist but to be very rare (e.g., supernovae), while others may be totally unanticipated. So far, no unmodeled sources have been discovered, but the lack of models makes the search for such sources much more difficult and less sensitive. We present here a search for unmodeled GW signals using semi-supervised machine learning. We apply deep learning and outlier detection algorithms to labeled spectrograms of GW strain data, and then search for spectrograms with anomalous patterns in public LIGO data. We searched $\sim 13\%$ of the coincident data from the first two observing runs. No candidates of GW signals were detected in the data analyzed. We evaluate the sensitivity of the search using simulated signals, we show that this search can detect spectrograms containing unusual or unexpected GW patterns, and we report the waveforms and amplitudes for which a $50\%$ detection rate is achieved.


title: Astrophysics Milestones For Pulsar Timing Array Gravitational Wave Detection

abstract: The NANOGrav Collaboration reported strong Bayesian evidence for a common-spectrum stochastic process in its 12.5-yr pulsar timing array dataset, with median characteristic strain amplitude at periods of a year of $A_{\rm yr} = 1.92^{+0.75}_{-0.55} \times 10^{-15}$. However, evidence for the quadrupolar Hellings \& Downs interpulsar correlations, which are characteristic of gravitational wave signals, was not yet significant. We emulate and extend the NANOGrav dataset, injecting a wide range of stochastic gravitational wave background (GWB) signals that encompass a variety of amplitudes and spectral shapes, and quantify three key milestones: (I) Given the amplitude measured in the 12.5 yr analysis and assuming this signal is a GWB, we expect to accumulate robust evidence of an interpulsar-correlated GWB signal with 15--17 yrs of data, i.e., an additional 2--5 yrs from the 12.5 yr dataset; (II) At the initial detection, we expect a fractional uncertainty of $40\%$ on the power-law strain spectrum slope, which is sufficient to distinguish a GWB of supermassive black-hole binary origin from some models predicting more exotic origins;(III) Similarly, the measured GWB amplitude will have an uncertainty of $44\%$ upon initial detection, allowing us to arbitrate between some population models of supermassive black-hole binaries. In addition, power-law models are distinguishable from those having low-frequency spectral turnovers once 20~yrs of data are reached. Even though our study is based on the NANOGrav data, we also derive relations that allow for a generalization to other pulsar-timing array datasets. Most notably, by combining the data of individual arrays into the International Pulsar Timing Array, all of these milestones can be reached significantly earlier.


title: Spin-Orbit Misalignments in Tertiary-Induced Black-Hole Binary Mergers: Theoretical Analysis

abstract: Black-hole (BH) binary mergers driven by gravitational perturbations of tertiary companions constitute an important class of dynamical formation channels for compact binaries detected by LIGO/VIRGO. Recent works have examined numerically the combined orbital and spin dynamics of BH binaries that undergo large Lidov-Kozai (LK) eccentricity oscillations induced by a highly inclined companion and merge via gravitational wave radiation. However, the extreme eccentricity variations make such systems difficult to characterize analytically. In this paper, we develop an analytical formalism for understanding the spin dynamics of binary BHs undergoing LK-induced mergers. We show that, under certain conditions, the eccentricity oscillations of the binary can be averaged over to determine the long-term behavior of the BH spin in a smooth way. In particular, we demonstrate that the final spin-orbit misalignment angle $\theta_{\rm sl}$ is often related to the binary's primordial spin orientation through an approximate adiabatic invariant. Our theory explains the "$90^\circ$ attractor" (as found in recent numerical studies) for the evolution of $\theta_{\rm sl}$ when the initial BH spin is aligned with the orbital axis and the octupole LK effects are negligible -- such a "$90^\circ$ attractor" would lead to a small binary effective spin parameter $\chi_{\rm eff}\sim 0$ even for large intrinsic BH spins. We calculate the deviation from adiabaticity in closed form as a function of the initial conditions. We also place accurate constraints on when this adiabatic invariant breaks down due to resonant spin-orbit interactions. We consider both stellar-mass and supermassive BH tertiary companions, and provide simple prescriptions for determining analytically the final spin-orbit misalignment angles of the merging BH binaries.


title: Anomalous and normal dislocation modes in Floquet topological insulators

abstract: Electronic bands featuring nontrivial bulk topological invariant manifest through robust gapless modes at the boundaries, e.g., edges and surfaces. As such this bulk-boundary correspondence is also operative in driven quantum materials. For example, a suitable periodic drive can convert a trivial insulator into a Floquet topological insulator (FTI) that accommodates nondissipative dynamic gapless modes at the interfaces with vacuum. Here we theoretically demonstrate that dislocations, ubiquitous lattice defects in crystals, can probe FTIs as well as unconventional $\pi$-trivial insulator in the bulk of driven quantum systems by supporting normal and anomalous modes, localized near the defect core. Respectively, normal and anomalous dislocation modes reside at the Floquet zone center and boundaries. We exemplify these outcomes specifically for two-dimensional (2D) Floquet Chern insulator and $p_x+ip_y$ superconductor, where the dislocation modes are respectively constituted by charged and neutral Majorana fermions. Our findings should be therefore instrumental in probing Floquet topological phases in the state-of-the-art experiments in driven quantum crystals, cold atomic setups, and photonic and phononic metamaterials through bulk topological lattice defects.


title: Fragile topology in line-graph lattices with two, three, or four gapped flat bands

abstract: The geometric properties of a lattice can have profound consequences on its band spectrum. For example, symmetry constraints and geometric frustration can give rise to topologicially nontrivial and dispersionless bands, respectively. Line-graph lattices are a perfect example of both of these features: their lowest energy bands are perfectly flat, and here we develop a formalism to connect some of their geometric properties with the presence or absence of fragile topology in their flat bands. This theoretical work will enable experimental studies of fragile topology in several types of line-graph lattices, most naturally suited to superconducting circuits.


title: Constraining cosmology with weak lensing voids

abstract: Upcoming surveys such as \LSST{} and \Euclid{} will significantly improve the power of weak lensing as a cosmological probe. To maximise the information that can be extracted from these surveys, it is important to explore novel statistics that complement standard weak lensing statistics such as the shear-shear correlation function and peak counts. In this work, we use a recently proposed weak lensing observable -- weak lensing voids -- to make parameter constraint forecasts for an LSST-like survey. We use the \cosmoslics{} $w$CDM simulation suite to measure void statistics as a function of cosmological parameters. The simulation data is used to train a Gaussian process regression emulator that we use to generate likelihood contours and provide parameter constraints from mock observations. We find that the void abundance is more constraining than the tangential shear profiles, though the combination of the two gives additional constraining power. We forecast that without tomographic decomposition, these void statistics can constrain the matter fluctuation amplitude, $S_8$ within 0.3\% (68\% confidence interval), while offering 1.5, 1.5 and 2.7\% precision on the matter density parameter, $\Omega_{\rm m}$, the reduced Hubble constant, $h$, and the dark energy equation of state parameter, $w_0$, respectively. These results are tighter than the constraints from the shear-shear correlation function with the same observational specifications for $\Omega_m$, $S_8$ and $w_0$. The constraints from the WL voids also have complementary parameter degeneracy directions to the shear 2PCF for all combinations of parameters that include $h$, making weak lensing void statistics a promising cosmological probe.


title: Galactic factories of cosmic-ray electrons and positrons

abstract: We present a novel calculation of the spectrum of electrons and positrons from random sources, supernova remnants and pulsars, distributed within the spiral arms of the Galaxy. The pulsar emissivity in terms of electron-positron pairs is considered as time dependent, following the magnetic dipole spin-down luminosity, and the temporal evolution of the potential drop is accounted for. Moreover each pulsar, with the magnetic field and initial spin period selected at random from the observed distribution, is considered as a source of pairs only after it leaves the parent supernova due to its birth kick velocity (also selected at random from the observed distribution). We show that (i) the spectrum of electrons is characterized by a feature at $\gtrsim 50$ GeV that proves that their transport is dominated by radiative losses. The flux reduction at $E\gtrsim 1$ TeV is explained as a result of lepton transport from sources in the spiral arms. (ii) The spectrum of positrons is very well described by the contribution of pulsars and the rising positron fraction originates naturally. The implications of pulsars as positron sources in terms of positron fraction at very high energies are also discussed. (iii) The role of fluctuations in the high-energy regime is thoroughly discussed and used to draw conclusions on the possibility to single out the contribution of local sources to the lepton spectrum with current and upcoming experiments.


title: Anatomy of Z2 fluxes in anyon Fermi liquids and Bose condensates

abstract: We study in detail the properties of pi-fluxes embedded in a state with a finite density of anyons that form either a Fermi liquid or a Bose-Einstein condensate. By employing a recently developed exact lattice bosonization in 2D, we demonstrate that such pi-flux remains a fully deconfined quasiparticle with a finite energy cost in a Fermi liquid of emergent fermions coupled to a Z2 gauge field. This pi-flux is accompanied by a screening cloud of fermions, which in the case of a Fermi gas with a parabolic dispersion binds exactly 1/8 of a fermionic hole. In addition there is a long-ranged power-law oscillatory disturbance of the liquid surrounding the pi-flux akin to Friedel oscillations. These results carry over directly to the pi-flux excitations in orthogonal metals. In sharp contrast, when the pi-flux is surrounded by a Bose-Einstein condensate of particles coupled to a Z2 gauge field, it binds a superfluid half-vortex, becoming a marginally confined excitation with a logarithmic energy cost divergence.


title: The Multiplicity Dependence of Pion Interferometry in Hydrodynamics

abstract: Understanding the origins of collective, fluid-like behavior in ultrarelativistic nuclear collisions constitutes one of the biggest open challenges in the field. In this Letter, it is argued that certain features in the multiplicity dependence of the source sizes extracted using pion interferometry may be understood quite naturally if small systems evolve hydrodynamically at sufficiently large multiplicities. Interferometry may therefore provide a baseline for probing and constraining the nature of collective behavior in nuclear collisions.


title: The Cosmic Ultraviolet Baryon Survey (CUBS) II: Discovery of an H$_{2}$-Bearing DLA in the Vicinity of an Early-Type Galaxy at z = 0.576

abstract: We report the serendipitous detection of an H$_{2}$-bearing damped Lyman-$\alpha$ absorber at z = 0.576 in the spectrum of the QSO J0111-0316 in the Cosmic Ultraviolet Baryon Survey. Spectroscopic observations from HST-COS in the far-ultraviolet reveal a damped absorber with log[N(HI)/cm^-2] = 20.1 +/- 0.2 and log[N(H$_{2}$)/cm^-2] = 18.97 (-0.06, +0.05). The diffuse molecular gas is found in two velocity components separated by dv = 60 km/s, with >99.9% of the total H$_{2}$ column density concentrated in one component. At a metallicity of $\approx$ 50% of solar, there is evidence for Fe enhancement and dust depletion, with a dust-to-gas ratio $\kappa_{\text{O}} \approx$ 0.4. A galaxy redshift survey conducted with IMACS and LDSS-3C on Magellan reveals an overdensity of nine galaxies at projected distance d <= 600 proper kpc (pkpc) and line-of-sight velocity offset dv$_{g}$ <= 300 km/s from the absorber. The closest is a massive, early-type galaxy at d = 41 pkpc which contains $\approx$ 70% of the total stellar mass identified at d <= 310 pkpc of the H$_{2}$ absorber. The close proximity of the H$_{2}$-bearing gas to the quiescent galaxy and the Fe-enhanced chemical abundance pattern of the absorber suggest a physical connection, in contrast to a picture in which DLAs are primarily associated with gas-rich dwarfs. This case study illustrates that deep galaxy redshift surveys are needed to gain insight into the diverse environments that host dense and potentially star-forming gas.


title: ROGER: Reconstructing Orbits of Galaxies in Extreme Regions using machine learning techniques

abstract: We present the ROGER (Reconstructing Orbits of Galaxies in Extreme Regions) code, which uses three different machine learning techniques to classify galaxies in, and around, clusters, according to their projected phase-space position. We use a sample of 34 massive, $M_{200}>10^{15} h^{-1} M_{\odot}$, galaxy clusters in the MultiDark Planck 2 (MDLP2) simulation at redshift zero. We select all galaxies with stellar mass $M_{\star} \ge 10^{8.5} h^{-1}M_{\odot}$, as computed by the semi-analytic model of galaxy formation SAG, that are located in, and in the vicinity of, the clusters and classify them according to their orbits. We train ROGER to retrieve the original classification of the galaxies out of their projected phase-space positions. For each galaxy, ROGER gives as output the probability of being a cluster galaxy, a galaxy that has recently fallen into a cluster, a backsplash galaxy, an infalling galaxy, or an interloper. We discuss the performance of the machine learning methods and potential uses of our code. Among the different methods explored, we find the K-Nearest Neighbours algorithm achieves the best performance.


title: A finite volume method for two-moment cosmic-ray hydrodynamics on a moving mesh

abstract: We present a new numerical algorithm to solve the recently derived equations of two-moment cosmic ray hydrodynamics (CRHD). The algorithm is implemented as a module in the moving mesh Arepo code. Therein, the anisotropic transport of cosmic rays (CRs) along magnetic field lines is discretised using a path-conservative finite volume method on the unstructured time-dependent Voronoi mesh of Arepo. The interaction of CRs and gyroresonant Alfv\'en waves is described by short-timescale source terms in the CRHD equations. We employ a custom-made semi-implicit adaptive time stepping source term integrator to accurately integrate this interaction on the small light-crossing time of the anisotropic transport step. Both the transport and the source term integration step are separated from the evolution of the magneto-hydrodynamical equations using an operator split approach. The new algorithm is tested with a variety of test problems, including shock tubes, a perpendicular magnetised discontinuity, the hydrodynamic response to a CR overpressure, CR acceleration of a warm cloud, and a CR blast wave, which demonstrate that the coupling between CR and magneto-hydrodynamics is robust and accurate. We demonstrate the numerical convergence of the presented scheme using new linear and non-linear analytic solutions.


title: Are quantum cryptographic security claims vacuous?

abstract: A central claim in quantum cryptography is that secrecy can be proved rigorously, based on the assumption that the relevant information-processing systems obey the laws of quantum physics. This claim has recently been challenged by Bernstein (arXiv:1803.04520). He argues that the laws of physics may also entail an unavoidable leakage of any classical information encoded in physical carriers. The security claim of quantum key distribution would then be vacuous, as the computation of the final secret key would leak its value. However, as we explain in this short note, Bernstein's reasoning is based on a too "classical" understanding of physics. It follows from known theorems about fault-tolerant quantum computation that quantum physics avoids his conclusion.


title: Active galactic nuclei ghosts: A systematic search for faded nuclei

abstract: Physical processes such as re-ignition, enhancement, and fading of active galactic nuclei (AGN) are not entirely understood because the timeline of these events is expected to last many years. However, it is well known that the differences in the energy budget between AGN components, like the optical ionizing region and the mid-infrared (MIR) dust echoes, can be interpreted as a hint on AGN evolution. Here we present a catalog of 88 AGN candidates showing hints on the fading and rising of their activity in the nearby Universe. We use AGN scaling relations to select them from an initial sample of 877 candidates using publicly available optical, X-ray, and MIR luminosities. We then use the multi-wavelength information to discard sources contaminated with extranuclear emission and those with an X-ray luminosity not well corrected for absorption. We find that 96% of our candidates are fading sources. This result suggests a scenario where the Universe had its peak of AGN activity somewhere in the past and is dominated by a fading phase at the present time. Alternatively, the fading phase is longer than the rising phase, which is consistent with galaxy merger simulations. Around 50% of these fading candidates are associated with merging or interacting systems. Finally, we also find the existence of jets in ~30% of these candidates and that the preferred AGN dust geometry is torus-like, instead of wind-like. Our results are compatible with the fading of nuclear activity, expected if they are in an inefficient state.


title: Classification of Magnetohydrodynamic Simulations using Wavelet Scattering Transforms

abstract: The complex interplay of magnetohydrodynamics, gravity, and supersonic turbulence in the interstellar medium (ISM) introduces non-Gaussian structure that can complicate comparison between theory and observation. We show that the Wavelet Scattering Transform (WST), in combination with linear discriminant analysis (LDA), is sensitive to non-Gaussian structure in 2D ISM dust maps. WST-LDA classifies magnetohydrodynamic (MHD) turbulence simulations with up to a 97\% true positive rate in our testbed of 8 simulations with varying sonic and Alfv\'{e}nic Mach numbers. We present a side-by-side comparison with two other methods for non-Gaussian characterization, the Reduced Wavelet Scattering Transform (RWST) and the 3-Point Correlation Function (3PCF). We also demonstrate the 3D-WST-LDA and apply it to classification of density fields in position-position-velocity (PPV) space, where density correlations can be studied using velocity coherence as a proxy. WST-LDA is robust to common observational artifacts, such as striping and missing data, while also sensitive enough to extract the net magnetic field direction for sub-Alfv\'{e}nic turbulent density fields. We include a brief analysis of the effect of point spread functions and image pixelization on 2D-WST-LDA applied to density fields, which informs the future goal of applying WST-LDA to 2D or 3D all-sky dust maps to extract hydrodynamic parameters of interest.


title: A general framework to test gravity using galaxy clusters III: Observable-mass scaling relations in $f(R)$ gravity

abstract: We test two methods, including one that is newly proposed in this work, for correcting for the effects of chameleon $f(R)$ gravity on the scaling relations between the galaxy cluster mass and four observable proxies. Using the first suite of cosmological simulations that simultaneously incorporate both full physics of galaxy formation and Hu-Sawicki $f(R)$ gravity, we find that these rescaling methods work with a very high accuracy for the gas temperature, the Compton $Y$-parameter of the Sunyaev-Zel'dovich (SZ) effect and the X-ray analogue of the $Y$-parameter. This allows the scaling relations in $f(R)$ gravity to be mapped to their $\Lambda$CDM counterparts to within a few percent. We confirm that a simple analytical tanh formula for the ratio between the dynamical and true masses of haloes in chameleon $f(R)$ gravity, proposed and calibrated using dark-matter-only simulations in a previous work, works equally well for haloes identified in simulations with two very different -- full-physics and non-radiative -- baryonic models. The mappings of scaling relations can be computed using this tanh formula, which depends on the halo mass, redshift and size of the background scalar field, also at a very good accuracy. Our results can be used for accurate determination of the cluster mass using SZ and X-ray observables, and will form part of a general framework for unbiased and self-consistent tests of gravity using data from present and upcoming galaxy cluster surveys. We also propose an alternative test of gravity, using the $Y_{\rm X}$-temperature relation, which does not involve mass calibration.


title: Runaway stars masquerading as star formation in galactic outskirts

abstract: In the outskirts of nearby spiral galaxies, star formation is observed in extremely low gas surface densities. Star formation in these regions, where the interstellar medium is dominated by diffuse atomic hydrogen, is difficult to explain with classic star formation theories. In this letter, we introduce runaway stars as an explanation for this observation. Runaway stars, produced by collisional dynamics in young stellar clusters, can travel kiloparsecs during their main-sequence lifetime. Using galactic-scale hydrodynamic simulations including a treatment of individual stars, we demonstrate that this mechanism enables the ejection of young massive stars into environments where the gas is not dense enough to trigger star formation. This results in the appearance of star formation in regions where it ought to be impossible. We conclude that runaway stars are a contributing, if not dominant, factor to the observations of star formation in the outskirts of spiral galaxies.


title: Unsupervised Data Augmentation with Naive Augmentation and without Unlabeled Data

abstract: Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noised' examples produced via data augmentation. While UDA has gained popularity for text classification, open questions linger over which design decisions are necessary and over how to extend the method to sequence labeling tasks. This method has recently gained traction for text classification. In this paper, we re-examine UDA and demonstrate its efficacy on several sequential tasks. Our main contribution is an empirical study of UDA to establish which components of the algorithm confer benefits in NLP. Notably, although prior work has emphasized the use of clever augmentation techniques including back-translation, we find that enforcing consistency between predictions assigned to observed and randomly substituted words often yields comparable (or greater) benefits compared to these complex perturbation models. Furthermore, we find that applying its consistency loss affords meaningful gains without any unlabeled data at all, i.e., in a standard supervised setting. In short: UDA need not be unsupervised, and does not require complex data augmentation to be effective.


title: Language Models are Open Knowledge Graphs

abstract: This paper shows how to construct knowledge graphs (KGs) from pre-trained language models (e.g., BERT, GPT-2/3), without human supervision. Popular KGs (e.g, Wikidata, NELL) are built in either a supervised or semi-supervised manner, requiring humans to create knowledge. Recent deep language models automatically acquire knowledge from large-scale corpora via pre-training. The stored knowledge has enabled the language models to improve downstream NLP tasks, e.g., answering questions, and writing code and articles. In this paper, we propose an unsupervised method to cast the knowledge contained within language models into KGs. We show that KGs are constructed with a single forward pass of the pre-trained language models (without fine-tuning) over the corpora. We demonstrate the quality of the constructed KGs by comparing to two KGs (Wikidata, TAC KBP) created by humans. Our KGs also provide open factual knowledge that is new in the existing KGs. Our code and KGs will be made publicly available.


title: Probing the Cold Deep Depths of the California Molecular Cloud: The Icy Relationship between CO and Dust

abstract: We study the relationship between molecular gas and dust in the California Molecular Cloud over an unprecedented dynamic range of cloud depth (Av = 3 - 60 magnitudes). We compare deep Herschel-based measurements of dust extinction with observations of the 12CO, 13CO, and C18O J=2-1 lines on sub-parsec scales across the cloud. We directly measure the ratio of CO integrated intensity to dust extinction to derive the CO X-factor at over 1e5 independent locations in the cloud. Confirming an earlier study, we find that no single 12CO X-factor can characterize the molecular gas in the cold ( Tdust<20K) regions of the cloud that account for most of its mass. We are able to derive a single-valued X-factor for all three CO isotopologues in the warm ( Tdust>25 K ) material that is spatially coincident with an HII region surrounding the star LKHa101. We derive LTE CO column densities for 13CO and C18O since we find both lines are relatively optically thin. In the warm cloud material CO is completely in the gas phase and we are able to recover the total 13CO and C18O abundances. Using CO abundances and deep Herschel observations, we measure lower bounds to the freeze-out of CO onto dust across the whole cloud finding some regions having CO depleted by a factor of >20. We construct the first maps of depletion that span the extent of a giant molecular cloud. Using these maps we identify 75 depletion-defined cores and discuss their physical nature.


title: Developing a Real Time Processing System for HERA

abstract: The Hydrogen Epoch of Reionization Array (HERA) is a radio telescope in the Karoo desert of South Africa endeavoring to observe Cosmic Dawn and the Epoch of Reionization. When fully constructed, it will consist of 350 antennas and generate over 60 terabytes (TB) of data each night. In order to keep pace with the relatively large rate of data, we have developed the real-time processing (RTP) system for HERA. The RTP is responsible for inspecting data for acceptable levels of quality and flagging unusable data, as well as providing an initial calibration solution. The RTP system consists of the pipeline management system, called the hera_opm package, and the data management system, called the librarian. Though the systems have been developed in the context of analyzing HERA data, they feature public and open source software, and have been designed to be adapted and used in other contexts as necessary.


title: Two-sample Test using Projected Wasserstein Distance

abstract: We develop a projected Wasserstein distance for the two-sample test, a fundamental problem in statistics and machine learning: given two sets of samples, to determine whether they are from the same distribution. In particular, we aim to circumvent the curse of dimensionality in Wasserstein distance: when the dimension is high, it has diminishing testing power, which is inherently due to the slow concentration property of Wasserstein metrics in the high dimension space. A key contribution is to couple optimal projection to find the low dimensional linear mapping to maximize the Wasserstein distance between projected probability distributions. We characterize the theoretical property of the finite-sample convergence rate on IPMs and present practical algorithms for computing this metric. Numerical examples validate our theoretical results.


title: Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising

abstract: Self-supervised frameworks that learn denoising models with merely individual noisy images have shown strong capability and promising performance in various image denoising tasks. Existing self-supervised denoising frameworks are mostly built upon the same theoretical foundation, where the denoising models are required to be J-invariant. However, our analyses indicate that the current theory and the J-invariance may lead to denoising models with reduced performance. In this work, we introduce Noise2Same, a novel self-supervised denoising framework. In Noise2Same, a new self-supervised loss is proposed by deriving a self-supervised upper bound of the typical supervised loss. In particular, Noise2Same requires neither J-invariance nor extra information about the noise model and can be used in a wider range of denoising applications. We analyze our proposed Noise2Same both theoretically and experimentally. The experimental results show that our Noise2Same remarkably outperforms previous self-supervised denoising methods in terms of denoising performance and training efficiency. Our code is available at https://github.com/divelab/Noise2Same.


title: The Cluster HEritage project with XMM-Newton: Mass Assembly and Thermodynamics at the Endpoint of structure formation. I. Programme overview

abstract: The Cluster HEritage project with XMM-Newton - Mass Assembly and Thermodynamics at the Endpoint of structure formation (CHEX-MATE) is a three mega-second Multi-Year Heritage Programme to obtain X-ray observations of a minimally-biased, signal-to-noise limited sample of 118 galaxy clusters detected by Planck through the Sunyaev-Zeldovich effect. The programme, described in detail in this paper, aims to study the ultimate products of structure formation in time and mass. It is composed of a census of the most recent objects to have formed (Tier-1: 0.05 < z < 0.2; 2 x 10e14 M_sun < M_500 < 9 x 10e14 M_sun), together with a sample of the highest-mass objects in the Universe (Tier-2: z < 0.6; M_500 > 7.25 x 10e14 M_sun). The programme will yield an accurate vision of the statistical properties of the underlying population, measure how the gas properties are shaped by collapse into the dark matter halo, uncover the provenance of non-gravitational heating, and resolve the major uncertainties in mass determination that limit the use of clusters for cosmological parameter estimation. We will acquire X-ray exposures of uniform depth, designed to obtain individual mass measurements accurate to 15-20% under the hydrostatic assumption. We present the project motivations, describe the programme definition, and detail the ongoing multi-wavelength observational (lensing, SZ, radio) and theoretical effort that is being deployed in support of the project.


title: Rediscovering the Slavic Continuum in Representations Emerging from Neural Models of Spoken Language Identification

abstract: Deep neural networks have been employed for various spoken language recognition tasks, including tasks that are multilingual by definition such as spoken language identification. In this paper, we present a neural model for Slavic language identification in speech signals and analyze its emergent representations to investigate whether they reflect objective measures of language relatedness and/or non-linguists' perception of language similarity. While our analysis shows that the language representation space indeed captures language relatedness to a great extent, we find perceptual confusability between languages in our study to be the best predictor of the language representation similarity.


title: Quantum-enabled communication without a phase reference

abstract: A phase reference has been a standard requirement in continuous-variable quantum sensing and communication protocols. However, maintaining a phase reference is challenging due to environmental fluctuations, preventing quantum phenomena such as entanglement and coherence from being utilized in many scenarios. We show that quantum communication and entanglement-assisted communication without a phase reference are possible, when a short-time memory effect is present. The degradation in the communication rate of classical or quantum information transmission decreases inversely with the correlation time. An exact solution of the quantum capacity and entanglement-assisted classical/quantum capacity for pure dephasing channels is derived, where non-Gaussian multipartite-entangled states show strict advantages over usual Gaussian sources. For thermal-loss dephasing channels, lower bounds of the capacities are derived. The lower bounds also extend to scenarios with fading effect in the channel. In addition, for entanglement-assisted communication, the lower bounds can be achieved by a simple phase-encoding scheme on two-mode squeezed vacuum sources, when the noise is large.


title: GEViTRec: Data Reconnaissance Through Recommendation Using a Domain-Specific Prevalence Visualization Design Space

abstract: Genomic Epidemiology (genEpi) is a branch of public health that uses many different data types including tabular, network, genomic, and geographic, to identify and contain outbreaks of deadly diseases. Due to the volume and variety of data, it is challenging for genEpi domain experts to conduct data reconnaissance; that is, have an overview of the data they have and make assessments toward its quality, completeness, and suitability. We present an algorithm for data reconnaissance through automatic visualization recommendation, GEViTRec. Our approach handles a broad variety of dataset types and automatically generates coordinated combinations of charts, in contrast to existing systems that primarily focus on singleton visual encodings of tabular datasets. We automatically detect linkages across multiple input datasets by analyzing non-numeric attribute fields, creating an entity graph within which we analyze and rank paths. For each high-ranking path, we specify chart combinations with spatial and color alignments between shared fields, using a gradual binding approach to transform initial partial specifications of singleton charts to complete specifications that are aligned and oriented consistently. A novel aspect of our approach is its combination of domain-agnostic elements with domain-specific information that is captured through a domain-specific visualization prevalence design space. Our implementation is applied to both synthetic data and real data from an Ebola outbreak. We compare GEViTRec's output to what previous visualization recommendation systems would generate, and to manually crafted visualizations used by practitioners. We conducted formative evaluations with ten genEpi experts to assess the relevance and interpretability of our results.


title: On the Elastic Properties and Fracture Patterns of MoX2 (X = S, Se, Te) Membranes: A Reactive Molecular Dynamics Study

abstract: We carried out fully-atomistic reactive molecular dynamics simulations to study the elastic properties and fracture patterns of transition metal dichalcogenide (TMD) MoX2 (X=S, Se, Te) membranes, in their 2H and 1T phases, within the framework of the Stillinger-Weber potential. Results showed that the fracture mechanism of these membranes occurs through a fast crack propagation followed by their abrupt rupture into moieties. As a general trend, the translated arrangement of the chalcogen atoms in the 1T phase contributes to diminishing their structural stability when contrasted with the 2H one. Among the TMDs studied here, 2H-MoSe2 has a higher tensile strength (25.98 GPa).


title: Search for planets in hot Jupiter systems with multi-sector TESS photometry. I. No companions in planetary systems KELT-18, KELT-23, KELT-24, Qatar-8, WASP-62, WASP-100, WASP-119, and WASP-126

abstract: Origins of giant planets on tight orbits, so called hot Jupiters, are a long-lasting question in the planetary formation and evolution theory. The answer seems to be hidden in architectures of those systems that remain only partially understood. Using multi-sector time-series photometry from the Transiting Exoplanet Survey Satellite, we searched for additional planets in the KELT-18, KELT-23, KELT-24, Qatar-8, WASP-62, WASP-100, WASP-119, and WASP-126 planetary systems using both the transit technique and transit timing method. Our homogenous analysis has eliminated the presence of transiting companions down to the terrestrial-size regime in the KELT-23 and WASP-62 systems, and down to mini-Neptunes or Neptunes in the remaining ones. Transit timing analysis has revealed no sign of either long-term trends or periodic perturbations for all the studied hot Jupiters, including the WASP-126 b for which deviations from a Keplerian model were claimed in the literature. The loneliness of the planets of the sample speaks in favour of the high-eccentricity migration mechanism that probably brought them to their tight orbits observed nowadays. As a byproduct of our study, the transit light curve parameters were redetermined with a substantial improvement of the precision for 6 systems. For KELT-24 b, a joint analysis allowed us to place a tighter constraint on its orbital eccentricity.


title: Deep Convolutional Neural Networks Model-based Brain Tumor Detection in Brain MRI Images

abstract: Diagnosing Brain Tumor with the aid of Magnetic Resonance Imaging (MRI) has gained enormous prominence over the years, primarily in the field of medical science. Detection and/or partitioning of brain tumors solely with the aid of MR imaging is achieved at the cost of immense time and effort and demands a lot of expertise from engaged personnel. This substantiates the necessity of fabricating an autonomous model brain tumor diagnosis. Our work involves implementing a deep convolutional neural network (DCNN) for diagnosing brain tumors from MR images. The dataset used in this paper consists of 253 brain MR images where 155 images are reported to have tumors. Our model can single out the MR images with tumors with an overall accuracy of 96%. The model outperformed the existing conventional methods for the diagnosis of brain tumor in the test dataset (Precision = 0.93, Sensitivity = 1.00, and F1-score = 0.97). Moreover, the proposed model's average precision-recall score is 0.93, Cohen's Kappa 0.91, and AUC 0.95. Therefore, the proposed model can help clinical experts verify whether the patient has a brain tumor and, consequently, accelerate the treatment procedure.


title: G\"odel's Theorem and Direct Self-Reference

abstract: In his paper on the incompleteness theorems, G\"odel seemed to say that a direct way of constructing a formula that says of itself that it is unprovable might involve a faulty circularity. In this note, it is proved that 'direct' self-reference can actually be used to prove his result.


title: A Joint Learning Approach based on Self-Distillation for Keyphrase Extraction from Scientific Documents

abstract: Keyphrase extraction is the task of extracting a small set of phrases that best describe a document. Most existing benchmark datasets for the task typically have limited numbers of annotated documents, making it challenging to train increasingly complex neural networks. In contrast, digital libraries store millions of scientific articles online, covering a wide range of topics. While a significant portion of these articles contain keyphrases provided by their authors, most other articles lack such kind of annotations. Therefore, to effectively utilize these large amounts of unlabeled articles, we propose a simple and efficient joint learning approach based on the idea of self-distillation. Experimental results show that our approach consistently improves the performance of baseline models for keyphrase extraction. Furthermore, our best models outperform previous methods for the task, achieving new state-of-the-art results on two public benchmarks: Inspec and SemEval-2017.


title: A novel auction system for selecting advertisements in Real-Time bidding

abstract: Real-Time Bidding is a new Internet advertising system that has become very popular in recent years. This system works like a global auction where advertisers bid to display their impressions in the publishers' ad slots. The most popular system to select which advertiser wins each auction is the Generalized second-price auction in which the advertiser that offers the most wins the bet and is charged with the price of the second largest bet. In this paper, we propose an alternative betting system with a new approach that not only considers the economic aspect but also other relevant factors for the functioning of the advertising system. The factors that we consider are, among others, the benefit that can be given to each advertiser, the probability of conversion from the advertisement, the probability that the visit is fraudulent, how balanced are the networks participating in RTB and if the advertisers are not paying over the market price. In addition, we propose a methodology based on genetic algorithms to optimize the selection of each advertiser. We also conducted some experiments to compare the performance of the proposed model with the famous Generalized Second-Price method. We think that this new approach, which considers more relevant aspects besides the price, offers greater benefits for RTB networks in the medium and long-term.


title: The Turking Test: Can Language Models Understand Instructions?

abstract: Supervised machine learning provides the learner with a set of input-output examples of the target task. Humans, however, can also learn to perform new tasks from instructions in natural language. Can machines learn to understand instructions as well? We present the Turking Test, which examines a model's ability to follow natural language instructions of varying complexity. These range from simple tasks, like retrieving the nth word of a sentence, to ones that require creativity, such as generating examples for SNLI and SQuAD in place of human intelligence workers ("turkers"). Despite our lenient evaluation methodology, we observe that a large pretrained language model performs poorly across all tasks. Analyzing the model's error patterns reveals that the model tends to ignore explicit instructions and often generates outputs that cannot be construed as an attempt to solve the task. While it is not yet clear whether instruction understanding can be captured by traditional language models, the sheer expressivity of instruction understanding makes it an appealing alternative to the rising few-shot inference paradigm.


title: Learnability and Complexity of Quantum Samples

abstract: Given a quantum circuit, a quantum computer can sample the output distribution exponentially faster in the number of bits than classical computers. A similar exponential separation has yet to be established in generative models through quantum sample learning: given samples from an n-qubit computation, can we learn the underlying quantum distribution using models with training parameters that scale polynomial in n under a fixed training time? We study four kinds of generative models: Deep Boltzmann machine (DBM), Generative Adversarial Networks (GANs), Long Short-Term Memory (LSTM) and Autoregressive GAN, on learning quantum data set generated by deep random circuits. We demonstrate the leading performance of LSTM in learning quantum samples, and thus the autoregressive structure present in the underlying quantum distribution from random quantum circuits. Both numerical experiments and a theoretical proof in the case of the DBM show exponentially growing complexity of learning-agent parameters required for achieving a fixed accuracy as n increases. Finally, we establish a connection between learnability and the complexity of generative models by benchmarking learnability against different sets of samples drawn from probability distributions of variable degrees of complexities in their quantum and classical representations.


title: Incoherent Cooper pairing and pseudogap behavior in single-layer FeSe/SrTiO$_3$

abstract: In many unconventional superconductors, the presence of a pseudogap - a suppression in the electronic density of states extending above the critical temperature - has been a long-standing mystery. Here, we employ combined \textit{in situ} electrical transport and angle-resolved photoemission spectroscopy (ARPES) measurements to reveal an unprecedentedly large pseudogap regime in single-layer FeSe/SrTiO$_3$, an interfacial superconductor where incoherent Cooper pairs are initially formed above $T_{\Delta}$ $\approx$ 60 K, but where a zero resistance state is only achieved below $T_{0}$ $<$ 30 K. We show that this behavior is accompanied by distinct transport signatures of two-dimensional phase fluctuating superconductivity, suggesting a mixed vortex state hosting incoherent Cooper pairs which persist well above the maximum clean limit $T_{c}$ of $\approx$ 40 K. Our work establishes the critical role of reduced dimensionality in driving the complex interplay between Cooper pairing and phase coherence in two-dimensional high-$T_c$ superconductors, providing a paradigm for understanding and engineering higher-$T_{c}$ interfacial superconductors.


title: MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences

abstract: Human communication is multimodal in nature; it is through multiple modalities such as language, voice, and facial expressions, that opinions and emotions are expressed. Data in this domain exhibits complex multi-relational and temporal interactions. Learning from this data is a fundamentally challenging research problem. In this paper, we propose Modal-Temporal Attention Graph (MTAG). MTAG is an interpretable graph-based neural model that provides a suitable framework for analyzing multimodal sequential data. We first introduce a procedure to convert unaligned multimodal sequence data into a graph with heterogeneous nodes and edges that captures the rich interactions across modalities and through time. Then, a novel graph fusion operation, called MTAG fusion, along with a dynamic pruning and read-out technique, is designed to efficiently process this modal-temporal graph and capture various interactions. By learning to focus only on the important interactions within the graph, MTAG achieves state-of-the-art performance on multimodal sentiment analysis and emotion recognition benchmarks, while utilizing significantly fewer model parameters.


title: Measurement of the branching fraction of the $B^{0}\rightarrow D_{s}^{+}\pi^{-}$ decay

abstract: A branching fraction measurement of the $B^{0}\rightarrow D_{s}^{+}\pi^{-}$ decay is presented using proton-proton collision data collected with the LHCb experiment, corresponding to an integrated luminosity of $5.0\,$fb$^{-1}$. The branching fraction is found to be ${\mathcal{B}(B^{0}\rightarrow D_{s}^{+}\pi^{-}) = (19.4 \pm 1.8\pm 1.3 \pm 1.2)\times 10^{-6}}$, where the first uncertainty is statistical, the second systematic and the third is due to the uncertainty on the $B^0 \to D^{-}\pi^{+}$, $D_{s}^{+}\rightarrow K^{+}K^{-}\pi^{+}$ and $D^{-}\rightarrow K^{+}\pi^{-}\pi^{-}$ branching fractions. This is the most precise single measurement of this quantity to date. As this decay proceeds through a single amplitude involving a $b \to u$ charged-current transition, the result provides information on non-factorisable strong interaction effects and the magnitude of the Cabibbo-Kobayashi-Maskawa matrix element $V_{ub}$. Additionally, the collision energy dependence of the hadronisation-fraction ratio $f_s/f_d$ is measured through $\bar{B}{}_{s}^{0}\rightarrow D_{s}^{+}\pi^{-}$ and $B^0 \to D^{-}\pi^{+}$ decays.


title: Froissaron and Maximal Odderon with spin-flip in $pp$ and $\bar pp$ high energy elastic scattering

abstract: We assume that the scattering amplitude is represented by Froissaron, Maximal Odderon as well as by standard Regge poles. From the fit to the data of $pp$ and $\bar pp$ scattering at high energy and not too large momentum transfers we found that this model taking into account the spin is available to describe not only the differential, total cross section and $\rho$, but also the existing experimental data on polarization.


title: Meta-Learning for Domain Generalization in Semantic Parsing

abstract: The importance of building semantic parsers which can be applied to new domains and generate programs unseen at training has long been acknowledged, and datasets testing out-of-domain performance are becoming increasingly available. However, little or no attention has been devoted to learning algorithms or objectives which promote domain generalization, with virtually all existing approaches relying on standard supervised learning. In this work, we use a meta-learning framework which targets zero-shot domain generalization for semantic parsing. We apply a model-agnostic training algorithm that simulates zero-shot parsing by constructing virtual train and test sets from disjoint domains. The learning objective capitalizes on the intuition that gradient steps that improve source-domain performance should also improve target-domain performance, thus encouraging a parser to generalize to unseen target domains. Experimental results on the (English) Spider and Chinese Spider datasets show that the meta-learning objective significantly boosts the performance of a baseline parser.


title: Locally Decodable/Correctable Codes for Insertions and Deletions

abstract: Recent efforts in coding theory have focused on building codes for insertions and deletions, called insdel codes, with optimal trade-offs between their redundancy and their error-correction capabilities, as well as efficient encoding and decoding algorithms. In many applications, polynomial running time may still be prohibitively expensive, which has motivated the study of codes with super-efficient decoding algorithms. These have led to the well-studied notions of Locally Decodable Codes (LDCs) and Locally Correctable Codes (LCCs). Inspired by these notions, Ostrovsky and Paskin-Cherniavsky (Information Theoretic Security, 2015) generalized Hamming LDCs to insertions and deletions. To the best of our knowledge, these are the only known results that study the analogues of Hamming LDCs in channels performing insertions and deletions. Here we continue the study of insdel codes that admit local algorithms. Specifically, we reprove the results of Ostrovsky and Paskin-Cherniavsky for insdel LDCs using a different set of techniques. We also observe that the techniques extend to constructions of LCCs. Specifically, we obtain insdel LDCs and LCCs from their Hamming LDCs and LCCs analogues, respectively. The rate and error-correction capability blow up only by a constant factor, while the query complexity blows up by a poly log factor in the block length. Since insdel locally decodable/correctble codes are scarcely studied in the literature, we believe our results and techniques may lead to further research. In particular, we conjecture that constant-query insdel LDCs/LCCs do not exist.


title: Applications of cone structures to the anisotropic rheonomic Huygens' principle

abstract: A general framework for the description of classic wave propagation is introduced. This relies on a cone structure $C$ determined by an intrinsic space $\Sigma$ of velocities of propagation (point, direction and time-dependent) and an observers' vector field $\partial_t$ whose integral curves provide both a Zermelo problem for the wave and an auxiliary Lorentz-Finsler metric $G$ compatible with $C$. The PDE for the wavefront is reduced to the ODE for the $t$-parametrized cone geodesics of $C$. Particular cases include time-independence ($\partial_t$ is Killing for $G$), infinitesimally ellipsoidal propagation ($G$ can be replaced by a Lorentz metric) or the case of a medium which moves with respect to $\partial_t$ faster than the wave (the strong wind case of a sound wave), where a conic time-dependent Finsler metric emerges. The specific case of wildfire propagation is revisited.


title: Atlas Fusion -- Modern Framework for Autonomous Agent Sensor Data Fusion

abstract: In this paper, we present our software sensor fusion framework for self-driving cars and other autonomous robots. We have designed our framework as a universal and scalable platform for building up a robust 3D model of the agent's surrounding environment by fusing a wide range of various sensors into the data model that we can use as a basement for the decision making and planning algorithms. Our software currently covers the data fusion of the RGB and thermal cameras, 3D LiDARs, 3D IMU, and a GNSS positioning. The framework covers a complete pipeline from data loading, filtering, preprocessing, environment model construction, visualization, and data storage. The architecture allows the community to modify the existing setup or to extend our solution with new ideas. The entire software is fully compatible with ROS (Robotic Operation System), which allows the framework to cooperate with other ROS-based software. The source codes are fully available as an open-source under the MIT license. See https://github.com/Robotics-BUT/Atlas-Fusion.


title: DECaNT: Simulation Tool for Diffusion of Excitons in Carbon Nanotube Films

abstract: We present the numerical tool DECaNT (Diffusion of Excitons in Carbon NanoTubes) that simulates exciton transport in thin films of carbon nanotubes. Through a mesh of nanotubes generated using the Bullet Physics C++ library, excitons move according to an ensemble Monte Carlo algorithm, with the scattering rates that account for tube chirality, orientation, and distance. We calculate the diffusion tensor from the position--position correlation functions and analyze its anisotropy and dependence on the film composition, morphology, and defect density.

categories: cond-mat.mes-hall cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.other


title: Unsupervised deep learning for grading of age-related macular degeneration using retinal fundus images

abstract: Many diseases are classified based on human-defined rubrics that are prone to bias. Supervised neural networks can automate the grading of retinal fundus images, but require labor-intensive annotations and are restricted to the specific trained task. Here, we employed an unsupervised network with Non-Parametric Instance Discrimination (NPID) to grade age-related macular degeneration (AMD) severity using fundus photographs from the Age-Related Eye Disease Study (AREDS). Our unsupervised algorithm demonstrated versatility across different AMD classification schemes without retraining, and achieved unbalanced accuracies comparable to supervised networks and human ophthalmologists in classifying advanced or referable AMD, or on the 4-step AMD severity scale. Exploring the networks behavior revealed disease-related fundus features that drove predictions and unveiled the susceptibility of more granular human-defined AMD severity schemes to misclassification by both ophthalmologists and neural networks. Importantly, unsupervised learning enabled unbiased, data-driven discovery of AMD features such as geographic atrophy, as well as other ocular phenotypes of the choroid, vitreous, and lens, such as visually-impairing cataracts, that were not pre-defined by human labels.


title: Thresholded Lasso Bandit

abstract: In this paper, we revisit the regret minimization problem in sparse stochastic contextual linear bandits, where feature vectors may be of large dimension $d$, but where the reward function depends on a few, say $s_0\ll d$, of these features only. We present Thresholded Lasso bandit, an algorithm that (i) estimates the vector defining the reward function as well as its sparse support, i.e., significant feature elements, using the Lasso framework with thresholding, and (ii) selects an arm greedily according to this estimate projected on its support. The algorithm does not require prior knowledge of the sparsity index $s_0$ and can be parameter-free under some symmetric assumptions. For this simple algorithm, we establish non-asymptotic regret upper bounds scaling as $\mathcal{O}( \log d + \sqrt{T} )$ in general, and as $\mathcal{O}( \log d + \log T)$ under the so-called margin condition (a probabilistic condition on the separation of the arm rewards). The regret of previous algorithms scales as $\mathcal{O}( \log d + \sqrt{T \log (d T)})$ and $\mathcal{O}( \log T \log d)$ in the two settings, respectively. Through numerical experiments, we confirm that our algorithm outperforms existing methods.


title: Investigating Cultural Aspects in the Fundamental Diagram using Convolutional Neural Networks and Simulation

abstract: This paper presents a study regarding group behavior in a controlled experiment focused on differences in an important attribute that vary across cultures -- the personal spaces -- in two Countries: Brazil and Germany. In order to coherently compare Germany and Brazil evolutions with same population applying same task, we performed the pedestrian Fundamental Diagram experiment in Brazil, as performed in Germany. We use CNNs to detect and track people in video sequences. With this data, we use Voronoi Diagrams to find out the neighbor relation among people and then compute the walking distances to find out the personal spaces. Based on personal spaces analyses, we found out that people behavior is more similar, in terms of their behaviours, in high dense populations and vary more in low and medium densities. So, we focused our study on cultural differences between the two Countries in low and medium densities. Results indicate that personal space analyses can be a relevant feature in order to understand cultural aspects in video sequences. In addition to the cultural differences, we also investigate the personality model in crowds, using OCEAN. We also proposed a way to simulate the FD experiment from other countries using the OCEAN psychological traits model as input. The simulated countries were consistent with the literature.


title: Spaces of embeddings: Nonsingular bilinear maps, chirality, and their generalizations

abstract: Given a space X we study the topology of the space of embeddings of X into $\mathbb{R}^d$ through the combinatorics of triangulations of X. We give a simple combinatorial formula for upper bounds for the largest dimension of a sphere that antipodally maps into the space of embeddings. This result summarizes and extends results about the nonembeddability of complexes into $\mathbb{R}^d$, the nonexistence of nonsingular bilinear maps, and the study of embeddings into $\mathbb{R}^d$ up to isotopy, such as the chirality of spatial graphs.


title: Characterizing Datasets for Social Visual Question Answering, and the New TinySocial Dataset

abstract: Modern social intelligence includes the ability to watch videos and answer questions about social and theory-of-mind-related content, e.g., for a scene in Harry Potter, "Is the father really upset about the boys flying the car?" Social visual question answering (social VQA) is emerging as a valuable methodology for studying social reasoning in both humans (e.g., children with autism) and AI agents. However, this problem space spans enormous variations in both videos and questions. We discuss methods for creating and characterizing social VQA datasets, including 1) crowdsourcing versus in-house authoring, including sample comparisons of two new datasets that we created (TinySocial-Crowd and TinySocial-InHouse) and the previously existing Social-IQ dataset; 2) a new rubric for characterizing the difficulty and content of a given video; and 3) a new rubric for characterizing question types. We close by describing how having well-characterized social VQA datasets will enhance the explainability of AI agents and can also inform assessments and educational interventions for people.