title: Sorting Short Keys in Circuits of Size o(n log n)

abstract: We consider the classical problem of sorting an input array containing $n$ elements, where each element is described with a $k$-bit comparison-key and a $w$-bit payload. A long-standing open problem is whether there exist $(k + w) \cdot o(n \log n)$-sized boolean circuits for sorting. We show that one can overcome the $n\log n$ barrier when the keys to be sorted are short. Specifically, we prove that there is a circuit with $(k + w) \cdot O(n k) \cdot \poly(\log^*n - \log^* (w + k))$ boolean gates capable of sorting any input array containing $n$ elements, each described with a $k$-bit key and a $w$-bit payload. Therefore, if the keys to be sorted are short, say, $k < o(\log n)$, our result is asymptotically better than the classical AKS sorting network (ignoring $\poly\log^*$ terms); and we also overcome the $n \log n$ barrier in such cases. Such a result might be surprising initially because it is long known that comparator-based techniques must incur $\Omega(n \log n)$ comparator gates even when the keys to be sorted are only $1$-bit long (e.g., see Knuth's "Art of Programming" textbook). To the best of our knowledge, we are the first to achieve non-trivial results for sorting circuits using non-comparison-based techniques. We also show that if the Li-Li network coding conjecture is true, our upper bound is optimal, barring $\poly\log^*$ terms, for every $k$ as long as $k = O(\log n)$.


title: ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction

abstract: GNNs and chemical fingerprints are the predominant approaches to representing molecules for property prediction. However, in NLP, transformers have become the de-facto standard for representation learning thanks to their strong downstream task transfer. In parallel, the software ecosystem around transformers is maturing rapidly, with libraries like HuggingFace and BertViz enabling streamlined training and introspection. In this work, we make one of the first attempts to systematically evaluate transformers on molecular property prediction tasks via our ChemBERTa model. ChemBERTa scales well with pretraining dataset size, offering competitive downstream performance on MoleculeNet and useful attention-based visualization modalities. Our results suggest that transformers offer a promising avenue of future work for molecular representation learning and property prediction. To facilitate these efforts, we release a curated dataset of 77M SMILES from PubChem suitable for large-scale self-supervised pretraining.


title: Non-parametric Binary regression in metric spaces with KL loss

abstract: We propose a non-parametric variant of binary regression, where the hypothesis is regularized to be a Lipschitz function taking a metric space to [0,1] and the loss is logarithmic. This setting presents novel computational and statistical challenges. On the computational front, we derive a novel efficient optimization algorithm based on interior point methods; an attractive feature is that it is parameter-free (i.e., does not require tuning an update step size). On the statistical front, the unbounded loss function presents a problem for classic generalization bounds, based on covering-number and Rademacher techniques. We get around this challenge via an adaptive truncation approach, and also present a lower bound indicating that the truncation is, in some sense, necessary.


title: Quantifying Urban Road Network Vulnerability and Resilience to Attacks

abstract: The rise of connected and autonomous vehicles, combined with the proliferation of IoT and connected surfaces, lead to the emergence of novel complex cyber risks. Lack of encryption and authentication in internal vehicular networks are widely recognized as cause for concern by cybersecurity experts, automobile, and OEM manufacturers. This concern has only been growing with the increase in cybersecurity incidents and demonstrations showing different vehicular vulnerabilities, making it nearly impossible to completely secure vehicles against cyber-attacks. Of particular concern is the potential for large-scale vehicular cyber-attacks to cascade to transportation networks, which are the lifeline of cities. Here, we develop a framework based on complex network theory, traffic flow, and new data based technologies to quantify the vulnerability of city-scale transportation to cyber-attacks. Application of our framework to the road network of Boston reveals that targeted attacks on a small fraction of nodes leads to disproportionately larger disruptions of routes. We develop an early-detection framework to quantify real-time risk based on gathering multidimensional traffic flow, incident, and social media data sets. Our results illustrate an effects based approach to transportation cyber-defense, through informed, intelligent vehicular agents.


title: An integral-free representation of the Dyson series using divided differences

abstract: The Dyson series is an infinite sum of multi-dimensional time-ordered integrals, which serves as a formal representation of the quantum time-evolution operator in the interaction-picture. Using the mathematical tool of divided differences, we introduce an alternative representation for the series that is entirely free from both time ordering and integrals. In this new formalism, the Dyson expansion is given as a sum of efficiently-computable divided differences of the exponential function, considerably simplifying the calculation of the Dyson expansion terms, while also allowing for time-dependent perturbation calculations to be performed directly in the Schr{\"o}dinger-picture. We showcase the utility of this novel representation by studying a number of use cases. We also discuss several immediate applications.

categories: quant-ph cond-mat.stat-mech hep-th math-ph math.MP nucl-th


title: How much progress have we made in neural network training? A New Evaluation Protocol for Benchmarking Optimizers

abstract: Many optimizers have been proposed for training deep neural networks, and they often have multiple hyperparameters, which make it tricky to benchmark their performance. In this work, we propose a new benchmarking protocol to evaluate both end-to-end efficiency (training a model from scratch without knowing the best hyperparameter) and data-addition training efficiency (the previously selected hyperparameters are used for periodically re-training the model with newly collected data). For end-to-end efficiency, unlike previous work that assumes random hyperparameter tuning, which over-emphasizes the tuning time, we propose to evaluate with a bandit hyperparameter tuning strategy. A human study is conducted to show that our evaluation protocol matches human tuning behavior better than the random search. For data-addition training, we propose a new protocol for assessing the hyperparameter sensitivity to data shift. We then apply the proposed benchmarking framework to 7 optimizers and various tasks, including computer vision, natural language processing, reinforcement learning, and graph mining. Our results show that there is no clear winner across all the tasks.


title: Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration

abstract: In this paper, we introduce Watch-And-Help (WAH), a challenge for testing social intelligence in agents. In WAH, an AI agent needs to help a human-like agent perform a complex household task efficiently. To succeed, the AI agent needs to i) understand the underlying goal of the task by watching a single demonstration of the human-like agent performing the same task (social perception), and ii) coordinate with the human-like agent to solve the task in an unseen environment as fast as possible (human-AI collaboration). For this challenge, we build VirtualHome-Social, a multi-agent household environment, and provide a benchmark including both planning and learning based baselines. We evaluate the performance of AI agents with the human-like agent as well as with real humans using objective metrics and subjective user ratings. Experimental results demonstrate that the proposed challenge and virtual environment enable a systematic evaluation on the important aspects of machine social intelligence at scale.


title: Robust Optimization as Data Augmentation for Large-scale Graphs

abstract: Data augmentation helps neural networks generalize better by enlarging the training set, but it remains an open question how to effectively augment graph data to enhance the performance of GNNs (Graph Neural Networks). While most existing graph regularizers focus on manipulating graph topological structures by adding/removing edges, we offer a method to augment node features for better performance. We propose FLAG (Free Large-scale Adversarial Augmentation on Graphs), which iteratively augments node features with gradient-based adversarial perturbations during training. By making the model invariant to small fluctuations in input data, our method helps models generalize to out-of-distribution samples and boosts model performance at test time. FLAG is a general-purpose approach for graph data, which universally works in node classification, link prediction, and graph classification tasks. FLAG is also highly flexible and scalable, and is deployable with arbitrary GNN backbones and large-scale datasets. We demonstrate the efficacy and stability of our method through extensive experiments and ablation studies. We also provide intuitive observations for a deeper understanding of our method.


title: Understanding YouTube Communities via Subscription-based Channel Embeddings

abstract: YouTube is an important source of news and entertainment worldwide, but the scale makes it challenging to study the ideas and topics being discussed on the platform. This paper presents new methods to discover and classify YouTube channels which enable the analysis of communities and categories on the platform using orders of magnitude more channels than have been used in previous studies. Instead of using channel and video data as features for classification as other researchers have, these methods use a self-supervised learning approach that leverages the public subscription pages of commenters. We test the classification method on the task of predicting the political lean of YouTube news channels and find that it outperforms the previous best model on the task. Further experiments also show that there are important advantages to using commenter subscriptions to discover channels. The subscription data, along with an iterative approach, is applied to discover, to our current understanding, the most comprehensive set of English language socio-political YouTube channels yet to be analyzed. We experiment with predicting more fine grained political tags for channels using a previously annotated dataset and find that our model performs better than the average individual human reviewer for most of the top tags. This fine grained political tag model is then applied to the newly discovered English language socio-political channels to create a new dataset to analyze the amount of traffic going to different political content. The data shows that some tags, such as "Partisan Right" and "Conspiracy", are significantly under represented when looking only at the most popular socio-political channels. Through the use of our methods, we are able to get a much more accurate picture of the size of these communities on YouTube.


title: LT-GAN: Self-Supervised GAN with Latent Transformation Detection

abstract: Generative Adversarial Networks (GANs) coupled with self-supervised tasks have shown promising results in unconditional and semi-supervised image generation. We propose a self-supervised approach (LT-GAN) to improve the generation quality and diversity of images by estimating the GAN-induced transformation (i.e. transformation induced in the generated images by perturbing the latent space of generator). Specifically, given two pairs of images where each pair comprises of a generated image and its transformed version, the self-supervision task aims to identify whether the latent transformation applied in the given pair is same to that of the other pair. Hence, this auxiliary loss encourages the generator to produce images that are distinguishable by the auxiliary network, which in turn promotes the synthesis of semantically consistent images with respect to latent transformations. We show the efficacy of this pretext task by improving the image generation quality in terms of FID on state-of-the-art models for both conditional and unconditional settings on CIFAR-10, CelebA-HQ and ImageNet datasets. Moreover, we empirically show that LT-GAN helps in improving controlled image editing for CelebA-HQ and ImageNet over baseline models. We experimentally demonstrate that our proposed LT self-supervision task can be effectively combined with other state-of-the-art training techniques for added benefits. Consequently, we show that our approach achieves the new state-of-the-art FID score of 9.8 on conditional CIFAR-10 image generation.


title: Herschel Gould Belt Survey Observations of Dense Cores in the Cepheus Flare Clouds

abstract: We present Herschel SPIRE and PACS maps of the Cepheus Flare clouds L1157, L1172, L1228, L1241, and L1251, observed by the Herschel Gould Belt Survey (HGBS) of nearby star-forming molecular clouds. Through modified blackbody fits to the SPIRE and PACS data, we determine typical cloud column densities of 0.5-1.0 $\times$ 10$^{21}$ cm$^{-2}$ and typical cloud temperatures of 14-15 K. Using the getsources identification algorithm, we extract 832 dense cores from the SPIRE and PACS data at 160-500 $\mu$m. From placement in a mass vs. size diagram, we consider 303 to be candidate prestellar cores, and 178 of these to be "robust" prestellar cores. From an independent extraction of sources at 70 $\mu$m, we consider 25 of the 832 dense cores to be protostellar. The distribution of background column densities coincident with candidate prestellar cores peaks at 2-4 $\times$ 10$^{21}$ cm$^{-2}$. About half of the candidate prestellar cores in Cepheus may have formed due to the widespread fragmentation expected to occur within filaments of "transcritical" line mass. The lognormal robust prestellar core mass function (CMF) drawn from all five Cepheus clouds peaks at 0.56 M$_{\odot}$ and has a width of $\sim$0.5 dex, similar to that of Aquila's CMF. Indeed, the width of Cepheus' aggregate CMF is similar to the stellar system Initial Mass Function (IMF). The similarity of CMF widths in different clouds and the system IMF suggests a common, possibly turbulent origin for seeding the fluctuations that evolve into prestellar cores and stars.


title: Multi-Window Data Augmentation Approach for Speech Emotion Recognition

abstract: We present a Multi-Window Data Augmentation (MWA-SER) approach for speech emotion recognition. MWA-SER is a unimodal approach that focuses on two key concepts; designing the speech augmentation method and building the deep learning model to recognize the underlying emotion of an audio signal. Our proposed multi-window augmentation approach generates additional data samples from the speech signal by employing multiple window sizes in the audio feature extraction process. We show that our augmentation method, combined with a deep learning model, improves speech emotion recognition performance. We evaluate the performance of our approach on three benchmark datasets: IEMOCAP, SAVEE, and RAVDESS. We show that the multi-window model improves the SER performance and outperforms a single-window model. The notion of finding the best window size is an essential step in audio feature extraction. We perform extensive experimental evaluations to find the best window choice and explore the windowing effect for SER analysis.


title: On Effective Convergence in Fekete's Lemma and Related Combinatorial Problems in Information Theory

abstract: Fekete's lemma is a well known result from combinatorial mathematics that shows the existence of a limit value related to super- and subadditive sequences of real numbers. In this paper, we analyze Fekete's lemma in view of the arithmetical hierarchy of real numbers by \citeauthor{ZhWe01} and fit the results into an information theoretic-context. We introduce special sets associated to super- and subadditive sequences and prove their effective equivalence to $\Sigma_1$ and $\Pi_1$. Using methods from the theory established by \citeauthor{ZhWe01}, we then show that the limit value emerging from Fekete's lemma is, in general, not a computable number. Furthermore, we characterize under which conditions the limit value can be computed and investigate the corresponding modulus of convergence. We close the paper by a discussion on how our findings affect common problems from information theory.


title: DQN-AF: Deep Q-Network based Adaptive Forwarding Strategy for Named Data Networking

abstract: NDN has gained significant attention due to the appearance of several unforeseen design flaws that became evident with new communication scenarios. Among its many features, the two standard NDN forwarding strategies are not adaptive, causing performance degradation in several scenarios. This paper proposes an adaptive forwarding strategy based on deep reinforcement learning with Deep Q-Network, which analyzes the NDN router interface metrics without creating signaling overhead or harming the design principles from the NDN architecture, besides showing significant performance gains compared to the standard strategies.


title: Quantification of Ebola virus replication kinetics in vitro

abstract: Mathematical modelling has successfully been used to provide quantitative descriptions of many viral infections, but for the Ebola virus, which requires biosafety level 4 facilities for experimentation, modelling can play a crucial role. Ebola modelling efforts have primarily focused on in vivo virus kinetics, e.g., in animal models, to aid the development of antivirals and vaccines. But, thus far, these studies have not yielded a detailed specification of the infection cycle, which could provide a foundational description of the virus kinetics and thus a deeper understanding of their clinical manifestation. Here, we obtain a diverse experimental data set of the Ebola infection in vitro, and then make use of Bayesian inference methods to fully identify parameters in a mathematical model of the infection. Our results provide insights into the distribution of time an infected cell spends in the eclipse phase (the period between infection and the start of virus production), as well as the rate at which infectious virions lose infectivity. We suggest how these results can be used in future models to describe co-infection with defective interfering particles, which are an emerging alternative therapeutic.


title: Joint Invariants of Linear Symplectic Actions

abstract: We review computations of joint invariants on a linear symplectic space, discuss variations for an extension of group and space and relate this to other equivalence problems and approaches, most importantly to differential invariants.


title: On the number of symmetric presentations of a determinantal hypersurface

abstract: A hypersurface $H$ in $\mathbb{P}^r$ of degree $n$ is called determinantal if it is the zero locus of a polynomial of the form $\operatorname{det}(x_0 A_0 + \ldots + x_r A_r)$ for some $(r+1)$-tuple of $n \times n$ matrices $A = (A_0, \ldots, A_r)$. We will refer to $A$ as a presentation of $H$. Another presentation $B = (B_0, B_1, \ldots, B_r)$ of $H$ can be obtained by choosing $g_1, g_2 \in \operatorname{GL}_n$ and setting $B_i = g_1 A_i g_2$ for every $i = 0, 1, \ldots, r$. In this case $A$ and $B$ are called equivalent. The second author and A. Vistoli have shown that for $r \geq 3$ a general determinantal hypersurface admits only finitely many presentations up to equivalence. In this paper we prove a similar result for symmetric presentations for every $r \geq 2$. Here the matrices $A_0, \ldots, A_r$ are required to be symmetric, and two $(r+1)$-tuples of $n \times n$ symmetric matrices $A = (A_0, A_1, \ldots, A_r)$ and $B = (B_0, B_1, \ldots, B_r)$ are considered equivalent if there exists a $g \in \operatorname{GL}_n$ such that $B_i = g^{\rm transpose} A_i g$ for every $i = 0, \ldots, r$.


title: Observing the suppression of superconductivity in RbEuFe$_4$As$_4$ by correlated magnetic fluctuations

abstract: In this letter, we describe quantitative magnetic imaging of superconducting vortices in RbEuFe$_4$As$_4$ in order to investigate the unique interplay between the magnetic and superconducting sublattices. Our scanning Hall microscopy data reveal a pronounced suppression of the superfluid density near the magnetic ordering temperature in good qualitative agreement with a recently-developed model describing the suppression of superconductivity by correlated magnetic fluctuations. These results indicate a pronounced exchange interaction between the superconducting and magnetic subsystems in RbEuFe\textsubscript{4}As\textsubscript{4} with important implications for future investigations of physical phenomena arising from the interplay between them.


title: The circum-galactic medium of quasars: transverse and line-of-sight absorptions

abstract: Quasar projected pairs (QPPs) can be used for investigating the circumgalactic medium of quasars through the study of intervening absorption lines in the spectrum of the background quasar that are at the same redshift of the foreground quasar. Here we report on optical spectroscopy, gathered at Gran Telescopio Canarias, of 14 QPPs. In 7 cases we find MgII absorption lines associated with the foreground quasar. Only for two cases line-of-sight absorptions (LOS) are revealed. These new observations complement our previous study performed on other 30 QPPs. A brief discussion of the properties of the intervening absorption lines associated with the foreground quasar for the full dataset is reported.


title: Teleoperated aerial manipulator and its avatar. Part 1: Communication, system's interconnection, control, and virtual world

abstract: The tasks that an aerial manipulator can perform are incredibly diverse. However, nowadays the technology is not completely developed to achieve complex tasks autonomously. That's why we propose a human-in-the-loop system that can control a semi-autonomous aerial manipulator to accomplish these kinds of tasks. Furthermore, motivated by the growing trend of virtual reality systems, together with teleoperation, we develop a system composed of: an aerial manipulator model programmed in PX4 and modeled in Gazebo, a virtual reality immersion with an interactive controller, and the interconnection between the aforementioned systems via the Internet. This research is the first part of a broader project. In this part, we present experiments in the software in the loop simulation. The code of this work is liberated on our GitHub page. Also, a video shows the conducted experiments.


title: Robust & Asymptotically Locally Optimal UAV-Trajectory Generation Based on Spline Subdivision

abstract: Generating locally optimal UAV-trajectories is challenging due to the non-convex constraints of collision avoidance and actuation limits. We present the first local, optimization-based UAV-trajectory generator that simultaneously guarantees the validity and asymptotic optimality for known environments. \textit{Validity:} Given a feasible initial guess, our algorithm guarantees the satisfaction of all constraints throughout the process of optimization. \textit{Asymptotic Optimality:} We use an asymptotic exact piecewise approximation of the trajectory with an automatically adjustable resolution of its discretization. The trajectory converges under refinement to the first-order stationary point of the exact non-convex programming problem. Our method has additional practical advantages including joint optimality in terms of trajectory and time-allocation, and robustness to challenging environments as demonstrated in our experiments.


title: SmartTriage: A system for personalized patient data capture, documentation generation, and decision support

abstract: Symptom checkers have emerged as an important tool for collecting symptoms and diagnosing patients, minimizing the involvement of clinical personnel. We developed a machine-learning-backed system, SmartTriage, which goes beyond conventional symptom checking through a tight bi-directional integration with the electronic medical record (EMR). Conditioned on EMR-derived patient history, our system identifies the patient's chief complaint from a free-text entry and then asks a series of discrete questions to obtain relevant symptomatology. The patient-specific data are used to predict detailed ICD-10-CM codes as well as medication, laboratory, and imaging orders. Patient responses and clinical decision support (CDS) predictions are then inserted back into the EMR. To train the machine learning components of SmartTriage, we employed novel data sets of over 25 million primary care encounters and 1 million patient free-text reason-for-visit entries. These data sets were used to construct: (1) a long short-term memory (LSTM) based patient history representation, (2) a fine-tuned transformer model for chief complaint extraction, (3) a random forest model for question sequencing, and (4) a feed-forward network for CDS predictions. In total, our system supports 337 patient chief complaints, which together make up $>90\%$ of all primary care encounters at Kaiser Permanente.


title: On the Consistency of Metric and Non-Metric K-medoids

abstract: We establish the consistency of K-medoids in the context of metric spaces. We start by proving that K-medoids is asymptotically equivalent to K-means restricted to the support of the underlying distribution under general conditions, including a wide selection of loss functions. This asymptotic equivalence, in turn, enables us to apply the work of Parna (1986) on the consistency of K-means. This general approach applies also to non-metric settings where only an ordering of the dissimilarities is available. We consider two types of ordinal information: one where all quadruple comparisons are available; and one where only triple comparisons are available. We provide some numerical experiments to illustrate our theory.


title: Color Image Segmentation Metrics

abstract: An automatic image segmentation procedure is an inevitable part of many image analyses and computer vision which deeply affect the rest of the system; therefore, a set of interactive segmentation evaluation methods can substantially simplify the system development process. This entry presents the state of the art of quantitative evaluation metrics for color image segmentation methods by performing an analytical and comparative review of the measures. The decision-making process in selecting a suitable evaluation metric is still very serious because each metric tends to favor a different segmentation method for each benchmark dataset. Furthermore, a conceptual comparison of these metrics is provided at a high level of abstraction and is discussed for understanding the quantitative changes in different image segmentation results.


title: Product Manifold Learning

abstract: We consider problems of dimensionality reduction and learning data representations for continuous spaces with two or more independent degrees of freedom. Such problems occur, for example, when observing shapes with several components that move independently. Mathematically, if the parameter space of each continuous independent motion is a manifold, then their combination is known as a product manifold. In this paper, we present a new paradigm for non-linear independent component analysis called manifold factorization. Our factorization algorithm is based on spectral graph methods for manifold learning and the separability of the Laplacian operator on product spaces. Recovering the factors of a manifold yields meaningful lower-dimensional representations and provides a new way to focus on particular aspects of the data space while ignoring others. We demonstrate the potential use of our method for an important and challenging problem in structural biology: mapping the motions of proteins and other large molecules using cryo-electron microscopy datasets.


title: The Role of Robotics in Infectious Disease Crises

abstract: The recent coronavirus pandemic has highlighted the many challenges faced by the healthcare, public safety, and economic systems when confronted with a surge in patients that require intensive treatment and a population that must be quarantined or shelter in place. The most obvious and pressing challenge is taking care of acutely ill patients while managing spread of infection within the care facility, but this is just the tip of the iceberg if we consider what could be done to prepare in advance for future pandemics. Beyond the obvious need for strengthening medical knowledge and preparedness, there is a complementary need to anticipate and address the engineering challenges associated with infectious disease emergencies. Robotic technologies are inherently programmable, and robotic systems have been adapted and deployed, to some extent, in the current crisis for such purposes as transport, logistics, and disinfection. As technical capabilities advance and as the installed base of robotic systems increases in the future, they could play a much more significant role in future crises. This report is the outcome of a virtual workshop co-hosted by the National Academy of Engineering (NAE) and the Computing Community Consortium (CCC) held on July 9-10, 2020. The workshop consisted of over forty participants including representatives from the engineering/robotics community, clinicians, critical care workers, public health and safety experts, and emergency responders. It identifies key challenges faced by healthcare responders and the general population and then identifies robotic/technological responses to these challenges. Then it identifies the key research/knowledge barriers that need to be addressed in developing effective, scalable solutions. Finally, the report ends with the following recommendations on how to implement this strategy.


title: Families of polynomials of every degree with no rational preperiodic points

abstract: Let $K$ be a number field. Given a polynomial $f(x)\in K[x]$ of degree $d\ge 2$, it is conjectured that the number of preperiodic points of $f$ is bounded by a uniform bound that depends only on $d$ and $[K:\mathbb Q]$. However, the only examples of parametric families of polynomials with no preperiodic points are known when $d$ is divisible by either $2$ or $3$ and $K=\mathbb Q$. In this article, given any integer $d\ge 2$, we display infinitely many parametric families of polynomials of the form $f_t(x)=x^d+c(t)$, $c(t)\in K(t)$, with no rational preperiodic points for any $t\in K$.


title: Causal Network Motifs: Identifying Heterogeneous Spillover Effects in A/B Tests

abstract: Randomized experiments, or "A/B" tests, remain the gold standard for evaluating the causal effect of a policy intervention or product change. However, experimental settings, such as social networks, where users are interacting and influencing one another, may violate conventional assumptions of no interference for credible causal inference. Existing solutions to the network setting include accounting for the fraction or count of treated neighbors in a user's network, yet most current methods do not account for the local network structure beyond simply counting the number of neighbors. Our study provides an approach that accounts for both the local structure in a user's social network via motifs as well as the treatment assignment conditions of neighbors. We propose a two-part approach. We first introduce and employ "causal network motifs", which are network motifs that characterize the assignment conditions in local ego networks; and then we propose a tree-based algorithm for identifying different network interference conditions and estimating their average potential outcomes. Our approach can account for social network theories, such as structural diversity and echo chambers, and also can help specify network interference conditions that are suitable to each experiment. We test our method on a synthetic network setting and on a real-world experiment on a large-scale network, which highlight how accounting for local structures can better account for different interference patterns in networks.


title: Weak Solutions for Potential Mean Field Games of Controls

abstract: We analyze a system of partial differential equations that model a potential mean field game of controls, briefly MFGC. Such a game describes the interaction of infinitely many negligible players competing to optimize a personal value function that depends in aggregate on the state and, most notably, control choice of all other players. A solution of the system corresponds to a Nash Equilibrium, a group optimal strategy for which no one player can improve by altering only their own action. We investigate the second order, possibly degenerate, case with non-strictly elliptic diffusion operator and local coupling function. The main result exploits potentiality to employ variational techniques to provide a unique weak solution to the system, with additional space and time regularity results under additional assumptions. New analytical subtleties occur in obtaining a priori estimates with the introduction of an additional coupling that depends on the state distribution as well as feedback.


title: SlimSell: A Vectorizable Graph Representation for Breadth-First Search

abstract: Vectorization and GPUs will profoundly change graph processing. Traditional graph algorithms tuned for 32- or 64-bit based memory accesses will be inefficient on architectures with 512-bit wide (or larger) instruction units that are already present in the Intel Knights Landing (KNL) manycore CPU. Anticipating this shift, we propose SlimSell: a vectorizable graph representation to accelerate Breadth-First Search (BFS) based on sparse-matrix dense-vector (SpMV) products. SlimSell extends and combines the state-of-the-art SIMD-friendly Sell-C-sigma matrix storage format with tropical, real, boolean, and sel-max semiring operations. The resulting design reduces the necessary storage (by up to 50%) and thus pressure on the memory subsystem. We augment SlimSell with the SlimWork and SlimChunk schemes that reduce the amount of work and improve load balance, further accelerating BFS. We evaluate all the schemes on Intel Haswell multicore CPUs, the state-of-the-art Intel Xeon Phi KNL manycore CPUs, and NVIDIA Tesla GPUs. Our experiments indicate which semiring offers highest speedups for BFS and illustrate that SlimSell accelerates a tuned Graph500 BFS code by up to 33%. This work shows that vectorization can secure high-performance in BFS based on SpMV products; the proposed principles and designs can be extended to other graph algorithms.


title: Software Engineering Practices for Scientific Software Development: A Systematic Mapping Study

abstract: Background: The development of scientific software applications is far from trivial, due to the constant increase in the necessary complexity of these applications, their increasing size, and their need for intensive maintenance and reuse. Aim: To this end, developers of scientific software (who usually lack a formal computer science background) need to use appropriate software engineering (SE) practices. This paper describes the results of a systematic mapping study on the use of SE for scientific application development and their impact on software quality. Method: To achieve this goal we have performed a systematic mapping study on 359 papers. We first describe a catalogue of SE practices used in scientific software development. Then, we discuss the quality attributes of interest that drive the application of these practices, as well as tentative side-effects of applying the practices on qualities. Results: The main findings indicate that scientific software developers are focusing on practices that improve implementation productivity, such as code reuse, use of third-party libraries, and the application of "good" programming techniques. In addition, apart from the finding that performance is a key-driver for many of these applications, scientific software developers also find maintainability and productivity to be important. Conclusions: The results of the study are compared to existing literature, are interpreted under a software engineering prism, and various implications for researchers and practitioners are provided. One of the key findings of the study, which is considered as important for driving future research endeavors is the lack of evidence on the trade-offs that need to be made when applying a software practice, i.e., negative (indirect) effects on other quality attributes.


title: \'Equation de Pell-Abel et applications

abstract: In this paper, we show that there are solutions of every degree $r$ of the equation of Pell-Abel on some real hyperelliptic curve of genus $g$ if and only if $ r > g$. This result, which is known to the experts, has consequences, which seem to be unknown to the experts. First, we deduce the existence of a primitive $k$-differential on an hyperelliptic curve of genus $g$ with a unique zero of order $k(2g-2)$ for every $(k,g)\neq(2,2)$. Moreover, we show that there exists a non Weierstrass point of order $n$ modulo a Weierstrass point on a hyperelliptic curve of genus $g$ if and only if $n > 2g$.


title: Deep Reinforcement Learning for Adaptive Network Slicing in 5G for Intelligent Vehicular Systems and Smart Cities

abstract: Intelligent vehicular systems and smart city applications are the fastest growing Internet of things (IoT) implementations at a compound annual growth rate of 30%. In view of the recent advances in IoT devices and the emerging new breed of IoT applications driven by artificial intelligence (AI), fog radio access network (F-RAN) has been recently introduced for the fifth generation (5G) wireless communications to overcome the latency limitations of cloud-RAN (C-RAN). We consider the network slicing problem of allocating the limited resources at the network edge (fog nodes) to vehicular and smart city users with heterogeneous latency and computing demands in dynamic environments. We develop a network slicing model based on a cluster of fog nodes (FNs) coordinated with an edge controller (EC) to efficiently utilize the limited resources at the network edge. For each service request in a cluster, the EC decides which FN to execute the task, i.e., locally serve the request at the edge, or to reject the task and refer it to the cloud. We formulate the problem as infinite-horizon Markov decision process (MDP) and propose a deep reinforcement learning (DRL) solution to adaptively learn the optimal slicing policy. The performance of the proposed DRL-based slicing method is evaluated by comparing it with other slicing approaches in dynamic environments and for different scenarios of design objectives. Comprehensive simulation results corroborate that the proposed DRL-based EC quickly learns the optimal policy through interaction with the environment, which enables adaptive and automated network slicing for efficient resource allocation in dynamic vehicular and smart city environments.


title: Electronic properties of substitutional impurities in graphene-like C$_2$N, $tg$-C$_3$N$_4$, and $hg$-C$_3$N$_4$

abstract: We study the electronic and structural properties of substitutional impurities of graphenelike nanoporous materials C$_2$N, $tg$-, and $hg$-C$_3$N$_4$ by means of density functional theory calculations. We consider four types of impurities; boron substitution on carbon sites (B(C)), carbon substitution on nitrogen sites (C(N)), nitrogen substitution on carbon sites (N(C)), and sulfur substitution on nitrogen sites (S(N)). From cohesive energy calculations, we find that the C(N) and B(C) substitutions are the most energetically favorable and induce small bond modifications in the vicinity of the impurity, while the S(N) induces strong lattice distortions. Though all of the studied impurities induce defect levels inside the band gap of these materials, their electronic properties are poles apart depending on the behavior of the impurity as an acceptor or a donor. It is also observed that acceptor (donor) wavefunctions are composed only of $\sigma$ ($\pi$) orbitals from the impurity itself and/or neighboring sites. Consequently, acceptor wavefunctions are directed towards the pores and donor wavefunctions are more extended throughout the neighboring atoms, a property that could further be explored to modify the interaction between these materials and adsorbates. Moreover, impurity properties display a strong site sensitivity and ground state binding energies ranging from $0.03$ to $1.13$ eV, thus offering an interesting route for tuning the optical properties of these materials. Finally, spin-polarized calculations reveal that all impurity configurations have a magnetic ground state that rises from the spin splitting of the impurity levels. In a few configurations, more than one impurity level can be found inside the gap and two of them could potentially be explored as two-level systems for single-photon emission, following similar proposals recently made on defect complexes on TMDCs.


title: Dynamics of a homogeneous and isotropic space in pure cubic f(R) gravity

abstract: We consider a possible ways of the dynamics of a homogeneous and isotropic space described by the FLRW metric in the framework of cubic f(R) gravity in the absence of matter. This article points an method for limiting the parameters of extended gravity models. We propose and develop a method for f(R) gravity models based on the dynamics of metrics for various model parameters in the simplest example. The influence of parameters and initial conditions on further dynamics are discussed. The parameters can be limited by 1) slow growth of space, 2) instability, 3) divergence with the inflationary scenario.


title: Optimal Decision Lists using SAT

abstract: Decision lists are one of the most easily explainable machine learning models. Given the renewed emphasis on explainable machine learning decisions, this machine learning model is increasingly attractive, combining small size and clear explainability. In this paper, we show for the first time how to construct optimal "perfect" decision lists which are perfectly accurate on the training data, and minimal in size, making use of modern SAT solving technology. We also give a new method for determining optimal sparse decision lists, which trade off size and accuracy. We contrast the size and test accuracy of optimal decisions lists versus optimal decision sets, as well as other state-of-the-art methods for determining optimal decision lists. We also examine the size of average explanations generated by decision sets and decision lists.


title: Optimality vs Stability Trade-off in Ensemble Kalman Filters

abstract: This paper is concerned with optimality and stability analysis of a family of ensemble Kalman filter (EnKF) algorithms. EnKF is commonly used as an alternative to the Kalman filter for high-dimensional problems, where storing the covariance matrix is computationally expensive. The algorithm consists of an ensemble of interacting particles driven by a feedback control law. The control law is designed such that, in the linear Gaussian setting and asymptotic limit of infinitely many particles, the mean and covariance of the particles follow the exact mean and covariance of the Kalman filter. The problem of finding a control law that is exact does not have a unique solution, reminiscent of the problem of finding a transport map between two distributions. A unique control law can be identified by introducing control cost functions, that are motivated by the optimal transportation problem or Schr\"odinger bridge problem. The objective of this paper is to study the relationship between optimality and long-term stability of a family of exact control laws. Remarkably, the control law that is optimal in the optimal transportation sense leads to an EnKF algorithm that is not stable.


title: Sufficient dimension reduction for classification using principal optimal transport direction

abstract: Sufficient dimension reduction is used pervasively as a supervised dimension reduction approach. Most existing sufficient dimension reduction methods are developed for data with a continuous response and may have an unsatisfactory performance for the categorical response, especially for the binary-response. To address this issue, we propose a novel estimation method of sufficient dimension reduction subspace (SDR subspace) using optimal transport. The proposed method, named principal optimal transport direction (POTD), estimates the basis of the SDR subspace using the principal directions of the optimal transport coupling between the data respecting different response categories. The proposed method also reveals the relationship among three seemingly irrelevant topics, i.e., sufficient dimension reduction, support vector machine, and optimal transport. We study the asymptotic properties of POTD and show that in the cases when the class labels contain no error, POTD estimates the SDR subspace exclusively. Empirical studies show POTD outperforms most of the state-of-the-art linear dimension reduction methods.


title: Causal Inference for Nonlinear Outcome Models with Possibly Invalid Instrumental Variables

abstract: Instrumental variable methods are widely used for inferring the causal effect in the presence of unmeasured confounders. Existing instrumental variable methods for nonlinear outcome models require stringent identifiability conditions. This paper considers a flexible semi-parametric potential outcome model that allows for possibly invalid instruments. We propose new identifiability conditions to identify the causal parameters when the majority of the instrumental variables are valid. We devise a novel inference procedure for a new average structural function and the conditional average treatment effect. We establish the asymptotic normality of the proposed estimators and construct confidence intervals for the causal estimands by bootstrap. The proposed method is demonstrated in large-scale simulation studies and is applied to infer the effect of income on house ownership.


title: Anti-Distillation: Improving reproducibility of deep networks

abstract: Deep networks have been revolutionary in improving performance of machine learning and artificial intelligence systems. Their high prediction accuracy, however, comes at a price of \emph{model irreproducibility\/} in very high levels that do not occur with classical linear models. Two models, even if they are supposedly identical, with identical architecture and identical trained parameter sets, and that are trained on the same set of training examples, while possibly providing identical average prediction accuracies, may predict very differently on individual, previously unseen, examples. \emph{Prediction differences\/} may be as large as the order of magnitude of the predictions themselves. Ensembles have been shown to somewhat mitigate this behavior, but without an extra push, may not be utilizing their full potential. In this work, a novel approach, \emph{Anti-Distillation\/}, is proposed to address irreproducibility in deep networks, where ensemble models are used to generate predictions. Anti-Distillation forces ensemble components away from one another by techniques like de-correlating their outputs over mini-batches of examples, forcing them to become even more different and more diverse. Doing so enhances the benefit of ensembles, making the final predictions more reproducible. Empirical results demonstrate substantial prediction difference reductions achieved by Anti-Distillation on benchmark and real datasets.


title: Observations of Pressure Anisotropy Effects within Semi-Collisional Magnetized-Plasma Bubbles

abstract: Magnetized plasma interactions are ubiquitous in astrophysical and laboratory plasmas. Various physical effects have been shown to be important within colliding plasma flows influenced by opposing magnetic fields, however, experimental verification of the mechanisms within the interaction region has remained elusive. Here we discuss a laser-plasma experiment whereby experimental results verify that Biermann battery generated magnetic fields are advected by Nernst flows and anisotropic pressure effects dominate these flows in a reconnection region. These fields are mapped using time-resolved proton probing in multiple directions. Various experimental, modelling and analytical techniques demonstrate the importance of anisotropic pressure in semi-collisional, high-$\beta$ plasmas, causing a reduction in the magnitude of the reconnecting fields when compared to resistive processes. Anisotropic pressure dynamics are crucial in collisionless plasmas, but are often neglected in collisional plasmas. We show pressure anisotropy to be essential in maintaining the interaction layer, redistributing magnetic fields even for semi-collisional, high energy density physics (HEDP) regimes


title: Hierarchical Paired Channel Fusion Network for Street Scene Change Detection

abstract: Street Scene Change Detection (SSCD) aims to locate the changed regions between a given street-view image pair captured at different times, which is an important yet challenging task in the computer vision community. The intuitive way to solve the SSCD task is to fuse the extracted image feature pairs, and then directly measure the dissimilarity parts for producing a change map. Therefore, the key for the SSCD task is to design an effective feature fusion method that can improve the accuracy of the corresponding change maps. To this end, we present a novel Hierarchical Paired Channel Fusion Network (HPCFNet), which utilizes the adaptive fusion of paired feature channels. Specifically, the features of a given image pair are jointly extracted by a Siamese Convolutional Neural Network (SCNN) and hierarchically combined by exploring the fusion of channel pairs at multiple feature levels. In addition, based on the observation that the distribution of scene changes is diverse, we further propose a Multi-Part Feature Learning (MPFL) strategy to detect diverse changes. Based on the MPFL strategy, our framework achieves a novel approach to adapt to the scale and location diversities of the scene change regions. Extensive experiments on three public datasets (i.e., PCD, VL-CMU-CD and CDnet2014) demonstrate that the proposed framework achieves superior performance which outperforms other state-of-the-art methods with a considerable margin.


title: Explainable Automated Fact-Checking for Public Health Claims

abstract: Fact-checking is the task of verifying the veracity of claims by assessing their assertions against credible evidence. The vast majority of fact-checking studies focus exclusively on political claims. Very little research explores fact-checking for other topics, specifically subject matters for which expertise is required. We present the first study of explainable fact-checking for claims which require specific expertise. For our case study we choose the setting of public health. To support this case study we construct a new dataset PUBHEALTH of 11.8K claims accompanied by journalist crafted, gold standard explanations (i.e., judgments) to support the fact-check labels for claims. We explore two tasks: veracity prediction and explanation generation. We also define and evaluate, with humans and computationally, three coherence properties of explanation quality. Our results indicate that, by training on in-domain data, gains can be made in explainable, automated fact-checking for claims which require specific expertise.


title: ColloQL: Robust Cross-Domain Text-to-SQL Over Search Queries

abstract: Translating natural language utterances to executable queries is a helpful technique in making the vast amount of data stored in relational databases accessible to a wider range of non-tech-savvy end users. Prior work in this area has largely focused on textual input that is linguistically correct and semantically unambiguous. However, real-world user queries are often succinct, colloquial, and noisy, resembling the input of a search engine. In this work, we introduce data augmentation techniques and a sampling-based content-aware BERT model (ColloQL) to achieve robust text-to-SQL modeling over natural language search (NLS) questions. Due to the lack of evaluation data, we curate a new dataset of NLS questions and demonstrate the efficacy of our approach. ColloQL's superior performance extends to well-formed text, achieving 84.9% (logical) and 90.7% (execution) accuracy on the WikiSQL dataset, making it, to the best of our knowledge, the highest performing model that does not use execution guided decoding.


title: Disjoining Pressure of Water in Nanochannels

abstract: Experiments of water wicking in 1D silicon-dioxide nanochannels of heights 59 nm, 87 nm, 124 nm and 1015 nm are used to estimate the disjoining pressure of water which was found to be as high as ~1.5 MPa while exponentially decreasing with increasing channel height. Such a relation resulting from curve fitting of experimentally-derived data was implemented and validated in computational fluid dynamics. This methodology integrates experimental nanoscale physics into continuum simulations thus enabling the numerical study of various phenomena where disjoining pressure plays an important role.


title: On the Sample Complexity of Privately Learning Unbounded High-Dimensional Gaussians

abstract: We provide sample complexity upper bounds for agnostically learning multivariate Gaussians under the constraint of approximate differential privacy. These are the first finite sample upper bounds for general Gaussians which do not impose restrictions on the parameters of the distribution. Our bounds are near-optimal in the case when the covariance is known to be the identity, and conjectured to be near-optimal in the general case. From a technical standpoint, we provide analytic tools for arguing the existence of global "locally small" covers from local covers of the space. These are exploited using modifications of recent techniques for differentially private hypothesis selection. Our techniques may prove useful for privately learning other distribution classes which do not possess a finite cover.


title: BIRD: Big Impulse Response Dataset

abstract: This paper introduces BIRD, the Big Impulse Response Dataset. This open dataset consists of 100,000 multichannel room impulse responses (RIRs) generated from simulations using the Image Method, making it the largest multichannel open dataset currently available. These RIRs can be used toperform efficient online data augmentation for scenarios that involve two microphones and multiple sound sources. The paper also introduces use cases to illustrate how BIRD can perform data augmentation with existing speech corpora.


title: Smooth activations and reproducibility in deep networks

abstract: Deep networks are gradually penetrating almost every domain in our lives due to their amazing success. However, with substantive performance accuracy improvements comes the price of \emph{irreproducibility}. Two identical models, trained on the exact same training dataset may exhibit large differences in predictions on individual examples even when average accuracy is similar, especially when trained on highly distributed parallel systems. The popular Rectified Linear Unit (ReLU) activation has been key to recent success of deep networks. We demonstrate, however, that ReLU is also a catalyzer to irreproducibility in deep networks. We show that not only can activations smoother than ReLU provide better accuracy, but they can also provide better accuracy-reproducibility tradeoffs. We propose a new family of activations; Smooth ReLU (\emph{SmeLU}), designed to give such better tradeoffs, while also keeping the mathematical expression simple, and thus implementation cheap. SmeLU is monotonic, mimics ReLU, while providing continuous gradients, yielding better reproducibility. We generalize SmeLU to give even more flexibility and then demonstrate that SmeLU and its generalized form are special cases of a more general methodology of REctified Smooth Continuous Unit (RESCU) activations. Empirical results demonstrate the superior accuracy-reproducibility tradeoffs with smooth activations, SmeLU in particular.


title: Overlapping neural representations for the position of visible and imagined objects

abstract: Humans can covertly track the position of an object, even if the object is temporarily occluded. What are the neural mechanisms underlying our capacity to track moving objects when there is no physical stimulus for the brain to track? One possibility is that the brain 'fills-in' information about imagined objects using internally generated representations similar to those generated by feed-forward perceptual mechanisms. Alternatively, the brain might deploy a higher order mechanism, for example using an object tracking model that integrates visual signals and motion dynamics. In the present study, we used EEG and time-resolved multivariate pattern analyses to investigate the spatial processing of visible and imagined objects. Participants tracked an object that moved in discrete steps around fixation, occupying six consecutive locations. They were asked to imagine that the object continued on the same trajectory after it disappeared and move their attention to the corresponding positions. Time-resolved decoding of EEG data revealed that the location of the visible stimuli could be decoded shortly after image onset, consistent with early retinotopic visual processes. For processing of unseen/imagined positions, the patterns of neural activity resembled stimulus-driven mid-level visual processes, but were detected earlier than perceptual mechanisms, implicating an anticipatory and more variable tracking mechanism. Encoding models revealed that spatial representations were much weaker for imagined than visible stimuli. Monitoring the position of imagined objects thus utilises similar perceptual and attentional processes as monitoring objects that are actually present, but with different temporal dynamics. These results indicate that internally generated representations rely on top-down processes, and their timing is influenced by the predictability of the stimulus.


title: Proximal Policy Gradient: PPO with Policy Gradient

abstract: In this paper, we propose a new algorithm PPG (Proximal Policy Gradient), which is close to both VPG (vanilla policy gradient) and PPO (proximal policy optimization). The PPG objective is a partial variation of the VPG objective and the gradient of the PPG objective is exactly same as the gradient of the VPG objective. To increase the number of policy update iterations, we introduce the advantage-policy plane and design a new clipping strategy. We perform experiments in OpenAI Gym and Bullet robotics environments for ten random seeds. The performance of PPG is comparable to PPO, and the entropy decays slower than PPG. Thus we show that performance similar to PPO can be obtained by using the gradient formula from the original policy gradient theorem.


title: Enhancing Keyphrase Extraction from Microblogs using Human Reading Time

abstract: The premise of manual keyphrase annotation is to read the corresponding content of an annotated object. Intuitively, when we read, more important words will occupy a longer reading time. Hence, by leveraging human reading time, we can find the salient words in the corresponding content. However, previous studies on keyphrase extraction ignore human reading features. In this article, we aim to leverage human reading time to extract keyphrases from microblog posts. There are two main tasks in this study. One is to determine how to measure the time spent by a human on reading a word. We use eye fixation durations extracted from an open source eye-tracking corpus (OSEC). Moreover, we propose strategies to make eye fixation duration more effective on keyphrase extraction. The other task is to determine how to integrate human reading time into keyphrase extraction models. We propose two novel neural network models. The first is a model in which the human reading time is used as the ground truth of the attention mechanism. In the second model, we use human reading time as the external feature. Quantitative and qualitative experiments show that our proposed models yield better performance than the baseline models on two microblog datasets.


title: Cue Me In: Content-Inducing Approaches to Interactive Story Generation

abstract: Automatically generating stories is a challenging problem that requires producing causally related and logical sequences of events about a topic. Previous approaches in this domain have focused largely on one-shot generation, where a language model outputs a complete story based on limited initial input from a user. Here, we instead focus on the task of interactive story generation, where the user provides the model mid-level sentence abstractions in the form of cue phrases during the generation process. This provides an interface for human users to guide the story generation. We present two content-inducing approaches to effectively incorporate this additional information. Experimental results from both automatic and human evaluations show that these methods produce more topically coherent and personalized stories compared to baseline methods.


title: Unsupervised Selective Manifold Regularized Matrix Factorization

abstract: Manifold regularization methods for matrix factorization rely on the cluster assumption, whereby the neighborhood structure of data in the input space is preserved in the factorization space. We argue that using the k-neighborhoods of all data points as regularization constraints can negatively affect the quality of the factorization, and propose an unsupervised and selective regularized matrix factorization algorithm to tackle this problem. Our approach jointly learns a sparse set of representatives and their neighbor affinities, and the data factorization. We further propose a fast approximation of our approach by relaxing the selectivity constraints on the data. Our proposed algorithms are competitive against baselines and state-of-the-art manifold regularization and clustering algorithms.


title: Estimating and backtesting risk under heavy tails

abstract: While the {estimation} of risk is an important question in the daily business of banking and insurance, many existing plug-in estimation procedures suffer from an unnecessary bias. This often leads to the underestimation of risk and negatively impacts backtesting results, especially in small sample cases. In this article we show that the link between estimation bias and backtesting can be traced back to the dual relationship between risk measures and the corresponding performance measures, and discuss this in reference to value-at-risk, expected shortfall and expectile value-at-risk. Motivated by the consistent underestimation of risk by plug-in procedures, we propose a new algorithm for bias correction and show how to apply it for generalized Pareto distributions to the i.i.d. setting and to a GARCH(1,1) time series. In particular, we show that the application of our algorithm leads to gain in efficiency when heavy tails or heteroscedasticity exists in the data.


title: Early Detection of Sepsis using Ensemblers

abstract: This paper describes a methodology to detect sepsis ahead of time by analyzing hourly patient records. The Physionet 2019 challenge consists of medical records of over 40,000 patients. Using imputation and weak ensembler technique to analyze these medical records and 3-fold validation, a model is created and validated internally. The model achieved an accuracy of 93.45% and a utility score of 0.271. The utility score as defined by the organizers takes into account true positives, negatives and false alarms.


title: Generally Applicable Formalism for Modeling the Observable Signatures of Inflows, Outflows, and Moving Coronal Plasma Close to Kerr Black Holes

abstract: We present a generally applicable formalism for modeling the emission, absorption, reflection, and reprocessing of radiation by moving plasma streams close to a Kerr Black hole. The formalism can be used to investigate the observational signatures of a wide range of phenomena, including: (i) the reflection of coronal X-ray radiation off plasma plunging from the inner edge of a black hole accretion disk towards the black hole; (ii) the reflection of coronal X-ray emission off the upper layers of a geometrically thick accretion flow; (iii) the illumination of the accretion disk by a corona moving with relativistic velocities towards or away from the accretion disk; (iv) the emission from a jet forming close to the black hole. After introducing the general relativistic treatment, we show the results for a fast wind forming close to a Kerr black hole. The approach presented here can be used to model X-ray spectral, timing, reverberation, and polarization data.


title: Autonomous Scheduling of Agile Spacecraft Constellations with Delay Tolerant Networking for Reactive Imaging

abstract: Small spacecraft now have precise attitude control systems available commercially, allowing them to slew in 3 degrees of freedom, and capture images within short notice. When combined with appropriate software, this agility can significantly increase response rate, revisit time and coverage. In prior work, we have demonstrated an algorithmic framework that combines orbital mechanics, attitude control and scheduling optimization to plan the time-varying, full-body orientation of agile, small spacecraft in a constellation. The proposed schedule optimization would run at the ground station autonomously, and the resultant schedules uplinked to the spacecraft for execution. The algorithm is generalizable over small steerable spacecraft, control capability, sensor specs, imaging requirements, and regions of interest. In this article, we modify the algorithm to run onboard small spacecraft, such that the constellation can make time-sensitive decisions to slew and capture images autonomously, without ground control. We have developed a communication module based on Delay/Disruption Tolerant Networking (DTN) for onboard data management and routing among the satellites, which will work in conjunction with the other modules to optimize the schedule of agile communication and steering. We then apply this preliminary framework on representative constellations to simulate targeted measurements of episodic precipitation events and subsequent urban floods. The command and control efficiency of our agile algorithm is compared to non-agile (11.3x improvement) and non-DTN (21% improvement) constellations.


title: Multiple-view clustering for identifying subject clusters and brain sub-networks using functional connectivity matrices without vectorization

abstract: In neuroscience, the functional magnetic resonance imaging (fMRI) is a vital tool to non-invasively access brain activity. Using fMRI, the functional connectivity (FC) between brain regions can be inferred, which has contributed to a number of findings of the fundamental properties of the brain. As an important clinical application of FC, clustering of subjects based on FC recently draws much attention, which can potentially reveal important heterogeneity in subjects such as subtypes of psychiatric disorders. In particular, a multiple-view clustering method is a powerful analytical tool, which identifies clustering patterns of subjects depending on their FC in specific brain areas. However, when one applies an existing multiple-view clustering method to fMRI data, there is a need to simplify the data structure, independently dealing with elements in a FC matrix, i.e., vectorizing a correlation matrix. Such a simplification may distort the clustering results. To overcome this problem, we propose a novel multiple-view clustering method based on Wishart mixture models, which preserves the correlation matrix structure without vectorization. The uniqueness of this method is that the multiple-view clustering of subjects is based on particular networks of nodes (or regions of interest, ROIs), optimized in a data-driven manner. Hence, it can identify multiple underlying pairs of associations between a subject cluster solution and a ROI sub-network. The key assumption of the method is independence among sub-networks, which is effectively addressed by whitening correlation matrices. We applied the proposed method to synthetic and fMRI data, demonstrating the usefulness and power of the proposed method.


title: Approximating Quasi-Stationary Distributions with Interacting Reinforced Random Walks

abstract: We propose two numerical schemes for approximating quasi-stationary distributions (QSD) of finite state Markov chains with absorbing states. Both schemes are described in terms of certain interacting chains in which the interaction is given in terms of the total time occupation measure of all particles in the system and has the impact of reinforcing transitions, in an appropriate fashion, to states where the collection of particles has spent more time. The schemes can be viewed as combining the key features of the two basic simulation-based methods for approximating QSD originating from the works of Fleming and Viot (1979) and Aldous, Flannery and Palacios (1998), respectively. The key difference between the two schemes studied here is that in the first method one starts with $a(n)$ particles at time $0$ and number of particles stays constant over time whereas in the second method we start with one particle and at most one particle is added at each time instant in such a manner that there are $a(n)$ particles at time $n$. We prove almost sure convergence to the unique QSD and establish Central Limit Theorems for the two schemes under the key assumption that $a(n)=o(n)$. When $a(n)\sim n$, the fluctuation behavior is expected to be non-standard. Some exploratory numerical results are presented to illustrate the performance of the two approximation schemes.


title: A High Accuracy Electrical Stopping Power Prediction Model based on Deep Learning Algorithm and its Applications

abstract: Energy loss of energetic ions in solid is crucial in many field, and accurate prediction of the ion stopping power is a long-time goal. Though great efforts have been made, it is still very difficult to find a universal prediction model to accurately calculate the ion stopping power in distinct target materials. Deep learning algorithm is a newly emerged method to solve multi-factors physical problems and can mine the deeply implicit relations among parameters, which make it a powerful tool in energy loss prediction. In this work, we developed an energy loss prediction model based on deep learning. When experimental data are available, our model can give predictions with an average absolute difference close to 5.7%, which is in the same level compared with other widely used programs e.g. SRIM. In the regime without experimental data, our model still can maintain a high performance, and has higher reliability compared with the existing models. The ion range of Au ions in SiC can be calculated with a relative error of 0.6~25% for ions in the energy range of 700~10'000 keV, which is much better than the results calculated by SRIM. Moreover, our model support the reciprocity conjecture of ion stopping power in solid proposed by P. Sigmund, which has been known for a long time but can hardly been proved by any of the existing stopping power models. This high-accuracy energy loss prediction model is very important for the research of ion-solid interaction mechanism and enormous relevant applications of energetic ions, such as in semiconductor fabrications, nuclear energy systems and the space facilities.


title: Evolution of the quantized field coupled to a thermal bath: a phase space approach

abstract: We present an alternative method for describing the evolution of a mode of the quantized electromagnetic field in contact with a finite temperature thermal bath. We use the expansion of the field density operator in terms of coherent states and the related Glauber-Sudarshan $P$-function in phase space. The method allows us to obtain analytical expressions of the system's time-evolved $P$-function without needing to solve the corresponding master equation.


title: Valley Modulation and Single-Edge Transport of Magnons in Staggered Kagome Ferromagnets

abstract: Owing to its charge-free property, magnon is highly promising to achieve dissipationless transport without Joule heating and thus potentially applicable to energy-efficient devices. Moreover, a kagome lattice, as stacking layers of many magnon ferromagnets, also exhibits valley structure in quasiparticle spectra, which are likely to add a new dimension to magnon excitation. Here, we investigate valley magnon and associated valley modulation in a kagome lattice, with staggered exchange interaction and Dzyaloshinskii-Moriya interaction. The staggered exchange interaction breaks spatial inversion symmetry, leading to gapped degenerate valleys at $\pm K$ and consequent valley magnon Hall effect. When the Dzyaloshinskii-Moriya interaction is further included, the valley degeneracy is lifted. As a result, net magnon anomalous Hall effect and topological phase transition are realized. More interestingly, by tuning valley splitting and excitation frequency, heat currents in the kagome strip can be localized at one edge to achieve single-edge transport. Besides, for the kagmon lattice, the edge heat currents include local circulating contribution within triangular fine structure, together with currents flowing parallel to the edges. These findings give full play to spin and valley degrees of freedom and enrich energy-efficient magnonic device paradigms.


title: Planning a Reference Constellation for Radiometric Cross-Calibration of Commercial Earth Observing Sensors

abstract: The Earth Observation planning community has access to tools that can propagate orbits and compute coverage of Earth observing imagers with customizable shapes and orientation, model the expected Earth Reflectance at various bands, epochs and directions, generate simplified instrument performance metrics for imagers and radars, and schedule single and multiple spacecraft payload operations. We are working toward integrating existing tools to design a planner that allows commercial small spacecraft to assess the opportunities for cross-calibration of their sensors against current satellite to be calibrated, specifications of the reference instruments, sensor stability, allowable latency between calibration measurements, differences in viewing and solar geometry between calibration measurements, etc. The planner would output cross-calibration opportunities for every reference target pair as a function of flexible user-defined parameters. We use a preliminary version of this planner to inform the design of a constellation of transfer radiometers that can serve as stable, radiometric references for commercial sensors to cross-calibrate with. We propose such a constellation for either vicarious cross-calibration using pre-selected sites, or top of the atmosphere (TOA) cross-calibration globally. Results from the calibration planner applied to a subset of informed architecture designs show that a 4 sat constellation provides multiple calibration opportunities within half a day planning horizon, for Cubesat sensors deployed into a typical rideshare orbits. While such opportunities are available for cross calibration image pairs within 5 deg of solar or view directions, and with-in an hour (for TOA) and less than a day (vicariously), the planner allows us to identify many more by relaxing user-defined restrictions.


title: Use of neural networks for stable, accurate and physically consistent parameterization of subgrid atmospheric processes with good performance at reduced precision

abstract: A promising approach to improve climate-model simulations is to replace traditional subgrid parameterizations based on simplified physical models by machine learning algorithms that are data-driven. However, neural networks (NNs) often lead to instabilities and climate drift when coupled to an atmospheric model. Here we learn an NN parameterization from a high-resolution atmospheric simulation in an idealized domain by coarse graining the model equations and output. The NN parameterization has a structure that ensures physical constraints are respected, and it leads to stable simulations that replicate the climate of the high-resolution simulation with similar accuracy to a successful random-forest parameterization while needing far less memory. We find that the simulations are stable for a variety of NN architectures and horizontal resolutions, and that an NN with substantially reduced numerical precision could decrease computational costs without affecting the quality of simulations.


title: Object Permanence Through Audio-Visual Representations

abstract: As robots perform manipulation tasks and interact with objects, it is probable that they accidentally drop objects (e.g., due to an inadequate grasp of an unfamiliar object) that subsequently bounce out of their visual fields. To enable robots to recover from such errors, we draw upon the concept of object permanence-objects remain in existence even when they are not being sensed (e.g., seen) directly. In particular, we developed a multimodal neural network model-using a partial, observed bounce trajectory and the audio resulting from drop impact as its inputs-to predict the full bounce trajectory and the end location of a dropped object. We empirically show that: 1) our multimodal method predicted end locations close in proximity (i.e., within the visual field of the robot's wrist camera) to the actual locations and 2) the robot was able to retrieve dropped objects by applying minimal vision-based pick-up adjustments. Additionally, we show that our method outperformed five comparison baselines in retrieving dropped objects. Our results contribute to enabling object permanence for robots and error recovery from object drops.


title: The capability of the Australian Square Kilometre Array Pathfinder to detect prompt radio bursts from neutron star mergers

abstract: We discuss observational strategies to detect prompt bursts associated with gravitational wave events using the Australian Square Kilometre Array Pathfinder (ASKAP). Many theoretical models of binary neutron stars mergers predict that bright, prompt radio emission would accompany the merger. The detection of such prompt emission would greatly improve our knowledge of the physical conditions, environment, and location of the merger. However, searches for prompt emission are complicated by the relatively poor localisation for gravitational wave events, with the 90\% credible region reaching hundreds or even thousands of square degrees. Operating in fly's eye mode, the ASKAP field of view can reach $\sim$1000 deg$^2$ at $\sim 888\,{\rm MHz}$. This potentially allows observers to cover most of the 90\% credible region quickly enough to detect prompt emission. We use skymaps for GW170817 and GW190814 from LIGO/Virgo's third observing run to simulate the probability of detecting prompt emission for gravitational wave events in the upcoming fourth observing run. With only alerts released after merger we find it difficult to slew the telescope sufficiently quickly as to capture any prompt emission. However, with the addition of alerts released \textit{before} merger by negative-latency pipelines we find that it should be possible to search for nearby, bright prompt FRB-like emission from gravitational wave events. Nonetheless, the rates are low: we would expect to observe $\sim$0.012 events during the fourth observing run, assuming that the prompt emission is emitted microseconds around the merger


title: Probabilistic Character Motion Synthesis using a Hierarchical Deep Latent Variable Model

abstract: We present a probabilistic framework to generate character animations based on weak control signals, such that the synthesized motions are realistic while retaining the stochastic nature of human movement. The proposed architecture, which is designed as a hierarchical recurrent model, maps each sub-sequence of motions into a stochastic latent code using a variational autoencoder extended over the temporal domain. We also propose an objective function which respects the impact of each joint on the pose and compares the joint angles based on angular distance. We use two novel quantitative protocols and human qualitative assessment to demonstrate the ability of our model to generate convincing and diverse periodic and non-periodic motion sequences without the need for strong control signals.


title: Metrics for Aerial, Urban LiDAR Point Clouds

abstract: This paper introduces five new density and accuracy metrics for aerial point clouds that address the complexity and objectives of modern, dense laser scans of urban scenes. The five metrics describe (1) vertical surface density (points per area on vertical surfaces); (2) vertical density as a function of horizontal density; (3) vertical surface accuracy; and a decomposition of error into (4) within-pass and (5) cross-pass components. Specifically considered is vertical surface coverage and the practice of overlapping flight passes to reduce the occlusions and achieve the vertical density needed for twenty-first-century use cases (e.g. curb and window detection). The application of these metrics to a quartet of recent urban flyovers demonstrates their relevance by establishing (1) the efficacy of considering sensor position and wall height when predicting point density on vertical surfaces; (2) that cross-pass registration accounts for a disproportionate amount of the vertical surface error (but not horizontal) and provides a meaningful parameter to compare high-density, urban point clouds; and (3) that compared to horizontal density and accuracy, the vertical counterparts are disproportionately impacted (positively for density and negatively for accuracy) by modern, optimized flight missions.


title: Sampling Theory of Bandlimited Continuous-Time Graph Signals

abstract: A continuous-time graph signal can be viewed as a time series of graph signals. It generalizes both the classical continuous-time signal and ordinary graph signal. Therefore, such a signal can be considered as a function on two domains: the graph domain and the time domain. In this paper, we consider the sampling theory of bandlimited continuous-time graph signals. To formulate the sampling problem, we need to consider the interaction between the graph and time domains. We describe an explicit procedure to determine a discrete sampling set for perfect signal recovery. Moreover, in analogous to the Nyquist-Shannon sampling theorem, we give an explicit formula for the minimal sample rate.


title: Region-specific Dictionary Learning-based Low-dose Thoracic CT Reconstruction

abstract: This paper presents a dictionary learning-based method with region-specific image patches to maximize the utility of the powerful sparse data processing technique for CT image reconstruction. Considering heterogeneous distributions of image features and noise in CT, region-specific customization of dictionaries is utilized in iterative reconstruction. Thoracic CT images are partitioned into several regions according to their structural and noise characteristics. Dictionaries specific to each region are then learned from the segmented thoracic CT images and applied to subsequent image reconstruction of the region. Parameters for dictionary learning and sparse representation are determined according to the structural and noise properties of each region. The proposed method results in better performance than the conventional reconstruction based on a single dictionary in recovering structures and suppressing noise in both simulation and human CT imaging. Quantitatively, the simulation study shows maximum improvement of image quality for the whole thorax can achieve 4.88% and 11.1% in terms of the Structure-SIMilarity (SSIM) and Root-Mean-Square Error (RMSE) indices, respectively. For human imaging data, it is found that the structures in the lungs and heart can be better recovered, while simultaneously decreasing noise around the vertebra effectively. The proposed strategy takes into account inherent regional differences inside of the reconstructed object and leads to improved images. The method can be readily extended to CT imaging of other anatomical regions and other applications.


title: Improving Dialog Systems for Negotiation with Personality Modeling

abstract: In this paper, we explore the ability to model and infer personality types of opponents, predict their responses, and use this information to adapt a dialog agent's high-level strategy in negotiation tasks. Inspired by the idea of incorporating a theory of mind (ToM) into machines, we introduce a probabilistic formulation to encapsulate the opponent's personality type during both learning and inference. We test our approach on the CraigslistBargain dataset and show that our method using ToM inference achieves a 20% higher dialog agreement rate compared to baselines on a mixed population of opponents. We also find that our model displays diverse negotiation behavior with different types of opponents.


title: Charge-dependent transverse momentum and its impact on the search for the chiral magnetic wave

abstract: The chiral magnetic wave (CMW) is sought using the charge asymmetry ($A_{\rm ch}$) dependence of anisotropic flow in heavy-ion collisions. The charge dependent transverse momentum ($p_{\rm T}$), however, could play a role as a background. With the string fragmentation models, including PYTHIA, we demonstrate the origin of the $A_{\rm ch}-p_{\rm T}$ correlation and its connection with the local charge conservation (LCC). The impact of $A_{\rm ch}-p_{\rm T}$ and its behavior in varied kinematic windows are also discussed. This study provides more insights for the search for the CMW and comprehending the collective motion of the quark-gluon plasma.


title: Total reaction cross section on a deuteron target and the eclipse effect of the constituent neutron and proton

abstract: Background: Eclipse effect of the neutron and proton in a deuteron target is essential to correctly describe high-energy deuteron scattering. The nucleus-deuteron scattering needs information not only on the nucleus-proton but also the nucleus-neutron interaction, for which no direct measurement of the nucleus-neutron cross sections is available for unstable nuclei. Purpose: We systematically evaluated the total reaction cross sections by a deuteron target to explore the feasibility of extracting the nucleus-neutron interaction from measurable cross sections. Methods: High-energy nucleus-deuteron collision is described by the Glauber model, in which the proton and neutron configuration of the deuteron is explicitly taken into account. Results: Our calculation reproduces available experimental total reaction cross section data on the nucleus-deuteron scattering. The possibility of extracting the nucleus-neutron total reaction cross section from nucleus-deuteron and nucleus-proton total reaction cross sections is explored. The total reaction cross sections of a nucleus by proton, neutron, and deuteron targets can be expressed, to good accuracy, in terms of the nuclear matter radius and neutron skin thickness. Incident-energy dependence of the total reaction cross sections is examined. Conclusions: The total reaction cross section on a deuteron target includes information on both the nucleus-neutron and nucleus-proton profile functions. Measuring the cross sections by deuteron and proton targets is a promising tool to extract the nuclear size properties.


title: Implications of a non-zero Poynting flux at infinity sans radiation reaction for a uniformly accelerated charge

abstract: We study in detail the electromagnetic fields and the Poynting flux in the case of a uniformly accelerated charge, in order to examine whether such a charge does `emit' radiation, especially in view of the widely accepted fact that there is no radiation reaction on the charge. Our concern, in particular, is with the Poynting flow computed at large distances (approaching infinity!) from the time-retarded positions of uniformly accelerated charge, and taken as an evidence of radiation emitted by the charge, which we shall demonstrate to be not true. As the charge picks up speed due to a constant acceleration, the energy in its self-fields accordingly increases and the Poynting flow, usually inferred as radiation, actually forms part of the requisite energy being fed into fields, at a rate just sufficient to match the increasing energy in its self-fields at various distances from the uniformly accelerated charge, including that in the far-off regions. In fact, for the decelerating charge, the energy in its self-fields decreases, at all distances from the charge, till it comes to momentary rest with no energy in its transverse fields, and this decrease in energy is shown {\em everywhere} by an inward radial flow of the Poynting vector, toward the `present' position of the decelerating charge. Moreover, there is a convective flow of self-fields of the charge, seen as a Poynting flow component always along the `present' direction of motion of the charge. Further, we shall show that effectively the electromagnetic fields, including the acceleration fields, even when they are at large distances from the time-retarded position of the charge, they continue to be all around the `present' position of the charge which itself is moving toward infinity due to the uniform acceleration.


title: Forecasting unemployment using Internet search data via PRISM

abstract: Big data generated from the Internet offer great potential for predictive analysis. Here we focus on using online users' Internet search data to forecast unemployment initial claims weeks into the future, which provides timely insights into the direction of the economy. To this end, we present a novel method PRISM (Penalized Regression with Inferred Seasonality Module), which uses publicly available online search data from Google. PRISM is a semi-parametric method, motivated by a general state-space formulation, and employs nonparametric seasonal decomposition and penalized regression. For forecasting unemployment initial claims, PRISM outperforms all previously available methods, including forecasting during the 2008-2009 financial crisis period and near-future forecasting during the COVID-19 pandemic period, when unemployment initial claims both rose rapidly. The timely and accurate unemployment forecasts by PRISM could aid government agencies and financial institutions to assess the economic trend and make well-informed decisions, especially in the face of economic turbulence.


title: Engineering Purely Nonlinear Coupling with the Quarton

abstract: Strong nonlinear coupling of superconducting qubits and/or photons is a critical building block for quantum information processing. Due to the perturbative nature of the Josephson nonlinearity, linear coupling is often used in the dispersive regime to approximate nonlinear coupling. However, this dispersive coupling is weak and the underlying linear coupling mixes the local modes which, for example, distributes unwanted self-Kerr to photon modes. Here, we use the quarton to yield purely nonlinear coupling between two linearly decoupled transmon qubits. The quarton's zero $\phi^2$ potential enables a giant gigahertz-level cross-Kerr which is an order of magnitude stronger compared to existing schemes, and the quarton's positive $\phi^4$ potential can cancel the negative self-Kerr of qubits to linearize them into resonators. This giant cross-Kerr between bare modes of qubit-qubit, qubit-photon, and even photon-photon is ideal for applications such as single microwave photon detection and implementation of bosonic codes.


title: Small-Footprint Keyword Spotting with Multi-Scale Temporal Convolution

abstract: Keyword Spotting (KWS) plays a vital role in human-computer interaction for smart on-device terminals and service robots. It remains challenging to achieve the trade-off between small footprint and high accuracy for KWS task. In this paper, we explore the application of multi-scale temporal modeling to the small-footprint keyword spotting task. We propose a multi-branch temporal convolution module (MTConv), a CNN block consisting of multiple temporal convolution filters with different kernel sizes, which enriches temporal feature space. Besides, taking advantage of temporal and depthwise convolution, a temporal efficient neural network (TENet) is designed for KWS system. Based on the purposed model, we replace standard temporal convolution layers with MTConvs that can be trained for better performance. While at the inference stage, the MTConv can be equivalently converted to the base convolution architecture, so that no extra parameters and computational costs are added compared to the base model. The results on Google Speech Command Dataset show that one of our models trained with MTConv performs the accuracy of 96.8% with only 100K parameters.


title: Advantages of Bilinear Koopman Realizations for the Modeling and Control of Systems with Unknown Dynamics

abstract: Nonlinear dynamical systems can be made easier to control by lifting them into the space of observable functions, where their evolution is described by the linear Koopman operator. This paper describes how the Koopman operator can be used to generate approximate linear, bilinear, and nonlinear model realizations from data, and argues in favor of bilinear realizations for characterizing systems with unknown dynamics. Necessary and sufficient conditions for a dynamical system to have a valid linear or bilinear realization over a given set of observable functions are presented and used to show that every control-affine system admits an infinite-dimensional bilinear realization, but does not necessarily admit a linear one. Therefore, approximate bilinear realizations constructed from generic sets of basis functions tend to improve as the number of basis functions increases, whereas approximate linear realizations may not. To demonstrate the advantages of bilinear Koopman realizations for control, a linear, bilinear, and nonlinear Koopman model realization of a simulated robot arm are constructed from data. In a trajectory following task, the bilinear realization exceeds the prediction accuracy of the linear realization and the computational efficiency of the nonlinear realization when incorporated into a model predictive control framework.


title: Homology handles with trivial Alexander polynomial

abstract: Using Freedman and Quinn's result for $\mathbb{Z}$-homology 3-spheres, we show that a 3-dimensional homology handle with trivial Alexander polynomial bounds a homology $S^1\times D^3$. As a consequence, a distinguished homology handle with trivial Alexander polynomial is topologically null $\widetilde{H}$-cobordant.


title: Sylvan resolutions in three variables

abstract: The canonical sylvan resolution is a resolution for arbitrary monomial ideals over a polynomial ring that is minimal and has an explicit combinatorial formula for the differential. The differential is a weighted sum over lattice paths of weights of chain-link fences, which are sequences of faces that are linked to each other via higher-dimensional analogues of spanning trees. The combinatorial formula for the differential simplifies greatly in the three-variable case. The main results in this paper express the sylvan matrix entries for monomial ideals in three variables as a sum over lattice paths of simpler weights that depend only on the number of specific Koszul simplicial complexes that lie along the corresponding lattice path, which bypasses any computation of chain-link fences.


title: Survivable Hyper-Redundant Robotic Arm with Bayesian Policy Morphing

abstract: In this paper we present a Bayesian reinforcement learning framework that allows robotic manipulators to adaptively recover from random mechanical failures autonomously, hence being survivable. To this end, we formulate the framework of Bayesian Policy Morphing (BPM) that enables a robot agent to self-modify its learned policy after the diminution of its maneuvering dimensionality. We build upon existing actor-critic framework, and extend it to perform policy gradient updates as posterior learning, taking past policy updates as prior distributions. We show that policy search, in the direction biased by prior experience, significantly improves learning efficiency in terms of sampling requirements. We demonstrate our results on an 8-DOF robotic arm with our algorithm of BPM, while intentionally disabling random joints with different damage types like unresponsive joints, constant offset errors and angular imprecision. Our results have shown that, even with physical damages, the robotic arm can still successfully maintain its functionality to accurately locate and grasp a given target object.


title: Uniform Approximation of Continuous Functions by Nontrivial Simple Functions

abstract: We prove that every nonnegative continuous real-valued function on a given compact metric space is the uniform limit of some increasing sequence of nonnegative simple functions being linear combinations of indicators of open sets; here the nontriviality is relative to the standard choice(s) of approximating simple functions for measurable functions, where one loses control over the indicated measurable sets. Thus the standard uniform approximation of bounded nonnegative measurable real-valued functions by increasing nonnegative simple functions may be improved for nonnegative continuous real-valued functions on compact metric spaces. There are also some interesting consequences regarding semi-continuous functions and smooth functions.


title: Back-reaction in canonical analogue black holes

abstract: We study the back-reaction associated with Hawking evaporation of an acoustic canonical analogue black hole in a Bose-Einstein condensate. We show that the emission of Hawking radiation induces a local back-reaction on the condensate, perturbing it in the near-horizon region, and a global back-reaction in the density distribution of the atoms. We discuss how these results produce useful insights into the process of black hole evaporation and its compatibility with a unitary evolution.