title: A Principal Component Analysis of polycyclic aromatic hydrocarbon emission in NGC 2023

abstract: We use the measured fluxes of polycyclic aromatic hydrocarbon (PAH) emission features at 6.2, 7.7, 8.6, 11.0 and 11.2 $\mu$m in the reflection nebula NGC 2023 to carry out a principal component analysis (PCA) as a means to study previously reported variations in the PAH emission. We find that almost all of the variations (99%) can be explained with just two parameters -- the first two principal components (PCs). We explore the characteristics of these PCs and show that the first PC ($PC_{1}$), which is the primary driver of the variation, represents the amount of emission of a mixture of PAHs with ionized species dominating over neutral species. The second PC ($PC_{2}$) traces variations in the ionization state of the PAHs across the nebula. Correlations of the PCs with various PAH ratios show that the 6.2 and 7.7 $\mu$m bands behave differently than the 8.6 and 11.0 $\mu$m bands, thereby forming two distinct groups of ionized bands. We compare the spatial distribution of the PCs to the physical conditions, in particular to the strength of the radiation field, $G_{0}$, and the $G_{0}/n_{H}$ ratio and find that the variations in $PC_{2}$, i.e. the ionization state of PAHs are strongly affected by $G_{0}$ whereas the amount of PAH emission (as traced by $PC_{1}$) does not depend on $G_0$.


title: When Is Parallel Trends Sensitive to Functional Form?

abstract: This paper assesses when the validity of difference-in-differences depends on functional form. We provide a novel characterization: the parallel trends assumption holds under all strictly monotonic transformations of the outcome if and only if a stronger ``parallel trends''-type condition holds for the cumulative distribution function of untreated potential outcomes. This condition for parallel trends to be insensitive to functional form is satisfied if and essentially only if the population can be partitioned into a subgroup for which treatment is effectively randomly assigned and a remaining subgroup for which the distribution of untreated potential outcomes is stable over time. These conditions have testable implications, and we introduce falsification tests for the null that parallel trends is insensitive to functional form.


title: A data-centric framework for crystal structure identification in atomistic simulations using machine learning

abstract: Atomic-level modeling performed at large scales enables the investigation of mesoscale materials properties with atom-by-atom resolution. The spatial complexity of such cross-scale simulations renders them unsuitable for simple human visual inspection. Instead, specialized structure characterization techniques are required to aid interpretation. These have historically been challenging to construct, requiring significant intuition and effort. Here we propose an alternative framework for a fundamental structural characterization task: classifying atoms according to the crystal structure to which they belong. Our approach is data-centric and favors the employment of Machine Learning over heuristic rules of classification. A group of data-science tools and simple local descriptors of atomic structure are employed together with an efficient synthetic training set. We also introduce the first standard and publicly available benchmark data set for evaluation of algorithms for crystal-structure classification. It is demonstrated that our data-centric framework outperforms all of the most popular heuristic methods -- especially at high temperatures when lattices are the most distorted -- while introducing a systematic route for generalization to new crystal structures. Moreover, through the use of outlier detection algorithms our approach is capable of discerning between amorphous atomic motifs (i.e., noncrystalline phases) and unknown crystal structures, making it uniquely suited for exploratory materials synthesis simulations.


title: Characterizing Policy Divergence for Personalized Meta-Reinforcement Learning

abstract: Despite ample motivation from costly exploration and limited trajectory data, rapidly adapting to new environments with few-shot reinforcement learning (RL) can remain a challenging task, especially with respect to personalized settings. Here, we consider the problem of recommending optimal policies to a set of multiple entities each with potentially different characteristics, such that individual entities may parameterize distinct environments with unique transition dynamics. Inspired by existing literature in meta-learning, we extend previous work by focusing on the notion that certain environments are more similar to each other than others in personalized settings, and propose a model-free meta-learning algorithm that prioritizes past experiences by relevance during gradient-based adaptation. Our algorithm involves characterizing past policy divergence through methods in inverse reinforcement learning, and we illustrate how such metrics are able to effectively distinguish past policy parameters by the environment they were deployed in, leading to more effective fast adaptation during test time. To study personalization more effectively we introduce a navigation testbed to specifically incorporate environment diversity across training episodes, and demonstrate that our approach outperforms meta-learning alternatives with respect to few-shot reinforcement learning in personalized settings.


title: Single-shot number-resolved detection of microwave photons with error mitigation

abstract: Single-photon detectors are ubiquitous and integral components of photonic quantum cryptography, communication, and computation. Many applications, however, require not only detecting the presence of any photons, but distinguishing the number present with a single shot. Here, we implement a single-shot, high-fidelity photon number-resolving detector of up to 15 microwave photons in a cavity-qubit circuit QED platform. This detector functions by measuring a series of generalized parity operators which make up the bits in the binary decomposition of the photon number. Our protocol consists of successive, independent measurements of each bit by entangling the ancilla with the cavity, then reading out and resetting the ancilla. Photon loss and ancilla readout errors can flip one or more bits, causing nontrivial errors in the outcome, but these errors have a traceable form which can be captured in a simple hidden Markov model. Relying on the independence of each bit measurement, we mitigate biases in ensembles of measurements, showing good agreement with the predictions of the model. The mitigation improves the average total variation distance error of Fock states from $13.5\%$ to $1.1\%$. We also show that the mitigation is efficiently scalable to an $M$-mode system provided that the errors are independent and sufficiently small. Our work motivates the development of new algorithms that utilize single-shot, high-fidelity PNR detectors.


title: Detuning Axis Pulsed Spectroscopy of Valley-Orbital States in Si/SiGe Quantum Dots

abstract: Silicon quantum dot qubits must contend with low-lying valley excited states which are sensitive functions of the quantum well heterostructure and disorder; quantifying and maximizing the energies of these states are critical to improving device performance. We describe a spectroscopic method for probing excited states in isolated Si/SiGe double quantum dots using standard baseband pulsing techniques, easing the extraction of energy spectra in multiple-dot devices. We use this method to measure dozens of valley excited state energies spanning multiple wafers, quantum dots, and orbital states, crucial for evaluating the dependence of valley splitting on quantum well width and other epitaxial conditions. Our results suggest that narrower wells can be beneficial for improving valley splittings, but this effect can be confounded by variations in growth and fabrication conditions. These results underscore the importance of valley splitting measurements for guiding the development of Si qubits.


title: How Does Mixup Help With Robustness and Generalization?

abstract: Mixup is a popular data augmentation technique based on taking convex combinations of pairs of examples and their labels. This simple technique has been shown to substantially improve both the robustness and the generalization of the trained model. However, it is not well-understood why such improvement occurs. In this paper, we provide theoretical analysis to demonstrate how using Mixup in training helps model robustness and generalization. For robustness, we show that minimizing the Mixup loss corresponds to approximately minimizing an upper bound of the adversarial loss. This explains why models obtained by Mixup training exhibits robustness to several kinds of adversarial attacks such as Fast Gradient Sign Method (FGSM). For generalization, we prove that Mixup augmentation corresponds to a specific type of data-adaptive regularization which reduces overfitting. Our analysis provides new insights and a framework to understand Mixup.


title: Finding geodesics on graphs using reinforcement learning

abstract: It is well-known in biology that ants are able to find shortest paths between their nest and the food by successive random explorations, without any mean of communication other than the pheromones they leave behind them. This striking phenomenon has been observed experimentally and modelled by different mean-field reinforcement-learning models in the biology literature. In this paper, we introduce the first probabilistic reinforcement-learning model for this phenomenon. In this model, the ants explore a finite graph in which two nodes are distinguished as the nest and the source of food. The ants perform successive random walks on this graph, starting from the nest and stopped when first reaching the food, and the transition probabilities of each random walk depend on the realizations of all previous walks through some dynamic weighting of the graph. We discuss different variants of this model based on different reinforcement rules and show that slight changes in this reinforcement rule can lead to drastically different outcomes. We prove that, in two variants of this model and when the underlying graph is, respectively, any series-parallel graph and a 5-edge non-series-parallel losange graph, the ants indeed eventually find the shortest path(s) between their nest and the food. Both proofs rely on the electrical network method for random walks on weighted graphs and on Rubin's embedding in continuous time. The proof in the series-parallel cases uses the recursive nature of this family of graphs, while the proof in the seemingly-simpler losange case turns out to be quite intricate: it relies on a fine analysis of some stochastic approximation, and on various couplings with standard and generalised P\'olya urns.


title: Understanding Local Robustness of Deep Neural Networks under Natural Variations

abstract: Deep Neural Networks (DNNs) are being deployed in a wide range of settings today, from safety-critical applications like autonomous driving to commercial applications involving image classifications. However, recent research has shown that DNNs can be brittle to even slight variations of the input data. Therefore, rigorous testing of DNNs has gained widespread attention. While DNN robustness under norm-bound perturbation got significant attention over the past few years, our knowledge is still limited when natural variants of the input images come. These natural variants, e.g. a rotated or a rainy version of the original input, are especially concerning as they can occur naturally in the field without any active adversary and may lead to undesirable consequences. Thus, it is important to identify the inputs whose small variations may lead to erroneous DNN behaviors. The very few studies that looked at DNN's robustness under natural variants, however, focus on estimating the overall robustness of DNNs across all the test data rather than localizing such error-producing points. This work aims to bridge this gap. To this end, we study the local per-input robustness properties of the DNNs and leverage those properties to build a white-box (DeepRobust-W) and a black-box (DeepRobust-B) tool to automatically identify the non-robust points. Our evaluation of these methods on three DNN models spanning three widely used image classification datasets shows that they are effective in flagging points of poor robustness. In particular, DeepRobust-W and DeepRobust-B are able to achieve an F1 score of up to 91.4% and 99.1%, respectively. We further show that DeepRobust-W can be applied to a regression problem in another domain. Our evaluation on three self-driving car models demonstrates that DeepRobust-W is effective in identifying points of poor robustness with F1 score up to 78.9%.


title: Spectral relaxations and branching strategies for global optimization of mixed-integer quadratic programs

abstract: We consider the global optimization of nonconvex quadratic programs and mixed-integer quadratic programs. We present a family of convex quadratic relaxations which are derived by convexifying nonconvex quadratic functions through perturbations of the quadratic matrix. We investigate the theoretical properties of these quadratic relaxations and show that they are equivalent to some particular semidefinite programs. We also introduce novel branching variable selection strategies which can be used in conjunction with the quadratic relaxations investigated in this paper. We integrate the proposed relaxation and branching techniques into the global optimization solver BARON, and test our implementation by conducting numerical experiments on a large collection of problems. Results demonstrate that the proposed implementation leads to very significant reductions in BARON's computational times to solve the test problems.


title: On some representations of context-free languages

abstract: Context-free languages are widely used to describe the syntax of programming languages and natural languages. Usually, we describe a context-free language mathematically with the help of context-free grammar (for generation) or pushdown automata (for recognition). The purpose of this study is to describe some unconventional methods of description of context-free languages, namely a representation with the help of finite digraphs and with automata - generators of context-free languages. We will mainly focus on the mathematical models of these representations.


title: A Cross-Level Information Transmission Network for Predicting Phenotype from New Genotype: Application to Cancer Precision Medicine

abstract: An unsolved fundamental problem in biology and ecology is to predict observable traits (phenotypes) from a new genetic constitution (genotype) of an organism under environmental perturbations (e.g., drug treatment). The emergence of multiple omics data provides new opportunities but imposes great challenges in the predictive modeling of genotype-phenotype associations. Firstly, the high-dimensionality of genomics data and the lack of labeled data often make the existing supervised learning techniques less successful. Secondly, it is a challenging task to integrate heterogeneous omics data from different resources. Finally, the information transmission from DNA to phenotype involves multiple intermediate levels of RNA, protein, metabolite, etc. The higher-level features (e.g., gene expression) usually have stronger discriminative power than the lower level features (e.g., somatic mutation). To address above issues, we proposed a novel Cross-LEvel Information Transmission network (CLEIT) framework. CLEIT aims to explicitly model the asymmetrical multi-level organization of the biological system. Inspired by domain adaptation, CLEIT first learns the latent representation of high-level domain then uses it as ground-truth embedding to improve the representation learning of the low-level domain in the form of contrastive loss. In addition, we adopt a pre-training-fine-tuning approach to leveraging the unlabeled heterogeneous omics data to improve the generalizability of CLEIT. We demonstrate the effectiveness and performance boost of CLEIT in predicting anti-cancer drug sensitivity from somatic mutations via the assistance of gene expressions when compared with state-of-the-art methods.


title: Characterizing dynamical states of Galactic open clusters with Gaia DR2

abstract: In this work, we investigate the dynamical properties of 38 Galactic open clusters: 34 of them are located at low Galactic latitudes (|b| < 10$^{\circ}$) and are projected against dense stellar fields; the other 4 comparison objects present clearer contrasts with the field population. We determine structural and time-related parameters that are associated with the clusters' dynamical evolution: core ($r_c$), tidal ($r_t$) and half-mass ($r_{hm}$) radii, ages ($t$) and crossing times ($t_{cr}$). We have also incorporated results for 27 previously studied clusters, creating a sample of 65, spanning the age and Galactocentric distance ($R_G$) ranges: 7.0 < log ($t$) < 9.7 and 6 < $R_G$ (kpc) < 13. We employ a uniform analysis method which incorporates photometric and astrometric data from the Gaia DR2 catalogue. Member stars are identified by employing a decontamination algorithm which operates on the 3D astrometric space of parallax and proper motion and attributes membership likelihoods for stars in the cluster region. Our results show that the internal relaxation causes $r_c$ to correlate negatively with the dynamical ratio $\tau_{dyn}$ = $t/t_{cr}$. This implies that dynamically older systems tend to be more centrally concentrated. The more concentrated ones tend to present smaller $r_{hm}/r_t$ ratios, which means that they are less subject to tidal disruption. The analysis of coeval groups at compatible $R_G$ suggests that the inner structure of clusters is reasonably insensitive to variations in the external tidal field. Additionally, our results confirm, on average, an increase in $r_t$ for regions with less intense Galactic gravitational field.


title: On Task-Level Dialogue Composition of Generative Transformer Model

abstract: Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such systems. It is natural for users of the system to want to accomplish multiple tasks within the same conversation, but the ability of generative models to compose multiple tasks is not well studied. In this work, we begin by studying the effect of training human-human task-oriented dialogues towards improving the ability to compose multiple tasks on Transformer generative models. To that end, we propose and explore two solutions: (1) creating synthetic multiple task dialogue data for training from human-human single task dialogue and (2) forcing the encoder representation to be invariant to single and multiple task dialogues using an auxiliary loss. The results from our experiments highlight the difficulty of even the sophisticated variant of transformer model in learning to compose multiple tasks from single task dialogues.


title: Towards Self-Regulating AI: Challenges and Opportunities of AI Model Governance in Financial Services

abstract: AI systems have found a wide range of application areas in financial services. Their involvement in broader and increasingly critical decisions has escalated the need for compliance and effective model governance. Current governance practices have evolved from more traditional financial applications and modeling frameworks. They often struggle with the fundamental differences in AI characteristics such as uncertainty in the assumptions, and the lack of explicit programming. AI model governance frequently involves complex review flows and relies heavily on manual steps. As a result, it faces serious challenges in effectiveness, cost, complexity, and speed. Furthermore, the unprecedented rate of growth in the AI model complexity raises questions on the sustainability of the current practices. This paper focuses on the challenges of AI model governance in the financial services industry. As a part of the outlook, we present a system-level framework towards increased self-regulation for robustness and compliance. This approach aims to enable potential solution opportunities through increased automation and the integration of monitoring, management, and mitigation capabilities. The proposed framework also provides model governance and risk management improved capabilities to manage model risk during deployment.


title: ElasticBroker: Combining HPC with Cloud to Provide Realtime Insights into Simulations

abstract: For large-scale scientific simulations, it is expensive to store raw simulation results to perform post-analysis. To minimize expensive I/O, "in-situ" analysis is often used, where analysis applications are tightly coupled with scientific simulations and can access and process the simulation results in memory. Increasingly, scientific domains employ Big Data approaches to analyze simulations for scientific discoveries. However, it remains a challenge to organize, transform, and transport data at scale between the two semantically different ecosystems (HPC and Cloud systems). In an effort to address these challenges, we design and implement the ElasticBroker software framework, which bridges HPC and Cloud applications to form an "in-situ" scientific workflow. Instead of writing simulation results to parallel file systems, ElasticBroker performs data filtering, aggregation, and format conversions to close the gap between an HPC ecosystem and a distinct Cloud ecosystem. To achieve this goal, ElasticBroker reorganizes simulation snapshots into continuous data streams and send them to the Cloud. In the Cloud, we deploy a distributed stream processing service to perform online data analysis. In our experiments, we use ElasticBroker to setup and execute a cross-ecosystem scientific workflow, which consists of a parallel computational fluid dynamics (CFD) simulation running on a supercomputer, and a parallel dynamic mode decomposition (DMD) analysis application running in a Cloud computing platform. Our results show that running scientific workflows consisting of decoupled HPC and Big Data jobs in their native environments with ElasticBroker, can achieve high quality of service, good scalability, and provide high-quality analytics for ongoing simulations.


title: Relation Classification as Two-way Span-Prediction

abstract: The current supervised relation classification (RC) task uses a single embedding to represent the relation between a pair of entities. We argue that a better approach is to treat the RC task as span-prediction (SP) problem, similar to Question answering (QA). We present a span-prediction based system for RC and evaluate its performance compared to the embedding based system. We demonstrate that the supervised SP objective works significantly better then the standard classification based objective. We achieve state-of-the-art results on the TACRED and SemEval task 8 datasets.


title: Students Readiness for E-learning in the Universities in Yemen

abstract: The e-learning is an advanced version of traditional education. It is defined as a way of learning by using the communication mechanisms of modern computer networks and multimedia, including voice, image, and graphics and mechanisms to search electronic libraries, as well as web portals, whether in the context of distance learning or in the classroom. The people who engage in the transition to web-supported education are the administrative staff, the faculty, and the students. They all have their needs and they all should meet specific requirements in order to facilitate the transition. The article presents the results of questionnaire research of the students readiness for e-learning in Yemeni universities.


title: Improving Local Identifiability in Probabilistic Box Embeddings

abstract: Geometric embeddings have recently received attention for their natural ability to represent transitive asymmetric relations via containment. Box embeddings, where objects are represented by n-dimensional hyperrectangles, are a particularly promising example of such an embedding as they are closed under intersection and their volume can be calculated easily, allowing them to naturally represent calibrated probability distributions. The benefits of geometric embeddings also introduce a problem of local identifiability, however, where whole neighborhoods of parameters result in equivalent loss which impedes learning. Prior work addressed some of these issues by using an approximation to Gaussian convolution over the box parameters, however, this intersection operation also increases the sparsity of the gradient. In this work, we model the box parameters with min and max Gumbel distributions, which were chosen such that space is still closed under the operation of the intersection. The calculation of the expected intersection volume involves all parameters, and we demonstrate experimentally that this drastically improves the ability of such models to learn.


title: The environmental dependence of X-ray AGN activity at $z\sim0.4$

abstract: We present an analysis of the X-ray Active Galactic Nucleus (AGN) population in a sample of seven massive galaxy clusters in the redshift range $0.35<z<0.45$. We utilize high-quality Chandra X-ray imaging to robustly identify AGN and precisely determine cluster masses and centroids. Follow-up VIMOS optical spectroscopy allows us to determine which AGN are cluster members. Studying the subset of AGN with 0.5-8 keV luminosities $>6.8\times10^{42}~\mathrm{erg~s^{-1}}$, within $r\leq2r_{500}$ (approximately the virial radius), we find that the cluster AGN space density scales with cluster mass as $\sim M^{-2.0^{+0.8}_{-0.9}}$. This result rules out zero mass dependence of the cluster X-ray AGN space density at the 2.5$\sigma$ level. We compare our cluster X-ray AGN sample to a control field with identical selection and find that the cluster AGN fraction is significantly suppressed relative to the field when considering the brightest galaxies with $V<21.5$. For fainter galaxies, this difference is not present. Comparing the X-ray hardness ratios of cluster member AGN to those in the control field, we find no evidence for enhanced X-ray obscuration of cluster member AGN. Lastly, we see tentative evidence that disturbed cluster environments may contribute to enhanced AGN activity.


title: Pandemic Lessons -- Devising an assessment framework to analyse policies for sustainability

abstract: COVID-19 pandemic has sharply projected the globally persistent multi-dimensional fundamental challenges in securing general socio-economic wellbeing of the society. The problems intensify with increasing population densities and also vary with several socio-economic-geo-cultural activity parameters. These problems directly highlight the urgent need for accomplishing the interdependent United Nations Sustainable Development Goals (SDGs) to ensure that in future we do not enter into vicious loops of contracting newer zoonotic viruses and need not search for their vaccines while incurring socio-economic havoc. Behavioural changes in human activities/responses are indispensable for achieving the interdependent SDGs. Using root cause analysis approach, we have developed a yearly assessment framework for viably analysing and identifying requisite region-specific downstream/upstream socio-economic policies to reach the SDGs. The framework makes use of an infographic bar chart representation based on the normalised values of 20 human activity/impact parameters classified under three categories as - negative, limiting and positive. With a holistic view encompassing the SDGs, we illustrate through this framework the impact and urgent need of region-specific human behavioural reforms. This framework enables the foresight about policies regarding their potential in bringing down the negative parameter values to the desired zero level for accomplishing the SDGs through planetary health.


title: Characterizing Fano Resonances During Recollision

abstract: When intense light irradiates a quantum system, an ionizing electron recollides with its parent ion within the same light cycle and, during that very brief (few femtosecond) encounter, its kinetic energy sweeps from low to high energy and back. Therefore, recollision offers unprecedented time resolution and it is the foundation on which attosecond science is built. For simple systems, recolliding trajectories are shaped by the strong field acting together with the Coulomb potential and they can be readily calculated and measured. However, for more complex systems, multielectron effects are also important because they dynamically alter the recolliding wave packet trajectories. Here, we theoretically study Fano resonances, one of the most accessible multielectron effects, and we show how multielectron dynamics can be unambiguously isolated when we use in situ measurement. The general class of in situ measurement can provide key information needed for time-dependent ab initio electronic structure theory and will allow us to measure the ultimate time response of matter.


title: Information bound for entropy production from the detailed fluctuation theorem

abstract: Fluctuation theorems impose fundamental bounds in the statistics of the entropy production, with the second law of thermodynamics being the most famous. Using information theory, we quantify the information of entropy production and find an upper tight bound as a function of its mean from the strong detailed fluctuation theorem. The bound is given in terms of a maximal distribution, a member of the exponential family with nonlinear argument. We show that the entropy produced by heat transfer using a bosonic mode at weak coupling reproduces the maximal distribution in a limiting case. The upper bound is extended to the continuous domain and verified for the heat transfer using a levitated nanoparticle. Finally, we show that a composition of qubit swap engines satisfies a particular case of the maximal distribution regardless of its size.


title: Paying down metadata debt: learning the representation of concepts using topic models

abstract: We introduce a data management problem called metadata debt, to identify the mapping between data concepts and their logical representations. We describe how this mapping can be learned using semisupervised topic models based on low-rank matrix factorizations that account for missing and noisy labels, coupled with sparsity penalties to improve localization and interpretability. We introduce a gauge transformation approach that allows us to construct explicit associations between topics and concept labels, and thus assign meaning to topics. We also show how to use this topic model for semisupervised learning tasks like extrapolating from known labels, evaluating possible errors in existing labels, and predicting missing features. We show results from this topic model in predicting subject tags on over 25,000 datasets from Kaggle.com, demonstrating the ability to learn semantically meaningful features.


title: CurbScan: Curb Detection and Tracking Using Multi-Sensor Fusion

abstract: Reliable curb detection is critical for safe autonomous driving in urban contexts. Curb detection and tracking are also useful in vehicle localization and path planning. Past work utilized a 3D LiDAR sensor to determine accurate distance information and the geometric attributes of curbs. However, such an approach requires dense point cloud data and is also vulnerable to false positives from obstacles present on both road and off-road areas. In this paper, we propose an approach to detect and track curbs by fusing together data from multiple sensors: sparse LiDAR data, a mono camera and low-cost ultrasonic sensors. The detection algorithm is based on a single 3D LiDAR and a mono camera sensor used to detect candidate curb features and it effectively removes false positives arising from surrounding static and moving obstacles. The detection accuracy of the tracking algorithm is boosted by using Kalman filter-based prediction and fusion with lateral distance information from low-cost ultrasonic sensors. We next propose a line-fitting algorithm that yields robust results for curb locations. Finally, we demonstrate the practical feasibility of our solution by testing in different road environments and evaluating our implementation in a real vehicle\footnote{Demo video clips demonstrating our algorithm have been uploaded to Youtube: https://www.youtube.com/watch?v=w5MwsdWhcy4, https://www.youtube.com/watch?v=Gd506RklfG8.}. Our algorithm maintains over 90\% accuracy within 4.5-22 meters and 0-14 meters for the KITTI dataset and our dataset respectively, and its average processing time per frame is approximately 10 ms on Intel i7 x86 and 100ms on NVIDIA Xavier board.


title: Rao-Blackwellizing the Straight-Through Gumbel-Softmax Gradient Estimator

abstract: Gradient estimation in models with discrete latent variables is a challenging problem, because the simplest unbiased estimators tend to have high variance. To counteract this, modern estimators either introduce bias, rely on multiple function evaluations, or use learned, input-dependent baselines. Thus, there is a need for estimators that require minimal tuning, are computationally cheap, and have low mean squared error. In this paper, we show that the variance of the straight-through variant of the popular Gumbel-Softmax estimator can be reduced through Rao-Blackwellization without increasing the number of function evaluations. This provably reduces the mean squared error. We empirically demonstrate that this leads to variance reduction, faster convergence, and generally improved performance in two unsupervised latent variable models.


title: Emotional Musical Prosody: Validated Vocal Dataset for Human Robot Interaction

abstract: Human collaboration with robotics is dependant on the development of a relationship between human and robot, without which performance and utilization can decrease. Emotion and personality conveyance has been shown to enhance robotic collaborations, with improved human-robot relationships and increased trust. One under-explored way for an artificial agent to convey emotions is through non-linguistic musical prosody. In this work we present a new 4.2 hour dataset of improvised emotional vocal phrases based on the Geneva Emotion Wheel. This dataset has been validated through extensive listening tests and shows promising preliminary results for use in generative systems.


title: CryptoCredit: Securely Training Fair Models

abstract: When developing models for regulated decision making, sensitive features like age, race and gender cannot be used and must be obscured from model developers to prevent bias. However, the remaining features still need to be tested for correlation with sensitive features, which can only be done with the knowledge of those features. We resolve this dilemma using a fully homomorphic encryption scheme, allowing model developers to train linear regression and logistic regression models and test them for possible bias without ever revealing the sensitive features in the clear. We demonstrate how it can be applied to leave-one-out regression testing, and show using the adult income data set that our method is practical to run.


title: Tailored Coupled Cluster Theory in Varying Correlation Regimes

abstract: The tailored coupled cluster (TCC) approach is a promising ansatz that preserves the simplicity of single-reference coupled cluster theory, while incorporating a multi-reference wave function through amplitudes obtained from a preceding multi-configurational calculation. Here, we present a detailed analysis of the TCC wave function based on model systems, which require an accurate description of both static and dynamic correlation. We investigate the reliability of the TCC approach with respect to the exact wave function. In addition to the error in the electronic energy and standard coupled cluster diagnostics, we exploit the overlap of TCC and full configuration interaction wave functions as a quality measure. We critically review issues such as the required size of the active space, size-consistency, symmetry breaking in the wave function, and the dependence of TCC on the reference wave function. We observe that possible errors caused by symmetry breaking can be mitigated by employing the determinant with the largest weight in the active space as reference for the TCC calculation. We find the TCC model to be promising in calculations with active orbital spaces which include all orbitals with a large single-orbital entropy, even if the active spaces become very large and then may require modern active-space approaches that are not restricted to comparatively small numbers of orbitals. Furthermore, utilizing large active spaces can improve on the TCC wave-function approximation and reduce the size-consistency error, because the presence of highly excited determinants affects the accuracy of the coefficients of low-excited determinants in the active space.

categories: physics.chem-ph cond-mat.str-el physics.atm-clus physics.comp-ph


title: Conformal retrofitting via Riemannian manifolds: distilling task-specific graphs into pretrained embeddings

abstract: Pretrained (language) embeddings are versatile, task-agnostic feature representations of entities, like words, that are central to many machine learning applications. These representations can be enriched through retrofitting, a class of methods that incorporate task-specific domain knowledge encoded as a graph over a subset of these entities. However, existing retrofitting algorithms face two limitations: they overfit the observed graph by failing to represent relationships with missing entities; and they underfit the observed graph by only learning embeddings in Euclidean manifolds, which cannot faithfully represent even simple tree-structured or cyclic graphs. We address these problems with two key contributions: (i) we propose a novel regularizer, a conformality regularizer, that preserves local geometry from the pretrained embeddings---enabling generalization to missing entities and (ii) a new Riemannian feedforward layer that learns to map pre-trained embeddings onto a non-Euclidean manifold that can better represent the entire graph. Through experiments on WordNet, we demonstrate that the conformality regularizer prevents even existing (Euclidean-only) methods from overfitting on link prediction for missing entities, and---together with the Riemannian feedforward layer---learns non-Euclidean embeddings that outperform them.


title: Exact asymptotic solution of an aggregation model with a bell-shaped distribution

abstract: We present in a detailed manner the scaling theory of irreversible aggregation characterized by the set of reaction rates $K(k,l)=1/k+1/l$, as well as a minor generalisation thereof. In this case, it is possible to evaluate the scaling function exactly. By this we mean that it is expressed as the unique solution of an ordinary differential equation with given boundary conditions. This can be solved numerically to high accuracy, making a highly detailed analysis of the scaling behaviour possible. The results confirm the far more general results of earlier work concerning a general scaling theory for so-called reaction rates of Type III. On the other hand, the behaviour of large aggregates at fixed time, that is, not in the scaling limit, which had been up to now analysed in an approximation valid in the limit of small times, can be determined more precisely in this case, and is shown to display subtle differences from the small-time approximation.


title: How well does surprisal explain N400 amplitude under different experimental conditions?

abstract: We investigate the extent to which word surprisal can be used to predict a neural measure of human language processing difficulty - the N400. To do this, we use recurrent neural networks to calculate the surprisal of stimuli from previously published neurolinguistic studies of the N400. We find that surprisal can predict N400 amplitude in a wide range of cases, and the cases where it cannot do so provide valuable insight into the neurocognitive processes underlying the response.

categories: cs.CL cs.AI cs.IT cs.LG math.IT q-bio.NC


title: Dimension-expanding polynomials and the discretized Elekes-R\'onyai theorem

abstract: We characterize when bivariate real analytic functions are "dimension expanding" when applied to a Cartesian product. If $P$ is a bivariate real analytic function that is not locally of the form $P(x,y) = h(a(x) + b(y))$, then whenever $A$ and $B$ are Borel subsets of $\mathbb{R}$ with Hausdorff dimension $0<\alpha<1$, we have that $P(A,B)$ has Hausdorff dimension at least $\alpha + \epsilon$ for some $\epsilon(\alpha)>0$ that is independent of $P$. The result is sharp, in the sense that no estimate of this form can hold if $P(x,y) = h(a(x) + b(y))$. We also prove a more technical single-scale version of this result, which is an analogue of the Elekes-R\'onyai theorem in the setting of the Katz-Tao discretized ring conjecture. As an application, we show that a discretized non-concentrated set cannot have small nonlinear projection under three distinct analytic projection functions, provided that the corresponding 3-web has non-vanishing Blaschke curvature.


title: A Unique Chief Series in the arboreal Galois Group of Belyi Maps

abstract: We give a complete description of the normal subgroups of arboreal Galois groups of Belyi maps. The normal groups form a unique chief series. We also carefully compute the discriminate of the iterate of a polynomial minus an algebraic number, which allows us to predict when a such discriminate is a perfect square in the base field or intermediate field for a postcritically finite polynomials (PCF). As a consequence we are able to find another PCF cubic polynomial that has the same arboreal Galois group as the one of Belyi maps.


title: A variational characterization of Langevin$\boldsymbol{-}$Smoluchowski diffusions

abstract: We show that Langevin$-$Smoluchowski measure on path space is invariant under time-reversal, followed by stochastic control of the drift with a novel entropic-type criterion. Repeated application of these forward-backward steps leads to a sequence of stochastic control problems, whose initial/terminal distributions converge to the Gibbs probability measure of the diffusion, and whose values decrease to zero along the relative entropy of the Langevin$-$Smoluchowski flow with respect to this Gibbs measure.


title: Improved analysis of GW190412 with a precessing numerical relativity surrogate waveform model

abstract: The recent observation of GW190412, the first high-mass ratio binary black-hole (BBH) merger, by the LIGO-Virgo Collaboration (LVC) provides a unique opportunity to probe the impact of subdominant harmonics and precession effects encoded in a gravitational wave signal. We present refined estimates of source parameters for GW190412 using \texttt{NRSur7dq4}, a recently developed numerical relativity waveform surrogate model that includes all $\ell \leq 4$ spin-weighted spherical harmonic modes as well as the full physical effects of precession. We compare our results with two different variants of phenomenological precessing BBH waveform models, \texttt{IMRPhenomPv3HM} and \texttt{IMRPhenomXPHM}, as well as to the LVC results. Our results are broadly in agreement with \texttt{IMRPhenomXPHM} results and the reported LVC analysis compiled with the \texttt{SEOBNRv4PHM} waveform model, but in tension with \texttt{IMRPhenomPv3HM}. Using the \texttt{NRSur7dq4} model, we provide a tighter constraint on the mass-ratio ($0.26^{+0.08}_{-0.06}$) as compared to the LVC estimate of $0.28^{+0.13}_{-0.07}$ (both reported as median values withs 90\% credible intervals). We also constrain the binary to be more face-on, and find a broader posterior for the spin precession parameter. We further find that even though $\ell=4$ harmonic modes have negligible signal-to-noise ratio, omission of these modes will influence the estimated posterior distribution of several source parameters including chirp mass, effective inspiral spin, luminosity distance, and inclination. We also find that commonly used model approximations, such as neglecting the asymmetric modes (which are generically excited during precession), have negligible impact on parameter recovery for moderate SNR-events similar to GW190412.


title: Modeling Human Temporal Uncertainty in Human-Agent Teams

abstract: Automated scheduling is potentially a very useful tool for facilitating efficient, intuitive interactions between a robot and a human teammate. However, a current gapin automated scheduling is that it is not well understood how to best represent the timing uncertainty that human teammates introduce. This paper attempts to address this gap by designing an online human-robot collaborative packaging game that we use to build a model of human timing uncertainty from a population of crowd-workers. We conclude that heavy-tailed distributions are the best models of human temporal uncertainty, with a Log-Normal distribution achieving the best fit to our experimental data. We discuss how these results along with our collaborative online game will inform and facilitate future explorations into scheduling for improved human-robot fluency.


title: On Hodge decomposition, effective viscous flux and compressible Navier-Stokes

abstract: It has been known, since the pioneering works by Serre, Hoff, Va\u{i}gant-Kazhikhov, Lions and Feireisl, among others, the regularizing properties of the effective viscous flux and its characterization as the function whose gradient is the gradient part in the Hodge decomposition of the Newtonian force of the fluid, when the shear viscosity of the fluid is constant. In this article, we explore further the connection between the Hodge decomposition of the Newtonian force and the regularizing properties of its gradient part, by addressing the problem of the global existence of weak solutions for compressible Navier-Stokes equations with both viscosities depending on a spatial mollification of the density.


title: Voting-based Approaches For Differentially Private Federated Learning

abstract: Differentially Private Federated Learning (DPFL) is an emerging field with many applications. Gradient averaging based DPFL methods require costly communication rounds and hardly work with large-capacity models, due to the explicit dimension dependence in its added noise. In this work, inspired by knowledge transfer non-federated privacy learning from Papernot et al.(2017; 2018), we design two new DPFL schemes, by voting among the data labels returned from each local model, instead of averaging the gradients, which avoids the dimension dependence and significantly reduces the communication cost. Theoretically, by applying secure multi-party computation, we could exponentially amplify the (data-dependent) privacy guarantees when the margin of the voting scores are large. Extensive experiments show that our approaches significantly improve the privacy-utility trade-off over the state-of-the-arts in DPFL.


title: Existence of two-solitary waves with logarithmic distance for the nonlinear Klein-Gordon equation

abstract: $\newcommand\normt[1]{\left\lVert#1\right\rVert_{L^2}} \newcommand\normo[1]{\left\lVert#1\right\rVert_{H^1}} \newcommand\normpro[1]{\left\lVert#1\right\rVert_{E}}$ We consider the focusing nonlinear Klein-Gordon (NLKG) equation \begin{equation*} \partial_{tt}u - \Delta u + u - |u|^{p-1}u = 0,\quad (t,x)\in \mathbb{R}\times \mathbb{R}^d \end{equation*} for $1\leq d\leq 5$ and $p>2$ subcritical for the $\dot H^1$ norm. In this paper we show the existence of a solution $u(t)$ of the equation such that \begin{equation*} \normo{u(t) - \sum_{k=1,2}Q_k(t)} + \normt{\partial_t u(t)} \to 0\quad \mbox{as $t\to +\infty$,} \end{equation*} where $Q_k(t,x)$ are two solitary waves of the equation with translations $z_k:\mathbb{R}\to \mathbb{R}^d$ satisfying \begin{equation*} |z_1(t) - z_2(t)| \sim 2\log(t)\quad \text{as } t\to +\infty. \end{equation*}


title: A posteriori subcell finite volume limiter for general PNPM schemes: applications from gasdynamics to relativistic magnetohydrodynamics

abstract: In this work, we consider the general family of the so called ADER PNPM schemes for the numerical solution of hyperbolic partial differential equations with \textit{arbitrary} high order of accuracy in space and time. The family of one-step PNPM schemes was introduced in [Dumbser et al., JCP, 2008] and represents a unified framework for classical high order Finite Volume (FV) schemes (N=0), the usual Discontinuous Galerkin (DG) methods (N=M), as well as a new class of intermediate hybrid schemes for which a reconstruction operator of degree M is applied over piecewise polynomial data of degree N with M>N. In all cases with M >= N > 0 the PNPM schemes are linear in the sense of Godunov, thus when considering phenomena characterized by discontinuities, spurious oscillations may appear and even destroy the simulation. Therefore, in this paper we present a new simple, robust and accurate a posteriori subcell finite volume limiting strategy that is valid for the entire class of PNPM schemes. The subcell FV limiter is activated only where it is needed, i.e. in the neighborhood of shocks or other discontinuities, and is able to maintain the resolution of the underlying high order PNPM schemes, due to the use of a rather fine subgrid of 2N+1 subcells per space dimension. The paper contains a wide set of test cases for different hyperbolic PDE systems, solved on adaptive Cartesian meshes (AMR) that show the capabilities of the proposed method both on smooth and discontinuous problems, as well as the broad range of its applicability. The tests range from compressible gasdynamics over classical MHD to relativistic magnetohydrodynamics.


title: Generalized master equation for first-passage problems in partitioned spaces

abstract: Motivated by a range of biological applications related to the transport of molecules in cells, we present a modular framework to treat first-passage problems for diffusion in partitioned spaces. The spatial domains can differ with respect to their diffusivity, geometry, and dimensionality, but can also refer to transport modes alternating between diffusive, driven, or anomalous motion. The approach relies on a coarse-graining of the motion by dissecting the trajectories on domain boundaries or when the mode of transport changes, yielding a small set of states. The time evolution of the reduced model follows a generalized master equation (GME) for non-Markovian jump processes; the GME takes the form of a set of linear integro-differential equations in the occupation probabilities of the states and the corresponding probability fluxes. Further building blocks of the model are partial first-passage time (FPT) densities, which encode the transport behavior in each domain or state. After an outline of the general framework for multiple domains, the approach is exemplified and validated for a target search problem with two domains in one- and three-dimensional space, first by exactly reproducing known results for an artificially divided, homogeneous space, and second by considering the situation of domains with distinct diffusivities. Analytical solutions for the FPT densities are given in Laplace domain and are complemented by numerical backtransforms yielding FPT densities over many decades in time, confirming that the geometry and heterogeneity of the space can introduce additional characteristic time scales.


title: Kernel Methods for Causal Functions: Dose, Heterogeneous, and Incremental Response Curves

abstract: We propose estimators based on kernel ridge regression for nonparametric causal functions such as dose, heterogeneous, and incremental response curves. Treatment and covariates may be discrete or continuous in general spaces. Due to a decomposition property specific to the RKHS, our estimators have simple closed form solutions. We prove uniform consistency with finite sample rates via original analysis of generalized kernel ridge regression. We extend our main results to counterfactual distributions and to causal functions identified by front and back door criteria. We achieve state-of-the-art performance in nonlinear simulations with many covariates, and conduct a policy evaluation of the US Job Corps training program for disadvantaged youths.


title: Study of quantum Otto heat engine using driven-dissipative Schr\"{o}dinger equation

abstract: The quantum heat engines have drawn much attention due to miniaturization of devices recently. We study the dynamics of the quantum Otto heat engine using the driven-dissipative Schr\"{o}dinger equation. Starting from different initial states, we simulate the time evolutions of the internal energy, power and heat-work conversion efficiency. The initial state impacts on these thermodynamic quantities before the Otto cycle reaches stable. In the transition period, the efficiency and power may be higher or lower than the corresponding values in the cyclostationary state. Remarkably, the efficiency could surpass the Otto limit and even the Carnot limit and the power could be much higher than the rated power. The efficiency anomaly is due to the energy in the initial state. Thus, we suggest that periodically pumping could take the similar role of a hot bath but could be manipulated flexibly. Furthermore, we propose a new quantum engine working in a single reservoir to convert the pump energy into mechanical work. This manipulative engine could potentially be applied to working in the microenvironments without a large temperature difference, such as the biological tissues in vivo. Our protocol is expected to model a new quantum engine with the advantage of applicability and controllability.


title: A teleparallel type theory for massless spin 2 fields

abstract: We present the Lagrangian and Hamiltonian formulations of a theory for spin 2 fields. The construction is developed in flat space-time. The construction in curved space-time is conceptually straightforward, although it is not unique. The theory is based on a symmetric tensor $S_{\mu\nu}$, contains two degrees of freedom of radiation, is motivated by the teleparallel formulation of general relativity, and displays a certain resemblance with Maxwell's theory for the electromagnetic field.


title: A novel exact magnetic black hole solution in four-dimensional extended scalar-tensor-Gauss-Bonnet theory

abstract: In this work the first exact asymptotically flat static and spherically symmetric black hole solution for $(3+1)$-dimensional ESTGB is presented, with a model of nonlinear electrodynamics -- that reduces to Maxwell's theory in the weak field limit and satisfies the weak energy condition -- as a source. The solution has a nonzero magnetic charge, and scalar hair, which turns out to be dependent of the magnetic charge. It is characterized by the ADM mass $m$ and the magnetic charge $q$. Depending on the range of these parameters, the solution describes black holes with different structure. In the case $m\geq0$ and $q\geq0$, it shares many of the characteristics of the Schwarzschild solution. For $m>0$ and $q<0$, it is akin to the Reissner-Nordstr\"om metric. In the case $m=0$, it represents a purely magnetic black hole.


title: Simultaneous Sorting of Wavelengths and Spatial Modes using Multi-Plane Light Conversion

abstract: We propose a wavelength-mode sorter realized by multi-plane light conversion (MPLC). For the first time, to our best knowledge, wavelengths and spatial modes can be sorted simultaneously. We first demonstrate pure wavelength sorting by a series of phase masks, which could find applications in high-power wavelength beam combining (WBC) or coarse wavelength-division multiplexing (CWDM), for example. We then present a design of a 4-wavelength, 3-mode sorter using only 5 phase masks. Insertion loss (IL) and mode dependent loss (MDL) as low as 1.27 dB and 2.45 dB can be achieved, respectively.


title: Element- and enantiomer-selective visualization of ibuprofen dimer vibrations

abstract: In chemistry, biology and materials science, the ability to access interatomic interactions and their dynamical evolution has become possible with the advent of femtosecond lasers. In particular, the observation of vibrational wave packets via optical (UV-visible-IR) spectroscopies has been a major achievement as it can track the motion of nuclei within the system. However, optical spectroscopies only detect the effect of the interatomic vibrations on the global electronic surfaces. New tuneable, pulsed and polarized sources of short-wavelength radiation, such as X-Ray Free electron lasers, can overcome this limitation, allowing for chemical and, of primary importance in biochemistry, enantiomeric selectivity. This selectivity may be complemented by taking into account the chemical shifts of atoms belonging to different molecular moieties


title: Electroweak decay of quark matter within dense astrophysical combustion flames

abstract: We study the weak interaction processes taking place within a combustion flame that converts dense hadronic matter into quark matter in a compact star. Using the Boltzmann equation we follow the evolution of a small element of just deconfined quark matter all along the flame interior until it reaches chemical equilibrium at the back boundary of the flame. We obtain the reaction rates and neutrino emissivities of all the relevant weak interaction processes without making any assumption about the neutrino degeneracy. We analyse systematically the role the initial conditions of unburnt hadronic matter, such as density, temperature, neutrino trapping and composition, focusing on typical astrophysical scenarios such as cold neutron stars, protoneutron stars, and post merger compact objects. We find that the temperature within the flame rises significantly in a timescale of 1 nanosecond. The increase in $T$ strongly depends on the initial strangeness of hadronic matter and tends to be more drastic at larger densities. Typical final values range between $20$ and $60 \, \mathrm{MeV}$. The nonleptonic process $u + d \rightarrow u + s$ is always dominant in cold stars, but in hot objects the process $u + e^{-} \leftrightarrow d + {\nu_e}$ becomes relevant, and in some cases dominant, near chemical equilibrium. The rates for the other processes are orders of magnitude smaller. We find that the neutrino emissivity per baryon is very large, leading to a total energy release per baryon of $2-60 \, \mathrm{MeV}$ in the form of neutrinos along the flame. We discuss some astrophysical consequences of the results.


title: Remarks on Optimal Scores for Speaker Recognition

abstract: In this article, we first establish the theory of optimal scores for speaker recognition. Our analysis shows that the minimum Bayes risk (MBR) decisions for both the speaker identification and speaker verification tasks can be based on a normalized likelihood (NL). When the underlying generative model is a linear Gaussian, the NL score is mathematically equivalent to the PLDA likelihood ratio, and the empirical scores based on cosine distance and Euclidean distance can be seen as approximations of this linear Gaussian NL score under some conditions. We discuss a number of properties of the NL score and perform a simple simulation experiment to demonstrate the properties of the NL score.


title: RatE: Relation-Adaptive Translating Embedding for Knowledge Graph Completion

abstract: Many graph embedding approaches have been proposed for knowledge graph completion via link prediction. Among those, translating embedding approaches enjoy the advantages of light-weight structure, high efficiency and great interpretability. Especially when extended to complex vector space, they show the capability in handling various relation patterns including symmetry, antisymmetry, inversion and composition. However, previous translating embedding approaches defined in complex vector space suffer from two main issues: 1) representing and modeling capacities of the model are limited by the translation function with rigorous multiplication of two complex numbers; and 2) embedding ambiguity caused by one-to-many relations is not explicitly alleviated. In this paper, we propose a relation-adaptive translation function built upon a novel weighted product in complex space, where the weights are learnable, relation-specific and independent to embedding size. The translation function only requires eight more scalar parameters each relation, but improves expressive power and alleviates embedding ambiguity problem. Based on the function, we then present our Relation-adaptive translating Embedding (RatE) approach to score each graph triple. Moreover, a novel negative sampling method is proposed to utilize both prior knowledge and self-adversarial learning for effective optimization. Experiments verify RatE achieves state-of-the-art performance on four link prediction benchmarks.


title: A clustering-based biased Monte Carlo approach to protein titration curve prediction

abstract: In this work, we developed an efficient approach to compute ensemble averages in systems with pairwise-additive energetic interactions between the entities. Methods involving full enumeration of the configuration space result in exponential complexity. Sampling methods such as Markov Chain Monte Carlo (MCMC) algorithms have been proposed to tackle the exponential complexity of these problems; however, in certain scenarios where significant energetic coupling exists between the entities, the efficiency of the such algorithms can be diminished. We used a strategy to improve the efficiency of MCMC by taking advantage of the cluster structure in the interaction energy matrix to bias the sampling. We pursued two different schemes for the biased MCMC runs and show that they are valid MCMC schemes. We used both synthesized and real-world systems to show the improved performance of our biased MCMC methods when compared to the regular MCMC method. In particular, we applied these algorithms to the problem of estimating protonation ensemble averages and titration curves of residues in a protein.


title: Learning Acoustic Scattering Fields for Dynamic Interactive Sound Propagation

abstract: We present a novel hybrid sound propagation algorithm for interactive applications. Our approach is designed for dynamic scenes and uses a neural network-based learned scattered field representation along with ray tracing to generate specular, diffuse, diffraction, and occlusion effects efficiently. We use geometric deep learning to approximate the acoustic scattering field using spherical harmonics. We use a large 3D dataset for training, and compare its accuracy with the ground truth generated using an accurate wave-based solver. The additional overhead of computing the learned scattered field at runtime is small and we demonstrate its interactive performance by generating plausible sound effects in dynamic scenes with diffraction and occlusion effects. We demonstrate the perceptual benefits of our approach based on an audio-visual user study.


title: Failed and delayed protostellar outflows with high mass accretion rates

abstract: The evolution of protostellar outflows is investigated under different mass accretion rates in the range $\sim10^{-5}-10^{-2} {\rm M}_\odot$ yr$^{-1}$ with three-dimensional magnetohydrodynamic simulations. A powerful outflow always appears in strongly magnetized clouds with $B_0 \gtrsim B_{\rm 0, cr}$ $=10^{-4} (M_{\rm cl}/100 {\rm M}_\odot){\rm G}$, where $M_{\rm cl}$ is the cloud mass. When a cloud has a weaker magnetic field, the outflow does not evolve promptly with a high mass accretion rate. In some cases with moderate magnetic fields $B_0$ slightly smaller than $B_{\rm 0,cr}$, the outflow growth is suppressed or delayed until the infalling envelope dissipates and the ram pressure around the protostellar system is significantly reduced. In such an environment, the outflow begins to grow and reaches a large distance only during the late accretion phase. On the other hand, the protostellar outflow fails to evolve and is finally collapsed by the strong ram pressure when a massive $(\gtrsim 100 {\rm M}_\odot)$ initial cloud is weakly magnetized with $B_0 \lesssim 100 \mu {\rm G}$. The failed outflow creates a toroidal structure that is supported by magnetic pressure and encloses the protostar and disk system. Our results indicate that high-mass stars form only in strongly magnetized clouds, if all high-mass protostars possess a clear outflow. If we would observe either very weak or no outflow around evolved protostars, it means that strong magnetic fields are not necessarily required for high-mass star formation. In any case, we can constrain the high-mass star formation process from observations of outflows.


title: Radial solutions of the hydrodynamic model of semiconductors with sonic boundary

abstract: The purpose of this paper is to study radial solutions for steady hydrodynamic model of semiconductors represented by Euler-Poisson equations with sonic boundary. The existence and uniqueness of radial subsonic solution, and the existence of radial supersonic solutions are derived by using the energy method and the compactness method, but under a general condition of the doping profile. In particular, for radial supersonic solutions, it is more difficult to get the related estimates by the effect of high dimensional space and the sonic boundary, so we apply a special iteration to complete the proofs. The results obtained essentially improve and develop the previous studies in the one-dimensional case.


title: Temporal Vectorization for Stencils

abstract: Stencil computations represent a very common class of nested loops in scientific and engineering applications. Exploiting vector units in modern CPUs is crucial to achieving peak performance. Previous vectorization approaches often consider the data space, in particular the innermost unit-strided loop. It leads to the well-known data alignment conflict problem that vector loads are overlapped due to the data sharing between continuous stencil computations. This paper proposes a novel temporal vectorization scheme for stencils. It vectorizes the stencil computation in the iteration space and assembles points with different time coordinates in one vector. The temporal vectorization leads to a small fixed number of vector reorganizations that is irrelevant to the vector length, stencil order, and dimension. Furthermore, it is also applicable to Gauss-Seidel stencils, whose vectorization is not well-studied. The effectiveness of the temporal vectorization is demonstrated by various Jacobi and Gauss-Seidel stencils.


title: Direct Measurement of Curvature-Dependent Surface Tension in a Capillary-Condensed Alcohol Nanomeniscus

abstract: Surface tension is a key parameter for understanding nucleation from the very initial stage of phase transformation. Although surface tension has been predicted to vary with the curvature of the liquid-vapor interface, particularly at the large curvature of, e.g., the subnanometric critical nucleus, experimental study still remains challenging due to inaccessibility to such a small cluster. Here, by directly measuring the critical size of a single capillary-condensed nanomeniscus using atomic force microscopy, we address the curvature dependence of surface tension of alcohols and observe the surface tension is doubled for ethanol and n-propanol with the radius-of-curvature of ~ -0.46 nm. We also find that the interface of larger negative (positive) curvature exhibits the larger (smaller) surface tension, which evidently governs nucleation at ~ 1 nm scale, indicating more facilitated nucleation than normally expected. Such well characterized curvature effects contribute to better understanding and accurate analysis of nucleation occurring in various fields including material science and atmospheric science.


title: Robust Constrained-MDPs: Soft-Constrained Robust Policy Optimization under Model Uncertainty

abstract: In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision process (CMDP), with the theory of robust Markov decision process (RMDP), leading to a formulation of robust constrained-MDPs (RCMDP). This formulation, simple in essence, allows us to design RL algorithms that are robust in performance, and provides constraint satisfaction guarantees, with respect to uncertainties in the system's states transition probabilities. The need for RCMPDs is important for real-life applications of RL. For instance, such formulation can play an important role for policy transfer from simulation to real world (Sim2Real) in safety critical applications, which would benefit from performance and safety guarantees which are robust w.r.t model uncertainty. We first propose the general problem formulation under the concept of RCMDP, and then propose a Lagrangian formulation of the optimal problem, leading to a robust-constrained policy gradient RL algorithm. We finally validate this concept on the inventory management problem.


title: Training Binary Neural Networks through Learning with Noisy Supervision

abstract: This paper formalizes the binarization operations over neural networks from a learning perspective. In contrast to classical hand crafted rules (\eg hard thresholding) to binarize full-precision neurons, we propose to learn a mapping from full-precision neurons to the target binary ones. Each individual weight entry will not be binarized independently. Instead, they are taken as a whole to accomplish the binarization, just as they work together in generating convolution features. To help the training of the binarization mapping, the full-precision neurons after taking sign operations is regarded as some auxiliary supervision signal, which is noisy but still has valuable guidance. An unbiased estimator is therefore introduced to mitigate the influence of the supervision noise. Experimental results on benchmark datasets indicate that the proposed binarization technique attains consistent improvements over baselines.


title: Self-play for Data Efficient Language Acquisition

abstract: When communicating, people behave consistently across conversational roles: People understand the words they say and are able to produce the words they hear. To date, artificial agents developed for language tasks have lacked such symmetry, meaning agents trained to produce language are unable to understand it and vice-versa. In this work, we exploit the symmetric nature of communication in order to improve both the efficiency and quality of language acquisition in learning agents. Specifically, we consider the setting in which an agent must learn to both understand and generate words in an existing language, but with the assumption that access to interaction with "oracle" speakers of the language is very limited. We show that using self-play as a substitute for direct supervision enables the agent to transfer its knowledge across roles (e.g. training as a listener but testing as a speaker) and make better inferences about the ground truth lexicon using only a handful of interactions with the oracle.


title: Unveiling Class-Labeling Structure for Universal Domain Adaptation

abstract: As a more practical setting for unsupervised domain adaptation, Universal Domain Adaptation (UDA) is recently introduced, where the target label set is unknown. One of the big challenges in UDA is how to determine the common label set shared by source and target domains, as there is simply no labeling available in the target domain. In this paper, we employ a probabilistic approach for locating the common label set, where each source class may come from the common label set with a probability. In particular, we propose a novel approach for evaluating the probability of each source class from the common label set, where this probability is computed by the prediction margin accumulated over the whole target domain. Then, we propose a simple universal adaptation network (S-UAN) by incorporating the probabilistic structure for the common label set. Finally, we analyse the generalization bound focusing on the common label set and explore the properties on the target risk for UDA. Extensive experiments indicate that S-UAN works well in different UDA settings and outperforms the state-of-the-art methods by large margins.


title: The Analytic Classification of Plane Curves

abstract: In this paper, we present a solution to the problem of the analytic classification of germs of plane curves with several irreducible components. Our algebraic approach follows precursive ideas of Oscar Zariski and as a subproduct allow us to recover some particular cases found in the literature.


title: Point process models for sequence detection in high-dimensional neural spike trains

abstract: Sparse sequences of neural spikes are posited to underlie aspects of working memory, motor production, and learning. Discovering these sequences in an unsupervised manner is a longstanding problem in statistical neuroscience. Promising recent work utilized a convolutive nonnegative matrix factorization model to tackle this challenge. However, this model requires spike times to be discretized, utilizes a sub-optimal least-squares criterion, and does not provide uncertainty estimates for model predictions or estimated parameters. We address each of these shortcomings by developing a point process model that characterizes fine-scale sequences at the level of individual spikes and represents sequence occurrences as a small number of marked events in continuous time. This ultra-sparse representation of sequence events opens new possibilities for spike train modeling. For example, we introduce learnable time warping parameters to model sequences of varying duration, which have been experimentally observed in neural circuits. We demonstrate these advantages on experimental recordings from songbird higher vocal center and rodent hippocampus.


title: Instability dynamics of nonlinear normal modes in the Fermi-Pasta-Ulam-Tsingou chains

abstract: Nonlinear normal modes are periodic orbits that survive in nonlinear chains, whose instability plays a crucial role in the dynamics of many-body Hamiltonian systems toward thermalization. Here we focus on how the stability of nonlinear modes depends on the perturbation strength and the system size to observe whether they have the same behavior in different models. To this end, as illustrating examples, the instability dynamics of the ${N}/{2}$ mode in both the Fermi-Pasta-Ulam-Tsingou (FPUT) -$\alpha$ and -$\beta$ chains under fixed boundary conditions are studied systematically. Applying the Floquet theory, we show that for both models the stability time $T$ as a function of the perturbation strength $\lambda$ follows the same behavior; i.e., $T\propto(\lambda-\lambda_c)^{-\frac{1}{2}}$, where $\lambda_c$ is the instability threshold. The dependence of $\lambda_c$ on $N$ is also obtained. The results of $T$ and $\lambda_c$ agree well with those obtained by the direct molecular dynamics simulations. Finally, the effect of instability dynamics on the thermalization properties of a system is briefly discussed.


title: Analysis of Users Reaction around Impeachment in Peru using Twitter

abstract: Covid-19 pandemic generated many problems and show other hidden issues in countries in South America. Every government analyzed his own context and decided which health policies would be used. Peru is a country in the middle of South America region, the first reported case was on March 6. Besides, a lockdown was established in ground borders, sea and air. Peruvian government analyzed the context and proposed many policies around health, economy, employment, transport. But, these action were not enough for the existence of previous lack of infrastructure in hospitals, as result of past governments. By the other hand, a variety of politic parties in the Parliament and their search for own interests, was evidenced during this pandemic period. Considering previous condition of lack of success in health, economic policies, the discussion about possible impeachment started. Therefore, this work has the main aim of finding evidence about what users were talking about and what was the impact on Peruvian population using Twitter.


title: Power Spectra of Constrained Codes with Level-Based Signaling: Overcoming Finite-Length Challenges

abstract: Constrained codes are used to eliminate error-prone patterns in various practical systems. Recently, we introduced efficient binary symmetric lexicographically-ordered constrained (LOCO) codes and asymmetric LOCO (A-LOCO) codes to increase density in magnetic recording systems and lifetime in Flash systems by eliminating the relevant detrimental patterns. Due to their application, LOCO and A-LOCO codes are associated with level-based signaling. Studying the power spectrum of a random signal with certain properties is principal for any storage or transmission system. In this paper, we first modify a framework from the literature in order to introduce a method to derive the power spectrum of a sequence of constrained data associated with level-based signaling. We apply our method to infinitely long sequences satisfying symmetric and asymmetric constraints. Next, we show how to generalize the method such that it works for a stream of finite-length codewords. We use the generalized method to devise closed forms for the spectra of finite-length LOCO and A-LOCO codes from their transition diagrams. Our LOCO and A-LOCO spectral derivations can be performed for any code length and can be extended to other constrained codes. We plot these power spectra, and discuss various important spectral properties for both LOCO and A-LOCO codes.


title: Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework

abstract: Most neural network pruning methods, such as filter-level and layer-level prunings, prune the network model along one dimension (depth, width, or resolution) solely to meet a computational budget. However, such a pruning policy often leads to excessive reduction of that dimension, thus inducing a huge accuracy loss. To alleviate this issue, we argue that pruning should be conducted along three dimensions comprehensively. For this purpose, our pruning framework formulates pruning as an optimization problem. Specifically, it first casts the relationships between a certain model's accuracy and depth/width/resolution into a polynomial regression and then maximizes the polynomial to acquire the optimal values for the three dimensions. Finally, the model is pruned along the three optimal dimensions accordingly. In this framework, since collecting too much data for training the regression is very time-costly, we propose two approaches to lower the cost: 1) specializing the polynomial to ensure an accurate regression even with less training data; 2) employing iterative pruning and fine-tuning to collect the data faster. Extensive experiments show that our proposed algorithm surpasses state-of-the-art pruning algorithms and even neural architecture search-based algorithms.


title: Designing for Recommending Intermediate States in A Scientific Workflow Management System

abstract: To process a large amount of data sequentially and systematically, proper management of workflow components (i.e., modules, data, configurations, associations among ports and links) in a Scientific Workflow Management System (SWfMS) is inevitable. Managing data with provenance in a SWfMS to support reusability of workflows, modules, and data is not a simple task. Handling such components is even more burdensome for frequently assembled and executed complex workflows for investigating large datasets with different technologies (i.e., various learning algorithms or models). However, a great many studies propose various techniques and technologies for managing and recommending services in a SWfMS, but only a very few studies consider the management of data in a SWfMS for efficient storing and facilitating workflow executions. Furthermore, there is no study to inquire about the effectiveness and efficiency of such data management in a SWfMS from a user perspective. In this paper, we present and evaluate a GUI version of such a novel approach of intermediate data management with two use cases (Plant Phenotyping and Bioinformatics). The technique we call GUI-RISPTS (Recommending Intermediate States from Pipelines Considering Tool-States) can facilitate executions of workflows with processed data (i.e., intermediate outcomes of modules in a workflow) and can thus reduce the computational time of some modules in a SWfMS. We integrated GUI-RISPTS with an existing workflow management system called SciWorCS. In SciWorCS, we present an interface that users use for selecting the recommendation of intermediate states (i.e., modules' outcomes). We investigated GUI-RISP's effectiveness from users' perspectives along with measuring its overhead in terms of storage and efficiency in workflow execution.


title: Twilled 3-Lie algebras, generalized matched pairs of 3-Lie algebras and O-operators

abstract: In this paper, first we introduce the notion of a twilled 3-Lie algebra, and construct an $L_\infty$-algebra, whose Maurer-Cartan elements give rise to new twilled 3-Lie algebras by twisting. In particular, we recover the Lie $3$-algebra whose Maurer-Cartan elements are O-operators (also called relative Rota-Baxter operators) on 3-Lie algebras. Then we introduce the notion of generalized matched pairs of 3-Lie algebras using generalized representations of 3-Lie algebras, which will give rise to twilled 3-Lie algebras. The usual matched pairs of 3-Lie algebras correspond to a special class of twilled 3-Lie algebras, which we call strict twilled 3-Lie algebras. Finally, we use O-operators to construct explicit twilled 3-Lie algebras, and explain why an $r$-matrix for a 3-Lie algebra can not give rise to a double construction 3-Lie bialgebra. Examples of twilled 3-Lie algebras are given to illustrate the various interesting phenomenon.


title: Modified Wave Operators for the Wave-Klein-Gordon System

abstract: We consider a coupled Wave-Klein-Gordon system in 3D, which is a simplified model for the global nonlinear stability of the Minkowski space-time for self-gravitating massive fields. In this paper we study the large-time asymptotic behavior of solutions to such systems, and prove modified wave operators for small and smooth data with mild decay at infinity. The key novelty comes from a crucial observation that the asymptotic dynamics are dictated by the resonant interactions. As a consequence, our main results include the derivation of a resonant system with good error bounds, and a detailed description of the asymptotic dynamics of such quasilinear evolution system of hyperbolic and dispersive type.


title: Adversarial Self-Supervised Data-Free Distillation for Text Classification

abstract: Large pre-trained transformer-based language models have achieved impressive results on a wide range of NLP tasks. In the past few years, Knowledge Distillation(KD) has become a popular paradigm to compress a computationally expensive model to a resource-efficient lightweight model. However, most KD algorithms, especially in NLP, rely on the accessibility of the original training dataset, which may be unavailable due to privacy issues. To tackle this problem, we propose a novel two-stage data-free distillation method, named Adversarial self-Supervised Data-Free Distillation (AS-DFD), which is designed for compressing large-scale transformer-based models (e.g., BERT). To avoid text generation in discrete space, we introduce a Plug & Play Embedding Guessing method to craft pseudo embeddings from the teacher's hidden knowledge. Meanwhile, with a self-supervised module to quantify the student's ability, we adapt the difficulty of pseudo embeddings in an adversarial training manner. To the best of our knowledge, our framework is the first data-free distillation framework designed for NLP tasks. We verify the effectiveness of our method on several text classification datasets.


title: Truck-and-Trailer Backer-Upper problem using Cascaded Fuzzy Controllers

abstract: In this paper we craft a cascaded fuzzy controlling system for the traditional Truck-and-Trailer Backer-Upper problem, which is a benchmarking for testing various intelligent controlling systems. Inspired by the most inclination of human operations, we decompose the original overall controlling problem into two sub-controlling problems. A first fuzzy controller which predicts the optimal deviation of the trailer leading to a most potential successful docking is designed based on previous work of other scholars, then a second fuzzy controller which maximizes such a potentiality is applied to the truck in an intuitive manner. The final simulation and results not only demonstrate the practicability of the approach proposed in this paper, but also exhibits the dramatic simplicity compared with previous work which try to optimize the system from overall perspective.


title: Towards a Conversational Measure of Trust

abstract: The increasingly collaborative decision-making process between humans and agents demands a comprehensive, continuous, and unobtrusive measure of trust in agents. The gold standard format for measuring trust, a Likert-style survey, suffers from major limitations in dynamic human-agent interactions. We proposed a new approach to evaluate trust in a nondirective and relational conversation. The term nondirective refers to abstract word selections in open-ended prompts, which can probe respondents to freely describe their attitudes. The term relational refers to interactive conversations where respondents can clarify their responses in followup questions. We propose a systematic process for generating nondirective trust-based prompts by using text analysis from previously validated trust scales. This nondirective and relational approach provides a complementary trust measurement, which can unobtrusively elicit rich and dynamic information on situational trust throughout a human-agent interaction.


title: Regional Flood Risk Projections under Climate Change

abstract: Flood-related risks to people and property are expected to increase in the future due to environmental and demographic changes. It is important to quantify and effectively communicate flood hazards and exposure to inform the design and implementation of flood risk management strategies. Here we develop an integrated modeling framework to assess projected changes in regional riverine flood inundation risks. The framework samples climate model outputs to force a hydrologic model and generate streamflow projections. Together with a statistical and hydraulic model, we use the projected streamflow to map the uncertainty of flood inundation projections for extreme flood events. We implement the framework for rivers across the state of Pennsylvania, United States. Our projections suggest that flood hazards and exposure across Pennsylvania are overall increasing with future climate change. Specific regions, including the main stem Susquehanna River, lower portion of the Allegheny basin and central portion of Delaware River basin, demonstrate higher flood inundation risks. In our analysis, the climate uncertainty dominates the overall uncertainty surrounding the flood inundation projection chain. The combined hydrologic and hydraulic uncertainties can account for as much as 37% of the total uncertainty. We discuss how this framework can provide regional and dynamic flood-risk assessments and help to inform the design of risk-management strategies.


title: Discourse structure interacts with reference but not syntax in neural language models

abstract: Language models (LMs) trained on large quantities of text have been claimed to acquire abstract linguistic representations. Our work tests the robustness of these abstractions by focusing on the ability of LMs to learn interactions between different linguistic representations. In particular, we utilized stimuli from psycholinguistic studies showing that humans can condition reference (i.e. coreference resolution) and syntactic processing on the same discourse structure (implicit causality). We compared both transformer and long short-term memory LMs to find that, contrary to humans, implicit causality only influences LM behavior for reference, not syntax, despite model representations that encode the necessary discourse information. Our results further suggest that LM behavior can contradict not only learned representations of discourse but also syntactic agreement, pointing to shortcomings of standard language modeling.


title: Endpoint regularity for $2d$ Mumford-Shah minimizers: On a theorem of Andersson and Mikayelyan

abstract: We give an alternative proof of the regularity, up to the loose end, of minimizers, resp. critical points of the Mumford-Shah functional when they are sufficiently close to the cracktip, resp. they consist of a single arc terminating at an interior point.


title: Deep Active Learning for Joint Classification & Segmentation with Weak Annotator

abstract: CNN visualization and interpretation methods, like class-activation maps (CAMs), are typically used to highlight the image regions linked to class predictions. These models allow to simultaneously classify images and extract class-dependent saliency maps, without the need for costly pixel-level annotations. However, they typically yield segmentations with high false-positive rates and, therefore, coarse visualisations, more so when processing challenging images, as encountered in histology. To mitigate this issue, we propose an active learning (AL) framework, which progressively integrates pixel-level annotations during training. Given training data with global image-level labels, our deep weakly-supervised learning model jointly performs supervised image-level classification and active learning for segmentation, integrating pixel annotations by an oracle. Unlike standard AL methods that focus on sample selection, we also leverage large numbers of unlabeled images via pseudo-segmentations (i.e., self-learning at the pixel level), and integrate them with the oracle-annotated samples during training. We report extensive experiments over two challenging benchmarks -- high-resolution medical images (histology GlaS data for colon cancer) and natural images (CUB-200-2011 for bird species). Our results indicate that, by simply using random sample selection, the proposed approach can significantly outperform state-of the-art CAMs and AL methods, with an identical oracle-supervision budget. Our code is publicly available.


title: Rare-Event Simulation for Neural Network and Random Forest Predictors

abstract: We study rare-event simulation for a class of problems where the target hitting sets of interest are defined via modern machine learning tools such as neural networks and random forests. This problem is motivated from fast emerging studies on the safety evaluation of intelligent systems, robustness quantification of learning models, and other potential applications to large-scale simulation in which machine learning tools can be used to approximate complex rare-event set boundaries. We investigate an importance sampling scheme that integrates the dominating point machinery in large deviations and sequential mixed integer programming to locate the underlying dominating points. Our approach works for a range of neural network architectures including fully connected layers, rectified linear units, normalization, pooling and convolutional layers, and random forests built from standard decision trees. We provide efficiency guarantees and numerical demonstration of our approach using a classification model in the UCI Machine Learning Repository.


title: Online Optimal Control with Affine Constraints

abstract: This paper considers online optimal control with affine constraints on the states and actions under linear dynamics with bounded random disturbances. The system dynamics and constraints are assumed to be known and time-invariant but the convex stage cost functions change adversarially. To solve this problem, we propose Online Gradient Descent with Buffer Zones (OGD-BZ). Theoretically, we show that OGD-BZ with proper parameters can guarantee the system to satisfy all the constraints despite any admissible disturbances. Further, we investigate the policy regret of OGD-BZ, which compares OGD-BZ's performance with the performance of the optimal linear policy in hindsight. We show that OGD-BZ can achieve a policy regret upper bound that is the square root of the horizon length multiplied by some logarithmic terms of the horizon length under proper algorithm parameters.


title: Broken External Links on Stack Overflow

abstract: Stack Overflow hosts valuable programming-related knowledge with 11,926,354 links that reference to the third-party websites. The links that reference to the resources hosted outside the Stack Overflow websites extend the Stack Overflow knowledge base substantially. However, with the rapid development of programming-related knowledge, many resources hosted on the Internet are not available anymore. Based on our analysis of the Stack Overflow data that was released on Jun. 2, 2019, 14.2% of the links on Stack Overflow are broken links. The broken links on Stack Overflow can obstruct viewers from obtaining desired programming-related knowledge, and potentially damage the reputation of the Stack Overflow as viewers might regard the posts with broken links as obsolete. In this paper, we characterize the broken links on Stack Overflow. 65% of the broken links in our sampled questions are used to show examples, e.g., code examples. 70% of the broken links in our sampled answers are used to provide supporting information, e.g., explaining a certain concept and describing a step to solve a problem. Only 1.67% of the posts with broken links are highlighted as such by viewers in the posts' comments. Only 5.8% of the posts with broken links removed the broken links. Viewers cannot fully rely on the vote scores to detect broken links, as broken links are common across posts with different vote scores. The websites that host resources that can be maintained by their users are referenced by broken links the most on Stack Overflow -- a prominent example of such websites is GitHub. The posts and comments related to the web technologies, i.e., JavaScript, HTML, CSS, and jQuery, are associated with more broken links. Based on our findings, we shed lights for future directions and provide recommendations for practitioners and researchers.


title: Trust the Model When It Is Confident: Masked Model-based Actor-Critic

abstract: It is a popular belief that model-based Reinforcement Learning (RL) is more sample efficient than model-free RL, but in practice, it is not always true due to overweighed model errors. In complex and noisy settings, model-based RL tends to have trouble using the model if it does not know when to trust the model. In this work, we find that better model usage can make a huge difference. We show theoretically that if the use of model-generated data is restricted to state-action pairs where the model error is small, the performance gap between model and real rollouts can be reduced. It motivates us to use model rollouts only when the model is confident about its predictions. We propose Masked Model-based Actor-Critic (M2AC), a novel policy optimization algorithm that maximizes a model-based lower-bound of the true value function. M2AC implements a masking mechanism based on the model's uncertainty to decide whether its prediction should be used or not. Consequently, the new algorithm tends to give robust policy improvements. Experiments on continuous control benchmarks demonstrate that M2AC has strong performance even when using long model rollouts in very noisy environments, and it significantly outperforms previous state-of-the-art methods.


title: HAMLET: A Hierarchical Agent-based Machine Learning Platform

abstract: Hierarchical Multi-Agent Systems provide convenient and relevant ways to analyze, model, and simulate complex systems composed of a large number of entities that interact at different levels of abstraction. In this paper, we introduce HAMLET (Hierarchical Agent-based Machine LEarning plaTform), a hybrid machine learning platform based on hierarchical multi-agent systems, to facilitate the research and democratization of geographically and/or locally distributed machine learning entities. The proposed system models a machine learning solutions as a hypergraph and autonomously sets up a multi-level structure of heterogeneous agents based on their innate capabilities and learned skills. HAMLET aids the design and management of machine learning systems and provides analytical capabilities for research communities to assess the existing and/or new algorithms/datasets through flexible and customizable queries. The proposed hybrid machine learning platform does not assume restrictions on the type of learning algorithms/datasets and is theoretically proven to be sound and complete with polynomial computational requirements. Additionally, it is examined empirically on 120 training and four generalized batch testing tasks performed on 24 machine learning algorithms and 9 standard datasets. The provided experimental results not only establish confidence in the platform's consistency and correctness but also demonstrate its testing and analytical capacity.