title: lgpr: An interpretable nonparametric method for inferring covariate effects from longitudinal data

abstract: Longitudinal study designs are indispensable for studying disease progression. Inferring covariate effects from longitudinal data, however, requires interpretable methods that can model complicated covariance structures and detect nonlinear effects of both categorical and continuous covariates, as well as their interactions. Detecting disease effects is hindered by the fact that they often occur rapidly near the disease initiation time, and this time point cannot be exactly observed. An additional challenge is that the effect magnitude can be heterogeneous over the subjects. We present lgpr, a widely applicable and interpretable method for nonparametric analysis of longitudinal data using additive Gaussian processes. We demonstrate that it outperforms previous approaches in identifying the relevant categorical and continuous covariates in various settings. Furthermore, it implements important novel features, including the ability to account for the heterogeneity of covariate effects, their temporal uncertainty, and appropriate observation models for different types of biomedical data. The lgpr tool is implemented as a comprehensive and user-friendly R-package. lgpr is available at jtimonen.github.io/lgpr-usage with documentation, tutorials, test data, and code for reproducing the experiments of this paper.


title: Minimax Adaptive Control for State Matrix with Unknown Sign

abstract: For linear time-invariant systems having a state matrix with uncertain sign, we formulate a minimax adaptive control problem as a zero sum dynamic game. Explicit expressions for the optimal value function and the optimal control law are given in terms of a Riccati equation. The optimal control law is adaptive in the sense the past data is used to estimate the uncertain sign for prediction of future dynamics. Once the sign has been estimated, the controller behaves like standard H-infinity optimal state feedback.


title: Coarsening Kinetics of Complex Macromolecular Architectures in Bad Solvent

abstract: This study reports a general scenario for the out-of-equilibrium features of collapsing polymeric architectures. We use molecular dynamics simulations to characterize the coarsening kinetics, in bad solvent, for several macromolecular systems with an increasing degree of structural complexity. In particular, we focus on: flexible and semiflexible polymer chains, star polymers with 3 and 12 arms, and microgels with both ordered and disordered networks. Starting from a powerful analogy with critical phenomena, we construct a density field representation that removes fast fluctuations and provides a consistent characterization of the domain growth. Our results indicate that the coarsening kinetics presents a scaling behaviour that is independent of the solvent quality parameter, in analogy to time-temperature superposition principle. Interestingly, the domain growth in time follows a power-law behaviour that is approximately independent of the architecture for all the flexible systems; while it is steeper for the semiflexible chains. Nevertheless, the fractal nature of the dense regions emerging during the collapse exhibits the same scaling behaviour for all the macromolecules. This, suggests that the faster growing length scale in the semiflexible chains originates just from a faster mass diffusion along the chain contour, induced by the local stiffness. The decay of the dynamic correlations displays scaling behavior with the growing length scale of the system, which is a characteristic signature in coarsening phenomena.


title: Unravelling Ariadne's Thread: Exploring the Threats of Decentalised DNS

abstract: The current landscape of the core Internet technologies shows considerable centralisation with the big tech companies controlling the vast majority of traffic and services. This has sparked a wide range of decentralisation initiatives with perhaps the most profound and successful being the blockchain technology. In the past years, a core Internet infrastructure, domain name system (DNS), is being revised mainly due to its inherent security and privacy issues. One of the proposed panaceas is Blockchain-based DNS, which claims to solve many issues of traditional DNS. However, this does not come without security concerns and issues, as any introduction and adoption of a new technology does - let alone a disruptive one such as blockchain. In this work, we discuss a number of associated threats, including emerging ones, and we validate many of them with real-world data. In this regard, we explore a part of the blockchain DNS ecosystem in terms of the browser extensions using such technologies, the chain itself (Namecoin and Emercoin), the domains, and users which have been registered in both platforms. Finally, we provide some countermeasures to address the identified threats, and we propose a fertile common ground for further research.


title: Learning Norms from Stories: A Prior for Value Aligned Agents

abstract: Value alignment is a property of an intelligent agent indicating that it can only pursue goals and activities that are beneficial to humans. Traditional approaches to value alignment use imitation learning or preference learning to infer the values of humans by observing their behavior. We introduce a complementary technique in which a value aligned prior is learned from naturally occurring stories which encode societal norms. Training data is sourced from the childrens educational comic strip, Goofus and Gallant. In this work, we train multiple machine learning models to classify natural language descriptions of situations found in the comic strip as normative or non normative by identifying if they align with the main characters behavior. We also report the models performance when transferring to two unrelated tasks with little to no additional training on the new task.


title: Design and Characteristics of a Population Inversion X-ray Laser Oscillator

abstract: Oscillators are at the heart of optical lasers, providing stable transform limited pulses. In contrast, X-ray free electron lasers use self-amplified spontaneous emission (SASE), resulting in large stochastic intensity and spectral fluctuations. Amplified spontaneous emission (ASE) of the $K\alpha_1$ line has been recently observed for Ne gas, Cu compounds and Mn solutions at the LCLS and SACLA X-ray free electron lasers (XFELs), using an X-ray SASE pulse as a pump to create population inversion. Here we describe the physics and realization of an X-ray laser oscillator (XLO) based on periodically pumping a Cu compound gain medium in a tunable Bragg cavity with a SASE pulse train, generating intense ($\sim$ 5 x 10$^{10}$ ph/pulse), fully coherent, transform limited 8 keV pulses with 48 meV spectral resolution. We also discuss extending these results to other elements to operate XLO from about 5 to 12 keV, improving X-ray-based research beyond current capabilities.


title: New examples of non-Fourier-Mukai functors

abstract: In this paper we prove that any smooth projective variety of dimension $\ge 3$ equipped with a tilting bundle can serve as the source variety of a non-Fourier-Mukai functor between smooth projective schemes.


title: A percolation model for the emergence of the Bitcoin Lightning Network

abstract: The Lightning Network is a so-called second-layer technology built on top of the Bitcoin blockchain to provide "off-chain" fast payment channels between users, which means that not all transactions are settled and stored on the main blockchain. In this paper, we model the emergence of the Lightning Network as a (bond) percolation process and we explore how the distributional properties of the volume and size of transactions per user may impact its feasibility. The agents are all able to reciprocally transfer Bitcoins using the main blockchain and also - if economically convenient - to open a channel on the Lightning Network and transact "off chain". We base our approach on fitness-dependent network models: as in real life, a Lightning channel is opened with a probability that depends on the "fitness" of the concurring nodes, which in turn depends on wealth and volume of transactions. The emergence of a connected component is studied numerically and analytically as a function of the parameters, and the phase transition separating regions in the phase space where the Lightning Network is sustainable or not is elucidated. We characterize the phase diagram determining the minimal volume of transactions that would make the Lightning Network sustainable for a given level of fees or, alternatively, the maximal cost the Lightning ecosystem may impose for a given average volume of transactions. The model includes parameters that could be in principle estimated from publicly available data once the evolution of the Lighting Network will have reached a stationary operable state, and is fairly robust against different choices of the distributions of parameters and fitness kernels.


title: Growth Mode Selection of Radially Growing Turing Patterns

abstract: We study Turing pattern formation in a system undergoing radial growth in two dimensions. The Lengyel-Epstein two variable model is implemented in COMSOL Multiphysics and solved on domains growing at different speeds while sweeping other parameters to examine a wide range of Turing pattern morphologies. By altering the configuration of the finite element mesh, we examine patterning in several simulation growth modes. The observed pattern morphologies match previously observed trends for Turing pattern growth modes. Fast growth leads to pattern formation parallel to the growing boundary, intermediate growth leads to pattern formation perpendicular to the growing boundary, and slow growth leads to pattern growth from the interior. Exponential growth leads to the expected fast-growth mode of pattern formation parallel to the moving boundary. Simulations to replicate interior growth using logistic illumination do not show simple pattern trends due to the effects of partial pattern suppression from the illumination.


title: Hierarchical Cooperative Multi-Agent Reinforcement Learning with Skill Discovery

abstract: Human players in professional team sports achieve high level coordination by dynamically choosing complementary skills and executing primitive actions to perform these skills. As a step toward creating intelligent agents with this capability for fully cooperative multi-agent settings, we propose a two-level hierarchical multi-agent reinforcement learning (MARL) algorithm with unsupervised skill discovery. Agents learn useful and distinct skills at the low level via independent Q-learning, while they learn to select complementary latent skill variables at the high level via centralized multi-agent training with an extrinsic team reward. The set of low-level skills emerges from an intrinsic reward that solely promotes the decodability of latent skill variables from the trajectory of a low-level skill, without the need for hand-crafted rewards for each skill. For scalable decentralized execution, each agent independently chooses latent skill variables and primitive actions based on local observations. Our overall method enables the use of general cooperative MARL algorithms for training high level policies and single-agent RL for training low level skills. Experiments on a stochastic high dimensional team game show the emergence of useful skills and cooperative team play. The interpretability of the learned skills show the promise of the proposed method for achieving human-AI cooperation in team sports games.


title: Mechanisms of electron-phonon coupling unraveled in momentum and time: The case of soft-phonons in TiSe$_2$

abstract: The complex coupling between charge carriers and phonons is responsible for diverse phenomena in condensed matter. We apply ultrafast electron diffuse scattering to unravel electron-phonon coupling phenomena in 1T-TiSe$_2$ in both momentum and time. We are able to distinguish effects due to the real part of the many-body bare electronic susceptibility, $\Re\left[\chi_0(\mathbf{q})\right]$, from those due to the electron-phonon coupling vertex, $g_{\mathbf{q}}$, by following the response of semi-metallic (normal phase) 1T-TiSe$_2$ to the selective photo-doping of carriers into the electron pocket at the Fermi level. Quasi-impulsive and wavevector-specific renormalization of soft zone-boundary phonon frequencies (stiffening) is observed, followed by wavevector-independent electron-phonon equilibration. These results unravel the underlying mechanisms driving the phonon softening that is associated with the charge density wave transition at lower temperatures.


title: NNLO QCD Corrections for Higgs-plus-jet Production in the Four-lepton Decay Mode

abstract: We present the computation of Higgs boson production in association with a jet at the LHC including QCD corrections up to NNLO. The calculation includes the subsequent decay of the Higgs boson into four leptons, allowing for the full reconstruction of the final-state kinematics. In anticipation of improved LHC measurements based on the full Run II dataset, we present a study for single- and double-differential cross sections within the fiducial volume as defined in prior ATLAS analyses. Higher-order corrections are found to have a sizeable impact on both normalisation and shape of differential cross sections.


title: Normal approximation for mixtures of normal distributions and the evolution of phenotypic traits

abstract: An explicit bound is given for the Kolmogorov distance between a mixture of normal distributions and a normal distribution with properly chosen parameter values. A random variable X has a mixture of normal distributions if its conditional distribution given some sigma-algebra is normal. The bound depends only on the first two moments of the first two conditional moments of X given this sigma-algebra. As an application, the Yule-Ornstein-Uhlenbeck model, used in the field of phylogenetic comparative methods, is considered. A bound is derived for the Kolmogorov distance between the distribution of the average value of a phenotypic trait over n related species and a normal distribution. The bound goes to 0 as n goes to infinity, extending earlier limit theorems by Bartoszek and Sagitov.


title: Gelfand-Kirillov dimension for rings

abstract: The classical Gelfand-Kirillov dimension for algebras over fields has been extended recently by J. Bell and J.J Zhang to algebras over commutative domains. However, the behavior of this new notion has not been enough investigated for the principal algebraic constructions as polynomial rings, matrix rings, localizations, filtered-graded rings, skew $PBW$ extensions, etc. In this paper, we present complete proofs of the computation of this more general dimension for the mentioned algebraic constructions for algebras over commutative domains. The Gelfand-Kirillov dimension for modules and the Gelfand-Kirillov transcendence degree will be also considered. The obtained results can be applied in particular to algebras over the ring of integers, i.e, to arbitrary rings.


title: Augmented hyperbolic models with diffusive-dispersive shocks

abstract: Given a first-order nonlinear hyperbolic system of conservation laws endowed with a convex entropy-entropy flux pair, we can consider the class of weak solutions containing shock waves depending upon some small scale parameters. In this Note, we define and derive several classes of entropy-dissipating augmented models, as we call them, which involve (possibly nonlinear) second- and third-order augmentation terms. Such terms typically arise in continuum physics and model the viscosity and capillarity effects in a fluid, for instance. By introducing a new notion of positive entropy production that concerns general functions (rather than solutions) we can easily check the entropy-dissipating property for a broad class of augmented models. The weak solutions associated with the zero diffusion/dispersion limit may contain (nonclassical undercompressive) shocks whose selection is determined from these diffusive and dispersive effects (for instance by using traveling wave solutions), and having a classification of the models, as we propose, is essential for developing a general theory.


title: Anchoring Theory in Sequential Stackelberg Games

abstract: An underlying assumption of Stackelberg Games (SGs) is perfect rationality of the players. However, in real-life situations (which are often modeled by SGs) the followers (terrorists, thieves, poachers or smugglers) -- as humans in general -- may act not in a perfectly rational way, as their decisions may be affected by biases of various kinds which bound rationality of their decisions. One of the popular models of bounded rationality (BR) is Anchoring Theory (AT) which claims that humans have a tendency to flatten probabilities of available options, i.e. they perceive a distribution of these probabilities as being closer to the uniform distribution than it really is. This paper proposes an efficient formulation of AT in sequential extensive-form SGs (named ATSG), suitable for Mixed-Integer Linear Program (MILP) solution methods. ATSG is implemented in three MILP/LP-based state-of-the-art methods for solving sequential SGs and two recently introduced non-MILP approaches: one relying on Monte Carlo sampling (O2UCT) and the other one (EASG) employing Evolutionary Algorithms. Experimental evaluation indicates that both non-MILP heuristic approaches scale better in time than MILP solutions while providing optimal or close-to-optimal solutions. Except for competitive time scalability, an additional asset of non-MILP methods is flexibility of potential BR formulations they are able to incorporate. While MILP approaches accept BR formulations with linear constraints only, no restrictions on the BR form are imposed in either of the two non-MILP methods.


title: Scalable Algorithms for High-Order Approximations on Three-Dimensional Compact Stencils

abstract: This paper presents an efficient parallel direct algorithm with near-optimal complexity for the compact fourth and sixth-order approximation of the three-dimensional Helmholtz equations [1] with the problem coefficient depending on only one of the coordinate directions. The developed method is based on a combination of the separation of variables technique and a Fast Fourier Transform (FFT) type method. Similar direct solvers for the lower-order approximations of the two and three-dimensional Helmholtz equation were considered in several previous publications by the authors and other researchers (see e.g. [2,3,4,5]). The authors also consider a generalization of the presented algorithm to the solution of a wide class of linear systems obtained from approximation on the compact 27-point three-dimensional stencils on the rectangular grids with similar requirements on the stencil coefficients. The general restrictions on the coefficients in the considered class of compact schemes are developed and presented. This class includes the second, fourth and sixth-order compact approximation schemes for the three-dimensional Helmholtz equation considered in this paper and our previous publications [2,3,6]. As an example of the diversity of applications of the developed general method, the direct parallel implementation of a compact fourth-order approximation scheme for a convection-diffusion equation is considered. The results of the implementation of this method in OpenMP, MPI and hybrid programming environments on the multicore computers and multiple node clusters are presented and discussed. The results demonstrate the high efficiency of the proposed direct solvers for many important applications on the structured grid with the corresponding 27-diagonal matrices.


title: $\chi\rm{SB}$ of cascading gauge theory in de Sitter

abstract: ${\cal N}=1$ supersymmetric $SU(N)\times SU(N+M)$ cascading gauge theory of Klebanov et.al spontaneously breaks chiral symmetry in Minkowski space-time. We demonstrate that in de Sitter space-time the chiral symmetry breaking occurs for the values of the Hubble constant $H\lesssim 0.7 \Lambda $, as well as in a narrow window $0.92(1) \Lambda \le H\le 0.92(5) \Lambda $. We give a precise definition of the strong coupling scale $\Lambda $ of cascading gauge theory, which is related to the glueball mass scale in the theory $m_{glueball}$ and the asymptotic string coupling $g_s$ as $\Lambda \sim g_s^{1/2} m_{glueball}$.


title: Complexity growth for topological black holes by holographic method

abstract: We consider the growth of the action for black hole spacetime with a fundamental string. Our interest is to find the difference of the behavior between black holes with three different topologies in the scenario of complexity-action conjecture. These black holes have positive, negative and zero curvatures. We would like to calculate the action growth of these systems with a probe fundamental string according to the complexity-action conjecture. We find that for the case where the black holes have the toroidal horizon structure this probe string behaves very differently from the other two cases.


title: Magnetic interactions and magnetocaloric effect in (La0.5Pr0.5)0.6Ba0.4MnO3: Effect of A-site co-doping

abstract: We report on the structural, magnetic, and magnetocaloric properties of polycrystalline (La0.5Pr0.5)0.6Ba0.4MnO3 (LPBMO), which was fabricated by a conventional solid-state reaction method. LPBMO undergoes a second-order paramagnetic to ferromagnetic (PM-FM) phase transition around a Curie temperature TC ~ 277 K. The maximum magnetic entropy change is ~ 3.22 J kg-1 K-1 for a magnetic field change of 5 T. Based on the modified-Arrott plot and the iterative Kouvel Fisher methods, a set of critical exponents (beta = 0.514, gamma = 1.164, and delta = 3.265) are determined. These values are close to those expected for the mean field model with long range interactions below TC and for the 3D-Ising model with short range interactions above TC. Effect of A-site co-doping (La,Pr) on the magnetic and magnetocaloric properties of LPBMO is analyzed and discussed.


title: Data-Driven Model Reduction for Multilinear Control Systems via Tensor Trains

abstract: In this paper, we explore the role of tensor algebra in balanced truncation (BT) based model reduction/identification for high-dimensional multilinear/linear time invariant systems. In particular, we employ tensor train decomposition (TTD), which provides a good compromise between numerical stability and level of compression, and has an associated algebra that facilitates computations. Using TTD, we propose a new BT approach which we refer to as higher-order balanced truncation, and consider different data-driven variations including higher-order empirical gramians, higher-order balanced proper orthogonal decomposition and a higher-order eigensystem realization algorithm. We perform computational and memory complexity analysis for these different flavors of TTD based BT methods, and compare with the corresponding standard BT methods in order to develop insights into where the proposed framework may be beneficial. We provide numerical results on simulated and experimental datasets showing the efficacy of the proposed framework.


title: From Boltzmann to Zipf through Shannon and Jaynes

abstract: The word-frequency distribution provides the fundamental building blocks that generate discourse in language. It is well known, from empirical evidence, that the word-frequency distribution of almost any text is described by Zipf's law, at least approximately. Following Stephens and Bialek [Phys. Rev. E 81, 066119, 2010], we interpret the frequency of any word as arising from the interaction potential between its constituent letters. Indeed, Jaynes' maximum-entropy principle, with the constrains given by every empirical two-letter marginal distribution, leads to a Boltzmann distribution for word probabilities, with an energy-like function given by the sum of all pairwise (two-letter) potentials. The improved iterative-scaling algorithm allows us finding the potentials from the empirical two-letter marginals. Appling this formalism to words with up to six letters from the English subset of the recently created Standardized Project Gutenberg Corpus, we find that the model is able to reproduce Zipf's law, but with some limitations: the general Zipf's power-law regime is obtained, but the probability of individual words shows considerable scattering. In this way, a pure statistical-physics framework is used to describe the probabilities of words. As a by-product, we find that both the empirical two-letter marginal distributions and the interaction-potential distributions follow well-defined statistical laws.


title: Structure-Property Linkage in Shocked Multi-Material Flows Using A Level-Set Based Eulerian Image-To-Computation Framework

abstract: Morphology and dynamics at the meso-scale play crucial roles in the overall macro- or system-scale flow of heterogeneous materials. In a multi-scale framework, closure models upscale unresolved sub-grid (meso-scale) physics and therefore encapsulate structure-property (S-P) linkages to predict performance at the macro-scale. This work establishes a route to structure-property linkage, proceeding all the way from imaged micro-structures to flow computations in one unified level set-based framework. Level sets are used to: 1) Define embedded geometries via image segmentation; 2) Simulate the interaction of sharp immersed boundaries with the flow field, and 3) Calculate morphological metrics to quantify structure. Meso-scale dynamics are computed to calculate sub-grid properties, i.e. closure models for momentum and energy equations. The structure-property linkage is demonstrated for two types of multi-material flows: interaction of shocks with a cloud of particles and reactive meso-mechanics of pressed energetic materials. We also present an approach to connect local morphological characteristics in a microstructure containing topologically complex features with the shock response of imaged samples of such materials. This paves the way for using geometric machine learning techniques to associate imaged morphologies with their properties.


title: Sequential Chance Optimization For Flow-Tube Based Control Of Probabilistic Nonlinear Systems

abstract: In this paper, we address the problem of closed-loop control of nonlinear dynamical systems subjected to probabilistic uncertainties. More precisely, we design time-varying polynomial feedback controllers to follow the given nominal trajectory and also, for safety purposes, remain in the tube around the nominal trajectory, despite all uncertainties. We formulate this problem as a chance optimization problem where we maximize the probability of achieving control objectives. To address control problems with long planning horizons, we formulate the single large chance optimization problem as a sequence of smaller chance optimization problems. To solve the obtained chance optimization problems, we leverage the theory of measures and moments and obtain convex relaxations in the form of semidefinite programs. We provide numerical examples on stabilizing controller design and motion planning of uncertain nonlinear systems to illustrate the performance of the proposed approach.


title: Deep Variable-Block Chain with Adaptive Variable Selection

abstract: The architectures of deep neural networks (DNN) rely heavily on the underlying grid structure of variables, for instance, the lattice of pixels in an image. For general high dimensional data with variables not associated with a grid, the multi-layer perceptron and deep brief network are often used. However, it is frequently observed that those networks do not perform competitively and they are not helpful for identifying important variables. In this paper, we propose a framework that imposes on blocks of variables a chain structure obtained by step-wise greedy search so that the DNN architecture can leverage the constructed grid. We call this new neural network Deep Variable-Block Chain (DVC). Because the variable blocks are used for classification in a sequential manner, we further develop the capacity of selecting variables adaptively according to a number of regions trained by a decision tree. Our experiments show that DVC outperforms other generic DNNs and other strong classifiers. Moreover, DVC can achieve high accuracy at much reduced dimensionality and sometimes reveals drastically different sets of relevant variables for different regions.


title: Homotopy types of partial quotients for a certain case

abstract: In this paper, we determine the homotopy type of the quotient space $\mathcal{Z}_{\Delta^k_m}/S^1_d$, given by the moment-angle complex $\mathcal{Z}_{\Delta_m^k}$ under the diagonal circle action.


title: Functional inequalities on path space of sub-Riemannian manifolds and applications

abstract: For sub-Riemannian manifolds with a chosen complement, we first establish the derivative formula and integration by parts formula on path space with respect to a natural gradient operator. By using these formulae, we then show that upper and lower bounds of the horizontal Ricci curvature correspond to functional inequalities on path space analogous to what has been established in Riemannian geometry by Aaron Naber, such as gradient inequalities, log-Sobolev and Poincar\'e inequalities.


title: Notes on thermodynamics of super-entropic AdS black holes

abstract: The super-entropic black hole, which possesses a noncompact horizon topology and violates the reverse isoperimetric inequality, has been found to satisfy both the thermodynamic first law and the Bekenstein-Smarr mass formula. In this paper, we first derive a new Christodoulou-Ruffini-like squared-mass formula for the four-dimensional Kerr-Newman-AdS super-entropic black hole, and then establish a set of very simple relations between thermodynamic quantities of the super-entropic Kerr-Newman-AdS$_4$ black hole and its usual counterparts. Using these relations, the thermodynamic quantities of the Kerr-Newman-AdS$_4$ super-entropic black hole can be obtained from those of the usual pro-type by taking the ultra-spinning limit properly. Then these relations are extended to the singly-rotating Kerr-AdS black holes in arbitrary dimensions and the double-rotating charged black hole in the five-dimensional minimal gauged supergravity. It can be inferred that the thermodynamic quantities of all super-entropic black holes obey similar limiting relations to those of their corresponding conventional rotating AdS black holes, and thus can be obtained by taking the ultra-spinning limit appropriately.


title: Systematically Localizable Operators for Quantum Simulations of Quantum Field Theories

abstract: Correlations and measures of entanglement in ground state wavefunctions of relativistic quantum field theories are spatially localized over length scales set by the mass of the lightest particle. We utilize this localization to design digital quantum circuits for preparing the ground states of lattice scalar quantum field theories. Controlled rotations that are exponentially localized in their position-space extent are found to provide exponentially convergent wavefunction fidelity. These angles scale with the correlation between sites and the classical two-point correlation function, as opposed to the more localized mutual information or the hyper-localized negativity. We anticipate that further investigations will uncover quantum circuit designs with controlled rotations dictated by the measures of entanglement. This work is expected to impact quantum simulations of systems of importance to nuclear physics, high-energy physics, and basic energy sciences research.


title: Effects of Cooling Rate on Structural Relaxation in Amorphous Drugs: Elastically Collective Nonlinear Langevin Equation Theory and Machine Learning Study

abstract: Theoretical approaches are formulated to investigate the molecular mobility under various cooling rates of amorphous drugs. We describe the structural relaxation of a tagged molecule as a coupled process of cage-scale dynamics and collective molecular rearrangement beyond the first coordination shell. The coupling between local and non-local dynamics behaves distinctly in different substances. Theoretical calculations for the structural relaxation time, glass transition temperature, and dynamic fragility are carried out over twenty-two amorphous drugs and polymers. Numerical results have a quantitatively good accordance with experimental data and the extracted physical quantities using the Vogel-Fulcher-Tammann fit function and machine learning. The machine learning method reveals the linear relation between the glass transition temperature and the melting point, which is a key factor for pharmaceutical solubility. Our predictive approaches are reliable tools for developing drug formulation.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.chem-ph physics.med-ph


title: Neural Networks with Cheap Differential Operators

abstract: Gradients of neural networks can be computed efficiently for any architecture, but some applications require differential operators with higher time complexity. We describe a family of restricted neural network architectures that allow efficient computation of a family of differential operators involving dimension-wise derivatives, used in cases such as computing the divergence. Our proposed architecture has a Jacobian matrix composed of diagonal and hollow (non-diagonal) components. We can then modify the backward computation graph to extract dimension-wise derivatives efficiently with automatic differentiation. We demonstrate these cheap differential operators for solving root-finding subproblems in implicit ODE solvers, exact density evaluation for continuous normalizing flows, and evaluating the Fokker--Planck equation for training stochastic differential equation models.


title: EspressoDB: A scientific database for managing high-performance computing workflow

abstract: Leadership computing facilities around the world support cutting-edge scientific research across a broad spectrum of disciplines including understanding climate change, combating opioid addiction, or simulating the decay of a neutron. While the increase in computational power has allowed scientists to better evaluate the underlying model, the size of these computational projects have grown to a point where a framework is desired to facilitate managing the workflow. A typical scientific computing workflow includes: Defining all input parameters for every step of the computation; Defining dependencies of computational tasks; Storing some of the output data; Post-processing these data files; Performing data analysis on output. EspressoDB is a programmatic object-relational data management framework implemented in Python and based on the Django web framework. EspressoDB was developed to streamline data management workflows, centralize and guarantee data integrity, while providing domain flexibility and ease of use. The framework provided by EspressoDB aims to support the ever increasing complexity of workflows of scientific computing at leadership computing facilities, with the goal of reducing the amount of human time required to manage the jobs, thus giving scientists more time to focus on science.


title: Metals by micro-scale additive manufacturing: comparison of microstructure and mechanical properties

abstract: Many emerging applications in microscale engineering rely on the fabrication of three-dimensional architectures in inorganic materials. Small-scale additive manufacturing (AM) aspires to provide flexible and facile access to these geometries. Yet, the synthesis of device-grade inorganic materials is still a key challenge towards the implementation of AM in microfabrication. Here, we present a comprehensive overview of the microstructural and mechanical properties of metals fabricated by most state-of-the-art AM methods that offer a spatial resolution $\leq$10$\mu$m. Standardized sets of samples were studied by cross-sectional electron microscopy, nanoindentation and microcompression. We show that current microscale AM techniques synthesize metals with a wide range of microstructures and elastic and plastic properties, including materials of dense and crystalline microstructure with excellent mechanical properties that compare well to those of thin-film nanocrystalline materials. The large variation in materials performance can be related to the individual microstructure, which in turn is coupled to the various physico-chemical principles exploited by the different printing methods. The study provides practical guidelines for users of small-scale additive methods and establishes a baseline for the future optimization of the properties of printed metallic objects $-$ a significant step towards the potential establishment of AM techniques in microfabrication.


title: PIDForest: Anomaly Detection via Partial Identification

abstract: We consider the problem of detecting anomalies in a large dataset. We propose a framework called Partial Identification which captures the intuition that anomalies are easy to distinguish from the overwhelming majority of points by relatively few attribute values. Formalizing this intuition, we propose a geometric anomaly measure for a point that we call PIDScore, which measures the minimum density of data points over all subcubes containing the point. We present PIDForest: a random forest based algorithm that finds anomalies based on this definition. We show that it performs favorably in comparison to several popular anomaly detection methods, across a broad range of benchmarks. PIDForest also provides a succinct explanation for why a point is labelled anomalous, by providing a set of features and ranges for them which are relatively uncommon in the dataset.


title: On the structure of submodule of finitely generated module over PID

abstract: Consider $\mathbb{Z}/8\mathbb{Z}\oplus \mathbb{Z}/2\mathbb{Z}$, and the subgroup generated by $(2,1)$, it is a subgroup isomorphic to $\mathbb{Z}/4\mathbb{Z}$. If my theorem holds, it must contained in a cyclic group generated by some element of order $8$ which is impossible. The error in 4.2 is because "preimage" do not preserce the image of $[x\mapsto px]$.


title: Formalizing Event-Driven Behavior of Serverless Applications

abstract: We present new operational semantics for serverless computing that model the event-driven relationships between serverless functions, as well as their interaction with platforms services such as databases and object stores. These semantics precisely encapsulate how control transfers between functions, both directly and through reads and writes to platform services. We use these semantics to define the notion of the service call graph for serverless applications that captures program flows through functions and services. Finally, we construct service call graphs for twelve serverless JavaScript applications, using a prototype of our call graph construction algorithm, and we evaluate their accuracy.


title: Exploring the Ideal Depth of Neural Network when Predicting Question Deletion on Community Question Answering

abstract: In recent years, Community Question Answering (CQA) has emerged as a popular platform for knowledge curation and archival. An interesting aspect of question answering is that it combines aspects from natural language processing, information retrieval, and machine learning. In this paper, we have explored how the depth of the neural network influences the accuracy of prediction of deleted questions in question-answering forums. We have used different shallow and deep models for prediction and analyzed the relationships between number of hidden layers, accuracy, and computational time. The results suggest that while deep networks perform better than shallow networks in modeling complex non-linear functions, increasing the depth may not always produce desired results. We observe that the performance of the deep neural network suffers significantly due to vanishing gradients when large number of hidden layers are present. Constantly increasing the depth of the model increases accuracy initially, after which the accuracy plateaus, and finally drops. Adding each layer is also expensive in terms of the time required to train the model. This research is situated in the domain of neural information retrieval and contributes towards building a theory on how deep neural networks can be efficiently and accurately used for predicting question deletion. We predict deleted questions with more than 90\% accuracy using two to ten hidden layers, with less accurate results for shallower and deeper architectures.


title: Local Smart Inverter Control to Mitigate the Effects of Photovoltaic (PV) Generation Variability

abstract: The rapidly transforming electric power distribution system due to the integration of distributed energy resources(DERs) specifically roof-top photovoltaic (PV) generation may lead to significant operational challenges. In this paper, we address the challenges related to variable power generation profile from PV resources leading to voltage fluctuations at the secondary feeder level. The objective is to develop local smart inverter control methods to reduce the voltage fluctuations at distribution buses using reactive power support. Towards this goal, an approach based on the power flow measurements of the lines connected to the PV generation buses and the local PV generation measurements is proposed to obtain the required reactive power support to mitigate voltage fluctuations. The proposed method is validated using two three-phase unbalanced test systems: IEEE-123 bus and the modified R3-12.47-2 taxonomy feeder with 329-buses. It is shown that the proposed local control approach is effective in mitigating voltage violations resulting from large changes in active power injections of the PV generators and in reducing overall voltage fluctuations due to PV generation variability. Further, it is validated that the proposed local control approach results in a better performance with regard to decreasing the voltage fluctuations compared to a standard Thevenin impedance-based method.


title: Deep Learning-Based Feature-Aware Data Modeling for Complex Physics Simulations

abstract: Data modeling and reduction for in situ is important. Feature-driven methods for in situ data analysis and reduction are a priority for future exascale machines as there are currently very few such methods. We investigate a deep-learning based workflow that targets in situ data processing using autoencoders. We propose a Residual Autoencoder integrated Residual in Residual Dense Block (RRDB) to obtain better performance. Our proposed framework compressed our test data into 66 KB from 2.1 MB per 3D volume timestep.


title: Thermal Conductivity of Oxide Tunnel Barriers in Magnetic Tunnel Junctions Measured by Ultrafast Thermoreflectance and Magneto-optic Kerr Effect Thermometry

abstract: Spin-dependent charge transport in magnetic tunnel junctions (MTJs) can be manipulated by a temperature gradient, which can be utilized for spintronic and spin caloritronic applications. Evaluation of the thermally induced phenomena requires knowledge of the temperature differences across the oxide tunnel barrier adjacent to the ferromagnetic (FM) leads. However, it is challenging to accurately measure thermal properties of an oxide tunnel barrier consisting of only a few atomic layers. In this work, we experimentally interrogate the temperature evolutions in Ru/oxide/FM/seed/MgO (oxide=MgO, MgAl2O4; FM=Co, CoFeB; seed=Pt, Ta) structures having perpendicular magnetic anisotropy using ultrafast thermometry. The Ru layer is optically thick and heated by ultrafast laser pulses; the subsequent temperature changes are monitored using thermoreflectance of Ru and magneto-optic Kerr effect (MOKE) of the FM layers. We independently measure the response times of Co and CoFeB magnetism using quadratic MOKE and obtain {\tau}em=0.2 ps for Co and 2 ps for CoFeB. These time scales are much shorter than the time scale of heat transport through the oxide tunnel barrier, which occurs at 10-3000 ps. We determine effective thermal conductivities of MgO and MgAl2O4 tunnel barriers in the range of 0.4-0.6 W m-1 K-1, comparable to an estimate of the series conductance of the Ru/oxide and oxide/FM interfaces and an order of magnitude smaller than the thermal conductivity of MgO thin films. We find that the electron-phonon thermal conductance near the tunnel barrier is only a factor of 5-12 larger than the thermal conductance of the oxide tunnel barrier. Therefore, the drop in the electronic temperature is approximately 20-30% larger than the drop in the phonon temperature across the tunnel barrier.


title: Detecting Cyberattacks in Industrial Control Systems Using Online Learning Algorithms

abstract: Industrial control systems are critical to the operation of industrial facilities, especially for critical infrastructures, such as refineries, power grids, and transportation systems. Similar to other information systems, a significant threat to industrial control systems is the attack from cyberspace---the offensive maneuvers launched by "anonymous" in the digital world that target computer-based assets with the goal of compromising a system's functions or probing for information. Owing to the importance of industrial control systems, and the possibly devastating consequences of being attacked, significant endeavors have been attempted to secure industrial control systems from cyberattacks. Among them are intrusion detection systems that serve as the first line of defense by monitoring and reporting potentially malicious activities. Classical machine-learning-based intrusion detection methods usually generate prediction models by learning modest-sized training samples all at once. Such approach is not always applicable to industrial control systems, as industrial control systems must process continuous control commands with limited computational resources in a nonstop way. To satisfy such requirements, we propose using online learning to learn prediction models from the controlling data stream. We introduce several state-of-the-art online learning algorithms categorically, and illustrate their efficacies on two typically used testbeds---power system and gas pipeline. Further, we explore a new cost-sensitive online learning algorithm to solve the class-imbalance problem that is pervasive in industrial intrusion detection systems. Our experimental results indicate that the proposed algorithm can achieve an overall improvement in the detection rate of cyberattacks in industrial control systems.


title: Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language

abstract: We address the problem of retrieving a specific moment from an untrimmed video by a query sentence. This is a challenging problem because a target moment may take place in relations to other temporal moments in the untrimmed video. Existing methods cannot tackle this challenge well since they consider temporal moments individually and neglect the temporal dependencies. In this paper, we model the temporal relations between video moments by a two-dimensional map, where one dimension indicates the starting time of a moment and the other indicates the end time. This 2D temporal map can cover diverse video moments with different lengths, while representing their adjacent relations. Based on the 2D map, we propose a Temporal Adjacent Network (2D-TAN), a single-shot framework for moment localization. It is capable of encoding the adjacent temporal relation, while learning discriminative features for matching video moments with referring expressions. We evaluate the proposed 2D-TAN on three challenging benchmarks, i.e., Charades-STA, ActivityNet Captions, and TACoS, where our 2D-TAN outperforms the state-of-the-art.


title: Suprathermal electron acceleration by a quasi-perpendicular shock: simulations and observations

abstract: The acceleration of suprathermal electrons in the solar wind is mainly associated with shocks driven by interplanetary coronal mass ejections (ICMEs). It is well known that the acceleration of electrons is much more efficient at quasi-perpendicular shocks than at quasi-parallel ones. Yang et al. (2018, ApJ, 853, 89) (hereafter YEA2018) studied the acceleration of suprathermal electrons at a quasi-perpendicular ICME-driven shock event to claim the important role of shock drift acceleration (SDA). Here, we perform test-particle simulations to study the acceleration of electrons in this event, by calculating the downstream electron intensity distribution for all energy channels assuming an initial distribution based on the averaged upstream intensities. We obtain simulation results similar to the observations from YEA2018 as follows. It is shown that the ratio of downstream to upstream intensities peaks at about 90$^\circ$ pitch angle. In addition, in each pitch angle direction the downstream electron energy spectral index is much larger than the theoretical index of diffusive shock acceleration. Furthermore, considering SDA, the estimated drift length is proportional to the electron energy but the drift time is almost energy independent. Finally, we use a theoretical model based on SDA to describe the drift length and time, especially, to explain their energy dependence. These results indicate the importance of SDA in the acceleration of electrons by quasi-perpendicular shocks.


title: Distributed Fictitious Play in Potential Games with Time-Varying Communication Networks

abstract: We propose a distributed algorithm for multiagent systems that aim to optimize a common objective when agents differ in their estimates of the objective-relevant state of the environment. Each agent keeps an estimate of the environment and a model of the behavior of other agents. The model of other agents' behavior assumes agents choose their actions randomly based on a stationary distribution determined by the empirical frequencies of past actions. At each step, each agent takes the action that maximizes its expectation of the common objective computed with respect to its estimate of the environment and its model of others. We propose a weighted averaging rule with non-doubly stochastic weights for agents to estimate the empirical frequency of past actions of all other agents by exchanging their estimates with their neighbors over a time-varying communication network. Under this averaging rule, we show agents' estimates converge to the actual empirical frequencies fast enough. This implies convergence of actions to a Nash equilibrium of the game with identical payoffs given by the expectation of the common objective with respect to an asymptotically agreed estimate of the state of the environment.


title: Towards a Critical Race Methodology in Algorithmic Fairness

abstract: We examine the way race and racial categories are adopted in algorithmic fairness frameworks. Current methodologies fail to adequately account for the socially constructed nature of race, instead adopting a conceptualization of race as a fixed attribute. Treating race as an attribute, rather than a structural, institutional, and relational phenomenon, can serve to minimize the structural aspects of algorithmic unfairness. In this work, we focus on the history of racial categories and turn to critical race theory and sociological work on race and ethnicity to ground conceptualizations of race for fairness research, drawing on lessons from public health, biomedical research, and social survey research. We argue that algorithmic fairness researchers need to take into account the multidimensionality of race, take seriously the processes of conceptualizing and operationalizing race, focus on social processes which produce racial inequality, and consider perspectives of those most affected by sociotechnical systems.


title: Algebraic structure on Tate-Hochschild cohomology of a Frobenius algebra

abstract: We study cup product and cap product in Tate-Hochschild theory for a finite dimensional Frobenius algebra. We show that Tate-Hochschild cohomology ring equipped with cup product is isomorphic to singular Hochschild cohomology ring introduced by Wang. An application of cap product occurs in Tate-Hochschild duality; as in Tate (co)homology of a finite group, the cap product with the fundamental class of a finite dimensional Frobenius algebra provides certain duality result between Tate-Hochschild cohomology and homology groups. Moreover, we characterize minimal complete resolutions over a finite dimensional self-injective algebra by means of the notion of minimal complexes introduced by Avramov and Martsinkovsky.


title: Multifunctional Liquid Metal Lattice Materials with Recoverable and Reconfigurable Behaviors

abstract: Multifunctional lattice materials are of great interest to modern engineering including aerospace, robotics, wave control, and sensing. In this work, we proposed and developed a new class of functional lattice materials called liquid metal lattice materials, which are composed of liquid metals and elastomer coatings organized in a co-axial way. This hybrid design enables the liquid metal lattice materials with a thermal-activated shape memory effect and hence a variety of intriguing functionalities including recoverable energy absorption, tunable shape and rigidity, deployable and reconfigurable behaviors. The fabrication of liquid metal lattice materials is realised by a hybrid manufacturing approach combining 3D printing, vacuum casting, and coating. The mechanical properties and functionalities of these liquid metal lattice materials are studied via experimental testing. We expect that this new class of lattice materials will greatly expand the current realm of lattice materials and lead to novel multifunctional applications.


title: Bi-Level Volt-VAR Optimization to Coordinate Smart Inverters with Voltage Control Devices

abstract: Conservation voltage reduction(CVR) uses Volt-VAR optimization(VVO) methods to reduce customer power demand by controlling the feeders' voltage control devices. The objective of this paper is to present a VVO approach that controls the systems' legacy voltage control devices and coordinates their operation with smart inverter control. An optimal power flow (OPF) formulation is proposed by developing linear and nonlinear power flow approximations for a three-phase unbalanced electric power distribution system. A bi-level VVOapproach is proposed where Level-1 optimizes the control of legacy devices and smart inverters using a linear approximate three-phase power flow. In Level-2, the control parameters for smart inverters are adjusted to obtain an optimal and feasible solution by solving the approximate nonlinear OPF model. Level-1 is modeled as a Mixed Integer Linear Program(MILP) while level-2 as a Nonlinear Program(NLP) with a linear objective and quadratic constraints. The proposed approach is validated using 13-bus and 123-bus three-phase IEEE test feeders and a 329-bus three-phase PNNL taxonomy feeder. The results demonstrate the applicability of the framework in achieving the CVR objective. It is demonstrated that the proposed coordinated control approach help reduce feeders' power demand by reducing the bus voltages, the proposed approach maintains an average feeder voltage of 0.96 pu. A higher energy saving is reported during the minimum load conditions. The results and approximation steps are thoroughly validated using OpenDSS.


title: A viral propagation model with nonlinear infection rate and free boundaries

abstract: In this paper we put forward a viral propagation model with nonlinear infection rate and free boundaries and investigate the dynamical properties. This model is composed of two ordinary differential equations and one partial differential equation, in which the spatial range of the first equation is the whole space $\mathbb{R}$, and the last two equations have free boundaries. As a new mathematical model, we prove the existence, uniqueness and uniform estimates of global solution, and provide the criteria for spreading and vanishing, and long time behavior of the solution components $u,v,w$. Comparing with the corresponding ordinary differential systems, the {\it Basic Reproduction Number} ${\cal R}_0$ plays a different role. We find that when ${\cal R}_0\le 1$, the virus cannot spread successfully; when ${\cal R}_0>1$, the successful spread of virus depends on the initial value and varying parameters.


title: Electric dipole moments of atoms and molecules produced by enhanced nuclear Schiff moments

abstract: We perform calculations of the CP-violating atomic and molecular electric dipole moments (EDM) induced by the interaction of the nuclear Schiff moments with electrons. EDM of atoms Eu, Dy, Gd, Ac, Th, Pa, U, Np and Pu are of special interest since they have isotopes with strongly enhanced nuclear Schiff moments caused by the octupole nuclear deformation or soft octupole vibration mode. These atoms have open 4f or 5f shells making the calculations complicated. We use our special version of the configuration interaction method combined with the many-body perturbation theory method adopted for open f-shell case. To validate the method we perform similar calculations for simpler atoms (Xe, Hg, Tl+, Pb, Pb++, Rn, Ra) where some earlier results are available. In addition we present the estimates of the CP-violating nuclear spin - molecular axis interaction constants for molecules which may be of experimental interest including AcF, EuN, ThO, PbO and TlF. We also present updated values of the nuclear Schiff moments and atomic and molecular EDM expressed in terms of the CP-violating pi-meson - nucleon interaction constants g_0,g_1, g_2, QCD parameter theta and quark chromo-EDMs. The results may be used to test CP-violation theories and search for axion dark matter in atomic, molecular and solid state experiments.


title: Weighing in on black hole binaries with BPASS: LB-1 does not contain a 70M$_{\odot}$ black hole

abstract: The recent identification of a candidate very massive 70 M(Sun) black hole is at odds with our current understanding of stellar winds and pair-instability supernovae. We investigate alternate explanations for this system by searching the BPASS v2.2 stellar and population synthesis models for those that match the observed properties of the system. We find binary evolution models that match the LB-1 system, at the reported Gaia distance, with more moderate black hole masses of 4 to 7 M(Sun). We also examine the suggestion that the binary motion may have led to an incorrect distance determination by Gaia. We find that the Gaia distance is accurate and that the binary system is consistent with the observation at this distance. Consequently it is highly improbable that the black hole in this system has the extreme mass originally suggested. Instead, it is more likely to be representative of the typical black hole binary population expected in our Galaxy.


title: Repeatedly Energy-Efficient and Fair Service Coverage: UAV Slicing (Proactive UAV Network Slicing for URLLC and Mobile Broadband Service Multiplexing)

abstract: Unmanned aerial vehicle (UAV) networks are convinced as a significant part of 5G and emerging 6G wireless networks. UAV slicing is a promising proposal of converging different services onto a common UAV network without deploying individual network solution for each type of service. This paper is concerned with UAV slicing for providing energy-efficient and fair service coverage for enhanced mobile broadband (eMBB) users (UEs). Aiming at physically configuring UAV slices, the UAV slicing problem is formulated as a time-dependent mixed-integer-non-convex programming problem with a goal of maximizing all UEs' data rates while minimizing UAVs' total transmit power. To mitigate this challenging problem, we first decompose the original problem into two time-dependent subproblems using a Lyapunov approach. We then derive the procedure of tackling the non-convexity and the mixed-integer property of the subproblems by exploring a successive convex approximate (SCA) method and an alternative optimization scheme, respectively. Based on the derived results, we develop an algorithm with provable performance guarantees to mitigate the two subproblems repeatedly.


title: Feasibility Study of a Laser-Based Approach for Diagnosing Deuterium Neutrals in the Edge of Fusion Devices

abstract: In magnetically-confined plasmas of tokamaks, neutral deuterium/hydrogen (D/H) atoms play a role in energy, momentum, and particle balance, as well as the stabilization of plasma turbulence. One key important fusion performance parameter is the pedestal density. Understanding the pedestal density formation is critical for the development of predictive model of future fusion devices. Typically, measurements of the neutrals are obtained using optical emission spectroscopy of the Lyman alpha lines, which is a line-integrated measurement. The plasma in tokamaks is characterized by a high density of electrons and ions and a relatively low concentration of neutral hydrogen atoms, which could make direct measurement of density seemingly impossible at first. We propose a laser-based method that allows for accurate measurement of both the spatial and absolute magnitude of the neutral D/H with minimal knowledge of the radial profiles of electron temperatures and densities. This relies on the fact that the neutral spectral profile can have a larger peak than the electron spectral profile and thus make the neutral density signal resolvable. In practice, this method can be co-located with Thomson scattering systems and is referred to as laser Rayleigh scattering (LRS). More specifically, we assess and evaluate the LRS method for two test cases: in the midplane radii of the National Spherical Torus Experiment (NSTX), and in the small angle slot divertor configuration of DIII-D. Preliminary simulations and calculations will determine the feasibility of LRS in the presence of incoherent Thomson scattering under neutral densities ranging from $ 10^{13} $ to $ 10^{21} \ \text{m}^{-3} $. Wavelength dependence of LRS will be evaluated to determine the boost in the signal and photon generation capability.


title: Energy-Efficient Resource Allocation in a Multi-UAV-Aided NOMA Network

abstract: This paper is concerned with the resource allocation in a multi-unmanned aerial vehicle (UAV)-aided network for providing enhanced mobile broadband (eMBB) services for user equipments. Different from most of the existing network resource allocation approaches, we investigate a joint non-orthogonal user association, subchannel allocation and power control problem. The objective of the problem is to maximize the network energy efficiency under the constraints on user equipments' quality of service, UAVs' network capacity and power consumption. We formulate the energy efficiency maximization problem as a challenging mixed-integer non-convex programming problem. To alleviate this problem, we first decompose the original problem into two subproblems, namely, an integer non-linear user association and subchannel allocation subproblem and a non-convex power control subproblem. We then design a two-stage approximation strategy to handle the non-linearity of the user association and subchannel allocation subproblem and exploit a successive convex approximation approach to tackle the non-convexity of the power control subproblem. Based on the derived results, we develop an iterative algorithm with provable convergence to mitigate the original problem. Simulation results show that our proposed framework can improve energy efficiency compared with several benchmark algorithms.


title: Spatial Weibull Regression with Multivariate Log Gamma Process and Its Applications to China Earthquake Economic Loss

abstract: Bayesian spatial modeling of heavy-tailed distributions has become increasingly popular in various areas of science in recent decades. We propose a Weibull regression model with spatial random effects for analyzing extreme economic loss. Model estimation is facilitated by a computationally efficient Bayesian sampling algorithm utilizing the multivariate Log-Gamma distribution. Simulation studies are carried out to demonstrate better empirical performances of the proposed model than the generalized linear mixed effects model. An earthquake data obtained from Yunnan Seismological Bureau, China is analyzed. Logarithm of the Pseudo-marginal likelihood values are obtained to select the optimal model, and Value-at-risk, expected shortfall, and tail-value-at-risk based on posterior predictive distribution of the optimal model are calculated under different confidence levels.


title: Neural Network Generalization: The impact of camera parameters

abstract: We quantify the generalization of a convolutional neural network (CNN) trained to identify cars. First, we perform a series of experiments to train the network using one image dataset - either synthetic or from a camera - and then test on a different image dataset. We show that generalization between images obtained with different cameras is roughly the same as generalization between images from a camera and ray-traced multispectral synthetic images. Second, we use ISETAuto, a soft prototyping tool that creates ray-traced multispectral simulations of camera images, to simulate sensor images with a range of pixel sizes, color filters, acquisition and post-acquisition processing. These experiments reveal how variations in specific camera parameters and image processing operations impact CNN generalization. We find that (a) pixel size impacts generalization, (b) demosaicking substantially impacts performance and generalization for shallow (8-bit) bit-depths but not deeper ones (10-bit), and (c) the network performs well using raw (not demosaicked) sensor data for 10-bit pixels.


title: Anomalous temperature dependence of optical and acoustic phonons in Bi$_2$Se$_3$ arising from stacking faults

abstract: The class of layered 3D-topological insulators have shown intriguingly anomalous temperature dependence in their thermal expansion coefficients. It was proposed that stacking faults are the origin of the observed anomalous thermal expansion. Here, using femtosecond pump-probe differential reflectivity measurements we probe the carrier and coherently generated totally symmetric A1g1 optical phonons in Bi2Se3. Transient signals also show a low frequency (~GHz) oscillations due to coherent longitudinal acoustic phonons. We extract temperature dependence of optical constants, sound velocity and Young's modulus of Bi2Se3 using the strain pulse propagation model. A remarkable anomalous behavior around ~180 K is observed in the temperature dependence of optical and acoustic phonons as well as the optical constants. First-principles density functional theory (DFT) reveals that thermally activated formation of stacking faults is responsible for the anomalies observed in Bi2Se3, similar to case of Sb2Te3. We also show that inclusion of spin-orbit coupling plays an important role in reducing the total energy difference between the pristine and the faulted structures.


title: Individual predictions matter: Assessing the effect of data ordering in training fine-tuned CNNs for medical imaging

abstract: We reproduced the results of CheXNet with fixed hyperparameters and 50 different random seeds to identify 14 finding in chest radiographs (x-rays). Because CheXNet fine-tunes a pre-trained DenseNet, the random seed affects the ordering of the batches of training data but not the initialized model weights. We found substantial variability in predictions for the same radiograph across model runs (mean ln[(maximum probability)/(minimum probability)] 2.45, coefficient of variation 0.543). This individual radiograph-level variability was not fully reflected in the variability of AUC on a large test set. Averaging predictions from 10 models reduced variability by nearly 70% (mean coefficient of variation from 0.543 to 0.169, t-test 15.96, p-value < 0.0001). We encourage researchers to be aware of the potential variability of CNNs and ensemble predictions from multiple models to minimize the effect this variability may have on the care of individual patients when these models are deployed clinically.


title: Perfect bidder collusion through bribe and request

abstract: We study collusion in a second-price auction with two bidders in a dynamic environment. One bidder can make a take-it-or-leave-it collusion proposal, which consists of both an offer and a request of bribes, to the opponent. We show that there always exists a robust equilibrium in which the collusion success probability is one. In the equilibrium, for each type of initiator the expected payoff is generally higher than the counterpart in any robust equilibria of the single-option model (Es\"{o} and Schummer (2004)) and any other separating equilibria in our model.


title: Clustering of Intermittent Magnetic and Flow Structures near Parker Solar Probe's First Perihelion -- A Partial-Variance-of-Increments Analysis

abstract: During the Parker Solar Probe's (PSP) first perihelion pass, the spacecraft reached within a heliocentric distance of \(\sim 37~R_\odot\) and observed numerous magnetic and flow structures characterized by sharp gradients. To better understand these intermittent structures in the young solar wind, an important property to examine is their degree of correlation in time and space. To this end, we use the well-tested Partial Variance of Increments (PVI) technique to identify intermittent events in FIELDS and SWEAP observations of magnetic and proton-velocity fields (respectively) during PSP's first solar encounter, when the spacecraft was within 0.25 au from the Sun. We then examine distributions of waiting times between events with varying separation and PVI thresholds. We find power-law distributions for waiting times shorter than a characteristic scale comparable to the correlation time, suggesting a high degree of correlation that may originate in a clustering process. Waiting times longer than this characteristic time are better described by an exponential, suggesting a random memory-less Poisson process at play. These findings are consistent with near-Earth observations of solar wind turbulence. The present study complements the one by Dudok de Wit et al. (2020, present volume), which focuses on waiting times between observed "switchbacks" in the radial magnetic field.


title: Exploring the Back Alleys: Analysing The Robustness of Alternative Neural Network Architectures against Adversarial Attacks

abstract: We investigate to what extent alternative variants of Artificial Neural Networks (ANNs) are susceptible to adversarial attacks. We analyse the adversarial robustness of conventional, stochastic ANNs and Spiking Neural Networks (SNNs) in the raw image space, across three different datasets. Our experiments reveal that stochastic ANN variants are almost equally as susceptible as conventional ANNs when faced with simple iterative gradient-based attacks in the white-box setting. However we observe, that in black-box settings, stochastic ANNs are more robust than conventional ANNs, when faced with boundary attacks, transferability and surrogate attacks. Consequently, we propose improved attacks and defence mechanisms for stochastic ANNs in black-box settings. When performing surrogate-based black-box attacks, one can employ stochastic models as surrogates to observe higher attack success on both stochastic and deterministic targets. This success can be further improved with our proposed Variance Mimicking (VM) surrogate training method, against stochastic targets. Finally, adopting a defender's perspective, we investigate the plausibility of employing stochastic switching of model mixtures as a viable hardening mechanism. We observe that such a scheme does provide a partial hardening.


title: Light-quark components analysis and the nature of the $Y(4260)$

abstract: We study the processes $e^+ e^- \to Y(4260) \to J/\psi \pi\pi(K\bar{K})$. The strong final-state interactions, especially the coupled-channel ($\pi\pi$ and $K\bar{K}$) final-state interaction in the $S$-wave are taken into account in a model-independent way using dispersion theory. It is found that the light-quark SU(3) octet state plays a significant role in these transitions, implying that the $Y(4260)$ contains a large light-quark component. Our findings suggest that the $Y(4260)$ is neither a hybrid nor a conventional charmonium state. Furthermore, through an analysis of the ratio of the light-quark SU(3) octet and singlet components, we show that the $Y(4260)$ does not behave like a pure $\bar D D_1$ hadronic molecule as well.


title: Plasmon-induced efficient hot carrier generation in graphene on gold ultrathin film with periodic array of holes: Ultrafast pump-probe spectroscopy

abstract: Using ultrafast pump-probe reflectivity with 3.1 eV pump and coherent white light probe (1.1 to 2.6 eV), we show that graphene on gold nanostructures exhibits a strong coupling to the plasmonic resonances of the ordered lattice hole array, thus injecting a high density of hot carriers in graphene through plasmons. The system being studied is single-layer graphene on ultrathin film of gold with periodic arrangements of holes showing anomalous transmission. A comparison is made with gold film with and without hole array. By selectively probing transient carrier dynamics in the spectral regions corresponding to plasmonic resonances, we show efficient plasmon-induced hot carrier generation in graphene. We also show that due to high electromagnetic field intensities at the edge of the sub-micron holes, fast decay time (10-100 fs) and short decay length (1 nm) of plasmons, a highly confined density of hot carriers (very close to edge of the holes) is generated by Landau damping of plasmons within the holey gold film. A contribution to transient decay dynamics due to diffusion of initial non-uniform distribution of hot carriers away from the hole edges is observed. Our results are important for future applications of novel hot carrier device concepts where hot carriers with tunable energy can be generated in different graphene regions connected seamlessly.


title: Learning Sparse 2D Temporal Adjacent Networks for Temporal Action Localization

abstract: In this report, we introduce the Winner method for HACS Temporal Action Localization Challenge 2019. Temporal action localization is challenging since a target proposal may be related to several other candidate proposals in an untrimmed video. Existing methods cannot tackle this challenge well since temporal proposals are considered individually and their temporal dependencies are neglected. To address this issue, we propose sparse 2D temporal adjacent networks to model the temporal relationship between candidate proposals. This method is built upon the recent proposed 2D-TAN approach. The sampling strategy in 2D-TAN introduces the unbalanced context problem, where short proposals can perceive more context than long proposals. Therefore, we further propose a Sparse 2D Temporal Adjacent Network (S-2D-TAN). It is capable of involving more context information for long proposals and further learning discriminative features from them. By combining our S-2D-TAN with a simple action classifier, our method achieves a mAP of 23.49 on the test set, which win the first place in the HACS challenge.


title: DASZL: Dynamic Action Signatures for Zero-shot Learning

abstract: There are many realistic applications of activity recognition where the set of potential activity descriptions is combinatorially large. This makes end-to-end supervised training of a recognition system impractical as no training set is practically able to encompass the entire label set. In this paper, we present an approach to fine-grained recognition that models activities as compositions of dynamic action signatures. This compositional approach allows us to reframe fine-grained recognition as zero-shot activity recognition, where a detector is composed "on the fly" from simple first-principles state machines supported by deep-learned components. We evaluate our method on the Olympic Sports and UCF101 datasets, where our model establishes a new state of the art under multiple experimental paradigms. We also extend this method to form a unique framework for zero-shot joint segmentation and classification of activities in video and demonstrate the first results in zero-shot decoding of complex action sequences on a widely-used surgical dataset. Lastly, we show that we can use off-the-shelf object detectors to recognize activities in completely de-novo settings with no additional training.


title: On Robust Stability and Performance with a Fixed-Order Controller Design for Uncertain Systems

abstract: Typically, it is desirable to design a control system that is not only robustly stable in the presence of parametric uncertainties but also guarantees an adequate level of system performance. However, most of the existing methods need to take all extreme models over an uncertain domain into consideration, which then results in costly computation. Also, since these approaches attempt (rather unrealistically) to guarantee the system performance over a full frequency range, a conservative design is always admitted. Here, taking a specific viewpoint of robust stability and performance under a stated restricted frequency range (which is applicable in rather many real-world situations), this paper provides an essential basis for the design of a fixed-order controller for a system with bounded parametric uncertainties. A Hurwitz polynomial is used in the design and the robust stability is characterized by the notion of positive realness, such that the required robust stability condition is then suitably successfully constructed. Also, the robust performance criteria in terms of sensitivity shaping under different frequency ranges are constructed based on an approach of bounded realness analysis. Necessary and sufficient conditions are provided for both the robust stability and robust performance criteria. Furthermore, these conditions are expressed in the framework of linear matrix inequality (LMI) constraints, and thus can be efficiently solved. Comparative simulations are provided to illustrate the effectiveness and efficiency of the proposed approach.


title: Quantitative Estimates on the Singular Sets of Alexandrov Spaces

abstract: Let $X\in\text{Alex}\,^n(-1)$ be an $n$-dimensional Alexandrov space with curvature $\ge -1$. Let the $r$-scale $(k,\epsilon)$-singular set $\mathcal S^k_{\epsilon,\,r}(X)$ be the collection of $x\in X$ so that $B_r(x)$ is not $\epsilon r$-close to a ball in any splitting space $\mathbb R^{k+1}\times Z$. We show that there exists $C(n,\epsilon)>0$ and $\beta(n,\epsilon)>0$, independent of the volume, so that for any disjoint collection $\big\{B_{r_i}(x_i):x_i\in \mathcal S_{\epsilon,\,\beta r_i}^k(X)\cap B_1, \,r_i\le 1\big\}$, the packing estimate $\sum r_i^k\le C$ holds. Consequently, we obtain the Hausdorff measure estimates $\mathcal H^k(\mathcal S^k_\epsilon(X)\cap B_1)\le C$ and $\mathcal H^n\big(B_r (\mathcal S^k_{\epsilon,\,r}(X))\cap B_1(p)\big)\leq C\,r^{n-k}$. This answers an open question asked by Kapovitch and Lytchak. We also show that the $k$-singular set $\mathcal S^k(X)=\underset{\epsilon>0}\cup\left(\underset{r>0}\cap\mathcal S^k_{\epsilon,\,r}\right)$ is $k$-rectifiable and construct examples to show that such a structure is sharp. For instance, in the $k=1$ case we can build for any closed set $T\subseteq \mathbb S^1$ and $\epsilon>0$ a space $Y\in\text{Alex}^3(0)$ with $\mathcal S^{1}_\epsilon(Y)=\phi(T)$, where $\phi\colon\mathbb S^1\to Y$ is a bi-Lipschitz embedding. Taking $T$ to be a Cantor set it gives rise to an example where the singular set is a $1$-rectifiable, $1$-Cantor set with positive $1$-Hausdorff measure.


title: Data-Driven Linear Quadratic Optimization for Controller Synthesis with Structural Constraints

abstract: For various typical cases and situations where the formulation results in an optimal control problem, the Linear Quadratic Regulator (LQR) approach and its variants continue to be highly attractive. In certain scenarios, it can happen that some prescribed structural constraints on the gain matrix would arise. Consequently then, the Algebraic Riccati Equation (ARE) is no longer applicable in a straightforward way to obtain the optimal solution. This work presents a rather effective alternative optimization approach based on gradient projection. The utilized gradient is obtained through a data-driven methodology, and then projected onto applicable constrained hyperplanes. Essentially, this projection gradient determines a direction of progression and computation for the gain matrix update with a decreasing functional cost; and then the gain matrix is further refined in an iterative framework. With this formulation, a data-driven optimization algorithm is summarized for controller synthesis with structural constraints. This data-driven approach has the key advantage that it avoids the necessity of precise modeling which is always required in the classical model-based counterpart; and thus the approach can additionally accommodate various model uncertainties. Illustrative examples are also provided in the work to validate the theoretical results.


title: Additive Schwarz Methods for Convex Optimization as Gradient Methods

abstract: This paper gives a unified convergence analysis of additive Schwarz methods for general convex optimization problems. Resembling to the fact that additive Schwarz methods for linear problems are preconditioned Richardson methods, we prove that additive Schwarz methods for general convex optimization are in fact gradient methods. Then an abstract framework for convergence analysis of additive Schwarz methods is proposed. The proposed framework applied to linear elliptic problems agrees with the classical theory. We present applications of the proposed framework to various interesting convex optimization problems such as nonlinear elliptic problems, nonsmooth problems, and nonsharp problems.


title: Efficient Black-box Assessment of Autonomous Vehicle Safety

abstract: While autonomous vehicle (AV) technology has shown substantial progress, we still lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de-facto}$ evaluation method, is dangerous to the public. Moreover, due to the rare nature of failures, billions of miles of driving are needed to statistically validate performance claims. Thus, the industry has largely turned to simulation to evaluate AV systems. However, having a simulation stack alone is not a solution. A simulation testing framework needs to prioritize which scenarios to run, learn how the chosen scenarios provide coverage of failure modes, and rank failure scenarios in order of importance. We implement a simulation testing framework that evaluates an entire modern AV system as a black box. This framework estimates the probability of accidents under a base distribution governing standard traffic behavior. In order to accelerate rare-event probability evaluation, we efficiently learn to identify and rank failure scenarios via adaptive importance-sampling methods. Using this framework, we conduct the first independent evaluation of a full-stack commercial AV system, Comma AI's OpenPilot.


title: Channel Estimation for Reconfigurable Intelligent Surface Aided Multi-User mmWave MIMO Systems

abstract: Channel acquisition is one of the main challenges for the deployment of reconfigurable intelligent surface (RIS) aided communication systems. This is because an RIS has a large number of reflective elements, which are passive devices with no active transmitting/receiving abilities. In this paper, we study the channel estimation problem for the RIS aided multi-user millimeter-wave (mmWave) multi-input multi-output (MIMO) system. Specifically, we propose a novel channel estimation protocol for the above system to estimate the cascaded channels, which are the products of the channels from the base station (BS) to the RIS and from the RIS to the users. Further, since the cascaded channels are typically sparse, this allows us to formulate the channel estimation problem as a sparse recovery problem using compressive sensing (CS) techniques, thereby allowing the channels to be estimated with less training overhead. Moreover, the sparse channel matrices of the cascaded channels of all users have a common block sparsity structure due to the common channel between the BS and the RIS. To take advantage of the common sparsity pattern, we propose a two-step multi-user joint channel estimation procedure. In the first step, we make use of the common column-block sparsity and project the received signals onto the common column subspace. In the second step, we make use of the row-block sparsity of the projected signals and propose a multi-user joint sparse matrix recovery algorithm that takes into account the common channel between the BS and the RIS.


title: Reconfigurable Intelligent Surface-Based Wireless Communication: Antenna Design, Prototyping and Experimental Results

abstract: One of the key enablers of future wireless communications is constituted by massive multiple-input multiple-output (MIMO) systems, which can improve the spectral efficiency by orders of magnitude. However, in existing massive MIMO systems, conventional phased arrays are used for beamforming, which result in excessive power consumption and hardware cost. Recently, reconfigurable intelligent surface (RIS) has been considered as one of the revolutionary technologies to enable energy-efficient and smart wireless communications, which is a two-dimensional structure with a large number of passive elements. In this paper, we propose and develop a new type of high-gain yet low-cost RIS having 256 elements. The proposed RIS combines the functions of phase shift and radiation together on an electromagnetic surface, where positive intrinsic-negative (PIN) diodes are used to realize 2-bit phase shifting for beamforming. Based on this radical design, the world's first wireless communication prototype using RIS having 256 2-bit elements is designed and developed. Specifically, the prototype conceived consists of modular hardware and flexible software, including the hosts for parameter setting and data exchange, the universal software radio peripherals (USRPs) for baseband and radio frequency (RF) signal processing, as well as the RIS for signal transmission and reception. Our performance evaluation confirms the feasibility and efficiency of RISs in future wireless communications. More particularly, it is shown that a 21.7 dBi antenna gain can be obtained by the proposed RIS at 2.3 GHz, while at the millimeter wave (mmWave) frequency, i.e., 28.5 GHz, a 19.1 dBi antenna gain can be achieved. Furthermore, the over-the-air (OTA) test results show that the RIS-based wireless communication prototype developed is capable of significantly reducing the power consumption.


title: Post-processing techniques of 4D flow MRI: velocity and wall shear stress

abstract: As the original velocity field obtained from four-dimensional (4D) flow magnetic resonance imaging (MRI) contains considerable amount of noises and errors, the available Divergence-free smoothing (DFS) method can be used to process the 4D flow MRI data for reducing noises, eliminating errors, fixing missing data and eventually providing the smoothed flow field. However, the traditional DFS does not have the ability to deal with the flow in the near wall region of vessel, especially for satisfying the no-slip boundary condition. In this study, therefore, an improved DFS method with specific near wall treatment is introduced for processing with 4D flow MRI inner flow with curved wall boundary as the blood flows. On the other hand, due to the coarse resolution of 4D flow MRI, velocity gradients in the near wall region are normally underestimated. As a result, a special wall function is required for accurately computing wall shear stress (WSS).


title: Initial states and apodisation for quantum field simulations in phase-space

abstract: Bosonic quantum fields can be simulated with `quantum software' in phase-space. The positive-P, Wigner and Q-function phase-space methods are reviewed. Initial quantum states and boundaries for infinite domains are considered in detail. The quantum initial conditions treated include both multi-mode Gaussian states and number states, which are sampled using phase-shifted weighting techniques. This is more efficient than direct probabilistic sampling. Algorithms for treating periodic boundaries within infinite domains are developed via apodisation, or absorbers near the boundary. Similar truncation or anti-aliasing issues arise in the frequency domain with Fourier transform methods. Complex apodisation, in which there are phase-shifts as well as absorption, improves accuracy by reducing unwanted errors, and this is illustrated numerically. The complex power law apodisation techniques described here can be applied to numerical calculations or even directly in optics. Phase-space simulations, used for both quantum optical and Bose-Einstein condensate quantum dynamical calculations, require quantum noise terms to be included. A method is described to analyze number conservation in apodised calculations. Some techniques developed here are potentially applicable to all digital simulations, whether using classical or quantum logic.


title: Single image reflection removal via learning with multi-image constraints

abstract: Reflections are very common phenomena in our daily photography, which distract people's attention from the scene behind the glass. The problem of removing reflection artifacts is important but challenging due to its ill-posed nature. The traditional approaches solve an optimization problem over the constraints induced from multiple images, at the expense of large computation costs. Recent learning-based approaches have demonstrated a significant improvement in both performance and running time for single image reflection removal, but are limited as they require a large number of synthetic reflection/clean image pairs for direct supervision to approximate the ground truth, at the risk of overfitting in the synthetic image domain and degrading in the real image domain. In this paper, we propose a novel learning-based solution that combines the advantages of the aforementioned approaches and overcomes their drawbacks. Our algorithm works by learning a deep neural network to optimize the target with joint constraints enhanced among multiple input images during the training phase, but is able to eliminate reflections only from a single input for evaluation. Our algorithm runs in real-time and achieves state-of-the-art reflection removal performance on real images. We further propose a strong network backbone that disentangles the background and reflection information into separate latent codes, which are embedded into a shared one-branch deep neural network for both background and reflection predictions. The proposed backbone experimentally performs better than the other common network implementations, and provides insightful knowledge to understand the reflection removal task.


title: Bayesian Structure Adaptation for Continual Learning

abstract: Continual Learning is a learning paradigm where learning systems are trained with sequential or streaming tasks. Two notable directions among the recent advances in continual learning with neural networks are ($i$) variational Bayes based regularization by learning priors from previous tasks, and, ($ii$) learning the structure of deep networks to adapt to new tasks. So far, these two approaches have been orthogonal. We present a novel Bayesian approach to continual learning based on learning the structure of deep neural networks, addressing the shortcomings of both these approaches. The proposed model learns the deep structure for each task by learning which weights to be used, and supports inter-task transfer through the overlapping of different sparse subsets of weights learned by different tasks. Experimental results on supervised and unsupervised benchmarks shows that our model performs comparably or better than recent advances in continual learning setting.


title: Generalizing the Sokolov-Ternov effect for radiative polarization in intense laser fields

abstract: A consistent description of the radiative polarization for relativistic electrons in intense laser fields is derived by generalizing the Sokolov-Ternov effect in general field structure. The new form together with the spin-dependent radiation-reaction force provides a complete set of dynamical equations for electron momentum and spin in strong fields. When applied to varying intense fields, e.g. the laser fields, the generalized Sokolov-Ternov effect allows electrons to gain or lose polarization in any directions other than along the magnetic field in the rest frame of the electron. The generalized theory is applied to the collision process between initially polarized/unpolarized high energy electrons with linearly polarized ultra-intense laser pulse, showing results that eliminate the dependence on specific choices of a quantization axis and spin initialization existing in spin-projection models.


title: Holographic quantum critical conductivity from higher derivative electrodynamics

abstract: We study the conductivity from higher derivative electrodynamics in a holographic quantum critical phase (QCP). Two key features of this model are observed. First, a rescaling for the Euclidean frequency by a constant is needed when fitting the quantum Monte Carlo (QMC) data for the $O(2)$ QCP. We conclude that it is a common characteristic of the higher derivative electrodynamics. Second, both the Drude-like peak at low frequency and the pronounced peak can simultaneously emerge. They are more evident for the relevant operators than for the irrelevant operators. In addition, our result also further confirms that the conductivity for the $O(2)$ QCP is particle-like but not vortex-like. Finally, the electromagnetic (EM) duality is briefly discussed. The largest discrepancies of the particle-vortex duality in the boundary theory appear at the low frequency and the particle-vortex duality holds more well for the irrelevant operator than for the relevant operator.


title: A Multi Purpose and Large Scale Speech Corpus in Persian and English for Speaker and Speech Recognition: the DeepMine Database

abstract: DeepMine is a speech database in Persian and English designed to build and evaluate text-dependent, text-prompted, and text-independent speaker verification, as well as Persian speech recognition systems. It contains more than 1850 speakers and 540 thousand recordings overall, more than 480 hours of speech are transcribed. It is the first public large-scale speaker verification database in Persian, the largest public text-dependent and text-prompted speaker verification database in English, and the largest public evaluation dataset for text-independent speaker verification. It has a good coverage of age, gender, and accents. We provide several evaluation protocols for each part of the database to allow for research on different aspects of speaker verification. We also provide the results of several experiments that can be considered as baselines: HMM-based i-vectors for text-dependent speaker verification, and HMM-based as well as state-of-the-art deep neural network based ASR. We demonstrate that the database can serve for training robust ASR models.


title: 6-DOF Grasping for Target-driven Object Manipulation in Clutter

abstract: Grasping in cluttered environments is a fundamental but challenging robotic skill. It requires both reasoning about unseen object parts and potential collisions with the manipulator. Most existing data-driven approaches avoid this problem by limiting themselves to top-down planar grasps which is insufficient for many real-world scenarios and greatly limits possible grasps. We present a method that plans 6-DOF grasps for any desired object in a cluttered scene from partial point cloud observations. Our method achieves a grasp success of 80.3%, outperforming baseline approaches by 17.6% and clearing 9 cluttered table scenes (which contain 23 unknown objects and 51 picks in total) on a real robotic platform. By using our learned collision checking module, we can even reason about effective grasp sequences to retrieve objects that are not immediately accessible. Supplementary video can be found at https://youtu.be/w0B5S-gCsJk.


title: VoronoiNet: General Functional Approximators with Local Support

abstract: Voronoi diagrams are highly compact representations that are used in various Graphics applications. In this work, we show how to embed a differentiable version of it -- via a novel deep architecture -- into a generative deep network. By doing so, we achieve a highly compact latent embedding that is able to provide much more detailed reconstructions, both in 2D and 3D, for various shapes. In this tech report, we introduce our representation and present a set of preliminary results comparing it with recently proposed implicit occupancy networks.


title: Face Beautification: Beyond Makeup Transfer

abstract: Facial appearance plays an important role in our social lives. Subjective perception of women's beauty depends on various face-related (e.g., skin, shape, hair) and environmental (e.g., makeup, lighting, angle) factors. Similar to cosmetic surgery in the physical world, virtual face beautification is an emerging field with many open issues to be addressed. Inspired by the latest advances in style-based synthesis and face beauty prediction, we propose a novel framework of face beautification. For a given reference face with a high beauty score, our GAN-based architecture is capable of translating an inquiry face into a sequence of beautified face images with referenced beauty style and targeted beauty score values. To achieve this objective, we propose to integrate both style-based beauty representation (extracted from the reference face) and beauty score prediction (trained on SCUT-FBP database) into the process of beautification. Unlike makeup transfer, our approach targets at many-to-many (instead of one-to-one) translation where multiple outputs can be defined by either different references or varying beauty scores. Extensive experimental results are reported to demonstrate the effectiveness and flexibility of the proposed face beautification framework.