title: Numerical quasi-conformal transformations for electron dynamics on strained graphene surfaces

abstract: The dynamics of low energy electrons in general static strained graphene surface is modelled mathematically by the Dirac equation in curved space-time. In Cartesian coordinates, a parametrization of the surface can be straightforwardly obtained, but the resulting Dirac equation is intricate for general surface deformations. Two different strategies are introduced to simplify this problem: the diagonal metric approximation and the change of variables to isothermal coordinates. These coordinates are obtained from quasi-conformal transformations characterized by the Beltrami equation, whose solution gives the mapping between both coordinate systems. To implement this second strategy, a least square finite-element numerical scheme is introduced to solve the Beltrami equation. The Dirac equation is then solved via an accurate pseudo-spectral numerical method in the pseudo-Hermitian representation that is endowed with explicit unitary evolution and conservation of the norm. The two approaches are compared and applied to the scattering of electrons on Gaussian shaped graphene surface deformations. It is demonstrated that electron wave packets can be focused by these local strained regions.


title: Learning How to Solve Bubble Ball

abstract: "Bubble Ball" is a game built on a 2D physics engine, where a finite set of objects can modify the motion of a bubble-like ball. The objective is to choose the set and the initial configuration of the objects, in order to get the ball to reach a target flag. The presence of obstacles, friction, contact forces and combinatorial object choices make the game hard to solve. In this paper, we propose a hierarchical predictive framework which solves Bubble Ball. Geometric, kinematic and dynamic models are used at different levels of the hierarchy. At each level of the game, data collected during failed iterations are used to update models at all hierarchical level and converge to a feasible solution to the game. The proposed approach successfully solves a large set of Bubble Ball levels within reasonable number of trials. This proposed framework can also be used to solve other physics-based games, especially with limited training data from human demonstrations.


title: A General Framework for Distributed Inference with Uncertain Models

abstract: This paper studies the problem of distributed classification with a network of heterogeneous agents. The agents seek to jointly identify the underlying target class that best describes a sequence of observations. The problem is first abstracted to a hypothesis-testing framework, where we assume that the agents seek to agree on the hypothesis (target class) that best matches the distribution of observations. Non-Bayesian social learning theory provides a framework that solves this problem in an efficient manner by allowing the agents to sequentially communicate and update their beliefs for each hypothesis over the network. Most existing approaches assume that agents have access to exact statistical models for each hypothesis. However, in many practical applications, agents learn the likelihood models based on limited data, which induces uncertainty in the likelihood function parameters. In this work, we build upon the concept of uncertain models to incorporate the agents' uncertainty in the likelihoods by identifying a broad set of parametric distribution that allows the agents' beliefs to converge to the same result as a centralized approach. Furthermore, we empirically explore extensions to non-parametric models to provide a generalized framework of uncertain models in non-Bayesian social learning.


title: From Recognition to Prediction: Analysis of Human Action and Trajectory Prediction in Video

abstract: With the advancement in computer vision deep learning, systems now are able to analyze an unprecedented amount of rich visual information from videos to enable applications such as autonomous driving, socially-aware robot assistant and public safety monitoring. Deciphering human behaviors to predict their future paths/trajectories and what they would do from videos is important in these applications. However, human trajectory prediction still remains a challenging task, as scene semantics and human intent are difficult to model. Many systems do not provide high-level semantic attributes to reason about pedestrian future. This design hinders prediction performance in video data from diverse domains and unseen scenarios. To enable optimal future human behavioral forecasting, it is crucial for the system to be able to detect and analyze human activities as well as scene semantics, passing informative features to the subsequent prediction module for context understanding.


title: A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving

abstract: Capturing uncertainty in object detection is indispensable for safe autonomous driving. In recent years, deep learning has become the de-facto approach for object detection, and many probabilistic object detectors have been proposed. However, there is no summary on uncertainty estimation in deep object detection, and existing methods are not only built with different network architectures and uncertainty estimation methods, but also evaluated on different datasets with a wide range of evaluation metrics. As a result, a comparison among methods remains challenging, as does the selection of a model that best suits a particular application. This paper aims to alleviate this problem by providing a review and comparative study on existing probabilistic object detection methods for autonomous driving applications. First, we provide an overview of generic uncertainty estimation in deep learning, and then systematically survey existing methods and evaluation metrics for probabilistic object detection. Next, we present a strict comparative study for probabilistic object detection based on an image detector and three public autonomous driving datasets. Finally, we present a discussion of the remaining challenges and future works. Code has been made available at https://github.com/asharakeh/pod_compare.git


title: AI Governance for Businesses

abstract: Artificial Intelligence (AI) governance regulates the exercise of authority and control over the management of AI. It aims at leveraging AI through effective use of data and minimization of AI-related cost and risk. While topics such as AI governance and AI ethics are thoroughly discussed on a theoretical, philosophical, societal and regulatory level, there is limited work on AI governance targeted to companies and corporations. This work views AI products as systems, where key functionality is delivered by machine learning (ML) models leveraging (training) data. We derive a conceptual framework by synthesizing literature on AI and related fields such as ML. Our framework decomposes AI governance into governance of data, (ML) models and (AI) systems along four dimensions. It relates to existing IT and data governance frameworks and practices. It can be adopted by practitioners and academics alike. For practitioners the synthesis of mainly research papers, but also practitioner publications and publications of regulatory bodies provides a valuable starting point to implement AI governance, while for academics the paper highlights a number of areas of AI governance that deserve more attention.


title: Orthogonality of the Dickson polynomials of the (k+1)-th kind

abstract: We study the Dickson polynomials of the (k+1)-th kind over the field of complex numbers. We show that they are a family of co-recursive orthogonal polynomials with respect to a quasi-definite moment functional L_{k}. We find an integral representation for L_{k} and compute explicit expressions for all of its moments.


title: Data-Driven System Level Synthesis

abstract: We establish data-driven versions of the System Level Synthesis (SLS) parameterization of achievable closed-loop system responses for a linear-time-invariant system over a finite-horizon. Inspired by recent work in data-driven control that leverages tools from behavioral theory, we show that optimization problems over system-responses can be posed using only libraries of past system trajectories, without explicitly identifying a system model. We first consider the idealized setting of noise free trajectories, and show an exact equivalence between traditional and data-driven SLS. We then show that in the case of a system driven by process noise, tools from robust SLS can be used to characterize the effects of noise on closed-loop performance, and further draw on tools from matrix concentration to show that a simple trajectory averaging technique can be used to mitigate these effects. We end with numerical experiments showing the soundness of our methods.


title: An Effective Anti-Aliasing Approach for Residual Networks

abstract: Image pre-processing in the frequency domain has traditionally played a vital role in computer vision and was even part of the standard pipeline in the early days of deep learning. However, with the advent of large datasets, many practitioners concluded that this was unnecessary due to the belief that these priors can be learned from the data itself. Frequency aliasing is a phenomenon that may occur when sub-sampling any signal, such as an image or feature map, causing distortion in the sub-sampled output. We show that we can mitigate this effect by placing non-trainable blur filters and using smooth activation functions at key locations, particularly where networks lack the capacity to learn them. These simple architectural changes lead to substantial improvements in out-of-distribution generalization on both image classification under natural corruptions on ImageNet-C [10] and few-shot learning on Meta-Dataset [17], without introducing additional trainable parameters and using the default hyper-parameters of open source codebases.


title: Lie group classification and conservation laws of a class of hyperbolic equations

abstract: A new method for the Lie group classification of differential equations is proposed. It is based of the determination of all possible cases of linear dependence of certain indeterminate appearing in the determining equations of symmetries of the equation. The method is simple and systematic and applied to a family of hyperbolic equations. Moreover, as the said family contains several known equations with important physical applications, low-order conservation laws of some relevant equations from the family are computed, and the results obtained are discussed with regard to the symmetry integrability of a particular class from the underlying family of hyperbolic equations.


title: Computing properties of thermodynamic binding networks: An integer programming approach

abstract: The thermodynamic binding networks (TBN) model is a tool for studying engineered molecular systems. The TBN model allows one to reason about their behavior through a simplified abstraction that ignores details about molecular composition, focusing on two key determinants of a system's energetics common to any chemical substrate: how many molecular bonds are formed, and how many separate complexes exist in the system. We formulate as an integer program the NP-hard problem of computing stable (a.k.a., minimum energy) configurations of a TBN: those configurations that maximize the number of bonds and complexes. We provide open-source software solving this integer program. We give empirical evidence that this approach enables dramatically faster computation of TBN stable configurations than previous approaches based on SAT solvers. Furthermore, unlike SAT-based approaches, our integer programming formulation can reason about TBNs in which some molecules have unbounded counts. These improvements in turn allow us to efficiently automate verification of desired properties of practical TBNs. Finally, we show that the TBN has a natural representation with a unique Hilbert basis describing the "fundamental components" out of which locally minimal energy configurations are composed. This characterization helps verify correctness of not only stable configurations, but entire "kinetic pathways" in a TBN.


title: Open-Vocabulary Object Detection Using Captions

abstract: Despite the remarkable accuracy of deep neural networks in object detection, they are costly to train and scale due to supervision requirements. Particularly, learning more object categories typically requires proportionally more bounding box annotations. Weakly supervised and zero-shot learning techniques have been explored to scale object detectors to more categories with less supervision, but they have not been as successful and widely adopted as supervised models. In this paper, we put forth a novel formulation of the object detection problem, namely open-vocabulary object detection, which is more general, more practical, and more effective than weakly supervised and zero-shot approaches. We propose a new method to train object detectors using bounding box annotations for a limited set of object categories, as well as image-caption pairs that cover a larger variety of objects at a significantly lower cost. We show that the proposed method can detect and localize objects for which no bounding box annotation is provided during training, at a significantly higher accuracy than zero-shot approaches. Meanwhile, objects with bounding box annotation can be detected almost as accurately as supervised methods, which is significantly better than weakly supervised baselines. Accordingly, we establish a new state of the art for scalable object detection.


title: Cost-Effective Quasi-Parallel Sensing Instrumentation for Industrial Chemical Species Tomography

abstract: Chemical Species Tomography (CST) has been widely applied for imaging of critical gas-phase parameters in industrial processes. To acquire high-fidelity images, CST is typically implemented by line-of-sight Wavelength Modulation Spectroscopy (WMS) measurements from multiple laser beams. The modulated transmission signal on each laser beam needs to be a) digitised by a high-speed analogue-to-digital converter (ADC); b) demodulated by a digital lock-in (DLI) module; and c) transferred to high-level processor for image reconstruction. Although a fully parallel data acquisition (DAQ) and signal processing system can achieve these functionalities with maximised temporal response, it leads to a highly complex, expensive and power-consuming instrumentation system with high potential for inconsistency between the sampled beams due to the electronics alone. In addition, the huge amount of spectral data sampled in parallel significantly burdens the communication process in industrial applications where in situ signal digitisation is distanced from the high-level data processing. To address these issues, a quasi-parallel sensing technique and electronic circuits were developed for industrial CST, in which the digitisation and demodulation of the multi-beam transmission signals are multiplexed over the high-frequency modulation within a wavelength scan. Our development not only maintains the temporal response of the fully parallel sensing scheme, but also facilitates the cost-effective implementation of industrial CST with very low complexity and reduced load on data transfer. The proposed technique is analytically proven, numerically examined by noise-contaminated CST simulations, and experimentally validated using a lab-scale CST system with 32 laser beams.


title: HAWQV3: Dyadic Neural Network Quantization

abstract: Current low-precision quantization algorithms often have the hidden cost of conversion back and forth from floating point to quantized integer values. This hidden cost limits the latency improvement realized by quantizing Neural Networks. To address this, we present HAWQV3, a novel mixed-precision integer-only quantization framework. The contributions of HAWQV3 are the following: (i) An integer-only inference where the entire computational graph is performed only with integer multiplication, addition, and bit shifting, without any floating point operations or even integer division; (ii) A novel hardware-aware mixed-precision quantization method where the bit-precision is calculated by solving an integer linear programming problem that balances the trade-off between model perturbation and other constraints, e.g., memory footprint and latency; (iii) Direct hardware deployment and open source contribution for 4-bit uniform/mixed-precision quantization in TVM, achieving an average speed up of $1.45\times$ for uniform 4-bit, as compared to uniform 8-bit for ResNet50 on T4 GPUs; and (iv) extensive evaluation of the proposed methods on ResNet18/50 and InceptionV3, for various model compression levels with/without mixed precision. For ResNet50, our INT8 quantization achieves an accuracy of $77.58\%$, which is $2.68\%$ higher than prior integer-only work, and our mixed-precision INT4/8 quantization can reduce INT8 latency by $23\%$ and still achieve $76.73\%$ accuracy. Our framework and the TVM implementation have been open sourced.


title: Analysis and Evaluation of Baseline Manipulation in Demand Response Programs

abstract: The customer baseline is required to assign rebates to participants in baseline-based demand response (DR) programs. The average baseline method has been widely accepted in practice due to its simplicity and reliability. However, the customer's baseline manipulation is little-known in the literature. We start from a customer's perspective and establish a Markov decision process to model the customer's payoff-maximizing problem. The behavior of a rational customer's underconsumption on DR days and overconsumption on non-DR days are revealed. Furthermore, we propose an approximated baseline method and show how the consumption distribution and program parameters affect the results. Due to the curse of dimensionality, a linear policy-based rollout algorithm is introduced to obtain a practical approximate solution. Finally, a case study is carried out to illustrate the baseline manipulation, where the simulation results confirm the effectiveness of the proposed methods and shed light on how to properly design baseline methods.


title: Continuous-Time Convergence Rates in Potential and Monotone Games

abstract: In this paper, we provide exponential rates of convergence to the interior Nash equilibrium for continuous-time dual-space game dynamics such as mirror descent (MD) and actor-critic (AC). We perform our analysis in $N$-player continuous concave games that satisfy certain monotonicity assumptions while possibly also admitting potential functions. In the first part of this paper, we provide a novel relative characterization of monotone games and show that MD and its discounted version converge with $\mathcal{O}(e^{-\beta t})$ in relatively strongly and relatively hypo-monotone games, respectively. In the second part of this paper, we specialize our results to games that admit a relatively strongly concave potential and show AC converges with $\mathcal{O}(e^{-\beta t})$. These rates extend their known convergence conditions. Simulations are performed which empirically back up our results.

categories: math.OC cs.GT cs.MA cs.SY eess.SY math.DS


title: Athena: Constructing Dialogues Dynamically with Discourse Constraints

abstract: This report describes Athena, a dialogue system for spoken conversation on popular topics and current events. We develop a flexible topic-agnostic approach to dialogue management that dynamically configures dialogue based on general principles of entity and topic coherence. Athena's dialogue manager uses a contract-based method where discourse constraints are dispatched to clusters of response generators. This allows Athena to procure responses from dynamic sources, such as knowledge graph traversals and feature-based on-the-fly response retrieval methods. After describing the dialogue system architecture, we perform an analysis of conversations that Athena participated in during the 2019 Alexa Prize Competition. We conclude with a report on several user studies we carried out to better understand how individual user characteristics affect system ratings.


title: SHOT-VAE: Semi-supervised Deep Generative Models With Label-aware ELBO Approximations

abstract: Semi-supervised variational autoencoders (VAEs) have obtained strong results, but have also encountered the challenge that good ELBO values do not always imply accurate inference results. In this paper, we investigate and propose two causes of this problem: (1) The ELBO objective cannot utilize the label information directly. (2) A bottleneck value exists and continuing to optimize ELBO after this value will not improve inference accuracy. On the basis of the experiment results, we propose SHOT-VAE to address these problems without introducing additional prior knowledge. The SHOT-VAE offers two contributions: (1) A new ELBO approximation named smooth-ELBO that integrates the label predictive loss into ELBO. (2) An approximation based on optimal interpolation that breaks the ELBO value bottleneck by reducing the margin between ELBO and the data likelihood. The SHOT-VAE achieves good performance with a 25.30% error rate on CIFAR-100 with 10k labels and reduces the error rate to 6.11% on CIFAR-10 with 4k labels.


title: Linearly Implicit Multistep Methods for Time Integration

abstract: Time integration methods for solving initial value problems are an important component of many scientific and engineering simulations. Implicit time integrators are desirable for their stability properties, significantly relaxing restrictions on timestep size. However, implicit methods require solutions to one or more systems of nonlinear equations at each timestep, which for large simulations can be prohibitively expensive. This paper introduces a new family of linearly implicit multistep methods (LIMM), which only requires the solution of one linear system per timestep. Order conditions and stability theory for these methods are presented, as well as design and implementation considerations. Practical methods of order up to five are developed that have similar error coefficients, but improved stability regions, when compared to the widely used BDF methods. Numerical testing of a self-starting variable stepsize and variable order implementation of the new LIMM methods shows measurable performance improvement over a similar BDF implementation.


title: Effect of phase string on single-hole dynamics in the two-leg Hubbard ladder

abstract: Optical measurements in doped Mott insulators have discovered the emergence of spectral weights at mid-infrared (MIR) upon chemical doping and photodoping. MIR weights may have a relation to string-type excitation of spins, which is induced by a doped hole generating misarranged spins with respect to their sublattice. There are two types of string effects: one is an $S^z$ string that is repairable by quantum spin flips and the other is a phase string irreparable by the spin flips. We investigate the effect of $S^{z}$ and phase strings on MIR weights. Calculating the optical conductivity of the single-hole Hubbard model in the strong-coupling regime and the $t$-$J$ model on two-leg ladders by using time-dependent Lanczos and density-matrix renormalization group, we find that phase strings make a crucial effect on the emergence of MIR weights as compared with $S^{z}$ strings. Our findings indicate that a mutual Chern-Simons gauge field acting between spin and charge degrees of freedom, which is the origin of phase strings, is significant for obtaining MIR weights. Conversely, if we remove this gauge field, no phase is picked up by a doped hole. As a result, a spin-polaron accompanied by a local spin distortion emerges and a quasiparticle with a cosine-like energy dispersion is formed in single-particle spectral function. Furthermore, we suggest a Floquet engineering to examine the phase-string effect in cold atoms.


title: HDR Environment Map Estimation for Real-Time Augmented Reality

abstract: We present a method to estimate an HDR environment map from a narrow field-of-view LDR camera image in real-time. This enables perceptually appealing reflections and shading on virtual objects of any material finish, from mirror to diffuse, rendered into a real physical environment using augmented reality. Our method is based on our efficient convolutional neural network architecture, EnvMapNet, trained end-to-end with two novel losses, ProjectionLoss for the generated image, and ClusterLoss for adversarial training. Through qualitative and quantitative comparison to state-of-the-art methods, we demonstrate that our algorithm reduces the directional error of estimated light sources by more than 50%, and achieves 3.7 times lower Frechet Inception Distance (FID). We further showcase a mobile application that is able to run our neural network model in under 9 ms on an iPhone XS, and render in real-time, visually coherent virtual objects in previously unseen real-world environments.


title: Iterative Text-based Editing of Talking-heads Using Neural Retargeting

abstract: We present a text-based tool for editing talking-head video that enables an iterative editing workflow. On each iteration users can edit the wording of the speech, further refine mouth motions if necessary to reduce artifacts and manipulate non-verbal aspects of the performance by inserting mouth gestures (e.g. a smile) or changing the overall performance style (e.g. energetic, mumble). Our tool requires only 2-3 minutes of the target actor video and it synthesizes the video for each iteration in about 40 seconds, allowing users to quickly explore many editing possibilities as they iterate. Our approach is based on two key ideas. (1) We develop a fast phoneme search algorithm that can quickly identify phoneme-level subsequences of the source repository video that best match a desired edit. This enables our fast iteration loop. (2) We leverage a large repository of video of a source actor and develop a new self-supervised neural retargeting technique for transferring the mouth motions of the source actor to the target actor. This allows us to work with relatively short target actor videos, making our approach applicable in many real-world editing scenarios. Finally, our refinement and performance controls give users the ability to further fine-tune the synthesized results.


title: Asymptotic (statistical) periodicity in two-dimensional maps

abstract: In this paper we give a new sufficient condition for asymptotic periodicity of Frobenius-Perron operator corresponding to two--dimensional maps. The result of the asymptotic periodicity for strictly expanding systems, that is, all eigenvalues of the system are greater than one, in a high-dimensional dynamical systems was already known. Our new theorem enables to apply for the system having an eigenvalue smaller than one. The key idea for the proof is a function of bounded variation defined by line integration. Finally, we introduce a new two-dimensional dynamical system exhibiting the asymptotic periodicity with different periods depending on parameter values, and discuss to apply our theorem to the model.


title: Self-adapting Robustness in Demand Learning

abstract: We study dynamic pricing over a finite number of periods in the presence of demand model ambiguity. Departing from the typical no-regret learning environment, where price changes are allowed at any time, pricing decisions are made at pre-specified points in time and each price can be applied to a large number of arrivals. In this environment, which arises in retailing, a pricing decision based on an incorrect demand model can significantly impact cumulative revenue. We develop an adaptively-robust-learning (ARL) pricing policy that learns the true model parameters from the data while actively managing demand model ambiguity. It optimizes an objective that is robust with respect to a self-adapting set of demand models, where a given model is included in this set only if the sales data revealed from prior pricing decisions makes it "probable". As a result, it gracefully transitions from being robust when demand model ambiguity is high to minimizing regret when this ambiguity diminishes upon receiving more data. We characterize the stochastic behavior of ARL's self-adapting ambiguity sets and derive a regret bound that highlights the link between the scale of revenue loss and the customer arrival pattern. We also show that ARL, by being conscious of both model ambiguity and revenue, bridges the gap between a distributionally robust policy and a follow-the-leader policy, which focus on model ambiguity and revenue, respectively. We numerically find that the ARL policy, or its extension thereof, exhibits superior performance compared to distributionally robust, follow-the-leader, and upper-confidence-bound policies in terms of expected revenue and/or value at risk.


title: Tau Functions of (n,1) curves and Soliton Solutions on Non-Zero Constant Backgrounds

abstract: We study the tau function of the KP-hierarchy associated with an (n,1) curve $y^n=x-\alpha$. If $\alpha=0$ the corresponding tau function is 1. On the other hand if $\alpha\neq 0$ the tau function becomes the exponential of a quadratic function of the time variables. By applying vertex opertaors to the latter we obtain soliton solutions on non-zero constant backgrounds.


title: Riemann-Type Functional Equations -- Julia Line and Counting Formulae --

abstract: We study Riemann-type functional equations with respect to value-distribution theory and derive implications for their solutions. In particular, for a fixed complex number $a\neq0$ and a function from the Selberg class $\mathcal{L}$, we prove a Riemann-von Mangoldt formula for the number of a-points of the $\Delta$-factor of the functional equation of $\mathcal{L}$ and an analog of Landau's formula over these points. From the last formula we derive that the ordinates of these $a$-points are uniformly distributed modulo one. Lastly, we show the existence of the mean-value of the values of $\mathcal{L}(s)$ taken at these points.


title: Templates, Arrays, and Overlays

abstract: We will use overlays and templates derived from two-dimensional recurrence relations to build the arrays, and we will study the structure of the overlays, including initial conditions and basis arrays.


title: Approximating Ground State Energies and Wave Functions of Physical Systems with Neural Networks

abstract: Quantum theory has been remarkably successful in providing an understanding of physical systems at foundational scales. Solving the Schr\"odinger equation provides full knowledge of all dynamical quantities of the physical system. However closed form solutions to this equation are only available for a few systems and approximation methods are typically used to find solutions. In this paper we address the problem of solving the time independent Schr\"odinger equation for the ground state solution of physical systems. We propose using end-to-end deep learning approach in a variational optimization scheme for approximating the ground state energies and wave functions of these systems. A neural network realizes a universal trial wave function and is trained in an unsupervised learning framework by optimizing the expectation value of the Hamiltonian of a physical system. The proposed approach is evaluated on physical systems consisting of a particle in a box with and without a perturbation. We demonstrate that our approach obtains approximations of ground state energies and wave functions that are highly accurate, which makes it a potentially plausible candidate for solving more complex physical systems for which analytical solutions are beyond reach.


title: Sparse sketches with small inversion bias

abstract: For a tall $n\times d$ matrix $A$ and a random $m\times n$ sketching matrix $S$, the sketched estimate of the inverse covariance matrix $(A^\top A)^{-1}$ is typically biased: $E[(\tilde A^\top\tilde A)^{-1}]\ne(A^\top A)^{-1}$, where $\tilde A=SA$. This phenomenon, which we call inversion bias, arises, e.g., in statistics and distributed optimization, when averaging multiple independently constructed estimates of quantities that depend on the inverse covariance. We develop a framework for analyzing inversion bias, based on our proposed concept of an $(\epsilon,\delta)$-unbiased estimator for random matrices. We show that when the sketching matrix $S$ is dense and has i.i.d. sub-gaussian entries, then after simple rescaling, the estimator $(\frac m{m-d}\tilde A^\top\tilde A)^{-1}$ is $(\epsilon,\delta)$-unbiased for $(A^\top A)^{-1}$ with a sketch of size $m=O(d+\sqrt d/\epsilon)$. This implies that for $m=O(d)$, the inversion bias of this estimator is $O(1/\sqrt d)$, which is much smaller than the $\Theta(1)$ approximation error obtained as a consequence of the subspace embedding guarantee for sub-gaussian sketches. We then propose a new sketching technique, called LEverage Score Sparsified (LESS) embeddings, which uses ideas from both data-oblivious sparse embeddings as well as data-aware leverage-based row sampling methods, to get $\epsilon$ inversion bias for sketch size $m=O(d\log d+\sqrt d/\epsilon)$ in time $O(\text{nnz}(A)\log n+md^2)$, where nnz is the number of non-zeros. The key techniques enabling our analysis include an extension of a classical inequality of Bai and Silverstein for random quadratic forms, which we call the Restricted Bai-Silverstein inequality; and anti-concentration of the Binomial distribution via the Paley-Zygmund inequality, which we use to prove a lower bound showing that leverage score sampling sketches generally do not achieve small inversion bias.


title: Cophasing multiple aperture telescopes with Linearized Analytic Phase Diversity (LAPD)

abstract: Focal plane wavefront sensing is an appealing technique to cophase multiple aperture telescopes. Phase diversity, operable with any aperture configuration or source extension, generally suffers from high computing load. In this Letter, we introduce, characterize and experimentally validate the LAPD algorithm, based on a fast linearized phase diversity algorithm \rev{with a capture range comparable to classic phase diversity.} We demonstrate that a typical performance of lambda/75 RMS wavefront error can be reached.


title: Aerial Height Prediction and Refinement Neural Networks with Semantic and Geometric Guidance

abstract: Deep learning provides a powerful new approach to many computer vision tasks. Height prediction from aerial images is one of those tasks that benefited greatly from the deployment of deep learning which replaced old multi-view geometry techniques. This letter proposes a two-stage approach, where first a multi-task neural network is used to predict the height map resulting from a single RGB aerial input image. We also include a second refinement step, where a denoising autoencoder is used to produce higher quality height maps. Experiments on two publicly available datasets show that our method is capable of producing state-of-the-art results. Code is available at https://github.com/melhousni/DSMNet.


title: Backdoor Attacks on the DNN Interpretation System

abstract: Interpretability is crucial to understand the inner workings of deep neural networks (DNNs) and many interpretation methods generate saliency maps that highlight parts of the input image that contribute the most to the prediction made by the DNN. In this paper we design a backdoor attack that alters the saliency map produced by the network for an input image only with injected trigger that is invisible to the naked eye while maintaining the prediction accuracy. The attack relies on injecting poisoned data with a trigger into the training data set. The saliency maps are incorporated in the penalty term of the objective function that is used to train a deep model and its influence on model training is conditioned upon the presence of a trigger. We design two types of attacks: targeted attack that enforces a specific modification of the saliency map and untargeted attack when the importance scores of the top pixels from the original saliency map are significantly reduced. We perform empirical evaluation of the proposed backdoor attacks on gradient-based and gradient-free interpretation methods for a variety of deep learning architectures. We show that our attacks constitute a serious security threat when deploying deep learning models developed by untrusty sources. Finally, in the Supplement we demonstrate that the proposed methodology can be used in an inverted setting, where the correct saliency map can be obtained only in the presence of a trigger (key), effectively making the interpretation system available only to selected users.


title: Human Exposure to Radiofrequency Energy above 6 GHz: Review of Computational Dosimetry Studies

abstract: International guidelines/standards for human protection from electromagnetic fields have been revised recently, especially for frequencies above 6 GHz where new wireless communication systems have been deployed. Above this frequency a new physical quantity "absorbed/epithelia power density" has been adopted as a dose metric. Then, the permissible level of external field strength/power density is derived for practical assessment. In addition, a new physical quantity, fluence or absorbed energy density, is introduced for protection from brief pulses (especially for shorter than 10 sec). These limits were explicitly designed to avoid excessive increases in tissue temperature, based on electromagnetic and thermal modeling studies but supported by experimental data where available. This paper reviews the studies on the computational modeling/dosimetry which are related to the revision of the guidelines/standards. The comparisons with experimental data as well as an analytic solution are also been presented. Future research needs and additional comments on the revision will also be mentioned.


title: Some Open Problems Regarding the Number of Lines and Slopes in Arrangements that Determine Shapes

abstract: A set $L$ of straight lines and a set $P$ of points in the Euclidean plane define an arrangement $\mathcal{A}$ = ($L$, $P$) of construction lines and registration marks, if and only if: (1) any point in $P$ is a point of intersection of at least two lines in $L$, and (2) any two nonparallel lines in $L$ have a unique point of intersection in $P$. This paper discusses the following open problems regarding such arrangements. Suppose $k \geq 0$ number of points are given in the plane. How many construction lines $k$ points must determine? How many distinct slopes, or directions, are defined by construction lines that $k$ points determine? How many distinct sets of construction lines partition the plane, such that the lines meet at exactly $k$ points? Empirical evidence is reported for small numbers of $k$, offering partial answers to the three problems. A conjecture is also stated for the first problem, on the number of construction lines, after examining a related problem about finite linear spaces from incidence geometry.


title: London moment, London's superpotential, Nambu-Goldstone mode, and Berry connection from many-body wave functions

abstract: Although the standard theory of superconductivity based on the BCS theory is a successful one, there are several experimental results that indicate the necessity for fundamental revisions. One of them is the mass in the London moment. Experiments indicate the mass in the London moment is the free electron mass although the BCS theory and its extension predict it to be an effective mass. We show that this discrepancy is lifted if we install the London's superpotential in the theory, and identify it as the Berry phase arising from the many-body wave functions. Then, the induced current by the applied magnetic field becomes a stable current calculated using the free energy in contrast to the linear response current assumed in the standard theory which yields the Nambu-Goldstone mode. The Nambu-Goldstone mode arising from the breakdown of the global $U(1)$ gauge invariance in the standard theory is replaced by the collective mode arising from the Berry connection. Then, the free electron mass appears in the London moment.


title: CancerNet-SCa: Tailored Deep Neural Network Designs for Detection of Skin Cancer from Dermoscopy Images

abstract: Skin cancer continues to be the most frequently diagnosed form of cancer in the U.S., with not only significant effects on health and well-being but also significant economic costs associated with treatment. A crucial step to the treatment and management of skin cancer is effective skin cancer detection due to strong prognosis when treated at an early stage, with one of the key screening approaches being dermoscopy examination. Motivated by the advances of deep learning and inspired by the open source initiatives in the research community, in this study we introduce CancerNet-SCa, a suite of deep neural network designs tailored for the detection of skin cancer from dermoscopy images that is open source and available to the general public as part of the Cancer-Net initiative. To the best of the authors' knowledge, CancerNet-SCa comprises of the first machine-designed deep neural network architecture designs tailored specifically for skin cancer detection, one of which possessing a self-attention architecture design with attention condensers. Furthermore, we investigate and audit the behaviour of CancerNet-SCa in a responsible and transparent manner via explainability-driven model auditing. While CancerNet-SCa is not a production-ready screening solution, the hope is that the release of CancerNet-SCa in open source, open access form will encourage researchers, clinicians, and citizen data scientists alike to leverage and build upon them.


title: Absolute Hodge and $\ell$-adic Monodromy

abstract: Let $\mathbb{V}$ be a motivic variation of Hodge structure on a $K$-variety $S$, let $\mathcal{H}$ be the associated $K$-algebraic Hodge bundle, and let $\sigma \in \textrm{Aut}(\mathbb{C}/K)$ be an automorphism. The absolute Hodge conjecture predicts that given a Hodge vector $v \in \mathcal{H}_{\mathbb{C}, s}$ above $s \in S(\mathbb{C})$ which lies inside $\mathbb{V}_{s}$, the conjugate vector $v_{\sigma} \in \mathcal{H}_{\mathbb{C}, s_{\sigma}}$ is Hodge and lies inside $\mathbb{V}_{s_{\sigma}}$. We study this problem in the situation where we have an algebraic subvariety $Z \subset S_{\mathbb{C}}$ containing $s$ whose algebraic monodromy group $\mathbf{H}_Z$ fixes $v$. Using relationships between $\mathbf{H}_Z$ and $\mathbf{H}_{Z_{\sigma}}$ coming from the theories of complex and $\ell$-adic local systems, we establish a criterion that implies the absolute Hodge conjecture for $v$ subject to a group-theoretic condition on $\mathbf{H}_{Z}$. We then use our criterion to establish new cases of the absolute Hodge conjecture.


title: Neural Group Testing to Accelerate Deep Learning

abstract: Recent advances in deep learning have made the use of large, deep neural networks with tens of millions of parameters. The sheer size of these networks imposes a challenging computational burden during inference. Existing work focuses primarily on accelerating each forward pass of a neural network. Inspired by the group testing strategy for efficient disease testing, we propose neural group testing, which accelerates by testing a group of samples in one forward pass. Groups of samples that test negative are ruled out. If a group tests positive, samples in that group are then retested adaptively. A key challenge of neural group testing is to modify a deep neural network so that it could test multiple samples in one forward pass. We propose three designs to achieve this without introducing any new parameters and evaluate their performances. We applied neural group testing in an image moderation task to detect rare but inappropriate images. We found that neural group testing can group up to 16 images in one forward pass and reduce the overall computation cost by over 73% while improving detection performance.


title: Modeling transport of scalars in two-phase flows with a diffuse-interface method

abstract: In this article, we propose a novel scalar-transport model for the simulation of scalar quantities in two-phase flows with a phase-field method (diffuse-interface method). In a two-phase flow, the scalar quantities typically have disparate properties in two phases, which results in effective confinement of the scalar quantities in one of the phases, in the time scales of interest. This confinement of the scalars lead to the formation of sharp gradients of the scalar concentration values at the interface, presenting a serious challenge for its numerical simulations. To overcome this challenge, we propose a model for the transport of scalars. The model is discretized using a central-difference scheme, which leads to a non-dissipative implementation that is crucial for the simulation of turbulent flows. Furthermore, the provable strengths of the proposed model are: (a) the model maintains the positivity property of the scalar concentration field, a physical realizability requirement for the simulation of scalars, when the proposed criterion is satisfied, (b) the proposed model is such that the transport of the scalar concentration field is consistent with the transport of the volume fraction field, which results in the enforcement of the effective zero-flux boundary condition for the scalar at the interface; and therefore, prevents the artificial numerical diffusion of the scalar across the interface. Finally, we present numerical simulations using the proposed model in a wide range of two-phase flow regimes, spanning laminar to turbulent flows; and assess: the accuracy and robustness of the model, the validity of the positivity property of the scalar concentration field, and the enforcement of the zero-flux boundary condition for the scalar at the interface.


title: Speech Denoising with Auditory Models

abstract: Contemporary speech enhancement predominantly relies on audio transforms that are trained to reconstruct a clean speech waveform. The development of high-performing neural network sound recognition systems has raised the possibility of using deep feature representations as 'perceptual' losses with which to train denoising systems. We explored their utility by first training deep neural networks to classify either spoken words or environmental sounds from audio. We then trained an audio transform to map noisy speech to an audio waveform that minimized the difference in the deep feature representations between the output audio and the corresponding clean audio. The resulting transforms removed noise substantially better than baseline methods trained to reconstruct clean waveforms, and also outperformed previous methods using deep feature losses. However, a similar benefit was obtained simply by using losses derived from the filter bank inputs to the deep networks. The results show that deep features can guide speech enhancement, but suggest that they do not yet outperform simple alternatives that do not involve learned features.


title: Explainable Composition of Aggregated Assistants

abstract: A new design of an AI assistant that has become increasingly popular is that of an "aggregated assistant" -- realized as an orchestrated composition of several individual skills or agents that can each perform atomic tasks. In this paper, we will talk about the role of planning in the automated composition of such assistants and explore how concepts in automated planning can help to establish transparency of the inner workings of the assistant to the end-user.


title: Histology to 3D In Vivo MR Registration for Volumetric Evaluation of MRgFUS Treatment Assessment Biomarkers

abstract: Advances in imaging and early cancer detection have increased interest in magnetic resonance (MR) guided focused ultrasound (MRgFUS) technologies for cancer treatment. MRgFUS ablation treatments could reduce surgical risks, preserve organ tissue/function, and improve patient quality of life. However, surgical resection and histological analysis remain the gold standard to assess cancer treatment response. For non-invasive ablation therapies such as MRgFUS, the treatment response must be determined through MR imaging biomarkers. However, current MR biomarkers are inconclusive and have not been rigorously evaluated against histology via accurate registration. Existing registration methods rely on anatomical features to directly register in vivo MR and histology. For MRgFUS applications in anatomies such as liver, kidney, or breast, anatomical features independent from treatment features are often insufficient to perform direct registration. We present a novel MR to histology registration workflow that utilizes intermediate imaging and does not rely on these independent features. The presented workflow yields an overall registration accuracy of 1.00 +/- 0.13 mm. The developed registration pipeline is used to evaluate a common MRgFUS treatment assessment biomarker against histology. Evaluating MR biomarkers against histology using this registration pipeline will facilitate validating novel MRgFUS biomarkers to improve treatment assessment without surgical intervention.


title: Deep Learning for Channel Sensing and Hybrid Precoding in TDD Massive MIMO OFDM Systems

abstract: This paper proposes a deep learning approach to channel sensing and downlink hybrid beamforming for massive multiple-input multiple-output systems operating in the time division duplex mode and employing either single-carrier or multicarrier transmission. The conventional precoding design involves a two-step process of first estimating the high-dimensional channel, then designing the precoders based on such estimate. This two-step process is, however, not necessarily optimal. This paper shows that by using a learning approach to design the analog sensing and the hybrid downlink precoders directly from the received pilots without the intermediate high-dimensional channel estimation, the overall system performance can be significantly improved. Training a neural network to design the analog and digital precoders simultaneously is, however, difficult. Further, such an approach is not generalizable to systems with different number of users. In this paper, we develop a simplified and generalizable approach that learns the uplink sensing matrix and downlink analog precoder using a deep neural network that decomposes on a per-user basis, then designs the digital precoder based on the estimated low-dimensional equivalent channel. Numerical comparisons show that the proposed methodology results in significantly less training overhead and leads to an architecture that generalizes to various system settings.


title: Exploring Voice Conversion based Data Augmentation in Text-Dependent Speaker Verification

abstract: In this paper, we focus on improving the performance of the text-dependent speaker verification system in the scenario of limited training data. The speaker verification system deep learning based text-dependent generally needs a large scale text-dependent training data set which could be labor and cost expensive, especially for customized new wake-up words. In recent studies, voice conversion systems that can generate high quality synthesized speech of seen and unseen speakers have been proposed. Inspired by those works, we adopt two different voice conversion methods as well as the very simple re-sampling approach to generate new text-dependent speech samples for data augmentation purposes. Experimental results show that the proposed method significantly improves the Equal Error Rare performance from 6.51% to 4.51% in the scenario of limited training data.


title: Spatial Signal Analysis based on Wave-Spectral Fractal Scaling: A Case of Urban Street Networks

abstract: For a long time, many methods are developed to make temporal signal analyses based on time series. However, for geographical systems, spatial signal analyses are as important as temporal signal analyses. Nonstationary spatial and temporal processes are associated with nonlinearity, and cannot be effectively analyzed by conventional analytical approaches. Fractal theory provides a powerful tool for exploring complexity and is helpful for spatio-temporal signal analysis. This paper is devoted to researching spatial signals of geographical systems by means of wave-spectrum scaling. The traffic networks of 10 Chinese cities are taken as cases for positive studies. Fast Fourier transform and least squares regression analysis are employed to calculate spectral exponents. The results show that the wave-spectral density distribution of all these urban traffic networks follows scaling law, and the spectral scaling exponents can be converted to fractal dimension values. Using the fractal parameters, we can make spatial analyses for the geographical signals. The analytical process can be generalized to temporal signal analyses. The wave-spectrum scaling methods can be applied to both self-similar fractal signals and self-affine fractal signals in the geographical world.


title: Near-Optimal Data Source Selection for Bayesian Learning

abstract: We study a fundamental problem in Bayesian learning, where the goal is to select a set of data sources with minimum cost while achieving a certain learning performance based on the data streams provided by the selected data sources. First, we show that the data source selection problem for Bayesian learning is NP-hard. We then show that the data source selection problem can be transformed into an instance of the submodular set covering problem studied in the literature, and provide a standard greedy algorithm to solve the data source selection problem with provable performance guarantees. Next, we propose a fast greedy algorithm that improves the running times of the standard greedy algorithm, while achieving performance guarantees that are comparable to those of the standard greedy algorithm. The fast greedy algorithm can also be applied to solve the general submodular set covering problem with performance guarantees. Finally, we validate the theoretical results using numerical examples, and show that the greedy algorithms work well in practice.


title: SceneChecker: Boosting Scenario Verification using Symmetry Abstractions

abstract: We presentSceneChecker, a tool for verifying scenarios involving vehicles executing complex plans in large cluttered workspaces. SceneChecker converts the scenario verification problem to a standard hybrid system verification problem, and solves it effectively by exploiting structural properties in the plan and the vehicle dynamics. SceneChecker uses symmetry abstractions, a novel refinement algorithm, and importantly, is built to boost the performance of any existing reachability analysis tool as a plug-in subroutine. We evaluated SceneChecker on several scenarios involving ground and aerial vehicles with nonlinear dynamics and neural network controllers, employing different kinds of symmetries, using different reachability subroutines, and following plans with hundreds of way-points in complex workspaces. Compared to two leading tools, DryVR and Flow*, SceneChecker shows 20x speedup in verification time, even while using those very tools as reachability subroutines.


title: Double Meta-Learning for Data Efficient Policy Optimization in Non-Stationary Environments

abstract: We are interested in learning models of non-stationary environments, which can be framed as a multi-task learning problem. Model-free reinforcement learning algorithms can achieve good asymptotic performance in multi-task learning at a cost of extensive sampling, due to their approach, which requires learning from scratch. While model-based approaches are among the most data efficient learning algorithms, they still struggle with complex tasks and model uncertainties. Meta-reinforcement learning addresses the efficiency and generalization challenges on multi task learning by quickly leveraging the meta-prior policy for a new task. In this paper, we propose a meta-reinforcement learning approach to learn the dynamic model of a non-stationary environment to be used for meta-policy optimization later. Due to the sample efficiency of model-based learning methods, we are able to simultaneously train both the meta-model of the non-stationary environment and the meta-policy until dynamic model convergence. Then, the meta-learned dynamic model of the environment will generate simulated data for meta-policy optimization. Our experiment demonstrates that our proposed method can meta-learn the policy in a non-stationary environment with the data efficiency of model-based learning approaches while achieving the high asymptotic performance of model-free meta-reinforcement learning.


title: A Worrying Analysis of Probabilistic Time-series Models for Sales Forecasting

abstract: Probabilistic time-series models become popular in the forecasting field as they help to make optimal decisions under uncertainty. Despite the growing interest, a lack of thorough analysis hinders choosing what is worth applying for the desired task. In this paper, we analyze the performance of three prominent probabilistic time-series models for sales forecasting. To remove the role of random chance in architecture's performance, we make two experimental principles; 1) Large-scale dataset with various cross-validation sets. 2) A standardized training and hyperparameter selection. The experimental results show that a simple Multi-layer Perceptron and Linear Regression outperform the probabilistic models on RMSE without any feature engineering. Overall, the probabilistic models fail to achieve better performance on point estimation, such as RMSE and MAPE, than comparably simple baselines. We analyze and discuss the performances of probabilistic time-series models.


title: Euclidean traveling salesman problem with location dependent and power weighted edges

abstract: Consider~\(n\) nodes~\(\{X_i\}_{1 \leq i \leq n}\) independently distributed in the unit square~\(S,\) each according to a distribution~\(f\) and let~\(K_n\) be the complete graph formed by joining each pair of nodes by a straight line segment. For every edge~\(e\) in~\(K_n\) we associate a weight~\(w(e)\) that may depend on the \emph{individual locations} of the endvertices of~\(e\) and is not necessarily a power of the Euclidean length of~\(e.\) Denoting~\(TSP_n\) to be the minimum weight of a spanning cycle of~\(K_n\) corresponding to the travelling salesman problem (TSP) and assuming an equivalence condition on the weight function~\(w(.),\) we prove that~\(TSP_n\) appropriately scaled and centred converges to zero a.s.\ and in mean as~\(n \rightarrow \infty.\) We also obtain upper and lower bound deviation estimates for~\(TSP_n.\)


title: Strain localization regularization and patterns formation in rate-dependent plastic materials with multiphysics coupling

abstract: Strain localization is an instability phenomenon occurring in deformable solid materials which undergo dissipative deformation mechanisms. Such instability is characterized by the localization of the displacement or velocity fields in a zone of finite thickness and is generally associated with the failure of materials. In several fields of material engineering and natural sciences, estimating the thickness of localized deformation is required to make accurate predictions of the evolution of the physical properties within localized strain regions and of the material strength. In this context, scientists and engineers often rely on numerical modeling techniques to study strain localization in solid materials. However, classical continuum theory for elasto-plastic materials fails at estimating strain localization thicknesses due to the lack of an internal length in the model constitutive laws. In this study, we investigate at which conditions multiphysics coupling enables to regularize the problem of strain localization using rate-dependent plasticity. We show that coupling the constitutive laws for deformation to a single generic diffusion-reaction equation representing a dissipative state variable can be sufficient to regularize the ill-posed problem under some conditions on the softening parameters in the plastic potential. We demonstrate in these cases how rate-dependent plasticity and multiphysics coupling can lead to material instabilities depicting one or several internal length scales controlled by the physical parameters resulting in the formation of regular or erratic patterns. As we consider a general form of the equations, the results presented in this study can be applied to a large panel of examples in the material engineering and geosciences communities.


title: Learning-based attacks in Cyber-Physical Systems: Exploration, Detection, and Control Cost trade-offs

abstract: We study the problem of learning-based attacks in linear systems, where the communication channel between the controller and the plant can be hijacked by a malicious attacker. We assume the attacker learns the dynamics of the system from observations, then overrides the controller's actuation signal, while mimicking legitimate operation by providing fictitious sensor readings to the controller. On the other hand, the controller is on a lookout to detect the presence of the attacker and tries to enhance the detection performance by carefully crafting its control signals. We study the trade-offs between the information acquired by the attacker from observations, the detection capabilities of the controller, and the control cost. Specifically, we provide tight upper and lower bounds on the expected $\epsilon$-deception time, namely the time required by the controller to make a decision regarding the presence of an attacker with confidence at least $(1-\epsilon\log(1/\epsilon))$. We then show a probabilistic lower bound on the time that must be spent by the attacker learning the system, in order for the controller to have a given expected $\epsilon$-deception time. We show that this bound is also order optimal, in the sense that if the attacker satisfies it, then there exists a learning algorithm with the given order expected deception time. Finally, we show a lower bound on the expected energy expenditure required to guarantee detection with confidence at least $1-\epsilon \log(1/\epsilon)$.


title: Predicting impurity spectral functions using machine learning

abstract: The Anderson Impurity Model (AIM) is a canonical model of quantum many-body physics. Here we investigate whether machine learning models, both neural networks (NN) and kernel ridge regression (KRR), can accurately predict the AIM spectral function in all of its regimes, from empty orbital, to mixed valence, to Kondo. To tackle this question, we construct two large spectral databases containing approximately 410k and 600k spectral functions of the single-channel impurity problem. We show that the NN models can accurately predict the AIM spectral function in all of its regimes, with point-wise mean absolute errors down to 0.003 in normalized units. We find that the trained NN models outperform models based on KRR and enjoy a speedup on the order of $10^5$ over traditional AIM solvers. The required size of the training set of our model can be significantly reduced using furthest point sampling in the AIM parameter space, which is important for generalizing our method to more complicated multi-channel impurity problems of relevance to predicting the properties of real materials.


title: Robust statistical inference for the matched net benefit and the matched win ratio using prioritized composite endpoints

abstract: As alternatives to the time-to-first-event analysis of composite endpoints, the {\it net benefit} (NB) and the {\it win ratio} (WR) -- which assess treatment effects using prioritized component outcomes based on clinical importance -- have been proposed. However, statistical inference of NB and WR relies on a large-sample assumptions, which can lead to an invalid test statistic and inadequate, unsatisfactory confidence intervals, especially when the sample size is small or the proportion of wins is near 0 or 1. In this paper, we develop a systematic approach to address these limitations in a paired-sample design. We first introduce a new test statistic under the null hypothesis of no treatment difference. Then, we present the formula to calculate the sample size. Finally, we develop the confidence interval estimations of these two estimators. To estimate the confidence intervals, we use the {\it method of variance estimates recovery} (MOVER), that combines two separate individual-proportion confidence intervals into a hybrid interval for the estimand of interest. We assess the performance of the proposed test statistic and MOVER confidence interval estimations through simulation studies. We demonstrate that the MOVER confidence intervals are as good as the large-sample confidence intervals when the sample is large and when the proportions of wins is bounded away from 0 and 1. Moreover, the MOVER intervals outperform their competitors when the sample is small or the proportions are at or near the boundaries 0 and 1. We illustrate the method (and its competitors) using three examples from randomized clinical studies.


title: Learning Control Barrier Functions with High Relative Degree for Safety-Critical Control

abstract: Control barrier functions have shown great success in addressing control problems with safety guarantees. These methods usually find the next safe control input by solving an online quadratic programming problem. However, model uncertainty is a big challenge in synthesizing controllers. This may lead to the generation of unsafe control actions, resulting in severe consequences. In this paper, we develop a learning framework to deal with system uncertainty. Our method mainly focuses on learning the dynamics of the control barrier function, especially for high relative degree with respect to a system. We show that for each order, the time derivative of the control barrier function can be separated into the time derivative of the nominal control barrier function and a remainder. This implies that we can use a neural network to learn the remainder so that we can approximate the dynamics of the real control barrier function. We show by simulation that our method can generate safe trajectories under parametric uncertainty using a differential drive robot model.


title: A sequential view of self--similar measures, or, What the ghosts of Mahler and Cantor can teach us about dimension

abstract: We show that missing $q$-ary digit sets $F\subseteq[0,1]$ have corresponding naturally associated countable binary $q$-automatic sequence $f$. Using this correspondence, we show that the Hausdorff dimension of $F$ is equal to the base-$q$ logarithm of the Mahler eigenvalue of $f$. In addition, we demonstrate that the standard mass distribution $\nu_F$ supported on $F$ is equal to the ghost measure $\mu_f$ of $f$.


title: Non-uniform continuous dependence on initial data for a two_component Novikov system in Besov space

abstract: In this paper, we show that the solution map of the two-component Novikov system is not uniformly continuous on the initial data in Besov spaces $B_{p, r}^{s-1}(\mathbb{R})\times B_{p, r}^s(\mathbb{R})$ with $s>\max\{1+\frac{1}{p}, \frac{3}{2}\}$, $1\leq p< \infty$, $1\leq r<\infty$. Our result covers and extends the previous non-uniform continuity in Sobolev spaces $H^{s-1}(\mathbb{R})\times H^s(\mathbb{R})$ for $s>\frac{5}{2}$ (J. Math. Phys., 2017) to Besov spaces.


title: A Quantized Analogue of the Markov-Krein Correspondence

abstract: We study a family of measures originating from the signatures of the irreducible components of representations of the unitary group, as the size of the group goes to infinity. Given a random signature $\lambda$ of length $N$ with counting measure $\mathbf{m}$, we obtain a random signature $\mu$ of length $N-1$ through projection onto a unitary group of lower dimension. The signature $\mu$ interlaces with the signature $\lambda$, and we record the data of $\mu,\lambda$ in a random rectangular Young diagram $w$. We show that under a certain set of conditions on $\lambda$, both $\mathbf{m}$ and $w$ converge as $N\to\infty$. We provide an explicit moment generating function relationship between the limiting objects. We further show that the moment generating function relationship induces a bijection between bounded measures and certain continual Young diagrams, which can be viewed as a quantized analogue of the Markov-Krein correspondence.

categories: math.PR math-ph math.CO math.MP math.RT math.SP


title: Impact of signal-to-noise ratio and bandwidth on graph Laplacian spectrum from high-dimensional noisy point cloud

abstract: We systematically study the spectrum of kernel-based graph Laplacian (GL) constructed from high-dimensional and noisy random point cloud in the nonnull setup. The problem is motived by studying the model when the clean signal is sampled from a manifold that is embedded in a low-dimensional Euclidean subspace, and corrupted by high-dimensional noise. We quantify how the signal and noise interact over different regions of signal-to-noise ratio (SNR), and report the resulting peculiar spectral behavior of GL. In addition, we explore the impact of chosen kernel bandwidth on the spectrum of GL over different regions of SNR, which lead to an adaptive choice of kernel bandwidth that coincides with the common practice in real data. This result paves the way to a theoretical understanding of how practitioners apply GL when the dataset is noisy.


title: Object Rearrangement Using Learned Implicit Collision Functions

abstract: Robotic object rearrangement combines the skills of picking and placing objects. When object models are unavailable, typical collision-checking models may be unable to predict collisions in partial point clouds with occlusions, making generation of collision-free grasping or placement trajectories challenging. We propose a learned collision model that accepts scene and query object point clouds and predicts collisions for 6DOF object poses within the scene. We train the model on a synthetic set of 1 million scene/object point cloud pairs and 2 billion collision queries. We leverage the learned collision model as part of a model predictive path integral (MPPI) policy in a tabletop rearrangement task and show that the policy can plan collision-free grasps and placements for objects unseen in training in both simulated and physical cluttered scenes with a Franka Panda robot. The learned model outperforms both traditional pipelines and learned ablations by 9.8% in accuracy on a dataset of simulated collision queries and is 75x faster than the best-performing baseline. Videos and supplementary material are available at https://research.nvidia.com/publication/2021-03_Object-Rearrangement-Using.


title: Stochastic Talking Face Generation Using Latent Distribution Matching

abstract: The ability to envisage the visual of a talking face based just on hearing a voice is a unique human capability. There have been a number of works that have solved for this ability recently. We differ from these approaches by enabling a variety of talking face generations based on single audio input. Indeed, just having the ability to generate a single talking face would make a system almost robotic in nature. In contrast, our unsupervised stochastic audio-to-video generation model allows for diverse generations from a single audio input. Particularly, we present an unsupervised stochastic audio-to-video generation model that can capture multiple modes of the video distribution. We ensure that all the diverse generations are plausible. We do so through a principled multi-modal variational autoencoder framework. We demonstrate its efficacy on the challenging LRW and GRID datasets and demonstrate performance better than the baseline, while having the ability to generate multiple diverse lip synchronized videos.


title: A reduction approach to silting objects for derived categories of hereditary categories

abstract: Let $\mathcal{H}$ be a hereditary abelian category over a field $k$ with finite dimensional $\operatorname{Hom}$ and $\operatorname{Ext}$ spaces. It is proved that the bounded derived category $\mathcal{D}^b(\mathcal{H})$ has a silting object iff $\mathcal{H}$ has a tilting object iff $\mathcal{D}^b(\mathcal{H})$ has a simple-minded collection with acyclic $\operatorname{Ext}$-quiver. Along the way, we obtain a new proof for the fact that every presilting object of $\mathcal{D}^b(\mathcal{H})$ is a partial silting object. We also consider the question of complements for pre-simple-minded collections. In contrast to presilting objects, a pre-simple-minded collection $\mathcal{R}$ of $\mathcal{D}^b(\mathcal{H})$ can be completed into a simple-minded collection iff the $\operatorname{Ext}$-quiver of $\mathcal{R}$ is acyclic.


title: High-harmonic generation in metallic titanium nitride

abstract: High-harmonic generation is the cornerstone of nonlinear optics. It has been demonstrated in a wide range of crystalline systems including dielectrics, semiconductors, and semi-metals, as well as in gases, leaving metals out due to their low damage threshold. Here, we report on the high-harmonic generation in metallic titanium nitride (TiN) films. TiN is a refractory plasmonic metal, known for its high melting temperature and laser damage threshold, with optical properties similar to those of gold. We show that TiN can withstand laser pulses with peak intensities as high as 13 TW/cm$^2$, one order of magnitude higher than gold, enabling the emission of intraband harmonics up to photon energies of 11 eV. These harmonics can pave the way for compact and efficient plasmonic devices producing vacuum ultraviolet (VUV) frequency combs. Through numerical calculations and experimental studies, we show that the intensity scaling and angular anisotropy of the emitted VUV radiation stem from the anisotropic conduction band structure of TiN, thus confirming its intraband origin.


title: Towards Robust Data-Driven Control Synthesis for Nonlinear Systems with Actuation Uncertainty

abstract: Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model uncertainty using Control Certificate Functions (CCFs), resulting in a convex optimization based controller for achieving properties like stability and safety. An important benefit of our framework is nuanced data-dependent guarantees, which in principle can yield sample-efficient data collection approaches that need not fully determine the input-to-state relationship. This work serves as a starting point for addressing important questions at the intersection of nonlinear control theory and non-parametric learning, both theoretical and in application. We validate the proposed method in simulation with an inverted pendulum in multiple experimental configurations.


title: LRTA: A Transparent Neural-Symbolic Reasoning Framework with Modular Supervision for Visual Question Answering

abstract: The predominant approach to visual question answering (VQA) relies on encoding the image and question with a "black-box" neural encoder and decoding a single token as the answer like "yes" or "no". Despite this approach's strong quantitative results, it struggles to come up with intuitive, human-readable forms of justification for the prediction process. To address this insufficiency, we reformulate VQA as a full answer generation task, which requires the model to justify its predictions in natural language. We propose LRTA [Look, Read, Think, Answer], a transparent neural-symbolic reasoning framework for visual question answering that solves the problem step-by-step like humans and provides human-readable form of justification at each step. Specifically, LRTA learns to first convert an image into a scene graph and parse a question into multiple reasoning instructions. It then executes the reasoning instructions one at a time by traversing the scene graph using a recurrent neural-symbolic execution module. Finally, it generates a full answer to the given question with natural language justifications. Our experiments on GQA dataset show that LRTA outperforms the state-of-the-art model by a large margin (43.1% v.s. 28.0%) on the full answer generation task. We also create a perturbed GQA test set by removing linguistic cues (attributes and relations) in the questions for analyzing whether a model is having a smart guess with superficial data correlations. We show that LRTA makes a step towards truly understanding the question while the state-of-the-art model tends to learn superficial correlations from the training data.


title: A Bayesian framework for patient-level partitioned survival cost-utility analysis

abstract: Patient-level health economic data collected alongside clinical trials are an important component of the process of technology appraisal, with a view to informing resource allocation decisions. For end of life treatments, such as cancer treatments, modelling of cost-effectiveness/utility data may involve some form of partitioned survival analysis, where measures of health-related quality of life and survival time for both pre- and post-progression periods are combined to generate some aggregate measure of clinical benefits (e.g. quality-adjusted survival). In addition, resource use data are often collected from health records on different services from which different cost components are obtained (e.g. treatment, hospital or adverse events costs). A critical problem in these analyses is that both effectiveness and cost data present some complexities, including non-normality, spikes, and missingness, that should be addressed using appropriate methods. Bayesian modelling provides a powerful tool which has become more and more popular in the recent health economics and statistical literature to jointly handle these issues in a relatively easy way. This paper presents a general Bayesian framework that takes into account the complex relationships of trial-based partitioned survival cost-utility data, potentially providing a more adequate evidence for policymakers to inform the decision-making process. Our approach is motivated by, and applied to, a working example based on data from a trial assessing the cost-effectiveness of a new treatment for patients with advanced non-small-cell lung cancer.


title: Topological spaces induced by homotopic distance

abstract: Homotopic distance $\D$ as introduced in \cite{MVML} can be realized as a pseudometric on $\mathrm{Map}(X,Y)$. In this paper, we study the topology induced by the pseudometric $\D$. In particular, we consider the space $\mathrm{Map}(S^1,S^1)$ and show that homotopic distance between any two maps in this space is 1. Moreover, while a general proof of the non-compactness of the space $\mathrm{Map}(X,Y)$ is still an open problem, it can be shown that $\mathrm{Map}(S^1,S^1)$ is not compact.


title: MultiShifter: software to generate structural models of extended two-dimensional defects in 3D and 2D crystals

abstract: Extended defects in crystals, such as dislocations, stacking faults and grain boundaries, play a crucial role in determining a wide variety of materials properties. Extended defects can also lead to novel electronic properties in two-dimensional materials, as demonstrated by recent discoveries of emergent electronic phenomena in twisted graphene bilayers. This paper describes several approaches to construct crystallographic models of two-dimensional extended defects in crystals for first-principles electronic structure calculations, including (i) crystallographic models to parameterize generalized cohesive zone models for fracture studies and meso-scale models of dislocations and (ii) crystallographic models of twisted bilayers. The approaches are implemented in an open source software package called MultiShifter.


title: Lyapunov Exponents for Hamiltonian Systems under Small L\'evy Perturbations

abstract: This work is to investigate the (top) Lyapunov exponent for a class of Hamiltonian systems under small non-Gaussian L\'evy noise. In a suitable moving frame, the linearisation of such a system can be regarded as a small perturbation of a nilpotent linear system. The Lyapunov exponent is then estimated by taking a Pinsky-Wihstutz transformation and applying the Khas'minskii formula, under appropriate assumptions on smoothness, ergodicity and integrability. Finally, two examples are present to illustrate our results. The results characterize the growth or decay rates of a class of dynamical systems under the interaction between Hamiltonian structures and non-Gaussian uncertainties.


title: Maximum performance of strange-jet tagging at hadron colliders

abstract: The maximum achievable performance of strange-jet tagging at hadron colliders and the loss in performance in different detector designs is estimated based on simulated truth jets from strange-quark and down-quark hadronisation. Both jet types are classified with a recurrent neural network using long short-term memory units, at first using all available truth particles and then applying selections to study the impacts of ideal tracking detectors, Cherenkov detectors, and calorimeters. Additionally, a manual reconstruction of strange hadron decays such as $K_S\rightarrow \pi^+ \pi^-$ from charged tracks is considered.


title: Neural-iLQR: A Learning-Aided Shooting Method for Trajectory Optimization

abstract: Iterative linear quadratic regulator (iLQR) has gained wide popularity in addressing trajectory optimization problems with nonlinear system models. However, as a model-based shooting method, it relies heavily on an accurate system model to update the optimal control actions and the trajectory determined with forward integration, thus becoming vulnerable to inevitable model inaccuracies. Recently, substantial research efforts in learning-based methods for optimal control problems have been progressing significantly in addressing unknown system models, particularly when the system has complex interactions with the environment. Yet a deep neural network is normally required to fit substantial scale of sampling data. In this work, we present Neural-iLQR, a learning-aided shooting method over the unconstrained control space, in which a neural network with a simple structure is used to represent the local system model. In this framework, the trajectory optimization task is achieved with simultaneous refinement of the optimal policy and the neural network iteratively, without relying on the prior knowledge of the system model. Through comprehensive evaluations on two illustrative control tasks, the proposed method is shown to outperform the conventional iLQR significantly in the presence of inaccuracies in system models.


title: Multi Time-scale Imputation aided State Estimation in Distribution System

abstract: With the transition to a smart grid, we are witnessing a significant growth in sensor deployments and smart metering infrastructure in the distribution system. However, information from these sensors and meters are typically unevenly sampled at different time-scales and are incomplete. It is critical to effectively aggregate these information sources for situational awareness. In order to reconcile the heterogeneous multi-scale time-series data, we present a multi-task Gaussian process framework. This framework exploits the spatio-temporal correlation across the time-series data to impute data at any desired time-scale while providing confidence bounds on the imputations. The value of the imputed data for distribution system operation is illustrated via a matrix completion based state estimation strategy. Results on the IEEE 37 bus distribution system reveals the superior performance of the proposed approach relative to linear interpolation approaches.


title: An introduction to hyperholomorphic spectral theories and fractional powers of vector operators

abstract: The aim of this paper is to give an overview of the spectral theories associated with the notions of holomorphicity in dimension greater than one. A first natural extension is the theory of several complex variables whose Cauchy formula is used to define the holomorphic functional calculus for $n$-tuples of operators $(A_1,...,A_n)$. A second way is to consider hyperholomorphic functions of quaternionic or paravector variables. In this case, by the Fueter-Sce-Qian mapping theorem, we have two different notions of hyperholomorphic functions that are called slice hyperholomorphic functions and monogenic functions. Slice hyperholomorphic functions generate the spectral theory based on the $S$-spectrum while monogenic functions induce the spectral theory based on the monogenic spectrum. There is also an interesting relation between the two hyperholomorphic spectral theories via the $F$-functional calculus. The two hyperholomorphic spectral theories have different and complementary applications. Here we also discuss how to define the fractional Fourier's law for nonhomogeneous materials, such definition is based on the spectral theory on the $S$-spectrum.


title: A Blueprint for the Milky Way's Stellar Populations. II. Improved Isochrone Calibration in the SDSS and Pan-STARRS Photometric Systems

abstract: We improve the identification and isolation of individual stellar populations in the Galactic halo based on an updated set of empirically calibrated stellar isochrones in the Sloan Digital Sky Survey (SDSS) and Pan-STARRS 1 (PS1) photometric systems. Along the Galactic prime meridian ($l=0^{\circ}$ and $180^{\circ}$), where proper motions and parallaxes from Gaia DR2 can be used to compute rotational velocities of stars in the rest frame of the Milky Way, we use the observed double color-magnitude sequences of stars having large transverse motions, which are attributed to groups of stars in the metal-poor halo and the thick disk with halo-like kinematics, respectively. The Gaia sequences directly constrain color-magnitude relations of model colors, and help to improve our previous calibration using Galactic star clusters. Based on these updated sets of stellar isochrones, we confirm earlier results on the presence of distinct groups of stars in the metallicity versus rotational-velocity plane, and find that the distribution of the most metal-poor ([Fe/H] $<-2$) stars in our sample can be modeled using two separate groups on prograde and retrograde orbits, respectively. At $4$-$6$ kpc from the Galactic plane, we find approximately equal proportions of the Splashed Disk, and the metal-rich ($\langle {\rm [Fe/H]} \rangle\sim-1.6$) and metal-poor ($\langle {\rm [Fe/H]} \rangle\sim-2.5$) halos on prograde orbits. The Gaia-Sausage-Enceladus, the metal-weak thick disk, and the retrograde halo structure(s) ($\langle {\rm [Fe/H]} \rangle\sim-2.2$) constitute approximately $10\%$ of the rest of the stellar populations at these distances.


title: A Trace-restricted Kronecker-Factored Approximation to Natural Gradient

abstract: Second-order optimization methods have the ability to accelerate convergence by modifying the gradient through the curvature matrix. There have been many attempts to use second-order optimization methods for training deep neural networks. Inspired by diagonal approximations and factored approximations such as Kronecker-Factored Approximate Curvature (KFAC), we propose a new approximation to the Fisher information matrix (FIM) called Trace-restricted Kronecker-factored Approximate Curvature (TKFAC) in this work, which can hold the certain trace relationship between the exact and the approximate FIM. In TKFAC, we decompose each block of the approximate FIM as a Kronecker product of two smaller matrices and scaled by a coefficient related to trace. We theoretically analyze TKFAC's approximation error and give an upper bound of it. We also propose a new damping technique for TKFAC on convolutional neural networks to maintain the superiority of second-order optimization methods during training. Experiments show that our method has better performance compared with several state-of-the-art algorithms on some deep network architectures.


title: Unveiling the detection dynamics of semiconductor nanowire photodetectors by terahertz near-field nanoscopy

abstract: Semiconductor nanowire field-effect transistors represent a promising platform for the development of room-temperature (RT) terahertz (THz) frequency light detectors due to the strong nonlinearity of their transfer characteristics and their remarkable combination of low noise-equivalent powers (< 1 nW/Hz$^{1/2}$) and high responsivities (> 100 V/W). Nano-engineering a NW photodetector combining high sensitivity with high speed (sub-ns) in the THz regime at RT is highly desirable for many frontier applications in quantum optics and nanophotonics, but this requires a clear understanding of the origin of the photo-response. Conventional electrical and optical measurements, however, cannot unambiguously determine the dominant detection mechanism due to inherent device asymmetry that allows different processes to be simultaneously activated. Here, we innovatively capture snapshots of the photo-response of individual InAs nanowires via high spatial resolution (35 nm) THz photocurrent nanoscopy. By coupling a THz quantum cascade laser to scattering-type scanning near-field optical microscopy (s-SNOM) and monitoring both electrical and optical readouts, we simultaneously measure transport and scattering properties. The spatially resolved electric response provides unambiguous signatures of photo-thermoelectric or bolometric currents whose interplay is discussed as a function of photon density and material doping, therefore providing a route to engineer photo-responses by design.


title: Semantic-Based VPS for Smartphone Localization in Challenging Urban Environments

abstract: Accurate smartphone-based outdoor localization system in deep urban canyons are increasingly needed for various IoT applications such as augmented reality, intelligent transportation, etc. The recently developed feature-based visual positioning system (VPS) by Google detects edges from smartphone images to match with pre-surveyed edges in their map database. As smart cities develop, the building information modeling (BIM) becomes widely available, which provides an opportunity for a new semantic-based VPS. This article proposes a novel 3D city model and semantic-based VPS for accurate and robust pose estimation in urban canyons where global navigation satellite system (GNSS) tends to fail. In the offline stage, a material segmented city model is used to generate segmented images. In the online stage, an image is taken with a smartphone camera that provides textual information about the surrounding environment. The approach utilizes computer vision algorithms to rectify and hand segment between the different types of material identified in the smartphone image. A semantic-based VPS method is then proposed to match the segmented generated images with the segmented smartphone image. Each generated image holds a pose that contains the latitude, longitude, altitude, yaw, pitch, and roll. The candidate with the maximum likelihood is regarded as the precise pose of the user. The positioning results achieves 2.0m level accuracy in common high rise along street, 5.5m in foliage dense environment and 15.7m in alleyway. A 45% positioning improvement to current state-of-the-art method. The estimation of yaw achieves 2.3{\deg} level accuracy, 8 times the improvement to smartphone IMU.


title: Computation harvesting in road traffic dynamics

abstract: Owing to recent advances in artificial intelligence and internet of things (IoT) technologies, collected big data facilitates high computational performance, while its computational resources and energy cost are large. Moreover, data are often collected but not used. To solve these problems, we propose a framework for a computational model that follows a natural computational system, such as the human brain, and does not rely heavily on electronic computers. In particular, we propose a methodology based on the concept of `computation harvesting', which uses IoT data collected from rich sensors and leaves most of the computational processes to real-world phenomena as collected data. This aspect assumes that large-scale computations can be fast and resilient. Herein, we perform prediction tasks using real-world road traffic data to show the feasibility of computation harvesting. First, we show that the substantial computation in traffic flow is resilient against sensor failure and real-time traffic changes due to several combinations of harvesting from spatiotemporal dynamics to synthesize specific patterns. Next, we show the practicality of this method as a real-time prediction because of its low computational cost. Finally, we show that, compared to conventional methods, our method requires lower resources while providing a comparable performance.


title: Multiple-point statistical simulation for hydrogeological models: 3-D training image development and conditioning strategies

abstract: Most studies on the application of geostatistical simulations based on multiple-point statistics (MPS) to hydrogeological modelling focus on relatively fine-scale models and on the estimation of facies-level structural uncertainty. Less attention is paid to the input data and the construction of Training Images (TIs). E.g. even though the TI should capture a set of spatial geological characteristics, the majority of the research still relies on 2D or quasi-3D training images. Here, we demonstrate a novel strategy for 3D MPS modelling characterized by (i) realistic 3D TIs and (ii) an effective workflow for incorporating a diverse group of geological and geophysical data sets. The study covers 2810 km^2 in southern Denmark. MPS simulations are performed on a subset of the geological succession (the lower to middle Miocene sediments) which is characterized by relatively uniform structures and dominated by sand and clay. The simulated domain is large and each of the geostatistical realizations contains approximately 45 x 10^6 voxels with size 100 m x 100 m x 5 m. Data used for the modelling include water well logs, seismic data, and a previously published 3D geological model. We apply a series of different strategies for the simulations based on data quality and develop a novel method to effectively create observed spatial trends. The TI is constructed as a relatively small 3D voxel model covering an area of 90 km^2. We use an iterative training image development strategy and find that even slight modifications in the TI create significant changes in simulations. Thus, this study shows how to include both the geological environment and the type and quality of input information in order to achieve optimal results from MPS modelling. We present a practical workflow to build the TI and effectively handle different types of input information to perform large-scale geostatistical modelling


title: Some Generalizations of Jensen's Inequality

abstract: In this article we give some improvements and generalizations of the famous Jensen's and Jensen-Mercer inequalities for twice differentiable functions, where convexity property of the target function is not assumed in advance. They represents a refinement of these inequalities in the case of convex/concave functions with numerous applications in Theory of Means and Probability and Statistics.


title: Continuous-Time Risk Contribution of the Terminal Variance and its Related Risk Budgeting Problem

abstract: To achieve robustness of risk across different assets, risk parity investing rules, a particular state of risk contributions, have grown in popularity over the previous few decades. To generalize the concept of risk contribution from the simple covariance matrix case to the continuous-time case in which the terminal variance of wealth is used as the risk measure, we characterize risk contributions and marginal risk contributions on various assets as predictable processes using the Gateaux differential and Doleans measure. Meanwhile, the risk contributions we extend here have the aggregation property, namely that total risk can be represented as the aggregation of those among different assets and $(t,\omega)$. Subsequently, as an inverse target -- allocating risk, the risk budgeting problem of how to obtain policies whose risk contributions coincide with pre-given risk budgets in the continuous-time case is also explored in this paper. These policies are solutions to stochastic convex optimizations parametrized by the pre-given risk budgets. Moreover, single-period risk budgeting policies are explained as the projection of risk budgeting policies in continuous-time cases. On the application side, volatility-managed portfolios in [Moreira and Muir,2017] can be obtained by risk budgeting optimization; similarly to previous findings, continuous-time mean-variance allocation in [Zhou and Li, 2000] appears to be concentrated in terms of risk contribution.


title: Beyond the adiabatic limit in systems with fast environments: a $\tau$-leaping algorithm

abstract: We propose a $\tau$-leaping simulation algorithm for stochastic systems subject to fast environmental changes. Similar to conventional $\tau$-leaping the algorithm proceeds in discrete time steps, but as a principal addition it captures environmental noise beyond the adiabatic limit. The key idea is to treat the input rates for the $\tau$-leaping as (clipped) Gaussian random variables with first and second moments constructed from the environmental process. In this way, each step of the algorithm retains environmental stochasticity to sub-leading order in the time scale separation between system and environment. We test the algorithm on several toy examples with discrete and continuous environmental states, and find good performance in the regime of fast environmental dynamics. At the same time, the algorithm requires significantly less computing time than full simulations of the combined system and environment. In this context we also discuss several methods for the simulation of stochastic population dynamics in time-varying environments with continuous states.