title: Decision Automation for Electric Power Network Recovery

abstract: Critical infrastructure systems such as electric power networks, water networks, and transportation systems play a major role in the welfare of any community. In the aftermath of disasters, their recovery is of paramount importance; orderly and efficient recovery involves the assignment of limited resources (a combination of human repair workers and machines) to repair damaged infrastructure components. The decision maker must also deal with uncertainty in the outcome of the resource-allocation actions during recovery. The manual assignment of resources seldom is optimal despite the expertise of the decision maker because of the large number of choices and uncertainties in consequences of sequential decisions. This combinatorial assignment problem under uncertainty is known to be \mbox{NP-hard}. We propose a novel decision technique that addresses the massive number of decision choices for large-scale real-world problems; in addition, our method also features an experiential learning component that adaptively determines the utilization of the computational resources based on the performance of a small number of choices. Our framework is closed-loop, and naturally incorporates all the attractive features of such a decision-making system. In contrast to myopic approaches, which do not account for the future effects of the current choices, our methodology has an anticipatory learning component that effectively incorporates \emph{lookahead} into the solutions. To this end, we leverage the theory of regression analysis, Markov decision processes (MDPs), multi-armed bandits, and stochastic models of community damage from natural disasters to develop a method for near-optimal recovery of communities. Our method contributes to the general problem of MDPs with massive action spaces with application to recovery of communities affected by hazards.

categories: cs.AI cs.SY eess.SY math.OC stat.AP stat.CO


title: NESTA: Hamming Weight Compression-Based Neural Proc. Engine

abstract: In this paper, we present NESTA, a specialized Neural engine that significantly accelerates the computation of convolution layers in a deep convolutional neural network, while reducing the computational energy. NESTA reformats Convolutions into $3 \times 3$ batches and uses a hierarchy of Hamming Weight Compressors to process each batch. Besides, when processing the convolution across multiple channels, NESTA, rather than computing the precise result of a convolution per channel, quickly computes an approximation of its partial sum, and a residual value such that if added to the approximate partial sum, generates the accurate output. Then, instead of immediately adding the residual, it uses (consumes) the residual when processing the next batch in the hamming weight compressors with available capacity. This mechanism shortens the critical path by avoiding the need to propagate carry signals during each round of computation and speeds up the convolution of each channel. In the last stage of computation, when the partial sum of the last channel is computed, NESTA terminates by adding the residual bits to the approximate output to generate a correct result.


title: Distilling Effective Supervision from Severe Label Noise

abstract: Collecting large-scale data with clean labels for supervised training of neural networks is practically challenging. Although noisy labels are usually cheap to acquire, existing methods suffer a lot from label noise. This paper targets at the challenge of robust training at high label noise regimes. The key insight to achieve this goal is to wisely leverage a small trusted set to estimate exemplar weights and pseudo labels for noisy data in order to reuse them for supervised training. We present a holistic framework to train deep neural networks in a way that is highly invulnerable to label noise. Our method sets the new state of the art on various types of label noise and achieves excellent performance on large-scale datasets with real-world label noise. For instance, on CIFAR100 with a $40\%$ uniform noise ratio and only 10 trusted labeled data per class, our method achieves $80.2{\pm}0.3\%$ classification accuracy, where the error rate is only $1.4\%$ higher than a neural network trained without label noise. Moreover, increasing the noise ratio to $80\%$, our method still maintains a high accuracy of $75.5{\pm}0.2\%$, compared to the previous best accuracy $48.2\%$. Source code available: https://github.com/google-research/google-research/tree/master/ieg


title: TransGCN:Coupling Transformation Assumptions with Graph Convolutional Networks for Link Prediction

abstract: Link prediction is an important and frequently studied task that contributes to an understanding of the structure of knowledge graphs (KGs) in statistical relational learning. Inspired by the success of graph convolutional networks (GCN) in modeling graph data, we propose a unified GCN framework, named TransGCN, to address this task, in which relation and entity embeddings are learned simultaneously. To handle heterogeneous relations in KGs, we introduce a novel way of representing heterogeneous neighborhood by introducing transformation assumptions on the relationship between the subject, the relation, and the object of a triple. Specifically, a relation is treated as a transformation operator transforming a head entity to a tail entity. Both translation assumption in TransE and rotation assumption in RotatE are explored in our framework. Additionally, instead of only learning entity embeddings in the convolution-based encoder while learning relation embeddings in the decoder as done by the state-of-art models, e.g., R-GCN, the TransGCN framework trains relation embeddings and entity embeddings simultaneously during the graph convolution operation, thus having fewer parameters compared with R-GCN. Experiments show that our models outperform the-state-of-arts methods on both FB15K-237 and WN18RR.


title: Exploring how Component Factors and their Uncertainty Affect Judgements of Risk in Cyber-Security

abstract: Subjective judgements from experts provide essential information when assessing and modelling threats in respect to cyber-physical systems. For example, the vulnerability of individual system components can be described using multiple factors, such as complexity, technological maturity, and the availability of tools to aid an attack. Such information is useful for determining attack risk, but much of it is challenging to acquire automatically and instead must be collected through expert assessments. However, most experts inherently carry some degree of uncertainty in their assessments. For example, it is impossible to be certain precisely how many tools are available to aid an attack. Traditional methods of capturing subjective judgements through choices such as \emph{high}, \emph{medium} or \emph{low} do not enable experts to quantify their uncertainty. However, it is important to measure the range of uncertainty surrounding responses in order to appropriately inform system vulnerability analysis. We use a recently introduced interval-valued response-format to capture uncertainty in experts' judgements and employ inferential statistical approaches to analyse the data. We identify key attributes that contribute to hop vulnerability in cyber-systems and demonstrate the value of capturing the uncertainty around these attributes. We find that this uncertainty is not only predictive of uncertainty in the overall vulnerability of a given system component, but also significantly informs ratings of overall component vulnerability itself. We propose that these methods and associated insights can be employed in real world situations, including vulnerability assessments of cyber-physical systems, which are becoming increasingly complex and integrated into society, making them particularly susceptible to uncertainty in assessment.


title: Spherical k-Nearest Neighbors Interpolation

abstract: Geospatial interpolation is a challenging task due to real world data often being sparse, heterogeneous and inconsistent. For that matter, this work presents SkNNI, a spherical interpolation algorithm capable of working with such challenging geospatial data. This work also presents NDDNISD an accurate and efficient interpolation function for SkNNI which shines due to its spatial awareness in terms of proximity and distribution of observation neighbors. SkNNI's open source implementation is also discussed and illustrated with a simple usage example.


title: Hydrodynamic results on multiplicity fluctuations in heavy-ion collisions

abstract: Multiplicity fluctuations are one of the most crucial observables in the Beam Energy Scan program of the Relativistic Heavy Ion Collider. It is understood that they can be utilized to probe the whereabouts of the critical point on the phase diagram of the QCD matter. However, a significant portion of these fluctuations is, apart from that related to the QCD phase transition, attributed to the other origins, which we refer to as "noncritical" ones. The present study is dedicated to the noncritical aspects of the multiplicity fluctuations in heavy-ion collisions. In particular, we focus on those of dynamical origin, such as the hydrodynamic expansion of the system and the event-by-event initial fluctuations, in addition to the usual thermal fluctuations, finite volume corrections, and resonance decay at the freeze-out surface. The obtained results are compared to those of the hadronic resonance gas model as well as to the experimental data.


title: A weak form of self-testing

abstract: The concept of self-testing (or rigidity) refers to the fact that for certain Bell inequalities the maximal violation can be achieved in an essentially unique manner. In this work we present a family of Bell inequalities which are maximally violated by multiple inequivalent quantum realisations. We completely characterise the quantum realisations achieving the maximal violation and we show that each of them requires a maximally entangled state of two qubits. This implies the existence of a new, weak form of self-testing in which the maximal violation allows us to identify the state, but does not fully determine the measurements. From the geometric point of view the set of probability points that saturate the quantum bound is a line segment. We then focus on a particular member of the family and show that the self-testing statement is robust, i.e. that observing a non-maximal violation allows us to make a quantitative statement about the unknown state. To achieve this we present a new construction of extraction channels and analyse their performance. For completeness we provide two independent approaches: analytical and numerical. The noise robustness, i.e. the amount of white noise at which the bound becomes trivial, of the analytical bound is rather small (~0.06%), but the numerical method takes us into an experimentally-relevant regime (~5%). We conclude by investigating the amount of randomness that can be certified using these Bell violations. Perhaps surprisingly, we find that the qualitative behaviour resembles the behaviour of rigid inequalities like the Clauser-Horne-Shimony-Holt inequality. This shows that at least for some device-independent applications rigidity is not a necessary ingredient.


title: Origin of hydrogen fluoride emission in the Orion Bar: An excellent tracer for CO-dark H2 gas clouds

abstract: The hydrogen fluoride (HF) molecule is seen in absorption in the interstellar medium (ISM) along many lines of sight. Surprisingly, it is observed in emission toward the Orion Bar, which is an interface between the ionized region around the Orion Trapezium stars and the Orion molecular cloud. We aim to understand the origin of HF emission in the Orion Bar by comparing its spatial distribution with other tracers. We examine three mechanisms to explain the HF emission: thermal excitation, radiative dust pumping, and chemical pumping. We used a Herschel/HIFI strip map of the HF J = 1-0 line, covering 0.5' by 1.5' that is oriented perpendicular to the Orion Bar. We used the RADEX non-local thermodynamic equilibrium (non-LTE) code to construct the HF column density map. We use the Meudon PDR code to explain the morphology of HF. The bulk of the HF emission at 10 km s^-1 emerges from the CO-dark molecular gas that separates the ionization front from the molecular gas that is deeper in the Orion Bar. The excitation of HF is caused mainly by collisions with H2 at a density of 10^5 cm^-3 together with a small contribution of electrons in the interclump gas of the Orion Bar. Infrared pumping and chemical pumping are not important. We conclude that the HF J = 1-0 line traces CO-dark molecular gas. Similarly, bright photodissociation regions associated with massive star formation may be responsible for the HF emission observed toward active galactic nuclei.


title: Dynamical Resource Theory of Quantum Coherence

abstract: Decoherence is all around us. Every quantum system that interacts with the environment is doomed to decohere. The preservation of quantum coherence is one of the major challenges faced in quantum technologies, but its use as a resource is very promising and can lead to various operational advantages, for example in quantum algorithms. Hence, much work has been devoted in recent years to quantify the coherence present in a system. In the present paper, we formulate the quantum resource theory of dynamical coherence. The underlying physical principle we follow is that the free dynamical objects are those that cannot preserve or distribute coherence. This leads us to identify classical channels as the free elements in this theory. Consequently, even the quantum identity channel is not free as all physical systems undergo decoherence and hence, the preservation of coherence should be considered a resource. In our work, we introduce four different types of free superchannels (analogous to MIO, DIO, IO, and SIO) and discuss in detail two of them, namely, dephasing-covariant incoherent superchannels (DISC), maximally incoherent superchannels (MISC). The latter consists of all superchannels that do not generate non-classical channels from classical ones. We quantify dynamical coherence using channel-divergence-based monotones for MISC and DISC. We show that some of these monotones have operational interpretations as the exact, the approximate, and the liberal coherence cost of a quantum channel. Moreover, we prove that the liberal asymptotic cost of a channel is equal to a new type of regularized relative entropy. Finally, we show that the conversion distance between two channels under MISC and DISC can be computed using a semi-definite program (SDP).


title: M{\mu}l: The Power of Dynamic Multi-Methods

abstract: Multi-methods are a straightforward extension of traditional (single) dynamic dispatch, which is the core of most object oriented languages. With multi-methods, a method call will select an appropriate implementation based on the values of multiple arguments, and not just the first/receiver. Language support for both single and multiple dispatch is typically designed to be used in conjunction with other object oriented features, in particular classes and inheritance. But are these extra features really necessary? M{\mu}l is a dynamic language designed to be as simple as possible but still supporting flexible abstraction and polymorphism. M{\mu}l provides only two forms of abstraction: (object) identities and (multi) methods. In M{\mu}l method calls are dispatched based on the identity of arguments, as well as what other methods are defined on them. In order to keep M{\mu}ls design simple, when multiple method definitions are applicable, the most recently defined one is chosen, not the most specific (as is conventional with dynamic dispatch). In this paper we show how by defining methods at runtime, we obtain much of the power of classes and meta object protocols, in particular the ability to dynamically modify the state and behaviour of 'classes' of objects.


title: Symbolic expressions for fully differential single top quark production cross section and decay width of polarized top quark in the presence of anomalous Wtb couplings

abstract: Spin correlations in the t-channel single top quark production and its subsequent decay are investigated for the case of contributions involving anomalous Wtb couplings. We obtain analytical expressions for the differential widths for the three-particle decay of a polarized t quark in its rest frame and also expressions for the differential cross sections of the full process of production and decay of the t quark ($2\to 4$) as a function of the energy of a charged lepton and two angles of orientation of the quantization axis of the t-quark spin. The expression is presented in the most general form for the case of real and imaginary vector and tensor anomalous Wtb couplings. We show that shapes of certain multidimensional kinematic distributions of final state particles are significantly different for the contributions proportional to different combinations of the anomalous couplings. The most noticeable differences appear in the shape of the surfaces of two-dimensional distributions, where one of the variables is the energy of a charged lepton and the other is one of the t-quark spin orientation angles. Observed properties are confirmed by two methods of computations either from the obtained symbolic expression for the differential cross sections of the full process of the polarized single top quark production with its subsequent decay or by means of the CompHEP program for the complete process involving the t-channel single top. In addition, using the obtained analytical expressions, we estimate the statistical accuracy of extracting values of the anomalous Wtb couplings for different levels of the expected integral luminosity at the LHC.


title: Magnetic excitation in relativistic heavy ion collisions

abstract: In this note we study the conversion of nucleons into deltas induced by a strong magnetic field in ultraperipheral relativistic heavy ion collisions. The interaction Hamiltonian couples the magnetic field to the spin operator, which, acting on the spin part of the wave function, converts a spin 1/2 into a spin 3/2 state. We estimate this transition probability and calculate the cross section for delta production. This process can in principle be measured, since the delta moves close to the beam and decays almost exclusively into pions. Forward pions may be detected by forward calorimeters.


title: Homomorphisms between braid groups

abstract: We give a complete classification of homomorphisms from the braid group on $n$ strands to the braid group on $2n$ strands when $n$ is at least 5. We also classify endomorphisms of the braid group on 4 strands, as well as homomorphisms from the commutator subgroup of the braid group on $n$ strands to the braid group on $2n-5$ strands. Our classifications suggest a recursive classification of homomorphisms between any braid groups. We also give a simple, geometric proof of a theorem of Lin that highly constrains the holomorphic maps that may exist between spaces of monic, square-free polynomials of two given degrees.


title: Adaptive Continuous Visual Odometry from RGB-D Images

abstract: In this paper, we extend the recently developed continuous visual odometry framework for RGB-D cameras to an adaptive framework via online hyperparameter learning. We focus on the case of isotropic kernels with a scalar as the length-scale. In practice and as expected, the length-scale has remarkable impacts on the performance of the original framework. Previously it was handled using a fixed set of conditions within the solver to reduce the length-scale as the algorithm reaches a local minimum. We automate this process by a greedy gradient descent step at each iteration to find the next-best length-scale. Furthermore, to handle failure cases in the gradient descent step where the gradient is not well-behaved, such as the absence of structure or texture in the scene, we use a search interval for the length-scale and guide it gradually toward the smaller values. This latter strategy reverts the adaptive framework to the original setup. The experimental evaluations using publicly available RGB-D benchmarks show the proposed adaptive continuous visual odometry outperforms the original framework and the current state-of-the-art. We also make the software for the developed algorithm publicly available.


title: Action Anticipation for Collaborative Environments: The Impact of Contextual Information and Uncertainty-Based Prediction

abstract: To interact with humans in collaborative environments, machines need to be able to predict (i.e., anticipate) future events, and execute actions in a timely manner. However, the observation of the human limb movements may not be sufficient to anticipate their actions unambiguously. In this work, we consider two additional sources of information (i.e., context) over time, gaze, movement and object information, and study how these additional contextual cues improve the action anticipation performance. We address action anticipation as a classification task, where the model takes the available information as the input and predicts the most likely action. We propose to use the uncertainty about each prediction as an online decision-making criterion for action anticipation. Uncertainty is modeled as a stochastic process applied to a time-based neural network architecture, which improves the conventional class-likelihood (i.e., deterministic) criterion. The main contributions of this paper are four-fold: (i) We propose a novel and effective decision-making criterion that can be used to anticipate actions even in situations of high ambiguity; (ii) we propose a deep architecture that outperforms previous results in the action anticipation task when using the Acticipate collaborative dataset; (iii) we show that contextual information is important to disambiguate the interpretation of similar actions; and (iv) we also provide a formal description of three existing performance metrics that can be easily used to evaluate action anticipation models.Our results on the Acticipate dataset showed the importance of contextual information and the uncertainty criterion for action anticipation. We achieve an average accuracy of 98.75% in the anticipation task using only an average of 25% of observations.


title: Toward a Secure and Decentralized Blockchain-based Ride-Hailing Platform for Autonomous Vehicles

abstract: Ride-hailing and ride-sharing applications have recently gained in popularity as a convenient alternative to traditional modes of travel. Current research into autonomous vehicles is accelerating rapidly and will soon become a critical component of a ride-hailing platform's architecture. Implementing an autonomous vehicle ride-hailing platform proves a difficult challenge due to the centralized nature of traditional ride-hailing architectures. In a traditional ride-hailing environment the drivers operate their own personal vehicles so it follows that a fleet of autonomous vehicles would be required for a centralized ride-hailing platform to succeed. Decentralization of the ride-hailing platform would remove a road block along the way to an autonomous vehicle ride-hailing platform by allowing owners of autonomous vehicles to add their vehicle to a community driven fleet when not in use. Blockchain technology is an attractive choice for this decentralized architecture due to its immutability and fault tolerance. This paper proposes a framework for developing a decentralized ride-hailing architecture implemented on the Hyperledger Fabric blockchain platform. The implementation is evaluated using a static analysis tool and performing a performance analysis under heavy network load.


title: State-of-the-Art Speech Recognition Using Multi-Stream Self-Attention With Dilated 1D Convolutions

abstract: Self-attention has been a huge success for many downstream tasks in NLP, which led to exploration of applying self-attention to speech problems as well. The efficacy of self-attention in speech applications, however, seems not fully blown yet since it is challenging to handle highly correlated speech frames in the context of self-attention. In this paper we propose a new neural network model architecture, namely multi-stream self-attention, to address the issue thus make the self-attention mechanism more effective for speech recognition. The proposed model architecture consists of parallel streams of self-attention encoders, and each stream has layers of 1D convolutions with dilated kernels whose dilation rates are unique given stream, followed by a self-attention layer. The self-attention mechanism in each stream pays attention to only one resolution of input speech frames and the attentive computation can be more efficient. In a later stage, outputs from all the streams are concatenated then linearly projected to the final embedding. By stacking the proposed multi-stream self-attention encoder blocks and rescoring the resultant lattices with neural network language models, we achieve the word error rate of 2.2% on the test-clean dataset of the LibriSpeech corpus, the best number reported thus far on the dataset.


title: Probing multi-step electroweak phase transition with multi-peaked primordial gravitational waves spectra

abstract: Multi-peaked spectra of the primordial gravitational waves are considered as a phenomenologically relevant source of information about the dynamics of sequential phase transitions in the early Universe. In particular, such signatures trace back to specific patterns of the first-order electroweak phase transition in the early Universe occurring in multiple steps. Such phenomena appear to be rather generic in multi-scalar extensions of the Standard Model. In a particularly simple extension of the Higgs sector, we have identified and studied the emergence of sequential long- and short-lasting transitions as well as their fundamental role in generation of multi-peaked structures in the primordial gravitational-wave spectrum. We discuss the potential detectability of these signatures by the proposed gravitational-wave interferometers.


title: CMOS Platform for Atomic-Scale Device Fabrication

abstract: Controlled atomic scale fabrication of functional devices is one of the holy grails of nanotechnology. The most promising class of techniques that enable deterministic nanodevice fabrication are based on scanning probe patterning or surface assembly. However, this typically involves a complex process flow, stringent requirements for an ultra high vacuum environment, long fabrication times and, consequently, limited throughput and device yield. Here, a device platform is developed that overcomes these limitations by integrating scanning probe based dopant device fabrication with a CMOS-compatible process flow. Silicon on insulator substrates are used featuring a reconstructed Si(001):H surface that is protected by a capping chip and has pre-implanted contacts ready for scanning tunneling microscope (STM) patterning. Processing in ultra-high vacuum is thus reduced to only a few critical steps which minimizes the complexity, time and effort required for fabrication of the nanoscale dopant devices. Subsequent reintegration of the samples into the CMOS process flow not only simplifies the post-processing but also opens the door to successful application of STM based dopant devices as a building block in more complex device architectures. Full functionality of this approach is demonstrated with magnetotransport measurements on degenerately doped STM patterned Si:P nanowires up to room temperature.


title: Testing the radius scaling relation with ${\it Gaia}$ DR2 in the ${\it Kepler}$ field

abstract: We compare radii based on ${\it Gaia}$ parallaxes to asteroseismic scaling relation-based radii of $\sim 300$ dwarfs $\&$ subgiants and $\sim 3600$ first-ascent giants from the ${\it Kepler}$ mission. Systematics due to temperature, bolometric correction, extinction, asteroseismic radius, and the spatially-correlated ${\it Gaia}$ parallax zero-point, contribute to a $2\%$ systematic uncertainty on the ${\it Gaia}$-asteroseismic radius agreement. We find that dwarf and giant scaling radii are on a parallactic scale at the $-2.1 \% \pm 0.5 \% {\rm \ (rand.)} \pm 2.0\% {\rm \ (syst.)}$ level (dwarfs) and $+1.7\% \pm 0.3\% {\rm \ (rand.)} \pm 2.0\% {\rm \ (syst.)}$ level (giants), supporting the accuracy and precision of scaling relations in this domain. In total, the $2\%$ agreement that we find holds for stars spanning radii between $0.8R_{\odot}$ and $30 R_{\odot}$. We do, however, see evidence for $\textit{relative}$ errors in scaling radii between dwarfs and giants at the $4\% \pm 0.6\%$ level, and find evidence of departures from simple scaling relations for radii above $30 R_{\odot}$. Asteroseismic masses for very metal-poor stars are still overestimated relative to astrophysical priors, but at a reduced level. We see no trend with metallicity in radius agreement for stars with $-0.5 <$ [Fe/H] $< +0.5$. We quantify the spatially-correlated parallax errors in the ${\it Kepler}$ field, which globally agree with the ${\it Gaia}$ team's published covariance model. We provide ${\it Gaia}$ radii, corrected for extinction and the ${\it Gaia}$ parallax zero-point for our full sample of $\sim 3900$ stars, including dwarfs, subgiants, and first-ascent giants.


title: The numerical range of a class of periodic tridiagonal operators

abstract: In this paper we compute the closure of the numerical range of certain periodic tridiagonal operators. This is achieved by showing that the closure of the numerical range of such operators can be expressed as the closure of the convex hull of the uncountable union of numerical ranges of certain symbol matrices. For a special case, this result can be improved so that it is the convex hull of the union of the numerical ranges of only two matrices. A conjecture is stated for the general case.


title: LIT: Light-field Inference of Transparency for Refractive Object Localization

abstract: Translucency is prevalent in everyday scenes. As such, perception of transparent objects is essential for robots to perform manipulation. Compared with texture-rich or texture-less Lambertian objects, transparency induces significant uncertainty on object appearances. Ambiguity can be due to changes in lighting, viewpoint, and backgrounds, each of which brings challenges to existing object pose estimation algorithms. In this work, we propose LIT, a two-stage method for transparent object pose estimation using light-field sensing and photorealistic rendering. LIT employs multiple filters specific to light-field imagery in deep networks to capture transparent material properties, with robust depth and pose estimators based on generative sampling. Along with the LIT algorithm, we introduce the light-field transparent object dataset ProLIT for the tasks of recognition, localization and pose estimation. With respect to this ProLIT dataset, we demonstrate that LIT can outperform both state-of-the-art end-to-end pose estimation methods and a generative pose estimator on transparent objects.


title: Comparing Deep Learning Models for Multi-cell Classification in Liquid-based Cervical Cytology Images

abstract: Liquid-based cytology (LBC) is a reliable automated technique for the screening of Papanicolaou (Pap) smear data. It is an effective technique for collecting a majority of the cervical cells and aiding cytopathologists in locating abnormal cells. Most methods published in the research literature rely on accurate cell segmentation as a prior, which remains challenging due to a variety of factors, e.g., stain consistency, presence of clustered cells, etc. We propose a method for automatic classification of cervical slide images through generation of labeled cervical patch data and extracting deep hierarchical features by fine-tuning convolution neural networks, as well as a novel graph-based cell detection approach for cellular level evaluation. The results show that the proposed pipeline can classify images of both single cell and overlapping cells. The VGG-19 model is found to be the best at classifying the cervical cytology patch data with 95 % accuracy under precision-recall curve.


title: Stochastic many-body perturbation theory for Moir\'e states in twisted bilayer phosphorene

abstract: A new implementation of stochastic many-body perturbation theory for periodic 2D systems is presented. The method is used to compute quasiparticle excitations in twisted bilayer phosphorene. Excitation energies are studied using stochastic $G_0W_0$ and partially self-consistent $\bar \Delta GW_0$ approaches. The approach is inexpensive; it is used to study twisted systems with unit cells containing $>2,700$ atoms ($>13,500$ valence electrons), which corresponds to a minimum twisting angle of $\approx 3.1^\circ$. Twisted bilayers exhibit band splitting, increased localization and formation of localized Moir\'e impurity states, as documented by band-structure unfolding. Structural changes in twisted structures lift band degeneracies. Energies of the impurity states vary with the twisting angle due to an interplay between non-local exchange and polarization effects. The mechanisms of quasiparticle energy (de)stabilization due to twisting are likely applicable to a wide range of low-dimensional Moir\'{e} superstructures.


title: A Pre-defined Sparse Kernel Based Convolution for Deep CNNs

abstract: The high demand for computational and storage resources severely impede the deployment of deep convolutional neural networks (CNNs) in limited-resource devices. Recent CNN architectures have proposed reduced complexity versions (e.g. SuffleNet and MobileNet) but at the cost of modest decreases inaccuracy. This paper proposes pSConv, a pre-defined sparse 2D kernel-based convolution, which promises significant improvements in the trade-off between complexity and accuracy for both CNN training and inference. To explore the potential of this approach, we have experimented with two widely accepted datasets, CIFAR-10 and Tiny ImageNet, in sparse variants of both the ResNet18 and VGG16 architectures. Our approach shows a parameter count reduction of up to 4.24x with modest degradation in classification accuracy relative to that of standard CNNs. Our approach outperforms a popular variant of ShuffleNet using a variant of ResNet18 with pSConv having 3x3 kernels with only four of nine elements not fixed at zero. In particular, the parameter count is reduced by 1.7x for CIFAR-10 and 2.29x for Tiny ImageNet with an increased accuracy of ~4%.


title: Cosmic Microwave Background Anisotropy numerical solution (CMBAns) I: An introduction to $C_l$ calculation

abstract: Cosmological Boltzmann codes are often used by researchers for calculating the CMB angular power spectra from different theoretical models, for cosmological parameter estimation, etc. Therefore, the accuracy of a Boltzmann code is of utmost importance. Different Markov Chain Monte Carlo based parameter estimation algorithms typically require 10^3 - 10^4 iterations of Boltzmann code. This makes the time complexity of such codes another critical factor. In the last two decades, several Boltzmann packages, such as CMBFAST, CAMB, CMBEasy, CLASS etc., have been developed. In this paper, we present a new cosmological Boltzmann code, CMBAns, that can be used for accurate calculation of the CMB power spectrum. At present, CMBAns is developed for a flat background matrix. It is mostly written in the C language. However, we borrowed the concept of class from C++. This gives researchers the flexibility to develop their own independent package based on CMBAns, without an in-depth understanding of the source code. We also develop multiple stand-alone facilities which can be directly compiled and run on a given parameter set. In this paper, we discuss all the mathematical formulation, approximation schemes, integration methods etc., that are used in CMBAns. The package will be made available through github for public use in the near future.


title: Animating Face using Disentangled Audio Representations

abstract: All previous methods for audio-driven talking head generation assume the input audio to be clean with a neutral tone. As we show empirically, one can easily break these systems by simply adding certain background noise to the utterance or changing its emotional tone (to such as sad). To make talking head generation robust to such variations, we propose an explicit audio representation learning framework that disentangles audio sequences into various factors such as phonetic content, emotional tone, background noise and others. We conduct experiments to validate that conditioned on disentangled content representation, the generated mouth movement by our model is significantly more accurate than previous approaches (without disentangled learning) in the presence of noise and emotional variations. We further demonstrate that our framework is compatible with current state-of-the-art approaches by replacing their original audio learning component with ours. To our best knowledge, this is the first work which improves the performance of talking head generation from disentangled audio representation perspective, which is important for many real-world applications.


title: Analyzing and Improving Neural Networks by Generating Semantic Counterexamples through Differentiable Rendering

abstract: Even as deep neural networks (DNNs) have achieved remarkable success on vision-related tasks, their performance is brittle to transformations in the input. Of particular interest are semantic transformations that model changes that have a basis in the physical world, such as rotations, translations, changes in lighting or camera pose. In this paper, we show how differentiable rendering can be utilized to generate images that are informative, yet realistic, and which can be used to analyze DNN performance and improve its robustness through data augmentation. Given a differentiable renderer and a DNN, we show how to use off-the-shelf attacks from adversarial machine learning to generate semantic counterexamples -- images where semantic features are changed as to produce misclassifications or misdetections. We validate our approach on DNNs for image classification and object detection. For classification, we show that semantic counterexamples, when used to augment the dataset, (i) improve generalization performance (ii) enhance robustness to semantic transformations, and (iii) transfer between models. Additionally, in comparison to sampling-based semantic augmentation, our technique generates more informative data in a sample efficient manner.


title: Understanding and Benchmarking the Impact of GDPR on Database Systems

abstract: The General Data Protection Regulation (GDPR) provides new rights and protections to European people concerning their personal data. We analyze GDPR from a systems perspective, translating its legal articles into a set of capabilities and characteristics that compliant systems must support. Our analysis reveals the phenomenon of metadata explosion, wherein large quantities of metadata needs to be stored along with the personal data to satisfy the GDPR requirements. Our analysis also helps us identify new workloads that must be supported under GDPR. We design and implement an open-source benchmark called GDPRbench that consists of workloads and metrics needed to understand and assess personal-data processing database systems. To gauge the readiness of modern database systems for GDPR, we follow best practices and developer recommendations to modify Redis, PostgreSQL, and a commercial database system to be GDPR compliant. Our experiments demonstrate that the resulting GDPR compliant systems achieve poor performance on GPDR workloads, and that performance scales poorly as the volume of personal data increases. We discuss the real-world implications of these findings, and identify research challenges towards making GDPR compliance efficient in production environments. We release all of our software artifacts and datasets at http://www.gdprbench.org


title: Mid-Point Technique for Calculating Divergent integrals

abstract: A mid-point technique is suggested to overcome the difficulties in other techniques. The modified effective interaction quark potential which uses to calculate different properties of the NJL model such as the constituent quark mass, the pressure, and the energy density is solved using the present technique. The present method gives good accuracy for the mathematical problem and avoids the physical difficulty in the previous works.


title: Potential Key Technologies for 6G Mobile Communications

abstract: The standard development of 5G wireless communication culminated between 2017 and 2019, followed by the worldwide deployment of 5G networks, which is expected to result in very high data rate for enhanced mobile broadband, support ultra-reliable and low-latency services and accommodate massive number of connections. Research attention is shifting to future generation of wireless communications, for instance, beyond 5G or 6G. Unlike previous papers, which discussed the use cases, deployment scenarios, or new network architectures of 6G in depth, this paper focuses on a few potential technologies for 6G wireless communications, all of which represent certain fundamental breakthrough at the physical layer-technical hardcore of any new generation of wireless communications. Some of them, such as holographic radio, terahertz communication, large intelligent surface, and orbital angular momentum, are of revolutionary nature and many related studies are still at their scientific exploration stage. Several technical areas, such as advanced channel coding and modulation, visible light communication, and advanced duplex, while having been studied, may find more opportunities in 6G.


title: A Survey of Big Data Machine Learning Applications Optimization in Cloud Data Centers and Networks

abstract: This survey article reviews the challenges associated with deploying and optimizing big data applications and machine learning algorithms in cloud data centers and networks. The MapReduce programming model and its widely-used open-source platform; Hadoop, are enabling the development of a large number of cloud-based services and big data applications. MapReduce and Hadoop thus introduce innovative, efficient, and accelerated intensive computations and analytics. These services usually utilize commodity clusters within geographically-distributed data centers and provide cost-effective and elastic solutions. However, the increasing traffic between and within the data centers that migrate, store, and process big data, is becoming a bottleneck that calls for enhanced infrastructures capable of reducing the congestion and power consumption. Moreover, enterprises with multiple tenants requesting various big data services are challenged by the need to optimize leasing their resources at reduced running costs and power consumption while avoiding under or over utilization. In this survey, we present a summary of the characteristics of various big data programming models and applications and provide a review of cloud computing infrastructures, and related technologies such as virtualization, and software-defined networking that increasingly support big data systems. Moreover, we provide a brief review of data centers topologies, routing protocols, and traffic characteristics, and emphasize the implications of big data on such cloud data centers and their supporting networks. Wide ranging efforts were devoted to optimize systems that handle big data in terms of various applications performance metrics and/or infrastructure energy efficiency. Finally, some insights and future research directions are provided.


title: Model reduction for the collective dynamics of globally coupled oscillators: From finite networks to the thermodynamic limit

abstract: Model reduction techniques have been widely used to study the collective behavior of globally coupled oscillators. However, most approaches assume that there are infinitely many oscillators. Here we propose a new ansatz, based on the collective coordinate approach, that reproduces the collective dynamics of the Kuramoto model for finite networks to high accuracy, yields the same bifurcation structure in the thermodynamic limit of infinitely many oscillators as previous approaches, and additionally captures the dynamics of the order parameter in the thermodynamic limit, including critical slowing down that results from a cascade of saddle-node bifurcations.


title: Core-collapse Supernovae as Cosmic Ray Sources

abstract: Core-collapse supernovae produce fast shocks which expand into the dense circumstellar medium (CSM) of the stellar progenitor. Cosmic rays (CRs) accelerated at these shocks can induce the growth of electromagnetic fluctuations in the pre-shock medium. Using a self-similar description for the shock evolution, we calculate the growth time-scales of CR driven instabilities for SNe in general, and SN 1993J in particular. We find that extended SN shocks can trigger fast intra-day instabilities, strong magnetic field amplification, and CR acceleration. In particular, the non-resonant streaming instability can contribute to about 50 per cent of the magnetic field intensity deduced from radio data. This results in the acceleration of CR particles to energies of 1-10 PeV within a few days after the shock breakout.


title: An integrated approach to simulating the vulnerable atherosclerotic plaque

abstract: Analyses of individual atherosclerotic plaques are mostly descriptive, relying -- for example -- on histological classification by spectral analysis of ultrasound waves or staining and observing particular cellular components. Such passive methods have proved useful for characterizing the structure and vulnerability of plaques but have little quantitative predictive power. In this viewpoint article, we propose an integrated quantitative framework to understand the evolution of plaque. The main approach is to use Partial Differential Equations (PDEs) with macrophages, necrotic cells, oxidized lipids, oxygen concentration and PDGF as primary variables coupled to a biomechanical model to describe vessel growth. The model is deterministic, providing mechanical, morphological, and histological characteristics of an atherosclerotic vessel at any desired future time point. We discuss the pros and cons of such a model, how such a model can provide insight to the clinician, and potentially guide therapy. Finally, we use our model to create computer-generated animations of a plaque evolution that are in qualitative agreement with serial ultrasound images published by Kubo et al. (2010) and hypothesize possible atherogenic mechanisms.


title: Temperature-Based Hardware Trojan For Ring-Oscillator-Based TRNGs

abstract: True random number generators (TRNGs) are essential components of cryptographic designs, which are used to generate private keys for encryption and authentication, and are used in masking countermeasures. In this work, we present a mechanism to design a stealthy parametric hardware Trojan for a ring oscillator based TRNG architecture proposed by Yang et al. at ISSCC 2014. Once the Trojan is triggered the malicious TRNG generates predictable non-random outputs. Such a Trojan does not require any additional logic (even a single gate) and is purely based on subtle manipulations on the sub-transistor level. The underlying concept is to disable the entropy source at high temperature to trigger the Trojan, while ensuring that Trojan-infected TRNG works correctly under normal conditions. We show how an attack can be performed with the Trojan-infected TRNG design in which the attacker uses a stochastic Markov Chain model to predict its reduced-entropy outputs.


title: Boosting Image Recognition with Non-differentiable Constraints

abstract: In this paper, we study the problem of image recognition with non-differentiable constraints. A lot of real-life recognition applications require a rich output structure with deterministic constraints that are discrete or modeled by a non-differentiable function. A prime example is recognizing digit sequences, which are restricted by such rules (e.g., \textit{container code detection}, \textit{social insurance number recognition}, etc.). We investigate the usefulness of adding non-differentiable constraints in learning for the task of digit sequence recognition. Toward this goal, we synthesize six different datasets from MNIST and Cropped SVHN, with three discrete rules inspired by real-life protocols. To deal with the non-differentiability of these rules, we propose a reinforcement learning approach based on the policy gradient method. We find that incorporating this rule-based reinforcement can effectively increase the accuracy for all datasets and provide a good inductive bias which improves the model even with limited data. On one of the datasets, MNIST\_Rule2, models trained with rule-based reinforcement increase the accuracy by 4.7\% for 2000 samples and 23.6\% for 500 samples. We further test our model against synthesized adversarial examples, e.g., blocking out digits, and observe that adding our rule-based reinforcement increases the model robustness with a relatively smaller performance drop.


title: Side-Channel Hardware Trojan for Provably-Secure SCA-Protected Implementations

abstract: Hardware Trojans have drawn the attention of academia, industry and government agencies. Effective detection mechanisms and countermeasures against such malicious designs can only be developed when there is a deep understanding of how hardware Trojans can be built in practice, in particular Trojans specifically designed to avoid detection. In this work, we present a mechanism to introduce an extremely stealthy hardware Trojan into cryptographic primitives equipped with provably-secure first-order side-channel countermeasures. Once the Trojan is triggered, the malicious design exhibits exploitable side-channel leakage, leading to successful key recovery attacks. Generally, such a Trojan requires neither addition nor removal of any logic which makes it extremely hard to detect. On ASICs, it can be inserted by subtle manipulations at the sub-transistor level and on FPGAs by changing the routing of particular signals, leading to \textbf{zero} logic overhead. The underlying concept is based on modifying a securely-masked hardware implementation in such a way that running the device at a particular clock frequency violates one of its essential properties, leading to exploitable leakage. We apply our technique to a Threshold Implementation of the PRESENT block cipher realized in two different CMOS technologies, and show that triggering the Trojan makes the ASIC prototypes vulnerable.


title: Scenario Generalization of Data-driven Imitation Models in Crowd Simulation

abstract: Crowd simulation, the study of the movement of multiple agents in complex environments, presents a unique application domain for machine learning. One challenge in crowd simulation is to imitate the movement of expert agents in highly dense crowds. An imitation model could substitute an expert agent if the model behaves as good as the expert. This will bring many exciting applications. However, we believe no prior studies have considered the critical question of how training data and training methods affect imitators when these models are applied to novel scenarios. In this work, a general imitation model is represented by applying either the Behavior Cloning (BC) training method or a more sophisticated Generative Adversarial Imitation Learning (GAIL) method, on three typical types of data domains: standard benchmarks for evaluating crowd models, random sampling of state-action pairs, and egocentric scenarios that capture local interactions. Simulated results suggest that (i) simpler training methods are overall better than more complex training methods, (ii) training samples with diverse agent-agent and agent-obstacle interactions are beneficial for reducing collisions when the trained models are applied to new scenarios. We additionally evaluated our models in their ability to imitate real world crowd trajectories observed from surveillance videos. Our findings indicate that models trained on representative scenarios generalize to new, unseen situations observed in real human crowds.


title: OpenUAV Cloud Testbed: a Collaborative Design Studio for Field Robotics

abstract: Simulations play a crucial role in robotics research and education. This paper presents the OpenUAV testbed, an open-source, easy-to-use, web-based, and reproducible software system that enables students and researchers to run robotic simulations on the cloud. We have built upon our previous work and have addressed some of the educational and research challenges associated with the prior work. The critical contributions of the paper to the robotics and automation community are threefold: First, OpenUAV saves students and researchers from tedious and complicated software setups by providing web-browser-based Linux desktop sessions with standard robotics software like Gazebo, ROS, and flight autonomy stack. Second, a method for saving an individual's research work with its dependencies for the work's future reproducibility. Third, the platform provides a mechanism to support photorealistic robotics simulations by combining Unity game engine-based camera rendering and Gazebo physics. The paper addresses a research need for photorealistic simulations and describes a methodology for creating a photorealistic aquatic simulation. We also present the various academic and research use-cases of this platform to improve robotics education and research, especially during times like the COVID-19 pandemic, when virtual collaboration is necessary.


title: On existence and regularity of a terminal value problem for the time fractional diffusion equation

abstract: In this paper we consider a final value problem for a diffusion equation with time-space fractional differentiation on a bounded domain $D$ of $ \mathbb{R}^{k}$, $k\ge 1$, which includes the fractional power $\mathcal L^\beta$, $0<\beta\le 1$, of a symmetric uniformly elliptic operator $\mathcal L$ defined on $L^2(D)$. A representation of solutions is given by using the Laplace transform and the spectrum of $\mathcal L^\beta$. We establish some existence and regularity results for our problem in both the linear and nonlinear case.


title: Emergence of Writing Systems Through Multi-Agent Cooperation

abstract: Learning to communicate is considered an essential task to develop a general AI. While recent literature in language evolution has studied emergent language through discrete or continuous message symbols, there has been little work in the emergence of writing systems in artificial agents. In this paper, we present a referential game setup with two agents, where the mode of communication is a written language system that emerges during the play. We show that the agents can learn to coordinate successfully using this mode of communication. Further, we study how the game rules affect the writing system taxonomy by proposing a consistency metric.


title: ChainSplitter: Towards Blockchain-based Industrial IoT Architecture for Supporting Hierarchical Storage

abstract: The fast developing Industrial Internet of Things (IIoT) technologies provide a promising opportunity to build large-scale systems to connect numerous heterogeneous devices into the Internet. Most existing IIoT infrastructures are based on a centralized architecture, which is easier for management but cannot effectively support immutable and verifiable services among multiple parties. Blockchain technology provides many desired features for large-scale IIoT infrastructures, such as decentralization, trustworthiness, trackability, and immutability. This paper presents a blockchain-based IIoT architecture to support immutable and verifiable services. However, when applying blockchain technology to the IIoT infrastructure, the required storage space posts a grant challenge to resource-constrained IIoT infrastructures. To address the storage issue, this paper proposes a hierarchical blockchain storage structure, \textit{ChainSplitter}. Specially, the proposed architecture features a hierarchical storage structure where the majority of the blockchain is stored in the clouds, while the most recent blocks are stored in the overlay network of the individual IIoT networks. The proposed architecture seamlessly binds local IIoT networks, the blockchain overlay network, and the cloud infrastructure together through two connectors, the \textit{blockchain connector} and the \textit{cloud connector}, to construct the hierarchical blockchain storage. The blockchain connector in the overlay network builds blocks in blockchain from data generated in IIoT networks, and the cloud connector resolves the blockchain synchronization issues between the overlay network and the clouds. We also provide a case study to show the efficiency of the proposed hierarchical blockchain storage in a practical Industrial IoT case.


title: Fluctuations of $\beta$-Jacobi Product Processes

abstract: We study Markov chains formed by squared singular values of products of truncated orthogonal, unitary, symplectic matrices (corresponding to the Dyson index $\beta = 1,2,4$ respectively) where time corresponds to the number of terms in the product. More generally, we consider the $\beta$-Jacobi product process obtained by extrapolating to arbitrary $\beta > 0$. When the time scaling is preserved, we show that the global fluctuations are jointly Gaussian with explicit covariances. For time growing linearly with matrix size, we show convergence of moments after suitable rescaling. When $\beta = 2$, our results imply that the right edge converges to a process which interpolates between the Airy point process and a deterministic configuration. This process connects a time-parametrized family of point processes appearing in the works of Akemann-Burda-Kieburg and Liu-Wang-Wang across time. In the arbitrary $\beta > 0$ case, our results show tightness of the particles near the right edge. The limiting moment formulas correspond to expressions for the Laplace transform of a conjectural $\beta$-generalization of the interpolating process.


title: Reverse-Engineering Deep ReLU Networks

abstract: It has been widely assumed that a neural network cannot be recovered from its outputs, as the network depends on its parameters in a highly nonlinear way. Here, we prove that in fact it is often possible to identify the architecture, weights, and biases of an unknown deep ReLU network by observing only its output. Every ReLU network defines a piecewise linear function, where the boundaries between linear regions correspond to inputs for which some neuron in the network switches between inactive and active ReLU states. By dissecting the set of region boundaries into components associated with particular neurons, we show both theoretically and empirically that it is possible to recover the weights of neurons and their arrangement within the network, up to isomorphism.


title: Minimax D-optimal designs for multivariate regression models with multi-factors

abstract: In multi-response regression models, the error covariance matrix is never known in practice. Thus, there is a need for optimal designs which are robust against possible misspecification of the error covariance matrix. In this paper, we approximate the error covariance matrix with a neighbourhood of covariance matrices, in order to define minimax D-optimal designs which are robust against small departures from an assumed error covariance matrix. It is well known that the optimization problems associated with robust designs are non-convex, which makes it challenging to construct robust designs analytically or numerically, even for one-response regression models. We show that the objective function for the minimax D-optimal design is a difference of two convex functions. This leads us to develop a flexible algorithm for computing minimax D-optimal designs, which can be applied to any multi-response model with a discrete design space. We also derive several theoretical results for minimax D-optimal designs, including scale invariance and reflection symmetry.


title: Modeling the Dense Spray Regime Using an Euler-Lagrange Approach With Volumetric Displacement Effects

abstract: Modeling of a dense spray regime using an Euler-Lagrange approach is challenging because of local high volume loading. A cluster of droplets, that are assumed subgrid, can lead to locally low void fractions for the fluid phase. Under these conditions, spatio-temporal changes in the fluid volume fractions should be considered in an Euler-Lagrange, two-way coupling model. This leads to zero-Mach number, variable density governing equations. Using pressure-based solvers, this gives rise to a source term in the pressure Poisson equation and a non-divergence free velocity field. To test the validity and predictive capability of such an approach, a round jet laden with particles is investigated using Direct Numerical Simulation coupled with point-Particle based model and compared with available experimental data for a particulate turbulent round jet with $Re_j=5712$. Standard force closures including drag, lift, Magnus effect, pressure, added mass as well as viscous torque acting on each individual particle are employed in the Point-Particle based model. In addition, volume displacement effects due to the presence of solid particles or liquid droplets, which is commonly neglected in the standard two-way coupling, are taken into account in both continuity and inter-phase momentum transfer to accurately capture the underlying structure of particle-turbulence interactions. Prediction results are in well agreement with the corresponding experiment.


title: Interplay of quantum phase transition and flat band in hybrid lattices

abstract: We investigate the interplay of superradiant phase transition (SPT) and energy band physics in an extended Dicke-Hubbard lattice whose unit cell consists of a Dicke model coupled to an atomless cavity. We found in such a periodic lattice the critical point that occurs in a single Dicke model becomes a critical region that is periodically changing with the wavenumber $k$. In the weak-coupling normal phase of the system we observed a flat band and its corresponding localization that can be controlled by the ground-state SPT. Our work builds the connection between flat band physics and SPT, which may fundamentally broaden the regimes of many-body theory and quantum optics.


title: A Deep Factorization of Style and Structure in Fonts

abstract: We propose a deep factorization model for typographic analysis that disentangles content from style. Specifically, a variational inference procedure factors each training glyph into the combination of a character-specific content embedding and a latent font-specific style variable. The underlying generative model combines these factors through an asymmetric transpose convolutional process to generate the image of the glyph itself. When trained on corpora of fonts, our model learns a manifold over font styles that can be used to analyze or reconstruct new, unseen fonts. On the task of reconstructing missing glyphs from an unknown font given only a small number of observations, our model outperforms both a strong nearest neighbors baseline and a state-of-the-art discriminative model from prior work.


title: Top quark as a probe of heavy Majorana neutrino at the LHC and future collider

abstract: Right-handed (RH) Majorana neutrinos play a crucial role in understanding the origin of neutrino mass, the nature of dark matter and the mechanism of matter-antimatter asymmetry. In this work, we investigate the observability of heavy Majorana neutrino through the top quark neutrinoless double beta decay process $t \to b \ell^+ \ell^+ j j$ at hadron colliders. By performing detector level simulation, we demonstrate that our method can give stronger limits on the light-heavy neutrino mixing parameters $|V_{eN, \mu N}|$ in the mass range of 15 GeV $< m_N <$ 80 GeV than other existing collider bounds.


title: Averaging Gaussian functionals

abstract: This paper consists of two parts. In the first part, we focus on the average of a functional over shifted Gaussian homogeneous noise and as the averaging domain covers the whole space, we establish a Breuer-Major type Gaussian fluctuation based on various assumptions on the covariance kernel and/or the spectral measure. Our methodology for the first part begins with the application of Malliavin calculus around Nualart-Peccati's Fourth Moment Theorem, and in addition we apply the Fourier techniques as well as a soft approximation argument based on Bessel functions of first kind. The same methodology leads us to investigate a closely related problem in the second part. We study the spatial average of a linear stochastic heat equation driven by space-time Gaussian colored noise. The temporal covariance kernel $\gamma_0$ is assumed to be locally integrable in this paper. If the spatial covariance kernel is nonnegative and integrable on the whole space, then the spatial average admits Gaussian fluctuation; with some extra mild integrability condition on $\gamma_0$, we are able to provide a functional central limit theorem. These results complement recent studies on the spatial average for SPDEs. Our analysis also allows us to consider the case where the spatial covariance kernel is not integrable: For example, in the case of the Riesz kernel, the first chaotic component of the spatial average is dominant so that the Gaussian fluctuation also holds true.


title: Functional limit theorems for the Euler characteristic process in the critical regime

abstract: This study presents functional limit theorems for the Euler characteristic of Vietoris-Rips complexes. The points are drawn from a non-homogeneous Poisson process on $\mathbb{R}^d$, and the connectivity radius governing the formation of simplices is taken as a function of time parameter $t$, which allows us to treat the Euler characteristic as a stochastic process. The setting in which this takes place is that of the critical regime, in which the simplicial complexes are highly connected and have non-trivial topology. We establish two "functional-level" limit theorems, a strong law of large numbers and a central limit theorem for the appropriately normalized Euler characteristic process.


title: Ward2ICU: A Vital Signs Dataset of Inpatients from the General Ward

abstract: We present a proxy dataset of vital signs with class labels indicating patient transitions from the ward to intensive care units called Ward2ICU. Patient privacy is protected using a Wasserstein Generative Adversarial Network to implicitly learn an approximation of the data distribution, allowing us to sample synthetic data. The quality of data generation is assessed directly on the binary classification task by comparing specificity and sensitivity of an LSTM classifier on proxy and original datasets. We initialize a discussion of unintentionally disclosing commercial sensitive information and propose a solution for a special case through class label balancing


title: Equivariant Flows: sampling configurations for multi-body systems with symmetric energies

abstract: Flows are exact-likelihood generative neural networks that transform samples from a simple prior distribution to the samples of the probability distribution of interest. Boltzmann Generators (BG) combine flows and statistical mechanics to sample equilibrium states of strongly interacting many-body systems such as proteins with 1000 atoms. In order to scale and generalize these results, it is essential that the natural symmetries of the probability density - in physics defined by the invariances of the energy function - are built into the flow. Here we develop theoretical tools for constructing such equivariant flows and demonstrate that a BG that is equivariant with respect to rotations and particle permutations can generalize to sampling nontrivially new configurations where a nonequivariant BG cannot.

categories: stat.ML cs.LG physics.chem-ph physics.comp-ph


title: Joint Learning of Semantic Alignment and Object Landmark Detection

abstract: Convolutional neural networks (CNNs) based approaches for semantic alignment and object landmark detection have improved their performance significantly. Current efforts for the two tasks focus on addressing the lack of massive training data through weakly- or unsupervised learning frameworks. In this paper, we present a joint learning approach for obtaining dense correspondences and discovering object landmarks from semantically similar images. Based on the key insight that the two tasks can mutually provide supervisions to each other, our networks accomplish this through a joint loss function that alternatively imposes a consistency constraint between the two tasks, thereby boosting the performance and addressing the lack of training data in a principled manner. To the best of our knowledge, this is the first attempt to address the lack of training data for the two tasks through the joint learning. To further improve the robustness of our framework, we introduce a probabilistic learning formulation that allows only reliable matches to be used in the joint learning process. With the proposed method, state-of-the-art performance is attained on several standard benchmarks for semantic matching and landmark detection, including a newly introduced dataset, JLAD, which contains larger number of challenging image pairs than existing datasets.


title: Fast integral equation methods for linear and semilinear heat equations in moving domains

abstract: We present a family of integral equation-based solvers for the linear or semilinear heat equation in complicated moving (or stationary) geometries. This approach has significant advantages over more standard finite element or finite difference methods in terms of accuracy, stability and space-time adaptivity. In order to be practical, however, a number of technical capabilites are required: fast algorithms for the evaluation of heat potentials, high-order accurate quadratures for singular and weakly integrals over space-time domains, and robust automatic mesh refinement and coarsening capabilities. We describe all of these components and illustrate the performance of the approach with numerical examples in two space dimensions.


title: Beamspace Channel Estimation for Massive MIMO mmWave Systems: Algorithm and VLSI Design

abstract: Millimeter-wave (mmWave) communication in combination with massive multiuser multiple-input multiple-output (MU-MIMO) enables high-bandwidth data transmission to multiple users in the same time-frequency resource. The strong path loss of wave propagation at such high frequencies necessitates accurate channel state information to ensure reliable data transmission. We propose a novel channel estimation algorithm called BEAmspace CHannel EStimation (BEACHES), which leverages the fact that wave propagation at mmWave frequencies is predominantly directional. BEACHES adaptively denoises the channel vectors in the beamspace domain using an adaptive shrinkage procedure that relies on Stein's unbiased risk estimator (SURE). Simulation results for line-of-sight (LoS) and non-LoS mmWave channels reveal that BEACHES performs on par with state-of-the-art channel estimation methods while requiring orders-of-magnitude lower complexity. To demonstrate the effectiveness of BEACHES in practice, we develop a very large-scale integration (VLSI) architecture and provide field-programmable gate array (FPGA) implementation results. Our results show that adaptive channel denoising can be performed at high throughput and in a hardware-friendly manner for massive MU-MIMO mmWave systems with hundreds of antennas.


title: Quantifying Voter Biases in Online Platforms: An Instrumental Variable Approach

abstract: In content-based online platforms, use of aggregate user feedback (say, the sum of votes) is commonplace as the "gold standard" for measuring content quality. Use of vote aggregates, however, is at odds with the existing empirical literature, which suggests that voters are susceptible to different biases -- reputation (e.g., of the poster), social influence (e.g., votes thus far), and position (e.g., answer position). Our goal is to quantify, in an observational setting, the degree of these biases in online platforms. Specifically, what are the causal effects of different impression signals -- such as the reputation of the contributing user, aggregate vote thus far, and position of content -- on a participant's vote on content? We adopt an instrumental variable (IV) framework to answer this question. We identify a set of candidate instruments, carefully analyze their validity, and then use the valid instruments to reveal the effects of the impression signals on votes. Our empirical study using log data from Stack Exchange websites shows that the bias estimates from our IV approach differ from the bias estimates from the ordinary least squares (OLS) method. In particular, OLS underestimates reputation bias (1.6--2.2x for gold badges) and position bias (up to 1.9x for the initial position) and overestimates social influence bias (1.8--2.3x for initial votes). The implications of our work include: redesigning user interface to avoid voter biases; making changes to platforms' policy to mitigate voter biases; detecting other forms of biases in online platforms.


title: Local invariants of non-commutative tori

abstract: We consider a generic curved non-commutative torus extending the notion of conformally deformed non-commutative torus from \cite{Connes-Tretkoff}. In general, a curved non-commutative torus is no longer represented by a spectral triple, not even by a twisted spectral triple. Therefore, the geometry of this manifold is governed by a positive second order differential operator (Laplace-Betrami operator) rather than a first order differential operator (Dirac operator). For this manifold, we prove an asymptotic expansion of the heat semi-group generated by Laplace-Beltrami operator and provide an algorithm to compute the local invariants which appear as coefficients in the expansion. This allows to extend the results of \cite{Connes-Tretkoff}, \cite{Connes-Moscovici}, \cite{FaKh} (beyond conformal case and/or for multi-dimensional tori).


title: A new formulation for the numerical proof of the existence of solutions to elliptic problems

abstract: Infinite-dimensional Newton methods can be effectively used to derive numerical proofs of the existence of solutions to partial differential equations (PDEs). In computer-assisted proofs of PDEs, the original problem is transformed into the infinite Newton-type fixed point equation $w = - {\mathcal L}^{-1} {\mathcal F}(\hat{u}) + {\mathcal L}^{-1} {\mathcal G}(w)$, where ${\mathcal L}$ is a linearized operator, ${\mathcal F}(\hat{u})$ is a residual, and ${\mathcal G}(w)$ is a local Lipschitz term. Therefore, the estimations of $\| {\mathcal L}^{-1} {\mathcal F}(\hat{u}) \|$ and $\| {\mathcal L}^{-1}{\mathcal G}(w) \|$ play major roles in the verification procedures. In this paper, using a similar concept as the `Schur complement' for matrix problems, we represent the inverse operator ${\mathcal L}^{-1}$ as an infinite-dimensional operator matrix that can be decomposed into two parts, one finite dimensional and one infinite dimensional. This operator matrix yields a new effective realization of the infinite-dimensional Newton method, enabling a more efficient verification procedure compared with existing methods for the solution of elliptic PDEs. We present some numerical examples that confirm the usefulness of the proposed method. Related results obtained from the representation of the operator matrix as ${\mathcal L}^{-1}$ are presented in the appendix.


title: Efficient Graph Generation with Graph Recurrent Attention Networks

abstract: We propose a new family of efficient and expressive deep generative models of graphs, called Graph Recurrent Attention Networks (GRANs). Our model generates graphs one block of nodes and associated edges at a time. The block size and sampling stride allow us to trade off sample quality for efficiency. Compared to previous RNN-based graph generative models, our framework better captures the auto-regressive conditioning between the already-generated and to-be-generated parts of the graph using Graph Neural Networks (GNNs) with attention. This not only reduces the dependency on node ordering but also bypasses the long-term bottleneck caused by the sequential nature of RNNs. Moreover, we parameterize the output distribution per block using a mixture of Bernoulli, which captures the correlations among generated edges within the block. Finally, we propose to handle node orderings in generation by marginalizing over a family of canonical orderings. On standard benchmarks, we achieve state-of-the-art time efficiency and sample quality compared to previous models. Additionally, we show our model is capable of generating large graphs of up to 5K nodes with good quality. To the best of our knowledge, GRAN is the first deep graph generative model that can scale to this size. Our code is released at: https://github.com/lrjconan/GRAN.


title: Deploying the NASA Valkyrie Humanoid for IED Response: An Initial Approach and Evaluation Summary

abstract: As part of a feasibility study, this paper shows the NASA Valkyrie humanoid robot performing an end-to-end improvised explosive device (IED) response task. To demonstrate and evaluate robot capabilities, sub-tasks highlight different locomotion, manipulation, and perception requirements: traversing uneven terrain, passing through a narrow passageway, opening a car door, retrieving a suspected IED, and securing the IED in a total containment vessel (TCV). For each sub-task, a description of the technical approach and the hidden challenges that were overcome during development are presented. The discussion of results, which explicitly includes existing limitations, is aimed at motivating continued research and development to enable practical deployment of humanoid robots for IED response. For instance, the data shows that operator pauses contribute to 50\% of the total completion time, which implies that further work is needed on user interfaces for increasing task completion efficiency.


title: Accelerating Deep Learning by Focusing on the Biggest Losers

abstract: This paper introduces Selective-Backprop, a technique that accelerates the training of deep neural networks (DNNs) by prioritizing examples with high loss at each iteration. Selective-Backprop uses the output of a training example's forward pass to decide whether to use that example to compute gradients and update parameters, or to skip immediately to the next example. By reducing the number of computationally-expensive backpropagation steps performed, Selective-Backprop accelerates training. Evaluation on CIFAR10, CIFAR100, and SVHN, across a variety of modern image models, shows that Selective-Backprop converges to target error rates up to 3.5x faster than with standard SGD and between 1.02--1.8x faster than a state-of-the-art importance sampling approach. Further acceleration of 26% can be achieved by using stale forward pass results for selection, thus also skipping forward passes of low priority examples.


title: Robust and highly-efficient discrimination of chiral molecules through three-mode parallel paths

abstract: We propose to discriminate chiral molecules by combining one- and two-photon processes in a closed-loop configuration. The one-photon-coupling intrinsic {\pi}-phase difference between two enantiomers leads to their different superposition states, which is then followed by a two-photon process through three-mode parallel paths (3MPPs), enabling the discrimination of enantiomers by inducing their entirely-different population distributions. The 3MPPs are constructed by "chosen paths", a method of shortcuts to adiabaticity (STA), exhibiting a fast two-photon process. As an example, we propose to perform the scheme in 1, 2-propanediol molecules, which shows relatively robust and highly-efficient results under considering the experimental issues concerning unwanted transitions, imperfect initial state, pulse shaping, control errors and the effect of energy relaxations. The present work may provide help for laboratory researchers in a robust separation of chiral molecules.


title: Searching for Dark Photons with PADME

abstract: PADME is a fixed-target, missing-mass experiment at the Laboratori Nazionali di Frascati (LNF) to search for evidence of dark photons. It has collected a first set of commissioning data in 2018/2019 which will also be used for preliminary data analysis. PADME is expected to reach a sensitivity of up to $10^{-8}$ in $\epsilon^2$ (kinetic mixing coefficient) for low-mass dark photons ($\sim$ few MeV). Here we describe PADME's design, status of the experiment, and future plans.


title: SharPer: Sharding Permissioned Blockchains Over Network Clusters

abstract: Scalability is one of the main roadblocks to business adoption of blockchain systems. Despite recent intensive research on using sharding techniques to enhance the scalability of blockchain systems, existing solutions do not efficiently address cross-shard transactions. In this paper, we introduce SharPer, a permissioned blockchain system that improves scalability by clustering (partitioning) the nodes and assigning different data shards to different clusters where each data shard is replicated on the nodes of a cluster. SharPer supports both intra-shard and cross-shard transactions and processes intra-shard transactions of different clusters as well as cross-shard transactions with non-overlapping clusters simultaneously. In SharPer, the blockchain ledger is formed as a directed acyclic graph where each cluster maintains only a view of the ledger. SharPer also incorporates a flattened protocol to establish consensus among clusters on the order of cross-shard transactions. The experimental results reveal the efficiency of SharPer in terms of performance and scalability especially in workloads with a low percentage of cross-shard transactions.


title: Poisson statistics for beta ensembles on the real line at high temperature

abstract: This paper studies beta ensembles on the real line in a high temperature regime, that is, the regime where $\beta N \to const \in (0, \infty)$, with $N$ the system size and $\beta$ the inverse temperature. In this regime, the convergence to the equilibrium measure is a consequence of a recent result on large deviation principle by Liu and Wu (Stochastic Processes and their Applications (2019)). This paper focuses on the local behavior and shows that the local statistics around any fixed reference energy converges weakly to a homogeneous Poisson point process.


title: Cognitive Agent Based Simulation Model For Improving Disaster Response Procedures

abstract: In the event of a disaster, saving human lives is of utmost importance. For developing proper evacuation procedures and guidance systems, behavioural data on how people respond during panic and stress is crucial. In the absence of real human data on building evacuation, there is a need for a crowd simulator to model egress and decision-making under uncertainty. In this paper, we propose an agent-based simulation tool, which is grounded in human cognition and decision-making, for evaluating and improving the effectiveness of building evacuation procedures and guidance systems during a disaster. Specifically, we propose a predictive agent-wayfinding framework based on information theory that is applied at intersections with variable route choices where it fuses N dynamic information sources. The proposed framework can be used to visualize trajectories and prediction results (i.e., total evacuation time, number of people evacuated) for different combinations of reinforcing or contradicting information sources (i.e., signage, crowd flow, familiarity, and spatial layout). This tool can enable designers to recreate various disaster scenarios and generate simulation data for improving the evacuation procedures and existing guidance systems.


title: Contextual Local Explanation for Black Box Classifiers

abstract: We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an interpretable model. We demonstrate the flexibility of CLE by explaining different models for text, tabular and image classification, and the fidelity of it by doing simulated user experiments.


title: $FI$-modules over preadditive categories and torsion theories

abstract: We work with $FI$-modules over a small preadditive category $\mathcal R$, viewed as a ring with several objects. Our aim is to study torsion theories for $FI$-modules. We are especially interested in torsion theories on finitely generated $FI$-modules and the category of what we call "shift finitely generated" $FI$-modules. We also apply these methods to study inductive descriptions of $FI$-modules over $\mathcal R$.


title: A strong stationary time for random transpositions

abstract: We show that the random transposition walk on the symmetric group $S_n$ has cutoff in separation distance at $\frac{1}{2}n \log n$, by constructing a strong stationary time. The construction involves working with cycle types of permutations and some partition combinatorics.


title: Resonantly driven singlet-triplet spin qubit in silicon

abstract: We report implementation of a resonantly driven singlet-triplet spin qubit in silicon. The qubit is defined by the two-electron anti-parallel spin states and universal quantum control is provided through a resonant drive of the exchange interaction at the qubit frequency. The qubit exhibits long $T_2^*$ exceeding 1 $\mu$s that is limited by dephasing due to the $^{29}$Si nuclei rather than charge noise thanks to the symmetric operation and a large micro-magnet Zeeman field gradient. The randomized benchmarking shows 99.6 % single gate fidelity which is the highest reported for singlet-triplet qubits.


title: MAC Protocols for Wireless Mesh Networks with Multi-beam Antennas: A Survey

abstract: Multi-beam antenna technologies have provided lots of promising solutions to many current challenges faced in wireless mesh networks. The antenna can establish several beamformings simultaneously and initiate concurrent transmissions or receptions using multiple beams, thereby increasing the overall throughput of the network transmission. Multi-beam antenna has the ability to increase the spatial reuse, extend the transmission range, improve the transmission reliability, as well as save the power consumption. Traditional Medium Access Control (MAC) protocols for wireless network largely relied on the IEEE 802.11 Distributed Coordination Function(DCF) mechanism, however, IEEE 802.11 DCF cannot take the advantages of these unique capabilities provided by multi-beam antennas. This paper surveys the MAC protocols for wireless mesh networks with multi-beam antennas. The paper first discusses some basic information in designing multi-beam antenna system and MAC protocols, and then presents the main challenges for the MAC protocols in wireless mesh networks compared with the traditional MAC protocols. A qualitative comparison of the existing MAC protocols is provided to highlight their novel features, which provides a reference for designing the new MAC protocols. To provide some insights on future research, several open issues of MAC protocols are discussed for wireless mesh networks using multi-beam antennas.


title: Approximating the Geometric Edit Distance

abstract: Edit distance is a measurement of similarity between two sequences such as strings, point sequences, or polygonal curves. Many matching problems from a variety of areas, such as signal analysis, bioinformatics, etc., need to be solved in a geometric space. Therefore, the geometric edit distance (GED) has been studied. In this paper, we describe the first strictly sublinear approximate near-linear time algorithm for computing the GED of two point sequences in constant dimensional Euclidean space. Specifically, we present a randomized (O(n\log^2n)) time (O(\sqrt n))-approximation algorithm. Then, we generalize our result to give a randomized $\alpha$-approximation algorithm for any $\alpha\in [\sqrt{\log n}, \sqrt{n / \log n}]$, running in time $O(n^2/\alpha^2 \log n)$. Both algorithms are Monte Carlo and return approximately optimal solutions with high probability.


title: LRP2020: Machine Learning Advantages in Canadian Astrophysics

abstract: The application of machine learning (ML) methods to the analysis of astrophysical datasets is on the rise, particularly as the computing power and complex algorithms become more powerful and accessible. As the field of ML enjoys a continuous stream of breakthroughs, its applications demonstrate the great potential of ML, ranging from achieving tens of millions of times increase in analysis speed (e.g., modeling of gravitational lenses or analysing spectroscopic surveys) to solutions of previously unsolved problems (e.g., foreground subtraction or efficient telescope operations). The number of astronomical publications that include ML has been steadily increasing since 2010. With the advent of extremely large datasets from a new generation of surveys in the 2020s, ML methods will become an indispensable tool in astrophysics. Canada is an unambiguous world leader in the development of the field of machine learning, attracting large investments and skilled researchers to its prestigious AI Research Institutions. This provides a unique opportunity for Canada to also be a world leader in the application of machine learning in the field of astrophysics, and foster the training of a new generation of highly skilled researchers.


title: Variational Temporal Abstraction

abstract: We introduce a variational approach to learning and inference of temporally hierarchical structure and representation for sequential data. We propose the Variational Temporal Abstraction (VTA), a hierarchical recurrent state space model that can infer the latent temporal structure and thus perform the stochastic state transition hierarchically. We also propose to apply this model to implement the jumpy-imagination ability in imagination-augmented agent-learning in order to improve the efficiency of the imagination. In experiments, we demonstrate that our proposed method can model 2D and 3D visual sequence datasets with interpretable temporal structure discovery and that its application to jumpy imagination enables more efficient agent-learning in a 3D navigation task.


title: The isomorphism theorem for linear fragments of continuous logic

abstract: The ultraproduct construction is generalized to $p$-ultramean constructions ($1\leqslant p<\infty$) by replacing ultrafilters with finitely additive measures. These constructions correspond to the linear fragments $\mathscr L^p$ of continuous logic. A powermean variant of Keisler-Shelah isomorphism theorem is proved for $\mathscr L^p$. It is then proved that $\mathscr L^p$-sentences (and their approximations) are exactly those sentences of continuous logic which are preserved by such constructions. Some other applications are also given.


title: Prime Clocks

abstract: Physical implementations of digital computers began in the latter half of the 1930's and were first constructed from various forms of logic gates. Based on the prime numbers, we introduce prime clocks and prime clock sums, where the clocks utilize time and act as computational primitives instead of gates. The prime clocks generate an infinite abelian group, where for each n, there is a finite subgroup S such that for each Boolean function f : {0, 1}^n --> {0, 1}, there exists a finite prime clock sum in S that can represent and compute f. A parallelizable algorithm, implemented with a finite prime clock sum, is provided that computes f. In contrast, the negation, conjunction, and disjunction operations generate a Boolean algebra. In terms of computation, Boolean circuits computed with logic gates NOT, AND, OR have a depth. This means that a completely parallel computation of Boolean functions is not possible with these gates. Overall, some new connections between number theory, Boolean functions and computation are established.


title: Stability of Equilibrium Asset Pricing Models: A Necessary and Sufficient Condition

abstract: We obtain an exact necessary and sufficient condition for the existence and uniqueness of equilibrium asset prices in infinite horizon, discrete-time, arbitrage free environments. Through several applications we show how the condition sharpens and improves on previous results. We connect the condition, and hence the problem of existence and uniqueness of asset prices, with the recent literature on stochastic discount factor decompositions. Finally, we discuss computation of the test value associated with our condition, providing a Monte Carlo method that is naturally parallelizable.


title: Proof of two supercongruences conjectured by Z.-W. Sun

abstract: In this paper, we prove two supercongruences conjectured by Z.-W. Sun via the Wilf-Zeilberger method. One of them is, for any prime $p>3$, \begin{align*} \sum_{n=0}^{p-1}\frac{6n+1}{256^n}\binom{2n}n^3&\equiv p(-1)^{(p-1)/2}-p^3E_{p-3}\pmod{p^4}. \end{align*} In fact, this supercongruence is a generalization of a supercongruence of van Hamme.


title: How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections?

abstract: DenseNets introduce concatenation-type skip connections that achieve state-of-the-art accuracy in several computer vision tasks. In this paper, we reveal that the topology of the concatenation-type skip connections is closely related to the gradient propagation which, in turn, enables a predictable behavior of DNNs' test performance. To this end, we introduce a new metric called NN-Mass to quantify how effectively information flows through DNNs. Moreover, we empirically show that NN-Mass also works for other types of skip connections, e.g., for ResNets, Wide-ResNets (WRNs), and MobileNets, which contain addition-type skip connections (i.e., residuals or inverted residuals). As such, for both DenseNet-like CNNs and ResNets/WRNs/MobileNets, our theoretically grounded NN-Mass can identify models with similar accuracy, despite having significantly different size/compute requirements. Detailed experiments on both synthetic and real datasets (e.g., MNIST, CIFAR-10, CIFAR-100, ImageNet) provide extensive evidence for our insights. Finally, the closed-form equation of our NN-Mass enables us to design significantly compressed DenseNets (for CIFAR-10) and MobileNets (for ImageNet) directly at initialization without time-consuming training and/or searching.


title: Quantum-classical reinforcement learning for decoding noisy classical parity information

abstract: Learning a hidden parity function from noisy data, known as learning parity with noise (LPN), is an example of intelligent behavior that aims to generalize a concept based on noisy examples. The solution to LPN immediately leads to decoding a random binary linear code in the presence of classification noise. This problem is thought to be intractable classically, but can be solved efficiently if a quantum oracle can be queried. However, in practice, a learner is more likely to receive data from classical oracles. In this work, we show that a naive application of the quantum LPN algorithm to classical data encoded in an equal superposition state requires an exponential sample complexity. We then propose a quantum-classical reinforcement learning algorithm to solve the LPN problem for data generated by a classical oracle and demonstrate a significant reduction in the sample complexity. Simulations with a hidden bit string of length up to 12 show that the quantum-classical reinforcement learning performs better than known classical algorithms when the sample complexity, run time, and robustness to classical noise are collectively considered. Our algorithm is robust to any noise in the quantum circuit that effectively appears as Pauli errors on the final state.


title: Optimization Based Planner Tracker Design for Safety Guarantees

abstract: We present a safe-by-design approach to path planning and control for nonlinear systems. The planner uses a low fidelity model of the plant to compute reference trajectories by solving an MPC problem, while the plant being controlled utilizes a feedback control law that tracks those trajectories with an upper-bound on the tracking error. Our main goal is to allow for maximum permissiveness (that is, room for constraint feasibility) of the planner, while maintaining safety after accounting for the tracking error bound. We achieve this by parametrizing the state and input constraints imposed on the planner and deriving corresponding parametrized tracking control laws and tracking error bounds, which are computed offline through Sum-of-Squares programming. The parameters are then optimally chosen to maximize planner permissiveness, while guaranteeing safety.


title: Global exponential stability of primal-dual gradient flow dynamics based on the proximal augmented Lagrangian: A Lyapunov-based approach

abstract: For a class of nonsmooth composite optimization problems with linear equality constraints, we utilize a Lyapunov-based approach to establish the global exponential stability of the primal-dual gradient flow dynamics based on the proximal augmented Lagrangian. The result holds when the differentiable part of the objective function is strongly convex with a Lipschitz continuous gradient; the non-differentiable part is proper, lower semi-continuous, and convex; and the matrix in the linear constraint is full row rank. Our quadratic Lyapunov function generalizes recent result from strongly convex problems with either affine equality or inequality constraints to a broader class of composite optimization problems with nonsmooth regularizers and it provides a worst-case lower bound of the exponential decay rate. Finally, we use computational experiments to demonstrate that our convergence rate estimate is less conservative than the existing alternatives.