title: Simulation Of Reaction Systems By The Strictly Minimal Ones

abstract: Reaction systems, introduced by Ehrenfeucht and Rozenberg, are elementary computational models based on biochemical reactions transpiring within the living cells. Numerous studies focus on mathematical aspects of minimal reaction systems due to their simplicity and rich generative power. In 2014 Manzoni, Pocas, and Porreca showed that every reaction system can be simulated by some minimal reaction system over an extended background set. Motivated by their work, we introduce the concepts of strictly minimal and hybrid reaction systems. Using our new concepts, the result of Manzoni et al. is revisited and strengthened. We also show that extension of the background set by polynomially bounded many elements is not sufficient to guarantee the aforementioned simulation. Finally, an analogous result for strong simulation is obtained.


title: Cortical surface parcellation based on intra-subject white matter fiber clustering

abstract: We present a hybrid method that performs the complete parcellation of the cerebral cortex of an individual, based on the connectivity information of the white matter fibers from a whole-brain tractography dataset. The method consists of five steps, first intra-subject clustering is performed on the brain tractography. The fibers that make up each cluster are then intersected with the cortical mesh and then filtered to discard outliers. In addition, the method resolves the overlapping between the different intersection regions (sub-parcels) throughout the cortex efficiently. Finally, a post-processing is done to achieve more uniform sub-parcels. The output is the complete labeling of cortical mesh vertices, representing the different cortex sub-parcels, with strong connections to other sub-parcels. We evaluated our method with measures of brain connectivity such as functional segregation (clustering coefficient), functional integration (characteristic path length) and small-world. Results in five subjects from ARCHI database show a good individual cortical parcellation for each one, composed of about 200 subparcels per hemisphere and complying with these connectivity measures.


title: Rapid Quantification of White Matter Disconnection in the Human Brain

abstract: With an estimated five million new stroke survivors every year and a rapidly aging population suffering from hyperintensities and diseases of presumed vascular origin that affect white matter and contribute to cognitive decline, it is critical that we understand the impact of white matter damage on brain structure and behavior. Current techniques for assessing the impact of lesions consider only location, type, and extent, while ignoring how the affected region was connected to the rest of the brain. Regional brain function is a product of both local structure and its connectivity. Therefore, obtaining a map of white matter disconnection is a crucial step that could help us predict the behavioral deficits that patients exhibit. In the present work, we introduce a new practical method for computing lesion-based white matter disconnection maps that require only moderate computational resources. We achieve this by creating diffusion tractography models of the brains of healthy adults and assessing the connectivity between small regions. We then interrupt these connectivity models by projecting patients' lesions into them to compute predicted white matter disconnection. A quantified disconnection map can be computed for an individual patient in approximately 35 seconds using a single core CPU-based computation. In comparison, a similar quantification performed with other tools provided by MRtrix3 takes 5.47 minutes.


title: Rational Choice Hypothesis as X-point of Utility Function and Norm Function

abstract: Towards the realization of a sustainable, fair and inclusive society, we proposed a novel decision-making model that incorporates social norms in a rational choice model from the standpoints of deontology and utilitarianism. We proposed a hypothesis that interprets choice of action as the X-point for individual utility function that increases with actions and social norm function that decreases with actions. This hypothesis is based on humans psychologically balancing the value of utility and norms in selecting actions. Using the hypothesis and approximation, we were able to isolate and infer utility function and norm function from real-world measurement data of actions on environmental conditions and elucidate the interaction between the both functions that led from current status to target actions. As examples of collective data that aggregate decision-making of individuals, we looked at the changes in power usage before and after the Great East Japan Earthquake and the correlation between national GDP and CO2 emission in different countries. The first example showed that the perceived benefits of power (i.e., utility of power usage) was stronger than the power usage restrictions imposed by norms after the earthquake, contrary to our expectation. The second example showed that a reduction of CO2 emission in each country was not related to utility derived from GDP but to norms related to CO2 emission. Going forward, we will apply this new X-point model to actual social practices involving normative problems, and design the approaches for the diagnosis, prognosis and intervention of social systems by IT systems.


title: Sustainability and Fairness Simulations Based on Decision-Making Model of Utility Function and Norm Function

abstract: We introduced a decision-making model based on value functions that included individualistic utility function and socio-constructivistic norm function and proposed a norm-fostering process that recursively updates norm function through mutual recognition between the self and others. As an example, we looked at the resource-sharing problem typical of economic activities and assumed the distribution of individual actions to define the (1) norm function fostered through mutual comparison of value/action ratio based on the equity theory (progressive tax-like), (2) norm function proportional to resource utilization (proportional tax-like) and (3) fixed norm function independent of resource utilization (fixed tax-like). By carrying out numerical simulation, we showed that the progressive tax-like norm function (i) does not increase disparity for the distribution of the actions, unlike the other norm functions, and (ii) has high resource productivity and low Gini coefficient. Therefore the progressive tax-like norm function has the highest sustainability and fairness.


title: Distributionally Robust Bayesian Optimization

abstract: Robustness to distributional shift is one of the key challenges of contemporary machine learning. Attaining such robustness is the goal of distributionally robust optimization, which seeks a solution to an optimization problem that is worst-case robust under a specified distributional shift of an uncontrolled covariate. In this paper, we study such a problem when the distributional shift is measured via the maximum mean discrepancy (MMD). For the setting of zeroth-order, noisy optimization, we present a novel distributionally robust Bayesian optimization algorithm (DRBO). Our algorithm provably obtains sub-linear robust regret in various settings that differ in how the uncertain covariate is observed. We demonstrate the robust performance of our method on both synthetic and real-world benchmarks.


title: Deep learning of interface structures from the 4D STEM data: cation intermixing vs. roughening

abstract: Interface structures in complex oxides remain one of the active areas of condensed matter physics research, largely enabled by recent advances in scanning transmission electron microscopy (STEM). Yet the nature of the STEM contrast in which the structure is projected along the given direction precludes separation of possible structural models. Here, we utilize deep convolutional neural networks (DCNN) trained on simulated 4D scanning transmission electron microscopy (STEM) datasets to predict structural descriptors of interfaces. We focus on the widely studied interface between LaAlO3 and SrTiO3, using dynamical diffraction theory and leveraging high performance computing to simulate thousands of possible 4D STEM datasets to train the DCNN to learn properties of the underlying structures on which the simulations are based. We validate the DCNN on simulated data and show that it is possible (with >95% accuracy) to identify a physically rough from a chemically diffuse interface and achieve 85% accuracy in determination of buried step positions within the interface. The method shown here is general and can be applied for any inverse imaging problem where forward models are present.


title: How to Evaluate Solutions in Pareto-based Search-Based Software Engineering? A Critical Review and Methodological Guidance

abstract: With modern requirements, there is an increasing tendency of considering multiple objectives/criteria simultaneously in many Software Engineering (SE) scenarios. Such a multi-objective optimization scenario comes with an important issue -- how to evaluate the outcome of optimization algorithms, which typically is a set of incomparable solutions (i.e., being Pareto non-dominated to each other). This issue can be challenging for the SE community, particularly for practitioners of Search-Based SE (SBSE). On one hand, multi-objective optimization could still be relatively new to SE/SBSE researchers, who may not be able to identify the right evaluation methods for their problems. On the other hand, simply following the evaluation methods for general multi-objective optimization problems may not be appropriate for specific SE problems, especially when the problem nature or decision maker's preferences are explicitly/implicitly available. This has been well echoed in the literature by various inappropriate/inadequate selection and inaccurate/misleading use of evaluation methods. In this paper, we first carry out a systematic and critical review of quality evaluation for multi-objective optimization in SBSE. We survey 717 papers published between 2009 and 2019 from 36 venues in seven repositories, and select 95 prominent studies, through which we identify five important but overlooked issues in the area. We then conduct an in-depth analysis of quality evaluation indicators/methods and general situations in SBSE, which, together with the identified issues, enables us to codify a methodological guidance for selecting and using evaluation methods in different SBSE scenarios.


title: Compressed Data Structures for Binary Relations in Practice

abstract: Binary relations are commonly used in Computer Science for modeling data. In addition to classical representations using matrices or lists, some compressed data structures have recently been proposed to represent binary relations in compact space, such as the $k^2$-tree and the Binary Relation Wavelet Tree (BRWT). Knowing their storage needs, supported operations and time performance is key for enabling an appropriate choice of data representation given a domain or application, its data distribution and typical operations that are computed over the data. In this work, we present an empirical comparison among several compressed representations for binary relations. We analyze their space usage and the speed of their operations using different (synthetic and real) data distributions. We include both neighborhood and set operations, also proposing algorithms for set operations for the BRWT, which were not presented before in the literature. We conclude that there is not a clear choice that outperforms the rest, but we give some recommendations of usage of each compact representation depending on the data distribution and types of operations performed over the data. We also include a scalability study of the data representations.


title: Chemical Diversity of Super-Earths As a Consequence of Formation

abstract: Recent observations of rocky super-Earths have revealed an apparent wider distribution of Fe/Mg ratios, or core to mantle ratios, than the planets in our Solar System. This study aims to understand how much of the chemical diversity in the super-Earth population can arise from giant impacts during planetary formation. Planet formation simulations have only recently begun to treat collisions more realistically in an attempt to replicate the planets in our Solar System. We investigate planet formation more generally by simulating the formation of rocky super-Earths with varying initial conditions using a version of SyMBA, a gravitational N-body code, that incorporates realistic collisions. We track the maximum plausible change in composition after each impact. The final planets span a range of Fe/Mg ratios similar to the Solar System planets, but do not completely match the distribution in super-Earth data. We only form a few planets with minor iron-depletion, suggesting other mechanisms are at work. The most iron-rich planets have a lower Fe/Mg ratio than Mercury, and are less enriched than planets such as Kepler-100b. This indicates that further work on our understanding of planet formation and further improvement of precision of mass and radius measurements are required to explain planets at the extremes of this Fe/Mg distribution.


title: oIRL: Robust Adversarial Inverse Reinforcement Learning with Temporally Extended Actions

abstract: Explicit engineering of reward functions for given environments has been a major hindrance to reinforcement learning methods. While Inverse Reinforcement Learning (IRL) is a solution to recover reward functions from demonstrations only, these learned rewards are generally heavily \textit{entangled} with the dynamics of the environment and therefore not portable or \emph{robust} to changing environments. Modern adversarial methods have yielded some success in reducing reward entanglement in the IRL setting. In this work, we leverage one such method, Adversarial Inverse Reinforcement Learning (AIRL), to propose an algorithm that learns hierarchical disentangled rewards with a policy over options. We show that this method has the ability to learn \emph{generalizable} policies and reward functions in complex transfer learning tasks, while yielding results in continuous control benchmarks that are comparable to those of the state-of-the-art methods.


title: A Road Map to Strong Intelligence

abstract: I wrote this paper because technology can really improve people's lives. With it, we can live longer in a healthy body, save time through increased efficiency and automation, and make better decisions. To get to the next level, we need to start looking at intelligence from a much broader perspective, and promote international interdisciplinary collaborations. Section 1 of this paper delves into sociology and social psychology to explain that the mechanisms underlying intelligence are inherently social. Section 2 proposes a method to classify intelligence, and describes the differences between weak and strong intelligence. Section 3 examines the Chinese Room argument from a different perspective. It demonstrates that a Turing-complete machine cannot have strong intelligence, and considers the modifications necessary for a computer to be intelligent and have understanding. Section 4 argues that the existential risk caused by the technological explosion of a single agent should not be of serious concern. Section 5 looks at the AI control problem and argues that it is impossible to build a super-intelligent machine that will do what it creators want. By using insights from biology, it also proposes a solution to the control problem. Section 6 discusses some of the implications of strong intelligence. Section 7 lists the main challenges with deep learning, and asserts that radical changes will be required to reach strong intelligence. Section 8 examines a neuroscience framework that could help explain how a cortical column works. Section 9 lays out the broad strokes of a road map towards strong intelligence. Finally, section 10 analyzes the impacts and the challenges of greater intelligence.


title: Brain Age Estimation Using LSTM on Children's Brain MRI

abstract: Brain age prediction based on children's brain MRI is an important biomarker for brain health and brain development analysis. In this paper, we consider the 3D brain MRI volume as a sequence of 2D images and propose a new framework using the recurrent neural network for brain age estimation. The proposed method is named as 2D-ResNet18+Long short-term memory (LSTM), which consists of four parts: 2D ResNet18 for feature extraction on 2D images, a pooling layer for feature reduction over the sequences, an LSTM layer, and a final regression layer. We apply the proposed method on a public multisite NIH-PD dataset and evaluate generalization on a second multisite dataset, which shows that the proposed 2D-ResNet18+LSTM method provides better results than traditional 3D based neural network for brain age estimation.


title: Neural Bayes: A Generic Parameterization Method for Unsupervised Representation Learning

abstract: We introduce a parameterization method called Neural Bayes which allows computing statistical quantities that are in general difficult to compute and opens avenues for formulating new objectives for unsupervised representation learning. Specifically, given an observed random variable $\mathbf{x}$ and a latent discrete variable $z$, we can express $p(\mathbf{x}|z)$, $p(z|\mathbf{x})$ and $p(z)$ in closed form in terms of a sufficiently expressive function (Eg. neural network) using our parameterization without restricting the class of these distributions. To demonstrate its usefulness, we develop two independent use cases for this parameterization: 1. Mutual Information Maximization (MIM): MIM has become a popular means for self-supervised representation learning. Neural Bayes allows us to compute mutual information between observed random variables $\mathbf{x}$ and latent discrete random variables $z$ in closed form. We use this for learning image representations and show its usefulness on downstream classification tasks. 2. Disjoint Manifold Labeling: Neural Bayes allows us to formulate an objective which can optimally label samples from disjoint manifolds present in the support of a continuous distribution. This can be seen as a specific form of clustering where each disjoint manifold in the support is a separate cluster. We design clustering tasks that obey this formulation and empirically show that the model optimally labels the disjoint manifolds. Our code is available at \url{https://github.com/salesforce/NeuralBayes}


title: Distributed No-Regret Learning in Multi-Agent Systems

abstract: In this tutorial article, we give an overview of new challenges and representative results on distributed no-regret learning in multi-agent systems modeled as repeated unknown games. Four emerging game characteristics---dynamicity, incomplete and imperfect feedback, bounded rationality, and heterogeneity---that challenge canonical game models are explored. For each of the four characteristics, we illuminate its implications and ramifications in game modeling, notions of regret, feasible game outcomes, and the design and analysis of distributed learning algorithms.


title: Unsupervised Pre-trained, Texture Aware And Lightweight Model for Deep Learning-Based Iris Recognition Under Limited Annotated Data

abstract: In this paper, we present a texture aware lightweight deep learning framework for iris recognition. Our contributions are primarily three fold. Firstly, to address the dearth of labelled iris data, we propose a reconstruction loss guided unsupervised pre-training stage followed by supervised refinement. This drives the network weights to focus on discriminative iris texture patterns. Next, we propose several texture aware improvisations inside a Convolution Neural Net to better leverage iris textures. Finally, we show that our systematic training and architectural choices enable us to design an efficient framework with upto 100X fewer parameters than contemporary deep learning baselines yet achieve better recognition performance for within and cross dataset evaluations.


title: Post-training Quantization with Multiple Points: Mixed Precision without Mixed Precision

abstract: We consider the post-training quantization problem, which discretizes the weights of pre-trained deep neural networks without re-training the model. We propose multipoint quantization, a quantization method that approximates a full-precision weight vector using a linear combination of multiple vectors of low-bit numbers; this is in contrast to typical quantization methods that approximate each weight using a single low precision number. Computationally, we construct the multipoint quantization with an efficient greedy selection procedure, and adaptively decides the number of low precision points on each quantized weight vector based on the error of its output. This allows us to achieve higher precision levels for important weights that greatly influence the outputs, yielding an 'effect of mixed precision' but without physical mixed precision implementations (which requires specialized hardware accelerators). Empirically, our method can be implemented by common operands, bringing almost no memory and computation overhead. We show that our method outperforms a range of state-of-the-art methods on ImageNet classification and it can be generalized to more challenging tasks like PASCAL VOC object detection.


title: Near-Optimal Hyperfast Second-Order Method for convex optimization and its Sliding

abstract: In this paper, we present a new Hyperfast Second-Order Method with convergence rate $O(N^{-5})$ up to a logarithmic factor for the convex function with Lipshitz the third derivative. This method based on two ideas. The first comes from the superfast second-order scheme of Yu. Nesterov (CORE Discussion Paper 2020/07, 2020). It allows implementing the third-order scheme by solving subproblem using only the second-order oracle. This method converges with rate $O(N^{-4})$. The second idea comes from the work of Kamzolov et al. (arXiv:2002.01004). It is the inexact near-optimal third-order method. In this work, we improve its convergence and merge it with the scheme of solving subproblem using only the second-order oracle. As a result, we get convergence rate $O(N^{-5})$ up to a logarithmic factor. This convergence rate is near-optimal and the best known up to this moment. Further, we investigate the situation when there is a sum of two functions and improve the sliding framework from Kamzolov et al. (arXiv:2002.01004) for the second-order methods.


title: An Elementary Approach to Convergence Guarantees of Optimization Algorithms for Deep Networks

abstract: We present an approach to obtain convergence guarantees of optimization algorithms for deep networks based on elementary arguments and computations. The convergence analysis revolves around the analytical and computational structures of optimization oracles central to the implementation of deep networks in machine learning software. We provide a systematic way to compute estimates of the smoothness constants that govern the convergence behavior of first-order optimization algorithms used to train deep networks. A diverse set of example components and architectures arising in modern deep networks intersperse the exposition to illustrate the approach.


title: Risk-Based Optimization of Virtual Reality over Terahertz Reconfigurable Intelligent Surfaces

abstract: In this paper, the problem of associating reconfigurable intelligent surfaces (RISs) to virtual reality (VR) users is studied for a wireless VR network. In particular, this problem is considered within a cellular network that employs terahertz (THz) operated RISs acting as base stations. To provide a seamless VR experience, high data rates and reliable low latency need to be continuously guaranteed. To address these challenges, a novel risk-based framework based on the entropic value-at-risk is proposed for rate optimization and reliability performance. Furthermore, a Lyapunov optimization technique is used to reformulate the problem as a linear weighted function, while ensuring that higher order statistics of the queue length are maintained under a threshold. To address this problem, given the stochastic nature of the channel, a policy-based reinforcement learning (RL) algorithm is proposed. Since the state space is extremely large, the policy is learned through a deep-RL algorithm. In particular, a recurrent neural network (RNN) RL framework is proposed to capture the dynamic channel behavior and improve the speed of conventional RL policy-search algorithms. Simulation results demonstrate that the maximal queue length resulting from the proposed approach is only within 1% of the optimal solution. The results show a high accuracy and fast convergence for the RNN with a validation accuracy of 91.92%.


title: Adapted Center and Scale Prediction: More Stable and More Accurate

abstract: Pedestrian detection benefits from deep learning technology and gains rapid development in recent years. Most of detectors follow general object detection frame, i.e. default boxes and two-stage process. Recently, anchor-free and one-stage detectors have been introduced into this area. However, their accuracies are unsatisfactory. Therefore, in order to enjoy the simplicity of anchor-free detectors and the accuracy of two-stage ones simultaneously, we propose some adaptations based on a detector, Center and Scale Prediction(CSP). The main contributions of our paper are: (1) We improve the robustness of CSP and make it easier to train. (2) We propose a novel method to predict width, namely compressing width. (3) We achieve the second best performance on CityPersons benchmark, i.e. 9.3% log-average miss rate(MR) on reasonable set, 8.7% MR on partial set and 5.6% MR on bare set, which shows an anchor-free and one-stage detector can still have high accuracy. (4) We explore some capabilities of Switchable Normalization which are not mentioned in its original paper.


title: Designing Fair AI for Managing Employees in Organizations: A Review, Critique, and Design Agenda

abstract: Organizations are rapidly deploying artificial intelligence (AI) systems to manage their workers. However, AI has been found at times to be unfair to workers. Unfairness toward workers has been associated with decreased worker effort and increased worker turnover. To avoid such problems, AI systems must be designed to support fairness and redress instances of unfairness. Despite the attention related to AI unfairness, there has not been a theoretical and systematic approach to developing a design agenda. This paper addresses the issue in three ways. First, we introduce the organizational justice theory, three different fairness types (distributive, procedural, interactional), and the frameworks for redressing instances of unfairness (retributive justice, restorative justice). Second, we review the design literature that specifically focuses on issues of AI fairness in organizations. Third, we propose a design agenda for AI fairness in organizations that applies each of the fairness types to organizational scenarios. Then, the paper concludes with implications for future research.


title: Encryption without Centralization: Distributing DNS Queries Across Recursive Resolvers

abstract: Emerging protocols such as DNS-over-HTTPS (DoH) and DNS-over-TLS (DoT) improve the privacy of DNS queries and responses. While this trend towards encryption is positive, deployment of these protocols has in some cases resulted in further centralization of the DNS, which introduces new challenges. In particular, centralization has consequences for performance, privacy, and availability; a potentially greater concern is that it has become more difficult to control the choice of DNS recursive resolver, particularly for IoT devices. Ultimately, the best strategy for selecting among one or more recursive resolvers may ultimately depend on circumstance, user, and even device. Accordingly, the DNS architecture must permit flexibility in allowing users, devices, and applications to specify these strategies. Towards this goal of increased de-centralization and improved flexibility, this paper presents the design and implementation of a refactored DNS resolver architecture that allows for de-centralized name resolution, preserving the benefits of encrypted DNS while satisfying other desirable properties, including performance and privacy.


title: Contact-less manipulation of millimeter-scale objects via ultrasonic levitation

abstract: Although general purpose robotic manipulators are becoming more capable at manipulating various objects, their ability to manipulate millimeter-scale objects are usually very limited. On the other hand, ultrasonic levitation devices have been shown to levitate a large range of small objects, from polystyrene balls to living organisms. By controlling the acoustic force fields, ultrasonic levitation devices can compensate for robot manipulator positioning uncertainty and control the grasping force exerted on the target object. The material agnostic nature of acoustic levitation devices and their ability to dexterously manipulate millimeter-scale objects make them appealing as a grasping mode for general purpose robots. In this work, we present an ultrasonic, contact-less manipulation device that can be attached to or picked up by any general purpose robotic arm, enabling millimeter-scale manipulation with little to no modification to the robot itself. This device is capable of performing the very first phase-controlled picking action on acoustically reflective surfaces. With the manipulator placed around the target object, the manipulator can grasp objects smaller in size than the robot's positioning uncertainty, trap the object to resist air currents during robot movement, and dexterously hold a small and fragile object, like a flower bud. Due to the contact-less nature of the ultrasound-based gripper, a camera positioned to look into the cylinder can inspect the object without occlusion, facilitating accurate visual feature extraction.


title: Nuclear modification factors, directed and elliptic flow of electrons from open heavy flavor decays in Au+Au collisions from STAR

abstract: We present the analyses of single electrons from semileptonic bottom and charm hadron decays at mid-rapidity in $\sqrt{s_{NN}}$ = 200 and 54.4 GeV Au+Au collisions (talk in Heavy-Flavor session III). The data at $\sqrt{s_{NN}}$ = 200 GeV incorporate information from the Heavy Flavor Tracker which enables the topological separation of electrons originating from bottom and charm hadron decays. We report the first STAR measurements at $\sqrt{s_{NN}}$ = 200 GeV of $v_{2}$ for bottom decay electrons as a function of $p_{T}$ and $v_{1}$ for charm decay electrons as a function of electron rapidity. Additionally, we present the improved measurements of heavy-flavor decay electron $R_{AA}$ and a new measurement of the ratio of $R_{CP}$ between bottom and charm decay electrons. Finally, we also report the measurement of non-photonic electron $v_{2}$ in $\sqrt{s_{NN}}$ = 54.4 GeV data collected during the 2017 RHIC run.


title: Probing UV-Sensitive Pathways for CN and HCN Formation in Protoplanetary Disks with the Hubble Space Telescope

abstract: The UV radiation field is a critical regulator of gas-phase chemistry in surface layers of disks around young stars. In an effort to understand the relationship between photocatalyzing UV radiation fields and gas emission observed at infrared and sub-mm wavelengths, we present an analysis of new and archival HST, Spitzer, ALMA, IRAM, and SMA data for five targets in the Lupus cloud complex and 14 systems in Taurus-Auriga. The HST spectra were used to measure LyA and FUV continuum fluxes reaching the disk surface, which are responsible for dissociating relevant molecular species (e.g. HCN, N2). Semi-forbidden C II] 2325 and UV-fluorescent H2 emission were also measured to constrain inner disk populations of C+ and vibrationally excited H2. We find a significant positive correlation between 14 micron HCN emission and fluxes from the FUV continuum and C II] 2325, consistent with model predictions requiring N2 photodissociation and carbon ionization to trigger the main CN/HCN formation pathways. We also report significant negative correlations between sub-mm CN emission and both C II] and FUV continuum fluxes, implying that CN is also more readily dissociated in disks with stronger FUV irradiation. No clear relationships are detected between either CN or HCN and LyA or UV-H2 emission. This is attributed to the spatial stratification of the various molecular species, which span several vertical layers and radii across the inner and outer disk. We expect that future observations with JWST will build on this work by enabling more sensitive IR surveys than were possible with Spitzer.


title: Three steps mixing for general random walks on the hypercube at criticality

abstract: We introduce a general class of random walks on the $N$-hypercube, study cut-off for the mixing time, and provide several types of representation for the transition probabilities. We observe that for a sub-class of these processes with long range (i.e. non-local) there exists a critical value of the range that allows an "almost-perfect" mixing in at most three steps. In other words, the total variation distance between the three steps transition and the stationary distribution decreases geometrically in $N$, which is the dimension of the hypercube. In some cases, the walk mixes almost-perfectly in exactly two steps. Notice that a well-known result (Theorem 1 in Diaconis and Shahshahani (1986)) shows that there exist no random walk on Abelian groups (such as the hypercube) which mixes perfectly in exactly two steps.


title: Background in the CMS muon detectors: simulation and measurements with pp collision data

abstract: The CMS muon system at the LHC is built of different detector technologies. The measurement of the background hit rates in the different muon detectors during the LHC Run-2 is of prime importance for an assessment of the longevity of the chambers and their on-board electronics, and therefore for the expected performance of the system at HL-LHC. Moreover, an accurate modelling of the backgrounds using simulations is also critical, as an estimation of the expected radiation background for the Phase-2 upgrade can only rely on Montecarlo-based predictions in the regions where new detectors are being installed. The present understanding of the backgrounds measured with data collected during the LHC Run-2, as well as at CERN high-intensity gamma irradiation facility, GIF++, is discussed, together with the work made to improve the accuracy of the background modelling in Fluka and GEANT4 simulations.


title: Construction of Poincar\'e-type series by generating kernels

abstract: Let $\Gamma\subset \textrm{PSL}_2({\mathbb R})$ be a Fuchsian group of the first kind having a fundamental domain with a finite hyperbolic area, and let $\widetilde\Gamma$ be its cover in $\textrm{SL}_2({\mathbb R})$. Consider the space of twice continuously differentiable, square-integrable functions on the hyperbolic upper half-plane, which transform in a suitable way with respect to a multiplier system of weight $k\in{\mathbb R}$ under the action of $\widetilde\Gamma$. The space of such functions admits the action of the hyperbolic Laplacian $\Delta_k$ of weight $k$. Following an approach of Jorgenson, von Pippich and Smajlovi\'c (where $k=0$), we use the spectral expansion associated to $\Delta_k$ to construct a wave distribution and then identify the conditions on its test functions under which it represents automorphic kernels and further gives rise to Poincar\'e-type series. An advantage of this method is that the resulting series may be naturally meromorphically continued to the whole complex plane. Additionally, we derive sup-norm bounds for the eigenfunctions in the discrete spectrum of $\Delta_k$.


title: Autonomous Discovery of Unknown Reaction Pathways from Data by Chemical Reaction Neural Network

abstract: Chemical reactions occur in energy, environmental, biological, and many other natural systems, and the inference of the reaction networks is essential to understand and design the chemical processes in engineering and life sciences. Yet, revealing the reaction pathways for complex systems and processes is still challenging due to the lack of knowledge of the involved species and reactions. Here, we present a neural network approach that autonomously discovers reaction pathways from the time-resolved species concentration data. The proposed Chemical Reaction Neural Network (CRNN), by design, satisfies the fundamental physics laws, including the Law of Mass Action and the Arrhenius Law. Consequently, the CRNN is physically interpretable such that the reaction pathways can be interpreted, and the kinetic parameters can be quantified simultaneously from the weights of the neural network. The inference of the chemical pathways is accomplished by training the CRNN with species concentration data via stochastic gradient descent. We demonstrate the successful implementations and the robustness of the approach in elucidating the chemical reaction pathways of several chemical engineering and biochemical systems. The autonomous inference by the CRNN approach precludes the need for expert knowledge in proposing candidate networks and addresses the curse of dimensionality in complex systems. The physical interpretability also makes the CRNN capable of not only fitting the data for a given system but also developing knowledge of unknown pathways that could be generalized to similar chemical systems.


title: Real-Time Optimal Guidance and Control for Interplanetary Transfers Using Deep Networks

abstract: We consider the Earth-Venus mass-optimal interplanetary transfer of a low-thrust spacecraft and show how the optimal guidance can be represented by deep networks in a large portion of the state space and to a high degree of accuracy. Imitation (supervised) learning of optimal examples is used as a network training paradigm. The resulting models are suitable for an on-board, real-time, implementation of the optimal guidance and control system of the spacecraft and are called G&CNETs. A new general methodology called Backward Generation of Optimal Examples is introduced and shown to be able to efficiently create all the optimal state action pairs necessary to train G&CNETs without solving optimal control problems. With respect to previous works, we are able to produce datasets containing a few orders of magnitude more optimal trajectories and obtain network performances compatible with real missions requirements. Several schemes able to train representations of either the optimal policy (thrust profile) or the value function (optimal mass) are proposed and tested. We find that both policy learning and value function learning successfully and accurately learn the optimal thrust and that a spacecraft employing the learned thrust is able to reach the target conditions orbit spending only 2 permil more propellant than in the corresponding mathematically optimal transfer. Moreover, the optimal propellant mass can be predicted (in case of value function learning) within an error well within 1%. All G&CNETs produced are tested during simulations of interplanetary transfers with respect to their ability to reach the target conditions optimally starting from nominal and off-nominal conditions.


title: Dynamics within a tunable harmonic/quartic waveguide

abstract: We present an analytical solution to the dynamics of a noninteracting cloud of thermal atoms in a cigar-shaped harmonic trap with a quartic perturbation along the axial direction. We calculate the first and second moments of position, which are sufficient to characterize the trap. The dynamics of the thermal cloud differ notably from those of a single particle, with an offset to the oscillation frequency that persists even as the oscillation amplitude approaches zero. We also present some numerical results that describe the effects of time-of-flight on the behavior of the cloud in order to better understand the results of a hypothetical experimental realization of this system.


title: The Dunkl kernel and intertwining operator for dihedral groups

abstract: Dunkl operators associated with finite reflection groups generate a commutative algebra of differential-difference operators. There exists a unique linear operator called intertwining operator which intertwines between this algebra and the algebra of standard differential operators. There also exists a generalization of the Fourier transform in this context called Dunkl transform. In this paper, we determine an integral expression for the Dunkl kernel, which is the integral kernel of the Dunkl transform, for all dihedral groups. We also determine an integral expression for the intertwining operator in the case of dihedral groups, based on observations valid for all reflection groups. As a special case, we recover the result of [Xu, Intertwining operators associated to dihedral groups. Constr. Approx. 2019]. Crucial in our approach is a systematic use of the link between both integral kernels and the simplex in a suitable high dimensional space.


title: Lagrangian and Dirac constraints for the ideal incompressible fluid and magnetohydrodynamics

abstract: The incompressibility constraint for fluid flow was imposed by Lagrange in the so-called Lagrangian variable description using his method of multipliers in the Lagrangian (variational) formulation. An alternative is the imposition of incompressibility in the Eulerian variable description by a generalization of Dirac's constraint method using noncanonical Poisson brackets. Here it is shown how to impose the incompressibility constraint using Dirac's method in terms of both the canonical Poisson brackets in the Lagrangian variable description and the noncanonical Poisson brackets in the Eulerian description, allowing for the advection of density. Both cases give dynamics of infinite-dimensional geodesic flow on the group of volume preserving diffeomorphisms and explicit expressions for this dynamics in terms of the constraints and original variables is given. Because Lagrangian and Eulerian conservation laws are not identical, comparison of the various methods is made.


title: Incremental Sampling Without Replacement for Sequence Models

abstract: Sampling is a fundamental technique, and sampling without replacement is often desirable when duplicate samples are not beneficial. Within machine learning, sampling is useful for generating diverse outputs from a trained model. We present an elegant procedure for sampling without replacement from a broad class of randomized programs, including generative neural models that construct outputs sequentially. Our procedure is efficient even for exponentially-large output spaces. Unlike prior work, our approach is incremental, i.e., samples can be drawn one at a time, allowing for increased flexibility. We also present a new estimator for computing expectations from samples drawn without replacement. We show that incremental sampling without replacement is applicable to many domains, e.g., program synthesis and combinatorial optimization.


title: Face Phylogeny Tree Using Basis Functions

abstract: Photometric transformations, such as brightness and contrast adjustment, can be applied to a face image repeatedly creating a set of near-duplicate images. Identifying the original image from a set of such near-duplicates and deducing the relationship between them are important in the context of digital image forensics. This is commonly done by generating an image phylogeny tree \textemdash \hspace{0.08cm} a hierarchical structure depicting the relationship between a set of near-duplicate images. In this work, we utilize three different families of basis functions to model pairwise relationships between near-duplicate images. The basis functions used in this work are orthogonal polynomials, wavelet basis functions and radial basis functions. We perform extensive experiments to assess the performance of the proposed method across three different modalities, namely, face, fingerprint and iris images; across different image phylogeny tree configurations; and across different types of photometric transformations. We also utilize the same basis functions to model geometric transformations and deep-learning based transformations. We also perform extensive analysis of each basis function with respect to its ability to model arbitrary transformations and to distinguish between the original and the transformed images. Finally, we utilize the concept of approximate von Neumann graph entropy to explain the success and failure cases of the proposed IPT generation algorithm. Experiments indicate that the proposed algorithm generalizes well across different scenarios thereby suggesting the merits of using basis functions to model the relationship between photometrically and geometrically modified images.


title: Optimizing Vulnerability-Driven Honey Traffic Using Game Theory

abstract: Enterprises are increasingly concerned about adversaries that slowly and deliberately exploit resources over the course of months or even years. A key step in this kill chain is network reconnaissance, which has historically been active (e.g., network scans) and therefore detectable. However, new networking technology increases the possibility of passive network reconnaissance, which will be largely undetectable by defenders. In this paper, we propose Snaz, a technique that uses deceptively crafted honey traffic to confound the knowledge gained through passive network reconnaissance. We present a two-player non-zero-sum Stackelberg game model that characterizes how a defender should deploy honey traffic in the presence of an adversary who is aware of Snaz. In doing so, we demonstrate the existence of optimal defender strategies that will either dissuade an adversary from acting on the existence of real vulnerabilities observed within network traffic, or reveal the adversary's presence when it attempts to unknowingly attack an intrusion detection node.


title: Stein Self-Repulsive Dynamics: Benefits From Past Samples

abstract: We propose a new Stein self-repulsive dynamics for obtaining diversified samples from intractable un-normalized distributions. Our idea is to introduce Stein variational gradient as a repulsive force to push the samples of Langevin dynamics away from the past trajectories. This simple idea allows us to significantly decrease the auto-correlation in Langevin dynamics and hence increase the effective sample size. Importantly, as we establish in our theoretical analysis, the asymptotic stationary distribution remains correct even with the addition of the repulsive force, thanks to the special properties of the Stein variational gradient. We perform extensive empirical studies of our new algorithm, showing that our method yields much higher sample efficiency and better uncertainty estimation than vanilla Langevin dynamics.


title: Four-point geometrical correlation functions in the two-dimensional $Q$-state Potts model: connections with the RSOS models

abstract: The "bootstrap determination" of the geometrical correlation functions in the two-dimensional Potts model proposed in a paper [arXiv:1607.07224] was later shown in [arXiv:1809.02191] to be incorrect, the actual spectrum of the model being considerably more complex than initially conjectured. We provide in this paper a geometrical interpretation of the four-point functions built in [arXiv:1607.07224], and explain why the results obtained by these authors, albeit incorrect, appeared so close to those of their numerical simulations of the Potts model. Our strategy is based on a cluster expansion of correlation functions in RSOS minimal models, and a subsequent numerical and algebraic analysis of the corresponding $s$-channel spectrum, in full analogy with our early work on the Potts model [arXiv:1809.02191]. Remarkable properties of the lattice amplitudes are uncovered, which explain in particular the truncation of the spectrum of [arXiv:1809.02191] to the much simpler one of the RSOS models, and which will be used in a forthcoming paper to finally determine the geometric four-point functions of the Potts model itself.

categories: hep-th cond-mat.stat-mech math-ph math.MP


title: GenDICE: Generalized Offline Estimation of Stationary Values

abstract: An important problem that arises in reinforcement learning and Monte Carlo methods is estimating quantities defined by the stationary distribution of a Markov chain. In many real-world applications, access to the underlying transition operator is limited to a fixed set of data that has already been collected, without additional interaction with the environment being available. We show that consistent estimation remains possible in this challenging scenario, and that effective estimation can still be achieved in important applications. Our approach is based on estimating a ratio that corrects for the discrepancy between the stationary and empirical distributions, derived from fundamental properties of the stationary distribution, and exploiting constraint reformulations based on variational divergence minimization. The resulting algorithm, GenDICE, is straightforward and effective. We prove its consistency under general conditions, provide an error analysis, and demonstrate strong empirical performance on benchmark problems, including off-line PageRank and off-policy policy evaluation.


title: Improved guarantees and a multiple-descent curve for Column Subset Selection and the Nystr\"om method

abstract: The Column Subset Selection Problem (CSSP) and the Nystr\"om method are among the leading tools for constructing small low-rank approximations of large datasets in machine learning and scientific computing. A fundamental question in this area is: how well can a data subset of size k compete with the best rank k approximation? We develop techniques which exploit spectral properties of the data matrix to obtain improved approximation guarantees which go beyond the standard worst-case analysis. Our approach leads to significantly better bounds for datasets with known rates of singular value decay, e.g., polynomial or exponential decay. Our analysis also reveals an intriguing phenomenon: the approximation factor as a function of k may exhibit multiple peaks and valleys, which we call a multiple-descent curve. A lower bound we establish shows that this behavior is not an artifact of our analysis, but rather it is an inherent property of the CSSP and Nystr\"om tasks. Finally, using the example of a radial basis function (RBF) kernel, we show that both our improved bounds and the multiple-descent curve can be observed on real datasets simply by varying the RBF parameter.


title: Coarse-Graining of Microscopic Dynamics into Mesoscopic Transient Potential Model

abstract: We show that a mesoscopic coarse-grained dynamics model which incorporates the transient potential can be formally derived from an underlying microscopic dynamics model. As a microscopic dynamics model, we employ the overdamped Langevin equation. By utilizing the path probability and the Onsager-Machlup type action, we calculate the path probability for the coarse-grained mesoscopic degrees of freedom. The action for the mesoscopic degrees of freedom can be simplified by incorporating the transient potential. Then the dynamic equation for the mesoscopic degrees of freedom can be simply described by the Langevin equation with the transient potential (LETP). As a simple and analytically tractable approximation, we introduce additional degrees of freedom which express the state of the transient potential. Then we approximately express the dynamics of the system as the the combination of the LETP and the dynamics model for the transient potential. The resulting dynamics model has the same dynamical structure as the responsive particle dynamics (RaPiD) type models [W. J. Briels, Soft Matter 5, 4401 (2009)] and the multi-chain slip-spring type models [T. Uneyama and Y. Masubuchi, J. Chem. Phys. 137, 154902 (2012)]. As a demonstration, we apply our coarse-graining method with the LETP to a single particle dynamics in a supercooled liquid, and compare the results of the LETP with the molecular dynamics simulations and other coarse-graining models.


title: Low Thermal Budget High-k/Metal Surface Gate for Buried Donor-Based Devices

abstract: Atomic precision advanced manufacturing (APAM) offers creation of donor devices in an atomically thin layer doped beyond the solid solubility limit, enabling unique device physics. This presents an opportunity to use APAM as a pathfinding platform to investigate digital electronics at the atomic limit. Scaling to smaller transistors is increasingly difficult and expensive, necessitating the investigation of alternative fabrication paths that extend to the atomic scale. APAM donor devices can be created using a scanning tunneling microscope (STM). However, these devices are not currently compatible with industry standard fabrication processes. There exists a tradeoff between low thermal budget (LT) processes to limit dopant diffusion and high thermal budget (HT) processes to grow defect-free layers of epitaxial Si and gate oxide. To this end, we have developed an LT epitaxial Si cap and LT deposited Al2O3 gate oxide integrated with an atomically precise single-electron transistor (SET) that we use as an electrometer to characterize the quality of the gate stack. The surface-gated SET exhibits the expected Coulomb blockade behavior. However, the leverage of the gate over the SET is limited by defects in the layers above the SET, including interfaces between the Si and oxide, and structural and chemical defects in the Si cap. We propose a more sophisticated gate stack and process flow that is predicted to improve performance in future atomic precision devices.


title: Equidecomposition in cardinal algebras

abstract: Let $\Gamma$ be a countable group. A classical theorem of Thorisson states that if $X$ is a standard Borel $\Gamma$-space and $\mu$ and $\nu$ are Borel probability measures on $X$ which agree on every $\Gamma$-invariant subset, then $\mu$ and $\nu$ are equidecomposable, i.e. there are Borel measures $(\mu_\gamma)_{\gamma\in\Gamma}$ on $X$ such that $\mu = \sum_\gamma \mu_\gamma$ and $\nu = \sum_\gamma \gamma\mu_\gamma$. We establish a generalization of this result to cardinal algebras.


title: Accelerating Reinforcement Learning with a Directional-Gaussian-Smoothing Evolution Strategy

abstract: Evolution strategy (ES) has been shown great promise in many challenging reinforcement learning (RL) tasks, rivaling other state-of-the-art deep RL methods. Yet, there are two limitations in the current ES practice that may hinder its otherwise further capabilities. First, most current methods rely on Monte Carlo type gradient estimators to suggest search direction, where the policy parameter is, in general, randomly sampled. Due to the low accuracy of such estimators, the RL training may suffer from slow convergence and require more iterations to reach optimal solution. Secondly, the landscape of reward functions can be deceptive and contains many local maxima, causing ES algorithms to prematurely converge and be unable to explore other parts of the parameter space with potentially greater rewards. In this work, we employ a Directional Gaussian Smoothing Evolutionary Strategy (DGS-ES) to accelerate RL training, which is well-suited to address these two challenges with its ability to i) provide gradient estimates with high accuracy, and ii) find nonlocal search direction which lays stress on large-scale variation of the reward function and disregards local fluctuation. Through several benchmark RL tasks demonstrated herein, we show that DGS-ES is highly scalable, possesses superior wall-clock time, and achieves competitive reward scores to other popular policy gradient and ES approaches.


title: Stochastic discrete time crystals: Entropy production and subharmonic synchronization

abstract: Discrete time crystals are periodically driven systems that display spontaneous symmetry breaking of time translation invariance in the form of indefinite subharmonic oscillations. We introduce a thermodynamically consistent model for a discrete time crystal and analyze it using the framework of stochastic thermodynamics. In particular, we evaluate the rate of energy dissipation of this many body system of interacting noisy subharmonic oscillators in contact with a heat bath. Our model displays the novel phenomena of subharmonic synchronization, which corresponds to collective subharmonic oscillations of the individual units.


title: Orbits of Bernoulli Measures in Cellular Automata

abstract: We discuss how to construct shift-invariant probability measures over the space of bisequences of symbols, and how to describe such measures in terms of block probabilities. We then define cellular automata as maps in the space of measures and discuss orbits of shift-invariant probability measures under these maps. Subsequently, the local structure approximation is discussed as a method to approximate orbits of Bernoulli measures under the action of cellular automata. The final sections presents some known examples of cellular automata, both deterministic and probabilistic, for which elements of the orbit of the Bernoulli measure (probabilities of short blocks) can be determined exactly.


title: Development of accurate human head models for personalized electromagnetic dosimetry using deep learning

abstract: The development of personalized human head models from medical images has become an important topic in the electromagnetic dosimetry field, including the optimization of electrostimulation, safety assessments, etc. Human head models are commonly generated via the segmentation of magnetic resonance images into different anatomical tissues. This process is time consuming and requires special experience for segmenting a relatively large number of tissues. Thus, it is challenging to accurately compute the electric field in different specific brain regions. Recently, deep learning has been applied for the segmentation of the human brain. However, most studies have focused on the segmentation of brain tissue only and little attention has been paid to other tissues, which are considerably important for electromagnetic dosimetry. In this study, we propose a new architecture for a convolutional neural network, named ForkNet, to perform the segmentation of whole human head structures, which is essential for evaluating the electrical field distribution in the brain. The proposed network can be used to generate personalized head models and applied for the evaluation of the electric field in the brain during transcranial magnetic stimulation. Our computational results indicate that the head models generated using the proposed network exhibit strong matching with those created via manual segmentation in an intra-scanner segmentation task.


title: S-stable foliations on flow-spines with transverse Reeb flow

abstract: The notion of S-stability of foliations on branched simple polyhedrons is introduced by R. Benedetti and C. Petronio in the study of characteristic foliations of contact structures on 3-manifolds. We additionally assume that the 1-form $\beta$ defining a foliation on a branched simple polyhedron $P$ satisfies $d\beta>0$, which means that the foliation is a characteristic foliation of a contact form whose Reeb flow is transverse to $P$. In this paper, we show that if there exists a 1-form $\beta$ on $P$ with $d\beta>0$ then we can find a 1-form with the same property and additionally being S-stable. We then prove that the number of simple tangency points of an S-stable foliation on a positive or negative flow-spine is at least 2 and give a recipe for constructing a characteristic foliation of a 1-form $\beta$ with $d\beta>0$ on the abalone.


title: Large Enhancement of Critical Current in Superconducting Devices by Gate Voltage

abstract: The gate-voltage-induced suppression of critical currents in metallic superconductors observed recently [De Simoni et al., Nat. Nanotechnol. 13, 802 (2018)] has raised crucial questions regarding the nature and mechanism of the electric field effect in these systems. Here, we demonstrate an enhancement of up to 30 % in critical current in the type II superconductor NbN, micro- and nano superconducting bridges, tunable via a back-gate voltage. Our suggested plausible mechanism of this enhancement in critical current based on surface nucleation and pinning of Abrikosov vortices is consistent with expectations and observations for type-II superconductor films with thicknesses comparable to their coherence length. Furthermore we demonstrate infinite electroresistance and a hysteretic resistance dependence on the applied electric field which could lead to logic and memory applications in a superconductors-based low-dissipation digital computing paradigm. Our work thus provides the first demonstration of an electric field enhancement in the superconducting property in metallic superconductors, constituting a crucial step towards understanding of electric field-effects on the fundamental properties of a superconductor and its exploitation for future technologies.


title: Angular momentum-related probe of cold gas deficiencies

abstract: Recent studies of neutral atomic hydrogen (HI) in nearby galaxies found that all field disk galaxies are HI saturated, in that they carry roughly as much HI as permitted before this gas becomes gravitationally unstable. By taking this HI saturation for granted, the atomic gas fraction $f_{\rm atm}$ of galactic disks can be predicted as a function of the stability parameter $q=j\sigma/(GM)$, where $M$ and $j$ are the baryonic mass and specific angular momentum of the disk and $\sigma$ is the HI velocity dispersion Obreschkow et al. 2016. The log-ratio $\Delta f_q$ between this predictor and the observed atomic fraction can be seen as a physically motivated `HI deficiency'. While field disk galaxies have $\Delta f_q \approx0$, objects subject to environmental removal of HI are expected to have $\Delta f_q>0$. Within this framework, we revisit the HI deficiencies of satellite galaxies in the Virgo cluster and in clusters of the EAGLE simulation. We find that observed and simulated cluster galaxies are HI deficient and that $\Delta f_q$ slightly increases when getting closer to the cluster centres. The $\Delta f_q$ values are similar to traditional HI deficiency estimators, but $\Delta f_q$ is more directly comparable between observations and simulations than morphology-based deficiency estimators. By tracking the simulated HI deficient cluster galaxies back in time, we confirm that $\Delta f_q\approx0$ until the galaxies first enter a halo with $M_{\rm halo}>10^{13} {\rm M_{\odot}}$, at which moment they quickly lose HI by environmental effects. Finally, we use the simulation to investigate the links between $\Delta f_q$ and quenching of star formation.


title: On the impressive performance of randomly weighted encoders in summarization tasks

abstract: In this work, we investigate the performance of untrained randomly initialized encoders in a general class of sequence to sequence models and compare their performance with that of fully-trained encoders on the task of abstractive summarization. We hypothesize that random projections of an input text have enough representational power to encode the hierarchical structure of sentences and semantics of documents. Using a trained decoder to produce abstractive text summaries, we empirically demonstrate that architectures with untrained randomly initialized encoders perform competitively with respect to the equivalent architectures with fully-trained encoders. We further find that the capacity of the encoder not only improves overall model generalization but also closes the performance gap between untrained randomly initialized and full-trained encoders. To our knowledge, it is the first time that general sequence to sequence models with attention are assessed for trained and randomly projected representations on abstractive summarization.


title: Leveraging Photogrammetric Mesh Models for Aerial-Ground Feature Point Matching Toward Integrated 3D Reconstruction

abstract: Integration of aerial and ground images has been proved as an efficient approach to enhance the surface reconstruction in urban environments. However, as the first step, the feature point matching between aerial and ground images is remarkably difficult, due to the large differences in viewpoint and illumination conditions. Previous studies based on geometry-aware image rectification have alleviated this problem, but the performance and convenience of this strategy is limited by several flaws, e.g. quadratic image pairs, segregated extraction of descriptors and occlusions. To address these problems, we propose a novel approach: leveraging photogrammetric mesh models for aerial-ground image matching. The methods of this proposed approach have linear time complexity with regard to the number of images, can explicitly handle low overlap using multi-view images and can be directly injected into off-the-shelf structure-from-motion (SfM) and multi-view stereo (MVS) solutions. First, aerial and ground images are reconstructed separately and initially co-registered through weak georeferencing data. Second, aerial models are rendered to the initial ground views, in which the color, depth and normal images are obtained. Then, the synthesized color images and the corresponding ground images are matched by comparing the descriptors, filtered by local geometrical information, and then propagated to the aerial views using depth images and patch-based matching. Experimental evaluations using various datasets confirm the superior performance of the proposed methods in aerial-ground image matching. In addition, incorporation of the existing SfM and MVS solutions into these methods enables more complete and accurate models to be directly obtained.


title: Common knowledge equilibrium of Boolean securities in distributed information market

abstract: We investigate common knowledge equilibrium of separable (or parity) and totally symmetric Boolean securities in distributed information market. We theoretically show that clearing price converges to the true value when a common prior probability distribution of information of each player satisfies some conditions.


title: On spectral inclusion and mapping theorems for scalar type spectral operators and semigroups

abstract: We establish spectral inclusion and mapping theorems for scalar type spectral operators, generalizing their counterparts for normal operators. Thereby, we extend a precise weak spectral mapping theorem, known to hold for $C_0$-semigroups of normal operators on complex Hilbert spaces, to the more general case of $C_0$-semigroups of scalar type spectral operators on complex Banach spaces. The finer spectrum structure is given itemized consideration.


title: Large-area microwire MoSi single-photon detectors at 1550 nm wavelength

abstract: We demonstrate saturated internal detection efficiency at 1550 nm wavelengths for meander-shaped superconducting nanowire single-photon detectors made of 3 nm thick MoSi films with widths of 1 and 3 ${\mu}m$, and active areas up to 400 by 400 ${\mu}m^2$. Despite hairpin turns and a large number of squares (up to $10^4$) in the device, the dark count rate was measured to be ~10$^3$ cps at 99% of the switching current. This value is about two orders of magnitude lower than results reported recently for short MoSi devices with shunt resistors. We also found that 5 nm thick MoSi detectors with the same geometry were insensitive to single near-infrared photons, which may be associated with different levels of suppression of the superconducting order parameter. However, our results obtained on 3 nm thick MoSi devices are in a good agreement with predictions in the frame of a kinetic-equation approach.


title: Safe Imitation Learning via Fast Bayesian Reward Inference from Preferences

abstract: Bayesian reward learning from demonstrations enables rigorous safety and uncertainty analysis when performing imitation learning. However, Bayesian reward learning methods are typically computationally intractable for complex control problems. We propose Bayesian Reward Extrapolation (Bayesian REX), a highly efficient Bayesian reward learning algorithm that scales to high-dimensional imitation learning problems by pre-training a low-dimensional feature encoding via self-supervised tasks and then leveraging preferences over demonstrations to perform fast Bayesian inference. Bayesian REX can learn to play Atari games from demonstrations, without access to the game score and can generate 100,000 samples from the posterior over reward functions in only 5 minutes on a personal laptop. Bayesian REX also results in imitation learning performance that is competitive with or better than state-of-the-art methods that only learn point estimates of the reward function. Finally, Bayesian REX enables efficient high-confidence policy evaluation without having access to samples of the reward function. These high-confidence performance bounds can be used to rank the performance and risk of a variety of evaluation policies and provide a way to detect reward hacking behaviors.


title: New SAV-pressure correction methods for the Navier-Stokes equations: stability and error analysis

abstract: We construct new first- and second-order pressure correction schemes using the scalar auxiliary variable (SAV) approach for the Navier-Stokes equations. These schemes are linear, decoupled and only require a sequence of solving Poisson type equations at each time step. Furthermore, they are unconditionally energy stable. We also establish rigorous error estimates for the velocity and pressure approximation of the first-order scheme without any condition on the time step.


title: Facilitating SQL Query Composition and Analysis

abstract: Formulating efficient SQL queries requires several cycles of tuning and execution, particularly for inexperienced users. We examine methods that can accelerate and improve this interaction by providing insights about SQL queries prior to execution. We achieve this by predicting properties such as the query answer size, its run-time, and error class. Unlike existing approaches, our approach does not rely on any statistics from the database instance or query execution plans. This is particularly important in settings with limited access to the database instance. Our approach is based on using data-driven machine learning techniques that rely on large query workloads to model SQL queries and their properties. We evaluate the utility of neural network models and traditional machine learning models. We use two real-world query workloads: the Sloan Digital Sky Survey (SDSS) and the SQLShare query workload. Empirical results show that the neural network models are more accurate in predicting the query error class, achieving a higher F-measure on classes with fewer samples as well as performing better on other problems such as run-time and answer size prediction. These results are encouraging and confirm that SQL query workloads and data-driven machine learning methods can be leveraged to facilitate query composition and analysis.


title: Progress on sufficient conditions for a graph to have a spanning $k-$ended tree

abstract: In 1998, Broersma and Tuinstra [J. Graph Theory \textbf{29} (1998), 227-237] proved that if $G$ is a connected graph satisfying $\sigma_2(G) \geq |G|-k+1$ then $G$ has a spanning $k-$ended tree. They also gave an example to show that the condition "$\sigma_2(G) \geq |G|-k+1$" is sharp. In this paper, we introduce a new progress for this result. Let $K_{m,m+k}$ be a complete bipartite graph with bipartition $V(K_{m,m+k})=A\cup B, |A|=m, |B|=m+k.$ Denote by $H$ to be the graph obtained from $K_{m,m+k}$ by adding (or no adding) some edges with two end vertices in $A.$ We prove that if $G$ is a connected graph satisfying $\sigma_2(G) \geq |G|-k$ then $G$ has a spanning $k-$ended tree except for the case $G$ is isomorphic to a graph $H.$ As a corollary of our main result, a sufficient condition for a graph to have a few branch vertices is given.


title: The Surprising Effectiveness of Linear Models for Visual Foresight in Object Pile Manipulation

abstract: In this paper, we tackle the problem of pushing piles of small objects into a desired target set using visual feedback. Unlike conventional single-object manipulation pipelines, which estimate the state of the system parametrized by pose, the underlying physical state of this system is difficult to observe from images. Thus, we take the approach of reasoning directly in the space of images, and acquire the dynamics of visual measurements in order to synthesize a visual-feedback policy. We present a simple controller using an image-space Lyapunov function, and evaluate the closed-loop performance using three different class of models for image prediction: deep-learning-based models for image-to-image translation, an object-centric model obtained from treating each pixel as a particle, and a switched-linear system where an action-dependent linear map is used. Through results in simulation and experiment, we show that for this task, a linear model works surprisingly well -- achieving better prediction error, downstream task performance, and generalization to new environments than the deep models we trained on the same amount of data. We believe these results provide an interesting example in the spectrum of models that are most useful for vision-based feedback in manipulation, considering both the quality of visual prediction, as well as compatibility with rigorous methods for control design and analysis. Project site: https://sites.google.com/view/linear-visual-foresight/home


title: Inverted-File k-Means Clustering: Performance Analysis

abstract: This paper presents an inverted-file k-means clustering algorithm (IVF) suitable for a large-scale sparse data set with potentially numerous classes. Given such a data set, IVF efficiently works at high-speed and with low memory consumption, which keeps the same solution as a standard Lloyd's algorithm. The high performance arises from two distinct data representations. One is a sparse expression for both the object and mean feature vectors. The other is an inverted-file data structure for a set of the mean feature vectors. To confirm the effect of these representations, we design three algorithms using distinct data structures and expressions for comparison. We experimentally demonstrate that IVF achieves better performance than the designed algorithms when they are applied to large-scale real document data sets in a modern computer system equipped with superscalar out-of-order processors and a deep hierarchical memory system. We also introduce a simple yet practical clock-cycle per instruction (CPI) model for speed-performance analysis. Analytical results reveal that IVF suppresses three performance degradation factors: the numbers of cache misses, branch mispredictions, and the completed instructions.


title: Parallel and distributed asynchronous adaptive stochastic gradient methods

abstract: Stochastic gradient methods (SGMs) are the predominant approaches to train deep learning models. The adaptive versions (e.g., Adam and AMSGrad) have been extensively used in practice, partly because they achieve faster convergence than the non-adaptive versions while incurring little overhead. On the other hand, asynchronous (async) parallel computing has exhibited significantly higher speed-up over its synchronous (sync) counterpart. Async-parallel non-adaptive SGMs have been well studied in the literature from the perspectives of both theory and practical performance. Adaptive SGMs can also be implemented without much difficulty in an async-parallel way. However, to the best of our knowledge, no theoretical result of async-parallel adaptive SGMs has been established. The difficulty for analyzing adaptive SGMs with async updates originates from the second moment term. In this paper, we propose an async-parallel adaptive SGM based on AMSGrad. We show that the proposed method inherits the convergence guarantee of AMSGrad for both convex and non-convex problems, if the staleness (also called delay) caused by asynchrony is bounded. Our convergence rate results indicate a nearly linear parallelization speed-up if $\tau=o(K^{\frac{1}{4}})$, where $\tau$ is the staleness and $K$ is the number of iterations. The proposed method is tested on both convex and non-convex machine learning problems, and the numerical results demonstrate its clear advantages over the sync counterpart and the async-parallel nonadaptive SGM.


title: Anonymizing Data for Privacy-Preserving Federated Learning

abstract: Federated learning enables training a global machine learning model from data distributed across multiple sites, without having to move the data. This is particularly relevant in healthcare applications, where data is rife with personal, highly-sensitive information, and data analysis methods must provably comply with regulatory guidelines. Although federated learning prevents sharing raw data, it is still possible to launch privacy attacks on the model parameters that are exposed during the training process, or on the generated machine learning model. In this paper, we propose the first syntactic approach for offering privacy in the context of federated learning. Unlike the state-of-the-art differential privacy-based frameworks, our approach aims to maximize utility or model performance, while supporting a defensible level of privacy, as demanded by GDPR and HIPAA. We perform a comprehensive empirical evaluation on two important problems in the healthcare domain, using real-world electronic health data of 1 million patients. The results demonstrate the effectiveness of our approach in achieving high model performance, while offering the desired level of privacy. Through comparative studies, we also show that, for varying datasets, experimental setups, and privacy budgets, our approach offers higher model performance than differential privacy-based techniques in federated learning.


title: Sector connectedness in the Chinese stock markets

abstract: Uncovering the risk transmitting path within economic sectors in China is crucial for understanding the stability of the Chinese economic system, especially under the current situation of the China-US trade conflicts. In this paper, we try to uncover the risk spreading channels by means of volatility spillovers within the Chinese sectors using stock market data. By applying the generalized variance decomposition framework based on the VAR model and the rolling window approach, a set of connectedness matrices is obtained to reveal the overall and dynamic spillovers within sectors. It is found that 17 sectors (mechanical equipment, electrical equipment, utilities, and so on) are risk transmitters and 11 sectors (national defence, bank, non-bank finance, and so on) are risk takers during the whole period. During the periods with the extreme risk events (the global financial crisis, the Chinese interbank liquidity crisis, the Chinese stock market plunge, and the China-US trade war), we observe that the connectedness measures significantly increase and the financial sectors play a buffer role in stabilizing the economic system. The robust tests suggest that our results are not sensitive to the changes of model parameters. Our results not only uncover the spillover effects within the Chinese sectors, but also highlight the deep understanding of the risk contagion patterns in the Chinese stock markets.


title: H-AP Deployment for Joint Wireless Information and Energy Transfer in Smart Cities

abstract: With the wireless communication being more various in the future, it's becoming challenging to prolong the lifetime of many battery powered devices, since frequently replacing their batteries is a cumbersome job. An hybrid access point (H-AP) is capable of simultaneously operating wireless information transfer (WIT) and wireless energy transfer (WET) by exploiting the radio frequency (RF) signals. By jointly considering both the mobility of the user and the popularity of the sites, we focus on the design of the H-AP's deployment scheme. Specifically, a mobility model of the grid based city streets is exploited for characterising the users' movements. Based on this mobility model, the impact of the deployment site's popularity on the WIT and WET efficiencies is firstly analysed. Then, an H-AP deployment scheme for striking a balance between the WIT and the WET efficiencies is proposed, which is regarded as the B-deployment scheme. The simulation results demonstrate that the B-deployment scheme is more flexible for satisfying diverse requirement of the WIT and WET efficiencies.


title: Radon transforms on homogeneous trees

abstract: We study the different horospherical Radon transforms that arise by regarding a homogeneous tree T as a simplicial complex whose simplices are vertices V, edges E or flags F (flags are oriented edges). The ends (infinite geodesic rays starting at a reference vertex) provide a boundary $\Omega$ for the tree. Then the horospheres form a trivial principal fiber bundle with base $\Omega$ and fiber $\mathZ$. There are three such fiber bundles, consisting of horospheres of vertices, edges or flags, but they are isomorphic: however, no isomorphism between these fiber bundles maps special sections to special sections (a special section consists of the set of horospheres through a given vertex, edge or flag). The groups of automorphisms of the fiber bundles contain a subgroup $A$ of parallel shifts, analogous to the Cartan subgroup of a semisimple group. The normalized eigenfunctions of the Laplace operator on T are boundary integrals of complex powers of the Poisson kernel, that is characters of $A$, and are matrix coefficients of representations induced from $A$ in the sense of Mackey, the so-called spherical representations. The vertex-horospherical Radon transform consists of summation over V in each vertex-horosphere, and similarly for edges or flags. We prove inversion formulas for all these Radon transforms, and give applications to harmonic analysis and the Plancherel measure on T. We show via integral geometry that the spherical representations for vertices and edges are equivalent. Also, we define the Radon back-projections and find the inversion operator of each Radon transform by composing it with its back-projection. This gives rise to a convolution operator on T, whose symbol is obtained via the spherical Fourier transform, and its reciprocal is the symbol of the Radon inversion formula.


title: Using Deep Learning to Improve Ensemble Smoother: Applications to Subsurface Characterization

abstract: Ensemble smoother (ES) has been widely used in various research fields to reduce the uncertainty of the system-of-interest. However, the commonly-adopted ES method that employs the Kalman formula, that is, ES$_\text{(K)}$, does not perform well when the probability distributions involved are non-Gaussian. To address this issue, we suggest to use deep learning (DL) to derive an alternative update scheme for ES in complex data assimilation applications. Here we show that the DL-based ES method, that is, ES$_\text{(DL)}$, is more general and flexible. In this new update scheme, a high volume of training data are generated from a relatively small-sized ensemble of model parameters and simulation outputs, and possible non-Gaussian features can be preserved in the training data and captured by an adequate DL model. This new variant of ES is tested in two subsurface characterization problems with or without Gaussian assumptions. Results indicate that ES$_\text{(DL)}$ can produce similar (in the Gaussian case) or even better (in the non-Gaussian case) results compared to those from ES$_\text{(K)}$. The success of ES$_\text{(DL)}$ comes from the power of DL in extracting complex (including non-Gaussian) features and learning nonlinear relationships from massive amounts of training data. Although in this work we only apply the ES$_\text{(DL)}$ method in parameter estimation problems, the proposed idea can be conveniently extended to analysis of model structural uncertainty and state estimation in real-time forecasting studies.


title: Lie Bracket Approximation-Based Extremum Seeking with Vanishing Input Oscillations

abstract: In recent years, an approach to extremum seeking control made it possible to design control vector fields that lead to asymptotic stability of the minimum point provided that the minimum value of the function is known a priori. In this work, we aim to relax that assumption. We propose an extremum-seeking control law that converges to the minimum point with vanishing control oscillations, without access to the minimum value of the cost function. We provide a numerical example to support our results.


title: Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems

abstract: Recommender systems are embracing conversational technologies to obtain user preferences dynamically, and to overcome inherent limitations of their static models. A successful Conversational Recommender System (CRS) requires proper handling of interactions between conversation and recommendation. We argue that three fundamental problems need to be solved: 1) what questions to ask regarding item attributes, 2) when to recommend items, and 3) how to adapt to the users' online feedback. To the best of our knowledge, there lacks a unified framework that addresses these problems. In this work, we fill this missing interaction framework gap by proposing a new CRS framework named Estimation-Action-Reflection, or EAR, which consists of three stages to better converse with users. (1) Estimation, which builds predictive models to estimate user preference on both items and item attributes; (2) Action, which learns a dialogue policy to determine whether to ask attributes or recommend items, based on Estimation stage and conversation history; and (3) Reflection, which updates the recommender model when a user rejects the recommendations made by the Action stage. We present two conversation scenarios on binary and enumerated questions, and conduct extensive experiments on two datasets from Yelp and LastFM, for each scenario, respectively. Our experiments demonstrate significant improvements over the state-of-the-art method CRM [32], corresponding to fewer conversation turns and a higher level of recommendation hits.


title: Greedy Policy Search: A Simple Baseline for Learnable Test-Time Augmentation

abstract: Test-time data augmentation$-$averaging the predictions of a machine learning model across multiple augmented samples of data$-$is a widely used technique that improves the predictive performance. While many advanced learnable data augmentation techniques have emerged in recent years, they are focused on the training phase. Such techniques are not necessarily optimal for test-time augmentation and can be outperformed by a policy consisting of simple crops and flips. The primary goal of this paper is to demonstrate that test-time augmentation policies can be successfully learned too. We introduce greedy policy search (GPS), a simple but high-performing method for learning a policy of test-time augmentation. We demonstrate that augmentation policies learned with GPS achieve superior predictive performance on image classification problems, provide better in-domain uncertainty estimation, and improve the robustness to domain shift.


title: Determination of spin-orbit torque efficiencies in heterostructures with in-plane magnetic anisotropy

abstract: It has been shown that the spin Hall effect from heavy transition metals can generate sufficient spin-orbit torque and further produce current-induced magnetization switching in the adjacent ferromagnetic layer. However, if the ferromagnetic layer has in-plane magnetic anisotropy, probing such switching phenomenon typically relies on tunneling magnetoresistance measurement of nano-sized magnetic tunnel junctions, differential planar Hall voltage measurement, or Kerr imaging approaches. We show that in magnetic heterostructures with spin Hall metals, there exist current-induced in-plane spin Hall effective fields and unidirectional magnetoresistance that will modify their anisotropic magnetoresistance behavior. We also demonstrate that by analyzing the response of anisotropic magnetoresistance under such influences, one can directly and electrically probe magnetization switching driven by the spin-orbit torque, even in micron-sized devices. This pump-probe method allows for efficient and direct determination of key parameters from spin-orbit torque switching events without lengthy device fabrication processes.


title: Network reconstruction from asynchronously updated evolutionary game

abstract: The interactions between players of prisoner's dilemma (PD) game are reconstructed with evolutionary game data. All participants play the game with their counterparts and gain corresponding rewards during each round of the game. However, their strategies are updated asynchronously during the evolutionary PD game. Two inference methods of the interactions between players are derived with naive mean-field (nMF) approximation and maximum log-likelihood estimation (MLE) respectively. The two methods are tested numerically also for fully connected asymmetric Sherrington-Kirkpatrick (SK) models, varying the data length, asymmetric degree, payoff and system noise (coupling strength). We find that the reconstruction mean square error (MSE) of MLE method is proportional to the inverse of data length and typically half (benefit from the extra information of update times) of that by nMF. Both methods are robust to the asymmetric degree but works better for large payoff. Compared with MLE, nMF is more sensitive to the couplings strength which prefers weak couplings.


title: An Evolutionary Deep Learning Method for Short-term Wind Speed Prediction: A Case Study of the Lillgrund Offshore Wind Farm

abstract: Accurate short-term wind speed forecasting is essential for large-scale integration of wind power generation. However, the seasonal and stochastic characteristics of wind speed make forecasting a challenging task. This study uses a new hybrid evolutionary approach that uses a popular evolutionary search algorithm, CMA-ES, to tune the hyper-parameters of two Long short-term memory(LSTM) ANN models for wind prediction. The proposed hybrid approach is trained on data gathered from an offshore wind turbine installed in a Swedish wind farm located in the Baltic Sea. Two forecasting horizons including ten-minutes ahead (absolute short term) and one-hour ahead (short term) are considered in our experiments. Our experimental results indicate that the new approach is superior to five other applied machine learning models, i.e., polynomial neural network (PNN), feed-forward neural network (FNN), nonlinear autoregressive neural network (NAR) and adaptive neuro-fuzzy inference system (ANFIS), as measured by five performance criteria.


title: Learning Precise 3D Manipulation from Multiple Uncalibrated Cameras

abstract: In this work, we present an effective multi-view approach to closed-loop end-to-end learning of precise manipulation tasks that are 3D in nature. Our method learns to accomplish these tasks using multiple statically placed but uncalibrated RGB camera views without building an explicit 3D representation such as a pointcloud or voxel grid. This multi-camera approach achieves superior task performance on difficult stacking and insertion tasks compared to single-view baselines. Single view robotic agents struggle from occlusion and challenges in estimating relative poses between points of interest. While full 3D scene representations (voxels or pointclouds) are obtainable from registered output of multiple depth sensors, several challenges complicate operating off such explicit 3D representations. These challenges include imperfect camera calibration, poor depth maps due to object properties such as reflective surfaces, and slower inference speeds over 3D representations compared to 2D images. Our use of static but uncalibrated cameras does not require camera-robot or camera-camera calibration making the proposed approach easy to setup and our use of \textit{sensor dropout} during training makes it resilient to the loss of camera-views after deployment.


title: Asymptotic Linearity of Consumption Functions and Computational Efficiency

abstract: We prove that the consumption functions in optimal savings problems are asymptotically linear if the marginal utility is regularly varying. We also analytically characterize the asymptotic marginal propensities to consume (MPCs) out of wealth. Our results are useful for obtaining good initial guesses when numerically computing consumption functions, and provide a theoretical justification for linearly extrapolating consumption functions outside the grid.


title: Adversarial Impacts on Autonomous Decentralized Lightweight Swarms

abstract: The decreased size and cost of Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) has enabled the use of swarms of unmanned autonomous vehicles to accomplish a variety of tasks. By utilizing swarming behaviors, it is possible to efficiently accomplish coordinated tasks while minimizing per-drone computational requirements. Some drones rely on decentralized protocols that exhibit emergent behavior across the swarm. While fully decentralized algorithms remove obvious attack vectors their susceptibility to external influence is less understood. This work investigates the influences that can compromise the functionality of an autonomous swarm leading to hazardous situations and cascading vulnerabilities. When a swarm is tasked with missions involving the safety or health of humans, external influences could have serious consequences. The adversarial swarm in this work utilizes an attack vector embedded within the decentralized movement algorithm of a previously defined autonomous swarm designed to create a perimeter sentry swarm. Various simulations confirm the adversarial swarm's ability to capture significant portions (6-23%) of the perimeter.


title: MITNS: Multiple-Ion Transport Numerical Solver for Magnetized Plasmas

abstract: MITNS (Multiple-Ion Transport Numerical Solver) is a new numerical tool designed to perform 1D simulations of classical cross-field transport in magnetized plasmas. Its detailed treatment of multi-species effects makes it a unique tool in the field. We describe the physical model it simulates, as well as its numerical implementation and performance.


title: Ergodicities and exponential ergodicities of Dawson-Watanabe type processes

abstract: Under natural assumptions, we prove the ergodicities and exponential ergodicities in Wasserstein and total variation distances of Dawson--Watanabe superprocesses without or with immigration. The strong Feller property in the total variation distance is derived as a by-product. The key of the approach is a set of estimates for the variations of the transition probabilities. The estimates in Wasserstein distance are derived from an upper bound of the kernels induced by the first moment of the superprocess. Those in total variation distance are based on a comparison of the cumulant semigroup of the superprocess with that of a continuous-state branching process. The results improve and extend considerably those of Stannat (2003a, 2003b) and Friesen (2019+). We also show a connection between the ergodicities of the associated immigration superprocesses and decomposable distributions.


title: Deep Sigma Point Processes

abstract: We introduce Deep Sigma Point Processes, a class of parametric models inspired by the compositional structure of Deep Gaussian Processes (DGPs). Deep Sigma Point Processes (DSPPs) retain many of the attractive features of (variational) DGPs, including mini-batch training and predictive uncertainty that is controlled by kernel basis functions. Importantly, since DSPPs admit a simple maximum likelihood inference procedure, the resulting predictive distributions are not degraded by any posterior approximations. In an extensive empirical comparison on univariate and multivariate regression tasks we find that the resulting predictive distributions are significantly better calibrated than those obtained with other probabilistic methods for scalable regression, including variational DGPs--often by as much as a nat per datapoint.


title: Construction of continuous-state branching processes in varying environments

abstract: A continuous-state branching process in varying environments is constructed by the pathwise unique solution to a stochastic integral equation driven by time-space noises. The process arises naturally in the limit theorem of Galton--Watson processes in varying environments established by Bansaye and Simatos (2015). In terms of the stochastic equation we clarify the behavior of the continuous-state process at its bottlenecks, which are the times when it arrives at zero almost surely by negative jumps.


title: Continuity of solutions for the phi-Laplacian operator

abstract: In this paper we give sufficient conditions to obtain continuity results of solutions for the so called {\em $\phi-$Laplacian} $\Delta_\phi$ with respect to domain perturbations. We point out that this kind of results can be extended to a more general class of operators including, for instance, nonlocal nonstandard growth type operators.


title: Symbolic Execution Game Semantics

abstract: We present a framework for symbolically executing and model checking higher-order programs with external (open) methods. We focus on the client-library paradigm and in particular we aim to check libraries with respect to any definable client. We combine traditional symbolic execution techniques with operational game semantics to build a symbolic execution semantics that captures arbitrary external behaviour. We prove the symbolic semantics to be sound and complete. This yields a bounded technique by imposing bounds on the depth of recursion and callbacks. We provide an implementation of our technique in the K framework and showcase its performance on a custom benchmark based on higher-order coding errors such as reentrancy bugs.