title: Bridging between the integrated and resolved main sequence of star formation

abstract: The position of galaxies on the stellar mass, star formation rate plane with respect to the star-forming main sequence at each redshift is a convenient way to infer where the galaxy is in its evolution compared to the rest of the population. We use Hubble Space Telescope high resolution images in the GOODS-S field from the CANDELS survey and fit multi wavelength lights in resolution elements of galaxies with stellar population synthesis models. We then construct resolved kpc-scale stellar mass, star formation rate surface density curves for galaxies at z~1. Fitting these resolved main sequence curves with Schechter functions, we parameterize and explain the multi-wavelength structure of galaxies with three variables: phi*, alpha, and M*. For quenched galaxies below the main sequence, we find an average high mass slope (alpha) of the resolved main sequence curves to be ~ -0.4. The scatter of this slope is higher among the lower mass star forming galaxies and those above the main sequence compared to quenched galaxies, due to lack of an evolved bulge. Our findings agree well with an inside-out quenching of star-formation. We find that the knee of the Schechter fits (M*) for galaxies below the main sequence occurs at lower stellar mass surface densities compared to star forming galaxies, which hints at how far quenching has proceeded outwards.


title: Asymptotic Guarantees for Generative Modeling Based on the Smooth Wasserstein Distance

abstract: Minimum distance estimation (MDE) gained recent attention as a formulation of (implicit) generative modeling. It considers minimizing, over model parameters, a statistical distance between the empirical data distribution and the model. This formulation lends itself well to theoretical analysis, but typical results are hindered by the curse of dimensionality. To overcome this and devise a scalable finite-sample statistical MDE theory, we adopt the framework of smooth 1-Wasserstein distance (SWD) $\mathsf{W}_1^{(\sigma)}$. The SWD was recently shown to preserve the metric and topological structure of classic Wasserstein distances, while enjoying dimension-free empirical convergence rates. In this work, we conduct a thorough statistical study of the minimum smooth Wasserstein estimators (MSWEs), first proving the estimator's measurability and asymptotic consistency. We then characterize the limit distribution of the optimal model parameters and their associated minimal SWD. These results imply an $O(n^{-1/2})$ generalization bound for generative modeling based on MSWE, which holds in arbitrary dimension. Our main technical tool is a novel high-dimensional limit distribution result for empirical $\mathsf{W}_1^{(\sigma)}$. The characterization of a nondegenerate limit stands in sharp contrast with the classic empirical 1-Wasserstein distance, for which a similar result is known only in the one-dimensional case. The validity of our theory is supported by empirical results, posing the SWD as a potent tool for learning and inference in high dimensions.


title: Limit Distribution for Smooth Total Variation and $\chi^2$-Divergence in High Dimensions

abstract: Statistical divergences are ubiquitous in machine learning as tools for measuring discrepancy between probability distributions. As these applications inherently rely on approximating distributions from samples, we consider empirical approximation under two popular $f$-divergences: the total variation (TV) distance and the $\chi^2$-divergence. To circumvent the sensitivity of these divergences to support mismatch, the framework of Gaussian smoothing is adopted. We study the limit distributions of $\sqrt{n}\delta_{\mathsf{TV}}(P_n\ast\mathcal{N},P\ast\mathcal{N})$ and $n\chi^2(P_n\ast\mathcal{N}\|P\ast\mathcal{N})$, where $P_n$ is the empirical measure based on $n$ independently and identically distributed (i.i.d.) observations from $P$, $\mathcal{N}_\sigma:=\mathcal{N}(0,\sigma^2\mathrm{I}_d)$, and $\ast$ stands for convolution. In arbitrary dimension, the limit distributions are characterized in terms of Gaussian process on $\mathbb{R}^d$ with covariance operator that depends on $P$ and the isotropic Gaussian density of parameter $\sigma$. This, in turn, implies optimality of the $n^{-1/2}$ expected value convergence rates recently derived for $\delta_{\mathsf{TV}}(P_n\ast\mathcal{N},P\ast\mathcal{N})$ and $\chi^2(P_n\ast\mathcal{N}\|P\ast\mathcal{N})$. These strong statistical guarantees promote empirical approximation under Gaussian smoothing as a potent framework for learning and inference based on high-dimensional data.


title: Four Principles of Explainable AI as Applied to Biometrics and Facial Forensic Algorithms

abstract: Traditionally, researchers in automatic face recognition and biometric technologies have focused on developing accurate algorithms. With this technology being integrated into operational systems, engineers and scientists are being asked, do these systems meet societal norms? The origin of this line of inquiry is `trust' of artificial intelligence (AI) systems. In this paper, we concentrate on adapting explainable AI to face recognition and biometrics, and we present four principles of explainable AI to face recognition and biometrics. The principles are illustrated by $\it{four}$ case studies, which show the challenges and issues in developing algorithms that can produce explanations.


title: Stripped-envelope core-collapse supernova $^{56}$Ni masses: Persistently larger values than supernovae type II

abstract: The mass of synthesised radioactive material is an important power source for all supernova (SN) types. Anderson 2019 recently compiled literature values and obtained $^{56}$Ni distributions for different core-collapse supernovae (CC-SNe), showing that the $^{56}$Ni distribution of stripped envelope CC-SNe (SE-SNe: types IIb, Ib, and Ic) is highly incompatible with that of hydrogen rich type II SNe (SNe-II). This motivates questions on differences in progenitors, explosion mechanisms, and $^{56}$Ni estimation methods. Here, we re-estimate the nucleosynthetic yields of $^{56}$Ni for a well-observed and well-defined sample of SE-SNe in a uniform manner. This allows us to investigate whether the observed SN-II--SE-SN $^{56}$Ni separation is due to real differences between these SN types, or because of systematic errors in the estimation methods. We compiled a sample of well observed SE-SNe and measured $^{56}$Ni masses through three different methods proposed in the literature. Arnett's rule -as previously shown - gives $^{56}$Ni masses for SE-SNe that are considerably higher than SNe-II. While for the distributions calculated using both the Khatami&Kasen prescription and Tail $^{56}$Ni masses are offset to lower values than `Arnett values', their $^{56}$Ni distributions are still statistically higher than that of SNe II. Our results are strongly driven by a lack of SE-SN with low $^{56}$Ni masses (that are in addition strictly lower limits). The lowest SE-SN $^{56}$Ni mass in our sample is of 0.015M$_\odot$, below which are more than 25$\%$ of SNe II. We conclude that there exists real, intrinsic differences in the mass of synthesised radioactive material between SNe II and SE-SNe . Any proposed current or future CCSN progenitor scenario and explosion mechanism must be able to explain why and how such differences arise, or outline a yet to be fully explored bias in current SN samples.


title: Equational theories of endomorphism monoids of categories with a topological flavor

abstract: It is shown that the endomorphism monoids of the category $2\mathfrak{Cob}$ of all $2$-cobordisms do not have finitely axiomatizable equational theories. The same holds for the {topological annular category} and various quotients of the latter, like the affine Temperley--Lieb category. Analogous results are obtained for versions with the algebraic signature enriched by involutions. Von-Neumann-regular extensions of these categories are also considered.


title: From eventually different functions to pandemic numberings

abstract: A function is strongly non-recursive (SNR) if it is eventually different from each recursive function. We obtain hierarchy results for the mass problems associated with computing such functions with varying growth bounds. In particular, there is no least and no greatest Muchnik degree among those of the form SNR$_f$ consisting of SNR functions bounded by varying recursive bounds $f$. We show that the connection between SNR functions and canonically immune sets is, in a sense, as strong as that between DNR (diagonally non-recursive) functions and effectively immune sets. Finally, we introduce pandemic numberings, a set-theoretic dual to immunity.


title: Dissecting the statistical properties of the Linear Extrapolation Method of determining protein stability

abstract: When protein stability is measured by denaturant induced unfolding the linear extrapolation method is usually used to analyse the data. This method is based on the observation that the change in Gibbs free energy associated with unfolding, $\Delta_rG$, is often found to be a linear function of the denaturant concentration, $D$. The free energy change of unfolding in the absence of denaturant, $\Delta_rG_0$, is estimated by extrapolation from this linear relationship. Data analysis is generally done by nonlinear least-squares regression to obtain estimates of the parameters as well as confidence intervals. We have compared different methods for calculating confidence intervals of the parameters and found that a simple method based on linear theory gives as good, if not better, results than more advanced methods. We have also compared three different parameterizations of the linear extrapolation method and show that one of the forms, $\Delta_rG(D) = \Delta_rG_0 - mD$, is problematic since the value of $\Delta_rG_0$ and that of the $m$-value are correlated in the nonlinear least-squares analysis. Parameter correlation can in some cases cause problems in the estimation of confidence-intervals and -regions and should be avoided when possible. Two alternative parameterizations, $\Delta_rG(D) = -m(D-D_{50})$ and $\Delta_rG(D) = \Delta_rG_0(1-D/D_{50})$, where $D_{50}$ is the midpoint of the transition region show much less correlation between parameters.


title: Approximately Optimal Spatial Design: How Good is it?

abstract: The increasing recognition of the association between adverse human health conditions and many environmental substances as well as processes has led to the need to monitor them. An important problem that arises in environmental statistics is the design of the locations of the monitoring stations for those environmental processes of interest. One particular design criterion for monitoring networks that tries to reduce the uncertainty about predictions of unseen processes is called the maximum-entropy design. However, this design criterion involves a hard optimization problem that is computationally intractable for large data sets. Previous work of Wang et al. (2017) examined a probabilistic model that can be implemented efficiently to approximate the underlying optimization problem. In this paper, we attempt to establish statistically sound tools for assessing the quality of the approximations.


title: Bending Loss Regularized Network for Nuclei Segmentation in Histopathology Images

abstract: Separating overlapped nuclei is a major challenge in histopathology image analysis. Recently published approaches have achieved promising overall performance on public datasets; however, their performance in segmenting overlapped nuclei are limited. To address the issue, we propose the bending loss regularized network for nuclei segmentation. The proposed bending loss defines high penalties to contour points with large curvatures, and applies small penalties to contour points with small curvature. Minimizing the bending loss can avoid generating contours that encompass multiple nuclei. The proposed approach is validated on the MoNuSeg dataset using five quantitative metrics. It outperforms six state-of-the-art approaches on the following metrics: Aggregate Jaccard Index, Dice, Recognition Quality, and Pan-optic Quality.


title: A Word to the WISE: Confusion is Unavoidable for WISE-selected Infrared Excesses

abstract: Stars with excess infrared radiation from circumstellar dust are invaluable for studies of exoplanetary systems, informing our understanding on processes of planet formation and destruction alike. All-sky photometric surveys have made the identification of dusty infrared excess candidates trivial, however, samples that rely on data from WISE are plagued with source confusion, leading to high false positive rates. Techniques to limit its contribution to WISE-selected samples have been developed, and their effectiveness is even more important as we near the end-of-life of Spitzer, the only facility capable of confirming the excess. Here, we present a Spitzer follow-up of a sample of 22 WISE-selected infrared excess candidates near the faint-end of the WISE detection limits. Eight of the 22 excesses are deemed the result of source confusion, with the remaining candidates all confirmed by the Spitzer data. We consider the efficacy of ground-based near-infrared imaging and astrometric filtering of samples to limit confusion among the sample. We find that both techniques are worthwhile for vetting candidates, but fail to identify all of the confused excesses, indicating that they cannot be used to confirm WISE-selected infrared excess candidates, but only to rule them out. This result confirms the expectation that WISE-selected infrared excess samples will always suffer from appreciable levels of contamination, and that care should be taken in their interpretation regardless of the filters applied.


title: Proportional integral derivative controller assisted reinforcement learning for path following by autonomous underwater vehicles

abstract: Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the physical system. However, if a system is highly complex, it might be infeasible to produce a reliable mathematical model of the system. Without a model most of the theoretical tools to develop control laws break down. In these settings, machine learning controllers become attractive: Controllers that can learn and adapt to complex systems, developing control laws where the engineer cannot. This article focuses on utilizing machine learning controllers in practical applications, specifically using deep reinforcement learning in motion control systems for an autonomous underwater vehicle with six degrees-of-freedom. Two methods are considered: end-to-end learning, where the vehicle is left entirely alone to explore the solution space in its search for an optimal policy, and PID assisted learning, where the DRL controller is essentially split into three separate parts, each controlling its own actuator.


title: Willems' Fundamental Lemma for State-space Systems and its Extension to Multiple Datasets

abstract: Willems et al.'s fundamental lemma asserts that all trajectories of a linear system can be obtained from a single given one, assuming that a persistency of excitation condition holds. This result has profound implications for system identification and data-driven control, and has seen a revival over the last few years. The purpose of this paper is to extend Willems' lemma to the situation where multiple (possibly short) system trajectories are given instead of a single long one. To this end, we introduce a notion of collective persistency of excitation. We will then show that all trajectories of a linear system can be obtained from a given finite number of trajectories, as long as these are collectively persistently exciting. We will demonstrate that this result enables the identification of linear systems from data sets with missing data samples. Additionally, we show that the result is of practical significance in data-driven control of unstable systems.


title: Congruent number triangles with the same hypotenuse

abstract: In this article, we discuss whether a single congruent number $t$ can have two (or more) distinct triangles with the same hypotenuse. We also describe and carry out computational experimentation providing evidence that this does not occur.


title: A Survey on Human Machine Interaction in Industry 4.0

abstract: Industry 4.0 or Industrial IoT both describe new paradigms for seamless interaction between humans and machines. Both concepts rely on intelligent, inter-connected cyber-physical production systems that are able to control the process flow of industrial production. As those machines take many decisions autonomously and further interact with production and manufacturing planning systems, the integration of human users requires new paradigms. In this paper, we provide an analysis of the current state-of-the-art in human-machine interaction in the Industry 4.0 domain.We focus on new paradigms that integrate the application of augmented and virtual reality technology. Based on our analysis, we further provide a discussion of research challenges.


title: Weights of Exponential Growth and Decay for Schr\"{o}dinger-type operators

abstract: Fix $d \geq 3$ and $1 < p < \infty$. Let $V : \mathbb{R}^{d} \rightarrow [0,\infty)$ belong to the reverse H\"{o}lder class $RH_{d/2}$ and consider the Schr\"{o}dinger operator $L_{V} := - \Delta + V$. In this article, we introduce classes of weights $w$ for which the Riesz transforms $\nabla L_{V}^{-1/2}$, their adjoints $L_{V}^{-1/2} \nabla$ and the heat maximal operator $\sup_{t > 0} e^{- t L_{V}} |f|$ are bounded on the weighted Lebesgue space $L^{p}(w)$. The boundedness of the $L_{V}$-Riesz potentials $L_{V}^{-\alpha/2}$ from $L^{p}(w)$ to $L^{\nu}(w^{\nu/p})$ for $0 < \alpha \leq 2$ and $\frac{1}{\nu} = \frac{1}{p} - \frac{\alpha}{d}$ will also be proved. These weight classes are strictly larger than a class previously introduced by B. Bongioanni, E. Harboure and O. Salinas that shares these properties and they contain weights of exponential growth and decay. The classes will also be considered in relation to different generalised forms of Schr\"{o}dinger operator. In particular, the Schr\"{o}dinger operator with measure potential $- \Delta + \mu$, the uniformly elliptic operator with potential $- \mathrm{div} A \nabla + V$ and the magnetic Schr\"{o}dinger operator $(\nabla - i a)^{2} + V$ will all be considered. It will be proved that, under suitable conditions, the standard operators corresponding to these second-order differential operators are bounded on $L^{p}(w)$ for weights $w$ in these classes.


title: On the Uniqueness of Functions that Maximize the Crouzeix Ratio

abstract: Let $A$ be an $n$ by $n$ matrix with numerical range $W(A) := \{ q^{*}Aq : q \in \mathbb{C}^n , ~\| q \|_2 = 1 \}$. We are interested in functions $\hat{f}$ that maximize $\| f(A) \|_2$ (the matrix norm induced by the vector 2-norm) over all functions $f$ that are analytic in the interior of $W(A)$ and continuous on the boundary and satisfy $\max_{z \in W(A)} | f(z) | \leq 1$. It is known that there are functions $\hat{f}$ that achieve this maximum and that such functions are of the form $B\circ\phi$, where $\phi$ is any conformal mapping from the interior of $W(A)$ to the unit disk $\mathbb{D}$, extended to be continuous on the boundary of $W(A)$, and $B$ is a Blaschke product of degree at most $n-1$. It is not known if a function $\hat{f}$ that achieves this maximum is unique, up to multiplication by a scalar of modulus one. We show that this is the case when $A$ is a $2\times 2$ nonnormal matrix or a Jordan block, but we give examples of some $3\times 3$ matrices with elliptic numerical range for which two different functions $\hat{f}$, involving the same conformal mapping but Blaschke products of different degrees, achieve the same maximal value of $||f(A)||_2$.


title: Asymptotically flat, parameterized black hole metric preserving Kerr symmetries

abstract: Recently the Event Horizon Telescope Collaboration, with very-long baseline interferometric observations, resolved structure at the scale of $\sim5$ Schwarzschild radii about the center of M87$^*$, the supermassive black hole resident at the center of Messier 87. This important observation has paved the way for testing what is known as the "no-hair" theorem, stating that isolated black holes are described by the Kerr metric, parameterized only by their mass and spin. Generic, parameterized spacetimes beyond Kerr allow one to arbitrarily test the no-hair theorem for deviations from the Kerr result with no prior theoretical knowledge or motivation. In this paper, we present such a new general, stationary, axisymmetric and asymptotically flat black hole solution with separable geodesic equations (thus preserving symmetries of a Kerr black hole), extending the previous work of Johannsen. In this new metric, five free non-linear functions parameterically deviate from the Kerr result, allowing one to effectively transform to many alternative black hole solutions present in the literature. We then derive analytic expressions for the Keplerian and epicyclic frequencies, the orbital energy and angular momentum, and the location of the innermost stable orbit of circular equatorial particle orbits. We also compute the image of the photon rings in the new spacetime, which correspond to the boundary of the black hole shadow image taken by the Event Horizon Telescope. We finally compare each quantity for the Kerr result against various parameterizations of the metric, finding that, especially for highly rotating black holes, the two solutions disagree significantly. Such a metric parameterization allows one to perform the no-hair tests in a model-independent way, and finally map constraints to specific alternative theories of gravity.


title: PDE-NetGen 1.0: from symbolic PDE representations of physical processes to trainable neural network representations

abstract: Bridging physics and deep learning is a topical challenge. While deep learning frameworks open avenues in physical science, the design of physically-consistent deep neural network architectures is an open issue. In the spirit of physics-informed NNs, PDE-NetGen package provides new means to automatically translate physical equations, given as PDEs, into neural network architectures. PDE-NetGen combines symbolic calculus and a neural network generator. The later exploits NN-based implementations of PDE solvers using Keras. With some knowledge of a problem, PDE-NetGen is a plug-and-play tool to generate physics-informed NN architectures. They provide computationally-efficient yet compact representations to address a variety of issues, including among others adjoint derivation, model calibration, forecasting, data assimilation as well as uncertainty quantification. As an illustration, the workflow is first presented for the 2D diffusion equation, then applied to the data-driven and physics-informed identification of uncertainty dynamics for the Burgers equation.


title: Detecting Fake News with Capsule Neural Networks

abstract: Fake news is dramatically increased in social media in recent years. This has prompted the need for effective fake news detection algorithms. Capsule neural networks have been successful in computer vision and are receiving attention for use in Natural Language Processing (NLP). This paper aims to use capsule neural networks in the fake news detection task. We use different embedding models for news items of different lengths. Static word embedding is used for short news items, whereas non-static word embeddings that allow incremental up-training and updating in the training phase are used for medium length or large news statements. Moreover, we apply different levels of n-grams for feature extraction. Our proposed architectures are evaluated on two recent well-known datasets in the field, namely ISOT and LIAR. The results show encouraging performance, outperforming the state-of-the-art methods by 7.8% on ISOT and 3.1% on the validation set, and 1% on the test set of the LIAR dataset.


title: SuperDTI: Ultrafast diffusion tensor imaging and fiber tractography with deep learning

abstract: Purpose: To propose a deep learning-based reconstruction framework for ultrafast and robust diffusion tensor imaging and fiber tractography. Methods: We propose SuperDTI to learn the nonlinear relationship between diffusion-weighted images (DWIs) and the corresponding tensor-derived quantitative maps as well as the fiber tractography. Super DTI bypasses the tensor fitting procedure, which is well known to be highly susceptible to noise and motion in DWIs. The network is trained and tested using datasets from Human Connectome Project and patients with ischemic stroke. SuperDTI is compared against the state-of-the-art methods for diffusion map reconstruction and fiber tracking. Results: Using training and testing data both from the same protocol and scanner, SuperDTI is shown to generate fractional anisotropy and mean diffusivity maps, as well as fiber tractography, from as few as six raw DWIs. The method achieves a quantification error of less than 5% in all regions of interest in white matter and gray matter structures. We also demonstrate that the trained neural network is robust to noise and motion in the testing data, and the network trained using healthy volunteer data can be directly applied to stroke patient data without compromising the lesion detectability. Conclusion: This paper demonstrates the feasibility of superfast diffusion tensor imaging and fiber tractography using deep learning with as few as six DWIs directly, bypassing tensor fitting. Such a significant reduction in scan time may allow the inclusion of DTI into the clinical routine for many potential applications.


title: Heuristic Chaotic Hurricane-aided Efficient Power Assignment for Elastic Optical Networks

abstract: In this paper we propose a dynamical transmission power allocation for elastic optical networks (EONs) based on the evolutionary hurricane search optimization (HSO) algorithm with a chaotic logistic map diversification strategy with the purpose of improving the capability to escape from local optima, namely CHSO. The aiming is the dynamical control of the transmitted optical powers according to the each link state variations due to traffic fluctuations, channel impairments, as well as other channel-power coupling effects. Such realistic EON scenarios are affected mainly by the channel estimation inaccuracy, channel ageing and power fluctuations. The link state is based on the channel estimation and quality of transmission (QoT) parameters obtained from the optical performance monitors (OPMs). Numerical results have demonstrated the effectiveness of the CHSO to dynamically mitigate the power penalty under real measurements conditions with uncertainties and noise, as well as when perturbations in the optical transmit powers are considered.


title: A Second Look at 12 Candidate Dual AGNs using ${\tt BAYMAX}$

abstract: We present an analysis of 12 optically selected dual AGN candidates at $z < 0.34$. Each candidate was originally identified via double-peaked [O III] $\lambda$5007 emission lines, and have received follow-up $Chandra$ and $HST$ observations. Because the X-ray data are low-count ($<100$ counts) with small separations ($<1$"), a robust analysis is necessary for classifying each source. Pairing long-slit [O III] observations with existing $Chandra$ observations, we re-analyze the X-ray observations with ${\tt BAYMAX}$ to determine whether the X-ray emission from each system is more likely a single or dual point source. We find that 4 of the 12 sources are likely dual X-ray point source systems. We examine each point source's spectra via a Monte Carlo method that probabilistically identifies the likely origin of each photon. When doing so, we find that (i) the secondary X-ray point sources in 2 of the systems have $L_{\mathrm{X}}<10^{40}$ erg s$^{-1}$, such that we cannot rule out a non-AGN origin, (ii) one source has a secondary with $L_{\mathrm{X}}>10^{40}$ erg s$^{-1}$ but a spectrum that is too soft to definitively preclude being X-ray emitting diffuse gas that was photoionized by the primary AGN, and (iii) one system (SDSS J1126+2944) is a dual AGN. Additionally, using complementary $HST$ observations, we analyze a sub-sample of systems that are visually identified as merging. Our results suggest that dual AGNs may preferentially reside in mergers with small separations, consistent with both simulations and observations.


title: Stan: Small tumor-aware network for breast ultrasound image segmentation

abstract: Breast tumor segmentation provides accurate tumor boundary, and serves as a key step toward further cancer quantification. Although deep learning-based approaches have been proposed and achieved promising results, existing approaches have difficulty in detecting small breast tumors. The capacity to detecting small tumors is particularly important in finding early stage cancers using computer-aided diagnosis (CAD) systems. In this paper, we propose a novel deep learning architecture called Small Tumor-Aware Network (STAN), to improve the performance of segmenting tumors with different size. The new architecture integrates both rich context information and high-resolution image features. We validate the proposed approach using seven quantitative metrics on two public breast ultrasound datasets. The proposed approach outperformed the state-of-the-art approaches in segmenting small breast tumors. Index


title: The Four Pillars of Research Software Engineering

abstract: Building software that can support the huge growth in data and computation required by modern research needs individuals with increasingly specialist skill sets that take time to develop and maintain. The Research Software Engineering movement, which started in the UK and has been built up over recent years, aims to recognise and support these individuals. Why does research software matter to professional software development practitioners outside the research community? Research software can have great impact on the wider world and recent progress means the area can now be considered as a more realistic option for a professional software development career. In this article we present a structure, along with supporting evidence of real-world activities, that defines four elements that we believe are key to providing comprehensive and sustainable support for Research Software Engineering. We also highlight ways that the wider developer community can learn from, and engage with, these activities.


title: Efficient 2D neuron boundary segmentation with local topological constraints

abstract: We present a method for segmenting neuron membranes in 2D electron microscopy imagery. This segmentation task has been a bottleneck to reconstruction efforts of the brain's synaptic circuits. One common problem is the misclassification of blurry membrane fragments as cell interior, which leads to merging of two adjacent neuron sections into one via the blurry membrane region. Human annotators can easily avoid such errors by implicitly performing gap completion, taking into account the continuity of membranes. Drawing inspiration from these human strategies, we formulate the segmentation task as an edge labeling problem on a graph with local topological constraints. We derive an integer linear program (ILP) that enforces membrane continuity, i.e. the absence of gaps. The cost function of the ILP is the pixel-wise deviation of the segmentation from a priori membrane probabilities derived from the data. Based on membrane probability maps obtained using random forest classifiers and convolutional neural networks, our method improves the neuron boundary segmentation accuracy compared to a variety of standard segmentation approaches. Our method successfully performs gap completion and leads to fewer topological errors. The method could potentially also be incorporated into other image segmentation pipelines with known topological constraints.


title: On lax transformations, adjunctions, and monads in $(\infty,2)$-categories

abstract: We use the basic expected properties of the Gray tensor product of $(\infty,2)$-categories to study (co)lax natural transformations. Using results of Riehl-Verity and Zaganidis we identify lax transformations between adjunctions and monads with commutative squares of (monadic) right adjoints. We also identify the colax transformations whose components are equivalences (generalizing the "icons" of Lack) with the 2-morphisms that arise from viewing $(\infty,2)$-categories as simplicial $\infty$-categories. Using this characterization we identify the $\infty$-category of monads on a fixed object and colax morphisms between them with the $\infty$-category of associative algebras in endomorphisms.


title: Gated Graph Recurrent Neural Networks

abstract: Graph processes exhibit a temporal structure determined by the sequence index and and a spatial structure determined by the graph support. To learn from graph processes, an information processing architecture must then be able to exploit both underlying structures. We introduce Graph Recurrent Neural Networks (GRNNs) as a general learning framework that achieves this goal by leveraging the notion of a recurrent hidden state together with graph signal processing (GSP). In the GRNN, the number of learnable parameters is independent of the length of the sequence and of the size of the graph, guaranteeing scalability. We prove that GRNNs are permutation equivariant and that they are stable to perturbations of the underlying graph support. To address the problem of vanishing gradients, we also put forward gated GRNNs with three different gating mechanisms: time, node and edge gates. In numerical experiments involving both synthetic and real datasets, time-gated GRNNs are shown to improve upon GRNNs in problems with long term dependencies, while node and edge gates help encode long range dependencies present in the graph. The numerical results also show that GRNNs outperform GNNs and RNNs, highlighting the importance of taking both the temporal and graph structures of a graph process into account.


title: Misiurewicz polynomials for rational maps with nontrivial automorphisms

abstract: In this paper, we consider a one-parameter family of degree $d\ge 2$ rational maps with an automorphism group containing the cyclic group of order $d$. We construct a polynomial whose roots correspond to parameter values for which the corresponding map is post-critically finite with a certain dynamical portrait. Then we prove that the polynomial is irreducible in certain cases.


title: Scale mixture of skew-normal linear mixed models with within-subject serial dependence

abstract: In longitudinal studies, repeated measures are collected over time and hence they tend to be serially correlated. In this paper we consider an extension of skew-normal/independent linear mixed models introduced by Lachos et al. (2010), where the error term has a dependence structure, such as damped exponential correlation or autoregressive correlation of order p. The proposed model provides flexibility in capturing the effects of skewness and heavy tails simultaneously when continuous repeated measures are serially correlated. For this robust model, we present an efficient EM-type algorithm for computation of maximum likelihood estimation of parameters and the observed information matrix is derived analytically to account for standard errors. The methodology is illustrated through an application to schizophrenia data and several simulation studies. The proposed algorithm and methods are implemented in the new R package skewlmm.


title: Beyond the Standard Model, guided by Lepton Universality

abstract: We discuss the current status of lepton flavour universality observables in semileptonic charged and neutral current $B$ meson decays. We recapitulate the current experimental situation. Assuming the current tensions with the SM are of beyond the Standard Model origin we present their implications for the effective theory couplings. Then we discuss general leptoquark models before finally focussing on the model with two scalar leptoquarks ($R_2$ and $S_3$) which have couplings connected by the underlying Grand Unified Theory framework. We present the viability of the model with regard to lepton flavour universality and present opportunities to search for this model in future high-intensity and high-energy experiments


title: Theory of Spin-Dependent Electron Transfer Dynamics at Ar/Co(0001) and Ar/Fe(110) Interfaces

abstract: Recent core-hole-clock experiments [Phys. Rev. Lett. $\textbf{112}$, 086801 (2014)] showed that the spin dependence of electron injection times at Ar/Co(0001) and Ar/Fe(110) interfaces is at variance with the expectations based on previous calculations for related systems. Here we reconcile theory and experiment, and demonstrate that the observed dependence is rooted in the details of the spin-split surface band structures. Our ab initio calculations back that minority electrons are injected significantly faster than majority electrons in line with the experimentally reported ultrashort injection times. The dynamics is particularly sensitive to the size (in reciprocal-space) of the projected band gaps around $\overline{\Gamma}$ for both substrates at the resonance energies. A simple tunneling model incorporating the spin-dependent gap sizes further supports these findings.


title: Differentially Private k-Means Clustering with Guaranteed Convergence

abstract: Iterative clustering algorithms help us to learn the insights behind the data. Unfortunately, this may allow adversaries to infer the privacy of individuals with some background knowledge. In the worst case, the adversaries know the centroids of an arbitrary iteration and the information of n-1 out of n items. To protect individual privacy against such an inference attack, preserving differential privacy (DP) for the iterative clustering algorithms has been extensively studied in the interactive settings. However, existing interactive differentially private clustering algorithms suffer from a non-convergence problem, i.e., these algorithms may not terminate without a predefined number of iterations. This problem severely impacts the clustering quality and the efficiency of a differentially private algorithm. To resolve this problem, in this paper, we propose a novel differentially private clustering framework in the interactive settings which controls the orientation of the movement of the centroids over the iterations to ensure the convergence by injecting DP noise in a selected area. We prove that, in the expected case, algorithm under our framework converges in at most twice the iterations of Lloyd's algorithm. We perform experimental evaluations on real-world datasets to show that our algorithm outperforms the state-of-the-art of the interactive differentially private clustering algorithms with guaranteed convergence and better clustering quality to meet the same DP requirement.


title: Optimal Confidence Regions for the Multinomial Parameter

abstract: Construction of tight confidence regions and intervals is central to statistical inference and decision making. This paper develops new theory showing minimum average volume confidence regions for categorical data. More precisely, consider an empirical distribution $\widehat{\boldsymbol{p}}$ generated from $n$ iid realizations of a random variable that takes one of $k$ possible values according to an unknown distribution $\boldsymbol{p}$. This is analogous to a single draw from a multinomial distribution. A confidence region is a subset of the probability simplex that depends on $\widehat{\boldsymbol{p}}$ and contains the unknown $\boldsymbol{p}$ with a specified confidence. This paper shows how one can construct minimum average volume confidence regions, answering a long standing question. We also show the optimality of the regions directly translates to optimal confidence intervals of linear functionals such as the mean, implying sample complexity and regret improvements for adaptive machine learning algorithms.

categories: stat.ML cs.IT cs.LG math.IT math.ST stat.TH


title: Careful synchronization of partial deterministic finite automata

abstract: We approach the task of computing a carefully synchronizing word of optimum length for a given partial deterministic automaton, encoding the problem as an instance of SAT and invoking a SAT solver. Our experiments demonstrate that this approach gives satisfactory results for automata with up to 100 states even if very modest computational resources are used. We compare our results with the ones obtained by the first author for exact synchronization, which is another version of synchronization studied in the literature, and draw some theoretical conclusions.


title: Limitations of Incentive Compatibility on Discrete Type Spaces

abstract: In the design of incentive compatible mechanisms, a common approach is to enforce incentive compatibility as constraints in programs that optimize over feasible mechanisms. Such constraints are often imposed on sparsified representations of the type spaces, such as their discretizations or samples, in order for the program to be manageable. In this work, we explore limitations of this approach, by studying whether all dominant strategy incentive compatible mechanisms on a set $T$ of discrete types can be extended to the convex hull of $T$. Dobzinski, Fu and Kleinberg (2015) answered the question affirmatively for all settings where types are single dimensional. It is not difficult to show that the same holds when the set of feasible outcomes is downward closed. In this work we show that the question has a negative answer for certain non-downward-closed settings with multi-dimensional types. This result should call for caution in the use of the said approach to enforcing incentive compatibility beyond single-dimensional preferences and downward closed feasible outcomes.


title: Data Market Platforms: Trading Data Assets to Solve Data Problems

abstract: Data only generates value for a few organizations with expertise and resources to make data shareable, discoverable, and easy to integrate. Sharing data that is easy to discover and integrate is hard because data owners lack information (who needs what data) and they do not have incentives to prepare the data in a way that is easy to consume by others. In this paper, we propose data market platforms to address the lack of information and incentives and tackle the problems of data sharing, discovery, and integration. In a data market platform, data owners want to share data because they will be rewarded if they do so. Consumers are encouraged to share their data needs because the market will solve the discovery and integration problem for them in exchange for some form of currency. We consider internal markets that operate within organizations to bring down data silos, as well as external markets that operate across organizations to increase the value of data for everybody. We outline a research agenda that revolves around two problems. The problem of market design, or how to design rules that lead to the outcomes we want, and the systems problem, how to implement the market and enforce the rules. Treating data as a first-class asset is sorely needed to extend the value of data to more organizations, and we propose data market platforms as one mechanism to achieve this goal.


title: Multi-Channel Attention Selection GANs for Guided Image-to-Image Translation

abstract: We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic guidance. The proposed SelectionGAN explicitly utilizes the semantic guidance information and consists of two stages. In the first stage, the input image and the conditional semantic guidance are fed into a cycled semantic-guided generation network to produce initial coarse results. In the second stage, we refine the initial results by using the proposed multi-scale spatial pooling & channel selection module and the multi-channel attention selection module. Moreover, uncertainty maps automatically learned from attention maps are used to guide the pixel loss for better network optimization. Exhaustive experiments on four challenging guided image-to-image translation tasks (face, hand, body, and street view) demonstrate that our SelectionGAN is able to generate significantly better results than the state-of-the-art methods. Meanwhile, the proposed framework and modules are unified solutions and can be applied to solve other generation tasks such as semantic image synthesis. The code is available at https://github.com/Ha0Tang/SelectionGAN.


title: Enhanced Ability of Information Gathering May Intensify Disagreement Among Groups

abstract: Today's society faces widening disagreement and conflicts among constituents with incompatible views. Escalated views and opinions are seen not only in radical ideology or extremism but also in many other scenes of our everyday life. Here we show that widening disagreement among groups may be linked to the advancement of information communication technology, by analyzing a mathematical model of population dynamics in a continuous opinion space. We adopted the interaction kernel approach to model enhancement of people's information gathering ability and introduced a generalized non-local gradient as individuals' perception kernel. We found that the characteristic distance between population peaks becomes greater as the wider range of opinions becomes available to individuals or the greater attention is attracted to opinions distant from theirs. These findings may provide a possible explanation for why disagreement is growing in today's increasingly interconnected society, without attributing its cause only to specific individuals or events.


title: Interference Analysis and Mitigation for Massive Access Aerial IoT Considering 3D Antenna Patterns

abstract: Due to dense deployments of Internet of things (IoT) networks, interference management becomes a critical challenge. With the proliferation of aerial IoT devices, such as unmanned aerial vehicles (UAVs), interference characteristics in 3D environments will be different than those in the existing terrestrial IoT networks. In this paper, we consider 3D topology IoT networks with a mixture of aerial and terrestrial links, with low-cost cross-dipole antennas at ground nodes and omni-directional antennas at aerial nodes. Considering a massive-access communication scenario, we first derive the statistics of the channel gain at IoT receivers in closed form while taking into account the radiation patterns of both ground and aerial nodes. These are then used to calculate the ergodic achievable rate as a function of the height of the aerial receiver. We propose an interference mitigation scheme that utilizes 3D antenna radiation pattern with different dipole antenna settings. Our results show that using the proposed scheme, the ergodic achievable rate improves as the height of aerial receivers increases. In addition, the ratio between the ground and aerial receivers that maximizes the peak rate also increases with the aerial IoT receiver height.


title: The higher-order phase transition in toroidal CDT

abstract: We investigate the transition between the phases $B$ and $C_b$ observed in four-dimensional Causal Dynamical Triangulations (CDT). We find that the critical properties of CDT with toroidal spatial topology are the same as earlier observed in spherical spatial topology where the $B-C_b$ transition was found to be higher-order. This may have important consequences for the existence of the continuum limit of CDT, describing the perspective UV limit of quantum gravity, which potentially can be investigated in the toroidal model.


title: Gibbs posterior inference on multivariate quantiles

abstract: Bayesian and other likelihood-based methods require specification of a statistical model and may not be fully satisfactory for inference on quantities, such as quantiles, that are not naturally defined as model parameters. In this paper, we construct a direct and model-free Gibbs posterior distribution for multivariate quantiles. Being model-free means that inferences drawn from the Gibbs posterior are not subject to model misspecification bias, and being direct means that no priors for or marginalization over nuisance parameters are required. We show here that the Gibbs posterior enjoys a root-$n$ convergence rate and a Bernstein--von Mises property, i.e., for large n, the Gibbs posterior distribution can be approximated by a Gaussian. Moreover, we present numerical results showing the validity and efficiency of credible sets derived from a suitably scaled Gibbs posterior.


title: Deep-URL: A Model-Aware Approach To Blind Deconvolution Based On Deep Unfolded Richardson-Lucy Network

abstract: The lack of interpretability in current deep learning models causes serious concerns as they are extensively used for various life-critical applications. Hence, it is of paramount importance to develop interpretable deep learning models. In this paper, we consider the problem of blind deconvolution and propose a novel model-aware deep architecture that allows for the recovery of both the blur kernel and the sharp image from the blurred image. In particular, we propose the Deep Unfolded Richardson-Lucy (Deep-URL) framework -- an interpretable deep-learning architecture that can be seen as an amalgamation of classical estimation technique and deep neural network, and consequently leads to improved performance. Our numerical investigations demonstrate significant improvement compared to state-of-the-art algorithms.


title: Is the PPG signal chaotic?

abstract: This paper shows how the dynamics of the PhotoPlethysmoGraphic (PPG) signal, an easily accessible biological signal from which valuable diagnostic information can be extracted, of young and healthy individuals performs at different timescales. On a small timescale, the dynamic behavior of the PPG signal is predominantly quasi-periodic. On a large timescale, a more complex dynamic diversity emerges, but never a chaotic behavior as earlier studies had reported. The procedure by which the dynamics of the PPG signal is determined consists of contrasting the dynamics of a PPG signal with well-known dynamics---named reference signals in this study---, mostly present in physical systems, such as periodic, quasi-periodic, aperiodic, chaotic or random dynamics. For this purpose, this paper provides two methods of analysis based on Deep Neural Network (DNN) architectures. The former uses a Convolutional Neural Network (CNN) architecture model. Upon training with reference signals, the CNN model identifies the dynamics present in the PPG signal at different timescales, assigning, according to a classification process, an occurrence probability to each of them. The latter uses a Recurrent Neural Network (RNN) based on a Long Short-Term Memory (LSTM) architecture. With each of the signals, whether reference signals or PPG signals, the RNN model infers an evolution function (nonlinear regression model) based on training data, and considers its predictive capability over a relatively short time horizon.


title: Semi-classical mass asymptotics on stationary spacetimes

abstract: We study the spectrum $\{\lambda_j(m)\}_{j=1}^{\infty}$ of a timelike Killing vector field $Z$ acting as a differential operator $D_Z$ on the Hilbert space of solutions of the massive Klein-Gordon equation $(\Box_g + m^2) u = 0$ on a globally hyperbolic stationary spacetime $(M, g)$ with compact Cauchy hypersurface. The inverse mass $m^{-1}$ is formally like the Planck constant in a Schr\"odinger equation, and we give Weyl asymptotics as $m \to \infty$ for the number $$N_{\nu, C}(m)= \# \{j \mid \frac{\lambda_j(m)}{m} \in [\nu - \frac{C}{m}, \nu + \frac{C}{m} ]\}$$ for a given $C > 0$. The semi-classical mass asymptotics are governed by the dynamics of the Killing flow $e^{tZ} $ on the hypersurface in the space of mass $1$ geodesics $\gamma$ where $\langle \dot{\gamma}, Z \rangle= \nu$.


title: Lattice QCD (focus on Charm and Beauty form factors, $R(D^*)$, $b$- & $c$-quark masses)

abstract: We present an overview of state of the art lattice quantum chromodynamcis calculations for heavy-light quantities. Special focus is given to the calculation of form factors for semi-leptonic decays of $B_{(s)}$ and $D$ mesons, the extraction of the Cabibbo-Kobayashi-Maskawa matrix elements $|V_{ub}|$ and $|V_{cb}|$ as well as the determination of $R(D^{(*)})$ testing the universality of lepton flavors in $b\to c$ transitions. In addition we report on the determination of $b$ and $c$ quark masses as well as on neutral $B_{(s)}$ meson mixing. Recent results are summarized and new developments highlighted.


title: Fokas method for linear boundary value problems involving mixed spatial derivatives

abstract: We obtain solution representation formulas for some linear initial boundary value problems posed on the half space that involve mixed spatial derivative terms via the unified transform method (UTM), also known as the Fokas method. We first implement the method on the second order parabolic PDEs; in this case one can alternatively eliminate the mixed derivatives by a linear change of variables. Then, we employ the method to biharmonic problems, where it is not possible to eliminate the cross term via a linear change of variables. A basic ingredient of the UTM is the use of certain invariant maps. It is shown here that these maps are well-defined provided that certain analyticity issues are appropriately addressed.


title: On Boolean posets of numerical events

abstract: Let S be a set of states of a physical system and p(s) the probability of the occurrence of an event when the system is in state s. A function p from S to [0,1] is called a numerical event or alternatively, an S-probability. If a set P of S-probabilities is ordered by the order of real functions it becomes a poset which can be considered as a quantum logic. In case P is a Boolean algebra this will indicate that the underlying physical system is a classical one. The goal of this paper is to study sets of S-probabilities which are not far from being Boolean algebras, especially by means of the addition and comparison of functions that occur in these sets. In particular, certain classes of Boolean posets of S-probabilities are characterized and related to each other and descriptions based on sets of states are derived.


title: Preventing Imitation Learning with Adversarial Policy Ensembles

abstract: Imitation learning can reproduce policies by observing experts, which poses a problem regarding policy privacy. Policies, such as human, or policies on deployed robots, can all be cloned without consent from the owners. How can we protect against external observers cloning our proprietary policies? To answer this question we introduce a new reinforcement learning framework, where we train an ensemble of near-optimal policies, whose demonstrations are guaranteed to be useless for an external observer. We formulate this idea by a constrained optimization problem, where the objective is to improve proprietary policies, and at the same time deteriorate the virtual policy of an eventual external observer. We design a tractable algorithm to solve this new optimization problem by modifying the standard policy gradient algorithm. Our formulation can be interpreted in lenses of confidentiality and adversarial behaviour, which enables a broader perspective of this work. We demonstrate the existence of "non-clonable" ensembles, providing a solution to the above optimization problem, which is calculated by our modified policy gradient algorithm. To our knowledge, this is the first work regarding the protection of policies in Reinforcement Learning.


title: Transfer Learning for HVAC System Fault Detection

abstract: Faults in HVAC systems degrade thermal comfort and energy efficiency in buildings and have received significant attention from the research community, with data driven methods gaining in popularity. Yet the lack of labeled data, such as normal versus faulty operational status, has slowed the application of machine learning to HVAC systems. In addition, for any particular building, there may be an insufficient number of observed faults over a reasonable amount of time for training. To overcome these challenges, we present a transfer methodology for a novel Bayesian classifier designed to distinguish between normal operations and faulty operations. The key is to train this classifier on a building with a large amount of sensor and fault data (for example, via simulation or standard test data) then transfer the classifier to a new building using a small amount of normal operations data from the new building. We demonstrate a proof-of-concept for transferring a classifier between architecturally similar buildings in different climates and show few samples are required to maintain classification precision and recall.


title: Parametric Analysis of Smartphone Camera for a Low Cost Particle Image Velocimetry System

abstract: This study focuses on assessing smartphone camera characteristics for developing an economic smartphone-based Particle Image Velocimetry (PIV) system. In the investigation, flow around a cylinder was visualized using two commercially-available smartphones (OnePlus 5T and iPhone X) cameras and low-intensity laser diodes. Hydrogen bubbles generated from electrolysis (termed Bubble Image Velocimetry) of aluminum electrodes were used as seeding medium. OpenPIV, an open-source toolbox, was used for processing captured images and obtaining the flow fields. A parametric analysis of the two smartphones was conducted across varying camera characteristics such as ISO, exposure compensation and frame rate. The results obtained through experimentation were compared with the results of a validated computational fluid dynamics (CFD) study with the same flow conditions and were found to be in good agreement, with deviation ranging from 1% to 3.5% for iPhone X and 1% to 7% for OnePlus 5T. It was observed that a higher frame rate results in greater accuracy of the measurement. Further, an exposure compensation of -1 EV and an ISO of 400 was found to produce results with the least error as compared to CFD values.


title: Counting minimal surfaces in negatively curved 3-manifolds

abstract: We introduced an asymptotic quantity that counts area-minimizing surfaces in negatively curved closed 3-manifolds and show that quantity to only be minimized, among all metrics of sectional curvature less than or equal -1, by the hyperbolic metric.


title: A comparison of exoplanet spectroscopic retrieval tools

abstract: Over the last several years, spectroscopic observations of transiting exoplanets have begun to uncover information about their atmospheres, including atmospheric composition and indications of the presence of clouds and hazes. Spectral retrieval is the leading technique for interpretation of transmission spectra and is employed by several teams using a variety of forward models and parameter estimation algorithms. However, different model suites have mostly been used in isolation and so it is unknown whether the results from each are comparable. As we approach the launch of the James Webb Space Telescope we anticipate advances in wavelength coverage, precision, and resolution of transit spectroscopic data, so it is important that the tools that will be used to interpret these information rich spectra are validated. To this end, we present an inter-model comparison of three retrieval suites: TauREx, NEMESIS and CHIMERA. We demonstrate that the forward model spectra are in good agreement (residual deviations on the order of 20 - 40 ppm), and discuss the results of cross retrievals between the three tools. Generally, the constraints from the cross retrievals are consistent with each other and with input values to within 1 sigma However, for high precision scenarios with error envelopes of order 30 ppm, subtle differences in the simulated spectra result in discrepancies between the different retrieval suites, and inaccuracies in retrieved values of several sigma. This can be considered analogous to substantial systematic/astrophysical noise in a real observation, or errors/omissions in a forward model such as molecular linelist incompleteness or missing absorbers.


title: Quantum nature of Wigner function for inflationary tensor perturbations

abstract: We study the Wigner function for the inflationary tensor perturbation defined in the real phase space. We compute explicitly the Wigner function including the contributions from the cubic self-interaction Hamiltonian of tensor perturbations. Then we argue that it is no longer an appropriate description for the probability distribution in the sense that quantum nature allows negativity around vanishing phase variables. This comes from the non-Gaussian wavefunction in the mixed state as a result of the non-linear interaction between super- and sub-horizon modes. We also show that this is related to the explicit infrared divergence in the Wigner function, in contrast to the trace of the density matrix.

categories: hep-th astro-ph.CO gr-qc hep-ph quant-ph


title: Fake News Detection by means of Uncertainty Weighted Causal Graphs

abstract: Society is experimenting changes in information consumption, as new information channels such as social networks let people share news that do not necessarily be trust worthy. Sometimes, these sources of information produce fake news deliberately with doubtful purposes and the consumers of that information share it to other users thinking that the information is accurate. This transmission of information represents an issue in our society, as can influence negatively the opinion of people about certain figures, groups or ideas. Hence, it is desirable to design a system that is able to detect and classify information as fake and categorize a source of information as trust worthy or not. Current systems experiment difficulties performing this task, as it is complicated to design an automatic procedure that can classify this information independent on the context. In this work, we propose a mechanism to detect fake news through a classifier based on weighted causal graphs. These graphs are specific hybrid models that are built through causal relations retrieved from texts and consider the uncertainty of causal relations. We take advantage of this representation to use the probability distributions of this graph and built a fake news classifier based on the entropy and KL divergence of learned and new information. We believe that the problem of fake news is accurately tackled by this model due to its hybrid nature between a symbolic and quantitative methodology. We describe the methodology of this classifier and add empirical evidence of the usefulness of our proposed approach in the form of synthetic experiments and a real experiment involving lung cancer.


title: On the Sample Complexity and Optimization Landscape for Quadratic Feasibility Problems

abstract: We consider the problem of recovering a complex vector $\mathbf{x}\in \mathbb{C}^n$ from $m$ quadratic measurements $\{\langle A_i\mathbf{x}, \mathbf{x}\rangle\}_{i=1}^m$. This problem, known as quadratic feasibility, encompasses the well known phase retrieval problem and has applications in a wide range of important areas including power system state estimation and x-ray crystallography. In general, not only is the the quadratic feasibility problem NP-hard to solve, but it may in fact be unidentifiable. In this paper, we establish conditions under which this problem becomes {identifiable}, and further prove isometry properties in the case when the matrices $\{A_i\}_{i=1}^m$ are Hermitian matrices sampled from a complex Gaussian distribution. Moreover, we explore a nonconvex {optimization} formulation of this problem, and establish salient features of the associated optimization landscape that enables gradient algorithms with an arbitrary initialization to converge to a \emph{globally optimal} point with a high probability. Our results also reveal sample complexity requirements for successfully identifying a feasible solution in these contexts.

categories: eess.SP cs.IT cs.LG math.IT math.OC stat.ML


title: Valuation rings are derived splinters

abstract: We give three proofs that valuation rings are derived splinters: a geometric proof using the absolute integral closure, a homological proof which reduces the problem to checking that valuation rings are splinters (which is done in the second author's PhD thesis and which we reprise here), and a proof by approximation which reduces the problem to Bhatt's proof of the derived direct summand conjecture. The approximation property also shows that smooth algebras over valuation rings are splinters.


title: Policy Gradient based Quantum Approximate Optimization Algorithm

abstract: The quantum approximate optimization algorithm (QAOA), as a hybrid quantum/classical algorithm, has received much interest recently. QAOA can also be viewed as a variational ansatz for quantum control. However, its direct application to emergent quantum technology encounters additional physical constraints: (i) the states of the quantum system are not observable; (ii) obtaining the derivatives of the objective function can be computationally expensive or even inaccessible in experiments, and (iii) the values of the objective function may be sensitive to various sources of uncertainty, as is the case for noisy intermediate-scale quantum (NISQ) devices. Taking such constraints into account, we show that policy-gradient-based reinforcement learning (RL) algorithms are well suited for optimizing the variational parameters of QAOA in a noise-robust fashion, opening up the way for developing RL techniques for continuous quantum control. This is advantageous to help mitigate and monitor the potentially unknown sources of errors in modern quantum simulators. We analyze the performance of the algorithm for quantum state transfer problems in single- and multi-qubit systems, subject to various sources of noise such as error terms in the Hamiltonian, or quantum uncertainty in the measurement process. We show that, in noisy setups, it is capable of outperforming state-of-the-art existing optimization algorithms.

categories: quant-ph cond-mat.other cs.LG physics.comp-ph


title: Nonequilibrium physics in integrable systems and spin-flip non-invariant conserved quantities

abstract: Recently found spin-flip non-invariant (SFNI) conserved quantities play important roles in discussing nonequilibrium physics of the XXZ model. The representative examples are the generalized Gibbs ensemble (GGE) and the ballistic transport of the spin current. In spite of big progress in understanding nonequilibrium physics of integrable systems, the general framework to determine a minimal complete set of conserved quantities which describes the long-time steady state has not yet been found. This paper shows that the GGE of the gapless XXZ model consists of functionally independent conserved quantities rather than linearly independent. At the same time, the physical meaning of SFNI conserved quantities is provided. We also discuss that there exist ballistic channels of the spin current supported by non-quasilocal conserved quantities. The saturation of the lower bound for the Drude weight by quasilocal conserved quantities reads the linear dependence of non-quasilocal conserved quantities on quasilocal ones. We show that their (generalized) linearly dependence relation is consistent with the statement that the GGE consists of functionally independent conserved quantities without containing all linearly independent conserved quantities.


title: The Node Weight Dependent Traveling Salesperson Problem: Approximation Algorithms and Randomized Search Heuristics

abstract: Several important optimization problems in the area of vehicle routing can be seen as a variant of the classical Traveling Salesperson Problem (TSP). In the area of evolutionary computation, the traveling thief problem (TTP) has gained increasing interest over the last 5 years. In this paper, we investigate the effect of weights on such problems, in the sense that the cost of traveling increases with respect to the weights of nodes already visited during a tour. This provides abstractions of important TSP variants such as the Traveling Thief Problem and time dependent TSP variants, and allows to study precisely the increase in difficulty caused by weight dependence. We provide a 3.59-approximation for this weight dependent version of TSP with metric distances and bounded positive weights. Furthermore, we conduct experimental investigations for simple randomized local search with classical mutation operators and two variants of the state-of-the-art evolutionary algorithm EAX adapted to the weighted TSP. Our results show the impact of the node weights on the position of the nodes in the resulting tour.


title: Concept Embedding for Information Retrieval

abstract: Concepts are used to solve the term-mismatch problem. However, we need an effective similarity measure between concepts. Word embedding presents a promising solution. We present in this study three approaches to build concepts vectors based on words vectors. We use a vector-based measure to estimate inter-concepts similarity. Our experiments show promising results. Furthermore, words and concepts become comparable. This could be used to improve conceptual indexing process.


title: Low Voltage Ride Through (LVRT) Constrained Transient Stability Assessment Using Lyapunov Functions Family Method

abstract: Growing penetration of renewable generation in power systems brings more challenges in transient stability assessment using direct methods. One of the reasons is the inability to assess the risk of instability brought by tripping of a large amount of RGs due to violation of their ride through curves. In this paper, a scalable approach is proposed based on the Lyapunov functions family to estimate the stability region under ride through constraints. An inner polytopic approximation to the feasibility region is proposed to convexify the overall problem. The acquired constrained stability region estimate helps capture trajectories that trigger undesirable tripping of renewable generation. A 2-machine system is used to visualize its effectiveness.


title: TLB and Pagewalk Performance in Multicore Architectures with Large Die-Stacked DRAM Cache

abstract: In this work we study the overheads of virtual-to-physical address translation in processor architectures, like x86-64, that implement paged virtual memory using a radix tree which are walked in hardware. Translation Lookaside Buffers are critical to system performance, particularly as applications demand larger memory footprints and with the adoption of virtualization; however the cost of a TLB miss potentially results in multiple memory accesses to retrieve the translation. Architectural support for superpages has been introduced to increase TLB hits but are limited by the operating systems ability to find contiguous memory. Numerous prior studies have proposed TLB designs to lower miss rates and reduce page walk overhead; however, these studies have modeled the behavior analytically. Further, to eschew the paging overhead for big-memory workloads and virtualization, Direct Segment maps part of a process linear virtual address space with segment registers albeit requiring a few application and operating system modifications. The recently evolved die-stacked DRAM technology promises a high bandwidth and large last-level cache, in the order of Gigabytes, closer to the processors. With such large caches the amount of data that can be accessed without causing a TLB fault - the reach of a TLB, is inadequate. TLBs are on the critical path for data accesses and incurring an expensive page walk can hinder system performance, especially when the data being accessed is a cache hit in the LLC. Hence, we are interested in exploring novel address translation mechanisms, commensurate to the size and latency of stacked DRAM. By accurately simulating the multitude of multi-level address translation structures using the QEMU based MARSSx86 full system simulator, we perform detailed study of TLBs in conjunction with the large LLCs using multi-programmed and multi-threaded workloads.


title: Convexification for a 1D Hyperbolic Coefficient Inverse Problem with Single Measurement Data

abstract: A version of the convexification numerical method for a Coefficient Inverse Problem for a 1D hyperbolic PDE is presented. The data for this problem are generated by a single measurement event. This method converges globally. The most important element of the construction is the presence of the Carleman Weight Function in a weighted Tikhonov-like functional. This functional is strictly convex on a certain bounded set in a Hilbert space, and the diameter of this set is an arbitrary positive number. The global convergence of the gradient projection method is established. Computational results demonstrate a good performance of the numerical method for noisy data.


title: Multistage Model for Robust Face Alignment Using Deep Neural Networks

abstract: An ability to generalize unconstrained conditions such as severe occlusions and large pose variations remains a challenging goal to achieve in face alignment. In this paper, a multistage model based on deep neural networks is proposed which takes advantage of spatial transformer networks, hourglass networks and exemplar-based shape constraints. First, a spatial transformer - generative adversarial network which consists of convolutional layers and residual units is utilized to solve the initialization issues caused by face detectors, such as rotation and scale variations, to obtain improved face bounding boxes for face alignment. Then, stacked hourglass network is employed to obtain preliminary locations of landmarks as well as their corresponding scores. In addition, an exemplar-based shape dictionary is designed to determine landmarks with low scores based on those with high scores. By incorporating face shape constraints, misaligned landmarks caused by occlusions or cluttered backgrounds can be considerably improved. Extensive experiments based on challenging benchmark datasets are performed to demonstrate the superior performance of the proposed method over other state-of-the-art methods.


title: M\"obius disjointness for $C^{1 + \varepsilon}$ skew products

abstract: We show that for $\varepsilon > 0$, every $C^{1 + \varepsilon}$ skew product on $\mathbb{T}^2$ over a rotation of $\mathbb{T}^1$ satisfies Sarnak's conjecture. This is an improvement of earlier results of Kulaga-Przymus-Lema\'nczyk, Huang-Wang-Ye, and Kanigowski-Lema\'nczyk-Radziwill.


title: Quantifying the Effects of Recommendation Systems

abstract: Recommendation systems today exert a strong influence on consumer behavior and individual perceptions of the world. By using collaborative filtering (CF) methods to create recommendations, it generates a continuous feedback loop in which user behavior becomes magnified in the algorithmic system. Popular items get recommended more frequently, creating the bias that affects and alters user preferences. In order to visualize and compare the different biases, we will analyze the effects of recommendation systems and quantify the inequalities resulting from them.


title: BRIGHTNESS: Leaking Sensitive Data from Air-Gapped Workstations via Screen Brightness

abstract: Air-gapped computers are systems that are kept isolated from the Internet since they store or process sensitive information. In this paper, we introduce an optical covert channel in which an attacker can leak (or, exfiltlrate) sensitive information from air-gapped computers through manipulations on the screen brightness. This covert channel is invisible and it works even while the user is working on the computer. Malware on a compromised computer can obtain sensitive data (e.g., files, images, encryption keys and passwords), and modulate it within the screen brightness, invisible to users. The small changes in the brightness are invisible to humans but can be recovered from video streams taken by cameras such as a local security camera, smartphone camera or a webcam. We present related work and discuss the technical and scientific background of this covert channel. We examined the channel's boundaries under various parameters, with different types of computer and TV screens, and at several distances. We also tested different types of camera receivers to demonstrate the covert channel. Lastly, we present relevant countermeasures to this type of attack. Lastly, we present relevant countermeasures to this type of attack.


title: Full analytical approximation to the stochastic gravitational wave background generated by cosmic string networks

abstract: We derive a full analytical approximation to the stochastic gravitational wave background generated by the loops that are produced throughout the cosmological evolution of cosmic string networks. We show that this approximation not only predicts the amplitude of the radiation-era plateau exactly, but also provides a good fit to the high-frequency cut-off and to the low-frequency peak generated by the loops that decay during the matter era, irrespective of cosmic string tension and of the length of loops created. We then find that it provides a good quantitative description of the full stochastic gravitational wave background across the relevant frequency range.


title: Bridging the Gap: Providing Post-Hoc Symbolic Explanations for Sequential Decision-Making Problems with Inscrutable Representations

abstract: As increasingly complex AI systems are introduced into our daily lives, it becomes important for such systems to be capable of explaining the rationale for their decisions and allowing users to contest these decisions. A significant hurdle to allowing for such explanatory dialogue could be the vocabulary mismatch between the user and the AI system. This paper introduces methods for providing contrastive explanations in terms of user-specified concepts for sequential decision-making settings where the system's model of the task may be best represented as an inscrutable model. We do this by building partial symbolic models of a local approximation of the task that can be leveraged to answer the user queries. We test these methods on a popular Atari game (Montezuma's Revenge) and variants of Sokoban (a well-known planning benchmark) and report the results of user studies to evaluate whether people find explanations generated in this form useful.


title: Secure Payment System Utilizing MANET for Disaster Areas

abstract: Mobile payment system in a disaster area have the potential to provide electronic transactions for people purchasing recovery goods like foodstuffs, clothes, and medicine. Conversely, to enable transactions in a disaster area, current payment systems need communication infrastructures (such as wired networks and cellular networks) which may be ruined during such disasters as large-scale earthquakes and flooding and thus cannot be depended on in a disaster area. In this paper, we introduce a new mobile payment system utilizing infrastructureless MANETs to enable transactions that permit users to shop in disaster areas. Specifically, we introduce an endorsement-based mechanism to provide payment guarantees for a customer-to-merchant transaction and a multilevel endorsement mechanism with a lightweight scheme based on Bloom filter and Merkle tree to reduce communication overheads. Our mobile payment system achieves secure transaction by adopting various schemes such as location-based mutual monitoring scheme and blind signature, while our newly introduce event chain mechanism prevents double spending attacks. As validated by simulations, the proposed mobile payment system is useful in a disaster area, achieving high transaction completion ratio, 65% - 90% for all scenario tested, and is storage-efficient for mobile devices with an overall average of 7MB merchant message size.


title: Near-degenerate quadrature-squeezed vacuum generation on a silicon-nitride chip

abstract: Squeezed states are a primary resource for continuous-variable (CV) quantum information processing. To implement CV protocols in a scalable and robust way, it is desirable to generate and manipulate squeezed states using an integrated photonics platform. In this Letter, we demonstrate the generation of quadrature-phase squeezed states in the radio-frequency carrier sideband using a small-footprint silicon-nitride microresonator with a dual-pumped four-wave-mixing process. We record a squeezed noise level of 1.34 dB ($\pm$0.16 dB) below the photocurrent shot noise, which corresponds to 3.09 dB ($\pm$0.49 dB) of quadrature squeezing on chip. We also show that it is critical to account for the nonlinear behavior of the pump fields to properly predict the squeezing that can be generated in this system. This technology represents a significant step toward creating and manipulating large-scale CV cluster states that can be used for quantum information applications including universal quantum computing.


title: Probabilistic State Estimation in Water Networks

abstract: State estimation in water distribution networks (WDN), the problem of estimating all unknown network heads and flows given select measurements, is challenging due to the nonconvexity of hydraulic models and significant uncertainty from water demands, network parameters, and measurements. To this end, a probabilistic modeling for state estimation (PSE) in WDNs is proposed. After linearizing the nonlinear hydraulic WDN model, the proposed PSE shows that the covariance matrix of unknown system states (unmeasured heads and flows) can be linearly expressed by the covariance matrix of three uncertainty sources (i.e., measurement noise, network parameters, and water demands). Instead of providing deterministic results for unknown states, the proposed PSE approach (i) regards the system states and uncertainty sources as random variables and yields variances of individual unknown states, (ii) considers thorough modeling of various types of valves and measurement scenarios in WDNs, and (iii) is also useful for uncertainty quantification, extended period simulations, and confidence limit analysis. The effectiveness and scalability of the proposed approach is tested using several WDN case studies.


title: On the analyticity of the value function in optimal investment and stochastically dominant markets

abstract: We study the analyticity of the value function in optimal investment with expected utility from terminal wealth and the relation to stochastically dominant financial models. We identify both a class of utilities and a class of semi-martingale models for which we establish analyticity. Specifically, these utilities have completely monotonic inverse marginals, while the market models have a maximal element in the sense of infinite-order stochastic dominance. We construct two counterexamples, themselves of independent interest, which show that analyticity fails if either the utility or the market model does not belong to the respective special class. We also provide explicit formulas for the derivatives, of all orders, of the value functions as well as their optimizers. Finally, we show that for the set of supermartingale deflators, stochastic dominance of infinite order is equivalent to the apparently stronger dominance of second order.


title: Decoding Visual Responses based on Deep Neural Networks with Ear-EEG Signals

abstract: Recently, practical brain-computer interface is actively carried out, especially, in an ambulatory environment. However, the electroencephalography signals are distorted by movement artifacts and electromyography signals in ambulatory condition, which make hard to recognize human intention. In addition, as hardware issues are also challenging, ear-EEG has been developed for practical brain-computer interface and is widely used. However, ear-EEG still contains contaminated signals. In this paper, we proposed robust two-stream deep neural networks in walking conditions and analyzed the visual response EEG signals in the scalp and ear in terms of statistical analysis and brain-computer interface performance. We validated the signals with the visual response paradigm, steady-state visual evoked potential. The brain-computer interface performance deteriorated as 3~14% when walking fast at 1.6 m/s. When applying the proposed method, the accuracies increase 15% in cap-EEG and 7% in ear-EEG. The proposed method shows robust to the ambulatory condition in session dependent and session-to-session experiments.


title: Temporal Evolution of Spatially-Resolved Individual Star Spots on a Planet-Hosting Solar-type Star: Kepler 17

abstract: Star spot evolution is visible evidence of the emergence/decay of the magnetic field on stellar surface, and it is therefore important for the understanding of the underlying stellar dynamo and consequential stellar flares. In this paper, we report the temporal evolution of individual star spot area on the hot-Jupiter-hosting active solar-type star Kepler 17 whose transits occur every 1.5 days. The spot longitude and area evolution are estimated (1) from the stellar rotational modulations of Kepler data and (2) from the brightness enhancements during the exoplanet transits caused by existence of large star spots. As a result of the comparison, number of spots, spot locations, and the temporal evolution derived from the rotational modulations is largely different from those of in-transit spots. We confirm that although only two light curve minima appear per rotation, there are clearly many spots present on the star. We find that the observed differential intensity changes are sometimes consistent with the spot pattern detected by transits, but they sometimes do not match with each other. Although the temporal evolution derived from the rotational modulation differs from those of in-transit spots to a certain degree, the emergence/decay rates of in-transit spots are within an order of magnitude of those derived for sunspots as well as our previous research based only on rotational modulations. This supports a hypothesis that the emergence/decay of sunspots and extremely-large star spots on solar-type stars occur through the same underlying processes.


title: Object Instance Mining for Weakly Supervised Object Detection

abstract: Weakly supervised object detection (WSOD) using only image-level annotations has attracted growing attention over the past few years. Existing approaches using multiple instance learning easily fall into local optima, because such mechanism tends to learn from the most discriminative object in an image for each category. Therefore, these methods suffer from missing object instances which degrade the performance of WSOD. To address this problem, this paper introduces an end-to-end object instance mining (OIM) framework for weakly supervised object detection. OIM attempts to detect all possible object instances existing in each image by introducing information propagation on the spatial and appearance graphs, without any additional annotations. During the iterative learning process, the less discriminative object instances from the same class can be gradually detected and utilized for training. In addition, we design an object instance reweighted loss to learn larger portion of each object instance to further improve the performance. The experimental results on two publicly available databases, VOC 2007 and 2012, demonstrate the efficacy of proposed approach.


title: Neuro-evolutionary Frameworks for Generalized Learning Agents

abstract: The recent successes of deep learning and deep reinforcement learning have firmly established their statuses as state-of-the-art artificial learning techniques. However, longstanding drawbacks of these approaches, such as their poor sample efficiencies and limited generalization capabilities point to a need for re-thinking the way such systems are designed and deployed. In this paper, we emphasize how the use of these learning systems, in conjunction with a specific variation of evolutionary algorithms could lead to the emergence of unique characteristics such as the automated acquisition of a variety of desirable behaviors and useful sets of behavior priors. This could pave the way for learning to occur in a generalized and continual manner, with minimal interactions with the environment. We discuss the anticipated improvements from such neuro-evolutionary frameworks, along with the associated challenges, as well as its potential for application to a number of research areas.


title: Accelerating Quantum Approximate Optimization Algorithm using Machine Learning

abstract: We propose a machine learning based approach to accelerate quantum approximate optimization algorithm (QAOA) implementation which is a promising quantum-classical hybrid algorithm to prove the so-called quantum supremacy. In QAOA, a parametric quantum circuit and a classical optimizer iterates in a closed loop to solve hard combinatorial optimization problems. The performance of QAOA improves with increasing number of stages (depth) in the quantum circuit. However, two new parameters are introduced with each added stage for the classical optimizer increasing the number of optimization loop iterations. We note a correlation among parameters of the lower-depth and the higher-depth QAOA implementations and, exploit it by developing a machine learning model to predict the gate parameters close to the optimal values. As a result, the optimization loop converges in a fewer number of iterations. We choose graph MaxCut problem as a prototype to solve using QAOA. We perform a feature extraction routine using 100 different QAOA instances and develop a training data-set with 13,860 optimal parameters. We present our analysis for 4 flavors of regression models and 4 flavors of classical optimizers. Finally, we show that the proposed approach can curtail the number of optimization iterations by on average 44.9% (up to 65.7%) from an analysis performed with 264 flavors of graphs.


title: Reducing Congestion-Induced Renewable Curtailment with Corrective Network Reconfiguration in Day-Ahead Scheduling

abstract: Renewable energy sources (RES) has gained a lot of interest recently. The limited transmission capacity serving RES often leads to network congestion since they are located in remote favorable locations. As a result, when poorly scheduled, the intermittent nature of RES may result in high curtailments of the free resource. Currently, grid operators utilize a static network when performing day-ahead scheduling and ignore transmission flexibility. This paper explores the possibility of utilizing network reconfiguration as a corrective action to reduce the transmission congestion and thereby the reduction of RES curtailments in day-ahead scheduling. To facilitate the RES integration in the grid, a stochastic N-1 security-constrained unit-commitment with corrective network reconfiguration (SSCUC-CNR) is modelled. SSCUC-CNR model is studied on a modified IEEE 24-bus system with RES. The simulation results demonstrate that CNR not only leads to a lower cost solution by reducing network congestion but also facilitates RES integration by reducing congestion-induced curtailments in high penetration cases. Emission studies demonstrate that more green generators are committed resulting in reduced carbon emissions when CNR is implemented.


title: Cartesian Difference Categories: Extended Report

abstract: Cartesian differential categories are categories equipped with a differential combinator which axiomatizes the directional derivative. Important models of Cartesian differential categories include classical differential calculus of smooth functions and categorical models of the differential lambda-calculus. However, Cartesian differential categories cannot account for other interesting notions of differentiation such as the calculus of finite differences or the Boolean differential calculus. On the other hand, change action models have been shown to capture these examples as well as more "exotic" examples of differentiation. However, change action models are very general and do not share the nice properties of a Cartesian differential category. In this paper, we introduce Cartesian difference categories as a bridge between Cartesian differential categories and change action models. We show that every Cartesian differential category is a Cartesian difference category, and how certain well-behaved change action models are Cartesian difference categories. In particular, Cartesian difference categories model both the differential calculus of smooth functions and the calculus of finite differences. Furthermore, every Cartesian difference category comes equipped with a tangent bundle monad whose Kleisli category is again a Cartesian difference category.


title: Human-centered Explainable AI: Towards a Reflective Sociotechnical Approach

abstract: Explanations--a form of post-hoc interpretability--play an instrumental role in making systems accessible as AI continues to proliferate complex and sensitive sociotechnical systems. In this paper, we introduce Human-centered Explainable AI (HCXAI) as an approach that puts the human at the center of technology design. It develops a holistic understanding of "who" the human is by considering the interplay of values, interpersonal dynamics, and the socially situated nature of AI systems. In particular, we advocate for a reflective sociotechnical approach. We illustrate HCXAI through a case study of an explanation system for non-technical end-users that shows how technical advancements and the understanding of human factors co-evolve. Building on the case study, we lay out open research questions pertaining to further refining our understanding of "who" the human is and extending beyond 1-to-1 human-computer interactions. Finally, we propose that a reflective HCXAI paradigm-mediated through the perspective of Critical Technical Practice and supplemented with strategies from HCI, such as value-sensitive design and participatory design--not only helps us understand our intellectual blind spots, but it can also open up new design and research spaces.


title: On the interaction between supervision and self-play in emergent communication

abstract: A promising approach for teaching artificial agents to use natural language involves using human-in-the-loop training. However, recent work suggests that current machine learning methods are too data inefficient to be trained in this way from scratch. In this paper, we investigate the relationship between two categories of learning signals with the ultimate goal of improving sample efficiency: imitating human language data via supervised learning, and maximizing reward in a simulated multi-agent environment via self-play (as done in emergent communication), and introduce the term supervised self-play (S2P) for algorithms using both of these signals. We find that first training agents via supervised learning on human data followed by self-play outperforms the converse, suggesting that it is not beneficial to emerge languages from scratch. We then empirically investigate various S2P schedules that begin with supervised learning in two environments: a Lewis signaling game with symbolic inputs, and an image-based referential game with natural language descriptions. Lastly, we introduce population based approaches to S2P, which further improves the performance over single-agent methods.


title: Jordan decomposition and the recurrent set of flows of automorphisms

abstract: In this paper we show that any linear vector field $\mathcal{X}$ on a connected Lie group $G$ admits a Jordan decomposition and the recurrent set of the associated ow of automorphisms is given as the intersection of the fixed points of the hyperbolic and nilpotent components of its Jordan decomposition.


title: Robust Optimal Design of Two-Armed Trials with Side Information

abstract: Significant evidence has become available that emphasizes the importance of personalization in medicine. In fact, it has become a common belief that personalized medicine is the future of medicine. The core of personalized medicine is the ability to design clinical trials that investigate the role of patient covariates on treatment effects. In this work, we study the optimal design of two-armed clinical trials to maximize accuracy of statistical models where the interaction between patient covariates and treatment effect are incorporated to enable precision medication. Such a modeling extension leads to significant complexities for the produced optimization problems because they include optimization over design and covariates concurrently. We take a robust optimization approach and minimize (over design) the maximum (over population) variance of interaction effect between treatment and patient covariates. This results in a min-max bi-level mixed integer nonlinear programming problem, which is notably challenging to solve. To address this challenge, we introduce a surrogate model by approximating the objective function for which we propose two solution approaches. The first approach provides an exact solution based on reformulation and decomposition techniques. In the second approach, we provide a lower bound for the inner optimization problem and solve the outer optimization problem over the lower bound. We test our proposed algorithms with synthetic and real-world data sets and compare it with standard (re-)randomization methods. Our numerical analysis suggests that the lower bounding approach provides high-quality solutions across a variety of settings.