title: Defect Reduction Planning (using TimeLIME)

abstract: Software comes in releases. An implausible change to software is something that has never been changed in prior releases. When planning how to reduce defects, it is better to use plausible changes, i.e., changes with some precedence in the prior releases. To demonstrate these points, this paper compares several defect reduction planning tools. LIME is a local sensitivity analysis tool that can report the fewest changes needed to alter the classification of some code module (e.g., from "defective" to "non-defective"). TimeLIME is a new tool, introduced in this paper, that improves LIME by restricting its plans to just those attributes which change the most within a project. In this study, we compared the performance of LIME and TimeLIME and several other defect reduction planning algorithms. The generated plans were assessed via (a) the similarity scores between the proposed code changes and the real code changes made by developers; and (b) the improvement scores seen within projects that followed the plans. For nine project trails, we found that TimeLIME outperformed all other algorithms (in 8 out of 9 trials). Hence, we strongly recommend using past releases as a source of knowledge for computing fixes for new releases (using TimeLIME). Apart from these specific results about planning defect reductions and TimeLIME, the more general point of this paper is that our community should be more careful about using off-the-shelf AI tools, without first applying SE knowledge. In this case study, it was not difficult to augment a standard AI algorithm with SE knowledge (that past releases are a good source of knowledge for planning defect reductions). As shown here, once that SE knowledge is applied, this can result in dramatically better systems.


title: Tidal Asteroseismology: Possible Evidence of Non-linear Mode Coupling in an Equilibrium State in Kepler Eclipsing Binary KIC 3230227

abstract: Previously, a series of tidally-excited oscillations were discovered in the eccentric eclipsing binary KIC 3230227. The pulsation amplitudes and phases suggest the observed oscillations are prograde quadruple modes. In this paper, we refine the analysis and extract more oscillation frequencies. We also study the temporal variations of amplitudes and phases and show that almost all modes have stable phases and amplitudes. We then focus on the non-orbital-harmonic oscillations. We consider two formation mechanisms: 1) nonlinear response of the surface convective layer, and 2) nonlinear three/multi-mode coupling. Although the former can explain some of the observed features, we find the latter mechanism is more probable. Assuming that these are coupled modes, the constant amplitude/phase over four years can be explained by either an equilibrium state in the mode coupling or modes undergoing limit cycles with very long periods. The observed frequency detuning and the calculated damping rates of the daughter modes favor the equilibrium-state interpretation. This is verified by integrating the amplitude equations of three-mode coupling. We find that the steady-state relation derived in Weinberg et al., which relates the observed frequency detuning, phase detuning, and mode damping rates, is approximately satisfied for one mode triplet. We also try to identify the azimuthal number of the modes based on the observed mode amplitude ratios and the selection rules in nonlinear three-mode coupling. We discuss further implications of these observations on nonlinear tidal asteroseismology.


title: Turning a Newtonian analogy for FLRW cosmology into a relativistic problem

abstract: A Newtonian uniform ball expanding in empty space constitutes a common heuristic analogy for FLRW cosmology. We discuss possible implementations of the corresponding general-relativistic problem and a variety of new cosmological analogies arising from them. We highlight essential ingredients of the Newtonian analogy, including that the quasilocal energy is always `Newtonian' in the sense that the magnetic part of the Weyl tensor does not contribute to it. A symmetry of the Einstein-Friedmann equations produces another one in the original Newtonian system.


title: F4Tele: FSO for Data Center Network Management and Packet Telemetry

abstract: The proliferation of bandwidth-hungry applications and services forces datacenter (DC) administrators to optimize the utilization of available resources. Precisely, the network share of management traffic has grown significantly because DC networks are becoming more sophisticated and require a massive amount of data for efficient debugging and troubleshooting. Accordingly, we use free space optics communication (FSO) with wavelength division multiplexing (WDM) technology to build a flexible yet high-performance logical network responsible for management traffic. The FSO-WDM can provide reconfigurable multi-terabit topology over line-of-sight (LoS) links. Due to space and processing capacity reasons, we can not offer direct connections from every data rack to the network management racks. Alternatively, the data racks are grouped together as each group is serviced for a duration of time matches its average arrival-rate. Since the data racks showed different arrival-rates, the hotspot racks are allocated with longer service time. The evaluation results show that F4Tele carried out high throughput close to the expensive solution (benchmark).


title: Revealing self-gravity in a Stern-Gerlach Humpty-Dumpty experiment

abstract: There is no consensus among today's physicists about how to describe the gravitational interaction properly in a quantum framework. We propose in this paper an experimental test aimed at revealing the existence of a non-linear self-interaction \`a la Schrodinger-Newton (S-N). In this test, a mesoscopic spin 1/2 microsphere is freely falling in a Humpty-Dumpty Stern-Gerlach interferometer. After clarifying the role of the scaling of the interaction in function of the amplitudes of the up and down spin components of the microsphere, it is shown that self-gravity induces a measurable phase shift between them, which paves the way to experimental tests. It is also shown that if we consider two distinct microspheres falling in parallel, the entangling power of the S-N interaction is exactly equal to zero.


title: Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Faces

abstract: Deepfake represents a category of face-swapping attacks that leverage machine learning models such as autoencoders or generative adversarial networks. Although the concept of the face-swapping is not new, its recent technical advances make fake content (e.g., images, videos) more realistic and imperceptible to Humans. Various detection techniques for Deepfake attacks have been explored. These methods, however, are passive measures against Deepfakes as they are mitigation strategies after the high-quality fake content is generated. More importantly, we would like to think ahead of the attackers with robust defenses. This work aims to take an offensive measure to impede the generation of high-quality fake images or videos. Specifically, we propose to use novel transformation-aware adversarially perturbed faces as a defense against GAN-based Deepfake attacks. Different from the naive adversarial faces, our proposed approach leverages differentiable random image transformations during the generation. We also propose to use an ensemble-based approach to enhance the defense robustness against GAN-based Deepfake variants under the black-box setting. We show that training a Deepfake model with adversarial faces can lead to a significant degradation in the quality of synthesized faces. This degradation is twofold. On the one hand, the quality of the synthesized faces is reduced with more visual artifacts such that the synthesized faces are more obviously fake or less convincing to human observers. On the other hand, the synthesized faces can easily be detected based on various metrics.


title: Scalability in nonlinear network systems affected by delays and disturbances

abstract: This paper is concerned with the study of scalability in nonlinear heterogeneous networks affected by communication delays and disturbances. After formalizing the notion of scalability, we give two sufficient conditions to assess this property. Our results can be used to study leader-follower and leaderless networks and also allow to consider the case when the desired configuration of the system changes over time. We show how our conditions can be turned into design guidelines to guarantee scalability and illustrate their effectiveness via numerical examples.


title: On the generating polynomials for the distribution of generalized binomial coefficients in discrete valuation domains

abstract: For a discrete valuation domain $V$ with maximal ideal $\mathfrak{m}$ such that the residue field $V/\mathfrak{m}$ is finite, there exists a sequence of polynomials $(F_n(x))_{n \ge 0}$ defined over the quotient field $K$ of $V$ that forms a basis of the $V$-module $\text{Int}(V) = \{f \in K[x] | f(V)\subseteq V\}$. This sequence of polynomials bears many resemblances to the classical binomial polynomials $(\binom{x}{n})_{n \ge 0}$. In this paper, we introduce a generating polynomial to account for the distribution of the $V$-values of the polynomials $F_n(x)$ modulo the maximal ideal $\mathfrak{m}$, and prove a result that provides a method for counting exactly how many $V$-values of the polynomials $(F_n(x))_{n \ge 0}$ fall into each of the residue classes modulo $\mathfrak{m}$. Our main theorem in this paper can be viewed as an analogue of the classical theorem of Garfield and Wilf in the context of discrete valuation domains.


title: Inhomogeneous Kondo-lattice in geometrically frustrated Pr$_{2}$Ir$_{2}$O$_{7}$

abstract: Magnetic fluctuations induced by geometric frustration of local Ir-spins disturb the formation of long range magnetic order in the family of pyrochlore iridates, R$_{2}$Ir$_{2}$O$_{7}$ (R = lanthanide)$^{1}$. As a consequence, Pr$_{2}$Ir$_{2}$O$_{7}$ lies at a tuning-free antiferromagnetic-to-paramagnetic quantum critical point and exhibits a diverse array of complex phenomena including Kondo effect, biquadratic band structure, metallic spin-liquid (MSL), and anomalous Hall effect$^{2-5}$. Using spectroscopic imaging with the scanning tunneling microscope, complemented with machine learning K-means clustering analysis, density functional theory, and theoretical modeling, we probe the local electronic states in single crystal of Pr$_{2}$Ir$_{2}$O$_{7}$ and discover an electronic phase separation. Nanoscale regions with a well-defined Kondo resonance are interweaved with a non-magnetic metallic phase with Kondo-destruction. Remarkably, the spatial nanoscale patterns display a correlation-driven fractal geometry with power-law behavior extended over two and a half decades, consistent with being in proximity to a critical point. Our discovery reveals a new nanoscale tuning route, viz. using a spatial variation of the electronic potential as a means of adjusting the balance between Kondo entanglement and geometric frustration.


title: Measuring Forecasting Skill from Text

abstract: People vary in their ability to make accurate predictions about the future. Prior studies have shown that some individuals can predict the outcome of future events with consistently better accuracy. This leads to a natural question: what makes some forecasters better than others? In this paper we explore connections between the language people use to describe their predictions and their forecasting skill. Datasets from two different forecasting domains are explored: (1) geopolitical forecasts from Good Judgment Open, an online prediction forum and (2) a corpus of company earnings forecasts made by financial analysts. We present a number of linguistic metrics which are computed over text associated with people's predictions about the future including: uncertainty, readability, and emotion. By studying linguistic factors associated with predictions, we are able to shed some light on the approach taken by skilled forecasters. Furthermore, we demonstrate that it is possible to accurately predict forecasting skill using a model that is based solely on language. This could potentially be useful for identifying accurate predictions or potentially skilled forecasters earlier.


title: Optimal Control of Singular Parabolic PDEs Modeling Multiphase Stefan-type Free Boundary Problems

abstract: Optimal control of the singular nonlinear parabolic PDE which is a distributional formulation of multidimensional and multiphase Stefan-type free boundary problem is analyzed. Approximating sequence of finite-dimensional optimal control problems is introduced via finite differences. Existence of the optimal control and the convergence of the sequence of discrete optimal control problems both with respect to functional and control is proved. In particular, convergence of the method of finite differences, and existence, uniqueness and stability estimations are established for the singular PDE problem under minimal regularity assumptions on the coefficients.


title: Comments on "Superstatistical properties of the one-dimensional Dirac oscillator" by Abdelmalek Boumali et al

abstract: In this comment, we discuss the mathematical formalism used in Boumali et al. (2020) which describes the superstatistical thermal properties of a one-dimensional Dirac oscillator. In particular, we point out the importance of maintaining the Legendre structure unaltered to ensure an accurate description of the thermodynamic observables when a Tsallis-like statistical description is assumed. Also, we remark that all the negative poles have to take into account to calculate the Gibbs--Boltzmann partition function. Our findings show that the divergences obtained by the authors in the Helmholtz free energy, which are propagated to the other thermal properties, are a consequence of an incomplete partition function. Moreover, we prove that the restrictions over the $q$-parameter are no needed if an appropriate partition function describes the system.


title: Thin-shell wormholes in AdS$_5$ and string dioptrics

abstract: We consider string probes in a traversable wormhole geometry that connects two locally AdS$_5$ asymptotic regions. Holographically, this describes two interacting copies of a 4-dimensional gauge theory. We consider string configurations whose endpoints are located either in the same boundary or in the two different boundaries of the wormhole. A string with both endpoints in the same boundary is dual to a quark-antiquark pair charged under the same gauge field, while a string extending through the wormhole describes a pair of colored particles charged under two different gauge fields. When one considers a quark-antiquark pair in each boundary, the system undergoes a phase transition: While for small separation each pair of charges exhibits Coulomb interaction, for large separation the charges in different field theories pair up. This behavior had previously been observed in other geometric realizations such as locally AdS$_5$ wormhole solutions with hyperbolic throats. The geometries we consider here, in contrast, are stable thin-shell wormholes with flat codimension-one hypersurfaces at fixed radial coordinate. They appear as electrovacuum solutions of higher-curvature gravity theories coupled to Abelian gauge fields. The presence of the thin-shells produces a refraction of the string configurations in the bulk, leading to the presence of cusps in the phase space diagram. We discuss these and other features of the phase diagram, including the analogies and difference with other wormhole solutions considered in related contexts.


title: Manifold GPLVMs for discovering non-Euclidean latent structure in neural data

abstract: A common problem in neuroscience is to elucidate the collective neural representations of behaviorally important variables such as head direction, spatial location, upcoming movements, or mental spatial transformations. Often, these latent variables are internal constructs not directly accessible to the experimenter. Here, we propose a new probabilistic latent variable model to simultaneously identify the latent state and the way each neuron contributes to its representation in an unsupervised way. In contrast to previous models which assume Euclidean latent spaces, we embrace the fact that latent states often belong to symmetric manifolds such as spheres, tori, or rotation groups of various dimensions. We therefore propose the manifold Gaussian process latent variable model (mGPLVM), where neural responses arise from (i) a shared latent variable living on a specific manifold, and (ii) a set of non-parametric tuning curves determining how each neuron contributes to the representation. Cross-validated comparisons of models with different topologies can be used to distinguish between candidate manifolds, and variational inference enables quantification of uncertainty. We demonstrate the validity of the approach on several synthetic datasets, as well as on calcium recordings from the ellipsoid body of Drosophila melanogaster and extracellular recordings from the mouse anterodorsal thalamic nucleus. These circuits are both known to encode head direction, and mGPLVM correctly recovers the ring topology expected from neural populations representing a single angular variable.


title: Continuous Control for Searching and Planning with a Learned Model

abstract: Decision-making agents with planning capabilities have achieved huge success in the challenging domain like Chess, Shogi, and Go. In an effort to generalize the planning ability to the more general tasks where the environment dynamics are not available to the agent, researchers proposed the MuZero algorithm that can learn the dynamical model through the interactions with the environment. In this paper, we provide a way and the necessary theoretical results to extend the MuZero algorithm to more generalized environments with continuous action space. Through numerical results on two relatively low-dimensional MuJoCo environments, we show the proposed algorithm outperforms the soft actor-critic (SAC) algorithm, a state-of-the-art model-free deep reinforcement learning algorithm.


title: Nano-photocurrent mapping of local electronic structure in twisted bilayer graphene

abstract: We report a combined nano-photocurrent and infrared nanoscopy study of twisted bilayer graphene (TBG) enabling access to the local electronic phenomena at length scales as short as 20 nm. We show that the photocurrent changes sign at carrier densities tracking the local superlattice density of states of TBG. We use this property to identify domains of varying local twist angle by local photo-thermoelectric effect. Consistent with the photocurrent study, infrared nano-imaging experiments reveal optical conductivity features dominated by twist-angle dependent interband transitions. Our results provide a fast and robust method for mapping the electronic structure of TBG and suggest that similar methods can be broadly applied to probe electronic inhomogeneities of moir\'e superlattices in other van der Waals heterostructures.


title: On the Skolem Problem and Prime Powers

abstract: The Skolem Problem asks, given a linear recurrence sequence $(u_n)$, whether there exists $n\in\mathbb{N}$ such that $u_n=0$. In this paper we consider the following specialisation of the problem: given in addition $c\in\mathbb{N}$, determine whether there exists $n\in\mathbb{N}$ of the form $n=lp^k$, with $k,l\leq c$ and $p$ any prime number, such that $u_n=0$.


title: A causal framework for distribution generalization

abstract: We consider the problem of predicting a response $Y$ from a set of covariates $X$ when test and training distributions differ. Since such differences may have causal explanations, we consider test distributions that emerge from interventions in a structural causal model, and focus on minimizing the worst-case risk. Causal regression models, which regress the response on its direct causes, remain unchanged under arbitrary interventions on the covariates, but they are not always optimal in the above sense. For example, for linear models and bounded interventions, alternative solutions have been shown to be minimax prediction optimal. We introduce the formal framework of distribution generalization that allows us to analyze the above problem in partially observed nonlinear models for both direct interventions on $X$ and interventions that occur indirectly via exogenous variables $A$. It takes into account that, in practice, minimax solutions need to be identified from data. Our framework allows us to characterize under which class of interventions the causal function is minimax optimal. We prove sufficient conditions for distribution generalization and present corresponding impossibility results. We propose a practical method, NILE, that achieves distribution generalization in a nonlinear IV setting with linear extrapolation. We prove consistency and present empirical results.


title: A Late-time Radio Survey of Short GRBs at $z<0.5$: New Constraints on the Remnants of Neutron Star Mergers

abstract: Massive, rapidly-spinning magnetar remnants produced as a result of binary neutron star (BNS) mergers may deposit a fraction of their energy into the surrounding kilonova ejecta, powering a synchrotron radio signal from the interaction of the ejecta with the circumburst medium. We present 6.0 GHz Very Large Array (VLA) observations of nine, low-redshift short gamma-ray bursts (SGRBs; $z<0.5$) on rest-frame timescales of $\approx2.4-13.9$ yr following the bursts. We place $3\sigma$ limits on radio continuum emission of $F_{\nu}\lesssim6-20\,\mu$Jy at the burst positions, or $L_{\nu}\lesssim(0.6-8.3)\times10^{28}$erg s$^{-1}$Hz$^{-1}$. Comparing these limits with new light curve modeling which properly incorporates relativistic effects, we obtain limits on the energy deposited into the ejecta of $E_{ej}\lesssim(0.6-6.7)\times 10^{52}$erg ($E_{ej}\lesssim(1.8-17.6)\times10^{52}$erg) for an ejecta mass of $0.03\,M_{\odot}$ ($0.1\,M_{\odot}$). We present a uniform re-analysis of 27 SGRBs with $5.5-6.0$ GHz observations, and find that $\gtrsim50\%$ of SGRBs did not form stable magnetar remnants in their mergers. Assuming SGRBs are produced by BNS mergers drawn from the Galactic BNS population plus an additional component of high-mass GW194025-like mergers in a fraction $f_{GW190425}$ of cases, we place constraints on the maximum mass of a non-rotating neutron star (NS) ($M_{TOV}$), finding $M_{TOV}\lesssim2.23\,M_{\odot}$ for $f_{GW190425}=0.4$; this limit increases for larger values of $f_{GW190425}$. The detection (or lack thereof) of radio remnants in untargeted surveys such as the VLA Sky Survey (VLASS) could provide more stringent constraints on the fraction of mergers that produce stable remnants. If $\gtrsim30-300$ radio remnants are discovered in VLASS, this suggests that SGRBs are a biased population of BNS mergers in terms of the stability of the remnants they produce.


title: An empirical Bayes Approach to stochastic blockmodels and graphons: shrinkage estimation and model selection

abstract: The graphon (W-graph), including the stochastic block model as a special case, has been widely used in modeling and analyzing network data. This random graph model is well-characterized by its graphon function, and estimation of the graphon function has gained a lot of recent research interests. Most existing works focus on community detection in the latent space of the model, while adopting simple maximum likelihood or Bayesian estimates for the graphon or connectivity parameters given the identified communities. In this work, we propose a hierarchical Binomial model and develop a novel empirical Bayes estimate of the connectivity matrix of a stochastic block model to approximate the graphon function. Based on the likelihood of our hierarchical model, we further introduce a model selection criterion for choosing the number of communities. Numerical results on extensive simulations and two well-annotated social networks demonstrate the superiority of our approach in terms of estimation accuracy and model selection.


title: Horizontal shear instabilities at low Prandtl number

abstract: Turbulent mixing in the radiative regions of stars is usually either ignored or crudely accounted for in most stellar evolution models. However, there is growing theoretical and observational evidence that such mixing is present and can affect various aspects of a star's life. In this work, we present a first attempt at quantifying mixing by horizontal shear instabilities in stars using Direct Numerical Simulations. The shear is driven by a body force, and rapidly becomes unstable. At saturation, we find that several distinct dynamical regimes exist, depending on the relative importance of stratification and thermal diffusion (viscosity can in principle also matter, but is usually negligible in most stellar applications). In each of the regimes identified, we put forward a certain number of theoretically motivated scaling laws for the turbulent vertical eddy scale, the typical turbulent diffusion coefficient, and the typical amplitude of temperature fluctuations (among other quantities). Based on our findings, we predict that the majority of stars should fall into one of two categories: high P\'eclet number stratified turbulence, and low P\'eclet number stratified turbulence. The latter is presented in detail in a related paper by Cope et al. (2020), while the former is discussed here. Applying our results to the best-known stellar shear layer, namely the solar tachocline, we find that it should lie in the high P\'eclet number stratified turbulence regime, and predict a substantial amount of vertical mixing for temperature, momentum and composition. Taken as is, the new turbulence model predictions are incompatible with the Spiegel & Zahn (1992) model of the solar tachocline. However, we also show that rotation and magnetic fields are likely to affect the turbulence, and need to be taken into account in future studies.


title: A nondefinability result for expansions of the ordered real field by the Weierstrass $\wp$ function

abstract: Suppose that $\Omega$ is a complex lattice that is closed under complex conjugation and that $I$ is a small real interval, and that $D$ is a disc in $ \mathbb{C}$. Then the restriction $\wp|_D$ is definable in the structure $(\bar{\mathbb{R}},\wp|_I)$ if and only if the lattice $\Omega$ has complex multiplication. This characterises lattices with complex multiplication in terms of definability.


title: Attentive Feature Reuse for Multi Task Meta learning

abstract: We develop new algorithms for simultaneous learning of multiple tasks (e.g., image classification, depth estimation), and for adapting to unseen task/domain distributions within those high-level tasks (e.g., different environments). First, we learn common representations underlying all tasks. We then propose an attention mechanism to dynamically specialize the network, at runtime, for each task. Our approach is based on weighting each feature map of the backbone network, based on its relevance to a particular task. To achieve this, we enable the attention module to learn task representations during training, which are used to obtain attention weights. Our method improves performance on new, previously unseen environments, and is 1.5x faster than standard existing meta learning methods using similar architectures. We highlight performance improvements for Multi-Task Meta Learning of 4 tasks (image classification, depth, vanishing point, and surface normal estimation), each over 10 to 25 test domains/environments, a result that could not be achieved with standard meta learning techniques like MAML.


title: Singularity of random symmetric matrices -- simple proof

abstract: In this paper we give a simple, short, and self-contained proof for a non-trivial upper bound on the probability that a random $\pm 1$ symmetric matrix is singular.


title: Pointer Data Structure Synthesis from Answer Set Programming Specifications

abstract: We develop an inductive proof-technique to generate imperative programs for pointer data structures from behavioural specifications expressed in the Answer Set Programming (ASP) formalism. ASP is a non-monotonic logic based formalism that employs negation-as-failure which helps emulate the human thought process, allowing domain experts to model desired system behaviour succinctly. We argue in this paper that ASP's reliance on negation-as-failure makes it a better formalism than those based on first-order logic for writing formal specifications. We assume the a domain expert provides the representation of inductively defined data structures along with a specification of its operations. Our procedures combined with our novel proof-technique reason over the specifications and automatically generate an imperative program. Our proof-technique leverages the idea of partial deduction to simplify logical specifications. By algebraically simplifying logical specifications we arrive at a residual specification which can be interpreted as an appropriate imperative program. This work is in the realm of constructing programs that are correct according to a given specification.


title: On the optimal constants in the two-sided Stechkin inequalities

abstract: We address the optimal constants in the strong and the weak Stechkin inequalities, both in their discrete and continuous variants. These inequalities appear in the characterization of approximation spaces which arise from sparse approximation or have applications to interpolation theory. An elementary proof of a constant in the strong discrete Stechkin inequality given by Bennett is provided, and we improve the constants given by Levin and Stechkin and by Copson. Finally, the minimal constants in the weak discrete Stechkin inequalities and both continuous Stechkin inequalities are presented.


title: Self-Imitation Learning via Generalized Lower Bound Q-learning

abstract: Self-imitation learning motivated by lower-bound Q-learning is a novel and effective approach for off-policy learning. In this work, we propose a n-step lower bound which generalizes the original return-based lower-bound Q-learning, and introduce a new family of self-imitation learning algorithms. To provide a formal motivation for the potential performance gains provided by self-imitation learning, we show that n-step lower bound Q-learning achieves a trade-off between fixed point bias and contraction rate, drawing close connections to the popular uncorrected n-step Q-learning. We finally show that n-step lower bound Q-learning is a more robust alternative to return-based self-imitation learning and uncorrected n-step, over a wide range of continuous control benchmark tasks.


title: Algorithm for Computing Approximate Nash Equilibrium in Continuous Games with Application to Continuous Blotto

abstract: Successful algorithms have been developed for computing Nash equilibrium in a variety of finite game classes. However, solving continuous games -- in which the pure strategy space is (potentially uncountably) infinite -- is far more challenging. Nonetheless, many real-world domains have continuous action spaces, e.g., where actions refer to an amount of time, money, or other resource that is naturally modeled as being real-valued as opposed to integral. We present a new algorithm for {approximating} Nash equilibrium strategies in continuous games. In addition to two-player zero-sum games, our algorithm also applies to multiplayer games and games with imperfect information. We experiment with our algorithm on a continuous imperfect-information Blotto game, in which two players distribute resources over multiple battlefields. Blotto games have frequently been used to model national security scenarios and have also been applied to electoral competition and auction theory. Experiments show that our algorithm is able to quickly compute close approximations of Nash equilibrium strategies for this game.


title: Tentative Evidence for Water Vapor in the Atmosphere of the Neptune-Size Exoplanet HD 106315 c

abstract: We present a transmission spectrum for the Neptune-size exoplanet HD 106315 c from optical to infrared wavelengths based on transit observations from the Hubble Space Telescope/Wide Field Camera 3, K2, and Spitzer. The spectrum shows tentative evidence for a water absorption feature in the $1.1 - 1.7\mu$m wavelength range with a small amplitude of 30 ppm (corresponding to just $0.8 \pm 0.04$ atmospheric scale heights). Based on an atmospheric retrieval analysis, the presence of water vapor is tentatively favored with a Bayes factor of 1.7 - 2.6 (depending on prior assumptions). The spectrum is most consistent with either enhanced metallicity, high altitude condensates, or both. Cloud-free solar composition atmospheres are ruled out at $>5\sigma$ confidence. We compare the spectrum to grids of cloudy and hazy forward models and find that the spectrum is fit well by models with moderate cloud lofting or haze formation efficiency, over a wide range of metallicities ($1 - 100\times$ solar). We combine the constraints on the envelope composition with an interior structure model and estimate that the core mass fraction is $\gtrsim0.3$. With a bulk composition reminiscent of that of Neptune and an orbital distance of 0.15 AU, HD 106315 c hints that planets may form out of broadly similar material and arrive at vastly different orbits later in their evolution.


title: An Algorithm to Generate Random Factored Smooth Integers

abstract: Let $x\ge y>0$ be integers. We present an algorithm that will generate an integer $n\le x$ at random, with known prime factorization, such that every prime divisor of $n$ is $\le y$. Further, asymptotically, $n$ is chosen uniformly from among all integers $\le x$ that have no prime divisors $>y$. In particular, if we assume the Extended Riemann Hypothesis, then with probability $1-o(1)$, the average running time of our algorithm is $$ O\left( \frac{ (\log x)^3 }{\log\log x} \right) $$ arithmetic operations. We also present other running times based on differing sets of assumptions and heuristics.


title: Safety-guaranteed Reinforcement Learning based on Multi-class Support Vector Machine

abstract: Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of satisfying hard state constraints in a model-free RL setting with the deterministic system dynamics. The proposed algorithm is developed for the discrete state and action space and utilizes a multi-class support vector machine (SVM) to represent the policy. The state constraints are incorporated in the SVM optimization framework to derive an analytical solution for determining the policy parameters. This final policy converges to a solution which is guaranteed to satisfy the constraints. Additionally, the proposed formulation adheres to the Q-learning framework and thus, also guarantees convergence to the optimal solution. The algorithm is demonstrated with multiple example problems.


title: Efficient simulation of ruin probabilities when claims are mixtures of heavy and light tails

abstract: We consider the classical Cram\'er-Lundberg risk model with claim sizes that are mixtures of phase-type and subexponential variables. Exploiting a specific geometric compound representation, we propose control variate techniques to efficiently simulate the ruin probability in this situation. The resulting estimators perform well for both small and large initial capital. We quantify the variance reduction as well as the efficiency gain of our method over another fast standard technique based on the classical Pollaczek-Khinchine formula. We provide a numerical example to illustrate the performance, and show that for more time-consuming conditional Monte Carlo techniques, the new series representation also does not compare unfavorably to the one based on the Pollaczek- Khinchine formula.


title: Entanglement and correlation in two-nucleon systems

abstract: We examine the mode entanglement and correlation of two fermionic particles. We study the one- and two-mode entropy and a global characteristic, the one-body entanglement entropy. We consider not only angular momentum coupled states with single configuration but use the configuration interaction method. With the help of the Slater decomposition, we derive analytical expressions for the entanglement measures. We show that when the total angular momentum is zero specific single configurations describe maximally entangled states. It turns out that for a finite number of associated modes the one- and two-mode entropies have identical values. In the shell model framework, we numerically study two valence neutrons in the $sd$ shell. The one-body entanglement entropy of the ground state is close to the maximal value and the associated modes have the largest mutual information.


title: Sleeping is Efficient: MIS in $O(1)$-rounds Node-averaged Awake Complexity

abstract: Maximal Independent Set (MIS) is one of the fundamental problems in distributed computing. The round (time) complexity of distributed MIS has traditionally focused on the \emph{worst-case time} for all nodes to finish. The best-known (randomized) MIS algorithms take $O(\log{n})$ worst-case rounds on general graphs (where $n$ is the number of nodes). Motivated by the goal to reduce \emph{total} energy consumption in energy-constrained networks such as sensor and ad hoc wireless networks, we take an alternative approach to measuring performance. We focus on minimizing the total (or equivalently, the \emph{average}) time for all nodes to finish. It is not clear whether the currently best-known algorithms yield constant-round (or even $o(\log{n})$) node-averaged round complexity for MIS in general graphs. We posit the \emph{sleeping model}, a generalization of the traditional model, that allows nodes to enter either ``sleep'' or ``waking'' states at any round. While waking state corresponds to the default state in the traditional model, in sleeping state a node is ``offline'', i.e., it does not send or receive messages (and messages sent to it are dropped as well) and does not incur any time, communication, or local computation cost. Hence, in this model, only rounds in which a node is awake are counted and we are interested in minimizing the average as well as the worst-case number of rounds a node spends in the awake state. Our main result is that we show that {\em MIS can be solved in (expected) $O(1)$ rounds under node-averaged awake complexity measure} in the sleeping model. In particular, we present a randomized distributed algorithm for MIS that has expected {\em $O(1)$-rounds node-averaged awake complexity} and, with high probability has {\em $O(\log{n})$-rounds worst-case awake complexity} and {\em $O(\log^{3.41}n)$-rounds worst-case complexity}.


title: A Unified Learning Platform for Dynamic Frequency Scaling in Pipelined Processors

abstract: A machine learning (ML) design framework is proposed for dynamically adjusting clock frequency based on propagation delay of individual instructions. A Random Forest model is trained to classify propagation delays in real-time, utilizing current operation type, current operands, and computation history as ML features. The trained model is implemented in Verilog as an additional pipeline stage within a baseline processor. The modified system is simulated at the gate-level in 45 nm CMOS technology, exhibiting a speed-up of 68% and energy reduction of 37% with coarse-grained ML classification. A speed-up of 95% is demonstrated with finer granularities at additional energy costs.


title: Empirical Observability Gramian for Stochastic Observability of Nonlinear Systems

abstract: We extend observability metrics based on the empirical observability Gramian from deterministic nonlinear systems to nonlinear stochastic systems in order to capture the impact of process noise on observability. We demonstrate that the empirical observability Gramian can be used to provide an equivalent condition for a definition of stochastic observability on linear systems, and that the Gramian can be used to extend stochastic observability to nonlinear stochastic systems. We further demonstrate through simulation that consideration of process noise can reveal observability in systems that would be considered unobservable using traditional deterministic tools.


title: Secure Route Planning Using Dynamic Games with Stopping States

abstract: We consider the classic motion planning problem defined over a roadmap in which a vehicle seeks to find an optimal path from a source to a destination in presence of an attacker who can launch attacks on the vehicle over any edge of the roadmap. The vehicle (defender) has the capability to switch on/off a countermeasure that can detect and permanently disable the attack if it occurs concurrently. We model the problem of traveling along en edge using the framework of a simultaneous zero-sum dynamic game (edge-game) with a stopping state played between an attacker and defender. We characterize the Nash equiliria of an edge-game and provide closed form expressions for two actions per player. We further provide an analytic and approximate expression on the value of an edge-game and characterize conditions under which it grows sub-linearly with the number of stages. We study the sensitivity of Nash equilibrium to the (i) cost of using the countermeasure, (ii) cost of motion and (iii) benefit of disabling the attack. The solution of an edge-game is used to formulate and solve for the secure planning problem known as a meta-game. We design an efficient heuristic by converting the problem to a shortest path problem using the edge cost as the solution of corresponding edge-games. We illustrate our findings through several insightful simulations.


title: Returning the Favor: What Wireless Networking Can Offer to AI and Edge Learning

abstract: Machine learning (ML) and artificial intelligence (AI) have recently made a significant impact on improving the operations of wireless networks and establishing intelligence at the edge. In return, rare efforts were made to explore how adapting, optimizing, and arranging wireless networks can contribute to implementing ML/AI at the edge. This article aims to address this void by setting a vision on how wireless networking researchers can leverage their expertise to return the favor to edge learning. It will review the enabling technologies, summarize the inaugural works on this path, and shed light on different directions to establish a comprehensive framework for mobile edge learning (MEL).


title: Fast Maximum Likelihood Estimation and Supervised Classification for the Beta-Liouville Multinomial

abstract: The multinomial and related distributions have long been used to model categorical, count-based data in fields ranging from bioinformatics to natural language processing. Commonly utilized variants include the standard multinomial and the Dirichlet multinomial distributions due to their computational efficiency and straightforward parameter estimation process. However, these distributions make strict assumptions about the mean, variance, and covariance between the categorical features being modeled. If these assumptions are not met by the data, it may result in poor parameter estimates and loss in accuracy for downstream applications like classification. Here, we explore efficient parameter estimation and supervised classification methods using an alternative distribution, called the Beta-Liouville multinomial, which relaxes some of the multinomial assumptions. We show that the Beta-Liouville multinomial is comparable in efficiency to the Dirichlet multinomial for Newton-Raphson maximum likelihood estimation, and that its performance on simulated data matches or exceeds that of the multinomial and Dirichlet multinomial distributions. Finally, we demonstrate that the Beta-Liouville multinomial outperforms the multinomial and Dirichlet multinomial on two out of four gold standard datasets, supporting its use in modeling data with low to medium class overlap in a supervised classification context.


title: Conformable Fractional Isothermal Gas Spheres

abstract: The isothermal gas sphere is well known as a powerful tool to model many problems in astrophysics, physics, chemistry, and engineering. This singular differential equation has not an exact solution and solved only by numerical and approximate methods. In the present paper and within the framework of the Newtonian hydrostatic equilibrium, we have developed general analytical formulations for the fractional isothermal gas sphere. To obtain analytical expressions for mass, radius, and density, besides the fractional isothermal gas sphere, we used the conformable fractional calculus. Using the series expansion method, we obtained a general recurrences relation, which allows us to determine the series coefficients. The comparison of the series solution with the numerical ones for the fractional parameter \alpha=1 is good for dimensional parameters up to x=3.2, beyond this value, the series diverges. We applied a combination of Euler-Abel and Pade techniques to accelerate the series, therefore accelerated series converge to the numerical desired value. We analyzed some physical parameters of a typical model of the neutron stars such as the mass-radius relation, density, and pressure ratio for different models. We found that the current models of the conformable neutron stars had smaller volumes and masses than both stars in the context of modified Rienmann-Liouville derivatives as well as the integer one.


title: Evidence of Crowding on Russell 3000 Reconstitution Events

abstract: We develop a methodology which replicates in great accuracy the FTSE Russell indexes reconstitutions, including the quarterly rebalancings due to new initial public offerings (IPOs). While using only data available in the CRSP US Stock database for our index reconstruction, we demonstrate the accuracy of this methodology by comparing it to the original Russell US indexes for the time period between 1989 to 2019. A python package that generates the replicated indexes is also provided. As an application, we use our index reconstruction protocol to compute the permanent and temporary price impact on the Russell 3000 annual additions and deletions, and on the quarterly additions of new IPOs . We find that the index portfolios following the Russell 3000 index and rebalanced on an annual basis are overall more crowded than those following the index on a quarterly basis. This phenomenon implies that transaction costs of indexing strategies could be significantly reduced by buying new IPOs additions in proximity to quarterly rebalance dates.


title: Detangling robustness in high dimensions: composite versus model-averaged estimation

abstract: Robust methods, though ubiquitous in practice, are yet to be fully understood in the context of regularized estimation and high dimensions. Even simple questions become challenging very quickly. For example, classical statistical theory identifies equivalence between model-averaged and composite quantile estimation. However, little to nothing is known about such equivalence between methods that encourage sparsity. This paper provides a toolbox to further study robustness in these settings and focuses on prediction. In particular, we study optimally weighted model-averaged as well as composite $l_1$-regularized estimation. Optimal weights are determined by minimizing the asymptotic mean squared error. This approach incorporates the effects of regularization, without the assumption of perfect selection, as is often used in practice. Such weights are then optimal for prediction quality. Through an extensive simulation study, we show that no single method systematically outperforms others. We find, however, that model-averaged and composite quantile estimators often outperform least-squares methods, even in the case of Gaussian model noise. Real data application witnesses the method's practical use through the reconstruction of compressed audio signals.


title: Projection Robust Wasserstein Distance and Riemannian Optimization

abstract: Projection robust Wasserstein (PRW) distance, or Wasserstein projection pursuit (WPP), is a robust variant of the Wasserstein distance. Recent work suggests that this quantity is more robust than the standard Wasserstein distance, in particular when comparing probability measures in high-dimensions. However, it is ruled out for practical application because the optimization model is essentially non-convex and non-smooth which makes the computation intractable. Our contribution in this paper is to revisit the original motivation behind WPP/PRW, but take the hard route of showing that, despite its non-convexity and lack of nonsmoothness, and even despite some hardness results proved by~\citet{Niles-2019-Estimation} in a minimax sense, the original formulation for PRW/WPP \textit{can} be efficiently computed in practice using Riemannian optimization, yielding in relevant cases better behavior than its convex relaxation. More specifically, we provide three simple algorithms with solid theoretical guarantee on their complexity bound (one in the appendix), and demonstrate their effectiveness and efficiency by conducing extensive experiments on synthetic and real data. This paper provides a first step into a computational theory of the PRW distance and provides the links between optimal transport and Riemannian optimization.


title: Consistent Estimation of Identifiable Nonparametric Mixture Models from Grouped Observations

abstract: Recent research has established sufficient conditions for finite mixture models to be identifiable from grouped observations. These conditions allow the mixture components to be nonparametric and have substantial (or even total) overlap. This work proposes an algorithm that consistently estimates any identifiable mixture model from grouped observations. Our analysis leverages an oracle inequality for weighted kernel density estimators of the distribution on groups, together with a general result showing that consistent estimation of the distribution on groups implies consistent estimation of mixture components. A practical implementation is provided for paired observations, and the approach is shown to outperform existing methods, especially when mixture components overlap significantly.


title: An Improved Semi-Supervised VAE for Learning Disentangled Representations

abstract: Learning interpretable and disentangled representations is a crucial yet challenging task in representation learning. In this work, we focus on semi-supervised disentanglement learning and extend work by Locatello et al. (2019) by introducing another source of supervision that we denote as label replacement. Specifically, during training, we replace the inferred representation associated with a data point with its ground-truth representation whenever it is available. Our extension is theoretically inspired by our proposed general framework of semi-supervised disentanglement learning in the context of VAEs which naturally motivates the supervised terms commonly used in existing semi-supervised VAEs (but not for disentanglement learning). Extensive experiments on synthetic and real datasets demonstrate both quantitatively and qualitatively the ability of our extension to significantly and consistently improve disentanglement with very limited supervision.


title: Learning Causal Models Online

abstract: Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization. One solution for achieving strong generalization is to incorporate causal structures in the models; such structures constrain learning by ignoring correlations that contradict them. However, learning these structures is a hard problem in itself. Moreover, it's not clear how to incorporate the machinery of causality with online continual learning. In this work, we take an indirect approach to discovering causal models. Instead of searching for the true causal model directly, we propose an online algorithm that continually detects and removes spurious features. Our algorithm works on the idea that the correlation of a spurious feature with a target is not constant over-time. As a result, the weight associated with that feature is constantly changing. We show that by continually removing such features, our method converges to solutions that have strong generalization. Moreover, our method combined with random search can also discover non-spurious features from raw sensory data. Finally, our work highlights that the information present in the temporal structure of the problem -- destroyed by shuffling the data -- is essential for detecting spurious features online.


title: Generalized Quasi-Einstein Manifolds in Contact Geometry

abstract: In this study, we investigate generalized quasi-Einstein structure for normal metric contact pair manifolds. Firstly, we deal with elementary properties and examine, existence, and characterizations of generalized quasi-Einstein normal metric contact pair manifold. Secondly, the generalized quasi-constant curvature of normal metric contact pair manifolds are studied and it is proven that a normal metric contact pair manifold with generalized quasi-constant curvature is a generalized quasi-Einstein manifold. Normal metric contact pair manifolds satisfying cyclic Ricci tensor and the Codazzi type of Ricci tensor are considered and its shown that a generalized quasi-Einstein normal metric contact pair manifold does not satisfy Codazzi type of Ricci tensor. Finally, we work on normal metric contact pair manifolds satisfying certain curvature conditions related to $ \mathcal{M}- $projective, conformal, and concircular curvature tensors. We show that a normal metric contact pair manifold with generalized quasi-constant curvature is locally isometric to the Hopf manifold $ S^{2n+1}(1) \times S^1 $.


title: Phase-type approximations perturbed by a heavy-tailed component for the Gerber-Shiu function of risk processes with two-sided jumps

abstract: We consider in this paper a risk reserve process where the claims and gains arrive according to two independent Poisson processes. While the gain sizes are phase-type distributed, we assume instead that the claim sizes are phase-type perturbed by a heavy-tailed component; that is, the claim size distribution is formally chosen to be phase-type with large probability $1-\epsilon$ and heavy-tailed with small probability $\epsilon$. We analyze the seminal Gerber-Shiu function coding the joint distribution of the time to ruin, the surplus immediately before ruin, and the deficit at ruin. We derive its value as an expansion with respect to powers of $\epsilon$ with known coefficients and we construct approximations from the first two terms of the aforementioned series. The main idea is based on the so-called fluid embedding that allows to put the considered risk process into the framework of spectrally negative Markov-additive processes and use its fluctuation theory developed in Ivanovs and Palmowski (2012).


title: Hypermodels for Exploration

abstract: We study the use of hypermodels to represent epistemic uncertainty and guide exploration. This generalizes and extends the use of ensembles to approximate Thompson sampling. The computational cost of training an ensemble grows with its size, and as such, prior work has typically been limited to ensembles with tens of elements. We show that alternative hypermodels can enjoy dramatic efficiency gains, enabling behavior that would otherwise require hundreds or thousands of elements, and even succeed in situations where ensemble methods fail to learn regardless of size. This allows more accurate approximation of Thompson sampling as well as use of more sophisticated exploration schemes. In particular, we consider an approximate form of information-directed sampling and demonstrate performance gains relative to Thompson sampling. As alternatives to ensembles, we consider linear and neural network hypermodels, also known as hypernetworks. We prove that, with neural network base models, a linear hypermodel can represent essentially any distribution over functions, and as such, hypernetworks are no more expressive.


title: Dirac operator on the quantum fuzzy four-sphere $ S_{qF}^{4} $

abstract: The q-deformed fuzzy Dirac and chirality operators on quantum fuzzy four-sphere $ S^{4}_{qF} $. Using the q-deformed fuzzy Ginsparg-Wilson algebra, it has been studied the q-deformed fuzzy Dirac and chirality operators in instanton and no-instanton sector. Also, gauged Dirac and chirality operators in both cases have been constructed. It has been showed that In each step our results have correct commutative limit in the limit case when $ q\longrightarrow1 $ and noncommutative parameter $ l $ tends to infinity.


title: Asymptotics for moist deep convection I: Refined scalings and self-sustaining updrafts

abstract: Moist processes are among the most important drivers of atmospheric dynamics,and scale analysis and asymptotics are cornerstones of theoretical meteorology. Accounting for moist processes in systematic scale analyses therefore seems of considerable importance for the field. Klein & Majda (TCFD, 20, 525--552, (2006)) proposed a scaling regime for the incorporation of moist bulk microphysics closures in multiscale asymptotic analyses of tropical deep convection. This regime is refined here to allow for mixtures of ideal gases and to establish consistency with a more general multiple scales modelling framework for atmospheric flows. Deep narrow updrafts, so-called "hot towers", constitute principal building blocks of larger scale storm systems. They are analysed here in a sample application of the new scaling regime. A single quasi-onedimensional columnar cloud is considered on the vertical advective (or tower life cycle) time scale. The refined asymptotic scaling regime is essential for this example as it reveals a new mechanism for the self-sustainance of such updrafts. Even for strongly positive convectively available potential energy (CAPE), a vertical balance of buoyancy forces is found in the presence of precipitation. This balance induces a diagnostic equation for the vertical velocity and it is responsible for the generation of self-sustained balanced updrafts. The time dependent updraft structure is encoded in a Hamilton-Jacobi equation for the precipitation mixing ratio. Numerical solutions of this equation suggest that the self-sustained updrafts may strongly enhance hot tower life cycles.


title: The J-PET detector -- a tool for precision studies of ortho-positronium decays

abstract: The J-PET tomograph is constructed from plastic scintillator strips arranged axially in concentric cylindrical layers. It enables investigations of positronium decays by measurement of the time, position, polarization and energy deposited by photons in the scintillators, in contrast to studies conducted so far with crystal and semiconductor based detection systems where the key selection of events is based on the measurement of the photons energies. In this article we show that the J-PET tomograph system is capable of exclusive measurements of the decays of ortho-positronium atoms. We present the first positronium production results, its lifetime distribution measurements and discuss estimation of the influence of various background sources. The tomograph s performance demonstrated here makes it suitable for precision studies of positronium decays including entanglement of the final state photons, positron annihilation lifetime spectroscopy plus molecular imaging diagnostics.


title: Dirac's Classical-Quantum Analogy for the Harmonic Oscillator: Classical Aspects in Thermal Radiation Including Zero-Point Radiation

abstract: Dirac's Poisson-bracket-to-commutator analogy for the transition from classical to quantum mechanics assures that for many systems, the classical and quantum systems share the same algebraic structure. The quantum side of the analogy (involving operators on Hilbert space with commutators scaled by Planck's constant $\hbar$) not only gives the algebraic structure but also dictates the average values of physical quantities in the quantum ground state. On the other hand, the Poisson brackets of nonrelativistic mechanics, which give only the classical canonical transformations, do not give any values for physical quantities. Rather, one must go outside nonrelativistic classical mechanics in order to obtain a fundamental phase space distribution for classical physics. We assume that the values of physical quantities in classical theory at any temperature depend on the phase space probability distribution which arises from thermal radiation equilibrium including classical zero-point radiation with the scale set by Planck's constant $\hbar$. All mechanical systems in thermal radiation will inherit the constant $\hbar$ from thermal radiation. Here we note the connections between classical and quantum theories (agreement and contrasts) at all temperatures for the harmonic oscillator in one and three spatial dimensions.


title: TURB-Rot. A large database of 3d and 2d snapshots from turbulent rotating flows

abstract: We present TURB-Rot, a new open database of 3d and 2d snapshots of turbulent velocity fields, obtained by Direct Numerical Simulations (DNS) of the original Navier-Stokes equations in the presence of rotation. The aim is to provide the community interested in data-assimilation and/or computer vision with a new testing-ground made of roughly 300K complex images and fields. TURB-Rot data are characterized by multi-scales strongly non-Gaussian features and rough, non-differentiable, fields over almost two decades of scales. In addition, coming from fully resolved numerical simulations of the original partial differential equations, they offer the possibility to apply a wide range of approaches, from equation-free to physics-based models. TURB-Rot data are reachable at http://smart-turb.roma2.infn.it

categories: physics.flu-dyn cs.CV physics.data-an physics.geo-ph stat.ML


title: Integrated-photonic characterization of single-photon detectors for use in neuromorphic synapses

abstract: We show several techniques for using integrated-photonic waveguide structures to simultaneously characterize multiple waveguide-integrated superconducting-nanowire detectors with a single fiber input. The first set of structures allows direct comparison of detector performance of waveguide-integrated detectors with various widths and lengths. The second type of demonstrated integrated-photonic structure allows us to achieve detection with a high dynamic range. This device allows a small number of detectors to count photons across many orders of magnitude in count rate. However, we find a stray light floor of -30 dB limits the dynamic range to three orders of magnitude. To assess the utility of the detectors for use in synapses in spiking neural systems, we measured the response with average incident photon numbers ranging from less than $10^{-3}$ to greater than $10$. The detector response is identical across this entire range, indicating that synaptic responses based on these detectors will be independent of the number of incident photons in a communication pulse. Such a binary response is ideal for communication in neural systems. We further demonstrate that the response has a linear dependence of output current pulse height on bias current with up to a factor of 1.7 tunability in pulse height. Throughout the work, we compare room-temperature measurements to cryogenic measurements. The agreement indicates room-temperature measurements can be used to determine important properties of the detectors.


title: Common Envelope Wind Tunnel: Range of Applicability and Self-Similarity in Realistic Stellar Envelopes

abstract: Common envelope evolution, the key orbital tightening phase of the traditional formation channel for close binaries, is a multistage process that presents many challenges to the establishment of a fully descriptive, predictive theoretical framework. In an approach complementary to global 3D hydrodynamical modeling, we explore the range of applicability for a simplified drag formalism that incorporates the results of local hydrodynamic "wind tunnel" simulations into a semi-analytical framework in the treatment of the common envelope dynamical inspiral phase using a library of realistic giant branch stellar models across the low, intermediate, and high mass regimes. In terms of a small number of key dimensionless parameters, we characterize a wide range of common envelope events, revealing the broad range of applicability of the drag formalism as well its self-similar nature across mass regimes and ages. Limitations arising from global binary properties and local structural quantities are discussed together with the opportunity for a general prescriptive application for this formalism.


title: Learning-to-Learn Personalised Human Activity Recognition Models

abstract: Human Activity Recognition~(HAR) is the classification of human movement, captured using one or more sensors either as wearables or embedded in the environment~(e.g. depth cameras, pressure mats). State-of-the-art methods of HAR rely on having access to a considerable amount of labelled data to train deep architectures with many train-able parameters. This becomes prohibitive when tasked with creating models that are sensitive to personal nuances in human movement, explicitly present when performing exercises. In addition, it is not possible to collect training data to cover all possible subjects in the target population. Accordingly, learning personalised models with few data remains an interesting challenge for HAR research. We present a meta-learning methodology for learning to learn personalised HAR models for HAR; with the expectation that the end-user need only provides a few labelled data but can benefit from the rapid adaptation of a generic meta-model. We introduce two algorithms, Personalised MAML and Personalised Relation Networks inspired by existing Meta-Learning algorithms but optimised for learning HAR models that are adaptable to any person in health and well-being applications. A comparative study shows significant performance improvements against the state-of-the-art Deep Learning algorithms and the Few-shot Meta-Learning algorithms in multiple HAR domains.


title: Tensor-Krylov method for computing eigenvalues of parameter-dependent matrices

abstract: In this paper we extend the Residual Arnoldi method for calculating an extreme eigenvalue (e.g. largest real part, dominant,...) to the case where the matrices depend on parameters. The difference between this Arnoldi method and the classical Arnoldi algorithm is that in the former the residual is added to the subspace. We develop a Tensor-Krylov method that applies the Residual Arnoldi method (RA) for a grid of parameter points at the same time. The subspace contains an approximate Krylov space for all these points. Instead of adding the residuals for all parameter values to the subspace we create a low-rank approximation of the matrix consisting of these residuals and add only the column space to the subspace. In order to keep the computations efficient, it is needed to limit the dimension of the subspace and to restart once the subspace has reached the prescribed maximal dimension. The novelty of this approach is twofold. Firstly, we observed that a large error in the low-rank approximations is allowed without slowing down the convergence, which implies that we can do more iterations before restarting. Secondly, we pay particular attention to the way the subspace is restarted, since classical restarting techniques give a too large subspace in our case. We motivate why it is good enough to just keep the approximation of the searched eigenvector. At the end of the paper we extend this algorithm to shift-and-invert Residual Arnoldi method to calculate the eigenvalue close to a shift $\sigma$ for a specific parameter dependency. We provide theoretical results and report numerical experiments. The Matlab code is publicly available.


title: The undirected repetition threshold and undirected pattern avoidance

abstract: For a rational number $r$ such that $1<r\leq 2$, an undirected $r$-power is a word of the form $xyx'$, where the word $x$ is nonempty, the word $x'$ is in $\{x,x^R\}$, and we have $|xyx'|/|xy|=r$. The undirected repetition threshold for $k$ letters, denoted $\mbox{URT}(k)$, is the infimum of the set of all $r$ such that undirected $r$-powers are avoidable on $k$ letters. We first demonstrate that $\mbox{URT}(3)=\tfrac{7}{4}$. Then we show that $\mbox{URT}(k)\geq \tfrac{k-1}{k-2}$ for all $k\geq 4$. We conjecture that $\mbox{URT}(k)=\tfrac{k-1}{k-2}$ for all $k\geq 4$, and we confirm this conjecture for $k\in\{4,5,\ldots,21\}.$ We then consider related problems in pattern avoidance; in particular, we find the undirected avoidability index of every binary pattern. This is an extended version of a paper presented at WORDS 2019, and it contains new and improved results.


title: Early Blindness Detection Based on Retinal Images Using Ensemble Learning

abstract: Diabetic retinopathy (DR) is the primary cause of vision loss among grownup people around the world. In four out of five cases having diabetes for a prolonged period leads to DR. If detected early, more than 90 percent of the new DR occurrences can be prevented from turning into blindness through proper treatment. Despite having multiple treatment procedures available that are well capable to deal with DR, the negligence and failure of early detection cost most of the DR patients their precious eyesight. The recent developments in the field of Digital Image Processing (DIP) and Machine Learning (ML) have paved the way to use machines in this regard. The contemporary technologies allow us to develop devices capable of automatically detecting the condition of a persons eyes based on their retinal images. However, in practice, several factors hinder the quality of the captured images and impede the detection outcome. In this study, a novel early blind detection method has been proposed based on the color information extracted from retinal images using an ensemble learning algorithm. The method has been tested on a set of retinal images collected from people living in the rural areas of South Asia, which resulted in a 91 percent classification accuracy.


title: Combining Model-Based and Model-Free Methods for Nonlinear Control: A Provably Convergent Policy Gradient Approach

abstract: Model-free learning-based control methods have seen great success recently. However, such methods typically suffer from poor sample complexity and limited convergence guarantees. This is in sharp contrast to classical model-based control, which has a rich theory but typically requires strong modeling assumptions. In this paper, we combine the two approaches to achieve the best of both worlds. We consider a dynamical system with both linear and non-linear components and develop a novel approach to use the linear model to define a warm start for a model-free, policy gradient method. We show this hybrid approach outperforms the model-based controller while avoiding the convergence issues associated with model-free approaches via both numerical experiments and theoretical analyses, in which we derive sufficient conditions on the non-linear component such that our approach is guaranteed to converge to the (nearly) global optimal controller.


title: Real-time coupled-cluster approach for the cumulant Green's function

abstract: Green's function methods within many-body perturbation theory provide a general framework for treating electronic correlations in excited states. Here we investigate the cumulant form of the one-electron Green's function based on the coupled-cluster equation of motion approach in an extension of our previous study. The approach yields a non-perturbative expression for the cumulant in terms of the solution to a set of coupled first order, non-linear differential equations. The method thereby adds non-linear corrections to traditional cumulant methods linear in the self energy. The approach is applied to the core-hole Green's function and illustrated for a number of small molecular systems. For these systems we find that the non-linear contributions lead to significant improvements both for quasiparticle properties such as core-level binding energies, as well as the satellites corresponding to inelastic losses observed in photoemission spectra.


title: Streaming Computations with Region-Based State on SIMD Architectures

abstract: Streaming computations on massive data sets are an attractive candidate for parallelization, particularly when they exhibit independence (and hence data parallelism) between items in the stream. However, some streaming computations are stateful, which disrupts independence and can limit parallelism. In this work, we consider how to extract data parallelism from streaming computations with a common, limited form of statefulness. The stream is assumed to be divided into variably-sized regions, and items in the same region are processed in a common context of state. In general, the computation to be performed on a stream is also irregular, with each item potentially undergoing different, data-dependent processing. This work describes mechanisms to implement such computations efficiently on a SIMD-parallel architecture such as a GPU. We first develop a low-level protocol by which a data stream can be augmented with control signals that are delivered to each stage of a computation at precise points in the stream. We then describe an abstraction, enumeration and aggregation, by which an application developer can specify the behavior of a streaming application with region-based state. Finally, we study an implementation of our ideas as part of the MERCATOR system for irregular streaming computations on GPUs, investigating how the frequency of region boundaries in a stream impacts SIMD occupancy and hence application performance.


title: Stability and dynamics of optically levitated dielectric disks in a Gaussian standing wave beyond the harmonic approximation

abstract: Forces and torques exerted on dielectric disks trapped in a Gaussian standing wave are analyzed theoretically for disks of radius $2~\mu\text{m}$ with index of refraction $n=1.45$ and $n=2.0$ as well as disks of radius 200 nm with $n=1.45$. Calculations of the forces and torques were conducted both analytically and numerically using a discrete-dipole approximation method. Besides harmonic terms, third order ro-translational coupling terms in the potential energy can be significant and a necessary consideration when describing the dynamics of disks outside of the Rayleigh limit. The coupling terms are a result of the finite extension of the disk coupling to both the Gaussian and standing wave geometry of the beam. The resulting dynamics of the degrees of freedom most affected by the coupling terms exhibit several sidebands as evidenced in the power spectral densities. Simulations show that for Gaussian beam waists of $1-4~\mu\text{m}$ the disk remains stably trapped.


title: Improved Generalized Raking Estimators to Address Dependent Covariate and Failure-Time Outcome Error

abstract: Biomedical studies that use electronic health records (EHR) data for inference are often subject to bias due to measurement error. The measurement error present in EHR data is typically complex, consisting of errors of unknown functional form in covariates and the outcome, which can be dependent. To address the bias resulting from such errors, generalized raking has recently been proposed as a robust method that yields consistent estimates without the need to model the error structure. We provide rationale for why these previously proposed raking estimators can be expected to be inefficient in failure-time outcome settings involving misclassification of the event indicator. We propose raking estimators that utilize multiple imputation, to impute either the target variables or auxiliary variables, to improve the efficiency. We also consider outcome-dependent sampling designs and investigate their impact on the efficiency of the raking estimators, either with or without multiple imputation. We present an extensive numerical study to examine the performance of the proposed estimators across various measurement error settings. We then apply the proposed methods to our motivating setting, in which we seek to analyze HIV outcomes in an observational cohort with electronic health records data from the Vanderbilt Comprehensive Care Clinic.


title: Novel Approaches to Renormalization Group Transformations in the Continuum and on the Lattice

abstract: This thesis is about new methods of achieving RG transformations, in both a continuum spacetime background and on a lattice discretization thereof. The subject is explored from the point of view of euclidean quantum field theory. As a thesis grounded on the computational method of lattice simulation, I emphasize the role of lattice formulations throughout the work, especially in the first two chapters. In the first, I describe the essential aspects of lattice theory and its symbiosis with RG. In the second, I present a new, continuous approach to RG on the lattice, based on a numerical tool called Gradient Flow (GF). Simulation results from quartic scalar field theory in 2 and 3 dimensions ($\phi^4_d$) and 4-dimensional 12-flavor SU(3) gauge theory will be presented. In the third and fourth chapters, the focus becomes more analytic. Chapter 3 is an introductory review of Functional Renormalization Group (FRG). In chapter 4, I introduce the concept of Stochastic RG (SRG) by working out the relationship between FRG and stochastic processes.


title: Deciphering the properties of the central engine in GRB collapsars

abstract: The central engine in long gamma-ray bursts (GRBs) is thought to be a compact object produced by the core collapse of massive stars, but its exact nature (black hole or millisecond magnetar) is still debatable. Although the central engine of GRB collapsars is hidden to direct observation, its properties may be imprinted on the accompanying electromagnetic signals. We aim to decipher the generic properties of central engines that are consistent with prompt observations of long GRBs detected by the Burst Alert Telescope (BAT) on board the Neil Gehrels Swift Observatory. Adopting a generic model for the central engine, in which the engine power and activity timescale are independent of each other, we perform Monte Carlo simulations of long GRBs produced by jets that successfully breakout from the star. Our simulations consider the dependence of the jet breakout timescale on the engine luminosity and the effects of the detector's flux threshold. The two-dimensional (2D) distribution of simulated detectable bursts in the gamma-ray luminosity versus gamma-ray duration plane is consistent with the observed one for a range of parameter values describing the central engine. The intrinsic 2D distribution of simulated collapsar GRBs peaks at lower gamma-ray luminosities and longer durations than the observed one, a prediction that can be tested in the future with more sensitive detectors. Black-hole accretors, whose power and activity time are set by the large-scale magnetic flux through the progenitor star and stellar structure, respectively, are compatible with the properties of the central engine inferred by our model.


title: Atmospheric Temperature Inversions and He I 5876 Core Profile Structure in White Dwarfs

abstract: We report distinctive core profiles in the strongest optical helium line, He I 5876, from high-resolution high-sensitivity observations of spectral type DB white dwarfs. By analyzing a sample of 40 stars from Keck/HIRES and VLT/UVES, we find the core appearance to be related to the degree of hydrogen and heavy element content in the atmosphere. New Ca K-line measurements or upper limits are reported for about half the sample stars. He I 5876 emission cores with a self-reversed central component are present for those stars with relatively low hydrogen abundance, as well as relatively low atmospheric heavy element pollution. This self-reversed structure disappears for stars with higher degrees of pollution and/or hydrogen abundance, giving way to a single absorption core. From our model atmospheres, we show that the self-reversed emission cores can be explained by temperature inversions in the upper atmosphere. We propose that the transition to a single absorption core is due to the additional opacity from hydrogen and heavy elements that inhibits the temperature inversions. Our current models do not exactly match the effective temperature range of the phenomenon nor the amplitude of the self-reversed structure, which is possibly a result of missing physics such as 3D treatment, convective overshoot, and/or non-LTE effects. The He I 5876 line structure may prove to be a useful new diagnostic for calibrating temperature profiles in DB atmosphere models.


title: dagger: A Python Framework for Reproducible Machine Learning Experiment Orchestration

abstract: Many research directions in machine learning, particularly in deep learning, involve complex, multi-stage experiments, commonly involving state-mutating operations acting on models along multiple paths of execution. Although machine learning frameworks provide clean interfaces for defining model architectures and unbranched flows, burden is often placed on the researcher to track experimental provenance, that is, the state tree that leads to a final model configuration and result in a multi-stage experiment. Originally motivated by analysis reproducibility in the context of neural network pruning research, where multi-stage experiment pipelines are common, we present dagger, a framework to facilitate reproducible and reusable experiment orchestration. We describe the design principles of the framework and example usage.


title: Laser-Like Waves Amplification in Straits

abstract: We present the research of ocean surface wind waves excitation in non-homogeneous situations, on the example of deep water strait in presence of the constant wind, blowing perpendicular to the coastal line. The used statistical wave model is based on Hasselmann equation with high-wavenumbers wave-breaking dissipation, exact nonlinear four-waves interaction and ZRP wind input term. At the first stage, the waves propagate in the wind direction in a step-like moving front manner, which is the combination of self-similar fetch-limited and duration-limited solutions of Hasselmann equation. The second stage begins further, when sufficient amount of wave energy is concentrated at the incoming waves shore line. Beginning with that time, the nonlinear wave interactions start formation of the wave groups, propagating across and against the wind. Despite the absence of long-wave dissipation, the system asymptotically evolves into complicated quasi-stationary state, comprising of the self-similar ``wind sea'' in the wind direction, and quasi-monochromatic waves, radiated close to orthogonally with respect to the wind, while slightly tilting counter the wind direction with the angle increasing toward the wave turbulence origination shore line, and reaching $15^{\circ}$ close to it. The total wave energy in the asymptotic state surpasses the wave sea energy propagating along the wind by two times due to the presence of quasi-orthogonal and counter the wind wave fields. The very similar turbulence structure was previously observed experimentally, this paper presents theoretical explanation of these results. It is suggested to name this laser-like radiation phenomenon by Nonlinear Ocean Waves Amplifier, simplified to the abbreviation NOWA.


title: On Packing Low-Diameter Spanning Trees

abstract: Edge connectivity of a graph is one of the most fundamental graph-theoretic concepts. The celebrated tree packing theorem of Tutte and Nash-Williams from 1961 states that every $k$-edge connected graph $G$ contains a collection $\cal{T}$ of $\lfloor k/2 \rfloor$ edge-disjoint spanning trees, that we refer to as a tree packing; the diameter of the tree packing $\cal{T}$ is the largest diameter of any tree in $\cal{T}$. A desirable property of a tree packing, that is both sufficient and necessary for leveraging the high connectivity of a graph in distributed communication, is that its diameter is low. Yet, despite extensive research in this area, it is still unclear how to compute a tree packing, whose diameter is sublinear in $|V(G)|$, in a low-diameter graph $G$, or alternatively how to show that such a packing does not exist. In this paper we provide first non-trivial upper and lower bounds on the diameter of tree packing. First, we show that, for every $k$-edge connected $n$-vertex graph $G$ of diameter $D$, there is a tree packing $\cal{T}$ of size $\Omega(k)$, diameter $O((101k\log n)^D)$, that causes edge-congestion at most $2$. Second, we show that for every $k$-edge connected $n$-vertex graph $G$ of diameter $D$, the diameter of $G[p]$ is $O(k^{D(D+1)/2})$ with high probability, where $G[p]$ is obtained by sampling each edge of $G$ independently with probability $p=\Theta(\log n/k)$. This provides a packing of $\Omega(k/\log n)$ edge-disjoint trees of diameter at most $O(k^{(D(D+1)/2)})$ each. We then prove that these two results are nearly tight. Lastly, we show that if every pair of vertices in a graph has $k$ edge-disjoint paths of length at most $D$ connecting them, then there is a tree packing of size $k$, diameter $O(D\log n)$, causing edge-congestion $O(\log n)$. We also provide several applications of low-diameter tree packing in distributed computation.


title: Scalable Control Variates for Monte Carlo Methods via Stochastic Optimization

abstract: Control variates are a well-established tool to reduce the variance of Monte Carlo estimators. However, for large-scale problems including high-dimensional and large-sample settings, their advantages can be outweighed by a substantial computational cost. This paper considers control variates based on Stein operators, presenting a framework that encompasses and generalizes existing approaches that use polynomials, kernels and neural networks. A learning strategy based on minimising a variational objective through stochastic optimization is proposed, leading to scalable and effective control variates. Novel theoretical results are presented to provide insight into the variance reduction that can be achieved, and an empirical assessment, including applications to Bayesian inference, is provided in support.


title: The 4th Industrial Revolution Effect on the Enterprise Cyber Strategy

abstract: The Fourth (4th) Industrial Revolution represents the profound advancement of technology that will likely transform the boundaries between the digital and physical worlds in modern society. The impact of advance technology will disrupt almost every aspect of business and government communities alike. In the past few years, the advancement of information technologies has opened the door to artificial intelligence (AI), block chain technologies, robotics, virtual reality and the possibility of quantum computing being released in the commercial sector. The use of these innovative technologies will likely impact society by leveraging modern technological platforms such as cloud computing and AI. This also includes the release of 5G network technologies by Internet Service Providers (ISP) beginning in 2019. Networks that rely upon 5G technologies in combination with cloud computing platforms will open the door allow greater innovations and change the nature of how work is performed in the 4th Industrial Revolution.


title: Multispectral Biometrics System Framework: Application to Presentation Attack Detection

abstract: In this work, we present a general framework for building a biometrics system capable of capturing multispectral data from a series of sensors synchronized with active illumination sources. The framework unifies the system design for different biometric modalities and its realization on face, finger and iris data is described in detail. To the best of our knowledge, the presented design is the first to employ such a diverse set of electromagnetic spectrum bands, ranging from visible to long-wave-infrared wavelengths, and is capable of acquiring large volumes of data in seconds. Having performed a series of data collections, we run a comprehensive analysis on the captured data using a deep-learning classifier for presentation attack detection. Our study follows a data-centric approach attempting to highlight the strengths and weaknesses of each spectral band at distinguishing live from fake samples.


title: Understanding Unintended Memorization in Federated Learning

abstract: Recent works have shown that generative sequence models (e.g., language models) have a tendency to memorize rare or unique sequences in the training data. Since useful models are often trained on sensitive data, to ensure the privacy of the training data it is critical to identify and mitigate such unintended memorization. Federated Learning (FL) has emerged as a novel framework for large-scale distributed learning tasks. However, it differs in many aspects from the well-studied central learning setting where all the data is stored at the central server. In this paper, we initiate a formal study to understand the effect of different components of canonical FL on unintended memorization in trained models, comparing with the central learning setting. Our results show that several differing components of FL play an important role in reducing unintended memorization. Specifically, we observe that the clustering of data according to users---which happens by design in FL---has a significant effect in reducing such memorization, and using the method of Federated Averaging for training causes a further reduction. We also show that training with a strong user-level differential privacy guarantee results in models that exhibit the least amount of unintended memorization.


title: OrigamiNet: Weakly-Supervised, Segmentation-Free, One-Step, Full Page Text Recognition by learning to unfold

abstract: Text recognition is a major computer vision task with a big set of associated challenges. One of those traditional challenges is the coupled nature of text recognition and segmentation. This problem has been progressively solved over the past decades, going from segmentation based recognition to segmentation free approaches, which proved more accurate and much cheaper to annotate data for. We take a step from segmentation-free single line recognition towards segmentation-free multi-line / full page recognition. We propose a novel and simple neural network module, termed \textbf{OrigamiNet}, that can augment any CTC-trained, fully convolutional single line text recognizer, to convert it into a multi-line version by providing the model with enough spatial capacity to be able to properly collapse a 2D input signal into 1D without losing information. Such modified networks can be trained using exactly their same simple original procedure, and using only \textbf{unsegmented} image and text pairs. We carry out a set of interpretability experiments that show that our trained models learn an accurate implicit line segmentation. We achieve state-of-the-art character error rate on both IAM \& ICDAR 2017 HTR benchmarks for handwriting recognition, surpassing all other methods in the literature. On IAM we even surpass single line methods that use accurate localization information during training. Our code is available online at \url{https://github.com/IntuitionMachines/OrigamiNet}.


title: Probing Emergent Surface and Interfacial Properties in Complex Oxides via in situ X-ray Photoelectron Spectroscopy

abstract: Emergent behavior at complex oxide interfaces has driven much of the research in the oxide thin film community for the past twenty years. Interfaces have been engineered for potential applications in spintronics, topological quantum computing, and high-speed electronics in cases where the bulk materials would not exhibit the desired properties. Advances in thin film growth have made the synthesis of these interfaces possible, while surface characterization tools such as X-ray photoelectron spectroscopy have been critical to understanding surface and interfacial phenomena in these materials. In this review we discuss the leading research in the oxide field over the past 5-10 years with a focus on connecting the key results to the X-ray photoelectron spectroscopy studies that enabled them. We describe how in situ integration of synthesis and spectroscopy can be used to improve the film growth process and to perform immediate experiments on specifically tailored interfacial heterostructures. These studies can include determination of interfacial intermixing, valence band alignment, and interfacial charge transfer. We also show how advances in synchrotron-based spectroscopy techniques have answered questions that cannot be addressed in a lab-based system. By further tying together synthesis and spectroscopy through in situ techniques, we conclude by discussing future opportunities in the field through the careful design of thin film heterostructures that are optimized for X-ray studies.


title: Bayesian Additive Regression Trees with Model Trees

abstract: Bayesian Additive Regression Trees (BART) is a tree-based machine learning method that has been successfully applied to regression and classification problems. BART assumes regularisation priors on a set of trees that work as weak learners and is very flexible for predicting in the presence of non-linearity and high-order interactions. In this paper, we introduce an extension of BART, called Model Trees BART (MOTR-BART), that considers piecewise linear functions at node levels instead of piecewise constants. In MOTR-BART, rather than having a unique value at node level for the prediction, a linear predictor is estimated considering the covariates that have been used as the split variables in the corresponding tree. In our approach, local linearities are captured more efficiently and fewer trees are required to achieve equal or better performance than BART. Via simulation studies and real data applications, we compare MOTR-BART to its main competitors. R code for MOTR-BART implementation is available at https://github.com/ebprado/MOTR-BART.


title: Time-Domain Analysis of PWM Inverters

abstract: The time-domain analysis of pulse width modulated (PWM) single-phase inverters is presented for different load circuits. It is demonstrated that this analysis can be reduced to the solution of linear simultaneous algebraic equations with two diagonal matrices. Analytical solutions of such equations are easily found which leads to the explicit expressions for the output voltages and currents in terms of switching time-instants. This technique is presented for second and third order circuits, however it can be used in principle for any higher-order linear load circuit subject to pulse width modulated voltages.


title: Open Questions in Creating Safe Open-ended AI: Tensions Between Control and Creativity

abstract: Artificial life originated and has long studied the topic of open-ended evolution, which seeks the principles underlying artificial systems that innovate continually, inspired by biological evolution. Recently, interest has grown within the broader field of AI in a generalization of open-ended evolution, here called open-ended search, wherein such questions of open-endedness are explored for advancing AI, whatever the nature of the underlying search algorithm (e.g. evolutionary or gradient-based). For example, open-ended search might design new architectures for neural networks, new reinforcement learning algorithms, or most ambitiously, aim at designing artificial general intelligence. This paper proposes that open-ended evolution and artificial life have much to contribute towards the understanding of open-ended AI, focusing here in particular on the safety of open-ended search. The idea is that AI systems are increasingly applied in the real world, often producing unintended harms in the process, which motivates the growing field of AI safety. This paper argues that open-ended AI has its own safety challenges, in particular, whether the creativity of open-ended systems can be productively and predictably controlled. This paper explains how unique safety problems manifest in open-ended search, and suggests concrete contributions and research questions to explore them. The hope is to inspire progress towards creative, useful, and safe open-ended search algorithms.


title: Optimal Time-Domain Sinusoidal Pulse Width Modulation Technique

abstract: An optimal time-domain pulse width modulation technique is presented for single-phase and three-phase inverters under the constraint of sinusoidally modulated voltage pulse widths. Harmonic content in currents and voltages is expressed as function of displacement factors, which characterize the placement of the sinusoidally modulated voltage pulses in each sampling subinterval. Implications of symmetries on these displacement factors for three-phase inverters are discussed. Minimization of harmonics is stated as an optimization problem, which is then numerically solved to reveal improvements in harmonic performance.