title: Extreme Few-view CT Reconstruction using Deep Inference

abstract: Reconstruction of few-view x-ray Computed Tomography (CT) data is a highly ill-posed problem. It is often used in applications that require low radiation dose in clinical CT, rapid industrial scanning, or fixed-gantry CT. Existing analytic or iterative algorithms generally produce poorly reconstructed images, severely deteriorated by artifacts and noise, especially when the number of x-ray projections is considerably low. This paper presents a deep network-driven approach to address extreme few-view CT by incorporating convolutional neural network-based inference into state-of-the-art iterative reconstruction. The proposed method interprets few-view sinogram data using attention-based deep networks to infer the reconstructed image. The predicted image is then used as prior knowledge in the iterative algorithm for final reconstruction. We demonstrate effectiveness of the proposed approach by performing reconstruction experiments on a chest CT dataset.


title: AffWild Net and Aff-Wild Database

abstract: Emotions recognition is the task of recognizing people's emotions. Usually it is achieved by analyzing expression of peoples faces. There are two ways for representing emotions: The categorical approach and the dimensional approach by using valence and arousal values. Valence shows how negative or positive an emotion is and arousal shows how much it is activated. Recent deep learning models, that have to do with emotions recognition, are using the second approach, valence and arousal. Moreover, a more interesting concept, which is useful in real life is the "in the wild" emotions recognition. "In the wild" means that the images analyzed for the recognition task, come from from real life sources(online videos, online photos, etc.) and not from staged experiments. So, they introduce unpredictable situations in the images, that have to be modeled. The purpose of this project is to study the previous work that was done for the "in the wild" emotions recognition concept, design a new dataset which has as a standard the "Aff-wild" database, implement new deep learning models and evaluate the results. First, already existing databases and deep learning models are presented. Then, inspired by them a new database is created which includes 507.208 frames in total from 106 videos, which were gathered from online sources. Then, the data are tested in a CNN model based on CNN-M architecture, in order to be sure about their usability. Next, the main model of this project is implemented. That is a Regression GAN which can execute unsupervised and supervised learning at the same time. More specifically, it keeps the main functionality of GANs, which is to produce fake images that look as good as the real ones, while it can also predict valence and arousal values for both real and fake images. Finally, the database created earlier is applied to this model and the results are presented and evaluated.


title: The effect of gas accretion on the radial gas metallicity profile of simulated galaxies

abstract: We study the effect of the gas accretion rate ($\dot M_{\rm accr}$) on the radial gas metallicity profile (RMP) of galaxies using the EAGLE cosmological hydrodynamic simulations, focusing on central galaxies of stellar mass $M_\star \gtrsim 10^9 \, {\rm M_\odot}$ at $z \le 1$. We find clear relations between $\dot M_{\rm accr}$ and the slope of the RMP (measured within an effective radius), where higher $\dot M_{\rm accr}$ are associated with more negative slopes. The slope of the RMPs depends more strongly on $\dot M_{\rm accr}$ than on stellar mass, star formation rate or gas fraction, suggesting $\dot M_{\rm accr}$ to be a more fundamental driver of the RMP slope of galaxies. We find that eliminating the dependence on stellar mass is essential for pinning down the properties that shape the slope of the RMP. Although $\dot M_{\rm accr}$ is the main property modulating the slope of the RMP, we find that it causes other correlations that are more easily testable observationally: at fixed stellar mass, galaxies with more negative RMP slopes tend to have higher gas fractions and SFRs, while galaxies with lower gas fractions and SFRs tend to have flatter metallicity profiles within an effective radius.


title: Classification of Resting-State fMRI using Evolutionary Algorithms: Towards a Brain Imaging Biomarker for Parkinson's Disease

abstract: Accurate early diagnosis and monitoring of neurodegenerative conditions is essential for effective disease management and delivery of medication and treatment. This research develops automatic methods for detecting brain imaging preclinical biomarkers for Parkinson's disease (PD) by considering the novel application of evolutionary algorithms. A fundamental novel element of this work is the use of evolutionary algorithms to both map and predict the functional connectivity in patients using resting state functional MRI data taken from the PPMI to identify PD progression biomarkers. Specifically, Cartesian Genetic Programming was used to classify DCM data as well as time-series data. The findings were validated using two other commonly used classification methods (Artificial Neural Networks and Support Vector Machines) and by employing k-fold cross-validation. Across DCM and time-series analyses, findings revealed maximum accuracies of 75.21% for early stage (prodromal) PD patients versus healthy controls, 85.87% for PD patients versus prodromal PD patients, and 92.09% for PD patients versus healthy controls. Prodromal PD patients were classified from healthy controls with high accuracy - this is notable and represents the key finding of this research since current methods of diagnosing prodromal PD have both low reliability and low accuracy. Furthermore, Cartesian Genetic Programming provided comparable performance accuracy relative to ANN and SVM. Evolutionary algorithms enable us to decode the classifier in terms of understanding the data inputs that are used, more easily than in ANN and SVM. Hence, these findings underscore the relevance of both DCM analyses for classification and CGP as a novel classification tool for brain imaging data with medical implications for disease diagnosis, particularly in early and asymptomatic stages.


title: B-Splines for Sparse Grids: Algorithms and Application to Higher-Dimensional Optimization

abstract: In simulation technology, computationally expensive objective functions are often replaced by cheap surrogates, which can be obtained by interpolation. Full grid interpolation methods suffer from the so-called curse of dimensionality, rendering them infeasible if the parameter domain of the function is higher-dimensional (four or more parameters). Sparse grids constitute a discretization method that drastically eases the curse, while the approximation quality deteriorates only insignificantly. However, conventional basis functions such as piecewise linear functions are not smooth (continuously differentiable). Hence, these basis functions are unsuitable for applications in which gradients are required. One example for such an application is gradient-based optimization, in which the availability of gradients greatly improves the speed of convergence and the accuracy of the results. This thesis demonstrates that hierarchical B-splines on sparse grids are well-suited for obtaining smooth interpolants for higher dimensionalities. The thesis is organized in two main parts: In the first part, we derive new B-spline bases on sparse grids and study their implications on theory and algorithms. In the second part, we consider three real-world applications in optimization: topology optimization, biomechanical continuum-mechanics, and dynamic portfolio choice models in finance. The results reveal that the optimization problems of these applications can be solved accurately and efficiently with hierarchical B-splines on sparse grids.


title: Dark matter astrometry at underground detectors with multiscatter events

abstract: We show that current and imminent underground detectors are capable of precision astrometry of dark matter. First we show that galactic dark matter velocity distributions can be obtained from reconstructed tracks of dark matter scattering on multiple nuclei during transit; using the liquid scintillator neutrino detector SNO+ as an example, we find that the dark matter velocity vector can be reconstructed event-by-event with such a small uncertainty, that the precision of dark matter astrometry will be limited mainly by statistics. We then determine the number of dark matter events required to determine the dispersion speed, escape speed, and velocity anisotropies of the local dark matter halo, and also find that with as few as $\mathcal{O}(10)$ events, dark matter signals may be discriminated from potential backgrounds arising as power-law distributions. Finally, we discuss the prospects of dark matter astrometry at other liquid scintillator detectors, dark matter experiments, and the recently proposed MATHUSLA detector.


title: The Novikov conjecture and extensions of coarsely embeddable groups

abstract: Let $1 \to N \to G \to G/N \to 1$ be a short exact sequence of countable discrete groups and let $B$ be any $G$-$C^*$-algebra. In this paper, we show that the strong Novikov conjecture with coefficients in $B$ holds for such a group $G$ when the normal subgroup $N$ and the quotient group $G/N$ are coarsely embeddable into Hilbert spaces. As a result, the group $G$ satisfies the Novikov conjecture under the same hypothesis on $N$ and $G/N$.


title: Robust Incremental State Estimation through Covariance Adaptation

abstract: Recent advances in the fields of robotics and automation have spurred significant interest in robust state estimation. To enable robust state estimation, several methodologies have been proposed. One such technique, which has shown promising performance, is the concept of iteratively estimating a Gaussian Mixture Model (GMM), based upon the state estimation residuals, to characterize the measurement uncertainty model. Through this iterative process, the measurement uncertainty model is more accurately characterized, which enables robust state estimation through the appropriate de-weighting of erroneous observations. This approach, however, has traditionally required a batch estimation framework to enable the estimation of the measurement uncertainty model, which is not advantageous to robotic applications. In this paper, we propose an efficient, incremental extension to the measurement uncertainty model estimation paradigm. The incremental covariance estimation (ICE) approach, as detailed within this paper, is evaluated on several collected data sets, where it is shown to provide a significant increase in localization accuracy when compared to other state-of-the-art robust, incremental estimation algorithms.


title: The chemical Langevin equation: a path integral view of Gillespie's derivation

abstract: In 2000, Gillespie rehabilitated the chemical Langevin equation (CLE) by describing two conditions that must be satisfied for it yield a valid approximation of the chemical master equation (CME). In this work, we construct an original path integral description of the CME, and show how applying Gillespie's two conditions to it directly leads to a path integral equivalent to the CLE. We compare this approach to the path integral equivalent of a large system size derivation, and show that they are qualitatively different. In particular, both approaches involve converting many sums into many integrals, and the difference between the two methods is essentially the difference between using the Euler-Maclaurin formula and using Riemann sums. Our results shed light on how path integrals can be used to conceptualize coarse-graining biochemical systems, and are readily generalizable.


title: ORCCA: Optimal Randomized Canonical Correlation Analysis

abstract: Random features approach has been widely used for kernel approximation in large-scale machine learning. A number of recent studies have explored data-dependent sampling of features, modifying the stochastic oracle from which random features are sampled. While proposed techniques in this realm improve the approximation, their suitability is often verified on a single learning task. In this paper, we propose a task-specific scoring rule for selecting random features, which can be employed for different applications with some adjustments. We restrict our attention to Canonical Correlation Analysis (CCA), and we provide a novel, principled guide for finding the score function maximizing the canonical correlations. We prove that this method, called ORCCA, can outperform (in expectation) the corresponding Kernel CCA with a default kernel. Numerical experiments verify that ORCCA is significantly superior than other approximation techniques in the CCA task.


title: Near-Optimal Massively Parallel Graph Connectivity

abstract: Identifying the connected components of a graph, apart from being a fundamental problem with countless applications, is a key primitive for many other algorithms. In this paper, we consider this problem in parallel settings. Particularly, we focus on the Massively Parallel Computations (MPC) model, which is the standard theoretical model for modern parallel frameworks such as MapReduce, Hadoop, or Spark. We consider the truly sublinear regime of MPC for graph problems where the space per machine is $n^\delta$ for some desirably small constant $\delta \in (0, 1)$. We present an algorithm that for graphs with diameter $D$ in the wide range $[\log^{\epsilon} n, n]$, takes $O(\log D)$ rounds to identify the connected components and takes $O(\log \log n)$ rounds for all other graphs. The algorithm is randomized, succeeds with high probability, does not require prior knowledge of $D$, and uses an optimal total space of $O(m)$. We complement this by showing a conditional lower-bound based on the widely believed TwoCycle conjecture that $\Omega(\log D)$ rounds are indeed necessary in this setting. Studying parallel connectivity algorithms received a resurgence of interest after the pioneering work of Andoni et al. [FOCS 2018] who presented an algorithm with $O(\log D \cdot \log \log n)$ round-complexity. Our algorithm improves this result for the whole range of values of $D$ and almost settles the problem due to the conditional lower-bound. Additionally, we show that with minimal adjustments, our algorithm can also be implemented in a variant of the (CRCW) PRAM in asymptotically the same number of rounds.


title: Exploring Plasma Heating in the Current Sheet Region in a Three-Dimensional Coronal Mass Ejection Simulation

abstract: We simulate a coronal mass ejection (CME) using a three-dimensional magnetohydrodynamic (MHD) code that includes coronal heating, thermal conduction, and radiative cooling in the energy equation. The magnetic flux distribution at 1 R$_s$ is produced by a localized subsurface dipole superimposed on a global dipole field, mimicking the presence of an active region within the global corona. Transverse electric fields are applied near the polarity inversion line to introduce a transverse magnetic field, followed by the imposition of a converging flow to form and destabilize a flux rope, producing an eruption. We examine the quantities responsible for plasma heating and cooling during the eruption, including thermal conduction, radiation, adiabatic effects, coronal heating, and ohmic heating. We find that ohmic heating is an important contributor to hot temperatures in the current sheet region early in the eruption, but in the late phase adiabatic compression plays an important role in heating the plasma there. Thermal conduction also plays an important role in the transport of thermal energy away from the current sheet region throughout the reconnection process, producing a ``thermal halo'' and widening the region of high temperatures. We simulate emission from solar telescopes for this eruption and find that there is evidence for emission from heated plasma above the flare loops late in the eruption, when the adiabatic heating is the dominant heating term. These results provide an explanation for hot supra-arcade plasma sheets that are often observed in X-rays and extreme ultraviolet wavelengths during the decay phase of large flares.


title: The Case for Evaluating Causal Models Using Interventional Measures and Empirical Data

abstract: Causal inference is central to many areas of artificial intelligence, including complex reasoning, planning, knowledge-base construction, robotics, explanation, and fairness. An active community of researchers develops and enhances algorithms that learn causal models from data, and this work has produced a series of impressive technical advances. However, evaluation techniques for causal modeling algorithms have remained somewhat primitive, limiting what we can learn from experimental studies of algorithm performance, constraining the types of algorithms and model representations that researchers consider, and creating a gap between theory and practice. We argue for more frequent use of evaluation techniques that examine interventional measures rather than structural or observational measures, and that evaluate those measures on empirical data rather than synthetic data. We survey the current practice in evaluation and show that the techniques we recommend are rarely used in practice. We show that such techniques are feasible and that data sets are available to conduct such evaluations. We also show that these techniques produce substantially different results than using structural measures and synthetic data.


title: A Proof of Levi's Extension Lemma

abstract: We give a short and self-contained proof of Levi's Extension Lemma for pseudoline arrangements.


title: Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Study

abstract: As a promising paradigm, interactive semantic parsing has shown to improve both semantic parsing accuracy and user confidence in the results. In this paper, we propose a new, unified formulation of the interactive semantic parsing problem, where the goal is to design a model-based intelligent agent. The agent maintains its own state as the current predicted semantic parse, decides whether and where human intervention is needed, and generates a clarification question in natural language. A key part of the agent is a world model: it takes a percept (either an initial question or subsequent feedback from the user) and transitions to a new state. We then propose a simple yet remarkably effective instantiation of our framework, demonstrated on two text-to-SQL datasets (WikiSQL and Spider) with different state-of-the-art base semantic parsers. Compared to an existing interactive semantic parsing approach that treats the base parser as a black box, our approach solicits less user feedback but yields higher run-time accuracy.


title: The Maximum Matroid of a Graph

abstract: The ground set for all matroids in this paper is the set of all edges of a complete graph. The notion of a {\it maximum matroid for a graph} $G$ is introduced, and the existence and uniqueness of the maximum matroid for any graph $G$ is proved. The maximum matroid for $K_3$ is shown to be the cycle (or graphic) matroid. This result is pursued in two directions - to determine the maximum matroid for the $m$-cycle $C_m$ and to determine the maximum matroid for the complete graph $K_m$. The maximum matroid for $K_4$ is the matroid whose bases are the Laman graphs, related to structural rigidity of frameworks in the plane. The maximum matroid for $K_5$ is related to a famous 153 year old open problem of J. C. Maxwell.


title: Lambert's theorem and projective dynamics

abstract: We prove that the classical Lambert theorem about the elapsed time on an arc of Keplerian orbit extends without change to the Kepler problem on a space of constant curvature. We prove that the Hooke problem has a property similar to Lambert's theorem, which also extends to the spaces of constant curvature.


title: Stability of Traveling wave solutions of Nonlinear Dispersive equations of NLS type

abstract: In this paper we present a rigorous modulational stability theory for periodic traveling wave solutions to equations of nonlinear Schr\"odinger (NLS) type. We first argue that, for Hamiltonian dispersive equations with a non-singular symplectic form and $d$ conserved quantities (in addition to the Hamiltonian), one expects that generically ${\mathcal L}$, the linearization around a periodic traveling wave, will have a $2d$ dimensional generalized kernel, with a particular Jordan structure: The kernel of ${\mathcal L}$ is expected to be $d$ dimensional, the first generalized kernel is expected to be $d$ dimensional, and there are expected to be no higher generalized kernels. The breakup of this $2d$ dimensional kernel under perturbations arising from a change in boundary conditions dictates the modulational stability or instability of the underlying periodic traveling wave. This general picture is worked out in detail for the case of equations of NLS type. We give explicit genericity conditions that guarantee that the Jordan form is the generic one: these take the form of non-vanishing determinants of certain matrices whose entries can be expressed in terms of a finite number of moments of the traveling wave solution. Assuming that these genericity conditions are met we give a normal form for the small eigenvalues that result from the break-up of the generalized kernel, in the form of the eigenvalues of a quadratic matrix pencil. We compare these results to direct numerical simulation in a number of cases of interest: the cubic and quintic NLS equations, for focusing and defocusing nonlinearities, subject to both longitudinal and transverse perturbations. The longitudinal stability of traveling waves of the cubic NLS has been previously studied using the integrability: in this case our results agree with those in the literature. All of the remaining cases appear to be new.


title: Set-theoretical solutions of the Yang-Baxter and pentagon equations on semigroups

abstract: The Yang-Baxter and pentagon equations are two well-known equations of Mathematical Physic. If $S$ is a set, a map $s:S\times S\to S\times S$ is said to be a set theoretical solution of the Yang-Baxter equation if $$ s_{23}\, s_{13}\, s_{12} = s_{12}\, s_{13}\, s_{23}, $$ where $s_{12}=s\times id_S$, $s_{23}=id_S\times s$, and $s_{13}=(id_S\times \tau)\,s_{12}\,(id_S\times \tau)$ and $\tau$ is the flip map, i.e., the map on $S\times S$ given by $\tau(x,y)=(y,x)$. Instead, $s$ is called a set-theoretical solution of the pentagon equation if $$ s_{23}\, s_{13}\, s_{12}=s_{12}\, s_{23}. $$ The main aim of this work is to display how solutions of the pentagon equation turn out to be a useful tool to obtain new solutions of the Yang-Baxter equation. Specifically, we present a new construction of solutions of the Yang-Baxter equation involving two specific solutions of the pentagon equation. To this end, we provide a method to obtain solutions of the pentagon equation on the matched product of two semigroups, that is a semigroup including the classical Zappa product.


title: Global, Non-Scattering Solutions to the Energy Critical Yang-Mills Problem

abstract: We consider the Yang-Mills problem on $\mathbb{R}^{1+4}$ with gauge group $SO(4)$. In an appropriate equivariant reduction, this Yang-Mills problem reduces to a single scalar semilinear wave equation. This semilinear equation admits a one-parameter family of solitons, each of which is a re-scaling of a fixed solution. In this work, we construct a class of solutions, each of which consists of a soliton whose length scale is asymptotically constant, coupled to large radiation, plus corrections which slowly decay to zero in the energy norm. Our class of solutions includes ones for which the radiation component is only "logarithmically" better than energy class. As such, the solutions are not constructed by apriori assuming the length scale to be constant. Instead, we use an approach similar to a previous work of the author regarding wave maps. In the setup of this work, the soliton length scale asymptoting to a constant is a necessary condition for the radiation profile to have finite energy. An interesting point of our construction is that, for each radiation profile, there exist one-parameter families of solutions consisting of the radiation profile coupled to a soliton, which has any asymptotic value of the length scale.


title: FuseMODNet: Real-Time Camera and LiDAR based Moving Object Detection for robust low-light Autonomous Driving

abstract: Moving object detection is a critical task for autonomous vehicles. As dynamic objects represent higher collision risk than static ones, our own ego-trajectories have to be planned attending to the future states of the moving elements of the scene. Motion can be perceived using temporal information such as optical flow. Conventional optical flow computation is based on camera sensors only, which makes it prone to failure in conditions with low illumination. On the other hand, LiDAR sensors are independent of illumination, as they measure the time-of-flight of their own emitted lasers. In this work, we propose a robust and real-time CNN architecture for Moving Object Detection (MOD) under low-light conditions by capturing motion information from both camera and LiDAR sensors. We demonstrate the impact of our algorithm on KITTI dataset where we simulate a low-light environment creating a novel dataset "Dark KITTI". We obtain a 10.1% relative improvement on Dark-KITTI, and a 4.25% improvement on standard KITTI relative to our baselines. The proposed algorithm runs at 18 fps on a standard desktop GPU using $256\times1224$ resolution images.


title: Network Randomization: A Simple Technique for Generalization in Deep Reinforcement Learning

abstract: Deep reinforcement learning (RL) agents often fail to generalize to unseen environments (yet semantically similar to trained agents), particularly when they are trained on high-dimensional state spaces, such as images. In this paper, we propose a simple technique to improve a generalization ability of deep RL agents by introducing a randomized (convolutional) neural network that randomly perturbs input observations. It enables trained agents to adapt to new domains by learning robust features invariant across varied and randomized environments. Furthermore, we consider an inference method based on the Monte Carlo approximation to reduce the variance induced by this randomization. We demonstrate the superiority of our method across 2D CoinRun, 3D DeepMind Lab exploration and 3D robotics control tasks: it significantly outperforms various regularization and data augmentation methods for the same purpose.


title: Lagrangian surfaces with Legendrian boundary

abstract: In this note, we first introduce a boundary problem for Lagrangian submanifolds, analogous to the problem for free boundary hypersurfaces and capillary hypersurfaces. Then we present several interesting examples of Lagrangian submanifolds satisfying this boundary condition and we prove a Lagrangian version of Nitsche (or Hopf) type theorem. Some problems are proposed at the end of this note.


title: Mitosis: Transparently Self-Replicating Page-Tables for Large-Memory Machines

abstract: Multi-socket machines with 1-100 TBs of physical memory are becoming prevalent. Applications running on multi-socket machines suffer non-uniform bandwidth and latency when accessing physical memory. Decades of research have focused on data allocation and placement policies in NUMA settings, but there have been no studies on the question of how to place page-tables amongst sockets. We make the case for explicit page-table allocation policies and show that page-table placement is becoming crucial to overall performance. We propose Mitosis to mitigate NUMA effects on page-table walks by transparently replicating and migrating page-tables across sockets without application changes. This reduces the frequency of accesses to remote NUMA nodes when performing page-table walks. Mitosis uses two components: (i) a mechanism to enable efficient page-table replication and migration; and (ii) policies for processes to efficiently manage and control page-table replication and migration. We implement Mitosis in Linux and evaluate its benefits on real hardware. Mitosis improves performance for large-scale multi-socket workloads by up to 1.34x by replicating page-tables across sockets. Moreover, it improves performance by up to 3.24x in cases when the OS migrates a process across sockets by enabling cross-socket page-table migration.


title: Robust Hierarchical-Optimization RLS Against Sparse Outliers

abstract: This paper fortifies the recently introduced hierarchical-optimization recursive least squares (HO-RLS) against outliers which contaminate infrequently linear-regression models. Outliers are modeled as nuisance variables and are estimated together with the linear filter/system variables via a sparsity-inducing (non-)convexly regularized least-squares task. The proposed outlier-robust HO-RLS builds on steepest-descent directions with a constant step size (learning rate), needs no matrix inversion (lemma), accommodates colored nominal noise of known correlation matrix, exhibits small computational footprint, and offers theoretical guarantees, in a probabilistic sense, for the convergence of the system estimates to the solutions of a hierarchical-optimization problem: Minimize a convex loss, which models a-priori knowledge about the unknown system, over the minimizers of the classical ensemble LS loss. Extensive numerical tests on synthetically generated data in both stationary and non-stationary scenarios showcase notable improvements of the proposed scheme over state-of-the-art techniques.


title: The infrared line-emitting regions of T Tauri protoplanetary disks

abstract: Mid-infrared molecular line emission detected with the Spitzer Space Telescope is often interpreted using slab models. However, we need to understand the mid-infrared line emission in 2D disk models, such that we gain information about from where the lines are being emitted and under which conditions, such that we gain information about number densities, temperatures, and optical depths in both the radial and vertical directions. In this paper, we introduce a series of 2D thermochemical models of a prototypical T Tauri protoplanetary disk, in order to examine how sensitive the line-emitting regions are to changes in the UV and X-ray fluxes, the disk flaring angle, dust settling, and the dust-to-gas ratio. These all affect the heating of the inner disk, and thus can affect the mid-infrared spectral lines. Using the ProDiMo and FLiTs codes, we produce a series of 2D thermochemical disk models. We find that there is often a significant difference between the gas and dust temperatures in the line emitting regions, and we illustrate that the size of the line emitting regions is relatively robust against changes in the stellar and disk parameters (namely, the UV and X-ray fluxes, the flaring angle, and dust settling). These results demonstrate the potential for localized variations in the line-emitting region to greatly affect the resulting spectra and line fluxes, and the necessity of allowing for such variations in our models.


title: Capsule and convolutional neural network-based SAR ship classification in Sentinel-1 data

abstract: Synthetic Aperture Radar (SAR) constitutes a fundamental asset for wide-areas monitoring with high-resolution requirements. The first SAR sensors have given rise to coarse coastal and maritime monitoring applications, including oil spill, ship and ice floes detection. With the upgrade to very high-resolution sensors in the recent years, with relatively new SAR missions such as Sentinel-1, a great deal of data providing a stronger information content has been released, enabling more refined studies on general targets features and thus permitting complex classifications, as for ship classification, which has become increasingly relevant given the growing need for coastal surveillance in commercial and military segments. In the last decade, several works focused on this topic have been presented, generally based on radiometric features processing; furthermore, in the very recent years a significant amount of research works have focused on emerging deep learning techniques, in particular on Convolutional Neural Networks (CNN). Recently Capsule Neural Networks (CapsNets) have been presented, demonstrating a notable improvement in capturing the properties of given entities, improving the use of spatial informations, in particular of spatial dependence between features, a severely lacking feature in CNNs. In fact, CNNs pooling operations have been criticized for losing spatial relations, thus special capsules, along with a new iterative routing-by-agreement mechanism, have been proposed. In this work a comparison between Capsule and CNNs potential in the ship classification application domain is shown, by leveraging the OpenSARShip, a SAR Sentinel-1 ship chips dataset; in particular, a performance comparison between capsule and various convolutional architectures is built, demonstrating better performances of CapsNet in classifying ships within a small dataset.


title: Phases of Two Adjoints QCD$_{3}$ And a Duality Chain

abstract: We analyze the 2+1 dimensional gauge theory with two fermions in the real adjoint representation with non-zero Chern-Simons level. We propose a new fermion-fermion dualities between strongly-coupled theories and determine the quantum phase using the structure of a `Duality Chain'. We argue that when Chern-Simons level is sufficiently small, the theory in general develops a strongly coupled quantum phase described by an emergent topological field theory. For special cases, our proposal predicts an interesting dynamical scenario with spontaneous breaking of partial 1-form or 0-form global symmetry. It turns out that $SL(2,\mathbb Z)$ transformation and the generalized level/rank duality are crucial for the unitary group case. We further unveil the dynamics of the 2+1 dimensional gauge theory with any pair of adjoint/rank-two fermions or two bifundamental fermions using similar `Duality Chain'.


title: Timelike surfaces in the de Sitter space $\mathbb S^3_1(1)\subset \mathbb R^4_1$

abstract: This paper studies timelike minimal surfaces in the De Sitter space $\mathbb S^3_1(1) \subset \mathbb R^4_1$ via a complex variable. Using complex analysis and stereographic projection of lightlike vectors we obtain a representation formula. Real and complex special quadrics in $\mathbb CP^3$ are identified with the grassmannians of spacelike and timelike oriented 2-planes of $\mathbb R^4_1$, and the normal frame is written in terms of certain complex valued functions $x$ and $y$, which may be considered holomorphic functions as a special case. Then several results describing the analytic restrictions via solutions of certain PDE in complex variable, are shown. Finding solutions allows us to identify explicitly the representation of the associated surfaces. Moreover, using our technique we find a new kind of complex function which we call quasi-holomorphic and which satisfy a generalized version of the Cauchy-Riemann equations. Our technique allows the explicit construction of many families of minimal timelike surfaces in $\mathbb S^3_1(1)$ whose intrinsic Gauss map will also belong to the same class of surfaces.


title: Automated Discovery of Business Process Simulation Models from Event Logs

abstract: Business process simulation is a versatile technique to estimate the performance of a process under multiple scenarios. This, in turn, allows analysts to compare alternative options to improve a business process. A common roadblock for business process simulation is that constructing accurate simulation models is cumbersome and error-prone. Modern information systems store detailed execution logs of the business processes they support. Previous work has shown that these logs can be used to discover simulation models. However, existing methods for log-based discovery of simulation models do not seek to optimize the accuracy of the resulting models. Instead they leave it to the user to manually tune the simulation model to achieve the desired level of accuracy. This article presents an accuracy-optimized method to discover business process simulation models from execution logs. The method decomposes the problem into a series of steps with associated configuration parameters. A hyper-parameter optimization method is used to search through the space of possible configurations so as to maximize the similarity between the behavior of the simulation model and the behavior observed in the log. The method has been implemented as a tool and evaluated using logs from different domains.


title: Zap Q-Learning With Nonlinear Function Approximation

abstract: Zap Q-learning is a recent class of reinforcement learning algorithms, motivated primarily as a means to accelerate convergence. Stability theory has been absent outside of two restrictive classes: the tabular setting, and optimal stopping. This paper introduces a new framework for analysis of a more general class of recursive algorithms known as stochastic approximation. Based on this general theory, it is shown that Zap Q-learning is consistent under a non-degeneracy assumption, even when the function approximation architecture is nonlinear. Zap Q-learning with neural network function approximation emerges as a special case, and is tested on examples from OpenAI Gym. Based on multiple experiments with a range of neural network sizes, it is found that the new algorithms converge quickly and are robust to choice of function approximation architecture.


title: Compensation-Free High-Capacity Free-Space Optical Communication Using Turbulence-Resilient Vector Beams

abstract: Free-space optical communication is a promising means to establish versatile, secure and high-bandwidth communication for many critical point-to-point applications. While the spatial modes of light offer an additional degree of freedom to increase the information capacity of an optical link, atmospheric turbulence can introduce severe distortion to the spatial modes and lead to data degradation. Here, we propose and demonstrate a vector-beam-based, turbulence-resilient communication protocol, namely spatial polarization differential phase shift keying (SPDPSK), that can encode a large number of information levels using orthogonal spatial polarization states of light. We show experimentally that the spatial polarization profiles of the vector modes are resilient to atmospheric turbulence, and therefore can reliably transmit high-dimensional information through a turbid channel without the need of any adaptive optics for beam compensation. We construct a proof-of-principle experiment with a controllable turbulence cell. Using 34 vector modes, we have measured a channel capacity of 4.84 bits per pulse (corresponding to a data error rate of 4.3\%) through a turbulent channel with a scintillation index larger than 1. Our SPDPSK protocol can also effectively transmit 4.02 bits of information per pulse using 18 vector modes through even stronger turbulence with a scintillation index of 1.54. Our study provides direct experimental evidence on how the spatial polarization profiles of vector beams are resilient to atmospheric turbulence and paves the way towards practical, high-capacity, free-space communication solutions with robust performance under harsh turbulent environments.


title: Distance and Evolutionary States of Supernova Remnant G18.9-1.1 and Candidate G28.6+0.0

abstract: HI spectra of the supernova remnant G18.9-1.1 and the supernova remnant candidate G28.6+0.0 are analyzed. We compared the spectra to $^{13}$CO emission spectra and to spectra of HII regions in the area to determine kinematic distances. G18.9-1.1 is at 2.1$\pm$0.4 kpc and G28.6+0.0 is at 9.0$\pm$0.3 kpc from the Sun. Using published X-ray spectra of G18.9-1.1, we apply supernova remnant models for shocked-ISM temperature and emission measure. We find that G18.9-1.1 has a low, but not atypical, explosion energy of $\simeq$3$\times$10$^{50}$ erg and is in a low density region of the ISM, $\simeq$0.1 cm$^{-3}$. It has age $\simeq$3700 yr if the ejecta mass is 1.4 M$_{\odot}$, typical of Type Ia SNe, or $\simeq$4700 yr if the ejecta mass is 5 M$_{\odot}$ typical of core-collapse SN. The candidate G28.6+0.0 does not have reported X-ray emission, so we apply a basic Sedov model. The Sedov age is $\simeq$600 yr if the ISM density is 1 cm$^{-3}$ but could be as old as $\simeq$6000 yr if the ISM density is as high as 100 cm$^{-3}$.


title: Finite-dimensional Nichols algebras over dual Radford algebras

abstract: For $n,m\in \mathbb{N}$, let $H_{n,m}$ be the dual of the Radford algebra of dimension $n^{2}m$. We present new finite-dimensional Nichols algebras arising from the study of simple Yetter-Drinfeld modules over $H_{n,m}$. Along the way, we describe the simple objects in ${}^{H_{n,m}}_{H_{n,m}}\mathcal{YD}$ and their projective envelopes. Then, we determine those simple modules that give rise to finite-dimensional Nichols algebras for the case $n=2$. There are 18 possible cases. We present by generators and relations the corresponding Nichols algebras on five of these eighteen cases. As an application, we characterize finite-dimensional Nichols algebras over indecomposable modules for $n=2=m$ and $n=2$, $m=3$, which recovers some results of the second and third author in the former case, and of Xiong in the latter.


title: Risk- and Variance-Aware Electricity Pricing

abstract: The roll-out of stochastic renewable energy sources (RES) undermines the efficiency of power system and market operations. This paper proposes an approach to derive electricity prices that internalize RES stochasticity. We leverage a chance-constrained AC Optimal Power Flow (CC AC-OPF) model, which is robust against RES uncertainty and is also aware of the resulting variability (variance) of the system state variables. Using conic duality theory, we derive and analyze energy and balancing reserve prices that internalize the risk of system limit violations and the variance of system state variables. We compare the risk- and variance-aware prices on the IEEE 118-node testbed.


title: Phase space reconstruction from a biological time series. A PhotoPlethysmoGraphic signal a case study

abstract: In the analysis of biological time series, the state space comprises a framework for the study of systems with presumably deterministic properties. However, a physiological experiment typically captures an observable, or, in other words, a series of scalar measurements that characterize the temporal response of the physiological system under study; the dynamic variables that make up the state of the system at any time are not available. Therefore, only from the acquired observations should state vectors reconstructed to emulate the different states of the underlying system. It is what is known as the reconstruction of the state space, called phase space in real-world signals, for now only satisfactorily resolved using the method of delays. Each state vector consists of m components, extracted from successive observations delayed a time t. The morphology of the geometric structure described by the state vectors, as well as their properties, depends on the chosen parameters t and m. The real dynamics of the system under study is subject to the correct determination of the parameters t and m. Only in this way can be deduced characteristics with true physical meaning, revealing aspects that reliably identify the dynamic complexity of the physiological system. The biological signal presented in this work, as a case study, is the PhotoPlethysmoGraphic (PPG) signal. We find that m is five for all the subjects analyzed and that t depends on the time interval in which it evaluates. The H\'enon map and the Lorenz flow are used to facilitate a more intuitive understanding of applied techniques.


title: Snow avalanche segmentation in SAR images with Fully Convolutional Neural Networks

abstract: Knowledge about frequency and location of snow avalanche activity is essential for forecasting and mapping of snow avalanche hazard. Traditional field monitoring of avalanche activity has limitations, especially when surveying large and remote areas. In recent years, avalanche detection in Sentinel-1 radar satellite imagery has been developed to improve monitoring. However, the current state-of-the-art detection algorithms, based on radar signal processing techniques, are still much less accurate than human experts. To reduce this gap, we propose a deep learning architecture for detecting avalanches in Sentinel-1 radar images. We trained a neural network on 6,345 manually labelled avalanches from 117 Sentinel-1 images, each one consisting of six channels that include backscatter and topographical information. Then, we tested our trained model on a new SAR image. Comparing to the manual labelling (the gold standard), we achieved an F1 score above 66\%, while the state-of-the-art detection algorithm sits at an F1 score of only 38\%. A visual inspection of the results generated by our deep learning model shows that only small avalanches are undetected, while some avalanches that were originally not labelled by the human expert are discovered.


title: Modeling electromagnetic resonators using quasinormal modes

abstract: We present a bi-orthogonal approach for modeling the response of localized electromagnetic resonators using quasinormal modes, which represent the natural, dissipative eigenmodes of the system with complex frequencies. For many problems of interest in optics and nanophotonics, the quasinormal modes constitute a powerful modeling tool, and the bi-orthogonal approach provides a coherent, precise, and accessible derivation of the associated theory, enabling an illustrative connection between different modeling approaches that exist in the literature.


title: Temporal precision of molecular events with regulation and feedback

abstract: Cellular behaviors such as migration, division, and differentiation rely on precise timing, and yet the molecular events that govern these behaviors are highly stochastic. We investigate regulatory strategies that decrease the timing noise of molecular events. Autoregulatory feedback increases noise. Yet, we find that in the presence of regulation by a second species, autoregulatory feedback decreases noise. To explain this finding, we develop a method to calculate the optimal regulation function that minimizes the timing noise. The method reveals that the combination of feedback and regulation minimizes noise by maximizing the number of molecular events that must happen in sequence before a threshold is crossed. We compute the optimal timing precision for all two-node networks with regulation and feedback, derive a generic lower bound on timing noise, and discuss our results in the context of neuroblast migration during Caenorhabditis elegans development.


title: Circumbinary exoplanets and brown dwarfs with the Laser Interferometer Space Antenna

abstract: We explore the prospects for the detection of giant circumbinary exoplanets and brown dwarfs (BDs) orbiting Galactic double white dwarfs binaries (DWDs) with the Laser Interferometer Space Antenna (LISA). By assuming an occurrence rate of 50%, motivated by white dwarf pollution observations, we built a Galactic synthetic population of P-type giant exoplanets and BDs orbiting DWDs. We carried this out by injecting different sub-stellar populations, with various mass and orbital separation characteristics, into the DWD population used in the LISA mission proposal. We then performed a Fisher matrix analysis to measure how many of these three-body systems show a periodic Doppler-shifted gravitational wave perturbation detectable by LISA. We report the number of circumbinary planets (CBPs) and (BDs) that can be detected by LISA for various combinations of mass and semi-major axis distributions. We identify pessimistic and optimistic scenarios corresponding, respectively, to 3 and 83 (14 and 2218) detections of CBPs (BDs), observed during the length of the nominal LISA mission. These detections are distributed all over the Galaxy following the underlying DWD distribution, and they are biased towards DWDs with higher LISA signal-to-noise ratio and shorter orbital period. Finally, we show that if LISA were to be extended for four more years, the number of systems detected will be more than doubled in both the optimistic and pessimistic scenarios. Our results present promising prospects for the detection of post-main sequence exoplanets and BDs, showing that gravitational waves can prove the existence of these populations over the totality of the Milky Way. Detections by LISA will deepen our knowledge on the life of exoplanets subsequent to the most extreme evolution phases of their hosts, clarifying whether new phases of planetary formation take place later in the life of the stars.

categories: astro-ph.EP astro-ph.IM astro-ph.SR gr-qc


title: Finite-time blowup for a Navier-Stokes model equation for the self-amplification of strain

abstract: In this paper, we consider a model equation for the Navier--Stokes strain equation. This model equation has the same identity for enstrophy growth and a number of the same regularity criteria as the full Navier-Stokes strain equation, and is also an evolution equation on the same constraint space. We prove finite-time blowup for this model equation, which shows that the identity for enstrophy growth and the strain constraint space are not sufficient on their own to guarantee global regularity for Navier-Stokes. The mechanism for the finite-time blowup of this model equation is the self-amplification of strain, which is consistent with recent research suggesting that strain self-amplification, not vortex stretching, is the main mechanism behind the turbulent energy cascade. Because the strain self-amplification model equation is obtained by dropping certain terms from the full Navier-Stokes strain equation, we will also prove a conditional blowup result for the full Navier-Stokes equation involving a perturbative condition on the terms neglected in the model equation.


title: Using [CII] 158 micron Emission From Isolated ISM Phases as a Star-Formation Rate Indicator

abstract: The brightest observed emission line in many star-forming galaxies is the [CII] 158 micron line, making it detectable up to z~7. In order to better understand and quantify the [CII] emission as a tracer of star-formation, the theoretical ratio between the [NII] 205 micron emission and the [CII] 158 micron emission has been employed to empirically determine the fraction of [CII] emission that originates from the ionized and neutral phases of the ISM. Sub-kiloparsec measurements of the [CII] 158 micron and [NII] 205 micron line in nearby galaxies have recently become available as part of the Key Insights in Nearby Galaxies: a Far Infrared Survey with Herschel (KINGFISH) and Beyond the Peak (BtP) programs. With the information from these two far-infrared lines along with the multi-wavelength suite of KINGFISH data, a calibration of the [CII] emission line as a star formation rate indicator and a better understanding of the [CII] deficit are pursued. [CII] emission is also compared to PAH emission in these regions to compare photoelectric heating from PAH molecules to cooling by [CII] in the neutral and ionized phases of the ISM. We find that the [CII] emission originating in the neutral phase of the ISM does not exhibit a deficit with respect to the infrared luminosity and is therefore preferred over the [CII] emission originating in the ionized phase of the ISM as a star formation rate indicator for the normal star-forming galaxies included in this sample.


title: Concentration-compactness principle of singular Trudinger-Moser inequality involving $N$-Finsler-Laplacian operator

abstract: In this paper, suppose $F: \mathbb{R}^{N} \rightarrow [0, +\infty)$ be a convex function of class $C^{2}(\mathbb{R}^{N} \backslash \{0\})$ which is even and positively homogeneous of degree 1. We establish the Lions type concentration-compactness principle of singular Trudinger-Moser Inequalities involving $N$-Finsler--Laplacian operator. Let $\Omega\subset \mathbb{R}^{N}(N\geq 2)$ be a smooth bounded domain. $\{u_n\}\subset W_0^{1, N}(\Omega)$ be a sequence such that anisotropic Dirichlet norm$\int_{\Omega}F^N (\nabla u_n)dx=1$, $u_n \rightharpoonup u \not \equiv 0$ weakly in $W_0^{1, N}(\Omega)$. Then for any $0 < p < p_N(u):=(1-\int_{\Omega}F^N (\nabla u)dx)^{-\frac{1}{N-1}},$ we have $$ \int_{\Omega}\frac{e^{\lambda_{N}(1-\frac{\beta}{N})p |u_n|^{\frac{N}{N-1}}}}{F^{o}(x)^{\beta}}dx<+\infty, $$ where $0\leq\beta <N$, $\lambda_{N}=N^{\frac{N}{N-1}} \kappa_{N}^{\frac{1}{N-1}}$ and $\kappa_{N}$ is the volume of a unit Wulff ball. This conclusion fails if $p \geq p_N(u)$. Furthermore, we also obtain the corresponding concentration-compactness principle in the entire Euclidean space $\mathbb{R}^{N}$.


title: Closure relations of Gamma Ray Bursts in high energy emission

abstract: The synchrotron external shock model predicts the evolution of the spectral ($\beta$) and temporal ($\alpha$) indices during the gamma-ray burst (GRB) afterglow for different environmental density profiles, electron spectral indices, electron cooling regimes, and regions of the spectrum. We study the relationship between $\alpha$ and $\beta$, the so-called "closure relations" with GRBs detected by \textit{Fermi} Large Area Telescope (\textit{Fermi}-LAT) from 2008 August to 2018 August. The spectral and temporal indices for the > 100 MeV emission from the \textit{Fermi}-LAT as determined in the Second Fermi-LAT Gamma-ray Burst Catalog (2FLGC) are used in this work. We select GRBs whose spectral and temporal indices are well constrained (58 long-duration GRBs and 1 short-duration GRBs) and classify each GRB into the best-matched relation. As a result, we found that a number of GRBs require a very small fraction of the total energy density contained in the magnetic field ($\epsilon_{B}$ $\lesssim$ 10$^{-7}$). The estimated mean and standard deviation of electron spectral index $\mathit{p}$ are 2.40 and 0.44, respectively. The GRBs satisfying a closure relation of the slow cooling tend to have a softer $\mathit{p}$ value compared to those of the fast cooling. Moreover, the Kolmogorov--Smirnov test of the two $\mathit{p}$ distributions from the fast and slow coolings rejects a hypothesis that the two distributions are drawn from the single reference distribution with a significance of 3.2 $\sigma$. Lastly, the uniform density medium is preferred over the medium that decreases like the inverse of distance squared for long-duration GRBs.


title: Cosmology in front of the background: studying the growth of structure at CMB wavelengths

abstract: Canada has thriving communities in CMB (cosmic microwave background) studies, cosmology and submillimetre (submm) astronomy, with involvement in many facilities that featured prominently in previous Astronomy Long Range Plans. The standard cosmological model continues to be well fit using a small number of parameters. No one expects this model to be complete and so we need to continue to challenge it with data; moreover, it does not explain how galaxies and other structures form. So, how do we improve the precision of our understanding of structure formation within this model? Wavelengths from the microwave to the submm will be particularly fruitful for answering this question. That's because, in addition to the CMB anisotropies, there are other signals that can be extracted from large maps at these wavelengths - particularly the cosmic infrared and submm backgrounds, the thermal and kinetic Sunyaev-Zeldovich effects, and CMB lensing. Such signals carry a wealth of information about the cosmological model, as well as how dust, gas and star-formation evolve within dark-matter halos. Cross-correlations between these signals and those coming from the radio, optical and X-ray surveys, will provide even more information. Canadians are already members of teams for several related facilities and are working to be involved in others. In order for Canada to be fully engaged in exploiting the detailed information coming from these cosmological signatures, it is crucial that we find the resources to participate competitively in a combination of projects currently being planned. Examples include CMB-S4, CCAT-prime, AtLAST, a new camera for JCMT, balloon projects such as BFORE and a future ambitious CMB satellite.


title: Multiple Components in the Broadband $\gamma$-ray Emission of the Short GRB 160709A

abstract: GRB 160709A is one of the few bright short gamma-ray bursts detected by both the Gamma-ray Burst Monitor and the Large Area Telescope on board the $Fermi$ $Gamma$-$ray$ $Space$ $Telescope$. The $\gamma$-ray prompt emission of GRB 160709A is adequately fitted by combinations of three distinct components: (i) a nonthermal component described by a power law (PL) with a high-energy exponential cutoff, (ii) a thermal component modeled with a Planck function, and (iii) a second nonthermal component shaped by an additional PL crossing the whole $\gamma$-ray spectrum. While the thermal component dominates during $\sim$ 0.12 s of the main emission episode of GRB 160709A with an unusually high temperature of $\sim$ 340 keV, the nonthermal components dominate in the early and late time. The thermal component is consistent with the photospheric emission resulting in the following parameters: the size of the central engine, $R_{0}$ = $3.8 \substack{+5.9 \\ -1.8}$ $\times 10^{8}$ cm, the size of the photosphere, R$_{ph}$ = $7.4 \substack{+0.8 \\ -1.2}$ $\times 10^{10}$ cm, and a bulk Lorentz factor, $\Gamma$ = $728 \substack{+75 \\ -93}$ assuming a redshift of 1. The slope of the additional PL spectrum stays unchanged throughout the burst duration; however, its flux decreases continuously as a function of time. A standard external shock model has been tested for the additional PL component using the relation between the temporal and spectral indices (the closure relation). Each set of spectral and temporal indices from two energy bands (200 keV--40 MeV and 100 MeV--10 GeV) satisfies a distinct closure relation. From the closure relation test we derived the index for the electron spectral distribution, $p$ = 2.5 $\pm$ 0.1. The interaction of the jet with the interstellar environment is preferred over the interaction with the wind medium.


title: Statistical Linear Models in Virus Genomic Alignment-free Classification: Application to Hepatitis C Viruses

abstract: Viral sequence classification is an important task in pathogen detection, epidemiological surveys and evolutionary studies. Statistical learning methods are widely used to classify and identify viral sequences in samples from environments. These methods face several challenges associated with the nature and properties of viral genomes such as recombination, mutation rate and diversity. Also, new generations of sequencing technologies rise other difficulties by generating massive amounts of fragmented sequences. While linear classifiers are often used to classify viruses, there is a lack of exploration of the accuracy space of existing models in the context of alignment free approaches. In this study, we present an exhaustive assessment procedure exploring the power of linear classifiers in genotyping and subtyping partial and complete genomes. It is applied to the Hepatitis C viruses (HCV). Several variables are considered in this investigation such as classifier types (generative and discriminative) and their hyper-parameters (smoothing value and regularization penalty function), the classification task (genotyping and subtyping), the length of the tested sequences (partial and complete) and the length of k-mer words. Overall, several classifiers perform well given a set of precise combination of the experimental variables mentioned above. Finally, we provide the procedure and benchmark data to allow for more robust assessment of classification from virus genomes.


title: SiPPing Neural Networks: Sensitivity-informed Provable Pruning of Neural Networks

abstract: We introduce a pruning algorithm that provably sparsifies the parameters of a trained model in a way that approximately preserves the model's predictive accuracy. Our algorithm uses a small batch of input points to construct a data-informed importance sampling distribution over the network's parameters, and adaptively mixes a sampling-based and deterministic pruning procedure to discard redundant weights. Our pruning method is simultaneously computationally efficient, provably accurate, and broadly applicable to various network architectures and data distributions. Our empirical comparisons show that our algorithm reliably generates highly compressed networks that incur minimal loss in performance relative to that of the original network. We present experimental results that demonstrate our algorithm's potential to unearth essential network connections that can be trained successfully in isolation, which may be of independent interest.


title: Refined counting of core partitions into $d$-distinct parts

abstract: Using a combinatorial bijection with certain abaci diagrams, Nath and Sellers have enumerated $(s, m s \pm 1)$-core partitions into distinct parts. We generalize their result in several directions by including the number of parts of these partitions, by considering $d$-distinct partitions, and by allowing more general $(s, m s \pm r)$-core partitions. As an application of our approach, we obtain the average and maximum number of parts of these core partitions.


title: Anticipating Illegal Maritime Activities from Anomalous Multiscale Fleet Behaviors

abstract: Illegal fishing is prevalent throughout the world and heavily impacts the health of our oceans, the sustainability and profitability of fisheries, and even acts to destabilize geopolitical relations. To achieve the United Nations' Sustainable Development Goal of "Life Below Water", our ability to detect and predict illegal fishing must improve. Recent advances have been made through the use of vessel location data, however, most analyses to date focus on anomalous spatial behaviors of vessels one at a time. To improve predictions, we develop a method inspired by complex systems theory to monitor the anomalous multi-scale behavior of whole fleets as they respond to nearby illegal activities. Specifically, we analyze changes in the multiscale geospatial organization of fishing fleets operating on the Patagonia Shelf, an important fishing region with chronic exposure to illegal fishing. We show that legally operating (and visible) vessels respond anomalously to nearby illegal activities (by vessels that are difficult to detect). Indeed, precursor behaviors are identified, suggesting a path towards pre-empting illegal activities. This approach offers a promising step towards a global system for detecting, predicting and deterring illegal activities at sea in near real-time. Doing so will be a big step forward to achieving sustainable life underwater.


title: Illegible Text to Readable Text: An Image-to-Image Transformation using Conditional Sliced Wasserstein Adversarial Networks

abstract: Automatic text recognition from ancient handwritten record images is an important problem in the genealogy domain. However, critical challenges such as varying noise conditions, vanishing texts, and variations in handwriting make the recognition task difficult. We tackle this problem by developing a handwritten-to-machine-print conditional Generative Adversarial network (HW2MP-GAN) model that formulates handwritten recognition as a text-Image-to-text-Image translation problem where a given image, typically in an illegible form, is converted into another image, close to its machine-print form. The proposed model consists of three-components including a generator, and word-level and character-level discriminators. The model incorporates Sliced Wasserstein distance (SWD) and U-Net architectures in HW2MP-GAN for better quality image-to-image transformation. Our experiments reveal that HW2MP-GAN outperforms state-of-the-art baseline cGAN models by almost 30 in Frechet Handwritten Distance (FHD), 0.6 on average Levenshtein distance and 39% in word accuracy for image-to-image translation on IAM database. Further, HW2MP-GAN improves handwritten recognition word accuracy by 1.3% compared to baseline handwritten recognition models on the IAM database.


title: Quasi-Toric Differential Inclusions

abstract: Toric differential inclusions play a pivotal role in providing a rigorous interpretation of the connection between weak reversibility and the persistence of mass-action systems and polynomial dynamical systems. We introduce the notion of quasi-toric differential inclusions, which are strongly related to toric differential inclusions, but have a much simpler geometric structure. We show that every toric differential inclusion can be embedded into a quasi-toric differential inclusion and that every quasi-toric differential inclusion can be embedded into a toric differential inclusion. In particular, this implies that weakly reversible dynamical systems can be embedded into quasi-toric differential inclusions.


title: Vector acoustic full waveform inversion: taking advantage of de-aliasing and receiver ghosts

abstract: Data acquisition is changing to incorporate more components of the recorded wavefield. An example of this is so-called vector data in which both the pressure and particle velocity are recorded in marine data. We present a vector acoustic full waveform inversion (VAFWI) method. We demonstrate the connection of the VAFWI adjoint operator with inverse wavefield extrapolation and show that under the assumption of a plane wave propagating towards an infinite flat recording surface at normal incidence, the VAFWI adjoint is equivalent to inverse extrapolation of the normal derivative of the recorded field. Thus, unlike the conventional FWI adjoint, the VAFWI adjoint is an inverse wavefield extrapolation operator. If these assumptions are violated, this equivalence relation is no longer true and becomes an approximation. We argue that this has implications in the handling of receiver ghosts by the two inversion methods: in the VAFWI adjoint, the receiver ghosts interact constructively with the back-propagated reflected field. We show numerically that the de-aliasing property of vector data extends to VAFWI, which results in fewer artefacts in VAFWI images compared to conventional FWI when data are spatially undersampled and aliased. Additional information about the subsurface contained in properly handled receiver ghosts can be utilized to achieve further VAFWI image improvement.


title: Design Smell Analysis for Developing and Established Open Source Java Software

abstract: Software design smells are design attributes which violate the fundamental design principles. Design smells are a key cause of design debt. Although the activities of design smell identification and measurement are predominantly considered in current literature, those which identify and communicate which design smells occur more frequently in newly developing software and which ones are more dominant in established software have been studied to a limited extent. This research describes a mechanism for identifying the design smells that are more prevalent in developing and established software respectively. A tool is provided which is used for design smell detection by analyzing large volumes of source code. More specifically, 164,609 Lines of Code (LoC) and 5,712 class files of six developing and 244,930 LoC and 12,048 class files of five established open-source Java software are analyzed. Obtained results show that out of the 4,020 occurrences of smells that were made for nine preselected types of design smells, 1,643 design smells were detected for developing software, which mainly consisted of four specific types of smells. For established software, 2,397 design smells were observed which predominantly consisted of four other types of smells. The remaining design smell was equally prevalent in both developing and established software. Desirable precision values ranging from 72.9% to 84.1% were obtained for the tool.


title: Extraction of Complex DNN Models: Real Threat or Boogeyman?

abstract: Recently, machine learning (ML) has introduced advanced solutions to many domains. Since ML models provide business advantage to model owners, protecting intellectual property of ML models has emerged as an important consideration. Confidentiality of ML models can be protected by exposing them to clients only via prediction APIs. However, model extraction attacks can steal the functionality of ML models using the information leaked to clients through the results returned via the API. In this work, we question whether model extraction is a serious threat to complex, real-life ML models. We evaluate the current state-of-the-art model extraction attack (Knockoff nets) against complex models. We reproduce and confirm the results in the original paper. But we also show that the performance of this attack can be limited by several factors, including ML model architecture and the granularity of API response. Furthermore, we introduce a defense based on distinguishing queries used for Knockoff nets from benign queries. Despite the limitations of the Knockoff nets, we show that a more realistic adversary can effectively steal complex ML models and evade known defenses.


title: Spin coherence and optical properties of alkali-metal atoms in solid parahydrogen

abstract: We present a joint experimental and theoretical study of spin coherence properties of 39K, 85Rb, 87Rb, and 133Cs atoms trapped in a solid parahydrogen matrix. We use optical pumping to prepare the spin states of the implanted atoms and circular dichroism to measure their spin states. Optical pumping signals show order-of-magnitude differences depending on both matrix growth conditions and atomic species. We measure the ensemble transverse relaxation times (T2*) of the spin states of the alkali-metal atoms. Different alkali species exhibit dramatically different T2* times, ranging from sub-microsecond coherence times for high mF states of 87Rb, to ~100 microseconds for 39K. These are the longest ensemble T2* times reported for an electron spin system at high densities (n > 10^16 cm^-3). To interpret these observations, we develop a theory of inhomogenous broadening of hyperfine transitions of ^2S atoms in weakly-interacting solid matrices. Our calculated ensemble transverse relaxation times agree well with experiment, and suggest ways to longer coherence times in future work.


abstract: The Arecibo L-band Feed Array Zone of Avoidance (ALFAZOA) Shallow Survey is a blind HI survey of the extragalactic sky behind the northern Milky Way conducted with the ALFA receiver on the 305m Arecibo Radio Telescope. ALFAZOA Shallow covered 900 square degrees at full sensitivity from 30{\deg} ${\leq} l {\leq} $75{\deg} and |b|$ {\leq}$ 10{\deg} and an additional 460 square degrees at limited sensitivity at latitudes up to 20{\deg}. It has an rms sensitivity of 5-7 mJy and a velocity resolution of 9 - 20.6 km s$^{-1}$, and detected 403 galaxies out to a recessional velocity of 12,000 km s$^{-1}$, with an angular resolution of 3.4' and a positional accuracy between 0.2' and 1.7'. The survey is complete above an integrated line flux $F_{HI}$ = 2.0 Jy km s$^{-1}$ for half the survey, and above $F_{HI}$ = 2.8 Jy km s$^{-1}$ for the other half. Forty-three percent of the ALFAZOA HI detections have at least one possible optical/NIR counterpart in the literature, and an additional 16% have counterparts that only included previous HI measurements. There are fewer counterparts in regions of high extinction and for galaxies with lower HI mass. Comparing the results of the survey to the predictions of Erdogdu et al. (2006), and using their nomenclature, ALFAZOA confirms the position and extent in the ZOA of the C7, C${\zeta}$, Pegasus, Corona Borealis and Delphinus structures, but not of the Cygnus void. Two new structures are identified, both connected to the C7 overdensity; one extends to 35{\deg}, and the other crosses the ZOA.


title: Channel Estimation for Extremely Large-Scale Massive MIMO Systems

abstract: Extremely large-scale massive multiple-input multiple-output (MIMO) has shown considerable potential in future mobile communications. However, the use of extremely large aperture arrays has led to near-field and spatial non-stationary channel conditions, which result in changes to transceiver design and channel state information that should be acquired. This letter focuses on the channel estimation problem and describes the non-stationary channel through mapping between subarrays and scatterers. We propose subarray-wise and scatterer-wise channel estimation methods to estimate the near-field non-stationary channel from the view of subarray and scatterer, respectively. Numerical results demonstrate that subarray-wise method can derive accurate channel estimation results with low complexity, whereas the scatterer-wise method can accurately position the scatterers and identify almost all the mappings between subarrays and scatterers.


title: Orchestrating the Development Lifecycle of Machine Learning-Based IoT Applications: A Taxonomy and Survey

abstract: Machine Learning (ML) and Internet of Things (IoT) are complementary advances: ML techniques unlock complete potentials of IoT with intelligence, and IoT applications increasingly feed data collected by sensors into ML models, thereby employing results to improve their business processes and services. Hence, orchestrating ML pipelines that encompasses model training and implication involved in holistic development lifecycle of an IoT application often leads to complex system integration. This paper provides a comprehensive and systematic survey on the development lifecycle of ML-based IoT application. We outline core roadmap and taxonomy, and subsequently assess and compare existing standard techniques used in individual stage.


title: Tailoring a Molecule's Optical Absorbance Using Surface Plasmonics

abstract: The design of novel functional materials in silico is severely hampered by the lack of robust and computationally efficient methods for describing both molecular absorbance and screening on substrates. Here we employ our hybrid $G_0[W_0+\Delta W]$-BSE implementation, which incorporates the substrate via its screening $\Delta W$ at both the quasiparticle $G_0W_0$ level and when solving the Bethe-Salpeter equation (BSE). We show this method can be used to both efficiently and accurately describe the absorption spectra of physisorbed molecules on metal substrates and thereby tailor the molecule's absorbance by altering the surface plasmon's energy. Specifically, we investigate how the optical absorption spectra of three prototypical $\pi$-conjugated molecules: benzene (C$_6$H$_6$), terrylene (C$_{30}$H$_{16}$) and fullerene (C$_{60}$), depends on the Wigner-Seitz radius $r_s$ of the metallic substrate. To gain further understanding of the light--molecule/substrate interaction, we also study the bright exciton's electron and hole densities and their interactions with infrared active vibrational modes. Our results show that (1) benzene's bright $E_{1u}^1$ exciton at 7.0 eV, whose energy is insensitive to changes in $r_s$, could be relevant for photocatalytic dehydrogenation and polymerization reactions, (2) terrylene's bright $B_{3u}$ exciton at 2.3 eV hybridizes with the surface plasmon, allowing the tailoring of the excitonic energy and optical activation of a surface plasmon-like exciton, and (3) fullerene's $\pi-\pi^*$ bright and dark excitons at 6.4 and 6.8 eV hybridize with the surface plasmon, resulting in the tailoring of their excitonic energy and the activation of both a surface plasmon-like exciton and a dark quadrupolar mode via symmetry breaking by the substrate.


title: Cosmic footballs from superrotations

abstract: Superrotations arise from singular vector fields on the celestial sphere in asymptotically flat space, and their finite integrated versions have been argued by Strominger and Zhiboedov to insert cosmic strings into the spacetime. In this work, we argue for an alternative definition of the action of superrotations on Minkowski space that avoids introducing any defects. This involves realizing the finite superrotation not as a diffeomorphism between spaces, but as a mapping of Minkowski space to itself that may be multivalued or non-surjective. This eliminates any defects in the bulk spacetime at the expense of allowing for defects in the boundary celestial sphere metric. We further explore the geometry of the spatial surfaces in the superrotated spaces, and note that they intersect null infinity at the singularity of the superrotation, causing a breakdown in the large $r$ asymptotic expansion there. To determine how these surfaces embed into Minkowski space, a derivation of the finite superrotation transformation is presented in both Bondi and Newman-Unti gauges. The latter is particularly interesting, since the superrotations are shown to preserve the hyperbolic slicing of Minkowski space in Newman-Unti gauge, and this gauge also provides a means for extending the geometry beyond the Bondi coordinate patch. We argue that the new interpretation for the action of superrotations on spacetime motivates consideration of a wider class of celestial sphere metrics and asymptotic symmetry groups.


title: Ca hnk: Calcium-rich Transient SN 2016hnk from the Helium Shell Detonation of a Sub-Chandrasekhar White Dwarf

abstract: We present observations and modeling of SN 2016hnk, a Ca-rich supernova (SN) that is consistent with being the result of a He-shell double-detonation explosion of a C/O white dwarf. We find that SN 2016hnk is intrinsically red relative to typical thermonuclear SNe and has a relatively low peak luminosity ($M_B = -15.4$ mag), setting it apart from low-luminosity Type Ia supernovae (SNe Ia). SN 2016hnk has a fast-rising light curve that is consistent with other Ca-rich transients ($t_r = 15$ d). We determine that SN 2016hnk produced $0.03 \pm 0.01 M_{\odot}$ of ${}^{56}\textrm{Ni}$ and $0.9 \pm 0.3 M_{\odot}$ of ejecta. The photospheric spectra show strong, high-velocity Ca II absorption and significant line blanketing at $\lambda < 5000$ Angstroms, making it distinct from typical (SN 2005E-like) Ca-rich SNe. SN 2016hnk is remarkably similar to SN 2018byg, which was modeled as a He-shell double-detonation explosion. We demonstrate that the spectra and light curves of SN 2016hnk are well modeled by the detonation of a $0.02 \ M_{\odot}$ helium shell on the surface of a $0.85 \ M_{\odot}$ C/O white dwarf. This analysis highlights the second observed case of a He-shell double-detonation and suggests a specific thermonuclear explosion that is physically distinct from SNe that are defined simply by their low luminosities and strong [Ca II] emission.


title: Roweis Discriminant Analysis: A Generalized Subspace Learning Method

abstract: We present a new method which generalizes subspace learning based on eigenvalue and generalized eigenvalue problems. This method, Roweis Discriminant Analysis (RDA), is named after Sam Roweis to whom the field of subspace learning owes significantly. RDA is a family of infinite number of algorithms where Principal Component Analysis (PCA), Supervised PCA (SPCA), and Fisher Discriminant Analysis (FDA) are special cases. One of the extreme special cases, which we name Double Supervised Discriminant Analysis (DSDA), uses the labels twice; it is novel and has not appeared elsewhere. We propose a dual for RDA for some special cases. We also propose kernel RDA, generalizing kernel PCA, kernel SPCA, and kernel FDA, using both dual RDA and representation theory. Our theoretical analysis explains previously known facts such as why SPCA can use regression but FDA cannot, why PCA and SPCA have duals but FDA does not, why kernel PCA and kernel SPCA use kernel trick but kernel FDA does not, and why PCA is the best linear method for reconstruction. Roweisfaces and kernel Roweisfaces are also proposed generalizing eigenfaces, Fisherfaces, supervised eigenfaces, and their kernel variants. We also report experiments showing the effectiveness of RDA and kernel RDA on some benchmark datasets.


title: Comment on "Blessings of Multiple Causes"

abstract: (This comment has been updated to respond to Wang and Blei's rejoinder [arXiv:1910.07320].) The premise of the deconfounder method proposed in "Blessings of Multiple Causes" by Wang and Blei [arXiv:1805.06826], namely that a variable that renders multiple causes conditionally independent also controls for unmeasured multi-cause confounding, is incorrect. This can be seen by noting that no fact about the observed data alone can be informative about ignorability, since ignorability is compatible with any observed data distribution. Methods to control for unmeasured confounding may be valid with additional assumptions in specific settings, but they cannot, in general, provide a checkable approach to causal inference, and they do not, in general, require weaker assumptions than the assumptions that are commonly used for causal inference. While this is outside the scope of this comment, we note that much recent work on applying ideas from latent variable modeling to causal inference problems suffers from similar issues.


title: The Effect of Land Fraction and Host Star Spectral Energy Distribution on the Planetary Albedo of Terrestrial Worlds

abstract: The energy balance and climate of planets can be affected by the reflective properties of their land, ocean, and frozen surfaces. Here we investigate the effect of host star spectral energy distribution (SED) on the albedo of these surfaces using a one-dimensional (1-D) energy balance model (EBM). Incorporating spectra of M-, K-, G- and F-dwarf stars, we determined the effect of varying fractional and latitudinal distribution of land and ocean surfaces as a function of host star SED on the overall planetary albedo, climate, and ice-albedo feedback response. While noting that the spatial distribution of land masses on a given planet will have an effect on the overall planetary energy balance, we find that terrestrial planets with higher average land/ocean fractions are relatively cooler and have higher albedo regardless of star type. For Earth-like planets orbiting M-dwarf stars the increased absorption of water ice in the near-infrared (NIR), where M-dwarf stars emit much of their energy, resulted in warmer global mean surface temperatures, ice lines at higher latitudes, and increased climate stability as the ice-albedo feedback became negative at high land fractions. Conversely, planets covered largely by ocean, and especially those orbiting bright stars, had a considerably different energy balance due to the contrast between the reflective land and the absorptive ocean surface, which in turn resulted in warmer average surface temperatures than land-covered planets and a stronger potential ice-albedo feedback. While dependent on the properties of individual planetary systems, our results place so constraints on a range of climate states of terrestrial exoplanets based on albedo and incident flux.


title: Thermal conductivity of AlN, GaN, and Al$_x$Ga$_{1-x}$N alloys as a function of composition, temperature, crystallographic direction, and isotope disorder from first principles

abstract: Ultra-wide-band-gap group-III nitrides are of interest for applications in deep-ultraviolet optoelectronics and power electronics. Such devices must be able to efficiently dissipate heat generated from their operation, making the thermal conductivity of the constituent materials an important parameter for high-power applications. We have investigated the phonon-limited thermal conductivity of AlN, GaN, and Al$_x$Ga$_{1-x}$N using first-principles calculations, with a focus on the effects of compositional and isotopic disorder. Our Boltzmann-transport-equation calculations show that the maximum thermal conductivity for AlN (GaN) is 348 W m$^{-1}$ K$^{-1}$ (235 W m$^{-1}$ K$^{-1}$) for with pure $^{14}$N, and 292 W m$^{-1}$ K$^{-1}$ for GaN with pure $^{71}$Ga. Al$_x$Ga$_{1-x}$N alloys reach a minimum thermal conductivity at Al mole fractions of x = 0.60 to 0.71 over the 100-1000K temperature range. Our results provide understanding on the effects of isotope disorder on the thermal conductivity of AlN and GaN. We also present an analytical model for the evaluation of the thermal conductivity of Al$_x$Ga$_{1-x}$N alloys for arbitrary composition and temperature, which can be applied for the thermal design of AlGaN-based electronic and optoelectronic devices.


title: Geovisual Analytics and Interactive Machine Learning for Situational Awareness

abstract: The first responder community has traditionally relied on calls from the public, officially-provided geographic information and maps for coordinating actions on the ground. The ubiquity of social media platforms created an opportunity for near real-time sensing of the situation (e.g. unfolding weather events or crises) through volunteered geographic information. In this article, we provide an overview of the design process and features of the Social Media Analytics Reporting Toolkit (SMART), a visual analytics platform developed at Purdue University for providing first responders with real-time situational awareness. We attribute its successful adoption by many first responders to its user-centered design, interactive (geo)visualizations and interactive machine learning, giving users control over analysis.


title: Optimal couplings between sparse block models

abstract: We study the problem of coupling a stochastic block model with a planted bisection to a uniform random graph having the same average degree. Focusing on the regime where the average degree is a constant relative to the number of vertices $n$, we show that the distance to which the models can be coupled undergoes a phase transition from $O(\sqrt{n})$ to $\Omega(n)$ as the planted bisection in the block model varies. This settles half of a conjecture of Bollob\'{a}s and Riordan and has some implications for sparse graph limit theory. In particular, for certain ranges of parameters, a block model and the corresponding uniform model produce samples which must converge to the same limit point. This implies that any notion of convergence for sequences of graphs with $\Theta(n)$ edges which allows for samples from a limit object to converge back to the limit itself must identify these models.


title: Flexibility from Networks of Data Centers: A Market Clearing Formulation with Virtual Links

abstract: Data centers owned and operated by large companies have a high power consumption and this is expected to increase in the future. However, the ability to shift computing loads geographically and in time can provide flexibility to the power grid. We introduce the concept of virtual links to capture space-time load flexibility provided by geographically-distributed data centers in market clearing procedures. We show that the virtual link abstraction fits well into existing market clearing frameworks and can help analyze and establish market design properties. This is demonstrated using illustrative case studies.


title: Energy Efficiency Maximization of Self-Sustained Wireless Body Area Sensor Networks

abstract: Electronic health monitoring is one of the major applications of wireless body area networks (WBANs) that helps with early detection of any abnormal physiological symptoms. In this paper, we propose and solve an optimization problem that maximizes the energy efficiency (EE) of WBAN consisting of sensor nodes (SNs) equipped with energy harvesting capabilities communicating with an aggregator. We exploit the structure of the optimization problem to provide a sub-optimal solution at a lower computational complexity and derive the mathematical expressions of upper and lower bounds of the source rates of the SN. The simulation results reveal that the optimal allocation of the source rate to energy critical SNs improves the system performance of WBAN in terms of energy efficiency during different everyday activities.


title: Landmarks-assisted Collaborative Deep Framework for Automatic 4D Facial Expression Recognition

abstract: We propose a novel landmarks-assisted collaborative end-to-end deep framework for automatic 4D FER. Using 4D face scan data, we calculate its various geometrical images, and afterwards use rank pooling to generate their dynamic images encapsulating important facial muscle movements over time. As well, the given 3D landmarks are projected on a 2D plane as binary images and convolutional layers are used to extract sequences of feature vectors for every landmark video. During the training stage, the dynamic images are used to train an end-to-end deep network, while the feature vectors of landmark images are used train a long short-term memory (LSTM) network. The finally improved set of expression predictions are obtained when the dynamic and landmark images collaborate over multi-views using the proposed deep framework. Performance results obtained from extensive experimentation on the widely-adopted BU-4DFE database under globally used settings prove that our proposed collaborative framework outperforms the state-of-the-art 4D FER methods and reach a promising classification accuracy of 96.7% demonstrating its effectiveness.


title: On Empirical Comparisons of Optimizers for Deep Learning

abstract: Selecting an optimizer is a central step in the contemporary deep learning pipeline. In this paper, we demonstrate the sensitivity of optimizer comparisons to the hyperparameter tuning protocol. Our findings suggest that the hyperparameter search space may be the single most important factor explaining the rankings obtained by recent empirical comparisons in the literature. In fact, we show that these results can be contradicted when hyperparameter search spaces are changed. As tuning effort grows without bound, more general optimizers should never underperform the ones they can approximate (i.e., Adam should never perform worse than momentum), but recent attempts to compare optimizers either assume these inclusion relationships are not practically relevant or restrict the hyperparameters in ways that break the inclusions. In our experiments, we find that inclusion relationships between optimizers matter in practice and always predict optimizer comparisons. In particular, we find that the popular adaptive gradient methods never underperform momentum or gradient descent. We also report practical tips around tuning often ignored hyperparameters of adaptive gradient methods and raise concerns about fairly benchmarking optimizers for neural network training.


title: An Efficient Modal-based Approach Towards Guzheng Sound Synthesis

abstract: Encouraged by recent interest in traditional Chinese instruments this work proposes a computational sound synthesis model for a traditional Chinese instrument, the guzheng. Digital waveguide model and modal synthesis are the most popular physical modelling methods. However, the excitation signal is usually over-simplified and the design of some digital filters is inadequate for real-time synthesis. We propose an accurate and efficient approach to synthesise the string signal of the guzheng. Our proposed model enables accurate parametric control of the pluck because the parameters are based on physical model of the instrument. The sound of the guzheng is then computed as the convolution of the synthesised string signal and the impulse response of the resonant body. As proof of concept, the 21st string of the guzheng is synthesised using the proposed model. The sound computed using our model shows improved accuracy with an acceptable computational complexity.


title: Neural Memory Plasticity for Anomaly Detection

abstract: In the domain of machine learning, Neural Memory Networks (NMNs) have recently achieved impressive results in a variety of application areas including visual question answering, trajectory prediction, object tracking, and language modelling. However, we observe that the attention based knowledge retrieval mechanisms used in current NMNs restricts them from achieving their full potential as the attention process retrieves information based on a set of static connection weights. This is suboptimal in a setting where there are vast differences among samples in the data domain; such as anomaly detection where there is no consistent criteria for what constitutes an anomaly. In this paper, we propose a plastic neural memory access mechanism which exploits both static and dynamic connection weights in the memory read, write and output generation procedures. We demonstrate the effectiveness and flexibility of the proposed memory model in three challenging anomaly detection tasks in the medical domain: abnormal EEG identification, MRI tumour type classification and schizophrenia risk detection in children. In all settings, the proposed approach outperforms the current state-of-the-art. Furthermore, we perform an in-depth analysis demonstrating the utility of neural plasticity for the knowledge retrieval process and provide evidence on how the proposed memory model generates sparse yet informative memory outputs.


title: MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction

abstract: Predicting human behavior is a difficult and crucial task required for motion planning. It is challenging in large part due to the highly uncertain and multi-modal set of possible outcomes in real-world domains such as autonomous driving. Beyond single MAP trajectory prediction, obtaining an accurate probability distribution of the future is an area of active interest. We present MultiPath, which leverages a fixed set of future state-sequence anchors that correspond to modes of the trajectory distribution. At inference, our model predicts a discrete distribution over the anchors and, for each anchor, regresses offsets from anchor waypoints along with uncertainties, yielding a Gaussian mixture at each time step. Our model is efficient, requiring only one forward inference pass to obtain multi-modal future distributions, and the output is parametric, allowing compact communication and analytical probabilistic queries. We show on several datasets that our model achieves more accurate predictions, and compared to sampling baselines, does so with an order of magnitude fewer trajectories.


title: Structured condition number for multiple right-hand side linear systems with parameterized quasiseparable coefficient matrix

abstract: In this paper, we consider the structured perturbation analysis for multiple right-hand side linear systems with parameterized coefficient matrix. Especially, we present the explicit expressions for structured condition numbers for multiple right-hand sides linear systems with {1;1}-quasiseparable coefficient matrix in the quasiseparable and the Givens-vector representations. In addition, the comparisons of these two condition numbers between themselves, and with respect to unstructured condition number are investigated. Moreover, the effective structured condition number for multiple right-hand sides linear systems with {1;1}-quasiseparable coefficient matrix is proposed. The relationships between the effective structured condition number and structured condition numbers with respect to the quasiseparable and the Givens-vector representations are also studied. Numerical experiments show that there are situations in which the effective structured condition number can be much smaller than the unstructured ones.


title: Modeling Information Cascades with Self-exciting Processes via Generalized Epidemic Models

abstract: Epidemic models and self-exciting processes are two types of models used to describe diffusion phenomena online and offline. These models were originally developed in different scientific communities, and their commonalities are under-explored. This work establishes, for the first time, a general connection between the two model classes via three new mathematical components. The first is a generalized version of stochastic Susceptible-Infected-Recovered (SIR) model with arbitrary recovery time distributions; the second is the relationship between the (latent and arbitrary) recovery time distribution, recovery hazard function, and the infection kernel of self-exciting processes; the third includes methods for simulating, fitting, evaluating and predicting the generalized process. On three large Twitter diffusion datasets, we conduct goodness-of-fit tests and holdout log-likelihood evaluation of self-exciting processes with three infection kernels --- exponential, power-law and Tsallis Q-exponential. We show that the modeling performance of the infection kernels varies with respect to the temporal structures of diffusions, and also with respect to user behavior, such as the likelihood of being bots. We further improve the prediction of popularity by combining two models that are identified as complementary by the goodness-of-fit tests.


title: Adaptive design for Gaussian process regression under censoring

abstract: A key objective in engineering problems is to predict an unknown experimental surface over an input domain. In complex physical experiments, this may be hampered by response censoring, which results in a significant loss of information. For such problems, experimental design is paramount for maximizing predictive power using a small number of expensive experimental runs. To tackle this, we propose a novel adaptive design method, called the integrated censored mean-squared error (ICMSE) method. The ICMSE method first estimates the posterior probability of a new observation being censored, then adaptively chooses design points that minimize predictive uncertainty under censoring. Adopting a Gaussian process regression model with product correlation function, the proposed ICMSE criterion is easy to evaluate, which allows for efficient design optimization. We demonstrate the effectiveness of the ICMSE design in two real-world applications on surgical planning and wafer manufacturing.