title: Interpretable Machine Learning Approaches to Prediction of Chronic Homelessness

abstract: We introduce a machine learning approach to predict chronic homelessness from de-identified client shelter records drawn from a commonly used Canadian homelessness management information system. Using a 30-day time step, a dataset for 6521 individuals was generated. Our model, HIFIS-RNN-MLP, incorporates both static and dynamic features of a client's history to forecast chronic homelessness 6 months into the client's future. The training method was fine-tuned to achieve a high F1-score, giving a desired balance between high recall and precision. Mean recall and precision across 10-fold cross validation were 0.921 and 0.651 respectively. An interpretability method was applied to explain individual predictions and gain insight into the overall factors contributing to chronic homelessness among the population studied. The model achieves state-of-the-art performance and improved stakeholder trust of what is usually a "black box" neural network model through interpretable AI.


title: Running the COVID-19 marathon: the behavioral adaptations in mobility and facemask over 27 weeks of pandemic in Seoul, South Korea

abstract: Battle with COVID-19 turned out to be a marathon, not a sprint, and behavioral adjustments have been unavoidable to stay viable. In this paper, we employ a data-centric approach to investigate individual mobility adaptations and mask-wearing in Seoul, South Korea. We first identify six epidemic phases and two waves based on COVID-19 case count and its geospatial dispersion. The phase-specific linear models reveal the strong, self-driven mobility reductions in the first escalation and peak with a common focus on public transit use and less-essential weekend/afternoon trips. However, comparable reduction was not present in the second wave, as the shifted focus from mobility to mask-wearing was evident. Although no lockdowns and gentle nudge to wear mask seemed counter-intuitive, simple and persistent communication on personal safety has been effective and sustainable to induce cooperative behavioral adaptations. Our phase-specific analyses and interpretation highlight the importance of targeted response consistent with the fluctuating epidemic risk.


title: COVID-19 Literature Topic-Based Search via Hierarchical NMF

abstract: A dataset of COVID-19-related scientific literature is compiled, combining the articles from several online libraries and selecting those with open access and full text available. Then, hierarchical nonnegative matrix factorization is used to organize literature related to the novel coronavirus into a tree structure that allows researchers to search for relevant literature based on detected topics. We discover eight major latent topics and 52 granular subtopics in the body of literature, related to vaccines, genetic structure and modeling of the disease and patient studies, as well as related diseases and virology. In order that our tool may help current researchers, an interactive website is created that organizes available literature using this hierarchical structure.


title: A Survey on Smart Metering Systems using Blockchain for E-Mobility

abstract: Electricity is an essential comfort to support our daily activities. With the competitive increase and energy costs by the industry, new values and opportunities for delivering electricity to customers are produced. One of these new opportunities is electric vehicles. With the arrival of electric vehicles, various challenges and opportunities are being presented in the electric power system worldwide. For example, under the traditional electric power billing scheme, electric power has to be consumed where it is needed so that end-users could not charge their electric vehicles at different points (e.g. a relative's house) if this the correct user is not billed (this due to the high consumption of electrical energy that makes it expensive). To achieve electric mobility, they must solve new challenges, such as the smart metering of energy consumption and the cybersecurity of these measurements. The present work shows a study of the different smart metering technologies that use blockchain and other security mechanisms to achieve e-mobility.


title: The Relationship between Deteriorating Mental Health Conditions and Longitudinal Behavioral Changes in Google and YouTube Usages among College Students in the United States during COVID-19: Observational Study

abstract: Mental health problems among the global population are worsened during the coronavirus disease (COVID-19). How individuals engage with online platforms such as Google Search and YouTube undergoes drastic shifts due to pandemic and subsequent lockdowns. Such ubiquitous daily behaviors on online platforms have the potential to capture and correlate with clinically alarming deteriorations in mental health profiles in a non-invasive manner. The goal of this study is to examine, among college students, the relationship between deteriorating mental health conditions and changes in user behaviors when engaging with Google Search and YouTube during COVID-19. This study recruited a cohort of 49 students from a U.S. college campus during January 2020 (prior to the pandemic) and measured the anxiety and depression levels of each participant. This study followed up with the same cohort during May 2020 (during the pandemic), and the anxiety and depression levels were assessed again. The longitudinal Google Search and YouTube history data were anonymized and collected. From individual-level Google Search and YouTube histories, we developed 5 signals that can quantify shifts in online behaviors during the pandemic. We then assessed the differences between groups with and without deteriorating mental health profiles in terms of these features. Significant features included late-night online activities, continuous usages, and time away from the internet, porn consumptions, and keywords associated with negative emotions, social activities, and personal affairs. Though further studies are required, our results demonstrated the feasibility of utilizing pervasive online data to establish non-invasive surveillance systems for mental health conditions that bypasses many disadvantages of existing screening methods.


title: Open-Source Synthesizable Analog Blocks for High-Speed Link Designs: 20-GS/s 5b ENOB Analog-to-Digital Converter and 5-GHz Phase Interpolator

abstract: Using digital standard cells and digital place-and-route (PnR) tools, we created a 20 GS/s, 8-bit analog-to-digital converter (ADC) for use in high-speed serial link applications with an ENOB of 5.6, a DNL of 0.96 LSB, and an INL of 2.39 LSB, which dissipated 175 mW in 0.102 mm2 in a 16nm technology. The design is entirely described by HDL so that it can be ported to other processes with minimal effort and shared as open source.


title: Beyond Social Media Analytics: Understanding Human Behaviour and Deep Emotion using Self Structuring Incremental Machine Learning

abstract: This thesis develops a conceptual framework considering social data as representing the surface layer of a hierarchy of human social behaviours, needs and cognition which is employed to transform social data into representations that preserve social behaviours and their causalities. Based on this framework two platforms were built to capture insights from fast-paced and slow-paced social data. For fast-paced, a self-structuring and incremental learning technique was developed to automatically capture salient topics and corresponding dynamics over time. An event detection technique was developed to automatically monitor those identified topic pathways for significant fluctuations in social behaviours using multiple indicators such as volume and sentiment. This platform is demonstrated using two large datasets with over 1 million tweets. The separated topic pathways were representative of the key topics of each entity and coherent against topic coherence measures. Identified events were validated against contemporary events reported in news. Secondly for the slow-paced social data, a suite of new machine learning and natural language processing techniques were developed to automatically capture self-disclosed information of the individuals such as demographics, emotions and timeline of personal events. This platform was trialled on a large text corpus of over 4 million posts collected from online support groups. This was further extended to transform prostate cancer related online support group discussions into a multidimensional representation and investigated the self-disclosed quality of life of patients (and partners) against time, demographics and clinical factors. The capabilities of this extended platform have been demonstrated using a text corpus collected from 10 prostate cancer online support groups comprising of 609,960 prostate cancer discussions and 22,233 patients.


title: Problems in AI research and how the SP System may help to solve them

abstract: This paper describes problems in AI research and how the SP System (described in an appendix) may help to solve them. Most of the problems are described by leading researchers in AI in interviews with science writer Martin Ford, and reported by him in his book {\em Architects of Intelligence}. These problems are: the need to bridge the divide between symbolic and non-symbolic kinds of knowledge and processing; the tendency of deep neural networks (DNNs) to make large and unexpected errors in recognition; the need to strengthen the representation and processing of natural languages; the challenges of unsupervised learning; the need for a coherent account of generalisation; how to learn usable knowledge from a single exposure; how to achieve transfer learning; how to increase the efficiency of AI processing; the need for transparency in AI structures and processes; how to achieve varieties of probabilistic reasoning; the need for more emphasis on top-down strategies; how to minimise the risk of accidents with self-driving vehicles; the need for strong compositionality in AI knowledge; the challenges of commonsense reasoning and commonsense knowledge; establishing the importance of information compression in AI research; establishing the importance of a biological perspective in AI research; establishing whether knowledge in the brain is represented in `distributed' or `localist' form; how to bypassing the limited scope for adaptation in deep neural networks; the need to develop `broad AI'; and how to eliminate the problem of catastrophic forgetting.


title: Modelling risk-taking behaviour of avalanche accident victims

abstract: Each year, over 15000 requests for mountain rescue are counted in France. Avalanche accidents represent 39\% of reports, and are therefore our focus in this study. Modelling the behaviour of mountain accident victims is useful to develop more accurate rescue and prevention tools. Concretely, we observe the interference of two heuristics (availability and familiarity) in decision making when choosing an itinerary in backcountry skiing. We developed a serious game to evaluate their effect on the probability of engaging in a risky itinerary, while varying situational and environmental criteria in each participant (N = 278). The availability heuristic is operationalized by three situations, an avalanche accident video, a backcountry skiing video and a neutral context. The familiarity heuristic is operationalized by two criteria, strong and weak familiarity with the place. Results demonstrate the effects of both heuristics. Measurements through our serious game are discussed in the perspective of developing an interactive prevention tool for mitigating the negative effects of heuristics.


title: Closed-loop spiking control on a neuromorphic processor implemented on the iCub

abstract: Despite neuromorphic engineering promises the deployment of low latency, adaptive and low power systems that can lead to the design of truly autonomous artificial agents, the development of a fully neuromorphic artificial agent is still missing. While neuromorphic sensing and perception, as well as decision-making systems, are now mature, the control and actuation part is lagging behind. In this paper, we present a closed-loop motor controller implemented on mixed-signal analog-digital neuromorphic hardware using a spiking neural network. The network performs a proportional control action by encoding target, feedback, and error signals using a spiking relational network. It continuously calculates the error through a connectivity pattern, which relates the three variables by means of feed-forward connections. Recurrent connections within each population are used to speed up the convergence, decrease the effect of mismatch and improve selectivity. The neuromorphic motor controller is interfaced with the iCub robot simulator. We tested our spiking P controller in a single joint control task, specifically for the robot head yaw. The spiking controller sends the target positions, reads the motor state from its encoder, and sends back the motor commands to the joint. The performance of the spiking controller is tested in a step response experiment and in a target pursuit task. In this work, we optimize the network structure to make it more robust to noisy inputs and device mismatch, which leads to better control performances.


title: Visilant: Visual Support for the Exploration and Analytical Process Tracking in Criminal Investigations

abstract: The daily routine of criminal investigators consists of a thorough analysis of highly complex and heterogeneous data of crime cases. Such data can consist of case descriptions, testimonies, criminal networks, spatial and temporal information, and virtually any other data that is relevant for the case. Criminal investigators work under heavy time pressure to analyze the data for relationships, propose and verify several hypotheses, and derive conclusions, while the data can be incomplete or inconsistent and is changed and updated throughout the investigation, as new findings are added to the case. Based on a four-year intense collaboration with criminalists, we present a conceptual design for a visual tool supporting the investigation workflow and Visilant, a web-based tool for the exploration and analysis of criminal data guided by the proposed design. Visilant aims to support namely the exploratory part of the investigation pipeline, from case overview, through exploration and hypothesis generation, to the case presentation. Visilant tracks the reasoning process and as the data is changing, it informs investigators which hypotheses are affected by the data change and should be revised. The tool was evaluated by senior criminology experts within two sessions and their feedback is summarized in the paper. Additional supplementary material contains the technical details and exemplary case study.


title: What is an intelligent system?

abstract: The concept of intelligent system has emerged in information technology as a type of system derived from successful applications of artificial intelligence. The goal of this paper is to give a general description of an intelligent system, which integrates previous approaches and takes into account recent advances in artificial intelligence. The paper describes an intelligent system in a generic way, identifying its main properties and functional components. The presented description follows a pragmatic approach to be used in an engineering context as a general framework to analyze and build intelligent systems. Its generality and its use is illustrated with real-world system examples and related with artificial intelligence methods.


title: Intimate Partner Violence and Injury Prediction From Radiology Reports

abstract: Intimate partner violence (IPV) is an urgent, prevalent, and under-detected public health issue. We present machine learning models to assess patients for IPV and injury. We train the predictive algorithms on radiology reports with 1) IPV labels based on entry to a violence prevention program and 2) injury labels provided by emergency radiology fellowship-trained physicians. Our dataset includes 34,642 radiology reports and 1479 patients of IPV victims and control patients. Our best model predicts IPV a median of 3.08 years before violence prevention program entry with a sensitivity of 64% and a specificity of 95%. We conduct error analysis to determine for which patients our model has especially high or low performance and discuss next steps for a deployed clinical risk model.


title: Improving Performance of Zoom-In Cosmological Simulations using Initial Conditions with Customized Grids

abstract: We present a method for customizing the root grid of zoom-in initial conditions used for simulations of galaxy formation. Starting from the white noise used to seed the structures of an existing initial condition, we cut out a smaller region of interest and use this trimmed white noise cube to create a new root grid. This new root grid contains similar structures as the original, but allows for a smaller box volume and different grid resolution that can be tuned to best suit a given simulation code. To minimally disturb the zoom region, the dark matter particles and gas cells from the original zoom region are placed within the new root grid, with no modification other than a bulk velocity offset to match the systemic velocity of the corresponding region in the new root grid. We validate this method using a zoom-in initial condition containing a Local Group analog. We run collisionless simulations using the original and modified initial conditions, finding good agreement. The dark matter halo masses of the two most massive galaxies at $z=0$ match the original to within 15%. The times and masses of major mergers are reproduced well, as are the full dark matter accretion histories. While we do not reproduce specific satellite galaxies found in the original simulation, we obtain qualitative agreement in the distributions of the maximum circular velocity and the distance from the central galaxy. We also examine the runtime speedup provided by this method for full hydrodynamic simulations with the ART code. We find that reducing the root grid cell size improves performance, but the increased particle and cell numbers can negate some of the gain. We test several realizations, with our best runs achieving a speedup of nearly a factor of two.


title: Focused Clinical Query Understanding and Retrieval of Medical Snippets powered through a Healthcare Knowledge Graph

abstract: Clinicians face several significant barriers to search and synthesize accurate, succinct, updated, and trustworthy medical information from several literature sources during the practice of medicine and patient care. In this talk, we will be presenting our research behind the development of a Focused Clinical Search Service, powered by a Healthcare Knowledge Graph, to interpret the query intent behind clinical search queries and retrieve relevant medical snippets from a diverse corpus of medical literature.


title: Feature Selection on Lyme Disease Patient Survey Data

abstract: Lyme disease is a rapidly growing illness that remains poorly understood within the medical community. Critical questions about when and why patients respond to treatment or stay ill, what kinds of treatments are effective, and even how to properly diagnose the disease remain largely unanswered. We investigate these questions by applying machine learning techniques to a large scale Lyme disease patient registry, MyLymeData, developed by the nonprofit LymeDisease.org. We apply various machine learning methods in order to measure the effect of individual features in predicting participants' answers to the Global Rating of Change (GROC) survey questions that assess the self-reported degree to which their condition improved, worsened, or remained unchanged following antibiotic treatment. We use basic linear regression, support vector machines, neural networks, entropy-based decision tree models, and $k$-nearest neighbors approaches. We first analyze the general performance of the model and then identify the most important features for predicting participant answers to GROC. After we identify the "key" features, we separate them from the dataset and demonstrate the effectiveness of these features at identifying GROC. In doing so, we highlight possible directions for future study both mathematically and clinically.


title: An AI based talent acquisition and benchmarking for job

abstract: In a recruitment industry, selecting a best CV from a particular job post within a pile of thousand CV's is quite challenging. Finding a perfect candidate for an organization who can be fit to work within organizational culture is a difficult task. In order to help the recruiters to fill these gaps we leverage the help of AI. We propose a methodology to solve these problems by matching the skill graph generated from CV and Job Post. In this report our approach is to perform the business understanding in order to justify why such problems arise and how we intend to solve these problems using natural language processing and machine learning techniques. We limit our project only to solve the problem in the domain of the computer science industry.


title: Strain-induced semiconductor to metal transition in MA2Z4 bilayers

abstract: Very recently, a new type of two-dimensional layered material MoSi2N4 has been fabricated, which is semiconducting with weak interlayer interaction, high strength, and excellent stability. We systematically investigate theoretically the effect of vertical strain on the electronic structure of MA2Z4 (M=Ti/Cr/Mo, A=Si, Z=N/P) bilayers. Taking bilayer MoSi2N4 as an example, our first principle calculations show that its indirect band gap decreases monotonically as the vertical compressive strain increases. Under a critical strain around 22%, it undergoes a transition from semiconductor to metal. We attribute this to the opposite energy shift of states in different layers, which originates from the built-in electric field induced by the asymmetric charge transfer between two inner sublayers near the interface. Similar semiconductor to metal transitions are observed in other strained MA2Z4 bilayers, and the estimated critical pressures to realize such transitions are within the same order as semiconducting transition metal dichalcogenides. The semiconductor to metal transitions observed in the family of MA2Z4 bilayers present interesting possibilities for strain-induced engineering of their electronic properties.


title: MIRAGE: Mitigating Conflict-Based Cache Attacks with a Practical Fully-Associative Design

abstract: Shared processor caches are vulnerable to conflict-based side-channel attacks, where an attacker can monitor access patterns of a victim by evicting victim cache lines using cache-set conflicts. Recent mitigations propose randomized mapping of addresses to cache lines to obfuscate the locations of set-conflicts. However, these are vulnerable to new attacks that discover conflicting sets of addresses despite such mitigations, because these designs select eviction-candidates from a small set of conflicting lines. This paper presents Mirage, a practical design for a fully associative cache, wherein eviction candidates are selected randomly from all lines resident in the cache, to be immune to set-conflicts. A key challenge for enabling such designs in large shared caches (containing tens of thousands of cache lines) is the complexity of cache-lookup, as a naive design can require searching through all the resident lines. Mirage achieves full-associativity while retaining practical set-associative lookups by decoupling placement and replacement, using pointer-based indirection from tag-store to data-store to allow a newly installed address to globally evict the data of any random resident line. To eliminate set-conflicts, Mirage provisions extra invalid tags in a skewed-associative tag-store design where lines can be installed without set-conflict, along with a load-aware skew-selection policy that guarantees the availability of sets with invalid tags. Our analysis shows Mirage provides the global eviction property of a fully-associative cache throughout system lifetime (violations of full-associativity, i.e. set-conflicts, occur less than once in 10^4 to 10^17 years), thus offering a principled defense against any eviction-set discovery and any potential conflict based attacks. Mirage incurs limited slowdown (2%) and 17-20% extra storage compared to a non-secure cache.


title: Spin-momentum locking induced non-local voltage in topological insulator nanowire

abstract: The momentum and spin of charge carriers in the topological insulators are constrained to be perpendicular to each other due to the strong spin-orbit coupling. We have investigated this unique spin-momentum locking property in Sb2Te3 topological insulator nanowires by injecting spin-polarized electrons through magnetic tunnel junction electrodes. Non-local voltage measurements exhibit a symmetry with respect to the magnetic field applied perpendicular to the nanowire channel, which is remarkably different from that of a non-local measurement in a channel that lacks spin-momentum locking. In stark contrast to conventional non-local spin valves, simultaneous reversal of magnetic moments of all magnetic contacts to the Sb2Te3 nanowire alters the non-local voltage. This unusual symmetry is a clear signature of the spin-momentum locking in the Sb2Te3 nanowire surface states.


title: Evaluation of Local Explanation Methods for Multivariate Time Series Forecasting

abstract: Being able to interpret a machine learning model is a crucial task in many applications of machine learning. Specifically, local interpretability is important in determining why a model makes particular predictions. Despite the recent focus on AI interpretability, there has been a lack of research in local interpretability methods for time series forecasting while the few interpretable methods that exist mainly focus on time series classification tasks. In this study, we propose two novel evaluation metrics for time series forecasting: Area Over the Perturbation Curve for Regression and Ablation Percentage Threshold. These two metrics can measure the local fidelity of local explanation models. We extend the theoretical foundation to collect experimental results on two popular datasets, \textit{Rossmann sales} and \textit{electricity}. Both metrics enable a comprehensive comparison of numerous local explanation models and find which metrics are more sensitive. Lastly, we provide heuristical reasoning for this analysis.


title: Holistic Grid Fusion Based Stop Line Estimation

abstract: Intersection scenarios provide the most complex traffic situations in Autonomous Driving and Driving Assistance Systems. Knowing where to stop in advance in an intersection is an essential parameter in controlling the longitudinal velocity of the vehicle. Most of the existing methods in literature solely use cameras to detect stop lines, which is typically not sufficient in terms of detection range. To address this issue, we propose a method that takes advantage of fused multi-sensory data including stereo camera and lidar as input and utilizes a carefully designed convolutional neural network architecture to detect stop lines. Our experiments show that the proposed approach can improve detection range compared to camera data alone, works under heavy occlusion without observing the ground markings explicitly, is able to predict stop lines for all lanes and allows detection at a distance up to 50 meters.


title: FlexWatts: A Power- and Workload-Aware Hybrid Power Delivery Network for Energy-Efficient Microprocessors

abstract: Modern client processors typically use one of three commonly-used power delivery network (PDN): 1) motherboard voltage regulators (MBVR), 2) integrated voltage regulators (IVR), and 3) low dropout voltage regulators (LDO). We observe that the energy-efficiency of each of these PDNs varies with the processor power (e.g., thermal design power (TDP) and dynamic power-state) and workload characteristics. This leads to energy inefficiency and performance loss, as modern client processors operate across a wide spectrum of power consumption and execute a wide variety of workloads. We propose FlexWatts, a hybrid adaptive PDN for modern client processors whose goal is to provide high energy-efficiency across the processor's wide range of power consumption and workloads by dynamically allocating PDNs to processor domains. FlexWatts is based on three key ideas. First, it combines IVRs and LDOs in a novel way to share multiple on-chip and off-chip resources. This hybrid PDN is allocated for processor domains with a wide power consumption range and it dynamically switches between two modes: IVR-Mode and LDO-Mode, depending on the power consumption. Second, for all other processor domains, FlexWatts statically allocates off-chip VRs. Third, FlexWatts introduces a prediction algorithm that switches the hybrid PDN to the mode that is the most beneficial. To evaluate the tradeoffs of PDNs, we develop and open-source PDNspot, the first validated architectural PDN model that enables quantitative analysis of PDN metrics. Using PDNspot, we evaluate FlexWatts on a wide variety of SPEC CPU2006, 3DMark06, and battery life workloads against IVR, the state-of-the-art PDN in modern client processors. For a 4W TDP processor, FlexWatts improves the average performance of the SPEC CPU2006 and 3DMark06 workloads by 22% and 25%, respectively. FlexWatts has comparable cost and area overhead to IVR.


title: The embeddings of the Heisenberg group into the Cremona group

abstract: In this note we describe the embeddings of the Heisenberg group into the Cremona group.


title: Entanglement Properties of Quantum Superpositions of Smooth, Differentiable Functions

abstract: We present an entanglement analysis of quantum superpositions corresponding to smooth, differentiable, real-valued (SDR) univariate functions. SDR functions are shown to be scalably approximated by low-rank matrix product states, for large system discretizations. We show that the maximum von-Neumann bipartite entropy of these functions grows logarithmically with the system size. This implies that efficient low-rank approximations to these functions exist in a matrix product state (MPS) for large systems. As a corollary, we show an upper bound on trace-distance approximation accuracy for a rank-2 MPS as $\Omega(\log N/N)$, implying that these low-rank approximations can scale accurately for large quantum systems.


title: Detecting anomalous citation groups in journal networks

abstract: The ever-increasing competitiveness in the academic publishing market incentivizes journal editors to pursue higher impact factors. This translates into journals becoming more selective, and, ultimately, into higher publication standards. However, the fixation on higher impact factors leads some journals to artificially boost impact factors through the coordinated effort of a "citation cartel" of journals. "Citation cartel" behavior has become increasingly common in recent years, with several instances being reported. Here, we propose an algorithm -- named CIDRE -- to detect anomalous groups of journals that exchange citations at excessively high rates when compared against a null model that accounts for scientific communities and journal size. CIDRE detects more than half of the journals suspended from Journal Citation Reports due to anomalous citation behavior in the year of suspension or in advance. Furthermore, CIDRE detects many new anomalous groups, where the impact factors of the member journals are lifted substantially higher by the citations from other member journals. We describe a number of such examples in detail and discuss the implications of our findings with regard to the current academic climate.


title: Characterizing [C II] Line Emission In Massive Star Forming Clumps

abstract: Because the 157.74 micron [C II] line is the dominant coolant of star-forming regions, it is often used to infer the global star-formation rates of galaxies. By characterizing the [C II] and far-infrared emission from nearby Galactic star-forming molecular clumps, it is possible to determine whether extragalactic [C II] emission arises from a large ensemble of such clumps, and whether [C II] is indeed a robust indicator of global star formation. We describe [C II] and far-infrared observations using the FIFI-LS instrument on the SOFIA airborne observatory toward four dense, high-mass, Milky Way clumps. Despite similar far-infrared luminosities, the [C II] to far-infrared luminosity ratio, L([C II])/L(FIR) varies by a factor of at least 140 among these four clumps. In particular, for AGAL313.576+0.324, no [C II] line emission is detected despite a FIR luminosity of 24,000 L_sun. AGAL313.576+0.324 lies a factor of more than 100 below the empirical correlation curve between L([C II])/L(FIR) and S_\nu (63 micron)/S_\nu (158 micron) found for galaxies. AGAL313.576+0.324 may be in an early evolutionary "protostellar" phase with insufficient ultraviolet flux to ionize carbon, or in a deeply embedded ``hypercompact' H II region phase where dust attenuation of UV flux limits the region of ionized carbon to undetectably small volumes. Alternatively, its apparent lack of \cii\, emission may arise from deep absorption of the \cii\, line against the 158 micron continuum, or self-absorption of brighter line emission by foreground material, which might cancel or diminish any emission within the FIFI-LS instrument's broad spectral resolution element (~250 km/s)


title: Looking Beyond Sentence-Level Natural Language Inference for Downstream Tasks

abstract: In recent years, the Natural Language Inference (NLI) task has garnered significant attention, with new datasets and models achieving near human-level performance on it. However, the full promise of NLI -- particularly that it learns knowledge that should be generalizable to other downstream NLP tasks -- has not been realized. In this paper, we study this unfulfilled promise from the lens of two downstream tasks: question answering (QA), and text summarization. We conjecture that a key difference between the NLI datasets and these downstream tasks concerns the length of the premise; and that creating new long premise NLI datasets out of existing QA datasets is a promising avenue for training a truly generalizable NLI model. We validate our conjecture by showing competitive results on the task of QA and obtaining the best reported results on the task of Checking Factual Correctness of Summaries.


title: Safety-Critical Kinematic Control of Robotic Systems

abstract: Over the decades, kinematic controllers have proven to be practically useful for applications like set-point and trajectory tracking in robotic systems. To this end, we formulate a novel safety-critical paradigm for kinematic control in this paper. In particular, we extend the methodology of control barrier functions (CBFs) to kinematic equations governing robotic systems. We demonstrate a purely kinematic implementation of a velocity-based CBF, and subsequently introduce a formulation that guarantees safety at the level of dynamics. This is achieved through a new form CBFs that incorporate kinetic energy with the classical forms, thereby minimizing model dependence and conservativeness. The approach is then extended to underactuated systems. This method and the purely kinematic implementation are demonstrated in simulation on two robotic platforms: a 6-DOF robotic manipulator, and a cart-pole system.


title: The Stein Effect for Frechet Means

abstract: The Frechet mean is a useful description of location for a probability distribution on a metric space that is not necessarily a vector space. This article considers simultaneous estimation of multiple Frechet means from a decision-theoretic perspective, and in particular, the extent to which the unbiased estimator of a Frechet mean can be dominated by a generalization of the James-Stein shrinkage estimator. It is shown that if the metric space satisfies a non-positive curvature condition, then this generalized James-Stein estimator asymptotically dominates the unbiased estimator as the dimension of the space grows. These results hold for a large class of distributions on a variety of spaces - including Hilbert spaces - and therefore partially extend known results on the applicability of the James-Stein estimator to non-normal distributions on Euclidean spaces. Simulation studies on metric trees and symmetric-positive-definite matrices are presented, numerically demonstrating the efficacy of this generalized James-Stein estimator.


title: Amazon Fake Reviews

abstract: Often, there are suspicious Amazon reviews that seem to be excessively positive or have been created through a repeating algorithm. I moved to detect fake reviews on Amazon through semantic analysis in conjunction with meta data such as time, word choice, and the user who posted. I first came up with several instances that may indicate a review isn't genuine and constructed what the algorithm would look like. Then I coded the algorithm and tested the accuracy of it using statistical analysis and analyzed it based on the six qualities of code.


title: C-SAW: A Framework for Graph Sampling and Random Walk on GPUs

abstract: Many applications require to learn, mine, analyze and visualize large-scale graphs. These graphs are often too large to be addressed efficiently using conventional graph processing technologies. Many applications have requirements to analyze, transform, visualize and learn large scale graphs. These graphs are often too large to be addressed efficiently using conventional graph processing technologies. Recent literatures convey that graph sampling/random walk could be an efficient solution. In this paper, we propose, to the best of our knowledge, the first GPU-based framework for graph sampling/random walk. First, our framework provides a generic API which allows users to implement a wide range of sampling and random walk algorithms with ease. Second, offloading this framework on GPU, we introduce warp-centric parallel selection, and two optimizations for collision migration. Third, towards supporting graphs that exceed GPU memory capacity, we introduce efficient data transfer optimizations for out-of-memory sampling, such as workload-aware scheduling and batched multi-instance sampling. In its entirety, our framework constantly outperforms the state-of-the-art projects. First, our framework provides a generic API which allows users to implement a wide range of sampling and random walk algorithms with ease. Second, offloading this framework on GPU, we introduce warp-centric parallel selection, and two novel optimizations for collision migration. Third, towards supporting graphs that exceed the GPU memory capacity, we introduce efficient data transfer optimizations for out-of-memory and multi-GPU sampling, such as workload-aware scheduling and batched multi-instance sampling. Taken together, our framework constantly outperforms the state of the art projects in addition to the capability of supporting a wide range of sampling and random walk algorithms.


title: Akita: A CPU scheduler for virtualized Clouds

abstract: Clouds inherit CPU scheduling policies of operating systems. These policies enforce fairness while leveraging best-effort mechanisms to enhance responsiveness of all schedulable entities, irrespective of their service level objectives (SLOs). This leads to unpredictable performance that forces cloud providers to enforce strict reservation and isolation policies to prevent high-criticality services (e.g., Memcached) from being impacted by low-criticality ones (e.g., logging), which results in low utilization. In this paper, we present Akita, a hypervisor CPU scheduler that delivers predictable performance at high utilization. Akita allows virtual machines (VMs) to be categorized into high- and low-criticality VMs. Akita provides strong guarantees on the ability of cloud providers to meet SLOs of high-criticality VMs, by temporarily slowing down low-criticality VMs if necessary. Akita, therefore, allows the co-existence of high and low-criticality VMs on the same physical machine, leading to higher utilization. The effectiveness of Akita is demonstrated by a prototype implementation in the Xen hypervisor. We present experimental results that show the many advantages of adopting Akita as the hypervisor CPU scheduler. In particular, we show that high-criticality Memcached VMs are able to deliver predictable performance despite being co-located with low-criticality CPU-bound VMs.


title: The well-poised property and torus quotients

abstract: An embedded variety is said to be well-poised when the associated initial ideal degenerations coming from points of the tropical variety are reduced and irreducible. Varieties with a well-poised embedding admit a large collection of explicitly constructible Newton-Okounkov bodies. This paper aims to study the well-poised property under torus quotients. Our first result states that GIT quotients of normal well-poised varieties by quasi-tori also have well-poised embeddings. As an application, we show that several Hassett spaces, $\overline{M}_{0,\beta}$, are well-poised under Alexeev's embedding. Conversely, given an affine $T$-variety $X$ with polyhedral divisor $\mathfrak{D}$ on a well-poised base $Y$, we construct an embedding of $X \subseteq \mathbb{A}^N$ and provide conditions on $Y$ and $\mathfrak{D}$ which if met, imply $X$ is well-poised under this embedding. Then we show that any affine arrangement variety meets the specified criteria, generalizing results of Ilten and the second author for rational complexity 1 varieties. Using this result, we explicitly compute many Newton-Okounkov cones of $X$ and provide a criterion for the associated toric degenerations to be normal. Our final application combines these two results to show that hypertoric varieties have well-poised embeddings.


title: Street Network Models and Indicators for Every Urban Area in the World

abstract: Cities worldwide exhibit a variety of street network patterns and configurations that shape human mobility, equity, health, and livelihoods. This study models and analyzes the street networks of every urban area in the world, using boundaries derived from the Global Human Settlement Layer. Street network data are acquired and modeled from OpenStreetMap with the open-source OSMnx software. In total, this study models over 160 million OpenStreetMap street network nodes and over 320 million edges across 8,914 urban areas in 178 countries, and attaches elevation and grade data. This article presents the study's reproducible computational workflow, introduces two new open data repositories of ready-to-use global street network models and calculated indicators, and discusses summary findings on street network form worldwide. It makes four contributions. First, it reports the methodological advances of this open-source workflow. Second, it produces an open data repository containing street network models for each urban area. Third, it analyzes these models to produce an open data repository containing street network form indicators for each urban area. No such global urban street network indicator dataset has previously existed. Fourth, it presents a summary analysis of urban street network form, reporting the first such worldwide results in the literature.

categories: physics.soc-ph math.GN physics.app-ph stat.AP


title: A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection

abstract: Unsupervised aspect detection (UAD) aims at automatically extracting interpretable aspects and identifying aspect-specific segments (such as sentences) from online reviews. However, recent deep learning-based topic models, specifically aspect-based autoencoder, suffer from several problems, such as extracting noisy aspects and poorly mapping aspects discovered by models to the aspects of interest. To tackle these challenges, in this paper, we first propose a self-supervised contrastive learning framework and an attention-based model equipped with a novel smooth self-attention (SSA) module for the UAD task in order to learn better representations for aspects and review segments. Secondly, we introduce a high-resolution selective mapping (HRSMap) method to efficiently assign aspects discovered by the model to aspects of interest. We also propose using a knowledge distilling technique to further improve the aspect detection performance. Our methods outperform several recent unsupervised and weakly supervised approaches on publicly available benchmark user review datasets. Aspect interpretation results show that extracted aspects are meaningful, have good coverage, and can be easily mapped to aspects of interest. Ablation studies and attention weight visualization also demonstrate the effectiveness of SSA and the knowledge distilling method.


title: On Kakeya maps with regularity assumptions

abstract: In $\mathbb R^n$, we parametrize Kakeya sets using Kakeya maps. A Kakeya map is defined to be a map $$\phi:B^{n-1}(0,1)\times [0,1]\rightarrow \mathbb{R}^{n}, (v,t)\mapsto (c(v)+tv,t),$$ where $ c:B^{n-1}(0,1)\rightarrow \mathbb{R}^{n-1}$. The associated Kakeya set is defined to be $ K:=\text{Im} (\phi). $ We show that the Kakeya set $K$ has positive measure if either one of the following conditions is true. (1) $c$ is continuous and $c|_{S^{n-2}}\in C^\alpha(S^{n-2})$ for some $\alpha>\frac{(n-2)n}{(n-1)^2}$, (2) $c$ is continuous and $c|_{S^{n-2}}\in W^{1,p}(S^{n-2})$ for some $p>n-2$.


title: A Convex Neural Network Solver for DCOPF with Generalization Guarantees

abstract: The DC optimal power flow (DCOPF) problem is a fundamental problem in power systems operations and planning. With high penetration of uncertain renewable resources in power systems, DCOPF needs to be solved repeatedly for a large amount of scenarios, which can be computationally challenging. As an alternative to iterative solvers, neural networks are often trained and used to solve DCOPF. These approaches can offer orders of magnitude reduction in computational time, but they cannot guarantee generalization, and small training error does not imply small testing errors. In this work, we propose a novel algorithm for solving DCOPF that guarantees the generalization performance. First, by utilizing the convexity of DCOPF problem, we train an input convex neural network. Second, we construct the training loss based on KKT optimality conditions. By combining these two techniques, the trained model has provable generalization properties, where small training error implies small testing errors. In experiments, our algorithm improves the optimality ratio of the solutions by a factor of five in comparison to end-to-end models.


title: Explainable boosted linear regression for time series forecasting

abstract: Time series forecasting involves collecting and analyzing past observations to develop a model to extrapolate such observations into the future. Forecasting of future events is important in many fields to support decision making as it contributes to reducing the future uncertainty. We propose explainable boosted linear regression (EBLR) algorithm for time series forecasting, which is an iterative method that starts with a base model, and explains the model's errors through regression trees. At each iteration, the path leading to highest error is added as a new variable to the base model. In this regard, our approach can be considered as an improvement over general time series models since it enables incorporating nonlinear features by residuals explanation. More importantly, use of the single rule that contributes to the error most allows for interpretable results. The proposed approach extends to probabilistic forecasting through generating prediction intervals based on the empirical error distribution. We conduct a detailed numerical study with EBLR and compare against various other approaches. We observe that EBLR substantially improves the base model performance through extracted features, and provide a comparable performance to other well established approaches. The interpretability of the model predictions and high predictive accuracy of EBLR makes it a promising method for time series forecasting.


title: FuncNN: An R Package to Fit Deep Neural Networks Using Generalized Input Spaces

abstract: Neural networks have excelled at regression and classification problems when the input space consists of scalar variables. As a result of this proficiency, several popular packages have been developed that allow users to easily fit these kinds of models. However, the methodology has excluded the use of functional covariates and to date, there exists no software that allows users to build deep learning models with this generalized input space. To the best of our knowledge, the functional neural network (FuncNN) library is the first such package in any programming language; the library has been developed for R and is built on top of the keras architecture. Throughout this paper, several functions are introduced that provide users an avenue to easily build models, generate predictions, and run cross-validations. A summary of the underlying methodology is also presented. The ultimate contribution is a package that provides a set of general modelling and diagnostic tools for data problems in which there exist both functional and scalar covariates.


title: An Interpretable and Uncertainty Aware Multi-Task Framework for Multi-Aspect Sentiment Analysis

abstract: In recent years, several online platforms have seen a rapid increase in the number of review systems that request users to provide aspect-level feedback. Document-level Multi-aspect Sentiment Classification (DMSC), where the goal is to predict the ratings/sentiment from a review at an individual aspect level, has become a challenging and imminent problem. To tackle this challenge, we propose a deliberate self-attention-based deep neural network model, namely FEDAR, for the DMSC problem, which can achieve competitive performance while also being able to interpret the predictions made. FEDAR is equipped with a highway word embedding layer to transfer knowledge from pre-trained word embeddings, an RNN encoder layer with output features enriched by pooling and factorization techniques, and a deliberate self-attention layer. In addition, we also propose an Attention-driven Keywords Ranking (AKR) method, which can automatically discover aspect keywords and aspect-level opinion keywords from the review corpus based on the attention weights. These keywords are significant for rating predictions by FEDAR. Since crowdsourcing annotation can be an alternate way to recover missing ratings of reviews, we propose a LEcture-AuDience (LEAD) strategy to estimate model uncertainty in the context of multi-task learning, so that valuable human resources can focus on the most uncertain predictions. Our extensive set of experiments on five different open-domain DMSC datasets demonstrate the superiority of the proposed FEDAR and LEAD models. We further introduce two new DMSC datasets in the healthcare domain and benchmark different baseline models and our models on them. Attention weights visualization results and visualization of aspect and opinion keywords demonstrate the interpretability of our model and the effectiveness of our AKR method.


title: Borel Combinatorics of Locally Finite Graphs

abstract: We provide a gentle introduction, aimed at non-experts, to Borel combinatorics that studies definable graphs on topological spaces. This is an emerging field on the borderline between combinatorics and descriptive set theory with deep connections to many other areas. After giving some background material, we present in careful detail some basic tools and results on the existence of Borel satisfying assignments: Borel versions of greedy algorithms and augmenting procedures, local rules, Borel transversals, etc. Also, we present the construction of Andrew Marks of acyclic Borel graphs for which the greedy bound $\Delta+1$ on the Borel chromatic number is best possible. In the remainder of the paper we briefly discuss various topics such as relations to LOCAL algorithms, measurable versions of Hall's marriage theorem and of Lov\'asz Local Lemma, applications to equidecomposability, etc.


title: The Evolution of Disk Winds from a Combined Study of Optical and Infrared Forbidden Lines

abstract: We analyze high-resolution (dv=<10km/s) optical and infrared spectra covering the [OI] 6300 angstrom and [NeII] 12.81 micron lines from a sample of 31 disks in different evolutionary stages. Following work at optical wavelengths, we use Gaussian profiles to fit the [NeII] lines and classify them into HVC (LVC) if the line centroid is more (less) blueshifted than 30 km/s with respect to the stellar radial velocity. Unlike for the [OI] where a HVC is often accompanied by a LVC, all 17 sources with a [NeII] detection have either a HVC or a LVC. [NeII] HVCs are preferentially detected toward high accretors (Macc > 10$^{-8}$ Msun/yr) while LVCs are found in sources with low Macc, low [OI] luminosity, and large infrared spectral index (n13-31). Interestingly, the [NeII] and [OI] LVC luminosities display an opposite behaviour with n13-31: as the inner dust disk depletes (higher n13-31) the [NeII] luminosity increases while the [OI] weakens. The [NeII] and [OI] HVC profiles are generally similar with centroids and FWHMs showing the expected behaviour from shocked gas in micro-jets. In contrast, the [NeII] LVC profiles are typically more blueshifted and narrower than the [OI] profiles. The FWHM and centroid vs. disk inclination suggest that the [NeII] LVC predominantly traces unbound gas from a slow, wide-angle wind that has not lost completely the Keplerian signature from its launching region. We sketch an evolutionary scenario that could explain the combined [OI] and [NeII] results and includes screening of hard (~1keV) X-rays in inner, mostly molecular, MHD winds.


title: An Efficient Language-Independent Multi-Font OCR for Arabic Script

abstract: Optical Character Recognition (OCR) is the process of extracting digitized text from images of scanned documents. While OCR systems have already matured in many languages, they still have shortcomings in cursive languages with overlapping letters such as the Arabic language. This paper proposes a complete Arabic OCR system that takes a scanned image of Arabic Naskh script as an input and generates a corresponding digital document. Our Arabic OCR system consists of the following modules: Pre-processing, Word-level Feature Extraction, Character Segmentation, Character Recognition, and Post-processing. This paper also proposes an improved font-independent character segmentation algorithm that outperforms the state-of-the-art segmentation algorithms. Lastly, the paper proposes a neural network model for the character recognition task. The system has experimented on several open Arabic corpora datasets with an average character segmentation accuracy 98.06%, character recognition accuracy 99.89%, and overall system accuracy 97.94% achieving outstanding results compared to the state-of-the-art Arabic OCR systems.


title: Analysis of artifacts in EEG signals for building BCIs

abstract: Brain-Computer Interface (BCI) is an essential mechanism that interprets the human brain signal. It provides an assistive technology that enables persons with motor disabilities to communicate with the world and also empowers them to lead independent lives. The common BCI devices use Electroencephalography (EEG) electrical activity recorded from the scalp. EEG signals are noisy owing to the presence of many artifacts, namely, eye blink, head movement, and jaw movement. Such artifacts corrupt the EEG signal and make EEG analysis challenging. This issue is addressed by locating the artifacts and excluding the EEG segment from the analysis, which could lead to a loss of useful information. However, we propose a practical BCI that uses the artifacts which has a low signal to noise ratio. The objective of our work is to classify different types of artifacts, namely eye blink, head nod, head turn, and jaw movements in the EEG signal. The occurrence of the artifacts is first located in the EEG signal. The located artifacts are then classified using linear time and dynamic time warping techniques. The located artifacts can be used by a person with a motor disability to control a smartphone. A speech synthesis application that uses eyeblinks in a single channel EEG system and jaw clinches in four channels EEG system are developed. Word prediction models are used for word completion, thus reducing the number of artifacts required.


title: Out of Sight, Out of Place: Detecting and Assessing Swapped Arguments

abstract: Programmers often add meaningful information about program semantics when naming program entities such as variables, functions, and macros. However, static analysis tools typically discount this information when they look for bugs in a program. In this work, we describe the design and implementation of a static analysis checker called SwapD, which uses the natural language information in programs to warn about mistakenly-swapped arguments at call sites. SwapD combines two independent detection strategies to improve the effectiveness of the overall checker. We present the results of a comprehensive evaluation of SwapD over a large corpus of C and C++ programs totaling 417 million lines of code. In this evaluation, SwapD found 154 manually-vetted real-world cases of mistakenly-swapped arguments, suggesting that such errors, while not pervasive in released code, are a real problem and a worthwhile target for static analysis.


title: Multi-contrast K-edge imaging on a bench-top photon-counting CT system: Acquisition parameter study

abstract: Purpose: Photon-counting computed tomography (PCCT) shows promise for medical imaging in regards to material separation and imaging of multiple contrast agents. However, many PCCT setups are under development and are not optimized for specific contrast agents or use cases. Here, we demonstrate how experimental system parameters may be varied in order to enhance performance and we propose a set of recommendations to achieve this based on contrast agent. Approach: A table-top PCCT system with a cadmium zinc telluride (CZT) detector capable of separating six energy bins was used to image multiple contrast agents in a small phantom. The contrast agents were separated and the concentration was quantified using K-edge subtraction. To increase system performance, we investigated three parameters: beam filter type and thickness, projection acquisition time, and energy bin width. The results from the parameters were compared based on PCCT signal and contrast to noise ratio (CNR) or noise in K-edge images. The concentrations of the contrast agents were quantified in K-edge images and compared to known concentrations. Results: The bench-top PCCT system was able to successfully quantify the contrast agents through K-edge subtraction. Decreasing projection acquisition time showed a decrease in K-edge CNR. However, it did not scale as the square root of time. Filter type and bin width demonstrated a dependence on the specific contrast agent. Conclusions: The presented bench-top system demonstrated the ability to separate contrast agents using K-edge subtraction and accurately determine contrast concentration in K-edge images. Specific parameters for future use will be chosen based on contrast agent.


title: Effect of Separate Initial Conditions on the Lyman-$\alpha$ Forest in Simulations

abstract: Using a set of high resolution simulations, we quantify the effect of species specific initial transfer functions on probes of the IGM via the Lyman-$\alpha$ forest. We focus on redshifts $2-6$, after H~{\sc i} reionization. We explore the effect of these initial conditions on measures of the thermal state of the low density IGM: the curvature, Doppler width cutoff, and Doppler width distribution. We also examine the matter and flux power spectrum, and potential consequences for constraints on warm dark matter models. We find that the curvature statistic is at most affected at the $\approx2\%$ level at $z=6$. The Doppler width cutoff parameters are affected by $\approx5\%$ for the intercept, and $\approx8\%$ for the fit slope, though this is subdominant to sample variation. The Doppler width distribution shows a $\approx30\%$ effect at $z=3$, however the distribution is not fully converged with simulation box size and resolution. The flux power spectrum is at most affected by $\approx5\%$ at high redshift and small scales. We discuss numerical convergence with simulation parameters.


title: Tradeoffs in Sentence Selection Techniques for Open-Domain Question Answering

abstract: Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex and expensive to run, so techniques to prune the space of retrieved text are critical to allow this approach to scale. In this paper, we focus on approaches which apply an intermediate sentence selection step to address this issue, and investigate the best practices for this approach. We describe two groups of models for sentence selection: QA-based approaches, which run a full-fledged QA system to identify answer candidates, and retrieval-based models, which find parts of each passage specifically related to each question. We examine trade-offs between processing speed and task performance in these two approaches, and demonstrate an ensemble module that represents a hybrid of the two. From experiments on Open-SQuAD and TriviaQA, we show that very lightweight QA models can do well at this task, but retrieval-based models are faster still. An ensemble module we describe balances between the two and generalizes well cross-domain.


title: Clumpy wind accretion in Cygnus X-1

abstract: Cygnus X-1 is one of the brightest X-ray sources observed and shows the X-ray intensity variations on time scales from milliseconds to months in both the soft and hard X-rays. The accretion onto the black hole is believed to be wind fed due to focused stellar wind from the binary companion HDE-226868. We aim to understand the physical mechanism responsible for the short timescale X-ray variability ($<$100 s) of the source in its Hard/Low state. We compute the 2D relativistic hydrodynamic simulation of the low angular momentum accretion flow with a time dependent outer boundary condition that reflects the focused, clumpy wind from the super-giant in this X-ray binary system. We follow the dynamical evolution of our model for about 100 s and present the results showing an oscillatory shock, being a potential explanation of variability observed in hard X-rays. The simulated model with shock solutions is in good agreement with the observed power density spectra of the source.


title: On complex dynamics from reversible cellular automata

abstract: Complexity has been a recurrent research topic in cellular automata because they represent systems where complex behaviors emerge from simple local interactions. A significant amount of previous research has been conducted proposing instances of complex cellular automata; however, most of the proposed methods are based on a careful search or a meticulous construction of evolution rules. This paper presents the emergence of complex behaviors based on reversible cellular automata. In particular, this paper shows that reversible cellular automata represent an adequate framework to obtain complex behaviors adding only new random states. Experimental results show that complexity can be obtained from reversible cellular automata appending a proportion of about two times more states at random than the original number of states in the reversible automaton. Thus, it is possible to obtain complex cellular automata with dozens of states. Complexity appears to be commonly obtained from reversible cellular automata, and using other operations such as permutations of states or row and column permutations in the evolution rule. The relevance of this paper is to present that reversibility can be a useful structure to implement complex behaviors in cellular automata.


title: Will it Unblend?

abstract: Natural language processing systems often struggle with out-of-vocabulary (OOV) terms, which do not appear in training data. Blends, such as "innoventor", are one particularly challenging class of OOV, as they are formed by fusing together two or more bases that relate to the intended meaning in unpredictable manners and degrees. In this work, we run experiments on a novel dataset of English OOV blends to quantify the difficulty of interpreting the meanings of blends by large-scale contextual language models such as BERT. We first show that BERT's processing of these blends does not fully access the component meanings, leaving their contextual representations semantically impoverished. We find this is mostly due to the loss of characters resulting from blend formation. Then, we assess how easily different models can recognize the structure and recover the origin of blends, and find that context-aware embedding systems outperform character-level and context-free embeddings, although their results are still far from satisfactory.


title: Cdh Descent for Homotopy Hermitian $K$-Theory of Rings with Involution

abstract: We provide a geometric model for the classifying space of automorphism groups of Hermitian vector bundles over a ring with involution $R$ such that $\frac{1}{2} \in R$; this generalizes a result of Schlichting-Tripathi \cite{SchTri}. We then prove a periodicity theorem for Hermitian $K$-theory and use it to construct an $E_\infty$ motivic ring spectrum $\mathbf{KR}^{\mathrm{alg}}$ representing homotopy Hermitian $K$-theory. From these results, we show that $\mathbf{KR}^{\mathrm{alg}}$ is stable under base change, and cdh descent for homotopy Hermitian $K$-theory of rings with involution is a formal consequence.


title: Semiclassical Gevrey operators in the complex domain

abstract: We study semiclassical Gevrey pseudodifferential operators, acting on exponentially weighted spaces of entire holomorphic functions. The symbols of such operators are Gevrey functions defined on suitable I-Lagrangian submanifolds of the complexified phase space, which are extended almost holomorphically in the same Gevrey class, or in some larger space, to complex neighborhoods of these submanifolds. Using almost holomorphic extensions, we obtain uniformly bounded realizations of such operators on a natural scale of exponentially weighted spaces of holomorphic functions for all Gevrey indices, with remainders that are optimally small, provided that the Gevrey index is $\leq 2$.


title: Computer Assisted Translation with Neural Quality Estimation and Automatic Post-Editing

abstract: With the advent of neural machine translation, there has been a marked shift towards leveraging and consuming the machine translation results. However, the gap between machine translation systems and human translators needs to be manually closed by post-editing. In this paper, we propose an end-to-end deep learning framework of the quality estimation and automatic post-editing of the machine translation output. Our goal is to provide error correction suggestions and to further relieve the burden of human translators through an interpretable model. To imitate the behavior of human translators, we design three efficient delegation modules -- quality estimation, generative post-editing, and atomic operation post-editing and construct a hierarchical model based on them. We examine this approach with the English--German dataset from WMT 2017 APE shared task and our experimental results can achieve the state-of-the-art performance. We also verify that the certified translators can significantly expedite their post-editing processing with our model in human evaluation.


title: Long-Short Term Masking Transformer: A Simple but Effective Baseline for Document-level Neural Machine Translation

abstract: Many document-level neural machine translation (NMT) systems have explored the utility of context-aware architecture, usually requiring an increasing number of parameters and computational complexity. However, few attention is paid to the baseline model. In this paper, we research extensively the pros and cons of the standard transformer in document-level translation, and find that the auto-regressive property can simultaneously bring both the advantage of the consistency and the disadvantage of error accumulation. Therefore, we propose a surprisingly simple long-short term masking self-attention on top of the standard transformer to both effectively capture the long-range dependence and reduce the propagation of errors. We examine our approach on the two publicly available document-level datasets. We can achieve a strong result in BLEU and capture discourse phenomena.


title: Semiclassical Gevrey operators and magnetic translations

abstract: We study semiclassical Gevrey pseudodifferential operators acting on the Bargmann space of entire functions with quadratic exponential weights. Using some ideas of the time frequency analysis, we show that such operators are uniformly bounded on a natural scale of exponentially weighted spaces of holomorphic functions, provided that the Gevrey index is $\geq 2$.


title: Morphological Reconstruction Improves Microvessel Mapping in Super-Resolution Ultrasound

abstract: Generation of super-resolution (SR) ultrasound (US) images, created from the successive local-ization of individual microbubbles in the circulation, has enabled the visualization of microvascular structure and flow at a level of detail that was not possible previously. Despite rapid progress, tradeoffs between spatial and temporal resolution may challenge the translation of this promising technology to the clinic. To temper these trade-offs, we propose a method based on morphological image reconstriction. This method can extract from ultrafast contrast-enhanced ultrasound (CEUS) images hundreds of microbubble peaks per image (312-by-180 pixels) with intensity values varying by an order of magnitude. Specifically, it offers a fourfold increase in the number of peaks detected per frame, requires on the order of 100 ms for processing, and is robust to additive electronic noise (down to 3.6 dB CNR in CEUS images). By integrating this method to a SR framework we demonstrate a 6-fold improvement in spatial resolution, as compared to CEUS, in imaging chicken embryo microvessels. This method that is computationally efficient and, thus, scalable to large data sets, may augment the abilities of SR-US in imaging microvascular structure and function.


title: How are Project-Specific Forums Utilized? A Study of Participation, Content, and Sentiment in the Eclipse Ecosystem

abstract: Although many software development projects have moved their developer discussion forums to generic platforms such as Stack Overflow, Eclipse has been steadfast in hosting their self-supported community forums. While recent studies show forums share similarities to generic communication channels, it is unknown how project-specific forums are utilized. In this paper, we analyze 832,058 forum threads and their linkages to four systems with 2,170 connected contributors to understand the participation, content and sentiment. Results show that Seniors are the most active participants to respond bug and non-bug-related threads in the forums (i.e., 66.1% and 45.5%), and sentiment among developers are inconsistent while knowledge sharing within Eclipse. We recommend the users to identify appropriate topics and ask in a positive procedural way when joining forums. For developers, preparing project-specific forums could be an option to bridge the communication between members. Irrespective of the popularity of Stack Overflow, we argue the benefits of using project-specific forum initiatives, such as GitHub Discussions, are needed to cultivate a community and its ecosystem.


title: 1D planar, cylindrical and spherical subsonic solitary waves in space electron-ion-positive dust plasma systems

abstract: The space electron-ion-positive dust plasma system containing isothermal inertialess electron species, cold inertial ion species, and stationary positive (positivively charged) dust species is considered. The basic features of one dimensional (1D) planar and nonplanar subsonic solitary waves are investigated by the pseudo-potential and reductive perturbation methods, respectively. It is observed that the presence of the positive dust species reduces the phase speed of the ion-acoustic waves, and consequently supports the subsonic solitary waves with the positive wave potential in such a space dusty plasma system. It is observed that the cylindrical and spherical subsonic solitary waves significantly evolve with time, and that the time evolution of the spherical solitary waves is faster than that of the cylindrical ones. The applications of the work in many space dusty plasma systems, particularly in Earth's mesosphere, cometary tails, Jupiter's magnetosphere, etc. are addressed.


title: Prior Art Search and Reranking for Generated Patent Text

abstract: Generative models, such as GPT-2, have demonstrated impressive results recently. A fundamental question we'd like to address is: where did the generated text come from? This work is our initial effort toward answering the question by using prior art search. The purpose of the prior art search is to find the most similar prior text in the training data of GPT-2. We take a reranking approach and apply it to the patent domain. Specifically, we pre-train GPT-2 models from scratch by using the patent data from the USPTO. The input for the prior art search is the patent text generated by the GPT-2 model. We also pre-trained BERT models from scratch for converting patent text to embeddings. The steps of reranking are: (1) search the most similar text in the training data of GPT-2 by taking a bag-of-word ranking approach (BM25), (2) convert the search results in text format to BERT embeddings, and (3) provide the final result by ranking the BERT embeddings based on their similarities with the patent text generated by GPT-2. The experiments in this work show that such reranking is better than ranking with embeddings alone. However, our mixed results also indicate that calculating the semantic similarities among long text spans is still challenging. To our knowledge, this work is the first to implement a reranking system to identify retrospectively the most similar inputs to a GPT model based on its output.


title: Engineering photonic environments for two-dimensional materials

abstract: A fascinating photonic platform with a small device scale, fast operating speed, as well as low energy consumption is two-dimensional (2D) materials, thanks to their in-plane crystalline structures and out-of-plane quantum confinement. The key to further advancement in this research field is the ability to modify the optical properties of the 2D materials. The modifications typically come from the materials themselves, for example, altering their chemical compositions. This article reviews a comparably less explored but promising means, through engineering the photonic surroundings. Rather than modifying materials themselves, this means manipulates the dielectric and metallic environments, both uniform and nanostructured, that directly interact with the materials. For 2D materials that are only one or a few atoms thick, the interaction with the environment can be remarkably efficient. This review summarizes the three degrees of freedom of this interaction: weak coupling, strong coupling, and multi-functionality. Also, it reviews a relatively timing concept of engineering that directly applied to the 2D materials by patterning. Benefiting from the burgeoning development of nanophotonics, the engineering of photonic environments provides a versatile and creative methodology of reshaping light-matter interaction in 2D materials.


title: Multibeam Electron Diffraction

abstract: One of the primary uses for transmission electron microscopy (TEM) is to measure diffraction pattern images in order to determine a crystal structure and orientation. In nanobeam electron diffraction (NBED) we scan a moderately converged electron probe over the sample to acquire thousands or even millions of sequential diffraction images, a technique that is especially appropriate for polycrystalline samples. However, due to the large Ewald sphere of TEM, excitation of Bragg peaks can be extremely sensitive to sample tilt, varying strongly for even a few degrees of sample tilt for crystalline samples. In this paper, we present multibeam electron diffraction (MBED), where multiple probe forming apertures are used to create mutiple STEM probes, all of which interact with the sample simultaneously. We detail designs for MBED experiments, and a method for using a focused ion beam (FIB) to produce MBED apertures. We show the efficacy of the MBED technique for crystalline orientation mapping using both simulations and proof-of-principle experiments. We also show how the angular information in MBED can be used to perform 3D tomographic reconstruction of samples without needing to tilt or scan the sample multiple times. Finally, we also discuss future opportunities for the MBED method.


title: Resource-Aware Discretization of Accelerated Optimization Flows

abstract: This paper tackles the problem of discretizing accelerated optimization flows while retaining their convergence properties. Inspired by the success of resource-aware control in developing efficient closed-loop feedback implementations on digital systems, we view the last sampled state of the system as the resource to be aware of. The resulting variable-stepsize discrete-time algorithms retain by design the desired decrease of the Lyapunov certificate of their continuous-time counterparts. Our algorithm design employs various concepts and techniques from resource-aware control that, in the present context, have interesting parallelisms with the discrete-time implementation of optimization algorithms. These include derivative- and performance-based triggers to monitor the evolution of the Lyapunov function as a way of determining the algorithm stepsize, exploiting sampled information to enhance algorithm performance, and employing high-order holds using more accurate integrators of the original dynamics. Throughout the paper, we illustrate our approach on a newly introduced continuous-time dynamics termed heavy-ball dynamics with displaced gradient, but the ideas proposed here have broad applicability to other globally asymptotically stable flows endowed with a Lyapunov certificate.


title: Kernel Ridge Regression Using Importance Sampling with Application to Seismic Response Prediction

abstract: Scalable kernel methods, including kernel ridge regression, often rely on low-rank matrix approximations using the Nystrom method, which involves selecting landmark points from large data sets. The existing approaches to selecting landmarks are typically computationally demanding as they require manipulating and performing computations with large matrices in the input or feature space. In this paper, our contribution is twofold. The first contribution is to propose a novel landmark selection method that promotes diversity using an efficient two-step approach. Our landmark selection technique follows a coarse to fine strategy, where the first step computes importance scores with a single pass over the whole data. The second step performs K-means clustering on the constructed coreset to use the obtained centroids as landmarks. Hence, the introduced method provides tunable trade-offs between accuracy and efficiency. Our second contribution is to investigate the performance of several landmark selection techniques using a novel application of kernel methods for predicting structural responses due to earthquake load and material uncertainties. Our experiments exhibit the merits of our proposed landmark selection scheme against baselines.


title: Lossless White Balance For Improved Lossless CFA Image and Video Compression

abstract: Color filter array is spatial multiplexing of pixel-sized filters placed over pixel detectors in camera sensors. The state-of-the-art lossless coding techniques of raw sensor data captured by such sensors leverage spatial or cross-color correlation using lifting schemes. In this paper, we propose a lifting-based lossless white balance algorithm. When applied to the raw sensor data, the spatial bandwidth of the implied chrominance signals decreases. We propose to use this white balance as a pre-processing step to lossless CFA subsampled image/video compression, improving the overall coding efficiency of the raw sensor data.


title: Understanding the Strength of the Selenium -- Graphene Interfaces

abstract: We present a comprehensive first-principles Density Functional Theory (DFT) analyses of the interfacial strength and bonding mechanisms between crystalline and amorphous selenium(Se) with graphene(Gr), a promising duo for energy storage applications. Comparative interface analyses are presented on amorphous silicon(Si) with graphene and crystalline Se with aluminum(Al) substrate. The interface strength of monoclinic Se (0.43 J/m2) and amorphous Si with graphene (0.41 J/m2) is similar in magnitude. While both materials (c-Se, a-Si) are bonded loosely by van der Waals (vdW) forces over graphene, interfacial electron exchange is higher for a-Si/Gr. This is further elaborated by comparing potential energy step and charge transfer (delta q) across the graphene interfaces. The delta q for c-Se/Gr and a-Si/Gr are 0.3119 e-1 and 0.4266 e-1, respectively. However, the interface strength of c-Se on the 3D Al substrate is higher (0.99 J/m2), suggesting stronger adhesion. The amorphous Se with graphene has comparable interface strength (0.34 J/m2), but electron exchange in this system is slightly distinct from monoclinic Se. The electronic characteristics (density of states analysis) and bonding mechanisms are different for monoclinic and amorphous Se with graphene and they activate graphene via surface charge doping divergently. Our findings highlight the complex electrochemical phenomena in Se interfaced with graphene, which may profoundly differ from their 'free' counterparts.


title: Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data

abstract: Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and negative task transfer, or learning interference. Often, in Natural Language Processing (NLP), a separate model per task is needed to obtain the best performance. However, many fine-tuning approaches are both parameter inefficient, i.e., potentially involving one new model per task, and highly susceptible to losing knowledge acquired during pretraining. We propose a novel Transformer architecture consisting of a new conditional attention mechanism as well as a set of task-conditioned modules that facilitate weight sharing. Through this construction (a hypernetwork adapter), we achieve more efficient parameter sharing and mitigate forgetting by keeping half of the weights of a pretrained model fixed. We also use a new multi-task data sampling strategy to mitigate the negative effects of data imbalance across tasks. Using this approach, we are able to surpass single task fine-tuning methods while being parameter and data efficient (using around 66% of the data for weight updates). Compared to other BERT Large methods on GLUE, our 8-task model surpasses other Adapter methods by 2.8% and our 24-task model outperforms by 0.7-1.0% models that use MTL and single task fine-tuning. We show that a larger variant of our single multi-task model approach performs competitively across 26 NLP tasks and yields state-of-the-art results on a number of test and development sets. Our code is publicly available at https://github.com/CAMTL/CA-MTL.


title: Introspective Learning by Distilling Knowledge from Online Self-explanation

abstract: In recent years, many explanation methods have been proposed to explain individual classifications of deep neural networks. However, how to leverage the created explanations to improve the learning process has been less explored. As the privileged information, the explanations of a model can be used to guide the learning process of the model itself. In the community, another intensively investigated privileged information used to guide the training of a model is the knowledge from a powerful teacher model. The goal of this work is to leverage the self-explanation to improve the learning process by borrowing ideas from knowledge distillation. We start by investigating the effective components of the knowledge transferred from the teacher network to the student network. Our investigation reveals that both the responses in non-ground-truth classes and class-similarity information in teacher's outputs contribute to the success of the knowledge distillation. Motivated by the conclusion, we propose an implementation of introspective learning by distilling knowledge from online self-explanations. The models trained with the introspective learning procedure outperform the ones trained with the standard learning procedure, as well as the ones trained with different regularization methods. When compared to the models learned from peer networks or teacher networks, our models also show competitive performance and requires neither peers nor teachers.


title: Determinantal Processes and Stochastic Domination

abstract: We prove the stochastic domination for determinantal processes associated with finite rank projection kernels. The result was first proved by Lyons in discrete setting. We avoid the machinery of matroids in order to obtain a proof that works in a general setting. We prove another result on the stochastic domination of two determinantal processes where the kernels are represented with respect to different measures. Combining this result with Lyons' theorem on the Stochastic domination we obtain a result on the stochastic domination for the last passage time in a directed last passage percolation on $\mathbb{Z}^2$ with i.i.d. geometric weights.


title: Sum Secret Key Rate Maximization for TDD Multi-User Massive MIMO Wireless Networks

abstract: Physical-layer key generation (PKG) based on channel reciprocity has recently emerged as a new technique to establish secret keys between devices. Most works focus on pairwise communication scenarios with single or small-scale antennas. However, the fifth generation (5G) wireless communications employ massive multiple-input multiple-output (MIMO) to support multiple users simultaneously, bringing serious overhead of reciprocal channel acquisition. This paper presents a multi-user secret key generation in massive MIMO wireless networks. We provide a beam domain channel model, in which different elements represent the channel gains from different transmit directions to different receive directions. Based on this channel model, we analyze the secret key rate and derive a closed-form expression under independent channel conditions. To maximize the sum secret key rate, we provide the optimal conditions for the Kronecker product of the precoding and receiving matrices and propose an algorithm to generate these matrices with pilot reuse. The proposed optimization design can significantly reduce the pilot overhead of the reciprocal channel state information acquisition. Furthermore, we analyze the security under the channel correlation between user terminals (UTs), and propose a low overhead multi-user secret key generation with non-overlapping beams between UTs. Simulation results demonstrate the near optimal performance of the proposed precoding and receiving matrices design and the advantages of the non-overlapping beam allocation.


title: Active Learning for Product Type Ontology Enhancement in E-commerce

abstract: Entity-based semantic search has been widely adopted in modern search engines to improve search accuracy by understanding users' intent. In e-commerce, an accurate and complete product type (PT) ontology is essential for recognizing product entities in queries and retrieving relevant products from catalog. However, finding product types (PTs) to construct such an ontology is usually expensive due to the considerable amount of human efforts it may involve. In this work, we propose an active learning framework that efficiently utilizes domain experts' knowledge for PT discovery. We also show the quality and coverage of the resulting PTs in the experiment results.


title: Differentiable Refraction-Tracing for Mesh Reconstruction of Transparent Objects

abstract: Capturing the 3D geometry of transparent objects is a challenging task, ill-suited for general-purpose scanning and reconstruction techniques, since these cannot handle specular light transport phenomena. Existing state-of-the-art methods, designed specifically for this task, either involve a complex setup to reconstruct complete refractive ray paths, or leverage a data-driven approach based on synthetic training data. In either case, the reconstructed 3D models suffer from over-smoothing and loss of fine detail. This paper introduces a novel, high precision, 3D acquisition and reconstruction method for solid transparent objects. Using a static background with a coded pattern, we establish a mapping between the camera view rays and locations on the background. Differentiable tracing of refractive ray paths is then used to directly optimize a 3D mesh approximation of the object, while simultaneously ensuring silhouette consistency and smoothness. Extensive experiments and comparisons demonstrate the superior accuracy of our method.


title: The HI Structure of the Local Volume Dwarf Galaxy Pisces A

abstract: Dedicated HI surveys have recently led to a growing category of low-mass galaxies found in the Local Volume. We present synthesis imaging of one such galaxy, Pisces A, a low-mass dwarf originally confirmed via optical imaging and spectroscopy of neutral hydrogen (HI) sources in the Galactic Arecibo L-band Feed Array HI (GALFA-HI) survey. Using HI observations taken with the Karl G. Jansky Very Large Array (JVLA), we characterize the kinematic structure of the gas and connect it to the galaxy's environment and evolutionary history. While the galaxy shows overall ordered rotation, a number of kinematic features indicate a disturbed gas morphology. These features are suggestive of a tumultuous recent history, and represent $\sim 3.5$% of the total baryonic mass. We find a total baryon fraction $f_{\rm bary} = 0.13$ if we include these features. We also quantify the cosmic environment of Pisces A, finding an apparent alignment of the disturbed gas with nearby, large scale filamentary structure at the edge of the Local Void. We consider several scenarios for the origin of the disturbed gas, including gas stripping via ram pressure or galaxy-galaxy interactions, as well as accretion and ram pressure compression. Though we cannot rule out a past interaction with a companion, our observations best support the suggestion that the neutral gas morphology and recent star formation in Pisces A is a direct result of its interactions with the IGM.


title: Hierarchical Coding for Cloud Storage: Topology-Adaptivity, Scalability, and Flexibility

abstract: In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. The recent rise of the blockchain technology is also moving various information systems towards decentralization to achieve high privacy at low costs. While codes with hierarchical locality have been intensively studied in the context of centralized cloud storage due to their effectiveness in reducing the average reading time, those for decentralized storage networks (DSNs) have not yet been discussed. In this paper, we propose a joint coding scheme where each node receives extra protection through the cooperation with nodes in its neighborhood in a heterogeneous DSN with any given topology. This work extends and subsumes our prior work on coding for centralized cloud storage. In particular, our proposed construction not only preserves desirable properties such as scalability and flexibility, which are critical in dynamic networks, but also adapts to arbitrary topologies, a property that is essential in DSNs but has been overlooked in existing works.


title: Enhancing Dialogue Generation via Multi-Level Contrastive Learning

abstract: Most of the existing works for dialogue generation are data-driven models trained directly on corpora crawled from websites. They mainly focus on improving the model architecture to produce better responses but pay little attention to considering the quality of the training data contrastively. In this paper, we propose a multi-level contrastive learning paradigm to model the fine-grained quality of the responses with respect to the query. A Rank-aware Calibration (RC) network is designed to construct the multi-level contrastive optimization objectives. Since these objectives are calculated based on the sentence level, which may erroneously encourage/suppress the generation of uninformative/informative words. To tackle this incidental issue, on one hand, we design an exquisite token-level strategy for estimating the instance loss more accurately. On the other hand, we build a Knowledge Inference (KI) component to capture the keyword knowledge from the reference during training and exploit such information to encourage the generation of informative words. We evaluate the proposed model on a carefully annotated dialogue dataset and the results suggest that our model can generate more relevant and diverse responses compared to the baseline models.


title: Characterization of Probability Distributions via Functional Equations of Power-Mixture Type

abstract: We study power-mixture type functional equations in terms of Laplace-Stieltjes transforms of probability distributions. These equations arise when studying distributional equations of the type Z = X + TZ, where T is a known random variable, while the variable Z is defined via X, and we want to `find' X. We provide necessary and sufficient conditions for such functional equations to have unique solutions. The uniqueness is equivalent to a characterization property of a probability distribution. We present results which are either new or extend and improve previous results about functional equations of compound-exponential and compound-Poisson types. In particular, we give another affirmative answer to a question posed by J. Pitman and M. Yor in 2003. We provide explicit illustrative examples and deal with related topics.


title: Co-Evolution of Multi-Robot Controllers and Task Cues for Off-World Open Pit Mining

abstract: Robots are ideal for open-pit mining on the Moon as its a dull, dirty, and dangerous task. The challenge is to scale up productivity with an ever-increasing number of robots. This paper presents a novel method for developing scalable controllers for use in multi-robot excavation and site-preparation scenarios. The controller starts with a blank slate and does not require human-authored operations scripts nor detailed modeling of the kinematics and dynamics of the excavator. The 'Artificial Neural Tissue' (ANT) architecture is used as a control system for autonomous robot teams to perform resource gathering. This control architecture combines a variable-topology neural-network structure with a coarse-coding strategy that permits specialized areas to develop in the tissue. Our work in this field shows that fleets of autonomous decentralized robots have an optimal operating density. Too few robots result in insufficient labor, while too many robots cause antagonism, where the robots undo each other's work and are stuck in gridlock. In this paper, we explore the use of templates and task cues to improve group performance further and minimize antagonism. Our results show light beacons and task cues are effective in sparking new and innovative solutions at improving robot performance when placed under stressful situations such as severe time-constraint.


title: Population Susceptibility Variation and Its Effect on Contagion Dynamics

abstract: Susceptibility governs the dynamics of contagion. The classical SIR model is one of the simplest compartmental models of contagion spread, assuming a single shared susceptibility level. However, variation in susceptibility over a population can fundamentally affect the dynamics of contagion and thus the ultimate outcome of a pandemic. We develop mathematical machinery which explicitly considers susceptibility variation, illuminates how the susceptibility distribution is sculpted by contagion, and thence how such variation affects the SIR differential questions that govern contagion. Our methods allow us to derive closed form expressions for herd immunity thresholds as a function of initial susceptibility distributions and suggests an intuitively satisfying approach to inoculation when only a fraction of the population is accessible to such intervention. Of particular interest, if we assume static susceptibility of individuals in the susceptible pool, ignoring susceptibility diversity {\em always} results in overestimation of the herd immunity threshold and that difference can be dramatic. Therefore, we should develop robust measures of susceptibility variation as part of public health strategies for handling pandemics.