title: Improving Robot Success Detection using Static Object Data

abstract: We use static object data to improve success detection for stacking objects on and nesting objects in one another. Such actions are necessary for certain robotics tasks, e.g., clearing a dining table or packing a warehouse bin. However, using an RGB-D camera to detect success can be insufficient: same-colored objects can be difficult to differentiate, and reflective silverware cause noisy depth camera perception. We show that adding static data about the objects themselves improves the performance of an end-to-end pipeline for classifying action outcomes. Images of the objects, and language expressions describing them, encode prior geometry, shape, and size information that refine classification accuracy. We collect over 13 hours of egocentric manipulation data for training a model to reason about whether a robot successfully placed unseen objects in or on one another. The model achieves up to a 57% absolute gain over the task baseline on pairs of previously unseen objects.


title: A path planning and path-following control framework for a general 2-trailer with a car-like tractor

abstract: Maneuvering a general 2-trailer with a car-like tractor in backward motion is a task that requires significant skill to master and is unarguably one of the most complicated tasks a truck driver has to perform. This paper presents a path planning and path-following control solution that can be used to automatically plan and execute difficult parking and obstacle avoidance maneuvers by combining backward and forward motion. A lattice-based path planning framework is developed in order to generate kinematically feasible and collision-free paths and a path-following controller is designed to stabilize the lateral and angular path-following error states during path execution. To estimate the vehicle state needed for control, a nonlinear observer is developed which only utilizes information from sensors that are mounted on the car-like tractor, making the system independent of additional trailer sensors. The proposed path planning and path-following control framework is implemented on a full-scale test vehicle and results from simulations and real-world experiments are presented.


title: Focused Electron and X-ray Beam Crosslinking in Liquids for Nanoscale Hydrogels 3D Printing and Encapsulation

abstract: Additive fabrication of biocompatible 3D structures out of liquid hydrogel solutions has become pivotal technology for tissue engineering, soft robotics, biosensing, drug delivery, etc. Electron and X-ray lithography are well suited to pattern nanoscopic features out of dry polymers, however, the direct additive manufacturing in hydrogel solutions with these powerful tools is hard to implement due to vacuum incompatibility of hydrated samples. In this work, we resolve this principal impediment and demonstrate a technique for in-liquid hydrogel 3D-sculpturing separating high vacuum instrumentation and volatile sample with ultrathin molecularly impermeable membranes transparent to low-energy electrons and soft X-rays. Using either scanning focused electron or synchrotron soft X-ray beams, the principle of the technique, particularities of the in-liquid crosslinking mechanism and factors affecting the ultimate gel feature size are described and validated through the comparison of experiments and simulations. The potential of this technique is demonstrated on a few practical examples such as encapsulation of nanoparticles and live-cell as well as fabrication of mesoscopic 3D-hydrogel structures via modulation of the beam energy


title: Properties of the American price function in the Heston-type models

abstract: We study some properties of the American option price in the stochastic volatility Heston model. We first prove that, if the payoff function is convex and satisfies some regularity assumptions, then the option value function is increasing with respect to the volatility variable. Then, we focus on the standard put option and we extend to the Heston model some well known results in the Black and Scholes world, most by using probabilistic techniques. In particular, we study the exercise boundary, we prove the strict convexity of the value function in the continuation region, we extend to this model the early exercise premium formula and we prove a weak form of the smooth fit property.


title: Identifying disease-free chest X-ray images with deep transfer learning

abstract: Chest X-rays (CXRs) are among the most commonly used medical image modalities. They are mostly used for screening, and an indication of disease typically results in subsequent tests. As this is mostly a screening test used to rule out chest abnormalities, the requesting clinicians are often interested in whether a CXR is normal or not. A machine learning algorithm that can accurately screen out even a small proportion of the "real normal" exams out of all requested CXRs would be highly beneficial in reducing the workload for radiologists. In this work, we report a deep neural network trained for classifying CXRs with the goal of identifying a large number of normal (disease-free) images without risking the discharge of sick patients. We use an ImageNet-pretrained Inception-ResNet-v2 model to provide the image features, which are further used to train a model on CXRs labelled by expert radiologists. The probability threshold for classification is optimized for 100% precision for the normal class, ensuring no sick patients are released. At this threshold we report an average recall of 50%. This means that the proposed solution has the potential to cut in half the number of disease-free CXRs examined by radiologists, without risking the discharge of sick patients.


title: A frame semantic overview of NLP-based information extraction for cancer-related EHR notes

abstract: Objective: There is a lot of information about cancer in Electronic Health Record (EHR) notes that can be useful for biomedical research provided natural language processing (NLP) methods are available to extract and structure this information. In this paper, we present a scoping review of existing clinical NLP literature for cancer. Methods: We identified studies describing an NLP method to extract specific cancer-related information from EHR sources from PubMed, Google Scholar, ACL Anthology, and existing reviews. Two exclusion criteria were used in this study. We excluded articles where the extraction techniques used were too broad to be represented as frames and also where very low-level extraction methods were used. 79 articles were included in the final review. We organized this information according to frame semantic principles to help identify common areas of overlap and potential gaps. Results: Frames were created from the reviewed articles pertaining to cancer information such as cancer diagnosis, tumor description, cancer procedure, breast cancer diagnosis, prostate cancer diagnosis and pain in prostate cancer patients. These frames included both a definition as well as specific frame elements (i.e. extractable attributes). We found that cancer diagnosis was the most common frame among the reviewed papers (36 out of 79), with recent work focusing on extracting information related to treatment and breast cancer diagnosis. Conclusion: The list of common frames described in this paper identifies important cancer-related information extracted by existing NLP techniques and serves as a useful resource for future researchers requiring cancer information extracted from EHR notes. We also argue, due to the heavy duplication of cancer NLP systems, that a general purpose resource of annotated cancer frames and corresponding NLP tools would be valuable.


title: Combinatorial inequalities

abstract: This is an expanded version of the Notices of the AMS column with the same title. The text is unchanged, but we added acknowledgements and a large number of endnotes which provide the context and the references.


title: On the geometry optimization of X-band resonator for electron paramagnetic resonance application

abstract: The microwave resonator is one of the key components in the modern Electron Paramagnetic Resonance (EPR) spectroscopy setup, as it largely determines the performance characteristics and limitations of the entire spectrometer. In this research note the possible way of resonator optimization is described. A detailed computer model describing the distribution of the electromagnetic field for Bruker 4118X-MD-5W1 design resonator has been developed. All details including a dielectric insert, conductive screen, coupling antenna and PTFE supports were included in the model. All dissipation processes were considered in the calculation. The influence of the resonator geometry on the Q-factor, filling factor and operating frequency of the resonant mode has been investigated. The resonator geometric parameters are optimized to achieve maximum sensitivity. According to the calculations, the optimized resonator structure has in 10 times greater sensitivity than the original MD-5 design.


title: Higher-dimensional Buchdahl and Janis-Robinson-Winicour transformations in the Einstein-Maxwell system with a massless scalar field

abstract: We present higher-dimensional generalizations of the Buchdahl and Janis-Robinson-Winicour transformations which generate static solutions in the Einstein-Maxwell system with a massless scalar field. While the former adds a nontrivial scalar field to a vacuum solution, the latter generates a charged solution from a neutral one with the same scalar field. Applying these transformations to (i) a static solution with an Einstein base manifold, (ii) a multi-center solution, and (iii) a four-dimensional cylindrically symmetric solution, we construct several new exact solutions.


title: Bivariate Gaussian models for wind vectors in a distributional regression framework

abstract: A new probabilistic post-processing method for wind vectors is presented in a distributional regression framework employing the bivariate Gaussian distribution. In contrast to previous studies all parameters of the distribution are simultaneously modeled, namely the means and variances for both wind components and also the correlation coefficient between them employing flexible regression splines. To capture a possible mismatch between the predicted and observed wind direction, ensemble forecasts of both wind components are included using flexible two-dimensional smooth functions. This encompasses a smooth rotation of the wind direction conditional on the season and the forecasted ensemble wind direction. The performance of the new method is tested for stations located in plains, mountain foreland, and within an alpine valley employing ECMWF ensemble forecasts as explanatory variables for all distribution parameters. The rotation-allowing model shows distinct improvements in terms of predictive skill for all sites compared to a baseline model that post-processes each wind component separately. Moreover, different correlation specifications are tested and small improvements compared to the model setup with no estimated correlation could be found for stations located in alpine valleys.


title: The Narrow-beam Diffuser Subsystem of a Prototype Optical Calibration System for the Hyper-Kamiokande Detector

abstract: The Hyper-Kamiokande neutrino detector is set to begin construction in 2020, succeeding Super-Kamiokande as the world's largest water Cerenkov detector. Research and development are well underway for an integrated light injection system for Hyper-Kamiokande which will provide in-situ monitoring of photo-sensor responses and water transparency. In summer 2018, optical hardware forming an iteration of this system was installed in Super-Kamiokande. We present details of the narrow-beam diffuser hardware and testing procedures, in addition to a brief summary of the installed light injection system.


title: Astro2020 Science White Paper: Physical Conditions in the Cold Gas of Local Galaxies

abstract: We describe a next major frontier in observational studies of galaxy evolution and star formation: linking the physical conditions in the cold, star-forming interstellar medium to host galaxy and local environment. The integrated gas content of galaxies has been surveyed extensively over the last decades. The link between environment and cold gas density, turbulence, excitation, dynamical state, and chemical makeup remain far less well understood. We know that these properties do vary dramatically and theoretical work posits a strong connection between the state of the gas, its ability to form stars, and the impact of stellar feedback. A next major step in the field will be to use sensitive cm-, mm-, and submm-wave spectroscopy and high resolution spectroscopic imaging to survey the state of cold gas across the whole local galaxy population. Such observations have pushed the capabilities of the current generation of telescopes. We highlight three critical elements for progress in the next decade: (1) robust support and aggressive development of ALMA, (2) the deployment of very large heterodyne receiver arrays on single dish telescopes, and (3) development of a new interferometric array that dramatically improves on current capabilities at cm- and mm-wavelengths (~ 1-115 GHz).


title: Conceptual design and first results for a neutron detector with interaction localization capabilities

abstract: A new high-precision detector for studying neutrons from beta-delayed neutron emission and direct reaction studies is proposed. The Neutron dEtector with Xn Tracking (NEXT) array is designed to maintain high intrinsic neutron detection efficiency while reducing uncertainties in neutron energy measurements. A single NEXT module is composed of thin segments of plastic scintillator, each optically separated, capable of neutron-gamma discrimination. Each segmented module is coupled to position sensitive photodetectors enabling the high-precision determination of neutron time of arrival and interaction position within the active volume. A design study has been conducted based on simulations and experimental tests leading to the construction of prototype units. First results from measurements using a $^{252}$Cf neutron source and accelerator-produced monoenergetic neutrons are presented.


title: Ultra-sensitive Single-beam Atom-optical Magnetometer using Weak Measurement Method

abstract: Ultra-sensitive measurement of the magneto-optical rotation, due to interaction of linearly-polarized light passing through room-temperature Rb 85 atoms, in response to change in longitudinal magnetic field (\delta B_z ) is demonstrated using the weak measurement method. The polarization rotation angle measurement sensitivity (\delta \psi ) of 16 \mu~rad and hence of the magnetometer of 1 nT, achieved using the weak measurement method is better than the balanced optical polarimetry results by a factor of three. The improvement in the measurement sensitivity is realized via optical amplification of the polarization rotation angle via spin-orbit coupled light beam-field. The method is devoid of external rf modulation, allows for optimal tunability of sensitivity depending on the dynamic range of the applied magnetic field and the sensitivity can be further enhanced by operating in the Spin Exchange Relaxation Free regime of alkali spin polarization.


title: Mirroring to Build Trust in Digital Assistants

abstract: We describe experiments towards building a conversational digital assistant that considers the preferred conversational style of the user. In particular, these experiments are designed to measure whether users prefer and trust an assistant whose conversational style matches their own. To this end we conducted a user study where subjects interacted with a digital assistant that responded in a way that either matched their conversational style, or did not. Using self-reported personality attributes and subjects' feedback on the interactions, we built models that can reliably predict a user's preferred conversational style.


title: Activity Driven Weakly Supervised Object Detection

abstract: Weakly supervised object detection aims at reducing the amount of supervision required to train detection models. Such models are traditionally learned from images/videos labelled only with the object class and not the object bounding box. In our work, we try to leverage not only the object class labels but also the action labels associated with the data. We show that the action depicted in the image/video can provide strong cues about the location of the associated object. We learn a spatial prior for the object dependent on the action (e.g. "ball" is closer to "leg of the person" in "kicking ball"), and incorporate this prior to simultaneously train a joint object detection and action classification model. We conducted experiments on both video datasets and image datasets to evaluate the performance of our weakly supervised object detection model. Our approach outperformed the current state-of-the-art (SOTA) method by more than 6% in mAP on the Charades video dataset.


title: Phytochemical study and evaluation of the cytotoxic properties of methanolic extract from Baccharis obtusifolia

abstract: Some species of the Baccharis genus have been shown to possess important biomedical properties, including cytotoxic activity. In this study, we examined the cytotoxic effect of methanol extract from Baccharis obtusifolia (Asteraceae) in cancer cell lines of prostate (PC-3), colon (RKO), astrocytoma (D-384), and breast (MCF-7). The methanolic extract displayed the largest substantial cytotoxic effect in lines of colon cancer (RKO) and cerebral astrocytoma (D-384). Chromatographic purification of the B. obtusifolia methanolic extract led to the isolation and identification of 5,4'-dihydroxy-7-methoxyflavone (1) and 5-hydroxy-7,4'-dimethoxyflavone (2) compounds of the flavonoid type.


title: A review on the complementarity of renewable energy sources: concept, metrics, application and future research directions

abstract: It is expected, and regionally observed, that energy demand will soon be covered by a widespread deployment of renewable energy sources. However, the weather and climate driven energy sources are characterized by a significant spatial and temporal variability. One of the commonly mentioned solutions to overcome the mismatch between demand and supply provided by renewable generation is a hybridization of two or more energy sources in a single power station (like wind-solar, solar-hydro or solar-wind-hydro). The operation of hybrid energy sources is based on the complementary nature of renewable sources. Considering the growing importance of such systems and increasing number of research activities in this area this paper presents a comprehensive review of studies which investigated, analyzed, quantified and utilized the effect of temporal, spatial and spatio-temporal complementarity between renewable energy sources. The review starts with a brief overview of available research papers, formulates detailed definition of major concepts, summarizes current research directions and ends with prospective future research activities. The review provides a chronological and spatial information with regard to the studies on the complementarity concept.


title: Causal comparative effectiveness analysis of dynamic continuous-time treatment initiation rules with sparsely measured outcomes and death

abstract: Evidence supporting the current World Health Organization recommendations of early antiretroviral therapy (ART) initiation for adolescents is inconclusive. We leverage a large observational data and compare, in terms of mortality and CD4 cell count, the dynamic treatment initiation rules for HIV-infected adolescents. Our approaches extend the marginal structural model for estimating outcome distributions under dynamic treatment regimes (DTR), developed in Robins et al. (2008), to allow the causal comparisons of both specific regimes and regimes along a continuum. Furthermore, we propose strategies to address three challenges posed by the complex data set: continuous-time measurement of the treatment initiation process; sparse measurement of longitudinal outcomes of interest, leading to incomplete data; and censoring due to dropout and death. We derive a weighting strategy for continuous time treatment initiation; use imputation to deal with missingness caused by sparse measurements and dropout; and define a composite outcome that incorporates both death and CD4 count as a basis for comparing treatment regimes. Our analysis suggests that immediate ART initiation leads to lower mortality and higher median values of the composite outcome, relative to other initiation rules.


title: A ${\mathbb Z}_2$-index of symmetry protected topological phases with reflection symmetry for quantum spin chains

abstract: For the classification of SPT phases, defining an index is a central problem. In the famous paper [PTBO1], Pollmann, Tuner, Berg, and Oshikawa introduced ${\mathbb Z}_2$-indices for injective matrix products states (MPS) which have either ${\mathbb Z}_2\times {\mathbb Z}_2$ dihedral group (of $\pi$-rotations about $x$, $y$, and $z$-axes) symmetry, time-reversal symmetry, or reflection symmetry. The first two are on-site symmetries. In [O4], an index for on-site symmetries, which generalizes the index in [PTBO1], was introduced for general unique gapped ground state phases in quantum spin chains. It was proved that the index is an invariant of the $C^1$-classification of SPT phases. The index for the reflection symmetry, which is not an on-site symmetry, was left as an open question. In this paper, we introduce a ${\mathbb Z}_2$-index for the reflection symmetric unique gapped ground state phases, and complete the generalization problem of index by Pollmann et.al. We also show that the index is an invariant of the $C^1$-classification.

categories: math-ph cond-mat.stat-mech math.MP quant-ph


title: Lautum Regularization for Semi-supervised Transfer Learning

abstract: Transfer learning is a very important tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet, discrepancies between the underlying distributions of the source and target data are commonplace and are known to have a substantial impact on algorithm performance. In this work we suggest a novel information theoretic approach for the analysis of the performance of deep neural networks in the context of transfer learning. We focus on the task of semi-supervised transfer learning, in which unlabeled samples from the target dataset are available during the network training on the source dataset. Our theory suggests that one may improve the transferability of a deep neural network by imposing a Lautum information based regularization that relates the network weights to the target data. We demonstrate the effectiveness of the proposed approach in various transfer learning experiments.


title: Decomposing Quantum Generalized Toffoli with an Arbitrary Number of Ancilla

abstract: We present a general decomposition of the Generalized Toffoli, and for completeness, the multi-target gate using an arbitrary number of clean or dirty ancilla. While prior work has shown how to decompose the Generalized Toffoli using 0, 1, or $O(n)$ many clean ancilla and 0, 1, and $n-2$ dirty ancilla, we provide a generalized algorithm to bridge the gap, i.e. this work gives an algorithm to generate a decomposition for any number of clean or dirty ancilla. While it is hard to guarantee optimality, our decompositions guarantee a decrease in circuit depth as the number of ancilla increases.


title: Improving Interaction with Virtual Globes through Spatial Thinking: Helping Users Ask "Why?"

abstract: Virtual globes have progressed from little-known technology to broadly popular software in a mere few years. We investigated this phenomenon through a survey and discovered that, while virtual globes are en vogue, their use is restricted to a small set of tasks so simple that they do not involve any spatial thinking. Spatial thinking requires that users ask "what is where" and "why"; the most common virtual globe tasks only include the "what". Based on the results of this survey, we have developed a multi-touch virtual globe derived from an adapted virtual globe paradigm designed to widen the potential uses of the technology by helping its users to inquire about both the "what is where" and "why" of spatial distribution. We do not seek to provide users with full GIS (geographic information system) functionality, but rather we aim to facilitate the asking and answering of simple "why" questions about general topics that appeal to a wide virtual globe user base.


title: Helping Computers Understand Geographically-Bound Activity Restrictions

abstract: The lack of certain types of geographic data prevents the development of location-aware technologies in a number of important domains. One such type of "unmapped" geographic data is space usage rules (SURs), which are defined as geographically-bound activity restrictions (e.g. "no dogs", "no smoking", "no fishing", "no skateboarding"). Researchers in the area of human-computer interaction have recently begun to develop techniques for the automated mapping of SURs with the aim of supporting activity planning systems (e.g. one-touch "Can I Smoke Here?" apps, SUR-aware vacation planning tools). In this paper, we present a novel SUR mapping technique - SPtP - that outperforms state-of-the-art approaches by 30% for one of the most important components of the SUR mapping pipeline: associating a point observation of a SUR (e.g. a 'no smoking' sign) with the corresponding polygon in which the SUR applies (e.g. the nearby park or the entire campus on which the sign is located). This paper also contributes a series of new SUR benchmark datasets to help further research in this area.


title: Global Radiation Magneto-hydrodynamic Simulations of Sub-Eddington Accretion Disks around Supermassive Black Holes

abstract: We use global three dimensional radiation magneto-hydrodynamic simulations to study the properties of inner regions of accretion disks around a 5\times 10^8 solar mass black hole with mass accretion rates reaching 7% and 20% of the Eddington value. This region of the disk is supported by magnetic pressure with surface density significantly smaller than the values predicted by the standard thin disk model but with a much larger disk scale height. The disks do not show any sign of thermal instability over many thermal time scales. More than half of the accretion is driven by radiation viscosity in the optically thin corona region for the lower accretion rate case, while accretion in the optically thick part of the disk is driven by the Maxwell and Reynolds stresses from MRI turbulence. Coronae with gas temperatures > 10^8 K are generated only in the inner \approx 10 gravitational radii in both simulations, being more compact in the higher accretion rate case. In contrast to the thin disk model, surface density increases with increasing mass accretion rate, which causes less dissipation in the optically thin region and a relatively weaker corona. The simulation results may explain the formation of X-ray coronae in Active Galactic Nuclei (AGNs), the compact size of such coronae, and the observed trend of optical to X-ray luminosity with Eddington ratio for many AGNs.


title: SubwayPS: Towards Enabling Smartphone Positioning in Underground Public Transportation Systems

abstract: Thanks to rapid advances in technologies like GPS and Wi-Fi positioning, smartphone users are able to determine their location almost everywhere they go. This is not true, however, of people who are traveling in underground public transportation networks, one of the few types of high-traffic areas where smartphones do not have access to accurate position information. In this paper, we introduce the problem of underground transport positioning on smartphones and present SubwayPS, an accelerometer-based positioning technique that allows smartphones to determine their location substantially better than baseline approaches, even deep beneath city streets. We highlight several immediate applications of positioning in subway networks in domains ranging from mobile advertising to mobile maps and present MetroNavigator, a proof-of-concept smartphone and smartwatch app that notifies users of upcoming points-of-interest and alerts them when it is time to get ready to exit the train.


title: Evaluation of a meta-analysis of air quality and heart attacks, a case study

abstract: It is generally acknowledged that claims from observational studies often fail to replicate. An exploratory study was undertaken to assess the reliability of base studies used in meta-analysis of short-term air quality-myocardial infarction risk and to judge the reliability of statistical evidence from meta-analysis that uses data from observational studies. A highly cited meta-analysis paper examining whether short-term air quality exposure triggers myocardial infarction was evaluated as a case study. The paper considered six air quality components - carbon monoxide, nitrogen dioxide, sulfur dioxide, particulate matter 10 and 2.5 micrometers in diameter (PM10 and PM2.5), and ozone. The number of possible questions and statistical models at issue in each of 34 base papers used were estimated and p-value plots for each of the air components were constructed to evaluate the effect heterogeneity of p-values used from the base papers. Analysis search spaces (number of statistical tests possible) in the base papers were large, median of 12,288, interquartile range: 2,496 to 58,368, in comparison to actual statistical test results presented. Statistical test results taken from the base papers may not provide unbiased measures of effect for meta-analysis. Shapes of p-value plots for the six air components were consistent with the possibility of analysis manipulation to obtain small p-values in several base papers. Results suggest the appearance of heterogeneous, researcher-generated p-values used in the meta-analysis rather than unbiased evidence of real effects for air quality. We conclude that this meta-analysis does not provide reliable evidence for an association of air quality components with myocardial risk.


title: Hammering Mizar by Learning Clause Guidance

abstract: We describe a very large improvement of existing hammer-style proof automation over large ITP libraries by combining learning and theorem proving. In particular, we have integrated state-of-the-art machine learners into the E automated theorem prover, and developed methods that allow learning and efficient internal guidance of E over the whole Mizar library. The resulting trained system improves the real-time performance of E on the Mizar library by 70% in a single-strategy setting.


title: A note on generalized Fujii-Wilson conditions and BMO spaces

abstract: In this note we generalize the definition of Fujii-Wilson condition providing quantitative characterizations of some interesting classes of weights, such as $A_\infty$, $A_\infty^{weak}$ and $C_p$, in terms of BMO type spaces suited to them. We will provide as well some self improvement properties for some of those generalized BMO spaces and some quantitative estimates for Bloom's BMO type spaces.


title: Inversion, Iteration, and the Art of Dual Wielding

abstract: The humble $\dagger$ ("dagger") is used to denote two different operations in category theory: Taking the adjoint of a morphism (in dagger categories) and finding the least fixed point of a functional (in categories enriched in domains). While these two operations are usually considered separately from one another, the emergence of reversible notions of computation shows the need to consider how the two ought to interact. In the present paper, we wield both of these daggers at once and consider dagger categories enriched in domains. We develop a notion of a monotone dagger structure as a dagger structure that is well behaved with respect to the enrichment, and show that such a structure leads to pleasant inversion properties of the fixed points that arise as a result. Notably, such a structure guarantees the existence of fixed point adjoints, which we show are intimately related to the conjugates arising from a canonical involutive monoidal structure in the enrichment. Finally, we relate the results to applications in the design and semantics of reversible programming languages.


title: Dynamics from elastic neutron-scattering via direct measurement of the running time-integral of the van Hove distribution function

abstract: We present a new neutron-scattering approach to access the van Hove distribution function directly in the time domain, I(t), which reflects the system dynamics. Currently, I(t) is essentially determined from neutron energy-exchange. Our method consists of the straightforward measurement of the running time-integral of I(t), by computing the portion of scattered neutrons corresponding to species at rest within a time t, (conceptually elastic scattering). Previous attempts failed to recognise this connection. Starting from a theoretical standpoint, a practical realisation is assessed via numerical methods and an instrument simulation.

categories: physics.ins-det cond-mat.soft physics.bio-ph physics.chem-ph physics.data-an


title: Augmented Neural ODEs

abstract: We show that Neural Ordinary Differential Equations (ODEs) learn representations that preserve the topology of the input space and prove that this implies the existence of functions Neural ODEs cannot represent. To address these limitations, we introduce Augmented Neural ODEs which, in addition to being more expressive models, are empirically more stable, generalize better and have a lower computational cost than Neural ODEs.


title: The Relationship between Flux Coordinates and Equilibrium-based Frames of Reference in Fusion Theory

abstract: The properties of two local reference frames based on the magnetic field and the current density are investigated for magnetized plasmas in toroidal geometry with symmetric angle. The magnetic field-based local frame of reference has been well-studied for example by Dewar and colleagues [Phys. Fluids 27, 1723 (1984)] An analogous frame based on the current density vector is possible because it is also divergence free and perpendicular to the gradient of the poloidal flux. The concept of straightness of a vector is introduced and used to elucidate the Boozer and Hamada coordinate systems. The relationship of these local frames to the more well-known Frenet frame of reference, which specifies a curve in terms of curvature and torsion, is given. As an example of the usefulness of the these formal relationships, we briefly review the ideal MHD theory and their use. We also present a new annihilation operator, useful for eliminating shorter time scales than the time scale of interest, for deriving the inner layer equations of Glasser, Greene, and Johnson [Phys. Fluids 18, 875 (1975)]. Compared to the original derivation that is based on the local frame of reference in terms of the magnetic field, the new annihilation operator that is based on the local frame of reference in terms of the current density simplifies the derivation.


title: Template Bank for Compact Binary Coalescence Searches in Gravitational Wave Data: A General Geometric Placement Algorithm

abstract: We introduce an algorithm for placing template waveforms for the search of compact binary mergers in gravitational wave interferometer data. We exploit the smooth dependence of the amplitude and unwrapped phase of the frequency-domain waveform on the parameters of the binary. We group waveforms with similar amplitude profiles and perform a singular value decomposition of the phase profiles to obtain an orthonormal basis for the phase functions. The leading basis functions span a lower-dimensional linear space in which the unwrapped phase of any physical waveform is well approximated. The optimal template placement is given by a regular grid in the space of linear coefficients. The algorithm is applicable to any frequency-domain waveform model and detector sensitivity curve. It is computationally efficient and requires little tuning. Applying this method, we construct a set of template banks suitable for the search of aligned-spin binary neutron star, neutron-star--black-hole and binary black hole mergers in LIGO--Virgo data.


title: Impact of ASR on Alzheimer's Disease Detection: All Errors are Equal, but Deletions are More Equal than Others

abstract: Automatic Speech Recognition (ASR) is a critical component of any fully-automated speech-based dementia detection model. However, despite years of speech recognition research, little is known about the impact of ASR accuracy on dementia detection. In this paper, we experiment with controlled amounts of artificially generated ASR errors and investigate their influence on dementia detection. We find that deletion errors affect detection performance the most, due to their impact on the features of syntactic complexity and discourse representation in speech. We show the trend to be generalisable across two different datasets for cognitive impairment detection. As a conclusion, we propose optimising the ASR to reflect a higher penalty for deletion errors in order to improve dementia detection performance.


title: Measuring Calibration in Deep Learning

abstract: Overconfidence and underconfidence in machine learning classifiers is measured by calibration: the degree to which the probabilities predicted for each class match the accuracy of the classifier on that prediction. How one measures calibration remains a challenge: expected calibration error, the most popular metric, has numerous flaws which we outline, and there is no clear empirical understanding of how its choices affect conclusions in practice, and what recommendations there are to counteract its flaws. In this paper, we perform a comprehensive empirical study of choices in calibration measures including measuring all probabilities rather than just the maximum prediction, thresholding probability values, class conditionality, number of bins, bins that are adaptive to the datapoint density, and the norm used to compare accuracies to confidences. To analyze the sensitivity of calibration measures, we study the impact of optimizing directly for each variant with recalibration techniques. Across MNIST, Fashion MNIST, CIFAR-10/100, and ImageNet, we find that conclusions on the rank ordering of recalibration methods is drastically impacted by the choice of calibration measure. We find that conditioning on the class leads to more effective calibration evaluations, and that using the L2 norm rather than the L1 norm improves both optimization for calibration metrics and the rank correlation measuring metric consistency. Adaptive binning schemes lead to more stablity of metric rank ordering when the number of bins vary, and is also recommended. We open source a library for the use of our calibration measures.


title: Gaia-assisted selection of a quasar reddened by dust in an extremely-strong Damped Lyman-{\alpha} Absorber at z=2.226

abstract: Damped Lyman-{\alpha} Absorbers (DLAs) as a class of QSO absorption-line systems are currently our most important source of detailed information on the cosmic chemical evolution of galaxies. However, the degree to which this information is biased by dust remains to be understood. One strategy is to specifically search for QSOs reddened by metal-rich and dusty foreground absorbers. In this Letter we present the discovery of a z=2.60 QSO strongly reddened by dust in an intervening extremely-strong DLA at z=2.226. This QSO was identified through a novel selection combining the astrometric measurements from ESA's Gaia satellite with extent optical and near/mid-infrared photometry. We infer a total neutral atomic-hydrogen column density of log N(HI)=21.95{\pm}0.15 and a lower limit on the gas-phase metallicity of [Zn/H]>-0.96. This DLA is also remarkable in exhibiting shielded neutral gas witnessed in CI and tentative detections of CO molecular bands. The Spectral Energy Distribution (SED) of the QSO is well-accounted for by a normal QSO-SED reddened by dust from a DLA with a 10%-of-Solar metallicity, dust extinction of A_V=0.82{\pm}0.02mag, and LMC-like extinction curve including the characteristic 2175{\AA} extinction feature. Such QSO absorption-line systems have shown to be very rare in previous surveys, which have mostly revealed sight-lines with low extinction. The present case therefore suggests that previous samples have under-represented the fraction of dusty absorbers. Building a complete sample of such systems is needed to assess the significance of this effect.


title: Lab Hackathons to Overcome Laboratory Equipment Shortages in Africa: Opportunities and Challenges

abstract: Equipment shortages in Africa undermine Science, Technology, Engineering and Mathematics (STEM) Education. We have pioneered the LabHackathon (LabHack): a novel initiative that adapts the conventional hackathon and draws on insights from the Open Hardware movement and Responsible Research and Innovation (RRI). LabHacks are fun, educational events that challenge student participants to build frugal and reproducible pieces of laboratory equipment. Completed designs are then made available to others. LabHacks can therefore facilitate the open and sustainable design of laboratory equipment, in situ, in Africa. In this case study we describe the LabHackathon model, discuss its application in a pilot event held in Zimbabwe and outline the opportunities and challenges it presents.


title: Out of Site: Empowering a New Approach to Online Boycotts

abstract: GrabYourWallet, #boycottNRA and other online boycott campaigns have attracted substantial public interest in recent months. However, a number of significant challenges are preventing online boycotts from reaching their potential. In particular, complex webs of brands and subsidiaries can make it difficult for participants to conform to the goals of a boycott. Similarly, participants and organizers have limited visibility into a boycott's progress. This affects their ability to use sociotechnical innovations from social computing to incentivize participation. To address these challenges, this paper makes a system contribution: a new boycott tool called Out of Site. Out of Site uses lightweight automation to remove obstacles to successful online boycotts. We describe the design challenges associated with Out of Site and report results from two phases of deployment with the GrabYourWallet and Stop Animal Testing boycott communities. Our findings highlight the potential of boycott-assisting technologies and inform the design of this new class of technologies. Finally, like is the case for many systems in social computing, while we designed Out of Site for pro-social uses, there are a number of easily predictable ways in which the system can be leveraged for anti-social purposes (e.g. exacerbating filter bubble issues, empowering boycotts of businesses owned by racial, ethnic, and religious minorities). As such, we developed for this project a new, very straightforward design approach that treats preventing these anti-social uses as a top-tier design concern. This approach stands in contrast to the status quo of ignoring potential anti-social uses and/or considering them to be a secondary design priority. We discuss how our simple approach may help other research projects reduce their potential negative impacts with minimal burden.


title: The Tower of Babel Meets Web 2.0: User-Generated Content and its Applications in a Multilingual Context

abstract: This study explores language's fragmenting effect on user-generated content by examining the diversity of knowledge representations across 25 different Wikipedia language editions. This diversity is measured at two levels: the concepts that are included in each edition and the ways in which these concepts are described. We demonstrate that the diversity present is greater than has been presumed in the literature and has a significant influence on applications that use Wikipedia as a source of world knowledge. We close by explicating how knowledge diversity can be beneficially leveraged to create "culturally-aware applications" and "hyperlingual applications".


title: Monocular 3D Object Detection Leveraging Accurate Proposals and Shape Reconstruction

abstract: We present MonoPSR, a monocular 3D object detection method that leverages proposals and shape reconstruction. First, using the fundamental relations of a pinhole camera model, detections from a mature 2D object detector are used to generate a 3D proposal per object in a scene. The 3D location of these proposals prove to be quite accurate, which greatly reduces the difficulty of regressing the final 3D bounding box detection. Simultaneously, a point cloud is predicted in an object centered coordinate system to learn local scale and shape information. However, the key challenge is how to exploit shape information to guide 3D localization. As such, we devise aggregate losses, including a novel projection alignment loss, to jointly optimize these tasks in the neural network to improve 3D localization accuracy. We validate our method on the KITTI benchmark where we set new state-of-the-art results among published monocular methods, including the harder pedestrian and cyclist classes, while maintaining efficient run-time.


title: DeLTA: GPU Performance Model for Deep Learning Applications with In-depth Memory System Traffic Analysis

abstract: Training convolutional neural networks (CNNs) requires intense compute throughput and high memory bandwidth. Especially, convolution layers account for the majority of the execution time of CNN training, and GPUs are commonly used to accelerate these layer workloads. GPU design optimization for efficient CNN training acceleration requires the accurate modeling of how their performance improves when computing and memory resources are increased. We present DeLTA, the first analytical model that accurately estimates the traffic at each GPU memory hierarchy level, while accounting for the complex reuse patterns of a parallel convolution algorithm. We demonstrate that our model is both accurate and robust for different CNNs and GPU architectures. We then show how this model can be used to carefully balance the scaling of different GPU resources for efficient CNN performance improvement.


title: Method of Counteraction in Social Engineering on Information Activity Objectives

abstract: The article presents a study using attacks such as a fake access point and a phishing page. The previous publications on social engineering have been reviewed, statistics of break-ups are analyzed and directions and mechanism of realization of attacks having elements of social engineering are analyzed. The data from the research in three different places were collected and analyzed and the content statistics were provided. For comparison, three categories of higher education institutions were chosen: technical, humanitarian and mixed profiles. Since the research was conducted in educational institutions during the week, most students in the experiment and graduate students took part in the experiment. For each educational institution, a registration form template was created that mimicked the design of the main pages. Examples of hardware and software implementation of a typical stand for attack, data collection and analysis are given. In order to construct a test stand, widely available components were chosen to show how easy it is to carry out attacks of this kind without significant initial costs and special skills. The article provides statistics on the number of connections, permission to use the address of the e-mail and password, as well as permission to automatically transfer service data to the browser (cookies). The statistics are processed using specially written algorithms. The proposed approaches to solving the problem of socio-technical attacks can be used and implemented for operation on any objects of information activity. As a result of the experiments, it is clear that the awareness of users of even technical specialties is not enough, so one needs to pay particular attention to the development of methods for raising awareness of users and reducing the number of potential attacks on objects of information activity.


title: Multigrid Predictive Filter Flow for Unsupervised Learning on Videos

abstract: We introduce multigrid Predictive Filter Flow (mgPFF), a framework for unsupervised learning on videos. The mgPFF takes as input a pair of frames and outputs per-pixel filters to warp one frame to the other. Compared to optical flow used for warping frames, mgPFF is more powerful in modeling sub-pixel movement and dealing with corruption (e.g., motion blur). We develop a multigrid coarse-to-fine modeling strategy that avoids the requirement of learning large filters to capture large displacement. This allows us to train an extremely compact model (4.6MB) which operates in a progressive way over multiple resolutions with shared weights. We train mgPFF on unsupervised, free-form videos and show that mgPFF is able to not only estimate long-range flow for frame reconstruction and detect video shot transitions, but also readily amendable for video object segmentation and pose tracking, where it substantially outperforms the published state-of-the-art without bells and whistles. Moreover, owing to mgPFF's nature of per-pixel filter prediction, we have the unique opportunity to visualize how each pixel is evolving during solving these tasks, thus gaining better interpretability.


title: Pharos: improving navigation instructions on smartwatches by including global landmarks

abstract: Landmark-based navigation systems have proven benefits relative to traditional turn-by-turn systems that use street names and distances. However, one obstacle to the implementation of landmark-based navigation systems is the complex challenge of selecting salient local landmarks at each decision point for each user. In this paper, we present Pharos, a novel system that extends turn-by-turn navigation instructions using a single global landmark (e.g. the Eiffel Tower, the Burj Khalifa, municipal TV towers) rather than multiple, hard-to-select local landmarks. We first show that our approach is feasible in a large number of cities around the world through the use of computer vision to select global landmarks. We then present the results of a study demonstrating that by including global landmarks in navigation instructions, users navigate more confidently and build a more accurate mental map of the navigated area than using turn-by-turn instructions.


title: Beyond sub-Rayleigh imaging via high order correlation of speckle illumination

abstract: Second order intensity correlations of speckle illumination are extensively used in imaging applications that require going beyond the Rayleigh limit. The theoretical analysis shows that significantly improved imaging can be extracted from the study of increasingly higher order intensity cumulants. We provide experimental evidence by demonstrating resolution beyond what is achievable by second order correlations. We present results up to 20th order. We also show an increased visibility of cumulant correlations compared to moment correlations. Our findings clearly suggest the benefits of using higher order intensity cumulants in other disciplines like astronomy and biology.


title: Comparison of Possible Approaches for the Development of Low-Budget Spectrum Analyzers for Sensor Networks in the Range of 2.4-2.5 GHz

abstract: The article deals with the development, implementation and research of the spectrum analyzers that can be used in sensor networks and Internet systems of things. As an operating frequency range, 2.4-2.5 GHz ISM is selected. At the stage of hardware selection, a comparative analysis of existing available microcontrollers for the analysis of the spectrum, the choice of hardware interfaces, the ordering of the required modules and electrical components, as well as the input control is carried out. During development, several variants of spectrum analyzers on the basis of microcontroller and TI Chipcon CC2500 microcontrollers with USB interfaces, as well as Cypress CYWUSB6935 modules with LPT and USB interfaces, have been implemented. At the development stage, the development of the printed circuit board, its fabrication, component assembly, microcontroller programming, the verification of the assembly's robustness, making corrections, connecting to a personal computer and assembly in the case have been carried out. An analysis of existing software for collecting information on the state of the wireless broadcast is also conducted. According to the results of comparative experiments of various collections of spectrum analyzers, spectrographs for different types of signals were obtained. On these typical spectrographs a comparative analysis of the work of various prototypes was conducted. The offered approaches to building sensors on the basis of spectrum analyzers allow to create low-power modules for embedding in existing wireless information networks of enterprises for prevention of inter-channel interference and ensuring the integrity of data transmission.


title: Using spatial partitioning to reduce the bit error rate of diffusion-based molecular communications

abstract: This work builds on our earlier work on designing demodulators for diffusion-based molecular communications using a Markovian approach. The demodulation filters take the form of an ordinary differential equation (ODE) which computes the log-posteriori probability of observing a transmission symbol given the continuous history of receptor activities. A limitation of our earlier work is that the receiver is assumed to be a small cubic volume called a voxel. In this work, we extend the maximum a-posteriori demodulation to the case where the receiver may consist of multiple voxels and derive the ODE for log-posteriori probability calculation. This extension allows us to study receiver behaviour of different volumes and shapes. In particular, it also allows us to consider spatially partitioned receivers where the chemicals in the receiver are not allowed to mix. The key result of this paper is that spatial partitioning can be used to reduce bit-error rate in diffusion-based molecular communications.


title: VRGym: A Virtual Testbed for Physical and Interactive AI

abstract: We propose VRGym, a virtual reality testbed for realistic human-robot interaction. Different from existing toolkits and virtual reality environments, the VRGym emphasizes on building and training both physical and interactive agents for robotics, machine learning, and cognitive science. VRGym leverages mechanisms that can generate diverse 3D scenes with high realism through physics-based simulation. We demonstrate that VRGym is able to (i) collect human interactions and fine manipulations, (ii) accommodate various robots with a ROS bridge, (iii) support experiments for human-robot interaction, and (iv) provide toolkits for training the state-of-the-art machine learning algorithms. We hope VRGym can help to advance general-purpose robotics and machine learning agents, as well as assisting human studies in the field of cognitive science.


title: Resolution Study for Three-dimensional Supernova Simulations with the Prometheus-Vertex Code

abstract: We present a carefully designed, systematic study of the angular resolution dependence of simulations with the Prometheus-Vertex neutrino-hydrodynamics code. Employing a simplified neutrino heating-cooling scheme in the Prometheus hydrodynamics module allows us to sample the angular resolution between 4 degrees and 0.5 degrees. With a newly-implemented static mesh refinement (SMR) technique on the Yin-Yang grid, the angular coordinates can be refined in concentric shells, compensating for the diverging structure of the spherical grid. In contrast to previous studies with Prometheus and other codes, we find that higher angular resolution and therefore lower numerical viscosity provides more favorable explosion conditions and faster shock expansion. We discuss the possible reasons for the discrepant results. The overall dynamics seem to converge at a resolution of about 1 degree. Applying the SMR setup to marginally exploding progenitors is disadvantageous for the shock expansion, however, because kinetic energy of downflows is dissipated to internal energy at resolution interfaces, leading to a loss of turbulent pressure support and a steeper temperature gradient. We also present a way to estimate the numerical viscosity on grounds of the measured turbulent kinetic-energy spectrum, leading to smaller values that are better compatible with the flow behavior witnessed in our simulations than results following calculations in previous literature. Interestingly, the numerical Reynolds numbers in the turbulent, neutrino-heated postshock layer (some 10 to several 100) are in the ballpark of expected neutrino-drag effects on the relevant length scales in the turbulent postshock layer. We provide a formal derivation and quantitative assessment of the neutrino drag terms in an appendix.


title: Research of Stability in Ad Hoc Self-Organizated Wireless Networks

abstract: To date, there is a need for the development of efficient data and device exchange protocols that this exchange will provide, since standard protocols used in traditional networks can not fully meet the needs of a new type of network. The article describes the process of development and implementation of a full-scale model of noise-resistant and sensor network breaks. The stability of this network is achieved by building a distributed network, in which all nodes send messages to all available nodes. Wireless mobile peer-to-peer network (MANET) can be configured automatically, so the nodes in it can move freely. Wireless networks do not have the complexity of infrastructure and management, which allows devices to create and join on-the-go networks - anywhere, anytime. In this paper, the theoretical part of the functioning of such networks and the field of their use is considered. After that, an initial analysis of the available equipment used for constructing such hardware solutions was conducted. The software for developing such solutions is considered in detail, as well as examples of finished models that implement the investigated functional. After that, several variants of the model of network nodes, as well as the test device for creating a payload on the network, are collected. For this purpose, third-party open solutions were used in conjunction with their own developments. The system received a series of tests that made it possible to understand the weak and strong points of such a network and draw conclusions for the further development of the project and the creation of an improved working prototype. The article presents the basic electrical circuits of devices, the list of used equipment and software used and the photographic material of prototypes of the created system.


title: 3DRegNet: A Deep Neural Network for 3D Point Registration

abstract: We present 3DRegNet, a novel deep learning architecture for the registration of 3D scans. Given a set of 3D point correspondences, we build a deep neural network to address the following two challenges: (i) classification of the point correspondences into inliers/outliers, and (ii) regression of the motion parameters that align the scans into a common reference frame. With regard to regression, we present two alternative approaches: (i) a Deep Neural Network (DNN) registration and (ii) a Procrustes approach using SVD to estimate the transformation. Our correspondence-based approach achieves a higher speedup compared to competing baselines. We further propose the use of a refinement network, which consists of a smaller 3DRegNet as a refinement to improve the accuracy of the registration. Extensive experiments on two challenging datasets demonstrate that we outperform other methods and achieve state-of-the-art results. The code is available.


title: From atomic layer to the bulk: low-temperature atomistic structure, ferroelectric and electronic properties of SnTe films

abstract: SnTe hosts ferroelectricity that competes with its weak non-trivial band topology: in the high-symmetry rocksalt structure--in which its intrinsic electric dipole is quenched--this material develops metallic surface bands, but in its rhombic ground-state configuration--that hosts a non-zero spontaneous electric dipole--the crystalline symmetry is lowered and the presence of surface electronic bands is not guaranteed. Here, the type of ferroelectric coupling and the atomistic and electronic structure of SnTe films ranging from 2 to 40 ALs are examined on freestanding samples, to which atomic layers were gradually added. 4 AL SnTe films are antiferroelectrically-coupled, while thicker freestanding SnTe films are ferroelectrically-coupled. The electronic band gap reduces its magnitude in going from 2 ALs to 40 ALs but it does not close due to the rhombic nature of the structure. These results bridge the structure of SnTe films from the monolayer to the bulk.


title: The Wolf-Rayet Stellar Response To The Iron Opacity Bump: Envelope Inflation, Winds, and Microturbulence

abstract: Early-type Wolf-Rayet(WR) stellar models harbor a super-Eddington layer in their outer envelopes due to a prominent iron opacity bump. In the past few decades, one-dimensional hydrostatic and time-steady hydrodynamic models have suggested a variety of WR responses to a super-Eddington force including envelope inflation and optically thick winds. In this paper, I study these responses using semianalytical estimates and WR models from both MESA and Ro & Matzner; four conclusions are present. First, early-type WR stars do not harbor inflated envelopes because they have either strong winds or insufficient luminosities. Second, the condition for an opacity bump to harbor a sonic point is expressible as a minimum mass-loss rate, $\dot{M}_{\rm sp}(L_*)$. In agreement with Grassitelli et al. and Ro, the majority of galactic early-type WR stars can harbor sonic points at the iron opacity bump. However, about half of those in the Large Magellanic Cloud cannot given typical wind parameters. Third, WR winds driven by the iron opacity bump must have mass-loss rates that exceed a global minimum of $10^{-5.8}-10^{-6}M_\odot\,{\rm yr}^{-1}$. Lastly, the observed early-type WR distribution follows a simple mass-loss relation derived here if the radiation-to-gas pressure ratio is approximately $p_r/p_g \sim 145$ in the wind; a value consistent with studies by Grafener et al. and Nakauchi & Saio.


title: Magnetic Stability for the Hatree-Fock Ground State in Two Dimensional Rashba-Gauge Electronic Systems

abstract: The magnetic Hartree Fock ground state stability for a two-dimensional interacting electron system with Rashba-type coupling is studied by implementing the standard many body Green's function formalism. The externally applied electrical field $\mathbf{E}$ enters into the Hamiltonian model through a local gauge-type transformation $\sim E_{j}\mathcal{A}_{j}(\mathbf{k})$, with $\mathcal{A}_{j}(\mathbf{k})$ as the spin gauge vector potential. Phase diagrams associated to the average spin polarization, the Fermi energy, electron density and energy band gap at zero temperature are constructed. The magnetic polarization state as a function of $\mathbf{E}$ is obtained by minimizing the Helmholtz energy functional $\mathcal{F}$ with respect to the average $Z$-spin: $\langle\hat{\sigma}_{Z}\rangle$. We have found that the electric field might reverse the magnetic ground state, unlike the characteristic decreasing associated to the linear $\hat{\boldsymbol{\sigma}}\cdot(\mathbf{k\times E})$ spin-momentum-field coupling.


title: Improving Noise Tolerance of Mixed-Signal Neural Networks

abstract: Mixed-signal hardware accelerators for deep learning achieve orders of magnitude better power efficiency than their digital counterparts. In the ultra-low power consumption regime, limited signal precision inherent to analog computation becomes a challenge. We perform a case study of a 6-layer convolutional neural network running on a mixed-signal accelerator and evaluate its sensitivity to hardware specific noise. We apply various methods to improve noise robustness of the network and demonstrate an effective way to optimize useful signal ranges through adaptive signal clipping. The resulting model is robust enough to achieve 80.2% classification accuracy on CIFAR-10 dataset with just 1.4 mW power budget, while 6 mW budget allows us to achieve 87.1% accuracy, which is within 1% of the software baseline. For comparison, the unoptimized version of the same model achieves only 67.7% accuracy at 1.4 mW and 78.6% at 6 mW.


title: Weak Shock Propagation with Accretion. III. A Numerical Study On Shock Propagation & Stability

abstract: Core-collapse supernovae span a wide range of energies, from much less than to much greater than the binding energy of the progenitor star. As a result, the shock wave generated from a supernova explosion can have a wide range of Mach numbers. In this paper, we investigate the propagation of shocks with arbitrary initial strengths in polytropic stellar envelopes using a suite of spherically symmetric hydrodynamic simulations. We interpret these results using the three known self-similar solutions for this problem: the Sedov-Taylor blastwave describes an infinitely strong shock and the self-similar solutions from Coughlin et al. (2018b) (Paper I) and Coughlin et al. (2019) (Paper II) describe a weak and infinitely weak shock (the latter being a rarefaction wave). We find that shocks, no matter their initial strengths, evolve toward either the infinitely strong or infinitely weak self-similar solutions at sufficiently late times. For a given density profile, a single function characterizes the long-term evolution of a shock's radius and strength. However, shocks with strengths near the self-similar solution for a weak shock (from Paper I) evolve extremely slowly with time. Therefore, the self-similar solutions for infinitely strong and infinitely weak shocks are not likely to be realized in low-energy stellar explosions, which will instead retain memory of the shock strength initiated in the stellar interior.


title: On constraints imposed on a transversely isotropic elasticity tensor

abstract: We discuss several physical constraints imposed on elasticity parameters of a transversely isotropic (TI) tensor. There are three types of restrictions we investigate; a fundamental one of stability conditions, and two additional ones, commonly considered in seismology. The first commonly considered restriction comes from an assumption of a wave with a greater speed in the horizontal than vertical direction. The second constitute the assumption that quasi-P wave is faster than quasi-S waves. We show several numerical examples to examine how these restrictions affect a TI tensor with known values of certain elasticity constants that could be acquired from the vertical or horizontal measurements.


title: Symmetric Powers and Eilenberg--Maclane Spectra

abstract: We filter the equivariant Eilenberg Maclane spectrum $H\underline{\mathbb{F}}_p$ using the mod $p$ symmetric powers of the equivariant sphere spectrum, $\mathrm{Sp}_{\mathbb{Z}/p}^{\infty}(\Sigma^{\infty G}S^0)$. When $G$ is a $p$-group, we show that the layers in the filtration are the Steinberg summands of the equivariant classifying spaces of $(\mathbb{Z}/p)^n$ for $n=0, 1, 2, \ldots$. We show that the layers of the filtration split after smashing with $H\underline{\mathbb{F}}_p$. Along the way, we produced a general computation of the geometric fixed points of $H\underline{\mathbb{Z}}$ and $H\underline{\mathbb{F}}_p$ by using symmetric powers.


title: Evolving Plasticity for Autonomous Learning under Changing Environmental Conditions

abstract: A fundamental aspect of learning in biological neural networks is the plasticity property which allows them to modify their configurations during their lifetime. Hebbian learning is a biologically plausible mechanism for modeling the plasticity property in artificial neural networks (ANNs), based on the local interactions of neurons. However, the emergence of a coherent global learning behavior from local Hebbian plasticity rules is not very well understood. The goal of this work is to discover interpretable local Hebbian learning rules that can provide autonomous global learning. To achieve this, we use a discrete representation to encode the learning rules in a finite search space. These rules are then used to perform synaptic changes, based on the local interactions of the neurons. We employ genetic algorithms to optimize these rules to allow learning on two separate tasks (a foraging and a prey-predator scenario) in online lifetime learning settings. The resulting evolved rules converged into a set of well-defined interpretable types, that are thoroughly discussed. Notably, the performance of these rules, while adapting the ANNs during the learning tasks, is comparable to that of offline learning methods such as hill climbing.


title: An Optimal Control Derivation of Nonlinear Smoothing Equations

abstract: The purpose of this paper is to review and highlight some connections between the problem of nonlinear smoothing and optimal control of the Liouville equation. The latter has been an active area of recent research interest owing to work in mean-field games and optimal transportation theory. The nonlinear smoothing problem is considered here for continuous-time Markov processes. The observation process is modeled as a nonlinear function of a hidden state with an additive Gaussian measurement noise. A variational formulation is described based upon the relative entropy formula introduced by Newton and Mitter. The resulting optimal control problem is formulated on the space of probability distributions. The Hamilton's equation of the optimal control are related to the Zakai equation of nonlinear smoothing via the log transformation. The overall procedure is shown to generalize the classical Mortensen's minimum energy estimator for the linear Gaussian problem.


title: Data Disclosure under Perfect Sample Privacy

abstract: Perfect data privacy seems to be in fundamental opposition to the economical and scientific opportunities associated with extensive data exchange. Defying this intuition, this paper develops a framework that allows the disclosure of collective properties of datasets without compromising the privacy of individual data samples. We present an algorithm to build an optimal disclosure strategy/mapping, and discuss it fundamental limits on finite and asymptotically large datasets. Furthermore, we present explicit expressions to the asymptotic performance of this scheme in some scenarios, and study cases where our approach attains maximal efficiency. We finally discuss suboptimal schemes to provide sample privacy guarantees to large datasets with a reduced computational cost.


title: On geometric constants for (small) Morrey spaces

abstract: In this article, we compute Von Neumann-Jordan constant, James constant, and Dunkl-Williams constant for small Morrey spaces. Our approach can also be seen as an alternative way in computing the three constants for the (classical) Morrey spaces. In addition, we prove constructively that Morrey spaces are not uniformly non-octahedral.


title: Design, Analysis, Tools, and Apprenticeship (DATA) Lab

abstract: Recently, there have been several national calls to emphasize physics practices and skills within laboratory courses. In this paper, we describe the redesign and implementation of a two-course sequence of algebra-based physics laboratories at Michigan State University called Design Analysis Tools and Apprenticeship (DATA) Lab. The large-scale course transformation removes physics specific content from the overall learning goals of the course, and instead, uses physics concepts to focus on specific laboratory practices and research skills that students can take into their future careers. Students in DATA Lab engage in the exploration of physical systems to increase their understanding of the experimental process, data analysis, collaboration, and scientific communication. In order to ensure our students are making progress toward the skills outlined in the course learning goals, we designed all of the assessments in the courses to evaluate their progress specific to these laboratory practices. Here, we will describe the structures, scaffolds, goals, and assessments of the course.


title: A LeVeque-Type Inequality on the ring of $p$-adic integers

abstract: We derive an inequality on the discrepancy of sequences on the ring of $p$-adic integers $\ZZ_p$ using techniques from Fourier analysis. The inequality is used to obtain an upper bound on the discrepancy of the sequence $\alpha_n = na +b$, where $a$ and $b$ are elements of $\ZZ_p$. This is a $p$-adic analogue of the classical LeVeque inequality on the circle group $\RR/\ZZ$.


title: Expanding Polynomials and Pairs of Polynomials in Characteristic 0

abstract: We begin a generalized study of sum-product type phenomenon in different fields by considering pairs $P(x,y)$ and $Q(x,y)$ of two variable polynomials that simultaneously exhibit small symmetric expansion. Our first result is that such $P(x,y)$ and $Q(x,y)$ over $\mathbb{R}$ and $\mathbb{C}$ have very similar structure, obtained by employing semi-algebraic geometry/o-minimality. Then using model-theoretic transfer and basic Galois theory we deduce results for fields of characteristic $0$ and characteristic $p$ when $p$ is large. We obtain as corollaries a generalization of Elekes-R\'onyai type structural results to arbitrary characteristic 0 fields, and a strengthening of these classic results in a symmetric case of natural interest. We note a related bound of $5/4$ in the exponent for the sum-product problem in finite fields of large characteristic, although a lower bound for this characteristic cannot be computed from our methods.


title: The multi-component modified nonlinear Schr\"odinger system with nonzero boundary conditions

abstract: In a previous paper (Matsuno 2011 {\it J. Phys. A: Math. Theore.} {\bf 44} 495202), we have presented a determinantal expression of the bright $N$-soliton solution for a multi-component modified nonlinear Schr\"odinger (NLS) system with zero boundary conditions. The present paper provides the dark $N$-soliton solution for the same system of equations with plane-wave boundary conditions, as well as the bright-dark $N$-soliton solution with mixed zero and plane-wave boundary conditions. The proof of the $N$-soliton solutions is performed by means of an elementary theory of determinants in which acobi's identity plays the central role. The $N$-soliton formulas obtained here include as special cases the existing soliton solutions of the NLS and derivative NLS equations and their integrable multi-omponent analogs. The new features of soliton solutions are discussed. In particular, it is shown that the $N$ constraints must be imposed on the amplitude parameters of solitons in constructing the dark $N$-soliton solution with plane-wave boundary conditions. This makes it difficult to analyze the solutions as the number of components increases. For mixed type boundary conditions, the structure of soliton solutions is found to be more explicit than that of dark soliton solutions since no constraints are imposed on the soliton parameters. Last, we comment on an integrable multi-component system associated with the first negative flow of the multi-component derivative NLS hierarchy.


title: Fractal geometry of Airy_2 processes coupled via the Airy sheet

abstract: In last passage percolation models lying in the Kardar-Parisi-Zhang universality class, maximizing paths that travel over distances of order $n$ accrue energy that fluctuates on scale $n^{1/3}$; and these paths deviate from the linear interpolation of their endpoints on scale $n^{2/3}$. These maximizing paths and their energies may be viewed via a coordinate system that respects these scalings. What emerges by doing so is a system indexed by $x,y \in \mathbb{R}$ and $s,t \in \mathbb{R}$ with $s < t$ of unit order quantities $W_n\big( x,s ; y,t \big)$ specifying the scaled energy of the maximizing path that moves in scaled coordinates between $(x,s)$ and $(y,t)$. The space-time Airy sheet is, after a parabolic adjustment, the putative distributional limit $W_\infty$ of this system as $n \to \infty$. The Airy sheet has recently been constructed in [15] as such a limit of Brownian last passage percolation. In this article, we initiate the study of fractal geometry in the Airy sheet. We prove that the scaled energy difference profile given by $\mathbb{R} \to \mathbb{R}: z \to W_\infty \big( 1,0 ; z,1 \big) - W_\infty \big( -1,0 ; z,1 \big)$ is a non-decreasing process that is constant in a random neighbourhood of almost every $z \in \mathbb{R}$; and that the exceptional set of $z \in \mathbb{R}$ that violate this condition almost surely has Hausdorff dimension one-half. Points of violation correspond to special behaviour for scaled maximizing paths, and we prove the result by investigating this behaviour, making use of two inputs from recent studies of scaled Brownian LPP; namely, Brownian regularity of profiles, and estimates on the rarity of pairs of disjoint scaled maximizing paths that begin and end close to each other.


title: Empirical Evaluations of Preprocessing Parameters' Impact on Predictive Coding's Effectiveness

abstract: Predictive coding, once used in only a small fraction of legal and business matters, is now widely deployed to quickly cull through increasingly vast amounts of data and reduce the need for costly and inefficient human document review. Previously, the sole front-end input used to create a predictive model was the exemplar documents (training data) chosen by subject-matter experts. Many predictive coding tools require users to rely on static preprocessing parameters and a single machine learning algorithm to develop the predictive model. Little research has been published discussing the impact preprocessing parameters and learning algorithms have on the effectiveness of the technology. A deeper dive into the generation of a predictive model shows that the settings and algorithm can have a strong effect on the accuracy and efficacy of a predictive coding tool. Understanding how these input parameters affect the output will empower legal teams with the information they need to implement predictive coding as efficiently and effectively as possible. This paper outlines different preprocessing parameters and algorithms as applied to multiple real-world data sets to understand the influence of various approaches.


title: Empirical Evaluations of Active Learning Strategies in Legal Document Review

abstract: One type of machine learning, text classification, is now regularly applied in the legal matters involving voluminous document populations because it can reduce the time and expense associated with the review of those documents. One form of machine learning - Active Learning - has drawn attention from the legal community because it offers the potential to make the machine learning process even more effective. Active Learning, applied to legal documents, is considered a new technology in the legal domain and is continuously applied to all documents in a legal matter until an insignificant number of relevant documents are left for review. This implementation is slightly different than traditional implementations of Active Learning where the process stops once achieving acceptable model performance. The purpose of this paper is twofold: (i) to question whether Active Learning actually is a superior learning methodology and (ii) to highlight the ways that Active Learning can be most effectively applied to real legal industry data. Unlike other studies, our experiments were performed against large data sets taken from recent, real-world legal matters covering a variety of areas. We conclude that, although these experiments show the Active Learning strategy popularly used in legal document review can quickly identify informative training documents, it becomes less effective over time. In particular, our findings suggest this most popular form of Active Learning in the legal arena, where the highest-scoring documents are selected as training examples, is in fact not the most efficient approach in most instances. Ultimately, a different Active Learning strategy may be best suited to initiate the predictive modeling process but not to continue through the entire document review.


title: Neural Program Repair by Jointly Learning to Localize and Repair

abstract: Due to its potential to improve programmer productivity and software quality, automated program repair has been an active topic of research. Newer techniques harness neural networks to learn directly from examples of buggy programs and their fixes. In this work, we consider a recently identified class of bugs called variable-misuse bugs. The state-of-the-art solution for variable misuse enumerates potential fixes for all possible bug locations in a program, before selecting the best prediction. We show that it is beneficial to train a model that jointly and directly localizes and repairs variable-misuse bugs. We present multi-headed pointer networks for this purpose, with one head each for localization and repair. The experimental results show that the joint model significantly outperforms an enumerative solution that uses a pointer based model for repair alone.


title: Explainable Text Classification in Legal Document Review A Case Study of Explainable Predictive Coding

abstract: In today's legal environment, lawsuits and regulatory investigations require companies to embark upon increasingly intensive data-focused engagements to identify, collect and analyze large quantities of data. When documents are staged for review the process can require companies to dedicate an extraordinary level of resources, both with respect to human resources, but also with respect to the use of technology-based techniques to intelligently sift through data. For several years, attorneys have been using a variety of tools to conduct this exercise, and most recently, they are accepting the use of machine learning techniques like text classification to efficiently cull massive volumes of data to identify responsive documents for use in these matters. In recent years, a group of AI and Machine Learning researchers have been actively researching Explainable AI. In an explainable AI system, actions or decisions are human understandable. In typical legal `document review' scenarios, a document can be identified as responsive, as long as one or more of the text snippets in a document are deemed responsive. In these scenarios, if predictive coding can be used to locate these responsive snippets, then attorneys could easily evaluate the model's document classification decision. When deployed with defined and explainable results, predictive coding can drastically enhance the overall quality and speed of the document review process by reducing the time it takes to review documents. The authors of this paper propose the concept of explainable predictive coding and simple explainable predictive coding methods to locate responsive snippets within responsive documents. We also report our preliminary experimental results using the data from an actual legal matter that entailed this type of document review.


title: An Empirical Study of the Application of Machine Learning and Keyword Terms Methodologies to Privilege-Document Review Projects in Legal Matters

abstract: Protecting privileged communications and data from disclosure is paramount for legal teams. Unrestricted legal advice, such as attorney-client communications or litigation strategy. are vital to the legal process and are exempt from disclosure in litigations or regulatory events. To protect this information from being disclosed, companies and outside counsel must review vast amounts of documents to determine those that contain privileged material. This process is extremely costly and time consuming. As data volumes increase, legal counsel employ methods to reduce the number of documents requiring review while balancing the need to ensure the protection of privileged information. Keyword searching is relied upon as a method to target privileged information and reduce document review populations. Keyword searches are effective at casting a wide net but return over inclusive results -- most of which do not contain privileged information -- and without detailed knowledge of the data, keyword lists cannot be crafted to find all privilege material. Overly-inclusive keyword searching can also be problematic, because even while it drives up costs, it also can cast `too far of a net' and thus produce unreliable results.To overcome these weaknesses of keyword searching, legal teams are using a new method to target privileged information called predictive modeling. Predictive modeling can successfully identify privileged material but little research has been published to confirm its effectiveness when compared to keyword searching. This paper summarizes a study of the effectiveness of keyword searching and predictive modeling when applied to real-world data. With this study, this group of collaborators wanted to examine and understand the benefits and weaknesses of both approaches to legal teams with identifying privilege material in document populations.


title: Empirical Study of Deep Learning for Text Classification in Legal Document Review

abstract: Predictive coding has been widely used in legal matters to find relevant or privileged documents in large sets of electronically stored information. It saves the time and cost significantly. Logistic Regression (LR) and Support Vector Machines (SVM) are two popular machine learning algorithms used in predictive coding. Recently, deep learning received a lot of attentions in many industries. This paper reports our preliminary studies in using deep learning in legal document review. Specifically, we conducted experiments to compare deep learning results with results obtained using a SVM algorithm on the four datasets of real legal matters. Our results showed that CNN performed better with larger volume of training dataset and should be a fit method in the text classification in legal industry.


title: Ferromagnetic Instability for single-band Hubbard model in the strong-coupling regime

abstract: We study a ferromagnetic instability in a doped single-band Hubbard model by means of dynamical mean-field theory with the continuous-time quantum Monte Carlo simulations. Examining the effect of the strong correlations in the system on the hypercubic and Bethe lattice, we find that the ferromagnetically ordered state appears in the former, while it does not in the latter. We also reveal that the ferromagnetic order is more stable in the case that the noninteracting DOS exhibits a slower decay in the high-energy region. The present results suggest that, in the strong-coupling regime, the high-energy part of DOS plays an essential role for the emergence of the ferromagnetically ordered state, in contrast to the Stoner criterion justified in the weak interaction limit.


title: Using Google Analytics to Support Cybersecurity Forensics

abstract: Web traffic is a valuable data source, typically used in the marketing space to track brand awareness and advertising effectiveness. However, web traffic is also a rich source of information for cybersecurity monitoring efforts. To better understand the threat of malicious cyber actors, this study develops a methodology to monitor and evaluate web activity using data archived from Google Analytics. Google Analytics collects and aggregates web traffic, including information about web visitors' location, date and time of visit, visited webpages, and searched keywords. This study seeks to streamline analysis of this data and uses rule-based anomaly detection and predictive modeling to identify web traffic that deviates from normal patterns. Rather than evaluating pieces of web traffic individually, the methodology seeks to emulate real user behavior by creating a new unit of analysis: the user session. User sessions group individual pieces of traffic from the same location and date, which transforms the available information from single point-in-time snapshots to dynamic sessions showing users' trajectory and intent. The result is faster and better insight into large volumes of noisy web traffic.


title: Adaptive phase field method for quasi-static brittle fracture based on recovery based error indicator and quadtree decomposition

abstract: An adaptive phase field method is proposed for crack propagation in brittle materials under quasi-static loading. The adaptive refinement is based on the recovery type error indicator, which is combined with the quadtree decomposition. Such a decomposition leads to elements with hanging nodes. Thanks to the polygonal finite element method, the elements with hanging nodes are treated as polygonal elements and do not require any special treatment. The mean value coordinates are used to approximate the unknown field variables and a staggered solution scheme is adopted to compute the displacement and the phase field variable. A few standard benchmark problems are solved to show the efficiency of the proposed framework. It is seen that the proposed framework yields comparable results at a fraction of the computational cost when compared to standard approaches reported in the literature.


title: Stratum: A Serverless Framework for Lifecycle Management of Machine Learning based Data Analytics Tasks

abstract: With the proliferation of machine learning (ML) libraries and frameworks, and the programming languages that they use, along with operations of data loading, transformation, preparation and mining, ML model development is becoming a daunting task. Furthermore, with a plethora of cloud-based ML model development platforms, heterogeneity in hardware, increased focus on exploiting edge computing resources for low-latency prediction serving and often a lack of a complete understanding of resources required to execute ML workflows efficiently, ML model deployment demands expertise for managing the lifecycle of ML workflows efficiently and with minimal cost. To address these challenges, we propose an end-to-end data analytics, a serverless platform called Stratum. Stratum can deploy, schedule and dynamically manage data ingestion tools, live streaming apps, batch analytics tools, ML-as-a-service (for inference jobs), and visualization tools across the cloud-fog-edge spectrum. This paper describes the Stratum architecture highlighting the problems it resolves.


title: Deep Policy Hashing Network with Listwise Supervision

abstract: Deep-networks-based hashing has become a leading approach for large-scale image retrieval, which learns a similarity-preserving network to map similar images to nearby hash codes. The pairwise and triplet losses are two widely used similarity preserving manners for deep hashing. These manners ignore the fact that hashing is a prediction task on the list of binary codes. However, learning deep hashing with listwise supervision is challenging in 1) how to obtain the rank list of whole training set when the batch size of the deep network is always small and 2) how to utilize the listwise supervision. In this paper, we present a novel deep policy hashing architecture with two systems are learned in parallel: a query network and a shared and slowly changing database network. The following three steps are repeated until convergence: 1) the database network encodes all training samples into binary codes to obtain a whole rank list, 2) the query network is trained based on policy learning to maximize a reward that indicates the performance of the whole ranking list of binary codes, e.g., mean average precision (MAP), and 3) the database network is updated as the query network. Extensive evaluations on several benchmark datasets show that the proposed method brings substantial improvements over state-of-the-art hashing methods.


title: Error bounds for the normal approximation to the length of a Ewens partition

abstract: Let $K(=K_{n,\theta})$ be a positive integer-valued random variable whose distribution is given by ${\rm P}(K = x) = \bar{s}(n,x) \theta^x/(\theta)_n$ $(x=1,\ldots,n) $, where $\theta$ is a positive number, $n$ is a positive integer, $(\theta)_n=\theta(\theta+1)\cdots(\theta+n-1)$ and $\bar{s}(n,x)$ is the coefficient of $\theta^x$ in $(\theta)_n$ for $x=1,\ldots,n$. This formula describes the distribution of the length of a Ewens partition, which is a standard model of random partitions. As $n$ tends to infinity, $K$ asymptotically follows a normal distribution. Moreover, as $n$ and $\theta$ simultaneously tend to infinity, if $n^2/\theta\to\infty$, $K$ also asymptotically follows a normal distribution. In this paper, error bounds for the normal approximation are provided. The result shows that the decay rate of the error changes due to asymptotic regimes.


title: Sequencing and Scheduling for Multi-User Machine-Type Communication

abstract: In this paper, we propose joint sequencing and scheduling optimization for uplink machine-type communication (MTC). We consider multiple energy-constrained MTC devices that transmit data to a base station following the time division multiple access (TDMA) protocol. Conventionally, the energy efficiency performance in TDMA is optimized through multi-user scheduling, i.e., changing the transmission block length allocated to different devices. In such a system, the sequence of devices for transmission, i.e., who transmits first and who transmits second, etc., has not been considered as it does not have any impact on the energy efficiency. In this work, we consider that data compression is performed before transmission and show that the multi-user sequencing is indeed important. We apply three popular energy-minimization system objectives, which differ in terms of the overall system performance and fairness among the devices. We jointly optimize both multi-user sequencing and scheduling along with the compression and transmission rate control. Our results show that multi-user sequence optimization significantly improves the energy efficiency performance of the system. Notably, it makes the TDMA-based multi-user transmissions more likely to be feasible in the lower latency regime, and the performance gain is larger when the delay bound is stringent.


title: The Search For Leakage-free Entangling Fibonacci Braiding Gates

abstract: It is an open question if there are leakage-free entangling Fibonacci braiding gates. We provide evidence to the conjecture for the negative in this paper. We also found a much simpler protocol to generate approximately leakage-free entangling Fibonacci braiding gates than existing algorithms in the literature.


title: Energy Efficient and Resilient Infrastructure for Fog Computing Health Monitoring Applications

abstract: In this paper, we propose a resilient energy efficient and fog computing infrastructure for health monitoring applications. We design the infrastructure to be resilient against server failures under two scenarios; without geographical constraints and with geographical constraints. We consider a heart monitoring application where patients send their 30-seconds recording of Electrocardiogram (ECG) signal for processing, analysis and decision making at both primary and backup servers. A Mixed Integer Linear Programming (MILP) model is used to optimize the number and locations of the primary and backup processing servers so that the energy consumption of both the processing and networking equipment are minimized. The results show that considering geographical constraints yields a network energy consumption increase by up to 9% compared to without geographical constraint. The results also show that, increasing the number of processing servers that can be served at each candidate node can reduce the energy consumption of networking equipment besides reducing the rate of energy increase of networking equipment due to increasing level of demand.


title: Circularly polarized states spawning from bound states in the continuum

abstract: Bound states in the continuum in periodic photonic systems like photonic crystal slabs are proved to be accompanied by vortex polarization singularities on the photonic bands in the momentum space. The winding structures of polarization states not only widen the field of topological physics but also show great potential that such systems could be applied in polarization manipulating. In this work, we report the phenomenon that by in-plane inversion ($C_2$) symmetry breaking, pairs of circularly polarized states could spawn from the eliminated Bound states in the continuum. Along with the appearance of the circularly polarized states as the two poles of the Poincar\'e sphere together with linearly polarized states covering the equator, full coverage on the Poincar\'e sphere could be realized. As an application, ellipticity modulation of linear polarization is demonstrated in the visible frequency range. This phenomenon provides new degree of freedom in modulating polarization.