title: COMAP Early Science: I. Overview

abstract: The CO Mapping Array Project (COMAP) aims to use line intensity mapping of carbon monoxide (CO) to trace the distribution and global properties of galaxies over cosmic time, back to the Epoch of Reionization (EoR). To validate the technologies and techniques needed for this goal, a Pathfinder instrument has been constructed and fielded. Sensitive to CO(1-0) emission from $z=2.4$-$3.4$ and a fainter contribution from CO(2-1) at $z=6$-8, the Pathfinder is surveying $12$ deg$^2$ in a 5-year observing campaign to detect the CO signal from $z\sim3$. Using data from the first 13 months of observing, we estimate $P_\mathrm{CO}(k) = -2.7 \pm 1.7 \times 10^4\mu\mathrm{K}^2 \mathrm{Mpc}^3$ on scales $k=0.051-0.62 \mathrm{Mpc}^{-1}$ - the first direct 3D constraint on the clustering component of the CO(1-0) power spectrum. Based on these observations alone, we obtain a constraint on the amplitude of the clustering component (the squared mean CO line temperature-bias product) of $\langle Tb\rangle^2<49$ $\mu$K$^2$ - nearly an order-of-magnitude improvement on the previous best measurement. These constraints allow us to rule out two models from the literature. We forecast a detection of the power spectrum after 5 years with signal-to-noise ratio (S/N) 9-17. Cross-correlation with an overlapping galaxy survey will yield a detection of the CO-galaxy power spectrum with S/N of 19. We are also conducting a 30 GHz survey of the Galactic plane and present a preliminary map. Looking to the future of COMAP, we examine the prospects for future phases of the experiment to detect and characterize the CO signal from the EoR.


title: COMAP Early Science: II. Pathfinder Instrument

abstract: Line intensity mapping (LIM) is a new technique for tracing the global properties of galaxies over cosmic time. Detection of the very faint signals from redshifted carbon monoxide (CO), a tracer of star formation, pushes the limits of what is feasible with a total-power instrument. The CO Mapping Project (COMAP) Pathfinder is a first-generation instrument aiming to prove the concept and develop the technology for future experiments, as well as delivering early science products. With 19 receiver channels in a hexagonal focal plane arrangement on a 10.4 m antenna, and an instantaneous 26-34 GHz frequency range with 2 MHz resolution, it is ideally suited to measuring CO($J$=1-0) from $z\sim3$. In this paper we discuss strategies for designing and building the Pathfinder and the challenges that were encountered. The design of the instrument prioritized LIM requirements over those of ancillary science. After a couple of years of operation, the instrument is well understood, and the first year of data is already yielding useful science results. Experience with this Pathfinder will drive the design of the next generations of experiments.


title: COMAP Early Science: III. CO Data Processing

abstract: We describe the first season COMAP analysis pipeline that converts raw detector readouts to calibrated sky maps. This pipeline implements four main steps: gain calibration, filtering, data selection, and map-making. Absolute gain calibration relies on a combination of instrumental and astrophysical sources, while relative gain calibration exploits real-time total-power variations. High efficiency filtering is achieved through spectroscopic common-mode rejection within and across receivers, resulting in nearly uncorrelated white noise within single-frequency channels. Consequently, near-optimal but biased maps are produced by binning the filtered time stream into pixelized maps; the corresponding signal bias transfer function is estimated through simulations. Data selection is performed automatically through a series of goodness-of-fit statistics, including $\chi^2$ and multi-scale correlation tests. Applying this pipeline to the first-season COMAP data, we produce a dataset with very low levels of correlated noise. We find that one of our two scanning strategies (the Lissajous type) is sensitive to residual instrumental systematics. As a result, we no longer use this type of scan and exclude data taken this way from our Season 1 power spectrum estimates. We perform a careful analysis of our data processing and observing efficiencies and take account of planned improvements to estimate our future performance. Power spectrum results derived from the first-season COMAP maps are presented and discussed in companion papers.


title: COMAP Early Science: IV. Power Spectrum Methodology and Results

abstract: We present the power spectrum methodology used for the first-season COMAP analysis, and assess the quality of the current data set. The main results are derived through the Feed-feed Pseudo-Cross-Spectrum (FPXS) method, which is a robust estimator with respect to both noise modeling errors and experimental systematics. We use effective transfer functions to take into account the effects of instrumental beam smoothing and various filter operations applied during the low-level data processing. The power spectra estimated in this way have allowed us to identify a systematic error associated with one of our two scanning strategies, believed to be due to residual ground or atmospheric contamination. We omit these data from our analysis and no longer use this scanning technique for observations. We present the power spectra from our first season of observing and demonstrate that the uncertainties are integrating as expected for uncorrelated noise, with any residual systematics suppressed to a level below the noise. Using the FPXS method, and combining data on scales $k=0.051-0.62 \,\mathrm{Mpc}^{-1}$ we estimate $P_\mathrm{CO}(k) = -2.7 \pm 1.7 \times 10^4\mu\textrm{K}^2\mathrm{Mpc}^3$, the first direct 3D constraint on the clustering component of the CO(1-0) power spectrum in the literature.


title: COMAP Early Science: V. Constraints and Forecasts at $z \sim 3$

abstract: We present the current state of models for the $z\sim3$ carbon monoxide (CO) line-intensity signal targeted by the CO Mapping Array Project (COMAP) Pathfinder in the context of its early science results. Our fiducial model, relating dark matter halo properties to CO luminosities, informs parameter priors with empirical models of the galaxy-halo connection and previous CO(1-0) observations. The Pathfinder early science data spanning wavenumbers $k=0.051$-$0.62\,$Mpc$^{-1}$ represent the first direct 3D constraint on the clustering component of the CO(1-0) power spectrum. Our 95% upper limit on the redshift-space clustering amplitude $A_{\rm clust}\lesssim70\,\mu$K$^2$ greatly improves on the indirect upper limit of $420\,\mu$K$^2$ reported from the CO Power Spectrum Survey (COPSS) measurement at $k\sim1\,$Mpc$^{-1}$. The COMAP limit excludes a subset of models from previous literature, and constrains interpretation of the COPSS results, demonstrating the complementary nature of COMAP and interferometric CO surveys. Using line bias expectations from our priors, we also constrain the squared mean line intensity-bias product, $\langle{Tb}\rangle^2\lesssim50\,\mu$K$^2$, and the cosmic molecular gas density, $\rho_\text{H2}<2.5\times10^8\,M_\odot\,$Mpc$^{-3}$ (95% upper limits). Based on early instrument performance and our current CO signal estimates, we forecast that the five-year Pathfinder campaign will detect the CO power spectrum with overall signal-to-noise of 9-17. Between then and now, we also expect to detect the CO-galaxy cross-spectrum using overlapping galaxy survey data, enabling enhanced inferences of cosmic star-formation and galaxy-evolution history.


title: COMAP Early Science: VI. A First Look at the COMAP Galactic Plane Survey

abstract: We present early results from the COMAP Galactic Plane Survey conducted between June 2019 and April 2021, spanning $20^\circ<\ell<40^\circ$ in Galactic longitude and $|b|<1.\!\!^{\circ}5$ in Galactic latitude with an angular resolution of $4.5^{\prime}$. The full survey will span $\ell \sim 20^{\circ}$- $220^{\circ}$ and will be the first large-scale radio continuum survey at $30$ GHz with sub-degree resolution. We present initial results from the first part of the survey, including diffuse emission and spectral energy distributions (SEDs) of HII regions and supernova remnants. Using low and high frequency surveys to constrain free-free and thermal dust emission contributions, we find evidence of excess flux density at $30\,$GHz in six regions that we interpret as anomalous microwave emission. Furthermore we model UCHII contributions using data from the $5\,$GHz CORNISH catalogue and reject this as the cause of the $30\,$GHz excess. Six known supernova remnants (SNR) are detected at $30\,$GHz, and we measure spectral indices consistent with the literature or show evidence of steepening. The flux density of the SNR W44 at $30\,$GHz is consistent with a power-law extrapolation from lower frequencies with no indication of spectral steepening in contrast with recent results from the Sardinia Radio Telescope. We also extract five hydrogen radio recombination lines to map the warm ionized gas, which can be used to estimate electron temperatures or to constrain continuum free-free emission. The full COMAP Galactic plane survey, to be released in 2023/2024, will be an invaluable resource for Galactic astrophysics.


title: COMAP Early Science: VII. Prospects for CO Intensity Mapping at Reionization

abstract: We introduce COMAP-EoR, the next generation of the Carbon Monoxide Mapping Array Project aimed at extending CO intensity mapping to the Epoch of Reionization. COMAP-EoR supplements the existing 30 GHz COMAP Pathfinder with two additional 30 GHz instruments and a new 16 GHz receiver. This combination of frequencies will be able to simultaneously map CO(1--0) and CO(2--1) at reionization redshifts ($z\sim5-8$) in addition to providing a significant boost to the $z\sim3$ sensitivity of the Pathfinder. We examine a set of existing models of the EoR CO signal, and find power spectra spanning several orders of magnitude, highlighting our extreme ignorance about this period of cosmic history and the value of the COMAP-EoR measurement. We carry out the most detailed forecast to date of an intensity mapping cross-correlation, and find that five out of the six models we consider yield signal to noise ratios (S/N) $\gtrsim20$ for COMAP-EoR, with the brightest reaching a S/N above 400. We show that, for these models, COMAP-EoR can make a detailed measurement of the cosmic molecular gas history from $z\sim2-8$, as well as probe the population of faint, star-forming galaxies predicted by these models to be undetectable by traditional surveys. We show that, for the single model that does not predict numerous faint emitters, a COMAP-EoR-type measurement is required to rule out their existence. We briefly explore prospects for a third-generation Expanded Reionization Array (COMAP-ERA) capable of detecting the faintest models and characterizing the brightest signals in extreme detail.


title: A soft thumb-sized vision-based sensor with accurate all-round force perception

abstract: Vision-based haptic sensors have emerged as a promising approach to robotic touch due to affordable high-resolution cameras and successful computer-vision techniques. However, their physical design and the information they provide do not yet meet the requirements of real applications. We present a robust, soft, low-cost, vision-based, thumb-sized 3D haptic sensor named Insight: it continually provides a directional force-distribution map over its entire conical sensing surface. Constructed around an internal monocular camera, the sensor has only a single layer of elastomer over-molded on a stiff frame to guarantee sensitivity, robustness, and soft contact. Furthermore, Insight is the first system to combine photometric stereo and structured light using a collimator to detect the 3D deformation of its easily replaceable flexible outer shell. The force information is inferred by a deep neural network that maps images to the spatial distribution of 3D contact force (normal and shear). Insight has an overall spatial resolution of 0.4 mm, force magnitude accuracy around 0.03 N, and force direction accuracy around 5 degrees over a range of 0.03--2 N for numerous distinct contacts with varying contact area. The presented hardware and software design concepts can be transferred to a wide variety of robot parts.


title: A Meta-Method for Portfolio Management Using Machine Learning for Adaptive Strategy Selection

abstract: This work proposes a novel portfolio management technique, the Meta Portfolio Method (MPM), inspired by the successes of meta approaches in the field of bioinformatics and elsewhere. The MPM uses XGBoost to learn how to switch between two risk-based portfolio allocation strategies, the Hierarchical Risk Parity (HRP) and more classical Na\"ive Risk Parity (NRP). It is demonstrated that the MPM is able to successfully take advantage of the best characteristics of each strategy (the NRP's fast growth during market uptrends, and the HRP's protection against drawdowns during market turmoil). As a result, the MPM is shown to possess an excellent out-of-sample risk-reward profile, as measured by the Sharpe ratio, and in addition offers a high degree of interpretability of its asset allocation decisions.


title: SPA-GCN: Efficient and Flexible GCN Accelerator with an Application for Graph Similarity Computation

abstract: While there have been many studies on hardware acceleration for deep learning on images, there has been a rather limited focus on accelerating deep learning applications involving graphs. The unique characteristics of graphs, such as the irregular memory access and dynamic parallelism, impose several challenges when the algorithm is mapped to a CPU or GPU. To address these challenges while exploiting all the available sparsity, we propose a flexible architecture called SPA-GCN for accelerating Graph Convolutional Networks (GCN), the core computation unit in deep learning algorithms on graphs. The architecture is specialized for dealing with many small graphs since the graph size has a significant impact on design considerations. In this context, we use SimGNN, a neural-network-based graph matching algorithm, as a case study to demonstrate the effectiveness of our architecture. The experimental results demonstrate that SPA-GCN can deliver a high speedup compared to a multi-core CPU implementation and a GPU implementation, showing the efficiency of our design.


title: Recent Advances in Automated Question Answering In Biomedical Domain

abstract: The objective of automated Question Answering (QA) systems is to provide answers to user queries in a time efficient manner. The answers are usually found in either databases (or knowledge bases) or a collection of documents commonly referred to as the corpus. In the past few decades there has been a proliferation of acquisition of knowledge and consequently there has been an exponential growth in new scientific articles in the field of biomedicine. Therefore, it has become difficult to keep track of all the information in the domain, even for domain experts. With the improvements in commercial search engines, users can type in their queries and get a small set of documents most relevant for answering their query, as well as relevant snippets from the documents in some cases. However, it may be still tedious and time consuming to manually look for the required information or answers. This has necessitated the development of efficient QA systems which aim to find exact and precise answers to user provided natural language questions in the domain of biomedicine. In this paper, we introduce the basic methodologies used for developing general domain QA systems, followed by a thorough investigation of different aspects of biomedical QA systems, including benchmark datasets and several proposed approaches, both using structured databases and collection of texts. We also explore the limitations of current systems and explore potential avenues for further advancement.


title: Single Shot i-Toffoli Gate in Dispersively Coupled Superconducting Qubits

abstract: Quantum algorithms often benefit from the ability to execute multi-qubit (>2) gates. To date such multi-qubit gates are typically decomposed into single- and two-qubit gates, particularly in superconducting qubit architectures. The ability to perform multi-qubit operations in a single step could vastly improve the fidelity and execution time of many algorithms. Here, we propose a single shot method for executing an i-Toffoli gate, a three-qubit gate gate with two control and one target qubit, using currently existing superconducting hardware. We show numerical evidence for a process fidelity over 98% and a gate time of 500 ns for superconducting qubits interacting via tunable couplers. Our method can straight forwardly be extended to implement gates with more than two control qubits at similar fidelities.


title: A study on Channel Popularity in Twitch

abstract: In the past few decades, there has been an increasing need for Internet users to host real time events online and to share their experiences with live, interactive audiences. Online streaming services like Twitch have attracted millions of users to stream and to spectate. There have been few studies about the prediction of streamers' popularity on Twitch. In this paper, we look at potential factors that can contribute to the popularity of streamers. Streamer data was collected through consistent tracking using Twitch's API during a 4 weeks period. Each user's streaming information such as the number of current viewers and followers, the genre of the stream etc., were collected. From the results, we found that the frequency of streaming sessions, the types of content and the length of the streams are major factors in determining how much viewers and subscribers streamers can gain during sessions.


title: A Novel Corpus of Discourse Structure in Humans and Computers

abstract: We present a novel corpus of 445 human- and computer-generated documents, comprising about 27,000 clauses, annotated for semantic clause types and coherence relations that allow for nuanced comparison of artificial and natural discourse modes. The corpus covers both formal and informal discourse, and contains documents generated using fine-tuned GPT-2 (Zellers et al., 2019) and GPT-3(Brown et al., 2020). We showcase the usefulness of this corpus for detailed discourse analysis of text generation by providing preliminary evidence that less numerous, shorter and more often incoherent clause relations are associated with lower perceived quality of computer-generated narratives and arguments.


title: Generalizable Cross-Graph Embedding for GNN-based Congestion Prediction

abstract: Presently with technology node scaling, an accurate prediction model at early design stages can significantly reduce the design cycle. Especially during logic synthesis, predicting cell congestion due to improper logic combination can reduce the burden of subsequent physical implementations. There have been attempts using Graph Neural Network (GNN) techniques to tackle congestion prediction during the logic synthesis stage. However, they require informative cell features to achieve reasonable performance since the core idea of GNNs is built on the message passing framework, which would be impractical at the early logic synthesis stage. To address this limitation, we propose a framework that can directly learn embeddings for the given netlist to enhance the quality of our node features. Popular random-walk based embedding methods such as Node2vec, LINE, and DeepWalk suffer from the issue of cross-graph alignment and poor generalization to unseen netlist graphs, yielding inferior performance and costing significant runtime. In our framework, we introduce a superior alternative to obtain node embeddings that can generalize across netlist graphs using matrix factorization methods. We propose an efficient mini-batch training method at the sub-graph level that can guarantee parallel training and satisfy the memory restriction for large-scale netlists. We present results utilizing open-source EDA tools such as DREAMPLACE and OPENROAD frameworks on a variety of openly available circuits. By combining the learned embedding on top of the netlist with the GNNs, our method improves prediction performance, generalizes to new circuit lines, and is efficient in training, potentially saving over $90 \%$ of runtime.


title: BiPoS1 -- a computer programme for the dynamical processing of the initial binary star population

abstract: The first version of the Binary Population Synthesizer (BiPoS1) is made publicly available. It allows to efficiently calculate binary distribution functions after the dynamical processing of a realistic population of binary stars during the first few Myr in the hosting embedded star cluster. Instead of time-consuming N-body simulations, BiPoS1 uses a stellar dynamical operator which determines the fraction of surviving binaries depending on the binding energy of the binaries. The stellar dynamical operator depends on the initial star cluster density as well as the time until the residual gas of the star cluster is expelled. BiPoS1 has also a galactic-field mode, in order to synthesize the stellar population of a whole galaxy. At the time of gas expulsion, the dynamical processing of the binary population is assumed to efficiently end due to the subsequent expansion of the star cluster. While BiPoS1 $has been used previously unpublished, here we demonstrate its use in the modelling of the binary populations in the Orion Nebula Cluster, in OB associations and as an input for simulations of globular clusters.


title: Self-Supervised Multi-Object Tracking with Cross-Input Consistency

abstract: In this paper, we propose a self-supervised learning procedure for training a robust multi-object tracking (MOT) model given only unlabeled video. While several self-supervisory learning signals have been proposed in prior work on single-object tracking, such as color propagation and cycle-consistency, these signals cannot be directly applied for training RNN models, which are needed to achieve accurate MOT: they yield degenerate models that, for instance, always match new detections to tracks with the closest initial detections. We propose a novel self-supervisory signal that we call cross-input consistency: we construct two distinct inputs for the same sequence of video, by hiding different information about the sequence in each input. We then compute tracks in that sequence by applying an RNN model independently on each input, and train the model to produce consistent tracks across the two inputs. We evaluate our unsupervised method on MOT17 and KITTI -- remarkably, we find that, despite training only on unlabeled video, our unsupervised approach outperforms four supervised methods published in the last 1--2 years, including Tracktor++, FAMNet, GSM, and mmMOT.


title: Multi-Objective Optimization for Value-Sensitive and Sustainable Basket Recommendations

abstract: Sustainable consumption aims to minimize the environmental and societal impact of the use of services and products. Over-consumption of services and products leads to potential natural resource exhaustion and societal inequalities as access to goods and services becomes more challenging. In everyday life, a person can simply achieve more sustainable purchases by drastically changing their lifestyle choices and potentially going against their personal values or wishes. Conversely, achieving sustainable consumption while accounting for personal values is a more complex task as potential trade-offs arise when trying to satisfy environmental and personal goals. This article focuses on value-sensitive design of recommender systems, which enable consumers to improve the sustainability of their purchases while respecting personal and societal values. Value-sensitive recommendations for sustainable consumption are formalized as a multi-objective optimization problem, where each objective represents different sustainability goals and personal values. Novel and existing multi-objective algorithms calculate solutions to this problem. The solutions are proposed as personalized sustainable basket recommendations to consumers. These recommendations are evaluated on a synthetic dataset, which comprises three established real-world datasets from relevant scientific and organizational reports. The synthetic dataset contains quantitative data on product prices, nutritional values, and environmental impact metrics, such as greenhouse gas emissions and water footprint. The recommended baskets are highly similar to consumer purchased baskets and aligned with both sustainability goals and personal values relevant to health, expenditure, and taste. Even when consumers would accept only a fraction of recommendations, a considerable reduction of environmental impact is observed.


title: Convergence of the Weighted Yamabe Flow

abstract: We introduce the weighted Yamabe flow $\frac{\partial g}{\partial t}=(r^m_{\phi}-R^m_{\phi})g$, $\frac{\partial \phi}{\partial t}=\frac{m}{2}(R^m_{\phi}-r^m_{\phi})$ on a smooth metric measure space $(M^n, g, e^{-\phi}{\rm dvol}_g, m)$, where $R^m_{\phi}$ denotes the associated weighted scalar curvature, and $r^m_{\phi}$ denotes the mean value of the weighted scalar curvature. We prove long-time existence and convergence of the weighted Yamabe flow if the dimension $n$ satisfies $n\geqslant 3$.


title: Hot-Band Absorption Can Mimic Entangled Two-Photon Absorption

abstract: It has been proposed that entangled two-photon absorption (E2PA) can be observed with up to 10 orders of magnitude lower photon flux than its classical counterpart. However, there is a significant controversy regarding the magnitude of this quantum enhancement in excitation efficiency. We investigated the fluorescence signals from Rhodamine 6G and LDS798 excited with a CW laser or an entangled photon pair source at 1060 nm. We observed a signal that originates from hot-band absorption (HBA), which is one-photon absorption from thermally-populated vibrational levels of the ground electronic state. This mechanism, which has not been previously discussed in the context of E2PA, produces a signal with a linear power dependence, as would be expected for entangled two-photon excited fluorescence (E2PEF). For the typical conditions under which E2PEF measurements are performed, contributions from the HBA process could lead to a several orders-of-magnitude overestimate of the quantum advantage for excitation efficiency.


title: Privacy signaling games with binary alphabets

abstract: In this paper, we consider a privacy signaling game problem for binary alphabets and single-bit transmission where a transmitter has a pair of messages, one of which is a casual message that needs to be conveyed, whereas the other message contains sensitive data and needs to be protected. The receiver wishes to estimate both messages to acquire as much information as possible. For this setup, we study the interactions between the transmitter and the receiver with non-aligned information-theoretic objectives (modeled by mutual information and hamming distance) due to the privacy concerns of the transmitter. We derive conditions under which Nash and/or Stackelberg equilibria exist and identify the optimal responses of the encoder and decoders strategies for each type of game. One particularly surprising result is that when both types of equilibria exist, they admit the same encoding and decoding strategies. We corroborate our analysis with simulation studies.


title: Scaling ASR Improves Zero and Few Shot Learning

abstract: With 4.5 million hours of English speech from 10 different sources across 120 countries and models of up to 10 billion parameters, we explore the frontiers of scale for automatic speech recognition. We propose data selection techniques to efficiently scale training data to find the most valuable samples in massive datasets. To efficiently scale model sizes, we leverage various optimizations such as sparse transducer loss and model sharding. By training 1-10B parameter universal English ASR models, we push the limits of speech recognition performance across many domains. Furthermore, our models learn powerful speech representations with zero and few-shot capabilities on novel domains and styles of speech, exceeding previous results across multiple in-house and public benchmarks. For speakers with disorders due to brain damage, our best zero-shot and few-shot models achieve 22% and 60% relative improvement on the AphasiaBank test set, respectively, while realizing the best performance on public social media videos. Furthermore, the same universal model reaches equivalent performance with 500x less in-domain data on the SPGISpeech financial-domain dataset.


title: How to See Hidden Patterns in Metamaterials with Interpretable Machine Learning

abstract: Machine learning models can assist with metamaterials design by approximating computationally expensive simulators or solving inverse design problems. However, past work has usually relied on black box deep neural networks, whose reasoning processes are opaque and require enormous datasets that are expensive to obtain. In this work, we develop two novel machine learning approaches to metamaterials discovery that have neither of these disadvantages. These approaches, called shape-frequency features and unit-cell templates, can discover 2D metamaterials with user-specified frequency band gaps. Our approaches provide logical rule-based conditions on metamaterial unit-cells that allow for interpretable reasoning processes, and generalize well across design spaces of different resolutions. The templates also provide design flexibility where users can almost freely design the fine resolution features of a unit-cell without affecting the user's desired band gap.


title: Self-Compression in Bayesian Neural Networks

abstract: Machine learning models have achieved human-level performance on various tasks. This success comes at a high cost of computation and storage overhead, which makes machine learning algorithms difficult to deploy on edge devices. Typically, one has to partially sacrifice accuracy in favor of an increased performance quantified in terms of reduced memory usage and energy consumption. Current methods compress the networks by reducing the precision of the parameters or by eliminating redundant ones. In this paper, we propose a new insight into network compression through the Bayesian framework. We show that Bayesian neural networks automatically discover redundancy in model parameters, thus enabling self-compression, which is linked to the propagation of uncertainty through the layers of the network. Our experimental results show that the network architecture can be successfully compressed by deleting parameters identified by the network itself while retaining the same level of accuracy.


title: Finite volume and magnetic field effects on the two-pion correlation function in relativistic heavy-ion collisions

abstract: We study the combined effects of a finite volume and an external magnetic field on the charged two-pion correlation function. For these purposes, we consider a dilute system of pions where the finite volume effects are introduced computing the pion wave functions with rigid boundary conditions in a cylindrical geometry in the presence of a uniform and constant magnetic field. We find that for slow pions, namely, for the case where the average pair momentum is small, the correlation function shows a large distortion, as opposed to the case where the average pair momentum is large. For a finite density system, the intercept of the correlation function is reduced, signaling the increasing importance of the pion ground state contribution. An increasing strength of the magnetic field reduces the importance of the ground state and the intercept becomes closer to 2.


title: Mixtures of self-propelled particles interacting with asymmetric obstacles

abstract: In the presence of an obstacle, active particles condensate into a surface "wetting" layer due to persistent motion. If the obstacle is asymmetric, a rectification current arises in addition to wetting. Asymmetric geometries are therefore commonly used to concentrate microorganisms like bacteria and sperms. However, most studies neglect the fact that biological active matter is diverse, composed of individuals with distinct self-propulsions. Using simulations, we study a mixture of "fast" and "slow" active Brownian disks in two dimensions interacting with large half-disk obstacles. With this prototypical obstacle geometry, we analyze how the stationary collective behavior depends on the degree of self-propulsion "diversity", defined as proportional to the difference between the self-propulsion speeds, while keeping the average self-propulsion speed fixed. A wetting layer rich in fast particles arises. The rectification current is amplified by speed diversity due to a superlinear dependence of rectification on self-propulsion speed, which arises from cooperative effects. Thus, the total rectification current cannot be obtained from an effective one-component active fluid with the same average self-propulsion speed, highlighting the importance of considering diversity in active matter. Finally, rectification alters particle evaporation and absorption by the layer, making the density of the dilute phase increase with the global density. Therefore, the steady state violates the lever rule, a result which is valid even for systems of identical particles.


title: Robust Learning via Ensemble Density Propagation in Deep Neural Networks

abstract: Learning in uncertain, noisy, or adversarial environments is a challenging task for deep neural networks (DNNs). We propose a new theoretically grounded and efficient approach for robust learning that builds upon Bayesian estimation and Variational Inference. We formulate the problem of density propagation through layers of a DNN and solve it using an Ensemble Density Propagation (EnDP) scheme. The EnDP approach allows us to propagate moments of the variational probability distribution across the layers of a Bayesian DNN, enabling the estimation of the mean and covariance of the predictive distribution at the output of the model. Our experiments using MNIST and CIFAR-10 datasets show a significant improvement in the robustness of the trained models to random noise and adversarial attacks.


title: Fixed-Point Few-Body Hamiltonians in Quantum Mechanics

abstract: We revisited how Weinberg's ideas in Nuclear Physics influenced our own work and lead to a renormalization group invariant framework within the quantum mechanical few-body problem, and we also update the discussion on the relevant scales in the limit of short-range interactions. In this context, it is revised the formulation of the subtracted scattering equations and fixed-point Hamiltonians applied to few-body systems, in which the original interaction contains point-like singularities, such as Dirac-delta and/or its derivatives. The approach is being illustrated by considering two-nucleons described by singular interactions. This revision also includes an extension of the renormalization formalism to three-body systems, which is followed by an updated discussion on the applications to four particles.


title: Keys to Accurate Feature Extraction Using Residual Spiking Neural Networks

abstract: Spiking neural networks (SNNs) have become an interesting alternative to conventional artificial neural networks (ANN) thanks to their temporal processing capabilities and energy efficient implementations in neuromorphic hardware. However the challenges involved in training SNNs have limited their performance in terms of accuracy and thus their applications. Improving learning algorithms and neural architectures for a more accurate feature extraction is therefore one of the current priorities in SNN research. In this paper we present a study on the key components of modern spiking architectures. We design a spiking version of the successful residual network architecture and provide an in-depth study on the possible implementations of spiking residual connections. This study shows how, depending on the use case, the optimal residual connection implementation may vary. Additionally, we empirically compare different techniques in image classification datasets taken from the best performing networks. Our results provide a state of the art guide to SNN design, which allows to make informed choices when trying to build the optimal visual feature extractor. Finally, our network outperforms previous SNN architectures in CIFAR-10 (94.14%) and CIFAR-100 (74.65%) datasets and matches the state of the art in DVS-CIFAR10 (72.98%), with less parameters than the previous state of the art and without the need for ANN-SNN conversion. Code available at https://github.com/VicenteAlex/Spiking_ResNet


title: Feature Generation for Long-tail Classification

abstract: The visual world naturally exhibits an imbalance in the number of object or scene instances resulting in a \emph{long-tailed distribution}. This imbalance poses significant challenges for classification models based on deep learning. Oversampling instances of the tail classes attempts to solve this imbalance. However, the limited visual diversity results in a network with poor representation ability. A simple counter to this is decoupling the representation and classifier networks and using oversampling only to train the classifier. In this paper, instead of repeatedly re-sampling the same image (and thereby features), we explore a direction that attempts to generate meaningful features by estimating the tail category's distribution. Inspired by ideas from recent work on few-shot learning, we create calibrated distributions to sample additional features that are subsequently used to train the classifier. Through several experiments on the CIFAR-100-LT (long-tail) dataset with varying imbalance factors and on mini-ImageNet-LT (long-tail), we show the efficacy of our approach and establish a new state-of-the-art. We also present a qualitative analysis of generated features using t-SNE visualizations and analyze the nearest neighbors used to calibrate the tail class distributions. Our code is available at https://github.com/rahulvigneswaran/TailCalibX.


title: Why the first magic-angle is different from others in twisted graphene bilayers: interlayer currents, kinetic and confinement energy and wavefunction localization

abstract: The chiral Hamiltonian for twisted graphene bilayers is analyzed in terms of its squared Hamiltonian which removes the particle-hole symmetry and thus one bipartite lattice, allowing to write the Hamiltonian in terms of a $2\times 2$ matrix. This brings to the front the three main physical actors of twisted systems: kinetic energy, confinement potential and an interlayer interaction operator which is divided in two parts: a non-Abelian interlayer operator and an operator which contains an interaction energy between layers. Here, each of these components is analyzed as a function of the angle of rotation, as well as in terms of the wave-function localization properties. In particular, it is proved that the non-Abelian operator represents interlayer currents between each layer triangular sublattices, i.e., a second-neighbor interlayer current between bipartite sublattices. A crossover is seen between such contributions and thus the first magic angle is different from other higher order magic angles. Such angles are determined by a balance between the negative energy contribution from interlayer currents and the positive contributions from the kinetic and confinement energies. A perturbative analysis performed around the first magic angle allows to explore analytically the details of such energy balance.


title: Social Distancing, Gathering, Search Games: Mobile Agents on Simple Networks

abstract: During epidemics, the population is asked to Socially Distance, with pairs of individuals keeping two meters apart. We model this as a new optimization problem by considering a team of agents placed on the nodes of a network. Their common aim is to achieve pairwise graph distances of at least D, a state we call socially distanced. (If D=1, they want to be at distinct nodes; if D=2 they want to be non-adjacent.) We allow only a simple type of motion called a Lazy Random Walk: with probability p (called the laziness parameter), they remain at their current node next period; with complementary probability 1-p , they move to a random adjacent node. The team seeks the common value of p which achieves social distance in the least expected time, which is the absorption time of a Markov chain. We observe that the same Markov chain, with different goals (absorbing states), models the gathering, or multi-rendezvous problem (all agents at the same node). Allowing distinct laziness for two types of agents (searchers and hider), extends the existing literature on predator-prey search games to multiple searchers. We consider only special networks: line, cycle and grid. Keywords: epidemic, random walk, dispersion, rendezvous search


title: Advancing Brain Metastases Detection in T1-Weighted Contrast-Enhanced 3D MRI using Noisy Student-based Training

abstract: The detection of brain metastases (BM) in their early stages could have a positive impact on the outcome of cancer patients. We previously developed a framework for detecting small BM (with diameters of less than 15mm) in T1-weighted Contrast-Enhanced 3D Magnetic Resonance images (T1c) to assist medical experts in this time-sensitive and high-stakes task. The framework utilizes a dedicated convolutional neural network (CNN) trained using labeled T1c data, where the ground truth BM segmentations were provided by a radiologist. This study aims to advance the framework with a noisy student-based self-training strategy to make use of a large corpus of unlabeled T1c data (i.e., data without BM segmentations or detections). Accordingly, the work (1) describes the student and teacher CNN architectures, (2) presents data and model noising mechanisms, and (3) introduces a novel pseudo-labeling strategy factoring in the learned BM detection sensitivity of the framework. Finally, it describes a semi-supervised learning strategy utilizing these components. We performed the validation using 217 labeled and 1247 unlabeled T1c exams via 2-fold cross-validation. The framework utilizing only the labeled exams produced 9.23 false positives for 90% BM detection sensitivity; whereas, the framework using the introduced learning strategy led to ~9% reduction in false detections (i.e., 8.44) for the same sensitivity level. Furthermore, while experiments utilizing 75% and 50% of the labeled datasets resulted in algorithm performance degradation (12.19 and 13.89 false positives respectively), the impact was less pronounced with the noisy student-based training strategy (10.79 and 12.37 false positives respectively).


title: Grand-potential-based phase-field model of dissolution/precipitation: lattice Boltzmann simulations of counter term effect on porous medium

abstract: Most of the lattice Boltzmann methods simulate an approximation of the sharp interface problem of dissolution and precipitation. In such studies the curvature-driven motion of interface is neglected in the Gibbs-Thomson condition. In order to simulate those phenomena with or without curvature-driven motion, we propose a phase-field model which is derived from a thermodynamic functional of grand-potential. Compared to the free energy, the main advantage of the grand-potential is to provide a theoretical framework which is consistent with the equilibrium properties such as the equality of chemical potentials. The model is composed of one equation for the phase-field {\phi} coupled with one equation for the chemical potential {\mu}. In the phase-field method, the curvature-driven motion is always contained in the phase-field equation. For canceling it, a counter term must be added in the {\phi}-equation. For reason of mass conservation, the {\mu}-equation is written with a mixed formulation which involves the composition c and the chemical potential. The closure relationship between c and {\mu} is derived by assuming quadratic free energies of bulk phases. The anti-trapping current is also considered in the composition equation for simulations with null solid diffusion. The lattice Boltzmann schemes are implemented in LBM_saclay, a numerical code running on various High Performance Computing architectures. Validations are carried out with analytical solutions representative of dissolution and precipitation. Simulations with or without counter term are compared on the shape of porous medium characterized by microtomography. The computations have run on a single GPU-V100.

categories: cs.CE cond-mat.mtrl-sci nlin.CG physics.comp-ph


title: Rectangular, Range, and Restricted AONTs: Three Generalizations of All-or-Nothing Transforms

abstract: All-or-nothing transforms (AONTs) were originally defined by Rivest as bijections from $s$ input blocks to $s$ output blocks such that no information can be obtained about any input block in the absence of any output block. Numerous generalizations and extensions of all-or-nothing transforms have been discussed in recent years, many of which are motivated by diverse applications in cryptography, information security, secure distributed storage, etc. In particular, $t$-AONTs, in which no information can be obtained about any $t$ input blocks in the absence of any $t$ output blocks, have received considerable study. In this paper, we study three generalizations of AONTs that are motivated by applications due to Pham et al. and Oliveira et al. We term these generalizations rectangular, range, and restricted AONTs. Briefly, in a rectangular AONT, the number of outputs is greater than the number of inputs. A range AONT satisfies the $t$-AONT property for a range of consecutive values of $t$. Finally, in a restricted AONT, the unknown outputs are assumed to occur within a specified set of "secure" output blocks. We study existence and non-existence and provide examples and constructions for these generalizations. We also demonstrate interesting connections with combinatorial structures such as orthogonal arrays, split orthogonal arrays, MDS codes and difference matrices.


title: Adversarial sampling of unknown and high-dimensional conditional distributions

abstract: Many engineering problems require the prediction of realization-to-realization variability or a refined description of modeled quantities. In that case, it is necessary to sample elements from unknown high-dimensional spaces with possibly millions of degrees of freedom. While there exist methods able to sample elements from probability density functions (PDF) with known shapes, several approximations need to be made when the distribution is unknown. In this paper the sampling method, as well as the inference of the underlying distribution, are both handled with a data-driven method known as generative adversarial networks (GAN), which trains two competing neural networks to produce a network that can effectively generate samples from the training set distribution. In practice, it is often necessary to draw samples from conditional distributions. When the conditional variables are continuous, only one (if any) data point corresponding to a particular value of a conditioning variable may be available, which is not sufficient to estimate the conditional distribution. This work handles this problem using an a priori estimation of the conditional moments of a PDF. Two approaches, stochastic estimation, and an external neural network are compared here for computing these moments; however, any preferred method can be used. The algorithm is demonstrated in the case of the deconvolution of a filtered turbulent flow field. It is shown that all the versions of the proposed algorithm effectively sample the target conditional distribution with minimal impact on the quality of the samples compared to state-of-the-art methods. Additionally, the procedure can be used as a metric for the diversity of samples generated by a conditional GAN (cGAN) conditioned with continuous variables.

categories: stat.ML cs.LG physics.ao-ph physics.comp-ph physics.flu-dyn


title: Gravitational lensing of Continuous Gravitational Waves

abstract: Continuous gravitational waves are analogous to monochromatic light and therefore could be used to detect wave effects like interference or diffraction. This would be possible with strongly lensed gravitational waves. This article reviews and summaries the theory of gravitational lensing in the context of gravitational waves in two different regimes: geometric optics and wave optics, for two widely used lens models such as point mass lens and Singular Isothermal Sphere (SIS). Observable effects due to wave nature of gravitational waves are discussed. As a consequence of interference GWs produce beat patterns which might be observable with the next generation detectors like ground based Einstein Telescope, Cosmic Explorer or space-borne LISA, DECIGO. This will provide us a opportunity to estimate the properties of lensing system and other cosmological parameters with alternative techniques. Diffractive microlensing could become a valuable method to search for intermediate mass black holes formed in the centers of globular clusters. We also point to an interesting idea of detecting the Poisson-Arago spot proposed in the literature.


title: Spatial epidemiology and adaptive targeted sampling to manage the Chagas disease vector Triatoma dimidiata

abstract: Widespread application of insecticide remains the primary form of control for Chagas disease in Central America, despite only temporarily reducing domestic levels of the endemic vector Triatoma dimidiata and having little long-term impact. Recently, an approach emphasizing community feedback and housing improvements has been shown to yield lasting results. However, the additional resources and personnel required by such an intervention likely hinders its widespread adoption. One solution to this problem would be to target only a subset of houses in a community while still eliminating enough infestations to interrupt disease transfer. Here we develop a sequential sampling framework that adapts to information specific to a community as more houses are visited, thereby allowing us to efficiently find homes with domiciliary vectors while minimizing sampling bias. The method fits Bayesian geostatistical models to make spatially informed predictions, while gradually transitioning from prioritizing houses based on prediction uncertainty to targeting houses with a high risk of infestation. A key feature of the method is the use of a single exploration parameter, $\alpha$, to control the rate of transition between these two design targets. In a simulation study using empirical data from five villages in southeastern Guatemala, we test our method using a range of values for $\alpha$, and find it can consistently select fewer homes than random sampling, while still bringing the village infestation rate below a given threshold. We further find that when additional socioeconomic information is available, much larger savings are possible, but that meeting the target infestation rate is less consistent, particularly among the less exploratory strategies. Our results suggest new options for implementing long-term T. dimidiata control.


title: C\'alculo de propiedades \'opticas de metamateriales

abstract: We present an introduction to metamaterials, some of their optical prop-erties, and examples of their uses. We develop an efficient theory for thecalculation of the macroscopic permittivity of binary systems and systemswith more components, in the non-retarded case and in the general case, andwe present its implementation in a computational package and illustrate itsuse. We discuss some applications regarding the design of optimized nanos-tructured optical devices and we discuss the linear and non-linear properties obtained. Presentamos una introducci\'on a los metamateriales, algunas de sus pro-piedades \'opticas y ejemplos de sus usos. Desarrollamos una teor\'ia eficientepara el c\'alculo de su permitividad macrosc\'opica en sistemas binarios o conm\'as componentes, en el caso no retardado y en el caso general, y presenta-mos su implementaci\'on en un paquete computacional y su uso. Finalizamosdiscutiendo algunas aplicaciones del mismo para el dise\~no de dispositivos \'opti-cos nanoestructurados optimizados y discutimos las propiedades lineales y nolineales obtenidas.


title: Accurate confidence interval estimation for non-centrality parameters and effect size indices

abstract: We recently proposed a robust effect size index (RESI) that is related to the non-centrality parameter of a test statistic. RESI is advantageous over common indices because (1) it is widely applicable to many types of data; (2) it can rely on a robust covariance estimate; (3) it can accommodate the existence of nuisance parameters. We provided a consistent estimator for the RESI, however, there is no established confidence interval (CI) estimation procedure for the RESI. Here, we use statistical theory and simulations to evaluate several CI estimation procedures for three estimators of the RESI. Our findings show (1) in contrast to common effect sizes, the robust estimator is consistent for the true effect size; (2) common CI procedures for effect sizes that are non-centrality parameters fail to cover the true effect size at the nominal level. Using the robust estimator along with the proposed bootstrap CI is generally accurate and applicable to conduct consistent estimation and valid inference for the RESI, especially when model assumptions may be violated. Based on the RESI, we propose a general framework for the analysis of effect size (ANOES), such that effect sizes and confidence intervals can be easily reported in an analysis of variance (ANOVA) table format for a wide range of models


title: Entanglement in the Quantum Hall Matrix Model

abstract: Characterizing the entanglement of matrix degrees of freedom is essential for understanding the holographic emergence of spacetime. The Quantum Hall Matrix Model is a gauged $U(N)$ matrix quantum mechanics with two matrices whose ground state is known exactly and describes an emergent spatial disk with incompressible bulk dynamics. We define and compute an entanglement entropy in the ground state associated to a cut through the disk. There are two contributions. A collective field describing the eigenvalues of one of the matrices gives a gauge-invariant chiral boundary mode leading to an expected logarithmic entanglement entropy. Further, the cut through the bulk splits certain 'off-diagonal' matrix elements that must be duplicated and associated to both sides of the cut. Sewing these duplicated modes together in a gauge-invariant way leads to a bulk 'area law' contribution to the entanglement entropy. All of these entropies are regularized by finite $N$.


title: Linear Speedup in Personalized Collaborative Learning

abstract: Collaborative training can improve the accuracy of a model for a user by trading off the model's bias (introduced by using data from other users who are potentially different) against its variance (due to the limited amount of data on any single user). In this work, we formalize the personalized collaborative learning problem as a stochastic optimization of a task 0 while giving access to N related but different tasks 1,..., N. We provide convergence guarantees for two algorithms in this setting -- a popular collaboration method known as weighted gradient averaging, and a novel bias correction method -- and explore conditions under which we can achieve linear speedup w.r.t. the number of auxiliary tasks N. Further, we also empirically study their performance confirming our theoretical insights.


title: PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems

abstract: We present the PowerGridworld software package to provide users with a lightweight, modular, and customizable framework for creating power-systems-focused, multi-agent Gym environments that readily integrate with existing training frameworks for reinforcement learning (RL). Although many frameworks exist for training multi-agent RL (MARL) policies, none can rapidly prototype and develop the environments themselves, especially in the context of heterogeneous (composite, multi-device) power systems where power flow solutions are required to define grid-level variables and costs. PowerGridworld is an open-source software package that helps to fill this gap. To highlight PowerGridworld's key features, we present two case studies and demonstrate learning MARL policies using both OpenAI's multi-agent deep deterministic policy gradient (MADDPG) and RLLib's proximal policy optimization (PPO) algorithms. In both cases, at least some subset of agents incorporates elements of the power flow solution at each time step as part of their reward (negative cost) structures.


title: Core size of a random partition for the Plancherel measure

abstract: We prove that the size of the e-core of a partition taken under the Poissonised Plancherel measure converges in distribution to, as the Poisson parameter goes to infinity and after a suitable renormalisation, a sum of e-1 mutually independent Gamma distributions with explicit parameters. Such a result already exists for the uniform measure on the set of partitions of n as n goes to infinity, the parameters of the Gamma distributions being all equal. We rely on the fact that the descent set of a partition is a determinantal point process under the Poissonised Plancherel measure and on a central limit theorem for such processes.


title: An anthropic solution to the cosmological moduli problem

abstract: Light moduli fields, gravitationally coupled scalar fields with no classical potential and which are expected to emerge as remnants from string theory compactification, are dangerous to cosmology in that 1. their late-time decays may disrupt successful Big Bang Nucleosynthesis (BBN), 2. they may decay into gravitino pairs which result in violation of BBN constraints or overproduction of lightest SUSY particles (LSPs, assumed to constitute at least a portion of the dark matter in the universe) and 3. they may decay directly into LSPs, resulting in gross DM overproduction. Together, these constitute the cosmological moduli problem (CMP). The combined effects require lightest modulus mass m_\phi >~10^4 TeV, and if the lightest modulus mass m_\phi is correlated with the SUSY breaking scale m_{3/2}, then the underlying SUSY model would be highly unnatural. We present a solution to the CMP wherein the lightest modulus initial field strength \phi_0 is anthropically selected to be \phi_0\sim 10^{-7}m_P by the requirement that the dark matter-to-baryonic matter ratio be not-too-far removed from its present value so that sufficient baryons are present in the universe to create observers. In this case, instead of dark matter overproduction via neutralino reannihilation at the modulus decay temperature, the neutralinos inherit the reduced moduli number density, thereby gaining accord with the measured dark matter relic density.


title: Amazon SageMaker Model Parallelism: A General and Flexible Framework for Large Model Training

abstract: With deep learning models rapidly growing in size, systems-level solutions for large-model training are required. We present Amazon SageMaker model parallelism, a software library that integrates with PyTorch, and enables easy training of large models using model parallelism and other memory-saving features. In contrast to existing solutions, the implementation of the SageMaker library is much more generic and flexible, in that it can automatically partition and run pipeline parallelism over arbitrary model architectures with minimal code change, and also offers a general and extensible framework for tensor parallelism, which supports a wider range of use cases, and is modular enough to be easily applied to new training scripts. The library also preserves the native PyTorch user experience to a much larger degree, supporting module re-use and dynamic graphs, while giving the user full control over the details of the training step. We evaluate performance over GPT-3, RoBERTa, BERT, and neural collaborative filtering, and demonstrate competitive performance over existing solutions.


title: Soft Sensing Transformer: Hundreds of Sensors are Worth a Single Word

abstract: With the rapid development of AI technology in recent years, there have been many studies with deep learning models in soft sensing area. However, the models have become more complex, yet, the data sets remain limited: researchers are fitting million-parameter models with hundreds of data samples, which is insufficient to exercise the effectiveness of their models and thus often fail to perform when implemented in industrial applications. To solve this long-lasting problem, we are providing large scale, high dimensional time series manufacturing sensor data from Seagate Technology to the public. We demonstrate the challenges and effectiveness of modeling industrial big data by a Soft Sensing Transformer model on these data sets. Transformer is used because, it has outperformed state-of-the-art techniques in Natural Language Processing, and since then has also performed well in the direct application to computer vision without introduction of image-specific inductive biases. We observe the similarity of a sentence structure to the sensor readings and process the multi-variable sensor readings in a time series in a similar manner of sentences in natural language. The high-dimensional time-series data is formatted into the same shape of embedded sentences and fed into the transformer model. The results show that transformer model outperforms the benchmark models in soft sensing field based on auto-encoder and long short-term memory (LSTM) models. To the best of our knowledge, we are the first team in academia or industry to benchmark the performance of original transformer model with large-scale numerical soft sensing data.


title: User Centered Design (VII): From Automated Flight Deck to Intelligent Flight Deck

abstract: Driven by the "user-centered design" philosophy, this paper first outlines the human factors problems of the flight deck automation for large civil aircraft and the human factors research carried out based on the "human-centered automation" approach. This paper then reviews the previous initial human factors research on intelligent civil flight deck based on the "human-centered AI" approach and discusses the prospects for future human factors research. Based on our proposed human factors engineering model for intelligent human-computer interaction and the framework of joint cognitive eco-systems, this paper proposes an initial human factors solution for the single-pilot operations of large civil aircraft and presents preliminary suggestions for future human factors research.


title: Bourbaki-complete spaces and Samuel realcompactifiation

abstract: This thesis belongs to the area of General Topology and, in particular, to the field of study of uniform spaces. It is divided in three parts where the related topics Bourbaki-completeness and Samuel realcompactification are studied. In the first part of the thesis we study Bourbaki-completeness and cofinal Bourbaki-completeness (equivalently, uniform strong-paracompactness) of uniform spaces. In particular, we solve several primary problems related to products, subspaces, hyperspaces, metric spaces and fine spaces. Moreover, we show that completeness and cofinal completeness are, respectively, equivalent to Bourbaki-completeness and cofinal Bourbaki-completeness whenever we consider uniformities having a base of star-finite covers. In the second part, we embed the Bourbaki-complete metric spaces (and after, the Bourbaki-complete uniform spaces) into an universal space. Next, we characterized those metric spaces which are metrizable by a Bourbaki-complete metric or cofinally Bourbaki-complete metric. In the third part we characterize the Samuel realcompact spaces, that is, those uniform spaces which are complete with the weak uniformity induced by all the real-valued uniformly continuous functions on the space. It turns out that these are exactly the Bourbaki-complete uniform spaces having no uniform partition of Ulam-measurable cardinal. Finally, as a natural step in order to generalize the above result, we study which kind of metric or uniform spaces satisfy that the Samuel realcompactification and the Hewitt realcompactification are equivalent.


title: Classification of the Chess Endgame problem using Logistic Regression, Decision Trees, and Neural Networks

abstract: In this study we worked on the classification of the Chess Endgame problem using different algorithms like logistic regression, decision trees and neural networks. Our experiments indicates that the Neural Networks provides the best accuracy (85%) then the decision trees (79%). We did these experiments using Microsoft Azure Machine Learning as a case-study on using Visual Programming in classification. Our experiments demonstrates that this tool is powerful and save a lot of time, also it could be improved with more features that increase the usability and reduce the learning curve. We also developed an application for dataset visualization using a new programming language called Ring, our experiments demonstrates that this language have simple design like Python while integrates RAD tools like Visual Basic which is good for GUI development in the open-source world


title: Fast quantum state discrimination with nonlinear PTP channels

abstract: We investigate models of nonlinear quantum computation based on deterministic positive trace-preserving (PTP) channels and evolution equations. The models are defined in any finite Hilbert space, but the main results are for dimension $N \! = \! 2$. For every normalizable linear or nonlinear positive map $\phi$ on bounded linear operators $X$, there is an associated normalized PTP channel $ \phi(X) / {\rm tr}[\phi(X)]$. Normalized PTP channels include unitary mean field theories, such as the Gross-Pitaevskii equation for interacting bosons, as well as models of linear and nonlinear dissipation. They classify into 4 types, yielding 3 distinct forms of nonlinearity whose computational power we explore. In the qubit case these channels support Bloch ball torsion and other distortions studied previously, where it has been shown that such nonlinearity can be used to increase the separation between a pair of close qubit states, suggesting an exponential speedup for state discrimination. Building on this idea, we argue that this operation can be made robust to noise by using dissipation to induce a bifurcation to a novel phase where a pair of attracting fixed points create an intrinsically fault-tolerant nonlinear state discriminator.


title: SUPER-Net: Trustworthy Medical Image Segmentation with Uncertainty Propagation in Encoder-Decoder Networks

abstract: Deep Learning (DL) holds great promise in reshaping the healthcare industry owing to its precision, efficiency, and objectivity. However, the brittleness of DL models to noisy and out-of-distribution inputs is ailing their deployment in the clinic. Most models produce point estimates without further information about model uncertainty or confidence. This paper introduces a new Bayesian DL framework for uncertainty quantification in segmentation neural networks: SUPER-Net: trustworthy medical image Segmentation with Uncertainty Propagation in Encoder-decodeR Networks. SUPER-Net analytically propagates, using Taylor series approximations, the first two moments (mean and covariance) of the posterior distribution of the model parameters across the nonlinear layers. In particular, SUPER-Net simultaneously learns the mean and covariance without expensive post-hoc Monte Carlo sampling or model ensembling. The output consists of two simultaneous maps: the segmented image and its pixelwise uncertainty map, which corresponds to the covariance matrix of the predictive distribution. We conduct an extensive evaluation of SUPER-Net on medical image segmentation of Magnetic Resonances Imaging and Computed Tomography scans under various noisy and adversarial conditions. Our experiments on multiple benchmark datasets demonstrate that SUPER-Net is more robust to noise and adversarial attacks than state-of-the-art segmentation models. Moreover, the uncertainty map of the proposed SUPER-Net associates low confidence (or equivalently high uncertainty) to patches in the test input images that are corrupted with noise, artifacts, or adversarial attacks. Perhaps more importantly, the model exhibits the ability of self-assessment of its segmentation decisions, notably when making erroneous predictions due to noise or adversarial examples.


title: A Visual Analytics Framework for Distributed Data Analysis Systems

abstract: This paper proposes a visual analytics framework that addresses the complex user interactions required through a command-line interface to run analyses in distributed data analysis systems. The visual analytics framework facilitates the user to manage access to the distributed servers, incorporate data from the source, run data-driven analysis, monitor the progress, and explore the result using interactive visualizations. We provide a user interface embedded with generalized functionalities and access protocols and integrate it with a distributed analysis system. To demonstrate our proof of concept, we present two use cases from the earth science and Sustainable Human Building Ecosystem research domain.


title: Self-Supervised Real-time Video Stabilization

abstract: Videos are a popular media form, where online video streaming has recently gathered much popularity. In this work, we propose a novel method of real-time video stabilization - transforming a shaky video to a stabilized video as if it were stabilized via gimbals in real-time. Our framework is trainable in a self-supervised manner, which does not require data captured with special hardware setups (i.e., two cameras on a stereo rig or additional motion sensors). Our framework consists of a transformation estimator between given frames for global stability adjustments, followed by scene parallax reduction module via spatially smoothed optical flow for further stability. Then, a margin inpainting module fills in the missing margin regions created during stabilization to reduce the amount of post-cropping. These sequential steps reduce distortion and margin cropping to a minimum while enhancing stability. Hence, our approach outperforms state-of-the-art real-time video stabilization methods as well as offline methods that require camera trajectory optimization. Our method procedure takes approximately 24.3 ms yielding 41 fps regardless of resolution (e.g., 480p or 1080p).


title: Giant Gravitons Intersecting at Angles from Integrable Spin Chains

abstract: We study integrable non-diagonal open boundary conditions for spin chains arising from holographic gauge theories. Their dual description is in terms of open strings stretching between giant gravitons intersecting at arbitrary angles inside spheres or projective spaces. By studying properties of their ground and low-lying states we reproduce the expected spectrum near the intersections. Unlike the case of intersecting D-branes in flat space, intersecting giant gravitons related by $SU(N)$ rotations do not always preserve an additional supersymmetry. We quantify this lack of enhancement by whether or not there exists a simple ferromagnetic ground state for the open spin chain.


title: Plasmonically enhanced tunable spectrally selective NIR and SWIR photodetector based on intercalation doped nanopatterned multilayer graphene

abstract: We present a proof of concept for a spectrally selective near-infrared (NIR) and short-wavelength infrared (SWIR) photodetector based on nanopatterned multilayer graphene intercalated with FeCl$_3$ (NPMLG-FeCl$_3$), enabling large modulation p-doping of graphene. The localized surface plasmons (LSPs) on the graphene sheets in NPMLG-FeCl$_3$ allow for electrostatic tuning of the photodetection in the NIR and SWIR regimes from $\lambda =1.3$ $\mu$m to 3 $\mu$m, which is out of range for nanopatterned monolayer graphene (NPG). Most importantly, the LSPs along with an optical cavity increase the absorbance from about $N\times 2.6$\% for $N$-layer graphene-FeCl$_3$ (without patterning) to nearly 100\% for NPMLG-FeCl$_3$, where the strong absorbance occurs locally inside the graphene sheets only. Our NIR and SWIR detection scheme relies on the photo-thermoelectric effect induced by asymmetric patterning of the multi-layer graphene (MLG) sheets. The LSPs on the nanopatterned side create hot carriers that give rise to Seebeck photodetection at room temperature achieving a responsivity of $R=6.15\times 10^3$ V/W, a detectivity of $D^*=2.3\times 10^{9}$ Jones, and an ultrafast response time of the order of 100 ns. Our theoretical results pave the way to graphene-based photodetection, optical IR communication, IR color displays, and IR spectroscopy in the NIR, SWIR, mid-wavelength infrared (MWIR), and long-wavelength infrared (LWIR) regimes.


title: Test of Nuclear Decay Rate Variation due to an Antineutrino Flux

abstract: Unexplained variations of the decay rate for weak interaction decays such as $\beta^{\pm}$-decay, electron capture, as well as strong interaction $\alpha$-decay have been reported. Some researcher interpreted these variations as caused by an unexplained fundamental interaction. The purpose of the paper is to review decay rate parameter variations experiments and place them into a common comparable context and to make decay parameter measurements at the level of 10$^{-5}$ in the presences of an antineutrino flux, $\sim 3 \times10^{12}$ $\overline{\nu} \, cm^{-2} \, sec^{-1}$, 6.5 meters from the High Flux Isotope Reactor(HFIR) reactor core having an on-off cycle time of $\sim$30 days. Two weak interaction decays, one via electron capture and the other via $\beta^-$ decay were selected because the final state and the time reverse state each contain a neutrino and anti-neutrino, covering arguments that the anti-neutrino flux may interact differently or not at all in one of the cases. The experiment searched for variation of the $^{54}_{25}$Mn, e$^-$ capture and $^{137}_{~55}$Cs, $\beta^-$ decay rate parameters. The measured variation in the decay rate parameters are found to be $\delta \lambda/ \lambda = (0.034\pm 1.38)\times 10^{-5}$ for $^{54}_{25}$Mn and $\delta \lambda/ \lambda = (0.67\pm 1.56)\times 10^{-5}$ for $^{137}_{~55}$Cs. These results are consistent with no measurable decay rate parameter variation due to an antineutrino flux, yielding a $68\%$ confidence level upper limit sensitivity for $^{54}_{25}$Mn, $\delta \lambda/ \lambda \leq 1.31\times10^{-5}$ or $\sigma \leq 1.29\times10^{-25}\,cm^{2}$ in cross section and for $^{137}_{~55}$Cs, $\delta \lambda/ \lambda \leq 2.23\times10^{-5}$ or $\sigma \leq 5.69\times10^{-27}\,cm^{2}$. These null or no observable effect measurements places cross-section upper limits $\sim 10^{4}$ times more sensitive than past experiments.


title: On generalization of 2d gravity with the simplest non-invariant states

abstract: Two-dimensional quantum gravity has led to numerous curious results since it was developed in the 1980s. Following the method of the original works, we derive the effective action for the simplest modifications of the theory, when the matter is immersed into Poincar\'e non-invariant states. The latter ones, as it has been shown recently, may have a considerable response in the theories with gravity, and the 2d Universe is a basic example to start with the deep investigation of these phenomena. We consider the cases of the insertion of the primary state of CFT and the thermal distribution of conformal matter.


title: The modeling of multiple animals that share behavioral features

abstract: In this work, we propose a model that can be used to infer the behavior of multiple animals. Our proposal is defined as a set of hidden Markov models that are based on the sticky hierarchical Dirichlet process, with a shared base-measure, and a STAP emission distribution. The latent classifications are representative of the behavior assumed by the animals, which is described by the STAP parameters. Given the latent classifications, the animals are independent. As a result of the way we formalize the distribution over the STAP parameters, the animals may share, in different behaviors, the set or a subset of the parameters, thereby allowing us to investigate the similarities between them. The hidden Markov models, based on the Dirichlet process, allow us to estimate the number of latent behaviors for each animal, as a model parameter. This proposal is motivated by a real data problem, where the GPS coordinates of six Maremma Sheepdogs have been observed. Among the other results, we show that four dogs share most of the behavior characteristics, while two have specific behaviors.


title: SyMetric: Measuring the Quality of Learnt Hamiltonian Dynamics Inferred from Vision

abstract: A recently proposed class of models attempts to learn latent dynamics from high-dimensional observations, like images, using priors informed by Hamiltonian mechanics. While these models have important potential applications in areas like robotics or autonomous driving, there is currently no good way to evaluate their performance: existing methods primarily rely on image reconstruction quality, which does not always reflect the quality of the learnt latent dynamics. In this work, we empirically highlight the problems with the existing measures and develop a set of new measures, including a binary indicator of whether the underlying Hamiltonian dynamics have been faithfully captured, which we call Symplecticity Metric or SyMetric. Our measures take advantage of the known properties of Hamiltonian dynamics and are more discriminative of the model's ability to capture the underlying dynamics than reconstruction error. Using SyMetric, we identify a set of architectural choices that significantly improve the performance of a previously proposed model for inferring latent dynamics from pixels, the Hamiltonian Generative Network (HGN). Unlike the original HGN, the new HGN++ is able to discover an interpretable phase space with physically meaningful latents on some datasets. Furthermore, it is stable for significantly longer rollouts on a diverse range of 13 datasets, producing rollouts of essentially infinite length both forward and backwards in time with no degradation in quality on a subset of the datasets.


title: Tight bounds for minimum l1-norm interpolation of noisy data

abstract: We provide matching upper and lower bounds of order $\sigma^2/\log(d/n)$ for the prediction error of the minimum $\ell_1$-norm interpolator, a.k.a. basis pursuit. Our result is tight up to negligible terms when $d \gg n$, and is the first to imply asymptotic consistency of noisy minimum-norm interpolation for isotropic features and sparse ground truths. Our work complements the literature on "benign overfitting" for minimum $\ell_2$-norm interpolation, where asymptotic consistency can be achieved only when the features are effectively low-dimensional.

categories: math.ST cs.IT cs.LG math.IT stat.ML stat.TH


title: Cross-language Information Retrieval

abstract: Two key assumptions shape the usual view of ranked retrieval: (1) that the searcher can choose words for their query that might appear in the documents that they wish to see, and (2) that ranking retrieved documents will suffice because the searcher will be able to recognize those which they wished to find. When the documents to be searched are in a language not known by the searcher, neither assumption is true. In such cases, Cross-Language Information Retrieval (CLIR) is needed. This chapter reviews the state of the art for CLIR and outlines some open research questions.


title: Towards Understanding Enablers of Digital Transformation in Small and Medium-Sized Enterprises

abstract: Even though, digital transformation has attracted much attention of both academics and practitioners, a very limited number of studies have investigated the digital transformation process in small and medium-sized enterprises (SMEs) and the findings remain fragmented. Given the accessibility and availability of digital technologies to launch digital transformation initiatives and the importance of SMEs in the economy, a profound understanding of enablers of the digital transformation process in SMEs is much needed. As such, to address this, in this paper we conducted a comprehensive review of related literature in information systems, management, and business disciplines, to identify key enablers that facilitate the digital transformation process in SMEs.


title: Traffic4cast -- Large-scale Traffic Prediction using 3DResNet and Sparse-UNet

abstract: The IARAI competition Traffic4cast 2021 aims to predict short-term city-wide high-resolution traffic states given the static and dynamic traffic information obtained previously. The aim is to build a machine learning model for predicting the normalized average traffic speed and flow of the subregions of multiple large-scale cities using historical data points. The model is supposed to be generic, in a way that it can be applied to new cities. By considering spatiotemporal feature learning and modeling efficiency, we explore 3DResNet and Sparse-UNet approaches for the tasks in this competition. The 3DResNet based models use 3D convolution to learn the spatiotemporal features and apply sequential convolutional layers to enhance the temporal relationship of the outputs. The Sparse-UNet model uses sparse convolutions as the backbone for spatiotemporal feature learning. Since the latter algorithm mainly focuses on non-zero data points of the inputs, it dramatically reduces the computation time, while maintaining a competitive accuracy. Our results show that both of the proposed models achieve much better performance than the baseline algorithms. The codes and pretrained models are available at https://github.com/resuly/Traffic4Cast-2021.


title: The Application of Digital Technology and the Learning Characteristics of Generation Z in Higher Education

abstract: The Generation Z (Gen Z), or the digital natives have never experienced a life without the internet. In addition, the advancement of digital technologies such as social media, smart mobile technologies, cloud computing, and the Internet-of-things has transformed how individuals perform their day-to-day activities. Especially for Gen Z, the use of digital technology has become an essential part of their daily routine, as a result, challenging the norm. As such, Gen Z displays unique learning characteristics which are different from previous generations. This change opens new avenues for exploring the impact of digital technology on the learning characteristics of Gen Z and possible applications to the higher education environment. By conducting a literature review of 80 studies, this paper presents a comprehensive framework for understanding the influence of digital technologies on the learning characteristics of Gen Z in higher education.


title: On the Use and Misuse of Absorbing States in Multi-agent Reinforcement Learning

abstract: The creation and destruction of agents in cooperative multi-agent reinforcement learning (MARL) is a critically under-explored area of research. Current MARL algorithms often assume that the number of agents within a group remains fixed throughout an experiment. However, in many practical problems, an agent may terminate before their teammates. This early termination issue presents a challenge: the terminated agent must learn from the group's success or failure which occurs beyond its own existence. We refer to propagating value from rewards earned by remaining teammates to terminated agents as the Posthumous Credit Assignment problem. Current MARL methods handle this problem by placing these agents in an absorbing state until the entire group of agents reaches a termination condition. Although absorbing states enable existing algorithms and APIs to handle terminated agents without modification, practical training efficiency and resource use problems exist. In this work, we first demonstrate that sample complexity increases with the quantity of absorbing states in a toy supervised learning task for a fully connected network, while attention is more robust to variable size input. Then, we present a novel architecture for an existing state-of-the-art MARL algorithm which uses attention instead of a fully connected layer with absorbing states. Finally, we demonstrate that this novel architecture significantly outperforms the standard architecture on tasks in which agents are created or destroyed within episodes as well as standard multi-agent coordination tasks.


title: Cybersecurity Issues and Practices in a Cloud Context: A Comparison Amongst Micro, Small and Medium Enterprises

abstract: The advancement and the proliferation of information systems among enterprises have given rise to understanding cybersecurity. Cybersecurity practices provide a set of techniques and procedures to protect the systems, networks, programs and data from attack, damage, or unauthorised access. Such cybersecurity practices vary and are applied differently to different types of enterprises. The purpose of this research is to compare the critical cybersecurity threats and practices in the cloud context among micro, small, and medium enterprises. By conducting a survey among 289 micro, small and medium-sized enterprises in Australia, this study highlights the significant differences in their cloud security practices. It also concludes that future studies that focus on cybersecurity issues and practices in the context of cloud computing should pay attention to these differences.


title: Extended-SWIR Photodetection in All-Group IV Core/Shell Nanowires

abstract: Group IV Ge1-xSnx semiconductors hold the premise of enabling broadband silicon-integrated infrared optoelectronics due to their tunable bandgap energy and directness. Herein, we exploit these attributes along with the enhanced lattice strain relaxation in Ge/Ge0.92Sn0.08 core-shell nanowire heterostructures to implement highly responsive, room-temperature short-wave infrared nanoscale photodetectors. Atomic-level studies confirm the uniform shell composition and its higher crystallinity with respect to thin films counterparts. The demonstrated Ge/Ge0.92Sn0.08 p-type field-effect nanowire transistors exhibit superior optoelectronic properties achieving simultaneously a relatively high mobility, a high ON/OFF ratio, and a high responsivity, in addition to a broadband absorption in the short-wave infrared range. Indeed, the reduced bandgap of the Ge0.92Sn0.08 shell yields an extended cutoff wavelength of 2.1 um, with a room-temperature responsivity reaching 2.7 A/W at 1550 nm. These results highlight the potential of Ge/Ge1-xSnx core/shell nanowires as silicon-compatible building blocks for nanoscale integrated infrared photonics.


title: Parallel Quantum Annealing

abstract: Quantum annealers of D-Wave Systems, Inc., offer an efficient way to compute high quality solutions of NP-hard problems. This is done by mapping a problem onto the physical qubits of the quantum chip, from which a solution is obtained after quantum annealing. However, since the connectivity of the physical qubits on the chip is limited, a minor embedding of the problem structure onto the chip is required. In this process, and especially for smaller problems, many qubits will stay unused. We propose a novel method, called parallel quantum annealing, to make better use of available qubits, wherein either the same or several independent problems are solved in the same annealing cycle of a quantum annealer, assuming enough physical qubits are available to embed more than one problem. Although the individual solution quality may be slightly decreased when solving several problems in parallel (as opposed to solving each problem separately), we demonstrate that our method may give dramatic speed-ups in terms of Time-to-Solution (TTS) for solving instances of the Maximum Clique problem when compared to solving each problem sequentially on the quantum annealer. Additionally, we show that solving a single Maximum Clique problem using parallel quantum annealing reduces the TTS significantly.


title: A Few Identities of the Takagi Function on Dyadic Rationals

abstract: The number of unbalanced interior nodes of divide-and-conquer trees on $n$ leaves is known to form a sequence of dilations of the Takagi function on dyadic rationals. We use this fact to derive identities on the Takagi function, and on the Hamming weight of an integer in terms of the Takagi function.


title: Creating Exact Multipolar Fields with Azimuthally Modulated RF Cavities

abstract: RF cavities used in modern particle accelerators operate in TM$_{m10}$-like modes composed of a single, dominant multipole of order $m$; $m=0$ modes are used for the longitudinal acceleration of a particle beam and $m\neq0$ modes for controlling transverse beam dynamics. The practical design of the latter, however, can be complex and require extensive analysis through the iteration of both approximate mathematical models and computationally expensive simulations to optimise the performance of the structure. In this paper we present a new, systematic method for designing azimuthally modulated RF cavities that support modes composed of any number and magnitude of user-specified transverse multipoles, either with or without a longitudinally accelerating component. Two case studies are presented of RF cavity designs that support modes composed of a longitudinally accelerating field in addition to a single transverse multipole, and designs that support modes composed of two transverse multipoles. We discuss generalising the discoveries and conclusions from the two case studies to designing cavities that support modes composed of any number of multipoles. The theoretical work is verified with analysis of 3D simulations and experimental measurements are presented of a cavity operating in a 3 GHz mode that simultaneously longitudinally accelerates and transversely focuses a beam.


title: A Syntactic and Categorical Derivation of G\"{o}del's Completeness Theorem

abstract: Considering classical first-order logic with equality, we give a "fully syntactic" construction of the (weak) syntactic category $\text{Syn}(T)$ associated to a consistent theory $T$; we show it is a consistent coherent category; and we show that a morphism of coherent categories $\text{Syn}(T)\to \bf{Set}$ gives rise to a model $\mathcal{M}$ of $T$ in the usual sense. We then invoke Deligne's theorem on small consistent coherent categories.


title: What Does the Post-Moore Era Mean for Research Software Engineering?

abstract: We are entering the post-Moore era where we no longer enjoy the free ride of the performance growth from simply shrinking the transistor features. However, this does not necessarily mean that we are entering a dark era of computing. On the contrary, sustaining the performance growth of computing in the post-Moore era itself is cutting-edge research. Concretely, heterogeneity and hardware specialization are becoming promising approaches in hardware designs. However, these are paradigm shifts in computer architecture. So what does the post-Moore era mean for research software engineering? This position paper addresses such a question by summarizing possible challenges and opportunities for research software engineering in the post-Moore era. We then briefly discuss what is missing and how we prepare to tackle such challenges and exploit opportunities for the future of computing.


title: Primordial Big Bang Nucleosynthesis and Generalized Uncertainty Principle

abstract: The Generalized Uncertainty Principle (GUP) naturally emerges in several quantum gravity models, predicting the existence of a minimal length at Planck scale. Here, we consider the quadratic GUP as a semiclassical approach to thermodynamic gravity and constrain the deformation parameter by using observational bounds from Big Bang Nucleosynthesis and primordial abundances of the light elements 4He,D,7Li. We show that our result fits with most of existing bounds on \beta derived from other cosmological studies.


title: Generalized Hamiltonian for Kekul\'e graphene and the emergence of valley-cooperative Klein tunneling

abstract: We introduce a generalized Hamiltonian describing not only all topological phases observed experimentally in Kekul\'e graphene (KekGr) but predicting also new ones. These phases show features like a quadratic band crossing point, valley splitting, or the crossing of conduction bands, typically induced by Rashba spin-orbit interactions or Zeeman fields. The electrons in KekGr behave as Dirac fermions and follow pseudo-relativistic dispersion relations with Fermi velocities, rest masses, and valley-dependent self-gating. Transitions between the topological phases can be induced by tuning these parameters. The model is applied to study the current flow in KekGr $pn$ junctions evidencing a novel cooperative transport phenomenon, where Klein tunneling goes along with a valley flip. These junctions act as perfect filters and polarizers of massive Dirac fermions, which are the essential devices for valleytronics. The plethora of different topological phases in KekGr may also help to establish phenomena from spintronics.


title: SyzScope: Revealing High-Risk Security Impacts of Fuzzer-Exposed Bugs in Linux kernel

abstract: Fuzzing has become one of the most effective bug finding approach for software. In recent years, 24*7 continuous fuzzing platforms have emerged to test critical pieces of software, e.g., Linux kernel. Though capable of discovering many bugs and providing reproducers (e.g., proof-of-concepts), a major problem is that they neglect a critical function that should have been built-in, i.e., evaluation of a bug's security impact. It is well-known that the lack of understanding of security impact can lead to delayed bug fixes as well as patch propagation. In this paper, we develop SyzScope, a system that can automatically uncover new "high-risk" impacts given a bug with seemingly "low-risk" impacts. From analyzing over a thousand low-risk bugs on syzbot, SyzScope successfully determined that 183 low-risk bugs (more than 15%) in fact contain high-risk impacts, e.g., control flow hijack and arbitrary memory write, some of which still do not have patches available yet.


title: Detecting Fake Points of Interest from Location Data

abstract: The pervasiveness of GPS-enabled mobile devices and the widespread use of location-based services have resulted in the generation of massive amounts of geo-tagged data. In recent times, the data analysis now has access to more sources, including reviews, news, and images, which also raises questions about the reliability of Point-of-Interest (POI) data sources. While previous research attempted to detect fake POI data through various security mechanisms, the current work attempts to capture the fake POI data in a much simpler way. The proposed work is focused on supervised learning methods and their capability to find hidden patterns in location-based data. The ground truth labels are obtained through real-world data, and the fake data is generated using an API, so we get a dataset with both the real and fake labels on the location data. The objective is to predict the truth about a POI using the Multi-Layer Perceptron (MLP) method. In the proposed work, MLP based on data classification technique is used to classify location data accurately. The proposed method is compared with traditional classification and robust and recent deep neural methods. The results show that the proposed method is better than the baseline methods.


title: 14 Her: a likely case of planet-planet scattering

abstract: In this Letter, we measure the full orbital architecture of the two-planet system around the nearby K0 dwarf 14 Herculis. 14 Her (HD 145675, HIP 79248) is a middle-aged ($4.6^{+3.8}_{-1.3}$ Gyr) K0 star with two eccentric giant planets identified in the literature from radial velocity (RV) variability and long-term trends. Using archival RV data from Keck/HIRES in concert with \textit{Gaia-Hipparcos} acceleration in the proper motion vector for the star, we have disentangled the mass and inclination of the b planet to ${9.1}_{-1.1}^{+1.0}$ $M_\mathrm{Jup}$ and ${32.7}_{-3.2}^{+5.3}$ degrees. Despite only partial phase coverage for the c planet's orbit, we are able to constrain its mass and orbital parameters as well to ${6.9}_{-1.0}^{+1.7}$ $M_\mathrm{Jup}$ and ${101}_{-33}^{+31}$ degrees. We find that coplanarity of the b and c orbits is strongly disfavored. Combined with the age of the system and the comparable masses of its planets, this suggests that planet-planet scattering may be responsible for the current configuration of the system.


title: Agent Spaces

abstract: Exploration is one of the most important tasks in Reinforcement Learning, but it is not well-defined beyond finite problems in the Dynamic Programming paradigm (see Subsection 2.4). We provide a reinterpretation of exploration which can be applied to any online learning method. We come to this definition by approaching exploration from a new direction. After finding that concepts of exploration created to solve simple Markov decision processes with Dynamic Programming are no longer broadly applicable, we reexamine exploration. Instead of extending the ends of dynamic exploration procedures, we extend their means. That is, rather than repeatedly sampling every state-action pair possible in a process, we define the act of modifying an agent to itself be explorative. The resulting definition of exploration can be applied in infinite problems and non-dynamic learning methods, which the dynamic notion of exploration cannot tolerate. To understand the way that modifications of an agent affect learning, we describe a novel structure on the set of agents: a collection of distances (see footnote 7) $d_{a} \in A$, which represent the perspectives of each agent possible in the process. Using these distances, we define a topology and show that many important structures in Reinforcement Learning are well behaved under the topology induced by convergence in the agent space.