title: Development and Performance of a Sealed Liquid Xenon Time Projection Chamber

abstract: The liquid xenon (LXe) time projection chamber (TPC) technology is probing a wide range of dark matter masses from sub-GeV to a few TeV. To further improve its sensitivity to sub-GeV dark matter and its application in reactor neutrino monitoring via coherent elastic neutrino-nucleus scattering (CEvNS), more understanding and suppression of single/few electrons background rate are needed. Here we report on the design and performance of a sealed LXeTPC with a graphene-coated fused silica window as the cathode. The purpose of the sealed TPC is for isolating the liquid xenon target volume from the majority of out-gassing materials in the detector vessel, thus improving the liquid xenon purification efficiency and reducing the impurity-induced single/few electrons background. We investigated the out-gassing rate and purification efficiency using the data from the sealed TPC with a simple purification model. The single electron signals from the photoionization of impurities in LXe are obtained and their correlation with the LXe purity is investigated. The photo-electron emission rate on the graphene-coated electrode is compared to that from stainless steel, the electrode material typically used in LXe detectors. We discuss the possible further improvement and potential applications of the sealed TPC for the next generation liquid xenon experiments for dark matter and neutrino physics.


title: Palm Vein Identification based on hybrid features selection model

abstract: Palm vein identification (PVI) is a modern biometric security technique used for increasing security and authentication systems. The key characteristics of palm vein patterns include, its uniqueness to each individual, unforgettable, non-intrusive and cannot be taken by an unauthorized person. However, the extracted features from the palm vein pattern are huge with high redundancy. In this paper, we propose a combine model of two-Dimensional Discrete Wavelet Transform, Principal Component Analysis (PCA), and Particle Swarm Optimization (PSO) (2D-DWTPP) to enhance prediction of vein palm patterns. The 2D-DWT Extracts features from palm vein images, PCA reduces the redundancy in palm vein features. The system has been trained in selecting high reverent features based on the wrapper model. The PSO feeds wrapper model by an optimal subset of features. The proposed system uses four classifiers as an objective function to determine VPI which include Support Vector Machine (SVM), K Nearest Neighbor (KNN), Decision Tree (DT) and Na\"ive Bayes (NB). The empirical result shows the proposed system Iit satisfied best results with SVM. The proposed 2D-DWTPP model has been evaluated and the results shown remarkable efficiency in comparison with Alexnet and classifier without feature selection. Experimentally, our model has better accuracy reflected by (98.65) while Alexnet has (63.5) and applied classifier without feature selection has (78.79).


title: Designing Neural Speaker Embeddings with Meta Learning

abstract: Neural speaker embeddings trained using classification objectives have demonstrated state-of-the-art performance in multiple applications. Typically, such embeddings are trained on an out-of-domain corpus on a single task e.g., speaker classification, albeit with a large number of classes (speakers). In this work, we reformulate embedding training under the meta-learning paradigm. We redistribute the training corpus as an ensemble of multiple related speaker classification tasks, and learn a representation that generalizes better to unseen speakers. First, we develop an open source toolkit to train x-vectors that is matched in performance with pre-trained Kaldi models for speaker diarization and speaker verification applications. We find that different bottleneck layers in the architecture variedly favor different applications. Next, we use two meta-learning strategies, namely prototypical networks and relation networks, to improve over the x-vector embeddings. Our best performing model achieves a relative improvement of 12.37% and 7.11% in speaker error on the DIHARD II development corpus and the AMI meeting corpus, respectively. We analyze improvements across different domains in the DIHARD corpus. Notably, on the challenging child speech domain, we study the relation between child age and the diarization performance. Further, we show reductions in equal error rate for speaker verification on the SITW corpus (7.68%) and the VOiCES challenge corpus (8.78%). We observe that meta-learning particularly offers benefits in challenging acoustic conditions and recording setups encountered in these corpora. Our experiments illustrate the applicability of meta-learning as a generalized learning paradigm for training deep neural speaker embeddings.


title: Resolvent analysis of an airfoil laminar separation bubble at Re = 500,000

abstract: We perform resolvent analysis to examine the perturbation dynamics over the laminar separation bubble (LSB) that forms near the leading edge of a NACA 0012 airfoil at a chord-based Reynolds number of 500,000 and an angle of attack of 8 degrees. Randomized SVD is adopted in the present analysis to relieve the computational cost associated with the high-Re global base flow. To examine the local physics over the LSB, we consider the use of exponential discounting to limit the time horizon that allows for the instability to develop with respect to the base flow. With discounting, the gain distribution over frequency accurately captures the spectral content over the LSB obtained from flow simulation. The peak-gain frequency also agrees with previous flow control results on suppressing dynamic stall over a pitching airfoil. According to the gain distribution and the modal structures, we conclude that the dominant energy-amplification mechanism is the Kelvin-Helmholtz instability. In addition to discounting, we also examine the use of spatial windows for both the forcing and response. From the response-windowed analysis, we find that the LSB serves the main role of energy amplifier, with the amplification saturating at the reattachment point. The input window imposes the constraint of surface forcing, and the results show that the optimal actuator location is slightly upstream of the separation point. The surface-forcing mode also suggest the optimal momentum forcing in the surface-tangent direction, with strong uni-directionality that is ideal for synthetic-jet-type actuators. This study demonstrates the strength of randomized resolvent analysis in tackling high-Reynolds-number base flows and calls attention to the care needed for base-flow instabilities.


title: Object Detection and Tracking Algorithms for Vehicle Counting: A Comparative Analysis

abstract: The rapid advancement in the field of deep learning and high performance computing has highly augmented the scope of video based vehicle counting system. In this paper, the authors deploy several state of the art object detection and tracking algorithms to detect and track different classes of vehicles in their regions of interest (ROI). The goal of correctly detecting and tracking vehicles' in their ROI is to obtain an accurate vehicle count. Multiple combinations of object detection models coupled with different tracking systems are applied to access the best vehicle counting framework. The models' addresses challenges associated to different weather conditions, occlusion and low-light settings and efficiently extracts vehicle information and trajectories through its computationally rich training and feedback cycles. The automatic vehicle counts resulting from all the model combinations are validated and compared against the manually counted ground truths of over 9 hours' traffic video data obtained from the Louisiana Department of Transportation and Development. Experimental results demonstrate that the combination of CenterNet and Deep SORT, Detectron2 and Deep SORT, and YOLOv4 and Deep SORT produced the best overall counting percentage for all vehicles.


title: John Ward: Memoir of a Theoretical Physicist

abstract: A scientific biography of John Ward, who was responsible for the Ward Identity in quantum electrodynamics; the first detailed calculation of the quantum entanglement of two photons in electron-positron annihilation with Maurice Pryce; the prediction of neutral weak currents in electroweak theory with Sheldon Glashow and Abdus Salam, and many other major calculations in theoretical physics.


title: Quantum One-class Classification With a Distance-based Classifier

abstract: The advancement of technology in Quantum Computing has brought possibilities for the execution of algorithms in real quantum devices. However, the existing errors in the current quantum hardware and the low number of available qubits make it necessary to use solutions that use fewer qubits and fewer operations, mitigating such obstacles. Hadamard Classifier (HC) is a distance-based quantum machine learning model for pattern recognition. We present a new classifier based on HC named Quantum One-class Classifier (QOCC) that consists of a minimal quantum machine learning model with fewer operations and qubits, thus being able to mitigate errors from NISQ (Noisy Intermediate-Scale Quantum) computers. Experimental results were obtained by running the proposed classifier on a quantum device and show that QOCC has advantages over HC.


title: Impact ionization and multiple photon absorptions in the two-dimensional photoexcited Hubbard model

abstract: We study the non-equilibrium response of a 4x3 Hubbard model at U=8 under the influence of a short electric field pulse, with the main focus on multiple photon excitations and on the change of double occupancy after the pulse. The behavior mainly depends on the driving frequency of the electric field. The largest change of double occupancy occurs during the pulse. For frequencies below the Mott gap, we observe multiphoton excitations at large field intensities. For frequencies beyond the gap energy, there is a region where Auger recombination reduces the double occupancy after the pulse. Impact ionization (Multi Exciton Generation), namely a growing double occupancy after the pulse, occurs for frequencies larger than twice the Mott gap. From the Loschmidt amplitude we compute the eigenstate spectrum of the quantum state after the pulse, observing multiple distinct photon excitation peaks, in line with expectations from a quasiparticle picture. We introduce a technique with which we analyze the time evolution of double occupancy in each peak individually. The long-term behavior of the double occupancy almost only depends on the absorbed energy, and we explore the connection of this property to the Eigenstate Thermalization Hypothesis.


title: Collective 2p-2h intruder states in $^{118}$Sn studied via $\beta$-decay of $^{118}$In using GRIFFIN

abstract: The low-lying structure of semi-magic $^{118}$Sn has been investigated through the $\beta$-decay of $^{118}$In ($T_{1/2}=4.45$ min) to study shape coexistence via the reduced transition probabilities of states in the 2p-2h proton intruder band. This high-statistics study was carried out at TRIUMF-ISAC with the GRIFFIN spectrometer. In total, 99 transitions have been placed in the level scheme with 43 being newly observed. Three low-lying $\gamma$-ray transitions with energies near 285 keV have been resolved from which the 2$^+_{\mathrm{intr.}} \rightarrow 0^+_{\mathrm{intr.}}$ 284.52-keV transition was determined to have half of the previous branching fraction leading to a $B(E2;2^+_2\rightarrow 0^+_2)$ of 21(4) W.u. compared to 39(7) W.u. from the previous measurement. Calculations using $sd$ IBM-2 with mixing have also been made to compare the experimental $B(E2)$ values to the theoretical values and to make comparisons to the $^{114,116}$Sn isotopes previously studied using the same theoretical model.


title: Distinguishing secant from cactus varieties

abstract: Cactus varieties are a generalization of secant varieties. They are defined using linear spans of arbitrary finite schemes of bounded length, while secant varieties use only isolated reduced points. In particular, any secant variety is always contained in the respective cactus variety, and, except in a few initial cases, the inclusion is strict. It is known that lots of natural criteria that test membership in secant varieties are actually only tests for membership in cactus varieties. In this article, we propose the first techniques to distinguish actual secant variety from the cactus variety in the case of the Veronese variety. We focus on two initial cases, $\kappa_{14}(\nu_d(\mathbb{P}^n))$ and $\kappa_{8,3}(\nu_d(\mathbb{P}^n))$, the simplest that exhibit the difference between cactus and secant varieties. We show that for $d\geq 5$, the component of the cactus variety $\kappa_{14}(\nu_d(\mathbb{P}^6))$ other than the secant variety $\sigma_{14}(\nu_d(\mathbb{P}^6))$ consists of degree $d$ polynomials divisible by a $(d-3)$-rd power of a linear form. We generalize this description to an arbitrary number of variables. We present an algorithm for deciding whether a point in the cactus variety $\kappa_{14}(\nu_d(\mathbb{P}^n))$ belongs to the secant variety $\sigma_{14}(\nu_d(\mathbb{P}^n))$ for $d\geq 6,$ $n \geq 6$. We obtain similar results for the Grassmann cactus variety $\kappa_{8,3}(\nu_d(\mathbb{P}^n))$. Our intermediate results give also a partial answer to analogous problems for other cactus varieties and Grassmann cactus varieties to any Veronese variety.


title: Adversarial Attacks with Multiple Antennas Against Deep Learning-Based Modulation Classifiers

abstract: We consider a wireless communication system, where a transmitter sends signals to a receiver with different modulation types while the receiver classifies the modulation types of the received signals using its deep learning-based classifier. Concurrently, an adversary transmits adversarial perturbations using its multiple antennas to fool the classifier into misclassifying the received signals. From the adversarial machine learning perspective, we show how to utilize multiple antennas at the adversary to improve the adversarial (evasion) attack performance. Two main points are considered while exploiting the multiple antennas at the adversary, namely the power allocation among antennas and the utilization of channel diversity. First, we show that multiple independent adversaries, each with a single antenna cannot improve the attack performance compared to a single adversary with multiple antennas using the same total power. Then, we consider various ways to allocate power among multiple antennas at a single adversary such as allocating power to only one antenna, and proportional or inversely proportional to the channel gain. By utilizing channel diversity, we introduce an attack to transmit the adversarial perturbation through the channel with the largest channel gain at the symbol level. We show that this attack reduces the classifier accuracy significantly compared to other attacks under different channel conditions in terms of channel variance and channel correlation across antennas. Also, we show that the attack success improves significantly as the number of antennas increases at the adversary that can better utilize channel diversity to craft adversarial attacks.


title: Geometric Superconductivity in 3D Hofstadter Butterfly

abstract: Electrons on the lattice subject to a strong magnetic field exhibit the fractal spectrum of electrons, which is known as the Hofstadter butterfly. In this work, we investigate unconventional superconductivity in a three-dimensional Hofstadter butterfly system. While it is generally difficult to achieve the Hofstadter regime, we show that the quasi-two-dimensional materials with a tilted magnetic field produce the large-scale superlattices, which generate the Hofstadter butterfly even at the moderate magnetic field strength. We first show that the van-Hove singularities of the butterfly flat bands greatly elevate the superconducting critical temperature, offering a new mechanism of field-enhanced superconductivity. Furthermore, we demonstrate that the quantum geometry of the Landau mini-bands plays a crucial role in the description of the superconductivity, which is shown to be clearly distinct from the conventional superconductors. Finally, we discuss the relevance of our results to the recently discovered re-entrant superconductivity of UTe2 in strong magnetic fields.


title: Viscoelastic control of spatiotemporal order in bacterial active matter

abstract: Active matter consists of units that generate mechanical work by consuming energy. Examples include living systems, such as assemblies of bacteria and biological tissues, biopolymers driven by molecular motors, and suspensions of synthetic self-propelled particles. A central question in the field is to understand and control the self-organization of active assemblies in space and time. Most active systems exhibit either spatial order mediated by interactions that coordinate the spatial structure and the motion of active agents or the temporal synchronization of individual oscillatory dynamics. The simultaneous control of spatial and temporal organization is more challenging and generally requires complex interactions, such as reaction-diffusion hierarchies or genetically engineered cellular circuits. Here, we report a novel and simple means to simultaneously control the spatial and temporal self-organization of bacterial active matter. By confining an active bacterial suspension and manipulating a single macroscopic parameter, namely the viscoelasticity of the suspending fluid, we have found that the bacterial fluid first self-organizes in space into a millimeter-scale rotating vortex; then displays temporal organization as the giant vortex switches its global chirality periodically with tunable frequency, reminiscent of a torsional pendulum - a self-driven one. Combining experiments with an active matter model, we explain this striking behavior in terms of the interplay between active forcing and viscoelastic stress relaxation. Our findings advance the understanding of bacterial behavior in complex fluids, and demonstrate experimentally for the first time that rheological properties can be harnessed to control active matter flows. Coupled with actuation, our tunable self-oscillating bacterial vortex may be used as a "clock" for locomotion of soft robots and microfluidic pumping.


title: From tunnels to towers: quantum scars from Lie Algebras and q-deformed Lie Algebras

abstract: We present a general symmetry-based framework for obtaining many-body Hamiltonians with scarred eigenstates that do not obey the eigenstate thermalization hypothesis. Our models are derived from parent Hamiltonians with a non-Abelian (or q-deformed) symmetry, whose eigenspectra are organized as degenerate multiplets that transform as irreducible representations of the symmetry (`tunnels'). We show that large classes of perturbations break the symmetry, but in a manner that preserves a particular low-entanglement multiplet of states -- thereby giving generic, thermal spectra with a `shadow' of the broken symmetry in the form of scars. The generators of the Lie algebra furnish operators with `spectrum generating algebras' that can be used to lift the degeneracy of the scar states and promote them to equally spaced `towers'. Our framework applies to several known models with scars, but we also introduce new models with scars that transform as irreducible representations of symmetries such as SU(3) and $q$-deformed SU(2), significantly generalizing the types of systems known to harbor this phenomenon. Additionally, we present new examples of generalized AKLT models with scar states that do not transform in an irreducible representation of the relevant symmetry. These are derived from parent Hamiltonians with enhanced symmetries, and bring AKLT-like models into our framework.


title: G-CREWE: Graph CompREssion With Embedding for Network Alignment

abstract: Network alignment is useful for multiple applications that require increasingly large graphs to be processed. Existing research approaches this as an optimization problem or computes the similarity based on node representations. However, the process of aligning every pair of nodes between relatively large networks is time-consuming and resource-intensive. In this paper, we propose a framework, called G-CREWE (Graph CompREssion With Embedding) to solve the network alignment problem. G-CREWE uses node embeddings to align the networks on two levels of resolution, a fine resolution given by the original network and a coarse resolution given by a compressed version, to achieve an efficient and effective network alignment. The framework first extracts node features and learns the node embedding via a Graph Convolutional Network (GCN). Then, node embedding helps to guide the process of graph compression and finally improve the alignment performance. As part of G-CREWE, we also propose a new compression mechanism called MERGE (Minimum dEgRee neiGhbors comprEssion) to reduce the size of the input networks while preserving the consistency in their topological structure. Experiments on all real networks show that our method is more than twice as fast as the most competitive existing methods while maintaining high accuracy.


title: $q$-difference equations for homogeneous $q$-difference operators and their applications

abstract: In this short paper, we show how to deduce several types of generating functions from Srivastava {\it et al} [Appl. Set-Valued Anal. Optim. {\bf 1} (2019), pp. 187-201.] by the method of $q$-difference equations. Moreover, we build relations between transformation formulas and homogeneous $q$-difference equations.


title: TA-Dash: An Interactive Dashboard for Spatial-Temporal Traffic Analytics -- Demo Paper

abstract: In recent years, a large number of research efforts aimed at the development of machine learning models to predict complex spatial-temporal mobility patterns and their impact on road traffic and infrastructure. However, the utility of these models is often diminished due to the lack of accessible user interfaces to view and analyse prediction results. In this paper, we present the Traffic Analytics Dashboard ( TA-Dash), an interactive dashboard that enables the visualisation of complex spatial-temporal urban traffic patterns. We demonstrate the utility of TA-Dash at the example of two recently proposed spatial-temporal models for urban traffic and urban road infrastructure analysis. In particular, the use cases include the analysis, prediction and visualisation of the impact of planned special events on urban road traffic as well as the analysis and visualisation of structural dependencies within urban road networks. The lightweight TA-Dash dashboard aims to address non-expert users involved in urban traffic management and mobility service planning. The TA-Dash builds on a flexible layer-based architecture that is easily adaptable to the visualisation of new models.


title: Bosonic continuum theory of one-dimensional lattice anyons

abstract: Anyons with arbitrary exchange phases exist on 1D lattices in ultracold gases. Yet, known continuum theories in 1D do not match. We derive the continuum limit of 1D lattice anyons via interacting bosons. The theory maintains the exchange phase periodicity fully analogous to 2D anyons. This provides a mapping between experiments, lattice anyons, and continuum theories, including Kundu anyons with a natural regularization as a special case. We numerically estimate the Luttinger parameter as a function of the exchange angle to characterize long-range signatures of the theory and predict different velocities for left- and right-moving collective excitations.

categories: cond-mat.quant-gas cond-mat.mes-hall cond-mat.str-el quant-ph


title: Quenched fractions in the IllustrisTNG simulations: comparison with observations and other theoretical models

abstract: We make an in-depth comparison of the IllustrisTNG simulations with observational data on the quenched fractions of central and satellite galaxies, for $M_*=10^{9-12}M_{\odot}$ at $0\leq z\leq3$. We study how analysis methodologies and observational effects impact this comparison. This includes measurement choices -- aperture, quenched definition, star formation rate (SFR) indicator timescale -- as well as observational uncertainties and sample selection issues: projection effects, satellite/central misclassification, and host mass distribution sampling. The definition used to separate quenched and star-forming galaxies produces differences of up to 70 (30)$\%$ for centrals (satellites) $>\sim 10^{10.5} M_{\odot}$. Increasing the aperture within which SFR is measured can suppress the quenched fractions by up to $\sim50\%$, particularly at $z\gtrsim2$. Proper consideration of the stellar and host mass distributions is crucial: naive comparisons to volume-limited samples from simulations lead to misinterpretation of the quenched fractions as a function of $z$ by up to 20$\%$. Including observational uncertainties to theoretical values of $M_*$ and SFR changes the quenched fraction values and their trend and/or slope with mass. Taking projected rather than 3D distances for satellites decreases the quenched fractions by up to 10$\%$ due to field contamination. Comparing with data, TNG produces quenched fractions broadly consistent with observations. TNG predicts quenched fractions up to $\sim80-90\%$ for centrals at $z\leq2-3$, in line with recent observations, and notably higher than other theoretical models. The quantitative agreement of TNG and SDSS for satellite quenched fractions in groups and clusters depends strongly on the galaxy and host mass range. Our mock comparison between TNG and SDSS highlights the importance of properly accounting for observational effects and biases.


title: Quenched fractions in the IllustrisTNG simulations: the roles of AGN feedback, environment, and pre-processing

abstract: We use the IllustrisTNG simulations to show how the fractions of quenched galaxies vary across different environments and cosmic time, and to quantify the role AGN feedback and preprocessing play in quenching group and cluster satellites. At $z=0$, we select galaxies with $M_* = 10^{9-12} M_{\odot}$ residing within ($\leq R_{200c}$) groups and clusters of total host mass $M_{200c}=10^{13-15.2} M_{\odot}$. TNG predicts a quenched fraction of $\sim70-90\%$ (on average) for centrals and satellites $\gtrsim 10^{10.5} M_{\odot}$, regardless of host mass, cosmic time ($0\leq z\leq0.5$), clustercentric distance and time since infall in the $z=0$ host. Low-mass centrals ($\lesssim 10^{10} M_{\odot}$), instead, are rarely quenched unless they become members of groups ($10^{13-14} M_{\odot}$) or clusters ($\geq10^{14} M_{\odot}$), where the quenched fraction rises to $\sim80\%$. The fraction of low-mass passive galaxies is higher closer to the host center and for more massive hosts. The population of low-mass satellites accreted $\gtrsim$4-6 Gyr ago in massive hosts is almost entirely passive, thus suggesting an upper limit for the time needed for environmental quenching to occur. In fact, $\sim30\%$ of group and cluster satellites that are quenched at $z=0$ were already quenched before falling into their current host, and the bulk of them quenched as early as 4 to 10 billion years ago. For low-mass galaxies ($\lesssim10^{10-10.5}M_{\odot}$), this is due to preprocessing, whereby current satellites may have been members of other hosts, and hence have undergone environmental processes, before falling into their final host, this mechanism being more common and more effective for the purposes of quenching for satellites found today in more massive hosts. On the other hand, massive galaxies quench on their own and because of AGN feedback, regardless of whether they are centrals or satellites.


title: Programmable Quantum Annealing Architectures with Ising Quantum Wires

abstract: Quantum annealing aims at solving optimization problems efficiently by preparing the ground state of an Ising spin-Hamiltonian quantum mechanically. A prerequisite of building a quantum annealer is the implementation of programmable long-range two-, three- or multi-spin Ising interactions. We discuss an architecture, where the required spin interactions are implemented via two-port, or in general multi-port quantum Ising wires connecting the spins of interest. This quantum annealing architecture of spins connected by Ising quantum wires can be realized by exploiting the three dimensional (3D) character of atomic platforms, including atoms in optical lattices and Rydberg tweezer arrays. The realization only requires engineering on-site terms and two-body interactions between nearest neighboring qubits. The locally coupled spin model on a 3D cubic lattice is sufficient to effectively produce arbitrary all-to-all coupled Ising Hamiltonians. We illustrate the approach for few spin devices solving Max-Cut and prime factorization problems, and discuss the potential scaling to large atom based systems.


title: Fast radio bursts to be detected with the Square Kilometre Array

abstract: Fast radio bursts (FRBs) are mysterious extragalactic radio signals. Revealing their origin is one of the central foci in modern astronomy. Previous studies suggest that occurrence rates of non-repeating and repeating FRBs could be controlled by the cosmic stellar-mass density (CSMD) and star formation-rate density (CSFRD), respectively. The Square Kilometre Array (SKA) is one of the best future instruments to address this subject due to its high sensitivity and high-angular resolution. Here, we predict the number of FRBs to be detected with the SKA. In contrast to previous predictions, we estimate the detections of non-repeating and repeating FRBs separately, based on latest observational constraints on their physical properties including the spectral indices, FRB luminosity functions, and their redshift evolutions. We consider two cases of redshift evolution of FRB luminosity functions following either the CSMD or CSFRD. At $z\gtrsim2$, $z\gtrsim6$ and $z\gtrsim10$, non-repeating FRBs will be detected with the SKA at a rate of $\sim10^{4}$, $\sim10^{2}$, and $\sim10$ (sky$^{-1}$ day$^{-1}$), respectively, if their luminosity function follows the CSMD evolution. At $z\gtrsim1$, $z\gtrsim2$, and $z\gtrsim4$, sources of repeating FRBs will be detected at a rate of $\sim10^{3}$, $\sim10^{2}$, and $\lesssim10$ (sky$^{-1}$ day$^{-1}$), respectively, assuming that the redshift evolution of their luminosity function is scaled with the CSFRD. These numbers could change by about one order of magnitude depending on the assumptions on the CSMD and CSFRD. In all cases, abundant FRBs will be detected by the SKA, which will further constrain the luminosity functions and number density evolutions.


title: Constraining the Kilonova Rate with Zwicky Transient Facility Searches Independent of Gravitational Wave and Short Gamma-ray Burst Triggers

abstract: The first binary neutron star merger, GW170817, was accompanied by a radioactivity-powered optical/infrared transient called a kilonova. To date, no compelling kilonova has been found during optical surveys of the sky, independent of gravitational-wave triggers. In this work, we searched the first 23 months of the Zwicky Transient Facility (ZTF) data stream for candidate kilonovae in the form of rapidly evolving transients. We combined ZTF alert queries with forced point-spread-function photometry and nightly flux stacking to increase our sensitivity to faint and fast transients. Automatic queries yielded $>11,200$ candidates, 24 of which passed quality checks and strict selection criteria based on a grid of kilonova models tailored for both binary neutron star and neutron star-black hole mergers. None of the candidates in our sample was deemed a possible kilonova after thorough vetting, catalog cross-matching, and study of their color evolution. The sources that passed our selection criteria are dominated by Galactic cataclysmic variables. In addition, we identified two fast transients at high Galactic latitude, one of which is the confirmed afterglow of long-duration GRB190106A, and the other is a possible cosmological afterglow. Using a survey simulation code, we constrained the kilonova rate for a range of models including top-hat and linearly decaying light curves and synthetic light curves obtained with radiative transfer simulations. For prototypical GW170817-like kilonovae, we constrain the rate to be $R < 1775$ Gpc$^{-3}$ yr$^{-1}$ at 95% confidence level by requiring at least 2 high-significance detections. By assuming a population of kilonovae with the same geometry and composition of GW170817 observed under a uniform viewing angle distribution, we obtained a constraint on the rate of $R < 4029$ Gpc$^{-3}$ yr$^{-1}$.


title: The far-UV Interstellar Radiation Field in Galactic Disks: Numerical and Analytic Models

abstract: The intensity of the far-ultraviolet (FUV; 6-13.6 eV) interstellar radiation field (ISRF) in galaxies determines the thermal and chemical evolution of the neutral interstellar gas and is key for interpreting extragalactic observations and for theories of star-formation. We run a series of galactic disk models and derive the FUV ISRF intensity as a function of the dust-to-gas ratio, star-formation rate density, gas density, scale radius, and observer position. We develop an analytic formula for the median FUV ISRF flux. We identify two dimensionless parameters in the problem: (1) the dimensionless galactic radius, $X$, which measures the radial extent of FUV sources (OB stellar associations) in the disk; (2) the opacity over the inter-source distance, $\tau_{\star}$, which measures the importance of dust absorption. These parameters encapsulate the dependence on all of the physical parameters. We find that there exists a critical $\tau_{\star}$, or equivalently a critical dust-to-gas ratio, $Z_{d,{\rm crit}}' \approx 0.01-0.1$ the Milky Way value, at which the ISRF changes behavior. For $Z'_d>Z_{d,{\rm crit}}'$ the ISRF is limited by dust absorption. With decreasing $Z'_d$, the ISRF intensity increases as more sources contribute to the flux. For $Z'_d < Z_{d,{\rm crit}}'$ the ISRF saturates as the disk becomes optically thin. We find that the ISRF per star-formation rate density in low metallicity systems, such as dwarf and high redshift galaxies, is higher by up to a factor of 3-6 compared to their Milky-Way counterparts. We discuss implications to the potential mechanisms that regulate star-formation in low metallicity galaxies.


title: A Novel Survey for Young Substellar Objects with the W-band Filter. I. Filter Design and New Discoveries in Ophiuchus and Perseus

abstract: We present the design and implementation of a medium-band near-IR filter tailored for detecting low-mass stars and brown dwarfs from the summit of Maunakea. The W-band filter is centered at 1.45 micron with a bandpass width of 6%, designed to measure the depth of the H2O water absorption prominent in objects with spectral types of M6 and later. When combined with standard J- and H-band photometry, the W-band filter is designed to determine spectral types to $\approx$1.4 subtypes for late-M and L dwarfs, largely independent of surface gravity and reddening. This filter's primary application is completing the census of young substellar objects in star-forming regions, using W-band selection to greatly reduce contamination by reddened background stars that impede broad-band imaging surveys. We deployed the filter on the UH 88-inch telescope to survey $\approx$3 sq. deg. of the NGC 1333, IC 348, and rho Ophiuchus star-forming regions. Our spectroscopic followup of W-band selected candidates resulted in the confirmation of 48 ultracool dwarfs with a success rate of 89%, demonstrating the efficacy of this new filter and selection method.


title: Spin characterisation of systematics in CMB surveys -- a comprehensive formalism

abstract: The CMB $B$-mode polarisation signal -- both the primordial gravitational wave signature and the signal sourced by lensing -- is subject to many contaminants from systematic effects. Of particular concern are systematics that result in mixing of signals of different ``spin'', particularly leakage from the much larger spin-0 intensity signal to the spin-2 polarisation signal. We present a general formalism, which can be applied to arbitrary focal plane setups, that characterises signals in terms of their spin. We provide general expressions to describe how spin-coupled signals observed by the detectors manifest at map-level, in the harmonic domain, and in the power spectra, focusing on the polarisation spectra -- the signals of interest for upcoming CMB surveys. We demonstrate the presence of a previously unidentified cross-term between the systematic and the intrinsic sky signal in the power spectrum, which in some cases can be the dominant source of contamination. The formalism is not restricted to intensity to polarisation leakage but provides a complete elucidation of all leakage including polarisation mixing, and applies to both full and partial (masked) sky surveys, thus covering space-based, balloon-borne, and ground-based experiments. Using a pair-differenced setup, we demonstrate the formalism by using it to completely characterise the effects of differential gain and pointing systematics, incorporating both intensity leakage and polarisation mixing. We validate our results with full time ordered data simulations. Finally, we show in an Appendix that an extension of simple binning map-making to include additional spin information is capable of removing spin-coupled systematics during the map-making process.


title: SMASHing the low surface brightness SMC

abstract: The periphery of the Small Magellanic Cloud (SMC) can unlock important information regarding galaxy formation and evolution in interacting systems. Here, we present a detailed study of the extended stellar structure of the SMC using deep colour-magnitude diagrams (CMDs), obtained as part of the Survey of the MAgellanic Stellar History (SMASH). Special care was taken in the decontamination of our data from MW foreground stars, including from foreground globular clusters NGC 362 and 47 Tuc. We derived the SMC surface brightness using a ``conservative'' approach from which we calculated the general parameters of the SMC, finding a staggered surface brightness profile. We also traced the fainter outskirts by constructing a stellar density profile. This approach, based on stellar counts of the oldest main sequence turn-off (MSTO) stars, uncovered a tidally disrupted stellar feature that reaches as far out as 12 degrees from the SMC centre. We also serendipitously found a faint feature of unknown origin located at $\sim 14$ degrees from the centre of the SMC and that we tentatively associated to a more distant structure. We compared our results to in-house simulations of a $1\times10^{9} M_\odot$ SMC, finding that its elliptical shape can be explained by its tidal disruption under the combined presence of the MW and the LMC. Finally, we found that the older stellar populations show a smooth profile while the younger component presents a jump in the density followed by a flat profile, confirming the heavily disturbed nature of the SMC.


title: Loop corrections to the power spectrum for massive neutrino cosmologies with full time- and scale-dependence

abstract: Loop corrections to the power spectrum are frequently computed using approximate non-linear kernels adopted from an Einstein de-Sitter (EdS) cosmology. We present an algorithm that allows us to take the full time- and scale-dependence of the underlying fluid dynamics into account, and apply it to assess the impact of neutrino free-streaming on the 1- and 2-loop matter power spectrum. Neutrino perturbations are described by a hybrid Boltzmann/two-fluid model, that we show to agree with the CLASS Boltzmann solution at the linear level when using an appropriate effective neutrino sound velocity. We then use this scheme at 1- and 2-loop to perform a precision comparison of the matter power spectrum with simplified treatments of massive neutrinos. For a commonly adopted scheme using cold dark matter+baryon perturbations and EdS kernels to compute non-linear corrections, we find deviations above 1% for k > 0.15 h/Mpc at z=0, and sub-percent agreement on weakly non-linear scales at z=0.5. We also demonstrate the impact of the EdS approximation on the 2-loop power spectrum for massless neutrinos.


title: Foundations of matroids I: Matroids without large uniform minors

abstract: The foundation of a matroid is a canonical algebraic invariant which classifies representations of the matroid up to rescaling equivalence. Foundations of matroids are pastures, a simultaneous generalization of partial fields and hyperfields. Using deep results due to Tutte, Dress-Wenzel, and Gelfand-Rybnikov-Stone, we give a presentation for the foundation of a matroid in terms of generators and relations. The generators are certain "cross-ratios" generalizing the cross-ratio of four points on a projective line, and the relations encode dependencies between cross-ratios in certain low-rank configurations arising in projective geometry. Although the presentation of the foundation is valid for all matroids, it is simplest to apply in the case of matroids without large uniform minors, i.e. matroids having no minor corresponding to five points on a line or its dual configuration. For such matroids, we obtain a complete classification of all possible foundations. We then give a number of applications of this classification theorem, for example: - We prove the following strengthening of a theorem of Lee and Scobee: every orientation of a matroid without large uniform minors comes from a dyadic representation, which is unique up to rescaling. - For a matroid $M$ without large uniform minors, we establish the following strengthening of a 2017 theorem of Ardila-Rinc\'on-Williams: if $M$ is positively oriented then $M$ is representable over every field with at least three elements. - Two matroids are said to belong to the same representation class if they are representable over precisely the same pastures. We prove that there are precisely 12 possibilities for the representation class of a matroid without large uniform minors, exactly three of which are not representable over any field.


title: Phase and group velocities for correlation spreading in the Mott phase of the Bose-Hubbard model in dimensions greater than one

abstract: Lieb-Robinson and related bounds set an upper limit on the rate of spreading of information in non-relativistic quantum systems. Experimentally, they have been observed in the spreading of correlations in the Bose-Hubbard model after a quantum quench. Using a recently developed two particle irreducible (2PI) strong coupling approach to out-of-equilibrium dynamics in the Bose-Hubbard model we calculate both the group and phase velocities for the spreading of single-particle correlations in one, two and three dimensions as a function of interaction strength. Our results are in quantitative agreement with measurements of the velocities for the spreading of single particle correlations in both the one and two dimensional Bose-Hubbard model realized with ultra-cold atoms. They also agree with the claim that the phase velocity rather than the group velocity was observed in recent experiments in two dimensions. We demonstrate that there can be large differences between the phase and group velocities for the spreading of correlations and also explore the variation of the anisotropy in the velocity at which correlations spread across the phase diagram of the Bose-Hubbard model. Our results establish the 2PI strong coupling approach as a powerful tool to study out-of-equilibrium dynamics in the Bose-Hubbard model in dimensions greater than one.


title: Western ideological homogeneity in entrepreneurial finance research: Evidence from highly cited publications

abstract: Entrepreneurs play crucial roles in global sustainable development, but limited financial resources constrain their performance and survival rate. Entrepreneurial finance discipline is, therefore, born to explore the connection between finance and entrepreneurship. Despite the global presence of entrepreneurship, the literature of entrepreneurial finance is suspected to be Western ideologically homogenous. Thus, the objective of this study is to examine the existence of Western ideological homogeneity in entrepreneurial finance literature. Employing the mindsponge mechanism and bibliometric analyses (Y-index and social structure), we analyze 412 highly cited publications extracted from Web of Science database and find Western ideological dominance as well as weak tolerance towards heterogeneity in the set of core ideologies of entrepreneurial finance. These results are consistent across author-, institution-, and country-levels, which reveals strong evidence for the existence of Western ideological homogeneity in the field. We recommend editors, reviewers, and authors to have proactive actions to diversify research topics and enhancing knowledge exchange to avoid the shortfalls of ideological homogeneity. Moreover, the synthesis of mindsponge mechanism and bibliometric analyses are suggested as a possible way to evaluate the state of ideological diversity in other scientific disciplines.


title: Safety, Security, and Privacy Threats Posed by Accelerating Trends in the Internet of Things

abstract: The Internet of Things (IoT) is already transforming industries, cities, and homes. The economic value of this transformation across all industries is estimated to be trillions of dollars and the societal impact on energy efficiency, health, and productivity are enormous. Alongside potential benefits of interconnected smart devices comes increased risk and potential for abuse when embedding sensing and intelligence into every device. One of the core problems with the increasing number of IoT devices is the increased complexity that is required to operate them safely and securely. This increased complexity creates new safety, security, privacy, and usability challenges far beyond the difficult challenges individuals face just securing a single device. We highlight some of the negative trends that smart devices and collections of devices cause and we argue that issues related to security, physical safety, privacy, and usability are tightly interconnected and solutions that address all four simultaneously are needed. Tight safety and security standards for individual devices based on existing technology are needed. Likewise research that determines the best way for individuals to confidently manage collections of devices must guide the future deployments of such systems.


title: Process of Efficiently Parallelizing a Protein Structure Determination Algorithm

abstract: Computational protein structure determination involves optimization in a problem space much too large to exhaustively search. Existing approaches include optimization algorithms such as gradient descent and simulated annealing, but these typically only find local minima. One novel approach implemented in REDcRAFT is to instead of folding a protein all at the same time, fold it residue by residue. This simulates a protein folding as each residue exits from the generating ribosome. While REDcRAFT exponentially reduces the problem space so it can be explored in polynomial time, it is still extremely computationally demanding. This algorithm does have the advantage that most of the execution time is spent in inherently parallelizable code. However, preliminary results from parallel execution indicate that approximately two-thirds of execution time is dedicated to system overhead. Additionally, by carefully analyzing and timing the structure of the program the major bottlenecks can be identified. After addressing these issues, REDcRAFT becomes a scalable parallel application with nearly two orders of magnitude improvement.


title: On the weak stationarity conditions for Mathematical Programs with Cardinality Constraints: a unified approach

abstract: In this paper, we study a class of optimization problems, called Mathematical Programs with Cardinality Constraints (MPCaC). This kind of problem is generally difficult to deal with, because it involves a constraint that is not continuous neither convex, but provides sparse solutions. Thereby we reformulate MPCaC in a suitable way, by modeling it as mixed-integer problem and then addressing its continuous counterpart, which will be referred to as relaxed problem. We investigate the relaxed problem by analyzing the classical constraints in two cases: linear and nonlinear. In the linear case, we propose a general approach and present a discussion of the Guignard and Abadie constraint qualifications, proving in this case that every minimizer of the relaxed problem satisfies the Karush-Kuhn-Tucker (KKT) conditions. On the other hand, in the nonlinear case, we show that some standard constraint qualifications may be violated. Therefore, we cannot assert about KKT points. Motivated to find a minimizer for the MPCaC problem, we define new and weaker stationarity conditions, by proposing a unified approach that goes from the weakest to the strongest stationarity.


title: Relative importance of nonlinear electron-phonon coupling and vertex corrections in the Holstein model

abstract: Determining the range of validity of Migdal's approximation for electron-phonon ($e$-ph) coupled systems is a long-standing problem. Many attempts to answer this question employ the Holstein Hamiltonian, where the electron density couples linearly to local lattice displacements. When these displacements are large, however, nonlinear corrections to the interaction must also be included, which can significantly alter the physical picture obtained from this model. Using determinant quantum Monte Carlo and the self-consistent Migdal approximation, we compared superconducting and charge-density-wave correlations in the Holstein model with and without second-order nonlinear interactions. We find a disagreement between the two cases, even for relatively small values of the $e$-ph coupling strength, and, importantly, that this can occur in the same parameter regions where Migdal's approximation holds. Our results demonstrate that questions regarding the validity of Migdal's approximation go hand in hand with questions of the validity of a linear $e$-ph interaction.


title: Beartooth Relay Protocol: Supporting Real-Time Application Streams over LoRa

abstract: The near-ubiquitous availability of wireless connectivity lets users take advantage of a large variety of mobile applications. This connectivity predominantly comes as cellular and WiFi, limiting users to available infrastructure. At the same time, commercial efforts for infrastructure-less connectivity do not support mobile application traffic. In this paper, we present a new LoRa radio and a relay protocol capable of supporting real-time application traffic on point-to-point and multihop connection. Our solution has the potential to extend mobile application functionality beyond infrastructure coverage areas.


title: Milky Way Satellite Census. III. Constraints on Dark Matter Properties from Observations of Milky Way Satellite Galaxies

abstract: We perform a comprehensive study of Milky Way (MW) satellite galaxies to constrain the fundamental properties of dark matter (DM). This analysis fully incorporates inhomogeneities in the spatial distribution and detectability of MW satellites and marginalizes over uncertainties in the mapping between galaxies and DM halos, the properties of the MW system, and the disruption of subhalos by the MW disk. Our results are consistent with the cold, collisionless DM paradigm and yield the strongest cosmological constraints to date on particle models of warm, interacting, and fuzzy dark matter. At $95\%$ confidence, we report limits on (i) the mass of thermal relic warm DM, $m_{\rm WDM} > 6.5\ \mathrm{keV}$ (free-streaming length, $\lambda_{\rm{fs}} \lesssim 10\,h^{-1}\ \mathrm{kpc}$), (ii) the velocity-independent DM-proton scattering cross section, $\sigma_{0} < 8.8\times 10^{-29}\ \mathrm{cm}^{2}$ for a $100\ \mathrm{MeV}$ DM particle mass (DM-proton coupling, $c_p \lesssim (0.3\ \mathrm{GeV})^{-2}$), and (iii) the mass of fuzzy DM, $m_{\phi}> 2.9 \times 10^{-21}\ \mathrm{eV}$ (de Broglie wavelength, $\lambda_{\rm{dB}} \lesssim 0.5\ \mathrm{kpc}$). These constraints are complementary to other observational and laboratory constraints on DM properties.


title: Opportunities and Challenges for Next Generation Computing

abstract: Computing has dramatically changed nearly every aspect of our lives, from business and agriculture to communication and entertainment. As a nation, we rely on computing in the design of systems for energy, transportation and defense; and computing fuels scientific discoveries that will improve our fundamental understanding of the world and help develop solutions to major challenges in health and the environment. Computing has changed our world, in part, because our innovations can run on computers whose performance and cost-performance has improved a million-fold over the last few decades. A driving force behind this has been a repeated doubling of the transistors per chip, dubbed Moore's Law. A concomitant enabler has been Dennard Scaling that has permitted these performance doublings at roughly constant power, but, as we will see, both trends face challenges. Consider for a moment the impact of these two trends over the past 30 years. A 1980's supercomputer (e.g. a Cray 2) was rated at nearly 2 Gflops and consumed nearly 200 KW of power. At the time, it was used for high performance and national-scale applications ranging from weather forecasting to nuclear weapons research. A computer of similar performance now fits in our pocket and consumes less than 10 watts. What would be the implications of a similar computing/power reduction over the next 30 years - that is, taking a petaflop-scale machine (e.g. the Cray XK7 which requires about 500 KW for 1 Pflop (=1015 operations/sec) performance) and repeating that process? What is possible with such a computer in your pocket? How would it change the landscape of high capacity computing? In the remainder of this paper, we articulate some opportunities and challenges for dramatic performance improvements of both personal to national scale computing, and discuss some "out of the box" possibilities for achieving computing at this scale.


title: Fermi seas from Bose condensates in Chern-Simons matter theories and a bosonic exclusion principle

abstract: We generalize previously obtained results for the (all orders in the 't Hooft coupling) thermal free energy of bosonic and fermionic large $N$ Chern-Simons theories with fundamental matter, to values of the chemical potential larger than quasiparticle thermal masses. Building on an analysis by Geracie, Goykhman and Son, we present a simple explicit formula for the occupation number for a quasiparticle state of any given energy and charge as a function of the temperature and chemical potential. This formula is a generalization to finite 't Hooft coupling of the famous occupation number formula of Bose-Einstein statistics, and implies an exclusion principle for Chern-Simons coupled bosons: the total number of bosons occupying any particular state cannot exceed the Chern-Simons level. Specializing our results to zero temperature we construct the phase diagrams of these theories as a function of chemical potential and the UV parameters. At large enough chemical potential, all the bosonic theories we study transit into a compressible Bose condensed phase in which the runaway instability of free Bose condensates is stabilized by the bosonic exclusion principle. This novel Bose condensate is dual to - and reproduces the thermodynamics of - the fermionic Fermi sea.


title: Rethinking Default Values: a Low Cost and Efficient Strategy to Define Hyperparameters

abstract: Machine Learning (ML) algorithms have been increasingly applied to problems from several different areas. Despite their growing popularity, their predictive performance is usually affected by the values assigned to their hyperparameters (HPs). As consequence, researchers and practitioners face the challenge of how to set these values. Many users have limited knowledge about ML algorithms and the effect of their HP values and, therefore, do not take advantage of suitable settings. They usually define the HP values by trial and error, which is very subjective, not guaranteed to find good values and dependent on the user experience. Tuning techniques search for HP values able to maximize the predictive performance of induced models for a given dataset, but have the drawback of a high computational cost. Thus, practitioners use default values suggested by the algorithm developer or by tools implementing the algorithm. Although default values usually result in models with acceptable predictive performance, different implementations of the same algorithm can suggest distinct default values. To maintain a balance between tuning and using default values, we propose a strategy to generate new optimized default values. Our approach is grounded on a small set of optimized values able to obtain predictive performance values better than default settings provided by popular tools. After performing a large experiment and a careful analysis of the results, we concluded that our approach delivers better default values. Besides, it leads to competitive solutions when compared to tuned values, making it easier to use and having a lower cost. We also extracted simple rules to guide practitioners in deciding whether to use our new methodology or a HP tuning approach.


title: Extrapolation of Bandlimited Multidimensional Signals from Continuous Measurements

abstract: Conventional sampling and interpolation commonly rely on discrete measurements. In this paper, we develop a theoretical framework for extrapolation of signals in higher dimensions from knowledge of the continuous waveform on bounded high-dimensional regions. In particular, we propose an iterative method to reconstruct bandlimited multidimensional signals based on truncated versions of the original signal to bounded regions---herein referred to as continuous measurements. In the proposed method, the reconstruction is performed by iterating on a convex combination of region-limiting and bandlimiting operations. We show that this iteration consists of a firmly nonexpansive operator and prove strong convergence for multidimensional bandlimited signals. In order to improve numerical stability, we introduce a regularized iteration and show its connection to Tikhonov regularization. The method is illustrated numerically for two-dimensional signals.


title: Convolutional Autoencoders for Lossy Light Field Compression

abstract: Expansion and reduction of a neural network's width has well known properties in terms of the entropy of the propagating information. When carefully stacked on top of one another, an encoder network and a decoder network produce an autoencoder, often used in compression. Using this architecture, we develop an efficient method of encoding and decoding 4D Light Field data, with a substantial compression factor at a minimal loss in quality. Our best results managed to achieve a compression of 48.6x, with a PSNR of 29.46 dB and a SSIM of 0.8104. Computations of the encoder and decoder can be run in real time, with average computation times of 1.62s and 1.81s respectively, and the entire network occupies a reasonable 584MB by today's storage standards.


title: Investigating the association between meteorological factors and the transmission and fatality of COVID-19 in the US

abstract: A novel coronavirus disease (COVID-19) is sweeping the world and has taken away thousands of lives. As the current epicenter, the United States has the largest number of confirmed and death cases of COVID-19. Meteorological factors have been found associated with many respiratory diseases in the past studies. In order to understand that how and during which period of time do the meteorological factors have the strongest association with the transmission and fatality of COVID-19, we analyze the correlation between each meteorological factor during different time periods within the incubation window and the confirmation and fatality rate, and develop statistic models to quantify the effects at county level. Results show that meteorological variables except maximum wind speed during the day 13 - 0 before current day shows the most significant correlation (P < 0.05) with the daily confirmed rate, while temperature during the day 13 - 8 before are most significantly correlated (P < 0.05) with the daily fatality rate. Temperature is the only meteorological factor showing dramatic positive association nationally, particularly in the southeast US where the current outbreak most intensive. The influence of temperature is remarkable on the confirmed rate with an increase of over 5 pmp in many counties, but not as much on the fatality rate (mostly within 0.01%). Findings in this study will help understanding the role of meteorological factors in the spreading of COVID-19 and provide insights for public and individual in fighting against this global epidemic.


title: Cold Posteriors and Aleatoric Uncertainty

abstract: Recent work has observed that one can outperform exact inference in Bayesian neural networks by tuning the "temperature" of the posterior on a validation set (the "cold posterior" effect). To help interpret this phenomenon, we argue that commonly used priors in Bayesian neural networks can significantly overestimate the aleatoric uncertainty in the labels on many classification datasets. This problem is particularly pronounced in academic benchmarks like MNIST or CIFAR, for which the quality of the labels is high. For the special case of Gaussian process regression, any positive temperature corresponds to a valid posterior under a modified prior, and tuning this temperature is directly analogous to empirical Bayes. On classification tasks, there is no direct equivalence between modifying the prior and tuning the temperature, however reducing the temperature can lead to models which better reflect our belief that one gains little information by relabeling existing examples in the training set. Therefore although cold posteriors do not always correspond to an exact inference procedure, we believe they may often better reflect our true prior beliefs.


title: Chance Constrained Policy Optimization for Process Control and Optimization

abstract: Chemical process optimization and control are affected by 1) plant-model mismatch, 2) process disturbances, and 3) constraints for safe operation. Reinforcement learning by policy optimization would be a natural way to solve this due to its ability to address stochasticity, plant-model mismatch, and directly account for the effect of future uncertainty and its feedback in a proper closed-loop manner; all without the need of an inner optimization loop. One of the main reasons why reinforcement learning has not been considered for industrial processes (or almost any engineering application) is that it lacks a framework to deal with safety critical constraints. Present algorithms for policy optimization use difficult-to-tune penalty parameters, fail to reliably satisfy state constraints or present guarantees only in expectation. We propose a chance constrained policy optimization (CCPO) algorithm which guarantees the satisfaction of joint chance constraints with a high probability - which is crucial for safety critical tasks. This is achieved by the introduction of constraint tightening (backoffs), which are computed simultaneously with the feedback policy. Backoffs are adjusted with Bayesian optimization using the empirical cumulative distribution function of the probabilistic constraints, and are therefore self-tuned. This results in a general methodology that can be imbued into present policy optimization algorithms to enable them to satisfy joint chance constraints with high probability. We present case studies that analyze the performance of the proposed approach.


title: No-Reference Video Quality Assessment Using Space-Time Chips

abstract: We propose a new prototype model for no-reference video quality assessment (VQA) based on the natural statistics of space-time chips of videos. Space-time chips (ST-chips) are a new, quality-aware feature space which we define as space-time localized cuts of video data in directions that are determined by the local motion flow. We use parametrized distribution fits to the bandpass histograms of space-time chips to characterize quality, and show that the parameters from these models are affected by distortion and can hence be used to objectively predict the quality of videos. Our prototype method, which we call ChipQA-0, is agnostic to the types of distortion affecting the video, and is based on identifying and quantifying deviations from the expected statistics of natural, undistorted ST-chips in order to predict video quality. We train and test our resulting model on several large VQA databases and show that our model achieves high correlation against human judgments of video quality and is competitive with state-of-the-art models.


title: Sentiment Analysis based Multi-person Multi-criteria Decision Making Methodology using Natural Language Processing and Deep Learning for Smarter Decision Aid. Case study of restaurant choice using TripAdvisor reviews

abstract: Decision making models are constrained by taking the expert evaluations with pre-defined numerical or linguistic terms. We claim that the use of sentiment analysis will allow decision making models to consider expert evaluations in natural language. Accordingly, we propose the Sentiment Analysis based Multi-person Multi-criteria Decision Making (SA-MpMcDM) methodology for smarter decision aid, which builds the expert evaluations from their natural language reviews, and even from their numerical ratings if they are available. The SA-MpMcDM methodology incorporates an end-to-end multi-task deep learning model for aspect based sentiment analysis, named DOC-ABSADeepL model, able to identify the aspect categories mentioned in an expert review, and to distill their opinions and criteria. The individual evaluations are aggregated via the procedure named criteria weighting through the attention of the experts. We evaluate the methodology in a case study of restaurant choice using TripAdvisor reviews, hence we build, manually annotate, and release the TripR-2020 dataset of restaurant reviews. We analyze the SA-MpMcDM methodology in different scenarios using and not using natural language and numerical evaluations. The analysis shows that the combination of both sources of information results in a higher quality preference vector.


title: A fractional model for the COVID-19 pandemic: Application to Italian data

abstract: We provide a probabilistic SIRD model for the COVID-19 pandemic in Italy, where we allow the infection, recovery and death rates to be random. In particular, the underlying random factor is driven by a fractional Brownian motion. Our model is simple and needs only some few parameters to be calibrated.


title: 3D characterisation of individual grains of coexisting high-pressure H2O ice phases by time-domain Brillouin scattering

abstract: Time-domain Brillouin scattering uses ultrashort laser pulses to generate coherent acoustic pulses of picoseconds duration in a solid sample and to follow their propagation in order to image material inhomogeneities with sub-optical depth resolution. The width of the acoustic pulse limits the spatial resolution of the technique along the direction of the pulse propagation to less than several tens of nanometres. Thus, the time-domain Brillouin scattering outperforms axial resolution of the classical frequency-domain Brillouin scattering microscopy, which uses continuous lasers and thermal phonons and which spatial resolution is controlled by light focusing. The technique benefits from the application of the coherent acoustic phonons, and its application has exciting perspectives for the nanoscale imaging in biomedical and material sciences. In this study, we report on the application of the time-domain Brillouin scattering to the 3D imaging of a polycrystal of water ice containing two high-pressure phases. The imaging, accomplished via a simultaneous detection of quasi-longitudinal and quasi-shear waves, provided the opportunity to identify the phase for individual grains and evaluate their crystallographic orientation. Monitoring the propagation of the acoustic waves in two neighbouring grains simultaneously provided an additional mean for the localisation of the grain boundaries.


title: Phase-coherent sensing of the center-of-mass motion of trapped-ion crystals

abstract: Trapped ions are sensitive detectors of weak forces and electric fields that excite ion motion. Here measurements of the center-of-mass motion of a trapped-ion crystal that are phase-coherent with an applied weak external force are reported. These experiments are conducted far from the trap motional frequency on a two-dimensional trapped-ion crystal of approximately 100 ions, and determine the fundamental measurement imprecision of our protocol free from noise associated with the center-of-mass mode. The driven sinusoidal displacement of the crystal is detected by coupling the ion crystal motion to the internal spin-degree of freedom of the ions using an oscillating spin-dependent optical dipole force. The resulting induced spin-precession is proportional to the displacement amplitude of the crystal, and is measured with near-projection-noise-limited resolution. A $49\,$pm displacement is detected with a single measurement signal-to-noise ratio of 1, which is an order-of-magnitude improvement over prior phase-incoherent experiments. This displacement amplitude is $40$ times smaller than the zero-point fluctuations. With our repetition rate, a $8.4\,$pm$/\sqrt{\mathrm{Hz}}$ displacement sensitivity is achieved, which implies $12\,$yN$/\mathrm{ion}/\sqrt{\mathrm{Hz}}$ and $77\,\mu$V$/$m$/\sqrt{\mathrm{Hz}}$ sensitivities to forces and electric fields, respectively. This displacement sensitivity, when applied on-resonance with the center-of-mass mode, indicates the possibility of weak force and electric field detection below $10^{-3}\,$yN/ion and $1\,$nV/m, respectively.


title: TweepFake: about Detecting Deepfake Tweets

abstract: The recent advances in language modeling significantly improved the generative capabilities of deep neural models: in 2019 OpenAI released GPT-2, a pre-trained language model that can autonomously generate coherent, non-trivial and human-like text samples. Since then, ever more powerful text generative models have been developed. Adversaries can exploit these tremendous generative capabilities to enhance social bots that will have the ability to write plausible deepfake messages, hoping to contaminate public debate. To prevent this, it is crucial to develop deepfake social media messages detection systems. However, to the best of our knowledge no one has ever addressed the detection of machine-generated texts on social networks like Twitter or Facebook. With the aim of helping the research in this detection field, we collected the first dataset of \real deepfake tweets, TweepFake. It is real in the sense that each deepfake tweet was actually posted on Twitter. We collected tweets from a total of 23 bots, imitating 17 human accounts. The bots are based on various generation techniques, i.e., Markov Chains, RNN, RNN+Markov, LSTM, GPT-2. We also randomly selected tweets from the humans imitated by the bots to have an overall balanced dataset of 25,572 tweets (half human and half bots generated). The dataset is publicly available on Kaggle. Lastly, we evaluated 13 deepfake text detection methods (based on various state-of-the-art approaches) to both demonstrate the challenges that Tweepfake poses and create a solid baseline of detection techniques. We hope that TweepFake can offer the opportunity to tackle the deepfake detection on social media messages as well.


title: Fractal dimension in star formation regions

abstract: Several two-dimensional studies in spiral galaxies show that HII star formation regions have a fractal distribution, with a fractal dimension of approximately 2.3. In this work, the fractal dimension is calculated through the box-counting method implemented in an R code. The innovation of the work lies in calculating the fractal dimension directly in 3 dimensions, without the need for the use of projections, using position and distance data from Gaia (Data version 2). The estimated fractal dimension for the regions studied in the Milky Way are 2.468 (M16), 2.126 (Orion Nebula) and 2.435 (RCW 38).


title: Blazar Radio and Optical Survey (BROS): A catalog of blazar candidates showing flat radio spectrum and their optical identification in Pan-STARRS1 Surveys

abstract: Utilizing the latest and the most sensitive radio and optical catalogs, we completed a new blazar candidate catalog, Blazar Radio and Optical Survey (BROS), which includes 88,211 sources located at declination $\delta > -40^{\circ}$ and outside the galactic plane ($|b| > 10^{\circ}$). We list compact flat-spectrum radio sources of $\alpha > -0.6$ ($\alpha$ is defined as $F_{\nu} \propto \nu^\alpha$ ) from 0.15~GHz TGSS and 1.4~GHz NVSS catalogs. We further identify optical counterparts of the selected sources by cross-matching with Pan-STARRS1 photometric data. Color-color and color-magnitude plots for the selected BROS sources clearly show two distinct populations, An "quasar-like" population consisting of both flat-spectrum radio quasars and BL Lac type objects. On the other hand, an "elliptical-like" population of mostly BL Lac-type objects is buried in the elliptical galaxy. We emphasize that the latter population is missed by previous catalogs but newly emerged in the present BROS catalog, due to the lower radio flux threshold of our selection. Model calculations show that the "elliptical-like" population consists of elliptical galaxies located at redshift z $\lesssim$ 0.5, which is also supported by the logN-logS distribution of the power-law index of $1.49 \pm 0.05$. This BROS catalog is useful for identifying the electromagnetic counterparts of ultra-high-energy cosmic rays and PeV neutrinos recently detected by IceCube, as well as nearby BL Lac objects detectable by future high sensitivity TeV telescopes, such as Cherenkov Telescope Array.


title: Phase diagram of a two-site coupled complex Sachdev-Ye-Kitaev model

abstract: We study the thermodynamic properties of a two-site coupled complex Sachdev-Ye-Kitaev (SYK) model in the large $N$ limit by solving the saddle-point Schwinger-Dyson (SD) equations. We find that its phase diagram is richer than in the Majorana case. In the grand canonical ensemble, we identify a region of small chemical potential, and weak coupling between the two SYKs, for which two first order thermodynamic phase transitions occur as a function of temperature. First, we observe a transition from a cold wormhole phase to an intermediate phase that may correspond to a charged wormhole. For a higher temperature, there is another first order transition to the black hole phase. As in the Majorana case, the low temperature wormhole phase is gapped and, for sufficiently large coupling between the two complex SYK, or chemical potential, the first order transitions become crossovers. The total charge is good indicator to study the phase diagram of the model: it is zero in the cold wormhole phase and jumps discontinuously at the temperatures at which the transitions take place. Based on the approximate conformal symmetry of the ground state, expected to be close to a thermofield double state, we identify the effective low energy action of the model. It is a generalized Schwarzian action with $SL(2,R)\times U(1)$ symmetry with an additional potential and a extra degree of freedom related to the charge. In the large $N$ limit, results from this low energy action are consistent with those from the solution of the SD equations. Our findings are a preliminary step towards the characterization of traversable wormholes by its field theory dual, a strongly interacting fermionic system with charger, that is easier to model experimentally.


title: The Model of Quantum Thermodynamics From the First Principles: Quantum Halo or Small Environment

abstract: The evolution of the joint system (JS) - ``quantum system (QS)+thermal bath (TB)" is considered in the framework of a complex probabilistic processes that satisfies the stochastic differential equation of the Langevin-Schr\"{o}dinger type. Two linearly coupled oscillators that randomly interact with the environment and with each other are selected as QS. In the case when the interactions obey the law of a white random process, all the construction of the statistical parameters of the QS and its environment are performed analytically in the form of double integrals and solutions of second-order partial differential equations. Expressions of time-dependent von Neumann entropy and its generalization are obtained, taking into account the self-organization and entanglement processes occurring in the JS. It is mathematically proved that as a result of the relaxation of JS in the TB, a small quantized environment is formed, which can be interpreted as a continuation of QS or its halo. Bell states formed as a result of the decay of coupled two linear oscillators are constructed taking into account the influence of the environment. The transitions between $(in)$ and $(out$) asymptotic states of QS are studied in detail taking into account the influence of TB. Within the framework of the model problem, the possibility of constructing quantum thermodynamics from the first principle is proved without using any additional conditions.


title: Magnetic Properties of the Ising-like Rare Earth Pyrosilicate: D-Er$_{2}$Si$_{2}$O$_{7}$

abstract: Ising-like spin-1/2 magnetic materials are of interest for their ready connection to theory, particularly in the context of quantum critical behavior. In this work we report detailed studies of the magnetic properties of a member of the rare earth pyrosilicate family, D-Er$_{2}$Si$_{2}$O$_{7}$, which is known to display a highly anisotropic Ising-like g-tensor and effective spin-1/2 magnetic moments. We used powder neutron diffraction, powder inelastic neutron spectroscopy (INS), and single crystal AC susceptibility to characterize its magnetic properties. Neutron diffraction enabled us to determine the magnetic structure below the known transition temperature ($T_{N}$ = 1.9 K) in zero field, confirming that the magnetic state is a four-sublattice antiferromagnetic structure with two non-collinear Ising axes, as was previously hypothesized. Our powder INS data revealed a gapped excitation at zero field, consistent with anisotropic (possibly Ising) exchange. An applied field of 1 T produces a mode softening, which is consistent with a field-induced second order phase transition. To assess the relevance of D-Er$_{2}$Si$_{2}$O$_{7}$ to the transverse field Ising model, we performed AC susceptibility measurements on a single crystal with the magnetic field oriented in the direction transverse to the Ising axes. This revealed a transition at 2.65 T at 0.1 K, a field significantly higher than the mode-softening field observed by powder INS, showing that the field-induced phase transitions are highly field-direction dependent as expected. These measurements suggest that D-Er$_{2}$Si$_{2}$O$_{7}$ may be a candidate for further exploration related to the transverse field Ising model.


title: The nuclear symmetry energy from neutron skins and pure neutron matter in a Bayesian framework

abstract: We present an inference of the nuclear symmetry energy magnitude $J$, the slope $L$ and the curvature $K_{\rm sym}$ by combining neutron skin data on Ca, Pb and Sn isotopes and our best theoretical information about pure neutron matter (PNM). A Bayesian framework is used to consistently incorporate prior knowledge of the PNM equation of state from chiral effective field theory calculations. Neutron skins are modeled in a Hartree-Fock approach using an extended Skyrme energy-density functional which allows for independent variation of $J$, $L$ and $K_{\rm sym}$ without affecting the symmetric nuclear matter equation of state. We discuss the choice of neutron skin data sets, and combining errors in quadrature we obtain 95\% credible values of $J=31.3\substack{+4.2 \\ -5.9}$ MeV, $L=40\substack{+34 \\ -26}$ MeV and $K_{\tau} = L - 6K_{\rm sym}= -444\substack{+100 \\ -84}$ MeV using uninformative priors in $J$, $L$ and $K_{\rm sym}$, and $J=31.9\substack{+1.3 \\ -1.3}$ MeV, $L=37\substack{+9 \\ -8}$ MeV and $K_{\tau} = -480\substack{+25 \\ -26}$ MeV using PNM priors. The correlations between symmetry energy parameters induced by neutron skin data is discussed and compared with the droplet model. Neutron skin data alone is shown to place limits on the symmetry energy parameters as stringent as those obtained from chiral effective field theory alone, and when combined the 95\% credible intervals are reduced by a factor of 4-5. Ahead of new measurements of lead and calcium neutron skins from parity-violating electron scattering experiments at Jefferson Lab and Mainz Superconducting Accelerator, we make predictions based on existing data on neutron skins of tin for the neutron skins of calcium and lead of 0.166$\pm$0.008 fm and $0.169 \pm 0.014$ fm respectively, using uninformative priors, and 0.167$\pm$0.008 fm and $0.172 \pm 0.015$ fm respectively, using PNM priors.


title: Generalized Cut Polytopes for Binary Hierarchical Models

abstract: Marginal polytopes are important geometric objects that arise in statistics as the polytopes underlying hierarchical log-linear models. These polytopes can be used to answer geometric questions about these models, such as determining the existence of maximum likelihood estimates or the normality of the associated semigroup. Cut polytopes of graphs have been useful in analyzing binary marginal polytopes in the case where the simplicial complex underlying the hierarchical model is a graph. We introduce a generalized cut polytope that is isomorphic to the binary marginal polytope of an arbitrary simplicial complex via a generalized covariance map. This polytope is full dimensional in its ambient space and has a natural switching operation among its facets that can be used to deduce symmetries between the facets of the correlation and binary marginal polytopes. We find complete H-representations of the generalized cut polytope for some important families of simplicial complexes. We also compute the volume of these polytopes in some instances.


title: On the Computational Complexity of Linear Discrepancy

abstract: Many problems in computer science and applied mathematics require rounding a vector $\mathbf{w}$ of fractional values lying in the interval $[0,1]$ to a binary vector $\mathbf{x}$ so that, for a given matrix $\mathbf{A}$, $\mathbf{A}\mathbf{x}$ is as close to $\mathbf{A}\mathbf{w}$ as possible. For example, this problem arises in LP rounding algorithms used to approximate $\mathsf{NP}$-hard optimization problems and in the design of uniformly distributed point sets for numerical integration. For a given matrix $\mathbf{A}$, the worst-case error over all choices of $\mathbf{w}$ incurred by the best possible rounding is measured by the linear discrepancy of $\mathbf{A}$, a quantity studied in discrepancy theory, and introduced by Lovasz, Spencer, and Vesztergombi (EJC, 1986). We initiate the study of the computational complexity of linear discrepancy. Our investigation proceeds in two directions: (1) proving hardness results and (2) finding both exact and approximate algorithms to evaluate the linear discrepancy of certain matrices. For (1), we show that linear discrepancy is $\mathsf{NP}$-hard. Thus we do not expect to find an efficient exact algorithm for the general case. Restricting our attention to matrices with a constant number of rows, we present a poly-time exact algorithm for matrices consisting of a single row and matrices with a constant number of rows and entries of bounded magnitude. We also present an exponential-time approximation algorithm for general matrices, and an algorithm that approximates linear discrepancy to within an exponential factor.


title: From Data to Knowledge to Action: A Global Enabler for the 21st Century

abstract: A confluence of advances in the computer and mathematical sciences has unleashed unprecedented capabilities for enabling true evidence-based decision making. These capabilities are making possible the large-scale capture of data and the transformation of that data into insights and recommendations in support of decisions about challenging problems in science, society, and government. Key advances include jumps in the availability of rich streams of data, precipitous drops in the cost of storing and retrieving massive amounts of data, exponential increases in computing power and memory, and jumps in the prowess of methods for performing machine learning and reasoning. These advances have come together to create an inflection point in our ability to harness large amounts of data for generating insights and guiding decision making. The shift of commerce, science, education, art, and entertainment to the web makes available unprecedented quantities of structured and unstructured databases about human activities - much of it available to anyone who wishes to mine it for insights. In the sciences, new evidential paradigms and sensing technologies are making available great quantities of data, via use of fundamentally new kinds of low-cost sensors (e.g., genomic microarrays) or through viewers that provide unprecedented scope and resolution. The data pose a huge opportunity for data-centric analyses. To date, we have only scratched the surface of the potential for learning from these large-scale data sets. Opportunities abound for tapping our new capabilities more broadly to provide insights to decision makers and to enhance the quality of their actions and policies.


title: Relevant OTOC operators: footprints of the classical dynamics

abstract: The out-of-time order correlator (OTOC) has recently become relevant in different areas where it has been linked to scrambling of quantum information and entanglement. It has also been proposed as a good indicator of quantum complexity. In this sense, the OTOC-RE theorem relates the OTOCs summed over a complete base of operators to the second Renyi entropy. Here we have studied the OTOC-RE correspondence on physically meaningful bases like the ones constructed with the Pauli, reflection, and translation operators. The evolution is given by a paradigmatic bi-partite system consisting of two perturbed and coupled Arnold cat maps with different dynamics. We show that the sum over a small set of relevant operators, is enough in order to obtain a very good approximation for the entropy and hence to reveal the character of the dynamics, up to a time t 0 . In turn, this provides with an alternative natural indicator of complexity, i.e. the scaling of the number of relevant operators with time. When represented in phase space, each one of these sets reveals the classical dynamical footprints with different depth according to the chosen base.


title: Towards Class-Oriented Poisoning Attacks Against Neural Networks

abstract: Poisoning attacks on machine learning systems compromise the model performance by deliberately injecting malicious samples in the training dataset to influence the training process. Prior works focus on either availability attacks (i.e., lowering the overall model accuracy) or integrity attacks (i.e., enabling specific instance-based backdoor). In this paper, we advance the adversarial objectives of the availability attacks to a per-class basis, which we refer to as class-oriented poisoning attacks. We demonstrate that the proposed attack is capable of forcing the corrupted model to predict in two specific ways: (i) classify unseen new images to a targeted "supplanter" class, and (ii) misclassify images from a "victim" class while maintaining the classification accuracy on other non-victim classes. To maximize the adversarial effect as well as reduce the computational complexity of poisoned data generation, we propose a gradient-based framework that crafts poisoning images with carefully manipulated feature information for each scenario. Using newly defined metrics at the class level, we demonstrate the effectiveness of the proposed class-oriented poisoning attacks on various models (e.g., LeNet-5, Vgg-9, and ResNet-50) over a wide range of datasets (e.g., MNIST, CIFAR-10, and ImageNet-ILSVRC2012) in an end-to-end training setting.


title: Analysis of Prescription Drug Utilization with Beta Regression Models

abstract: The healthcare sector in the U.S. is complex and is also a large sector that generates about 20% of the country's gross domestic product. Healthcare analytics has been used by researchers and practitioners to better understand the industry. In this paper, we examine and demonstrate the use of Beta regression models to study the utilization of brand name drugs in the U.S. to understand the variability of brand name drug utilization across different areas. The models are fitted to public datasets obtained from the Medicare & Medicaid Services and the Internal Revenue Service. Integrated Nested Laplace Approximation (INLA) is used to perform the inference. The numerical results show that Beta regression models can fit the brand name drug claim rates well and including spatial dependence improves the performance of the Beta regression models. Such models can be used to reflect the effect of prescription drug utilization when updating an insured's health risk in a risk scoring model.


title: Mitigating the Backfire Effect Using Pacing and Leading

abstract: Online social networks create echo-chambers where people are infrequently exposed to opposing opinions. Even if such exposure occurs, the persuasive effect may be minimal or nonexistent. Recent studies have shown that exposure to opposing opinions causes a backfire effect, where people become more steadfast in their original beliefs. We conducted a longitudinal field experiment on Twitter to test methods that mitigate the backfire effect while exposing people to opposing opinions. Our subjects were Twitter users with anti-immigration sentiment. The backfire effect was defined as an increase in the usage frequency of extreme anti-immigration language in the subjects' posts. We used automated Twitter accounts, or bots, to apply different treatments to the subjects. One bot posted only pro-immigration content, which we refer to as arguing. Another bot initially posted anti-immigration content, then gradually posted more pro-immigration content, which we refer to as pacing and leading. We also applied a contact treatment in conjunction with the messaging based methods, where the bots liked the subjects' posts. We found that the most effective treatment was a combination of pacing and leading with contact. The least effective treatment was arguing with contact. In fact, arguing with contact consistently showed a backfire effect relative to a control group. These findings have many limitations, but they still have important implications for the study of political polarization, the backfire effect, and persuasion in online social networks.


title: Distribution of periodic points of certain Gauss shifts with infinite invariant measure

abstract: This paper investigates the periodic points of the Gauss type shifts associated to the even continued fraction (Schweiger) and to the backward continued fraction (R\'enyi). We show that they coincide exactly with two sets of quadratic irrationals that we call $E$-reduced, and respectively $B$-reduced. We prove that these numbers are equidistributed with respect to the (infinite) Lebesgue absolutely continuous invariant measures of the corresponding Gauss shift.


title: On the Convergence of SGD with Biased Gradients

abstract: We analyze the complexity of biased stochastic gradient methods (SGD), where individual updates are corrupted by deterministic, i.e. biased error terms. We derive convergence results for smooth (non-convex) functions and give improved rates under the Polyak-Lojasiewicz condition. We quantify how the magnitude of the bias impacts the attainable accuracy and the convergence rates (sometimes leading to divergence). Our framework covers many applications where either only biased gradient updates are available, or preferred, over unbiased ones for performance reasons. For instance, in the domain of distributed learning, biased gradient compression techniques such as top-k compression have been proposed as a tool to alleviate the communication bottleneck and in derivative-free optimization, only biased gradient estimators can be queried. We discuss a few guiding examples that show the broad applicability of our analysis.


title: Online Prediction With History-Dependent Experts: The General Case

abstract: We study the problem of prediction of binary sequences with expert advice in the online setting, which is a classic example of online machine learning. We interpret the binary sequence as the price history of a stock, and view the predictor as an investor, which converts the problem into a stock prediction problem. In this framework, an investor, who predicts the daily movements of a stock, and an adversarial market, who controls the stock, play against each other over $N$ turns. The investor combines the predictions of $n\geq 2$ experts in order to make a decision about how much to invest at each turn, and aims to minimize their regret with respect to the best-performing expert at the end of the game. We consider the problem with history-dependent experts, in which each expert uses the previous $d$ days of history of the market in making their predictions. We prove that the value function for this game, rescaled appropriately, converges as $N\to \infty$ at a rate of $O(N^{-1/6})$ to the viscosity solution of a nonlinear degenerate elliptic PDE, which can be understood as the Hamilton-Jacobi-Issacs equation for the two-person game. As a result, we are able to deduce asymptotically optimal strategies for the investor. Our results extend those established by the first author and R.V.Kohn [13] for $n=2$ experts and $d\leq 4$ days of history. To appear in Communications on Pure and Applied Mathematics.


title: Neural Network Degeneration and its Relationship to the Brain

abstract: This report discusses the application of neural networks (NNs) as small segments of the brain. The networks representing the biological connectome are altered both spatially and temporally. The degradation techniques applied here are "weight degradation", "weight scrambling", and variable activation function. These methods aim to shine light on the study of neurodegenerative diseases such as Alzheimer's, Huntington's and Parkinson's disease as well as strokes and brain tumors disrupting the flow of information in the brain's network. Fundamental insights to memory loss and generalized learning dysfunction are gained by monitoring the network's error function during network degradation. The biological significance of each facet is also discussed.


title: Securing CNN Model and Biometric Template using Blockchain

abstract: Blockchain has emerged as a leading technology that ensures security in a distributed framework. Recently, it has been shown that blockchain can be used to convert traditional blocks of any deep learning models into secure systems. In this research, we model a trained biometric recognition system in an architecture which leverages the blockchain technology to provide fault tolerant access in a distributed environment. The advantage of the proposed approach is that tampering in one particular component alerts the whole system and helps in easy identification of `any' possible alteration. Experimentally, with different biometric modalities, we have shown that the proposed approach provides security to both deep learning model and the biometric template.


title: From Data to Knowledge to Action: Enabling the Smart Grid

abstract: Our nation's infrastructure for generating, transmitting, and distributing electricity - "The Grid" - is a relic based in many respects on century-old technology. It consists of expensive, centralized generation via large plants, and a massive transmission and distribution system. It strives to deliver high-quality power to all subscribers simultaneously - no matter what their demand - and must therefore be sized to the peak aggregate demand at each distribution point. Ultimately, the system demands end-to-end synchronization, and it lacks a mechanism for storing ("buffering") energy, thus complicating sharing among grids or independent operation during an "upstream" outage. Recent blackouts demonstrate the existing grid's problems - failures are rare but spectacular. Moreover, the structure cannot accommodate the highly variable nature of renewable energy sources such as solar and wind. Many people are pinning their hopes on the "smart grid" - i.e., a more distributed, adaptive, and market-based infrastructure for the generation, distribution, and consumption of electrical energy. This new approach is designed to yield greater efficiency and resilience, while reducing environmental impact, compared to the existing electricity distribution system. Initial plans for the smart grid suggest it will make extensive use of existing information technology. In particular, recent advances in data analytics - i.e., data mining, machine learning, etc. - have the potential to greatly enhance the smart grid and, ultimately, amplify its impact, by helping us make sense of an increasing wealth of data about how we use energy and the kinds of demands that we are placing upon the current energy grid. Here we describe what the electricity grid could look like in 10 years, and specifically how Federal investment in data analytics approaches are critical to realizing this vision.


title: Gaussian Fields and Stochastic Heat Equations

abstract: The objective of the paper is to characterize the Gaussian free field as a stationary solution of the heat equation with additive space-time white noise. In the case of whole space, the investigation leads to other types of Gaussian fields, as well as interesting phenomena in dimensions one and two.