title: Detecting soccer balls with reduced neural networks: a comparison of multiple architectures under constrained hardware scenarios

abstract: Object detection techniques that achieve state-of-the-art detection accuracy employ convolutional neural networks, implemented to have optimal performance in graphics processing units. Some hardware systems, such as mobile robots, operate under constrained hardware situations, but still benefit from object detection capabilities. Multiple network models have been proposed, achieving comparable accuracy with reduced architectures and leaner operations. Motivated by the need to create an object detection system for a soccer team of mobile robots, this work provides a comparative study of recent proposals of neural networks targeted towards constrained hardware environments, in the specific task of soccer ball detection. We train multiple open implementations of MobileNetV2 and MobileNetV3 models with different underlying architectures, as well as YOLOv3, TinyYOLOv3, YOLOv4 and TinyYOLOv4 in an annotated image data set captured using a mobile robot. We then report their mean average precision on a test data set and their inference times in videos of different resolutions, under constrained and unconstrained hardware configurations. Results show that MobileNetV3 models have a good trade-off between mAP and inference time in constrained scenarios only, while MobileNetV2 with high width multipliers are appropriate for server-side inference. YOLO models in their official implementations are not suitable for inference in CPUs.


title: Static and Dynamic Measures of Active Music Listening as Indicators of Depression Risk

abstract: Music, an integral part of our lives, which is not only a source of entertainment but plays an important role in mental well-being by impacting moods, emotions and other affective states. Music preferences and listening strategies have been shown to be associated with the psychological well-being of listeners including internalized symptomatology and depression. However, till date no studies exist that examine time-varying music consumption, in terms of acoustic content, and its association with users' well-being. In the current study, we aim at unearthing static and dynamic patterns prevalent in active listening behavior of individuals which may be used as indicators of risk for depression. Mental well-being scores and listening histories of 541 Last.fm users were examined. Static and dynamic acoustic and emotion-related features were extracted from each user's listening history and correlated with their mental well-being scores. Results revealed that individuals with greater depression risk resort to higher dependency on music with greater repetitiveness in their listening activity. Furthermore, the affinity of depressed individuals towards music that can be perceived as sad was found to be resistant to change over time. This study has large implications for future work in the area of assessing mental illness risk by exploiting digital footprints of users via online music streaming platforms.


title: Tall $F_\sigma$ subideals of tall analytic ideals

abstract: Answering a question of Hru\v{s}\'ak, we show that every analytic tall ideal on $\omega$ contains an $F_\sigma$ tall ideal. We also give an example of an $F_\sigma$ tall ideal without a Borel selector.


title: Free-space non-separability decay of clasicaly-entangled modes

abstract: One of the most prominent features of quantum entanglement is its invariability under local unitary transformations, which implies the degree of entanglement remains constant during free-space propagation. While this is true for quantum and classically--entangled modes, here we demonstrate a novel type of classically-entangled modes that experience an entanglement decay upon free-space propagation. We show this by numerical simulations and corroborate experimentally. Our results evinces novel properties of classically-entangled modes, which pave the way to novel applications.


title: Blaschke, Osgood, Wiener, Hadamard and the Early Development of Modern Mathematics in China

abstract: In ancient times, China made great contributions to world civilization and in particular to mathematics. However, modern sciences including mathematics came to China rather too late. The first Chinese university was founded in 1895. The first mathematics department in China was formally opened at the university only in 1913. At the beginning of the twentieth century, some Chinese went to Europe, the United States of America and Japan for higher education in modern mathematics and returned to China as the pioneer generation. They created mathematics departments at the Chinese universities and sowed the seeds of modern mathematics in China. In 1930s, when a dozen of Chinese universities already had mathematics departments, several leading mathematicians from Europe and USA visited China, including Wilhelm Blaschke, George D. Birkhoff, William F. Osgood, Norbert Wiener and Jacques Hadamard. Their visits not only had profound impact on the mathematical development in China, but also became social events sometimes. This paper tells the history of their visits.


title: Oblivious Sampling Algorithms for Private Data Analysis

abstract: We study secure and privacy-preserving data analysis based on queries executed on samples from a dataset. Trusted execution environments (TEEs) can be used to protect the content of the data during query computation, while supporting differential-private (DP) queries in TEEs provides record privacy when query output is revealed. Support for sample-based queries is attractive due to \emph{privacy amplification} since not all dataset is used to answer a query but only a small subset. However, extracting data samples with TEEs while proving strong DP guarantees is not trivial as secrecy of sample indices has to be preserved. To this end, we design efficient secure variants of common sampling algorithms. Experimentally we show that accuracy of models trained with shuffling and sampling is the same for differentially private models for MNIST and CIFAR-10, while sampling provides stronger privacy guarantees than shuffling.


title: A Comparison of the Pathway Tools Software with the Reactome Software

abstract: This document compares SRI's Pathway Tools (PTools) software with the Reactome software. Both software systems serve the pathway bioinformatics area, including representation and analysis of metabolic pathways and signaling pathways. The comparison covers pathway bioinformatics capabilities, but does not cover other major facets of Pathway Tools that are completely absent from the Reactome software: Pathway Tools genome-informatics capabilities, regulatory informatics capabilities, and table-based analysis tools (SmartTables). Our overall findings are as follows. (1) PTools is significantly ahead of Reactome in its basic information pages. For example, PTools pathway layout algorithms have been developed to an advanced state over several decades, whereas Reactome pathway layouts are illegible, omit important information, and are created manually and therefore cannot scale to thousands of genomes. (2) PTools is far ahead of Reactome in omics analysis. PTools includes all of the omics-analysis methods that Reactome provides, and includes multiple methods that Reactome lacks. (3) PTools contains a metabolic route search tool (searching for paths through the metabolic network), which Reactome lacks. (4) PTools is significantly ahead of Reactome in inference of metabolic pathways from genome information to create new metabolic databases. (5) PTools has an extensive complement of metabolic-modeling tools whereas Reactome has none. (6) PTools is more scalable than Reactome, handling 18,000 genomes versus 90 genomes for Reactome. (7) PTools has a larger user base than Reactome. PTools powers 17 websites versus two for Reactome. PTools has been licensed by 10,800 users (Reactome licensed user count is unknown).


title: Transition properties in dynamical and statistical features of drying crack patterns

abstract: In this study, we experimentally investigated the time dependence of the statistical properties of two-dimensional drying crack patterns to determine the functional form of fragment size distribution. Experiments using a thin layer of a magnesium carbonate hydroxide paste revealed a "dynamical scaling" property in the time series of the fragment size distribution, which has been predicted by theoretical and numerical studies. Further analysis results based on Bayesian inference show the transition of the functional form of the fragment size distribution from a log-normal distribution to a generalized gamma distribution. The combination of a statistical model of the fragmentation process and the dynamics of stress concentration of a drying thin layer of viscoelastic material explains the origin of the transition.


title: A Nonparametric Unsupervised Learning Approach for Structural Damage Detection

abstract: In a world of aging infrastructure, structural health monitoring (SHM) emerges as a major step towards resilient and sustainable societies. The current advancements in machine learning and sensor technology have made SHM a more promising damage detection method than the traditional non-destructive testing methods. SHM using unsupervised learning methods offers an attractive alternative to the more commonly used supervised learning since it only requires data of the structure in normal conditions for the training process. The density-based novelty detection method provides a statistical element to the damage detection process but it relies heavily on the accuracy of the estimated probability density function (PDF). In this study, a novel unsupervised learning approach for SHM is proposed. It is based on the Kernel Density Maximum Entropy method by leveraging Bayesian optimization for hyperparameter tuning and also by extending the method into the multivariate space by the use of independent components analysis. The proposed approach is evaluated on a numerically simulated three-story reinforced concrete moment frame, where 94% of accuracy is achieved in structural damage detection.


title: Ultrafast pulse measurement via time-domain single-pixel imaging

abstract: In contrast with imaging using position-resolving cameras, single-pixel imaging uses a bucket detector along with spatially structured illumination for image recovery. This emerging imaging technique is a promising candidate for a broad range of applications due to high signal-to-noise ratio (SNR) and sensitivity, and applicability in a wide range of frequency bands. Here, inspired by single-pixel imaging in the spatial domain, we demonstrate a temporal single-pixel imaging (TSPI) system that covers frequency bands including both terahertz (THz) and near-infrared (NIR) region. By implementing a programmable temporal fan-out (TFO) gate based on a digital micromirror device (DMD), we can deterministically prepare temporally structured pulses with a temporal sampling size down to 16.00$\pm$0.01 fs. By inheriting the advantages in detection efficiency and sensitivity from spatial single-pixel imaging, TSPI enables the compressive recovery of a 5 fJ THz pulse and two NIR pulses with over 97$\%$ fidelity. We demonstrate that the TSPI is robust against temporal distortions in the probe pulse train as well. As a direct application, we apply TSPI to machine-learning-aided THz spectroscopy and demonstrate a high sample identification accuracy (97.5$\%$) even under low SNRs (SNR $\sim$ 10).


title: On Making Magnetic-Flux-Rope $\Omega$ Loops for Solar Bipolar Magnetic Regions of All Sizes by Convection Cells

abstract: We propose that the flux-rope $\Omega$ loop that emerges to become any bipolar magnetic region (BMR) is made by a convection cell of the $\Omega$-loop's size from initially-horizontal magnetic field ingested through the cell's bottom. This idea is based on (1) observed characteristics of BMRs of all spans ($\sim$ 1000 km to $\sim$ 200,000 km), (2) a well-known simulation of the production of a BMR by a supergranule-size convection cell from horizontal field placed at cell bottom, and (3) a well-known convection-zone simulation. From the observations and simulations, we (1) infer that the strength of the field ingested by the biggest convection cells (giant cells) to make the biggest BMR $\Omega$ loops is $\sim$ 10$^3$ G, (2) plausibly explain why the span and flux of the biggest observed BMRs are $\sim$ 200,000 km and $\sim$ 10$^{22}$ Mx, (3) suggest how giant cells might also make "failed-BMR" $\Omega$ loops that populate the upper convection zone with horizontal field, from which smaller convection cells make BMR $\Omega$ loops of their size, (4) suggest why sunspots observed in a sunspot cycle's declining phase tend to violate the hemispheric helicity rule, and (5) support a previously-proposed amended Babcock scenario for the sunspot cycle's dynamo process. Because the proposed convection-based heuristic model for making a sunspot-BMR $\Omega$ loop avoids having $\sim$ 10$^5$ G field in the initial flux rope at the bottom of the convection zone, it is an appealing alternative to the present magnetic-buoyancy-based standard scenario and warrants testing by high-enough-resolution giant-cell magnetoconvection simulations.


title: An equivariant Poincar\'e duality for proper cocompact actions by matrix groups

abstract: Let $G$ be a linear Lie group acting properly and isometrically on a $G$-spin$^c$ manifold $M$ with compact quotient. We show that Poincar\'e duality holds between $G$-equivariant $K$-theory of $M$, defined using finite-dimensional $G$-vector bundles, and $G$-equivariant $K$-homology of $M$, defined through the geometric model of Baum and Douglas.


title: Mathematical derivation for Vora-Value based filter design method: Gradient and Hessian

abstract: In this paper, we present the detailed mathematical derivation of the gradient and Hessian matrix for the Vora-Value based colorimetric filter optimization. We make a full recapitulation of the steps involved in differentiating the objective function and reveal the positive-definite Hessian matrix when a positive regularizer is applied. This paper serves as a supplementary material for our paper in the colorimetric filter design theory.


title: A Fast Graph Neural Network-Based Method for Winner Determination in Multi-Unit Combinatorial Auctions

abstract: The combinatorial auction (CA) is an efficient mechanism for resource allocation in different fields, including cloud computing. It can obtain high economic efficiency and user flexibility by allowing bidders to submit bids for combinations of different items instead of only for individual items. However, the problem of allocating items among the bidders to maximize the auctioneers" revenue, i.e., the winner determination problem (WDP), is NP-complete to solve and inapproximable. Existing works for WDPs are generally based on mathematical optimization techniques and most of them focus on the single-unit WDP, where each item only has one unit. On the contrary, few works consider the multi-unit WDP in which each item may have multiple units. Given that the multi-unit WDP is more complicated but prevalent in cloud computing, we propose leveraging machine learning (ML) techniques to develop a novel low-complexity algorithm for solving this problem with negligible revenue loss. Specifically, we model the multi-unit WDP as an augmented bipartite bid-item graph and use a graph neural network (GNN) with half-convolution operations to learn the probability of each bid belonging to the optimal allocation. To improve the sample generation efficiency and decrease the number of needed labeled instances, we propose two different sample generation processes. We also develop two novel graph-based post-processing algorithms to transform the outputs of the GNN into feasible solutions. Through simulations on both synthetic instances and a specific virtual machine (VM) allocation problem in a cloud computing platform, we validate that our proposed method can approach optimal performance with low complexity and has good generalization ability in terms of problem size and user-type distribution.


title: Learn like a Pathologist: Curriculum Learning by Annotator Agreement for Histopathology Image Classification

abstract: Applying curriculum learning requires both a range of difficulty in data and a method for determining the difficulty of examples. In many tasks, however, satisfying these requirements can be a formidable challenge. In this paper, we contend that histopathology image classification is a compelling use case for curriculum learning. Based on the nature of histopathology images, a range of difficulty inherently exists among examples, and, since medical datasets are often labeled by multiple annotators, annotator agreement can be used as a natural proxy for the difficulty of a given example. Hence, we propose a simple curriculum learning method that trains on progressively-harder images as determined by annotator agreement. We evaluate our hypothesis on the challenging and clinically-important task of colorectal polyp classification. Whereas vanilla training achieves an AUC of 83.7% for this task, a model trained with our proposed curriculum learning approach achieves an AUC of 88.2%, an improvement of 4.5%. Our work aims to inspire researchers to think more creatively and rigorously when choosing contexts for applying curriculum learning.


title: Leader: Prefixing a Length for Faster Word Vector Serialization

abstract: Two competing file formats have become the de facto standards for distributing pre-trained word embeddings. Both are named after the most popular pre-trained embeddings that are distributed in that format. The GloVe format is an entirely text based format that suffers from huge file sizes and slow reads, and the word2vec format is a smaller binary format that mixes a textual representation of words with a binary representation of the vectors themselves. Both formats have problems that we solve with a new format we call the Leader format. We include a word length prefix for faster reads while maintaining the smaller file size a binary format offers. We also created a minimalist library to facilitate the reading and writing of various word vector formats, as well as tools for converting pre-trained embeddings to our new Leader format.


title: A look into mirrors: A measurement of the $\beta$-asymmetry in $^{19}$Ne decay and searches for new physics

abstract: High precision measurements of isospin $T=1/2$ decays in the neutron and nuclei provide strong model-independent constraints on extensions to the standard model of particle physics. A measurement of the $\beta$-asymmetry in $^{19}$Ne decay between the initial nuclear spin and the direction of the emitted positron is presented which establishes this decay as the most precisely characterized nuclear mirror and fixes the Fermi-to-Gamow-Teller mixing ratio to $\rho = 1.6014(+21/-28)_{sys}(8)_{stat}$. This is consistent with the previous, most precise measurement, produces a value of the CKM unitarity parameter $V_{ud}$ in agreement with the nuclear mirror, neutron and superallowed $\beta$-decay data sets, shows no evidence for second class currents, and can be effectively used with neutron decay data to place a limits on exotic tensor couplings.


title: Montage: A General System for Buffered Durably Linearizable Data Structures

abstract: The recent emergence of fast, dense, nonvolatile main memory suggests that certain long-lived data might remain in its natural pointer-rich format across program runs and hardware reboots. Operations on such data must be instrumented with explicit write-back and fence instructions to ensure consistency in the wake of a crash. Techniques to minimize the cost of this instrumentation are an active topic of research. We present what we believe to be the first general-purpose approach to building buffered durably linearizable persistent data structures, and a system, Montage, to support that approach. Montage is built on top of the Ralloc nonblocking persistent allocator. It employs a slow-ticking epoch clock, and ensures that no operation appears to span an epoch boundary. It also arranges to persist only that data minimally required to reconstruct the structure after a crash. If a crash occurs in epoch $e$, all work performed in epochs $e$ and $e-1$ is lost, but work from prior epochs is preserved. We describe the implementation of Montage, argue its correctness, and report unprecedented throughput for persistent queues, sets/mappings, and general graphs.


title: A Comprehensive Survey of Machine Learning Applied to Radar Signal Processing

abstract: Modern radar systems have high requirements in terms of accuracy, robustness and real-time capability when operating on increasingly complex electromagnetic environments. Traditional radar signal processing (RSP) methods have shown some limitations when meeting such requirements, particularly in matters of target classification. With the rapid development of machine learning (ML), especially deep learning, radar researchers have started integrating these new methods when solving RSP-related problems. This paper aims at helping researchers and practitioners to better understand the application of ML techniques to RSP-related problems by providing a comprehensive, structured and reasoned literature overview of ML-based RSP techniques. This work is amply introduced by providing general elements of ML-based RSP and by stating the motivations behind them. The main applications of ML-based RSP are then analysed and structured based on the application field. This paper then concludes with a series of open questions and proposed research directions, in order to indicate current gaps and potential future solutions and trends.


title: Frequency-tunable nano-oscillator based on Ovonic Threshold Switch (OTS)

abstract: Nano-oscillator devices are gaining more and more attention as a prerequisite for developing novel energy-efficient computing systems based on coupled oscillators. Here, we introduce a highly scalable, frequency-tunable nano-oscillator consisting of one Ovonic threshold switch (OTS) and a field-effect transistor (FET). It is presented that the proposed device shows an oscillating behavior with a natural frequency (f_{nat}) adjustable from 0.5 to 2 MHz depending on the gate voltage applied to the FET. In addition, under a small periodic input, it is observed that the oscillating frequency (f_{osc}) of the device is locked to the frequency (f_{in}) of the input when f_{in} ~ f_{nat}, demonstrating the so-called synchronization phenomenon. It also shows the phase lock of the combined oscillator network using circuit simulation, where the phase relation between the oscillators can be controlled by the coupling strength. These results imply that the proposed device is promising for applications in oscillator-based computing systems.


title: Cranial Implant Design via Virtual Craniectomy with Shape Priors

abstract: Cranial implant design is a challenging task, whose accuracy is crucial in the context of cranioplasty procedures. This task is usually performed manually by experts using computer-assisted design software. In this work, we propose and evaluate alternative automatic deep learning models for cranial implant reconstruction from CT images. The models are trained and evaluated using the database released by the AutoImplant challenge, and compared to a baseline implemented by the organizers. We employ a simulated virtual craniectomy to train our models using complete skulls, and compare two different approaches trained with this procedure. The first one is a direct estimation method based on the UNet architecture. The second method incorporates shape priors to increase the robustness when dealing with out-of-distribution implant shapes. Our direct estimation method outperforms the baselines provided by the organizers, while the model with shape priors shows superior performance when dealing with out-of-distribution cases. Overall, our methods show promising results in the difficult task of cranial implant design.


title: Prediction of Intrinsic Triferroicity in Two-Dimensional Lattice

abstract: Intrinsic triferroicity is essential and highly sought for novel device applications, such as high-density multistate data storage. So far, the intrinsic triferroicity has only been discussed in three-dimensional systems. Herein on basis of first-principles, we report the intrinsic triferroicity in two-dimensional lattice. Being exfoliatable from the layered bulk, single-layer FeO2H is shown to be an intrinsically triferroic semiconductor, presenting antiferromagnetism, ferroelasticity and ferroelectricity simultaneously. Moreover, the directional control of its ferroelectric polarization is achievable by 90{\deg} reversible ferroelastic switching. In addition, single-layer FeO2H is identified to harbor in-plane piezoelectric effect. The unveiled phenomena and mechanism of triferroics in this two-dimensional system not only broaden the scientific and technological impact of triferroics but also enable a wide range of nanodevice applications.


title: Sphericalization with its applications in Gromov hyperbolic spaces

abstract: In this paper, we study certain applications of sphericalization in Gromov hyperbolic metric spaces. We first show that the doubling property regarding two classes of metrics on the Gromov boundary of hyperbolic spaces are coincided. Next, we obtain a characterization of unbounded Gromov hyperbolic domains via metric spaces sphericalization. Finally, we investigate the topological equivalence of Gromov hyperbolic $\varphi$-uniform domains between the Gromov boundary and the inner metric boundary.


title: Two-Hop Multi-UAV Relay Network Optimization with Directional Antennas

abstract: In this paper, we consider the multi-UAV deployment problem for a two-hop relaying system. For a better network performance, UAVs carry directional antennas that are modeled by a realistic radiation pattern. The goal is to maximize the minimum user rates, and therefore achieve fairness in the network. We propose an iterative algorithm to optimize the TDMA scheduling in both hops, UAV trajectories, antenna beamwidths, and transmit power of the base station and relays. Simulation results show the throughput improvement as a result of optimizing the directional antenna radiation patterns. In addition, we derive the optimal power allocation, which combined with the beamwidth optimization yields to a much better performance.


title: Extremely High Thermal Conductivity of Aligned Polyacetylene Predicted using First-Principles-Informed United-Atom Force Field

abstract: Molecular simulations of polymer rely on accurate force fields to describe the inter-atomic interactions. In this work, we use first-principles density functional theory (DFT) calculations to parameterize a united-atom force field for polyacetylene (PA), a conjugated polymer potentially of high thermal conductivity. Different electron correlation functionals in DFT have been tested. Bonding interactions for the alternating single and double bonds in the conjugated polymer backbone are explicitly described and Class II anharmonic functions are separately parameterized. Bond angle and dihedral interactions are also anharmonic and parameterized against DFT energy surfaces. The established force field is then used in molecular dynamics (MD) simulations to calculate the thermal conductivity of single PA chains and PA crystals with different simulation domain lengths. It is found that the thermal conductivity values of both PA single chains and crystals are very high and are length-dependent. At 790 nm, their respective thermal conductivity values are ~480 Wm-1K-1 and ~320 Wm-1K-1, which are comparatively higher than those of polyethylene (PE), the most thermally conductive polymer fiber measured up-to-date.


title: Mixed Cages: monotony, connectivity and upper bounds

abstract: A \emph{$[z, r; g]$-mixed cage} is a mixed graph $z$-regular by arcs, $r$-regular by edges, with girth $g$ and minimum order. %In this paper we study structural properties of mixed cages: Let $n[z,r;g]$ denote the order of a $[z,r;g]$-mixed cage. In this paper we prove that $n[z,r;g]$ is a monotonicity function, with respect of $g$, for $z\in \{1,2\}$, and we use it to prove that the underlying graph of a $[z,r;g]$-mixed cage is 2-connected, for $z\in \{1,2\}$. We also prove that $[z,r;g]$-mixed cages are strong connected. We present bounds of $n[z,r;g]$ and constructions of $[z,r;5]$-mixed graphs and show a $[10,3;5]$-mixed cage of order $50$.


title: The Primitive Derivation and Discrete Integrals

abstract: The modules of logarithmic derivations for the (extended) Catalan and Shi arrangements associated with root systems are known to be free. However, except for a few cases, explicit bases for such modules are not known. In this paper, we construct explicit bases for type $A$ root systems. Our construction is based on Bandlow-Musiker's integral formula for a basis of the space of quasiinvariants. The integral formula can be considered as an expression for the inverse of the primitive derivation introduced by K. Saito. We prove that the discrete analogues of the integral formulas provide bases for Catalan and Shi arrangements.


title: PDLight: A Deep Reinforcement Learning Traffic Light Control Algorithm with Pressure and Dynamic Light Duration

abstract: Existing ineffective and inflexible traffic light control at urban intersections can often lead to congestion in traffic flows and cause numerous problems, such as long delay and waste of energy. How to find the optimal signal timing strategy is a significant challenge in urban traffic management. In this paper, we propose PDlight, a deep reinforcement learning (DRL) traffic light control algorithm with a novel reward as PRCOL (Pressure with Remaining Capacity of Outgoing Lane). Serving as an improvement over the pressure used in traffic control algorithms, PRCOL considers not only the number of vehicles on the incoming lane but also the remaining capacity of the outgoing lane. Simulation results using both synthetic and real-world data-sets show that the proposed PDlight yields lower average travel time compared with several state-of-the-art algorithms, PressLight and Colight, under both fixed and dynamic green light duration.


title: The stellar metallicity distribution function of galaxies in the CALIFA survey

abstract: We present a novel method to retrieve the chemical structure of galaxies using integral field spectroscopy data through the stellar Metallicity Distribution Function (MDF). This is the probability distribution of observing stellar populations having a metallicity $Z$. We apply this method to a set of $550$ galaxies from the CALIFA survey. We present the behaviour of the MDF as a function of the morphology, the stellar mass and the radial distance. We use the stellar metallicity radial profiles retrieved as the first moment of the MDF, as an internal test for our method. The gradients in these radial profiles are consistent with the known trends: they are negative in massive early-type galaxies and tend to positive values in less massive late-type ones. We find that these radial profiles may not convey the complex chemical structure of some galaxy types. Overall, low mass galaxies ($\log{M_\star/\mathrm{M}_{\odot}}\leq10$) have broad MDFs ($\sigma_Z\sim1.0\,$dex), with unclear dependence on their morphology. However this result is likely affected by under-represented bins in our sample. On the other hand, massive galaxies ($\log{M_\star/\mathrm{M}_{\odot}}\geq11$) have systematically narrower MDFs ($\sigma_Z\leq0.2\,$dex). We find a clear trend whereby the MDFs at $r_k/R_e>1.5$ have large variance. This result is consistent with sparse SFHs in medium/low stellar density regions. We further find there are multi-modal MDFs in the outskirts ($\sim18\,$per cent) and the central regions ($\sim40\,$per cent) of galaxies. This behaviour is linked to a fast chemical enrichment during early stages of the SFH, along with the posterior formation of a metal-poor stellar population.


title: Chaos and frequent hypercyclicity for composition operators

abstract: The notions of chaos and frequent hypercyclicity enjoy an intimate relationship in linear dynamics. Indeed, after a series of partial results, it was shown by Bayart and Rusza in 2015 that for backward weighted shifts on $\ell_p(\mathbb{Z})$, the notions chaos and frequent hypercyclicity coincide. It is with some effort that one shows that these two notions are distinct. Bayart and Grivaux in 2007 constructed a non-chaotic frequently hypercyclic weighted shift on $c_0$. It was only in 2017 that Menet settled negatively whether every chaotic operator is frequently hypercylic. In this article, we show that for a large class of composition operators on $L^p$-spaces the notions of chaos and frequent hypercyclicity coincide. Moreover, in this particular class an invertible operator is frequently hypercyclic if and only if its inverse is frequently hypercyclic. This is in contrast to a very recent result of Menet where an invertible frequently hypercyclic operator on $\ell_1$ whose inverse is not frequently hypercyclic is constructed.


title: Learning to Generate Image Source-Agnostic Universal Adversarial Perturbations

abstract: Adversarial perturbations are critical for certifying the robustness of deep learning models. A universal adversarial perturbation (UAP) can simultaneously attack multiple images, and thus offers a more unified threat model, obviating an image-wise attack algorithm. However, the existing UAP generator is underdeveloped when images are drawn from different image sources (e.g., with different image resolutions). Towards an authentic universality across image sources, we take a novel view of UAP generation as a customized instance of few-shot learning, which leverages bilevel optimization and learning-to-optimize (L2O) techniques for UAP generation with improved attack success rate (ASR). We begin by considering the popular model agnostic meta-learning (MAML) framework to meta-learn a UAP generator. However, we see that the MAML framework does not directly offer the universal attack across image sources, requiring us to integrate it with another meta-learning framework of L2O. The resulting scheme for meta-learning a UAP generator (i) has better performance (50% higher ASR) than baselines such as Projected Gradient Descent, (ii) has better performance (37% faster) than the vanilla L2O and MAML frameworks (when applicable), and (iii) is able to simultaneously handle UAP generation for different victim models and image data sources.


title: A Branch-and-Price Algorithm Enhanced by Decision Diagrams for the Kidney Exchange Problem

abstract: Kidney paired donation programs allow patients registered with an incompatible donor to receive a suitable kidney from another donor, as long as the latter's co-registered patient, if any, also receives a kidney from a different donor. The kidney exchange problem (KEP) aims to find an optimal collection of kidney exchanges taking the form of cycles and chains. Existing exact solution methods for KEP either are designed for the case where only cyclic exchanges are considered, or can handle long chains but are scalable as long as cycles are short. We develop the first decomposition method that is able to deal with long cycles and long chains for large realistic instances. More specifically, we propose a branch-and-price framework, in which the pricing problems are solved (for the first time in packing problems in a digraph) through multi-valued decision diagrams. Also, we present a new upper bound on the optimal value of KEP, stronger than the one proposed in the literature, which is obtained via our master problem. Computational experiments show superior performance of our method over the state of the art by optimally solving almost all instances in the PrefLib library for multiple cycle and chain lengths.


title: Grow-Push-Prune: aligning deep discriminants for effective structural network compression

abstract: Most of today's popular deep architectures are hand-engineered to be generalists. However, this design procedure usually leads to massive redundant, useless, or even harmful features for specific tasks. Unnecessarily high complexities render deep nets impractical for many real-world applications, especially those without powerful GPU support. In this paper, we attempt to derive task-dependent compact models from a deep discriminant analysis perspective. We propose an iterative and proactive approach for classification tasks which alternates between (1) a pushing step, with an objective to simultaneously maximize class separation, penalize co-variances, and push deep discriminants into alignment with a compact set of neurons, and (2) a pruning step, which discards less useful or even interfering neurons. Deconvolution is adopted to reverse 'unimportant' filters' effects and recover useful contributing sources. A simple network growing strategy based on the basic Inception module is proposed for challenging tasks requiring larger capacity than what the base net can offer. Experiments on the MNIST, CIFAR10, and ImageNet datasets demonstrate our approach's efficacy. On ImageNet, by pushing and pruning our grown Inception-88 model, we achieve more accurate models than Inception nets generated during growing, residual nets, and popular compact nets at similar sizes. We also show that our grown Inception nets (without hard-coded dimension alignment) clearly outperform residual nets of similar complexities.


title: Sobolev inequalities in manifolds with nonnegative curvature

abstract: We prove a sharp Sobolev inequality on manifolds with nonnegative Ricci curvature. Moreover, we prove a Michael-Simon inequality for submanifolds in manifolds with nonnegative sectional curvature. Both inequalities depend on the asymptotic volume ratio of the ambient manifold.


title: Relative torsion and bordism classes of positive scalar curvature metrics on manifolds with boundary

abstract: In this paper, we define a relative $L^2$-$\rho$-invariant for Dirac operators on odd-dimensional spin manifolds with boundary and show that they are invariants of the bordism classes of positive scalar curvature metrics which are collared near the boundary. As an application, we show that if a $4k+3$-dimensional spin manifold with boundary admits such a metric and if, roughly speaking, there exists a torsion element in the difference of the fundamental groups of the manifold and its boundary, then there are infinitely many bordism classes of such psc metrics on the given manifold. This result in turn implies that the moduli-space of psc metrics on such manifolds has infinitely many path components. We also indicate how to define delocalised $\eta$-invariants for odd-dimensional spin manifolds with boundary, which could then be used to obtain similar results for $4k+1$-dimensional manifolds.


title: A problem concerning Riemann sums

abstract: An open problem concerning Riemann sums, posed by O. Furdui, is considered.


title: Adversarial Attacks Against Deep Learning Systems for ICD-9 Code Assignment

abstract: Manual annotation of ICD-9 codes is a time consuming and error-prone process. Deep learning based systems tackling the problem of automated ICD-9 coding have achieved competitive performance. Given the increased proliferation of electronic medical records, such automated systems are expected to eventually replace human coders. In this work, we investigate how a simple typo-based adversarial attack strategy can impact the performance of state-of-the-art models for the task of predicting the top 50 most frequent ICD-9 codes from discharge summaries. Preliminary results indicate that a malicious adversary, using gradient information, can craft specific perturbations, that appear as regular human typos, for less than 3% of words in the discharge summary to significantly affect the performance of the baseline model.


title: A Comprehensive Review for MRF and CRF Approaches in Pathology Image Analysis

abstract: Pathology image analysis is an essential procedure for clinical diagnosis of many diseases. To boost the accuracy and objectivity of detection, nowadays, an increasing number of computer-aided diagnosis (CAD) system is proposed. Among these methods, random field models play an indispensable role in improving the analysis performance. In this review, we present a comprehensive overview of pathology image analysis based on the markov random fields (MRFs) and conditional random fields (CRFs), which are two popular random field models. Firstly, we introduce the background of two random fields and pathology images. Secondly, we summarize the basic mathematical knowledge of MRFs and CRFs from modelling to optimization. Then, a thorough review of the recent research on the MRFs and CRFs of pathology images analysis is presented. Finally, we investigate the popular methodologies in the related works and discuss the method migration among CAD field.


title: Influence of driver behavior in the emergence of traffic gridlocks

abstract: We present a microscopic driving algorithm that prescribes the acceleration using three parameters: the distance to the leading vehicle, to the next traffic light and to the nearest stopping point when the next traffic light is in the red phase. We apply this algorithm to construct decision trees that enable two driving behaviors: aggressive and careful. The focus of this study is to analyze the amount of aggressive drivers that are needed in order to generate a traffic gridlock in a portion of a city with signalized intersections. At rush hour, aggressive drivers will enter the intersection regardless if they have enough time or space to clear it. When their traffic light changes they block other drivers, thus providing the conditions for a gridlock to develop. We find that gridlocks emerge even with very few aggressive drivers present. These results support the idea of promoting good driving behavior to avoid heavy congestion during rush hours.


title: A Flow Base Bi-path Network for Cross-scene Video Crowd Understanding in Aerial View

abstract: Drones shooting can be applied in dynamic traffic monitoring, object detecting and tracking, and other vision tasks. The variability of the shooting location adds some intractable challenges to these missions, such as varying scale, unstable exposure, and scene migration. In this paper, we strive to tackle the above challenges and automatically understand the crowd from the visual data collected from drones. First, to alleviate the background noise generated in cross-scene testing, a double-stream crowd counting model is proposed, which extracts optical flow and frame difference information as an additional branch. Besides, to improve the model's generalization ability at different scales and time, we randomly combine a variety of data transformation methods to simulate some unseen environments. To tackle the crowd density estimation problem under extreme dark environments, we introduce synthetic data generated by game Grand Theft Auto V(GTAV). Experiment results show the effectiveness of the virtual data. Our method wins the challenge with a mean absolute error (MAE) of 12.70. Moreover, a comprehensive ablation study is conducted to explore each component's contribution.


title: One Person, One Model, One World: Learning Continual User Representation without Forgetting

abstract: Learning user representations is a vital technique toward effective user modeling and personalized recommender systems. Existing approaches often derive an individual set of model parameters for each task by training on separate data. However, the representation of the same user potentially has some commonalities, such as preference and personality, even in different tasks. As such, these separately trained representations could be suboptimal in performance as well as inefficient in terms of parameter sharing. In this paper, we delve on research to continually learn user representations task by task, whereby new tasks are learned while using partial parameters from old ones. A new problem arises since when new tasks are trained, previously learned parameters are very likely to be modified, and as a result, an artificial neural network (ANN)-based model may lose its capacity to serve for well-trained previous tasks forever, this issue is termed catastrophic forgetting. To address this issue, we present \emph{Conure} the first \underline{con}tinual, or lifelong, \underline{u}ser \underline{re}presentation learner -- i.e., learning new tasks over time without forgetting old ones. Specifically, we propose iteratively removing less important weights of old tasks in a deep user representation model, motivated by the fact that neural network models are usually over-parameterized. In this way, we could learn many tasks with a single model by reusing the important weights, and modifying the less important weights to adapt to new tasks. We conduct extensive experiments on two real-world datasets with nine tasks and show that \emph{Conure} largely exceeds the standard model that does not purposely preserve such old "knowledge", and performs competitively or sometimes better than models which are trained either individually for each task or simultaneously by merging all task data.


title: On Robustness of the Normalized Subgradient Method with Randomly Corrupted Subgradients

abstract: Numerous modern optimization and machine learning algorithms rely on subgradient information being trustworthy and hence, they may fail to converge when such information is corrupted. In this paper, we consider the setting where subgradient information may be arbitrarily corrupted (with a given probability) and study the robustness properties of the normalized subgradient method. Under the probabilistic corruption scenario, we prove that the normalized subgradient method, whose updates rely solely on directional information of the subgradient, converges to a minimizer for convex, strongly convex, and weakly-pseudo convex functions satisfying certain conditions. Numerical evidence on linear regression and logistic classification problems support our results.


title: Rank of Sparse Bernoulli Matrices

abstract: Let $ A_n $ be an $n \times n$ random matrix with i.i.d Bernoulli($p$) entries. For a fixed positive integer $\beta$, suppose $p$ satisfies $$ \frac{ \log(n) }{ n } \le p \le c_\beta $$ where $c_\beta \in ( 0, 1/2 )$ is a $\beta$-dependentvalue. For $t \ge 0$, $$ \mathbb{P} \left\{ s_{ n - \beta + 1}(A) \le t n^{-2\beta + o_\mathfrak{n}(1) }(pn)^{-7} \right\} = t + ( 1 + o_\mathfrak{n}(1) ) \mathbb{P} \bigg\{ \mbox{either $\beta$ rows or $\beta$ columns of $A_n$ equal $\vec{0}$} \bigg\}. $$


title: Graph-based methods for analyzing orchard tree structure using noisy point cloud data

abstract: Digitisation of fruit trees using LiDAR enables analysis which can be used to better growing practices to improve yield. Sophisticated analysis requires geometric and semantic understanding of the data, including the ability to discern individual trees as well as identifying leafy and structural matter. Extraction of this information should be rapid, as should data capture, so that entire orchards can be processed, but existing methods for classification and segmentation rely on high-quality data or additional data sources like cameras. We present a method for analysis of LiDAR data specifically for individual tree location, segmentation and matter classification, which can operate on low-quality data captured by handheld or mobile LiDAR. Our methods for tree location and segmentation improved on existing methods with an F1 score of 0.774 and a v-measure of 0.915 respectively, while trunk matter classification performed poorly in absolute terms with an average F1 score of 0.490 on real data, though consistently outperformed existing methods and displayed a significantly shorter runtime.


title: Mapping properties of the zero-balanced hypergeometric functions

abstract: In the present paper, the order of convexity of z\Gauss(a,b;c;z) is first given under some conditions on the positive real parameters a, b and c. Then we show that the image domains of the unit disc \D under some shifted zero-balanced hypergeometric functions z\Gauss(a,b;a+b;z) are convex and bounded by two horizontal lines which solves the problem raised by Ponnusamy and Vuorinen in \cite{PonVuor:2001


title: Bespoke Neural Networks for Score-Informed Source Separation

abstract: In this paper, we introduce a simple method that can separate arbitrary musical instruments from an audio mixture. Given an unaligned MIDI transcription for a target instrument from an input mixture, we synthesize new mixtures from the midi transcription that sound similar to the mixture to be separated. This lets us create a labeled training set to train a network on the specific bespoke task. When this model applied to the original mixture, we demonstrate that this method can: 1) successfully separate out the desired instrument with access to only unaligned MIDI, 2) separate arbitrary instruments, and 3) get results in a fraction of the time of existing methods. We encourage readers to listen to the demos posted here: https://git.io/JUu5q.


title: A Fully Parallel Primal-Dual Algorithm for Centralized and Distributed Optimization

abstract: In this paper, a centralized two-block separable optimization is considered for which a fully parallel primal-dual discrete-time algorithm with fixed step size is derived based on monotone operator splitting method. In this algorithm, the primal variables are updated in an alternating fashion like Alternating Direction Method of Multipliers (ADMM). However, unlike existing discrete-time algorithms such as Method of Multipliers (MM), ADMM, Bi-Alternating Direction Method of Multipliers (BiADMM), and Primal-Dual Fixed Point (PDFP) algorithms, that all suffer from sequential updates, all primal and dual variables are updated in parallel in the sense that to update a variable at each time, updated version of other variable(s) is not required. One of advantages of the proposed algorithm is that its direct extension to multi-block optimization is still convergent. Then the method is applied to distributed optimization for which a fully parallel primal-dual distributed algorithm is obtained. Finally, since direct extension of ADMM may diverge for multi-block optimization, a numerical example of a three-block optimization is given for which the direct extension of the proposed algorithm is shown to converge to a solution.


title: G133.50+9.01: A likely cloud-cloud collision complex triggering the formation of filaments, cores and a stellar cluster

abstract: We present compelling observational evidence of G133.50+9.01 being a bona fide cloud-cloud collision candidate with signatures of induced filament, core, and cluster formation. The CO molecular line observations reveal that the G133.50+9.01 complex is made of two colliding molecular clouds with systemic velocities, -16.9 km s-1 and -14.1 km s-1. The intersection of the clouds is characterised by broad bridging features characteristic of collision. The morphology of the shocked layer at the interaction front resembles an arc like structure with enhanced excitation temperature and H2 column density. A complex network of filaments is detected in the SCUBA 850 {\mu}m image with 14 embedded dense cores, all well correlated spatially with the shocked layer. A stellar cluster revealed through an over-density of identified Class I and II young stellar objects is found located along the arc in the intersection region corroborating with a likely collision induced origin.


title: Learning Skills to Patch Plans Based on Inaccurate Models

abstract: Planners using accurate models can be effective for accomplishing manipulation tasks in the real world, but are typically highly specialized and require significant fine-tuning to be reliable. Meanwhile, learning is useful for adaptation, but can require a substantial amount of data collection. In this paper, we propose a method that improves the efficiency of sub-optimal planners with approximate but simple and fast models by switching to a model-free policy when unexpected transitions are observed. Unlike previous work, our method specifically addresses when the planner fails due to transition model error by patching with a local policy only where needed. First, we use a sub-optimal model-based planner to perform a task until model failure is detected. Next, we learn a local model-free policy from expert demonstrations to complete the task in regions where the model failed. To show the efficacy of our method, we perform experiments with a shape insertion puzzle and compare our results to both pure planning and imitation learning approaches. We then apply our method to a door opening task. Our experiments demonstrate that our patch-enhanced planner performs more reliably than pure planning and with lower overall sample complexity than pure imitation learning.


title: The Eris/Dysnomia system I: The orbit of Dysnomia

abstract: We present new results on the Eris/Dysnomia system including analysis of new images from the WFC3 instrument on the Hubble Space Telescope (HST). Seven HST orbits were awarded to program 15171 in January and February 2018, with the intervals between observations selected to sample Dysnomia over a full orbital period. Using relative astrometry of Eris and Dysnomia, we computed a best-fit Keplerian orbit for Dysnomia. Based on the Keplerian fit, we find an orbital period of 15.785899$\pm$0.000050 days, which is in good agreement with recent work. We report a non-zero eccentricity of 0.0062 at the 6.2-$\sigma$ level, despite an estimated eccentricity damping timescale of $\leq$17 Myr. Considering the volumes of both Eris and Dysnomia, the new system density was calculated to be 2.43$\pm$0.05 g cm$^{-3}$, a decrease of $\sim$4% from the previous value of 2.52$\pm$0.05 g cm$^{-3}$. The new astrometric measurements were high enough precision to break the degeneracy of the orbit pole orientation, and indicate that Dysnomia orbits in a prograde manner. The obliquity of Dysnomia's orbit pole with respect to the plane of Eris' heliocentric orbit was calculated to be 78.29$\pm$0.65$^{\circ}$ and is in agreement with previous work; the next mutual events season will occur in 2239. The Keplerian orbit fit to all the data considered in this investigation can be excluded at the 6.3-$\sigma$ level, but identifying the cause of the deviation was outside the scope of this work.


title: Semi-Supervised Node Classification by Graph Convolutional Networks and Extracted Side Information

abstract: The nodes of a graph existing in a cluster are more likely to connect to each other than with other nodes in the graph. Then revealing some information about some nodes, the structure of the graph (graph edges) provides this opportunity to know more information about other nodes. From this perspective, this paper revisits the node classification task in a semi-supervised scenario by graph convolutional networks (GCNs). The goal is to benefit from the flow of information that circulates around the revealed node labels. The contribution of this paper is twofold. First, this paper provides a method for extracting side information from a graph realization. Then a new GCN architecture is presented that combines the output of traditional GCN and the extracted side information. Another contribution of this paper is relevant to non-graph observations (independent side information) that exists beside a graph realization in many applications. Indeed, the extracted side information can be replaced by a sequence of side information that is independent of the graph structure. For both cases, the experiments on synthetic and real-world datasets demonstrate that the proposed model achieves a higher prediction accuracy in comparison to the existing state-of-the-art methods for the node classification task.


title: MetaMix: Improved Meta-Learning with Interpolation-based Consistency Regularization

abstract: Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt quickly to new tasks. However, current MAML-based algorithms have limitations in forming generalizable decision boundaries. In this paper, we propose an approach called MetaMix. It generates virtual feature-target pairs within each episode to regularize the backbone models. MetaMix can be integrated with any of the MAML-based algorithms and learn the decision boundaries generalizing better to new tasks. Experiments on the mini-ImageNet, CUB, and FC100 datasets show that MetaMix improves the performance of MAML-based algorithms and achieves state-of-the-art result when integrated with Meta-Transfer Learning.


title: Lucid Dreaming for Experience Replay: Refreshing Past States with the Current Policy

abstract: Experience replay (ER) improves the data efficiency of off-policy reinforcement learning (RL) algorithms by allowing an agent to store and reuse its past experiences in a replay buffer. While many techniques have been proposed to enhance ER by biasing how experiences are sampled from the buffer, thus far they have not considered strategies for refreshing experiences inside the buffer. In this work, we introduce Lucid Dreaming for Experience Replay (LiDER), a conceptually new framework that allows replay experiences to be refreshed by leveraging the agent's current policy. LiDER consists of three steps: First, LiDER moves an agent back to a past state. Second, from that state, LiDER then lets the agent execute a sequence of actions by following its current policy -- as if the agent were "dreaming" about the past and can try out different behaviors to encounter new experiences in the dream. Third, LiDER stores and reuses the new experience if it turned out better than what the agent previously experienced, i.e., to refresh its memories. LiDER is designed to be easily incorporated into off-policy, multi-worker RL algorithms that use ER; we present in this work a case study of applying LiDER to an actor-critic based algorithm. Results show LiDER consistently improves performance over the baseline in six Atari 2600 games. Our open-source implementation of LiDER and the data used to generate all plots in this work are available at github.com/duyunshu/lucid-dreaming-for-exp-replay.


title: Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network

abstract: In the tile-based 360-degree video streaming, predicting user's future viewpoints and developing adaptive bitrate (ABR) algorithms are essential for optimizing user's quality of experience (QoE). Traditional single-user based viewpoint prediction methods fail to achieve good performance in long-term prediction, and the recently proposed reinforcement learning (RL) based ABR schemes applied in traditional video streaming can not be directly applied in the tile-based 360-degree video streaming due to the exponential action space. Therefore, we propose a sequential reinforced 360-degree video streaming scheme with cross-user attentive network. Firstly, considering different users may have the similar viewing preference on the same video, we propose a cross-user attentive network (CUAN), boosting the performance of long-term viewpoint prediction by selectively utilizing cross-user information. Secondly, we propose a sequential RL-based (360SRL) ABR approach, transforming action space size of each decision step from exponential to linear via introducing a sequential decision structure. We evaluate the proposed CUAN and 360SRL using trace-driven experiments and experimental results demonstrate that CUAN and 360SRL outperform existing viewpoint prediction and ABR approaches with a noticeable margin.


title: Privacy Enhancement via Dummy Points in the Shuffle Model

abstract: The shuffle model is recently proposed to address the issue of severe utility loss in Local Differential Privacy (LDP) due to distributed data randomization.In the shuffle model, a shuffler is utilized to break the link between the user identity and the message uploaded to the data analyst. Since less noise needs to be introduced to achieve the same privacy guarantee, following this paradigm, the utility of privacy-preserving data collection is improved. We propose DUMP (\underline{DUM}my-\underline{P}oint-based), a framework for privacy-preserving histogram estimation in the shuffle model. The core of DUMP is a new concept of \emph{dummy blanket}, which enables enhancing privacy by just introducing \textit{points }on the user side and further improving the utility of the shuffle model.We instantiate DUMP by proposing two protocols: pureDUMP and mixDUMP, and conduct a comprehensive experimental evaluation to compare them with existing protocols. The experimental results show that, under the same privacy guarantee, (1) the proposed protocols have significant improvements in communication efficiency over all existing multi-message protocols, by at least 3 orders of magnitude; (2) they achieve competitive utility, while the only known protocol (Ghazi \textit{et al.}, PMLR 2020) having better utility than ours employs hard-to-exactly-sample distributions which are vulnerable to floating-point attacks (CCS 2012).


title: Determining the Hubble Constant with AGN-assisted Black Hole Mergers

abstract: Gravitational waves from neutron star mergers have long been considered a promising way to measure the Hubble constant, $H_0$, which describes the local expansion rate of the universe. While black hole mergers are more abundantly observed, their expected lack of electromagnetic emission and poor gravitational-wave localization make them less well suited for measuring $H_0$. Black hole mergers within the disks of Active Galactic Nuclei (AGN) could be an exception. Accretion from the AGN disk may produce an electromagnetic signal, pointing observers to the host galaxy. Alternatively, the low number density of AGNs could help identify the host galaxy of $1-5\%$ of mergers. Here we show that black hole mergers in AGN disks may be a sensitive way to determine $H_0$ with gravitational waves. If $1\%$ ($10\%$) of LIGO's observations occur in AGN disks with identified host galaxies, we could measure $H_0$ with $12\%$ ($4\%$) uncertainty in five years, possibly comparable to the sensitivity of neutron star mergers and set to considerably improve current gravitational wave measurements.


title: Magnetic corrections to the boson self-coupling and boson-fermion coupling in the linear sigma model with quarks

abstract: We compute the magnetic field-induced modifications to the boson self-coupling and the boson-fermion coupling, in the static limit, using an effective model of QCD, the linear sigma model with quarks. The former is computed for arbitrary field strengths as well as using the strong field approximation. The latter is obtained in the strong field limit. The arbitrary field result for the boson self-coupling depends on the ultraviolet renormalization scale and this dependence cannot be removed by a simple vacuum subtraction. Using the strong field result as a guide, we find the appropriate choice for this scale and discuss the physical implications. The boson-fermion coupling depends on the Schwinger's phase and we show how this phase can be treated consistently in such a way that the magnetic field induced vertex modification is both gauge invariant and can be written with an explicit factor corresponding to energy-momentum conservation for the external particles. Both couplings show a modest decrease with the field strength.


title: Competition Alleviates Present Bias in Task Completion

abstract: We build upon recent work [Kleinberg and Oren, 2014, Kleinberg et al., 2016, 2017] that considers present biased agents, who place more weight on costs they must incur now than costs they will incur in the future. They consider a graph theoretic model where agents must complete a task and show that present biased agents can take exponentially more expensive paths than optimal. We propose a theoretical model that adds competition into the mix -- two agents compete to finish a task first. We show that, in a wide range of settings, a small amount of competition can alleviate the harms of present bias. This can help explain why biased agents may not perform so poorly in naturally competitive settings, and can guide task designers on how to protect present biased agents from harm. Our work thus paints a more positive picture than much of the existing literature on present bias.


title: Lattice-motivated QCD coupling and hadronic contribution to muon $g-2$

abstract: We present an updated version of a QCD coupling which fulfills various physically motivated conditions: at high momenta it practically coincides with the perturbative QCD (pQCD) coupling; at intermediate momenta it reproduces correctly the physics of the semihadronic tau decay; and at very low momenta it is suppressed as suggested by large-volume lattice calculations. An earlier presented analysis is updated here in the sense that the Adler function, in the regime $|Q^2| \lesssim 1 \ {\rm GeV}^2$, is evaluated by a renormalon-motivated resummation method. This Adler function is then used here in the evaluation of the quantities related with the semihadronic (strangeless) $\tau$-decay spectral functions, including Borel-Laplace sum rules in the (V+A)-channel. The analysis is then extended to the evaluation of the hadronic vacuum polarization contribution to the muon anomalous magnetic moment, $a_{\mu}^{\rm had(1)}$, where we include in the Adler function the V-channel higher-twist OPE terms which are regulated in the infrared (IR) by mass parameters which are expected to be $\lesssim 1$ GeV. The correct value of $a_{\mu}^{\rm had(1)}$ can be reproduced with the mentioned IR-regulating mass parameters if the value of the condensate $\langle O_4 \rangle_{\rm V+A}$ is positive (and thus the gluon condensate value is positive). This restriction and the requirement of the acceptable quality of the fits to the various mentioned sum rules then lead us to the restriction $0.1171 < \alpha_s(M_Z^2;{\overline{MS}}) < 0.1180$.


title: SwiftFace: Real-Time Face Detection

abstract: Computer vision is a field of artificial intelligence that trains computers to interpret the visual world in a way similar to that of humans. Due to the rapid advancements in technology and the increasing availability of sufficiently large training datasets, the topics within computer vision have experienced a steep growth in the last decade. Among them, one of the most promising fields is face detection. Being used daily in a wide variety of fields; from mobile apps and augmented reality for entertainment purposes, to social studies and security cameras; designing high-performance models for face detection is crucial. On top of that, with the aforementioned growth in face detection technologies, precision and accuracy are no longer the only relevant factors: for real-time face detection, speed of detection is essential. SwiftFace is a novel deep learning model created solely to be a fast face detection model. By focusing only on detecting faces, SwiftFace performs 30% faster than current state-of-the-art face detection models. Code available at https://github.com/leo7r/swiftface


title: Ergodic Control Strategy for Multi-Agent Environment Exploration

abstract: In this study, an ergodic environment exploration problem is introduced for a centralized multi-agent system. Given the reference distribution represented by the Mixture of Gaussian (MoG), the ergodicity is achieved when the time-averaged robot distribution is identical to the given reference distribution. The major challenge associated with this problem is to determine proper timing for a team of agents (robots) to visit each Gaussian component in the reference MoG for ergodicity. The ergodic function is defined as a measure of ergodicity and the condition for convergence is derived based on timing analysis. The proposed control strategy provides relatively reasonable performance to achieve the ergodicity. We provide the formal algorithm for centralized multi-agent control to achieve the ergodicity and simulation results are presented for the validation of the proposed algorithm.


title: Waveform Design and Accurate Channel Estimation for Frequency-Hopping MIMO Radar-Based Communications

abstract: Frequency-hopping (FH) MIMO radar-based dual-function radar communication (FH-MIMO DFRC) enables communication symbol rate to exceed radar pulse repetition frequency, which requires accurate estimations of timing offset and channel parameters. The estimations, however, are challenging due to unknown, fast-changing hopping frequencies and the multiplicative coupling between timing offset and channel parameters. In this paper, we develop accurate methods for a single-antenna communication receiver to estimate timing offset and channel for FH-MIMO DFRC. First, we design a novel FH-MIMO radar waveform, which enables a communication receiver to estimate the hopping frequency sequence (HFS) used by radar, instead of acquiring it from radar. Importantly, the novel waveform incurs no degradation to radar ranging performance. Then, via capturing distinct HFS features, we develop two estimators for timing offset and derive mean squared error lower bound of each estimator. Using the bounds, we design an HFS that renders both estimators applicable. Furthermore, we develop an accurate channel estimation method, reusing the single hop for timing offset estimation. Validated by simulations, the accurate channel estimates attained by the proposed methods enable the communication performance of DFRC to approach that achieved based on perfect timing and ideal knowledge of channel.


title: Stationary solution for quasi-homogeneous small-scale magnetic field advected by non-Gaussian turbulent flow

abstract: We consider fluctuations of magnetic field excited by external force and advected by isotropic turbulent flow. It appears that non-Gaussian velocity gradient statistics and finite region of pumping force provide the existence of stationary solution. The mean-square magnetic field is calculated for arbitrary velocity gradient statistics. An estimate for possible feedback of magnetic field on velocity shows that, for wide range of parameters, stationarity without feedback would take place even in the case of intensive pumping of magnetic field.


title: Dynamic Slicing for Deep Neural Networks

abstract: Program slicing has been widely applied in a variety of software engineering tasks. However, existing program slicing techniques only deal with traditional programs that are constructed with instructions and variables, rather than neural networks that are composed of neurons and synapses. In this paper, we propose NNSlicer, the first approach for slicing deep neural networks based on data flow analysis. Our method understands the reaction of each neuron to an input based on the difference between its behavior activated by the input and the average behavior over the whole dataset. Then we quantify the neuron contributions to the slicing criterion by recursively backtracking from the output neurons, and calculate the slice as the neurons and the synapses with larger contributions. We demonstrate the usefulness and effectiveness of NNSlicer with three applications, including adversarial input detection, model pruning, and selective model protection. In all applications, NNSlicer significantly outperforms other baselines that do not rely on data flow analysis.


title: Thin accretion disk signatures of scalarized black holes in Einstein-scalar-Gauss-Bonnet gravity

abstract: Einstein-scalar-Gauss-Bonnet gravity has recently been known to exhibit spontaneous scalarization. In the presence of the Gauss-Bonnet term the no-hair theorem can be evaded and novel black hole solutions with non-trivial scalar fields have been found besides the general relativistic solutions. In this paper, we aim to investigate the possibility of observationally testing Einstein-scalar-Gauss-Bonnet gravity using thin accretion disk properties around such scalarized black holes. Using the Novikov-Thorne model, we numerically calculate the electromagnetic flux, temperature distribution, emission spectrum, innermost stable circular orbits and energy conversion efficiency of accretion disks around such black holes and compare the results with the standard general relativistic Schwarzschild solution. We find that the accretion disks around scalarized black holes are hotter and more luminous than in general relativity.


title: Distributed Online Linear Quadratic Control for Linear Time-invariant Systems

abstract: Classical linear quadratic (LQ) control centers around linear time-invariant (LTI) systems, where the control-state pairs introduce a quadratic cost with time-invariant parameters. Recent advancement in online optimization and control has provided novel tools to study LQ problems that are robust to time-varying cost parameters. Inspired by this line of research, we study the distributed online LQ problem for identical LTI systems. Consider a multi-agent network where each agent is modeled as an LTI system. The LTI systems are associated with decoupled, time-varying quadratic costs that are revealed sequentially. The goal of the network is to make the control sequence of all agents competitive to that of the best centralized policy in hindsight, captured by the notion of regret. We develop a distributed variant of the online LQ algorithm, which runs distributed online gradient descent with a projection to a semi-definite programming (SDP) to generate controllers. We establish a regret bound scaling as the square root of the finite time-horizon, implying that agents reach consensus as time grows. We further provide numerical experiments verifying our theoretical result.


title: Integrating Secure and High-Speed Communications into Frequency Hopping MIMO Radar

abstract: Dual-function radar-communication (DFRC) based on frequency hopping (FH) MIMO radar (FH-MIMO DFRC) achieves symbol rate much higher than radar pulse repetition frequency. Such DFRC, however, is prone to eavesdropping due to the spatially uniform illumination of FH-MIMO radar. How to enhance the physical layer security of FH-MIMO DFRC is vital yet unsolved. In this paper, we reveal the potential of using permutations of hopping frequencies to achieve secure and high-speed FH-MIMO DFRC. Detecting permutations at a communication user is challenging due to the dependence on spatial angle. We propose a series of baseband waveform processing methods which address the challenge specifically for the legitimate user (Bob) and meanwhile scrambles constellations almost omnidirectionally. We discover a deterministic sign rule from the signals processed by the proposed methods. Based on the rule, we develop accurate algorithms for information decoding at Bob. Confirmed by simulation, our design achieves substantially high physical layer security for FH-MIMO DFRC, improves decoding performance compared with existing designs and reduces mutual interference among radar targets.


title: The star-structure connectivity and star-substructure connectivity of hypercubes and folded hypercubes

abstract: As a generalization of vertex connectivity, for connected graphs $G$ and $T$, the $T$-structure connectivity $\kappa(G, T)$ (resp. $T$-substructure connectivity $\kappa^{s}(G, T)$) of $G$ is the minimum cardinality of a set of subgraphs $F$ of $G$ that each is isomorphic to $T$ (resp. to a connected subgraph of $T$) so that $G-F$ is disconnected. For $n$-dimensional hypercube $Q_{n}$, Lin et al. [6] showed $\kappa(Q_{n},K_{1,1})=\kappa^{s}(Q_{n},K_{1,1})=n-1$ and $\kappa(Q_{n},K_{1,r})=\kappa^{s}(Q_{n},K_{1,r})=\lceil\frac{n}{2}\rceil$ for $2\leq r\leq 3$ and $n\geq 3$. Sabir et al. [11] obtained that $\kappa(Q_{n},K_{1,4})=\kappa^{s}(Q_{n},K_{1,4})=\lceil\frac{n}{2}\rceil$ for $n\geq 6$, and for $n$-dimensional folded hypercube $FQ_{n}$, $\kappa(FQ_{n},K_{1,1})=\kappa^{s}(FQ_{n},K_{1,1})=n$, $\kappa(FQ_{n},K_{1,r})=\kappa^{s}(FQ_{n},K_{1,r})=\lceil\frac{n+1}{2}\rceil$ with $2\leq r\leq 3$ and $n\geq 7$. They proposed an open problem of determining $K_{1,r}$-structure connectivity of $Q_n$ and $FQ_n$ for general $r$. In this paper, we obtain that for each integer $r\geq 2$, $\kappa(Q_{n};K_{1,r})=\kappa^{s}(Q_{n};K_{1,r})=\lceil\frac{n}{2}\rceil$ and $\kappa(FQ_{n};K_{1,r})=\kappa^{s}(FQ_{n};K_{1,r})= \lceil\frac{n+1}{2}\rceil$ for all integers $n$ larger than $r$ in quare scale. For $4\leq r\leq 6$, we separately confirm the above result holds for $Q_n$ in the remaining cases.


title: Double Graph Based Reasoning for Document-level Relation Extraction

abstract: Document-level relation extraction aims to extract relations among entities within a document. Different from sentence-level relation extraction, it requires reasoning over multiple sentences across a document. In this paper, we propose Graph Aggregation-and-Inference Network (GAIN) featuring double graphs. GAIN first constructs a heterogeneous mention-level graph (hMG) to model complex interaction among different mentions across the document. It also constructs an entity-level graph (EG), based on which we propose a novel path reasoning mechanism to infer relations between entities. Experiments on the public dataset, DocRED, show GAIN achieves a significant performance improvement (2.85 on F1) over the previous state-of-the-art. Our code is available at https://github.com/DreamInvoker/GAIN .


title: Spin splitting and spin Hall conductivity in buckled monolayers of the group 14: First-principles calculations

abstract: Elemental monolayers of the group 14 with a buckled honeycomb structure, namely silicene, germanene, stanene, and plumbene, are known to demonstrate a spin splitting as a result of an electric field parallel to their high symmetry axis which is capable of tuning their topological phase between a quantum spin Hall insulator and an ordinary band insulator. We perform first-principles calculations based on the density functional theory to quantify the spin-dependent band gaps and the spin splitting as a function of the applied electric field and extract the main coefficients of the invariant Hamiltonian. Using the linear response theory and the Wannier interpolation method, we calculate the spin Hall conductivity in the monolayers and study its sensitivity to an external electric field. Our results show that the spin Hall conductivity is not quantized and in the case of silicene, germanene, and stanene degrades significantly as the electric field inverts the band gap and brings the monolayer into the trivial phase. The electric field induced band gap does not close in the case of plumbene which shows a spin Hall conductivity that is robust to the external electric field.


title: A Possible $\gamma$-ray Quasi-periodic Oscillation of $\sim$ 314 days in the Blazar OJ 287

abstract: We report the detection of a probable $\gamma$-ray quasi-periodic oscillation (QPO) of around 314 days in the monthly binned 0.1 -- 300 GeV $\gamma$-ray {\it Fermi}-LAT light curve of the well known BL Lac blazar OJ 287. To identify and quantify the QPO nature of the $\gamma$-ray light curve of OJ 287, we used the Lomb-Scargle periodogram (LSP), REDFIT, and weighted wavelet z-transform (WWZ) analyses. We briefly discuss possible emission models for radio-loud active galactic nuclei (AGN) that can explain a $\gamma$-ray QPO of such a period in a blazar. Reports of changes in the position of quasi-stationary radio knots over a yearly timescale as well as a strong correlation between gamma-ray and mm-radio emission in previous studies indicate that the signal is probably associated with these knots.


title: Geometric Loss for Deep Multiple Sclerosis lesion Segmentation

abstract: Multiple sclerosis (MS) lesions occupy a small fraction of the brain volume, and are heterogeneous with regards to shape, size and locations, which poses a great challenge for training deep learning based segmentation models. We proposed a new geometric loss formula to address the data imbalance and exploit the geometric property of MS lesions. We showed that traditional region-based and boundary-aware loss functions can be associated with the formula. We further develop and instantiate two loss functions containing first- and second-order geometric information of lesion regions to enforce regularization on optimizing deep segmentation models. Experimental results on two MS lesion datasets with different scales, acquisition protocols and resolutions demonstrated the superiority of our proposed methods compared to other state-of-the-art methods.


title: A fundamental domain for $PGL(2,\mathbb{F}_q[t])\backslash PGL\!\left(2,\mathbb{F}_q\!\left(\!(t^{-1})\!\right)\!\right)$

abstract: We give a strong fundamental domain for the quotient of $PGL_2\!\left(\mathbb{F}_q(\!(t^{-1})\!)\!\right)$ by $PGL_2\!\left(\mathbb{F}_q[t]\right)$ as a subset of distinct ordered triple points of $\mathbb{P}^1(\mathbb{F}_q(\!(t^{-1})\!))$.


title: Organic matter in interstellar dust lost at the approach to the heliosphere: Exothermic chemical reactions of free radicals ignited by the Sun

abstract: Aims. We tackle the conundrums of organic materials missing from interstellar dust when measured inside the Solar System, while undoubtedly existing in the local interstellar cloud (LIC), which surrounds the Solar System. Methods. We present a theoretical argument that organic compounds sublimate almost instantaneously by exothermic reactions, when solar insolation triggers the recombination of free radicals or the rearrangement of carbon bonds in the compounds. Results. It turns out that the triggering temperature lies in the range of 20$-$50 K by considering that sublimation of organic materials takes place beyond the so-called filtration region of interstellar neutral atoms. We find that in-situ measurements of LIC dust in the Solar System result in an overestimate for the gas-to-dust mass ratio of the LIC, unless the sublimation of organic materials is taken into account. We also find that previous measurements of interstellar pickup ions have determined the total elemental abundances of gas and organic materials, instead of interstellar gas alone. Conclusions. We conclude that LIC organic matter suffers from sublimation en route to the heliosphere, implying that our understanding of LIC dust from space missions is incomplete. Since space missions inside the orbit of Saturn cannot give any information on the organic substances of LIC dust, one must await a future exploration mission to the inner edge of the Oort cloud for a thorough understanding of organic substances in the LIC. Once our model for the sublimation of interstellar organic matter by exothermic chemical reactions of free radicals is confirmed, the hypothesis of panspermia from the diffuse interstellar medium is ruled out.


title: How do Visualization Designers Think? Design Cognition as a Core Aspect of Visualization Psychology

abstract: There are numerous opportunities for engaging in research at the intersection of psychology and visualization. While most opportunities taken up by the VIS community will likely focus on the psychology of users, there are also opportunities for studying the psychology of designers. In this position paper, I argue the importance of studying design cognition as a necessary component of a holistic program of research on visualization psychology. I provide a brief overview of research on design cognition in other disciplines, and discuss opportunities for VIS to build an analogous research program. Doing so can lead to a stronger integration of research and design practice, can provide a better understanding of how to educate and train future designers, and will likely surface both challenges and opportunities for future research.


title: Fast Parameter Estimation of Binary Mergers for Multimessenger Followup

abstract: Significant human and observational resources have been dedicated to electromagnetic followup of gravitational-wave events detected by Advanced LIGO and Virgo. As the sensitivity of LIGO and Virgo improves, the rate of sources detected will increase. Margalit & Metzger (2019; arXiv:1904.11995) have suggested that it may be necessary to prioritize observations of future events. Optimal prioritization requires a rapid measurement of a gravitational-wave event's masses and spins, as these can determine the nature of any electromagnetic emission. We extend the relative binning method of Zackay et al. (2018; arXiv:1806.08792) to a coherent detector-network statistic. We show that the method can be seeded from the output of a matched-filter search and used in a Bayesian parameter measurement framework to produce marginalized posterior probability densities for the source's parameters within 20 minutes of detection on 32 CPU cores. We demonstrate that this algorithm produces unbiased estimates of the parameters with the same accuracy as running parameter estimation using the standard gravitational-wave likelihood. We encourage the adoption of this method in future LIGO-Virgo observing runs to allow fast dissemination of the parameters of detected events so that the observing community can make best use of its resources.


title: A Dixmier-Malliavin theorem for Lie groupoids

abstract: A famous theorem of Dixmier-Malliavin asserts that every smooth, compactly-supported function on a Lie group can be expressed as a finite sum in which each term is the convolution, with respect to Haar measure, of two such functions. We establish that the same holds for a Lie groupoid. Most of the heavy lifting is done by a lemma in the original work of Dixmier-Malliavin. We also need the technology of Lie algebroids and the corresponding notion of exponential map. As an application, we obtain a result on the arithmetic of ideals in the smooth convolution algebra of a Lie groupoid arising from functions vanishing to given order on an invariant submanifold of the unit space.


title: Formal Verification of Arithmetic RTL: Translating Verilog to C++ to ACL2

abstract: We present a methodology for formal verification of arithmetic RTL designs that combines sequential logic equivalence checking with interactive theorem proving. An intermediate model of a Verilog module is hand-coded in Restricted Algorithmic C (RAC), a primitive subset of C augmented by the integer and fixed-point register class templates of Algorithmic C. The model is designed to be as abstract and compact as possible, but sufficiently faithful to the RTL to allow efficient equivalence checking with a commercial tool. It is then automatically translated to the logic of ACL2, enabling a mechanically checked proof of correctness with respect to a formal architectural specification. In this paper, we describe the RAC language, the translation process, and some techniques that facilitate formal analysis of the resulting ACL2 code.


title: Iteration in ACL2

abstract: Iterative algorithms are traditionally expressed in ACL2 using recursion. On the other hand, Common Lisp provides a construct, loop, which -- like most programming languages -- provides direct support for iteration. We describe an ACL2 analogue loop$ of loop that supports efficient ACL2 programming and reasoning with iteration.


title: New Rewriter Features in FGL

abstract: FGL is a successor to GL, a proof procedure for ACL2 that allows complicated finitary conjectures to be translated into efficient Boolean function representations and proved using SAT solvers. A primary focus of FGL is to allow greater programmability using rewrite rules. While the FGL rewriter is modeled on ACL2's rewriter, we have added several features in order to make rewrite rules more powerful. A particular focus is to make it more convenient for rewrite rules to use information from the syntactic domain, allowing them to replace built-in primitives and meta rules in many cases. Since it is easier to write, maintain, and prove the soundness of rewrite rules than to do the same for rules programmed at the syntactic level, these features help make it feasible for users to precisely program the behavior or the rewriter. We describe the new features that FGL's rewriter implements, discuss the solutions to some technical problems that we encountered in their implementation, and assess the feasibility of adding these features to the ACL2 rewriter.


title: Computing and Proving Well-founded Orderings through Finite Abstractions

abstract: A common technique for checking properties of complex state machines is to build a finite abstraction then check the property on the abstract system -- where a passing check on the abstract system is only transferred to the original system if the abstraction is proven to be representative. This approach does require the derivation or definition of the finite abstraction, but can avoid the need for complex invariant definition. For our work in checking progress of memory transactions in microprocessors, we need to prove that transactions in complex state machines always make progress to completion. As a part of this effort, we developed a process for computing a finite abstract graph of the target state machine along with annotations on whether certain measures decrease or not on arcs in the abstract graph. We then iteratively divide the abstract graph by splitting into strongly connected components and then building a measure for every node in the abstract graph which is ensured to be reducing on every transition of the original system guaranteeing progress. For finite state target systems (e.g. hardware designs), we present approaches for extracting the abstract graph efficiently using incremental SAT through GL and then the application of our process to check for progress. We present an implementation of the Bakery algorithm as an example application.


title: RP-Rewriter: An Optimized Rewriter for Large Terms in ACL2

abstract: RP-Rewriter (Retain-Property) is a verified clause processor that can use some of the existing ACL2 rewrite rules to prove conjectures through term rewriting. Optimized for conjectures that can expand into large terms, the rewriter tries to mimic some of the ACL2 rewriting heuristics but also adds some extra features. It can attach side-conditions to terms that help the rewriter retain properties about them and prevent possibly some very expensive backchaining. The rewriter supports user-defined complex meta rules that can return a special structure to prevent redundant rewriting. Additionally, it can store fast alists even when values are not quoted. RP-Rewriter is utilized for two applications, multiplier design proofs and SVEX simplification, which involve very large terms.


title: Quadratic Extensions in ACL2

abstract: Given a field K, a quadratic extension field L is an extension of K that can be generated from K by adding a root of a quadratic polynomial with coefficients in K. This paper shows how ACL2(r) can be used to reason about chains of quadratic extension fields Q = K_0, K_1, K_2, ..., where each K_i+1 is a quadratic extension field of K_i. Moreover, we show that some specific numbers, such as the cube root of 2 and the cosine of pi/9, cannot belong to any of the K_i, simply because of the structure of quadratic extension fields. In particular, this is used to show that the cube root of 2 and cosine of pi/9 are not rational.


title: Generating Mutually Inductive Theorems from Concise Descriptions

abstract: We describe defret-mutual-generate, a utility for proving ACL2 theorems about large mutually recursive cliques of functions. This builds on previous tools such as defret-mutual and make-flag, which automate parts of the process but still require a theorem body to be written out for each function in the clique. For large cliques, this tends to mean that certain common hypotheses and conclusions are repeated many times, making proofs difficult to read, write, and maintain. This utility automates several of the most common patterns that occur in these forms, such as including hypotheses based on formal names or types. Its input language is rich enough to support forms that have some common parts and some unique parts per function. One application of defret-mutual-generate has been to support proofs about the FGL rewriter, which consists of a mutually recursive clique of 49 functions. The use of this utility reduced the size of the forms that express theorems about this clique by an order of magnitude. It also greatly has reduced the need to edit theorem forms when changing definitions in the clique, even when adding or removing functions.


title: In-Order Sliding-Window Aggregation in Worst-Case Constant Time

abstract: Sliding-window aggregation is a widely-used approach for extracting insights from the most recent portion of a data stream. The aggregations of interest can usually be expressed as binary operators that are associative but not necessarily commutative nor invertible. Non-invertible operators, however, are difficult to support efficiently. In a 2017 conference paper, we introduced DABA, the first algorithm for sliding-window aggregation with worst-case constant time. Before DABA, if a window had size $n$, the best published algorithms would require $O(\log n)$ aggregation steps per window operation---and while for strictly in-order streams, this bound could be improved to $O(1)$ aggregation steps on average, it was not known how to achieve an $O(1)$ bound for the worst-case, which is critical for latency-sensitive applications. This article is an extended version of our 2017 paper. Besides describing DABA in more detail, this article introduces a new variant, DABA Lite, which achieves the same time bounds in less memory. Whereas DABA requires space for storing $2n$ partial aggregates, DABA Lite only requires space for $n+2$ partial aggregates. Our experiments on synthetic and real data support the theoretical findings.


title: Ethereum's Recursive Length Prefix in ACL2

abstract: Recursive Length Prefix (RLP) is used to encode a wide variety of data in Ethereum, including transactions. The work described in this paper provides a formal specification of RLP encoding and a verified implementation of RLP decoding, developed in the ACL2 theorem prover. This work has led to improvements to the Ethereum documentation and additions to the Ethereum test suite.


title: Hybrid Heavy-Ball Systems: Reset Methods for Optimization with Uncertainty

abstract: Momentum methods for convex optimization often rely on precise choices of algorithmic parameters, based on knowledge of problem parameters, in order to achieve fast convergence, as well as to prevent oscillations that could severely restrict applications of these algorithms to cyber-physical systems. To address these issues, we propose two dynamical systems, named the Hybrid Heavy-Ball System and Hybrid-inspired Heavy-Ball System, which employ a feedback mechanism for driving the momentum state toward zero whenever it points in undesired directions. We describe the relationship between the proposed systems and their discrete-time counterparts, deriving conditions based on linear matrix inequalities for ensuring exponential rates in both continuous time and discrete time. We provide numerical LMI results to illustrate the effects of our reset mechanisms on convergence rates in a setting that simulates uncertainty of problem parameters. Finally, we numerically demonstrate the efficiency and avoidance of oscillations of the proposed systems when solving both strongly convex and non-strongly convex problems.


title: Isomorphic Data Type Transformations

abstract: In stepwise derivations of programs from specifications, data type refinements are common. Many data type refinements involve isomorphic mappings between the more abstract and more concrete data representations. Examples include refinement of finite sets to duplicate-free ordered lists or to bit vectors, adding record components that are functions of the other fields to avoid expensive recomputation, etc. This paper describes the APT (Automated Program Transformations) tools to carry out isomorphic data type refinements in the ACL2 theorem prover and gives examples of their use. Because of the inherent symmetry of isomorphisms, these tools are also useful to verify existing programs, by turning more concrete data representations into more abstract ones to ease verification. Typically, a data type will have relatively few interface functions that access the internals of the type. Once versions of these interface functions have been derived that work on the isomorphic type, higher-level functions can be derived simply by substituting the old functions for the new ones. We have implemented the APT transformations isodata to generate the former, and propagate-iso for generating the latter functions as well as theorems about the generated functions from the theorems about the original functions. Propagate-iso also handles cases where the type is a component of a more complex one such as a list of the type or a record that has a field of the type: the isomorphism on the component type is automatically lifted to an isomorphism on the more complex type. As with all APT transformations, isodata and propagate-iso generate proofs of the relationship of the transformed functions to the originals.


title: Trust-Region Method with Deep Reinforcement Learning in Analog Design Space Exploration

abstract: This paper introduces new perspectives on analog design space search. To minimize the time-to-market, this endeavor better cast as constraint satisfaction problem than global optimization defined in prior arts. We incorporate model-based agents, contrasted with model-free learning, to implement a trust-region strategy. As such, simple feed-forward networks can be trained with supervised learning, where the convergence is relatively trivial. Experiment results demonstrate orders of magnitude improvement on search iterations. Additionally, the unprecedented consideration of PVT conditions are accommodated. On circuits with TSMC 5/6nm process, our method achieve performance surpassing human designers. Furthermore, this framework is in production in industrial settings.