title: Audio-Visual Instance Discrimination with Cross-Modal Agreement

abstract: We present a self-supervised learning approach to learn audio-visual representations from video and audio. Our method uses contrastive learning for cross-modal discrimination of video from audio and vice-versa. We show that optimizing for cross-modal discrimination, rather than within-modal discrimination, is important to learn good representations from video and audio. With this simple but powerful insight, our method achieves highly competitive performance when finetuned on action recognition tasks. Furthermore, while recent work in contrastive learning defines positive and negative samples as individual instances, we generalize this definition by exploring cross-modal agreement. We group together multiple instances as positives by measuring their similarity in both the video and audio feature spaces. Cross-modal agreement creates better positive and negative sets, which allows us to calibrate visual similarities by seeking within-modal discrimination of positive instances, and achieve significant gains on downstream tasks.


title: Stochastic filtering of a pure jump process with predictable jumps and path-dependent local characteristics

abstract: The objective of this paper is to study the filtering problem for a system of partially observable processes $(X, Y)$, where $X$ is a non-Markovian pure-jump process representing the signal and $Y$ is a general jump-diffusion which provides observations. Our model covers the case where both processes are not necessarily quasi left-continuous, allowing them to jump at predictable stopping times. By introducing the Markovian version of the signal, we are able to compute an explicit equation for the filtering process via the innovations approach.


title: Asymptotics for Nonlinear Integral Equations with a Generalized Heat Kernel using Renormalization Group Technique II: Marginal Perturbations and Logarithmic Corrections to the Time Decay of Solutions

abstract: In this paper, we proceed with the analysis started in \cite{bib:braga-mor-souza} and, using the Renormalization Group method, we obtain logarithmic corrections to the decay of solutions for a class of nonlinear integral equations whenever the nonlinearities are classified as marginal in the Renormalization Group sense.


title: The evolution of the broadband temporal features observed in the black-hole transient MAXI J1820+070 with Insight-HXMT

abstract: We study the evolution of the temporal properties of MAXI 1820+070 during the 2018 outburst in its hard state from MJD 58190 to 58289 with Insight-HXMT in a broad energy band 1-150 keV. We find different behaviors of the hardness ratio, the fractional rms and time lag before and after MJD 58257, suggesting a transition occurred at around this point. The observed time lags between the soft photons in the 1-5 keV band and the hard photons in higher energy bands, up to 150 keV, are frequency-dependent: the time lags in the low-frequency range, 2-10 mHz, are both soft and hard lags with a timescale of dozens of seconds but without a clear trend along the outburst; the time lags in the high-frequency range, 1-10 Hz, are only hard lags with a timescale of tens of milliseconds; first increase until around MJD 58257 and decrease after this date. The high-frequency time lags are significantly correlated to the photon index derived from the fit to the quasi-simultaneous NICER spectrum in the 1-10 keV band. This result is qualitatively consistent with a model in which the high-frequency time lags are produced by Comptonization in a jet.


title: Subexponential decay and regularity estimates for eigenfunctions of localization operators

abstract: We consider time-frequency localization operators $A_a^{\varphi_1,\varphi_2}$ with symbols $a$ in the wide weighted modulation space $ M^\infty_{w}(\mathbb{R}^{2d})$, and windows $ \varphi_1, \varphi_2 $ in the Gelfand-Shilov space $\mathcal{S}^{\left(1\right)}(\mathbb{R}^{d})$. If the weights under consideration are of ultra-rapid growth, we prove that the eigenfunctions of $A_a^{\varphi_1,\varphi_2}$ have appropriate subexponential decay in phase space, i.e. that they belong to the Gefand-Shilov space $ \mathcal{S}^{(\gamma)} (\mathbb{R}^{d}) $, where the parameter $\gamma \geq 1 $ is related to the growth of the considered weight. An important role is played by $\tau$-pseudodifferential operators $\mathrm{Op}_\tau(\sigma)$. In that direction we show convenient continuity properties of $\mathrm{Op}_\tau(\sigma)$ when acting on weighted modulation spaces. Furthermore, we prove subexponential decay and regularity properties of the eigenfunctions of $\mathrm{Op}_\tau(\sigma)$ when the symbol $\sigma$ belongs to a modulation space with appropriately chosen weight functions. As a tool we also prove new convolution relations for (quasi-)Banach weighted modulation spaces.


title: Constraints on a Massive Double-Copy and Applications to Massive Gravity

abstract: We propose and study a BCJ double-copy of massive particles, showing that it is equivalent to a KLT formula with a kernel given by the inverse of a matrix of massive bi-adjoint scalar amplitudes. For models with a uniform non-zero mass spectrum we demonstrate that the resulting double-copy factors on physical poles and that up to at least 5-particle scattering, color-kinematics satisfying numerators always exist. For the scattering of 5 or more particles, the procedure generically introduces spurious singularities that must be cancelled by imposing additional constraints. When massive particles are present, color-kinematics duality is not enough to guarantee a physical double-copy. As an example, we apply the formalism to massive Yang-Mills and show that up to 4-particle scattering the double-copy construction generates physical amplitudes of a model of dRGT massive gravity coupled to a dilaton and a two-form with dilaton parity violating couplings. We show that the spurious singularities in the 5-particle double-copy do not cancel in this example, and the construction fails to generate physically sensible amplitudes. We conjecture sufficient constraints on the mass spectrum, which in addition to massive BCJ relations, guarantee the absence of spurious singularities.


title: New Insights on Lepton Number and Dark Matter

abstract: Dark matter (DM) is usually assumed to be stabilized by a symmetry, which is mostly considered to be $Z_2$. For example, in supersymmetry it is $R$ parity, i.e. $(-1)^{3B+L+2j}$. However, it may be $Z_n$ or $U(1)_D$, and derivable from generalized lepton number. In this context, neutrinos may be Majorana or Dirac, and owe their masses to dark matter, i.e. they are scotogenic.


title: Analyzing COVID-19 pandemic with a new growth model for population ecology

abstract: We have proposed a new form of growth rate for population ecology. Generally, the growth rate is dependent on the size of the population at that particular epoch. We have introduced an alternative time-dependent form of growth rate. This form satisfies essential conditions to represent population growth and can be an alternative form for growth models to analyze population dynamics. We have employed the generalized Richards model as a guideline to compare our results. Further, we have applied our model in the case of epidemics. To check the efficacy of our model, we have verified the 2003 SARS data. This model has estimated the final epidemic size with good accuracy. Thereafter, we intend to describe the present COVID-2019 pandemic. We have performed our analysis with data for Italy, Spain, and Germany. Following, we have tried to predict the number of COVID-19 cases and the turning point for the USA, UK, and India.


title: Dynamic iteration schemes and port-Hamiltonian formulation in coupled DAE circuit simulation

abstract: Electric circuits are usually described by charge- and flux-oriented modified nodal analysis. In this paper, we derive models as port-Hamiltonian systems on several levels: overall systems, multiply coupled systems and systems within dynamic iteration procedures. To this end, we introduce new classes of port-Hamiltonian differential-algebraic equations. Thereby, we additionally allow for nonlinear dissipation on a subspace of the state space. Both, each subsystem and the overall system, possess a port-Hamiltonian structure. A structural analysis is performed for the new setups. Dynamic iteration schemes are investigated and we show that the Jacobi approach as well as an adapted Gauss-Seidel approach lead to port-Hamiltonian differential-algebraic equations.


title: The Solar Eclipses of the Pharaoh Akhenaten

abstract: We suggest an earlier date for the accession of the pharaoh Akhenaten of the New Kingdom in Egypt. His first year of reign would be placed in 1382 BCE. This conjecture is based on the possible witness of three annular eclipses of the sun during his lifetime: in 1399, 1389, and 1378 BCE. They would explain the motive for his worship of the sun that left its mark on later religious communities. Evidence from Akhenaten's era is scarce, though some lateral dependencies can be disentangled on implementing the historical course of the subsequent events.


title: General Comodule-Contramodule Correspondence

abstract: This paper is a fundamental study of comodules and contramodules over a comonoid in a symmetric closed monoidal category. We study both algebraic and homotopical aspects of them. Algebraically, we enrich the comodule and contramodule categories over the original category, construct enriched functors between them and enriched adjunctions between the functors. Homotopically, for simplicial sets and topological spaces, we investigate the categories of comodules and contramodules and the relations between them.


title: Comprehensive study of the phase diagram of the spin-1/2 Kitaev-Heisenberg-Gamma chain

abstract: A central question on Kitaev materials is the effects of additional couplings on the Kitaev model which is proposed to be a candidate for realizing topological quantum computations. However, two spatial dimension typically suffers the difficulty of lacking controllable approaches. In this work, using a combination of powerful analytical and numerical methods available in one dimension, we perform a comprehensive study on the phase diagram of a one-dimensional version of the spin-1/2 Kitaev-Heisenberg-Gamma model in its full parameter space. A strikingly rich phase diagram is found with nine distinct phases, including four Luttinger liquid phases, a ferromagnetic phase, a N\'eel ordered phase, an ordered phase of distorted-spiral spin alignments, and two ordered phase which both break a $D_3$ symmetry albeit in different ways, where $D_3$ is the dihedral group of order six. Our work paves the way for studying one-dimensional Kitaev materials and may provide hints to the physics in higher dimensional situations.


title: The evolutionary status of chemically peculiar eclipsing binary star DV Boo

abstract: Eclipsing binary systems are unique stellar objects to examine and understand the stellar evolution and the formation. Thanks to these systems, the fundamental stellar parameters (mass, radius) can be obtained very precisely. The existence of metallic-line (Am) stars in binaries is noticeably common. However, the known number of Am stars in eclipsing binaries is less. The Am stars in eclipsing binaries are extremely useful to deeply investigate the properties of Am stars, as the eclipsing binaries are the only tool to directly derive the fundamental stellar parameters. Additionally, the atmospheric parameters and the metallicities of the binary components could be obtained by a detailed spectroscopic study. Therefore, in this study, we present a comprehensive photometric and spectroscopic analysis of the eclipsing binary system DV\,Boo which has a possible Am component. The fundamental stellar parameters were determined by the analysis of radial velocity and photometric light curves. The atmospheric parameters of both binary components of DV\,Boo were derived using the disentangled spectra. The chemical abundance analysis was carried out as well. As a result, we showed that the primary component illustrates a typical Am star chemical abundance distribution. The fundamental stellar parameters of the binary components were also obtained with an accuracy of <1\% for masses and $<$3\% for radii. The evolutionary status of DV\,Boo was examined using the precisely obtained stellar parameters. The age of the system was found to be 1.00 +- 0.08\,Gyr.


title: Improving Sample Complexity Bounds for (Natural) Actor-Critic Algorithms

abstract: The actor-critic (AC) algorithm is a popular method to find an optimal policy in reinforcement learning. In the infinite horizon scenario, the finite-sample convergence rate for the AC and natural actor-critic (NAC) algorithms has been established recently, but under independent and identically distributed (i.i.d.) sampling and single-sample update at each iteration. In contrast, this paper characterizes the convergence rate and sample complexity of AC and NAC under Markovian sampling, with mini-batch data for each iteration, and with actor having general policy class approximation. We show that the overall sample complexity for a mini-batch AC to attain an $\epsilon$-accurate stationary point improves the best known sample complexity of AC by an order of $\mathcal{O}(\epsilon^{-1}\log(1/\epsilon))$, and the overall sample complexity for a mini-batch NAC to attain an $\epsilon$-accurate globally optimal point improves the existing sample complexity of NAC by an order of $\mathcal{O}(\epsilon^{-1}/\log(1/\epsilon))$. Moreover, the sample complexity of AC and NAC characterized in this work outperforms that of policy gradient (PG) and natural policy gradient (NPG) by a factor of $\mathcal{O}((1-\gamma)^{-3})$ and $\mathcal{O}((1-\gamma)^{-4}\epsilon^{-1}/\log(1/\epsilon))$, respectively. This is the first theoretical study establishing that AC and NAC attain orderwise performance improvement over PG and NPG under infinite horizon due to the incorporation of critic.


title: Physics-based Modeling and Scalable Optimization of Large Intelligent Reflecting Surfaces

abstract: Intelligent reflecting surfaces (IRSs) have the potential to transform wireless communication channels into smart reconfigurable propagation environments. To realize this new paradigm, the passive IRSs have to be large, especially for communication in far-field scenarios, so that they can compensate for the large end-to-end path-loss, which is caused by the multiplication of the individual path-losses of the transmitter-to-IRS and IRS-to-receiver channels. However, optimizing a large number of sub-wavelength IRS elements imposes a significant challenge for online transmission. To address this issue, in this paper, we develop a physics-based model and a scalable optimization framework for large IRSs. The basic idea is to partition the IRS unit cells into several subsets, referred to as tiles, model the impact of each tile on the wireless channel, and then optimize each tile in two stages, namely an offline design stage and an online optimization stage. For physics-based modeling, we borrow concepts from the radar literature, model each tile as an anomalous reflector, and derive its impact on the wireless channel for a given phase shift by solving the corresponding integral equations for the electric and magnetic vector fields. In the offline design stage, the IRS unit cells of each tile are jointly designed for the support of different transmission modes, where each transmission mode effectively corresponds to a given configuration of the phase shifts that the unit cells of the tile apply to an impinging electromagnetic wave. In the online optimization stage, the best transmission mode of each tile is selected such that a desired quality-of-service (QoS) criterion is maximized. We show that the proposed modeling and optimization framework can be used to efficiently optimize large IRSs comprising thousands of unit cells.


title: The state complexity of a class of operations involving roots and boolean operations

abstract: Modifiers are a sets of functions acting on tuple of automata and allowing one to construct regular operations. We define and study the class of friendly modifiers that describes a class of regular operations involving compositions of boolean operations and roots. We also give an explicit tight bound for the state complexity of these operations.


title: A Microscopic Epidemic Model and Pandemic Prediction Using Multi-Agent Reinforcement Learning

abstract: This paper introduces a microscopic approach to model epidemics, which can explicitly consider the consequences of individual's decisions on the spread of the disease. We first formulate a microscopic multi-agent epidemic model where every agent can choose its activity level that affects the spread of the disease. Then by minimizing agents' cost functions, we solve for the optimal decisions for individual agents in the framework of game theory and multi-agent reinforcement learning. Given the optimal decisions of all agents, we can make predictions about the spread of the disease. We show that there are negative externalities in the sense that infected agents do not have enough incentives to protect others, which then necessitates external interventions to regulate agents' behaviors. In the discussion section, future directions are pointed out to make the model more realistic.


title: Tradeoff-Focused Contrastive Explanation for MDP Planning

abstract: End-users' trust in automated agents is important as automated decision-making and planning is increasingly used in many aspects of people's lives. In real-world applications of planning, multiple optimization objectives are often involved. Thus, planning agents' decisions can involve complex tradeoffs among competing objectives. It can be difficult for the end-users to understand why an agent decides on a particular planning solution on the basis of its objective values. As a result, the users may not know whether the agent is making the right decisions, and may lack trust in it. In this work, we contribute an approach, based on contrastive explanation, that enables a multi-objective MDP planning agent to explain its decisions in a way that communicates its tradeoff rationale in terms of the domain-level concepts. We conduct a human subjects experiment to evaluate the effectiveness of our explanation approach in a mobile robot navigation domain. The results show that our approach significantly improves the users' understanding, and confidence in their understanding, of the tradeoff rationale of the planning agent.


title: Trans-NIH/Interagency Workshop on the Use and Development of Assistive Technology for the Aging Population and People with Chronic Disabilities

abstract: The first baby boomer born in 1946 turned 65 in 2011 and the last baby boomer will turn 65 in 2029. By then, the total U.S. population over 65 is projected to be 71.5 million (compared with 44.6 million in 2013). The current (2014) median cost of a nursing home is $226 a day ($82,490 per year), while assisted living is $3500 a month ($42,000 per year). While the elderly population continues to get larger and costs will continue to rise, nearly ninety percent (90%) of people want to grow old in their own home and community and remain out of the hospital, nursing home or other institutional setting. New technologies could potentially allow older adults and people with disabilities to remain in their homes longer, reduce health care costs and enhance the quality of life. In summary, there is a need for a new generation of research that addresses the complexity of supporting the quality of life and independence of a vast, diverse, and aging population. While there are common themes and needs in this research that we describe shortly, we must start by recognizing that there is more than one needed path and approach to meet these diverse needs. One path includes the tight integration of chronic disease management in the home with existing acute healthcare systems. Another path embraces comprehensive home health for improving nutrition and social connectedness while combating physical, cognitive and psychological ailments. Yet another path emphasizes wellness, consumer technologies and removing basic barriers to meaningful community participation. These paths will intersect in interesting ways for individuals, families, healthcare providers, and communities. However research is critically needed to illuminate these paths and to make measurable strides in our care and support for over 15% of our nation's citizens.


title: Social and Emotional Skills Training with Embodied Moxie

abstract: We present a therapeutic framework, namely STAR Framework, that leverages established and evidence-based therapeutic strategies delivered by the Embodied Moxie, an animate companion to support children with mental behavioral developmental disorders (MBDDs). This therapeutic framework jointly with Moxie aims to provide an engaging, safe, and secure environment for children aged five to ten years old. Moxie delivers content informed by therapeutic strategies including but not limited to naturalistic Applied Behavior Analysis, graded cueing, and Cognitive Behavior Therapy. Leveraging multimodal input from a camera and microphones, Moxie is uniquely positioned to be a first-hand witness of a child's progress and struggles alike. Moxie measures skills captured in state-of-the-art assessment scales, such as the Social Responsiveness Scale and Social Skill Improvement Scale, and augments those measures with quantitatively measured behavior skills, such as eye contact and language skills. While preliminary, the present study (N=12) also provides evidence that a six-week intervention using the STAR Framework and Moxie had significant impact on the children's abilities. We present our research in detail and provide an overview of the STAR Framework and all related components, such as Moxie and the companion app for parents.


title: Dynamics of particles trapped by dissipative domain walls

abstract: In this Letter we study the interactions of the dissipative domain walls with dielectric particles. It is shown that particles can be steadily trapped by the moving domain walls. The influence of the ratchet effect on particle trapping is considered. It is demonstrated, that the ratchet effect allows to obtain high accuracy in particle manipulation.


title: Nucleon-Nucleon Scattering with Coupled Nucleon-Delta Channels in Chiral Effective Field Theory

abstract: In this work the elastic scattering of two nucleons is calculated in chiral effective field theory at next-to-leading order taking into account the coupled N$\Delta$-, $\Delta$N- and $\Delta\Delta$-channels. To solve the coupled channel scattering equation one needs as input the potentials for all combinations of these initial and final states. Up to next-to leading order these (transition) potentials arise from one-pion exchange, two-pion exchange and contact interactions. For the two-pion exchange we give analytic expressions for the spectral functions derived from all contributing one-loop diagrams. The forms of the contact potentials at leading and next-to-leading order are determined. We perform a fit of the low energy constants, that belong to the $NN \rightarrow NN$ contact potential and contribute up to next-to-leading order to $S$- and $P$-waves of NN scattering only. The influence of the $\Delta$-isobar dynamics entering through the coupled channels is studied in detail.


title: Some application examples of minimization based formulations of inverse problems and their regularization

abstract: In this paper we extend a recent idea of formulating and regularizing inverse problems as minimization problems, so without using a forward operator, thus avoiding explicit evaluation of a parameter-to-state map. We do so by rephrasing three application examples in this minimization form, namely (a) electrical impedance tomography with the complete electrode model (b) identification of a nonlinear magnetic permeability from magnetic flux measurements (c) localization of sound sources from microphone array measurements. To establish convergence of the proposed regularization approach for these problems, we first of all extend the existing theory. In particular, we take advantage of the fact that observations are finite dimensional here, so that inversion of the noisy data can to some extent be done separately, using a right inverse of the observation operator. This new approach is actually applicable to a wide range of real world problems.


title: Analytic binary alloy volume-concentration relations and the deviation from Zen`s law

abstract: Alloys expand or contract as concentrations change, and the resulting relationship between atomic volume and alloy content is an important property of the solid. While a well-known approximation posits that the atomic volume varies linearly with concentration (Zen`s law), the actual variation is more complicated. Here we use an apparent size of the solute (solvent) atom and the elasticity to derive explicit analytical expressions for the atomic volume of binary solid alloys. Two approximations, continuum and terminal, are proposed. Deviations from Zen`s law are studied for 22 binary alloy systems.


title: A stability theorem for projective $CR$ manifolds

abstract: We consider smooth deformations of the $CR$ structure of a smooth $2$-pseudoconcave compact $CR$ submanifold $\textsf{M}$ of a reduced complex analytic variety $\textsf{X}$ outside the intersection $D\,{\cap}\,\textsf{M}$ with the support $D$ of a Cartier divisor of a positive line bundle $\texttt{F}_{\textsf{X}}.$ We show that nearby structures still admit projective $CR$ embeddings. Special results are obtained under the additional assumptions that $\textsf{X}$ is a projective space or a Fano variety.


title: Bipartite non-locality beyond Bell inequalities by means of multivariable correlations

abstract: We give a set of necessary conditions for locality in bipartite systems, which include and generalize known Bell's inequalities. Each condition corresponds to a specific order of the expansion of random variables defined on graphs, in terms of genuinely n-variable correlation functions. The first non-trivial order leads to known Bell inequalities, while higher orders produce additional, non-equivalent conditions. In particular, in CHSH settings, we obtain at least two additional tight conditions which do not reduce to the CHSH inequality. This shows that tight Bell inequalities are sufficient but not necessary conditions for the non-locality of bipartite quantum correlations.


title: Ab initio multi-shell valence-space Hamiltonians and the island of inversion

abstract: In the shell-model framework, valence-space Hamiltonians connecting multiple major-oscillator shells are of key interest for investigating the physics of neutron-rich nuclei, which have been the subject of intense experimental activity for decades. Here we present an extension of the ab initio valence-space in-medium similarity renormalization group which allows the derivation of such Hamiltonians nonperturbatively. Starting from initial two- and three-nucleon forces from chiral effective field theory, we then calculate properties of nuclei in the important island-of-inversion region above oxygen, so far unexplored with ab initio methods. Our results in the neon and magnesium isotopes indicate the importance of neutron excitation from the $sd$ to $pf$ shells and ground states dominated by intruder configurations around $N=20$, consistent with the conclusions from phenomenological studies. We also benchmark the excitation spectrum of $^{16}$O with coupled-cluster theory, finding generally good agreement, and discuss implications for ground state energies and charge radii in oxygen and calcium isotopes. Finally we outline the proper procedure for treating the long-standing issue of center-of-mass contamination, and show that with a particular choice of valence space, these spurious states can be removed successfully.


title: Gravitational lensing by charged black hole in regularized $4D$ Einstein-Gauss-Bonnet gravity

abstract: Among the higher curvature gravities, the most extensively studied theory is the so-called Einstein-Gauss-Bonnet (EGB) gravity, whose Lagrangian contains Einstein term with the GB combination of quadratic curvature terms, and the GB term yields nontrivial gravitational dynamics in $ D\geq5$. Recently there has been a surge of interest in regularizing, a $ D \to 4 $ limit of, the EGB gravity, and the resulting regularized $4D$ EGB gravity valid in $4D$. We consider gravitational lensing by Charged black holes in the $4D$ EGB gravity theory to calculate the light deflection coefficients in strong-field limits $\bar{a}$ and $\bar{b}$, while the former increases with increasing GB parameter $\alpha$ and charge $q$, later decrease. We also find a decrease in the deflection angle $\alpha_D$, angular position $\theta_{\infty}$ decreases more slowly and impact parameter for photon orbits $u_{m}$ more quickly, but angular separation $s$ increases more rapidly with $\alpha$ and charge $q$. We compare our results with those for analogous black holes in General Relativity (GR) and also the formalism is applied to discuss the astrophysical consequences in the case of the supermassive black holes Sgr A* and M87*.


title: Random evolution equations: well-posedness, asymptotics, and applications to graphs

abstract: We study diffusion-type equations supported on structures that are randomly varying in time. After settling the issue of well-posedness, we focus on the asymptotic behavior of solutions: our main result gives sufficient conditions for pathwise convergence in norm of the (random) propagator towards a (deterministic) steady state. We apply our findings in two environments with randomly evolving features: ensembles of difference operators on combinatorial graphs, or else of differential operators on metric graphs.


title: Incorporating historical information to improve phase I clinical trial designs

abstract: Incorporating historical data or real-world evidence has a great potential to improve the efficiency of phase I clinical trials and to accelerate drug development. For model-based designs, such as the continuous reassessment method (CRM), this can be conveniently carried out by specifying a "skeleton," i.e., the prior estimate of dose limiting toxicity (DLT) probability at each dose. In contrast, little work has been done to incorporate historical data or real-world evidence into model-assisted designs, such as the Bayesian optimal interval (BOIN), keyboard, and modified toxicity probability interval (mTPI) designs. This has led to the misconception that model-assisted designs cannot incorporate prior information. In this paper, we propose a unified framework that allows for incorporating historical data or real-world evidence into model-assisted designs. The proposed approach uses the well-established "skeleton" approach, combined with the concept of prior effective sample size, thus it is easy to understand and use. More importantly, our approach maintains the hallmark of model-assisted designs: simplicity---the dose escalation/de-escalation rule can be tabulated prior to the trial conduct. Extensive simulation studies show that the proposed method can effectively incorporate prior information to improve the operating characteristics of model-assisted designs, similarly to model-based designs.


title: Comparison of Windowed-Decoder Configurations for Spatially Coupled LDPC Codes Under Equal-Complexity Constraints

abstract: Spatially Coupled Low-Density Parity-Check (SC-LDPC) codes offer excellent decoding performance and can be elegantly decoded with a Windowed Decoder (WD). We determine an efficient WD configuration with low control overhead. For fair comparisons, we normalize all configurations to the same maximal computational complexity, which is an important measure of the decoding effort in packet-based data communication systems. We determine an optimized configuration from a joint evaluation of the window size, the window update strategy, and parity check-based Early Termination (ET). Firstly, we use a variable node-centered update strategy, which omits updates of messages in some parts of the decoding window. With the complexity normalization, the window size can be increased compared to a check node-centered update strategy, which uniformly updates all messages in the decoding window. Secondly, we only require the satisfaction of the top-most parity-check equations in each window to move to the next position more quickly. Using a surprisingly large window size, the resulting WD halves the average decoding complexity of the block decoder while maintaining a rather small gap in the decoding performance.


title: Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learning

abstract: Reinforcement learning provides a general framework for learning robotic skills while minimizing engineering effort. However, most reinforcement learning algorithms assume that a well-designed reward function is provided, and learn a single behavior for that single reward function. Such reward functions can be difficult to design in practice. Can we instead develop efficient reinforcement learning methods that acquire diverse skills without any reward function, and then repurpose these skills for downstream tasks? In this paper, we demonstrate that a recently proposed unsupervised skill discovery algorithm can be extended into an efficient off-policy method, making it suitable for performing unsupervised reinforcement learning in the real world. Firstly, we show that our proposed algorithm provides substantial improvement in learning efficiency, making reward-free real-world training feasible. Secondly, we move beyond the simulation environments and evaluate the algorithm on real physical hardware. On quadrupeds, we observe that locomotion skills with diverse gaits and different orientations emerge without any rewards or demonstrations. We also demonstrate that the learned skills can be composed using model predictive control for goal-oriented navigation, without any additional training.


title: Reaction-diffusion models for a class of infinite-dimensional non-linear stochastic differential equations

abstract: We establish the existence of solutions to a class of non-linear stochastic differential equation of reaction-diffusion type in an infinite-dimensional space, with diffusion corresponding to a given transition kernel. The solution obtained is the scaling limit of a sequence of interacting particle systems, and satisfies the martingale problem corresponding to the target differential equation.


title: Erd\H{o}s space in Julia sets

abstract: We prove that the rational Hilbert space $\mathfrak E$, known as Erd\H{o}s space, surfaces in complex dynamics via iteration of $e^z-1$.


title: Towards consistent black-to-white hole bounces from matter collapse

abstract: This article presents a new model-independent constraint for bouncing black hole geometries. Using the thin shell formalism, this constraint sets a bound on the minimal allowed radius of the time-like surface of the collapsing star at the bounce. It follows from this bound that the shell always bounces in an untrapped region or precisely on a trapping horizon. This constraint is of purely kinematical origin as it descends from the continuity of the metric between the geometries describing the interior and exterior of the collapsing object so that it is completely model-independent. The second part of this work investigates the conditions under which an effective extension of the Oppenheimer-Snyder collapse can describe consistent bouncing black hole solutions. We show that on top of the previous kinematical constraint, an additional dynamical condition has to be satisfied in order for the model to admit well-defined black-to-white hole solutions. As expected, this second condition turns out to be model-dependent. The resulting class of models describing bouncing compact objects are characterized by three parameters for the star (mass, initial radius and density) and two quantum parameters descending from the UV-completion of the exterior and interior geometries. The solution space contains (1) bouncing stars and (2) bouncing black holes and (3) a new class of astrophysical objects which alternate between a bouncing star and a bouncing black hole. Finally, we provide an explicit construction of a black-to-white hole bounce using the techniques of spatially closed LQC and discuss the novel properties induced by the presence of the inner horizon in this new framework. This generic framework lays down the foundation for interesting phenomenological investigations concerning the astrophysical properties of these objects, as well as a novel platform for further developments.


title: A Geometric Algorithm for Solving Linear Systems

abstract: Based on the geometric {\it Triangle Algorithm} for testing membership of a point in a convex set, we present a novel iterative algorithm for testing the solvability of a real linear system $Ax=b$, where $A$ is an $m \times n$ matrix of arbitrary rank. Let $C_{A,r}$ be the ellipsoid determined as the image of the Euclidean ball of radius $r$ under the linear map $A$. The basic procedure in our algorithm computes a point in $C_{A,r}$ that is either within $\varepsilon$ distance to $b$, or acts as a certificate proving $b \not \in C_{A,r}$. Each iteration takes $O(mn)$ operations and when $b$ is well-situated in $C_{A,r}$, the number of iterations is proportional to $\log{(1/\varepsilon)}$. If $Ax=b$ is solvable the algorithm computes an approximate solution or the minimum-norm solution. Otherwise, it computes a certificate to unsolvability, or the minimum-norm least-squares solution. It is also applicable to complex input. In a computational comparison with the state-of-the-art algorithm BiCGSTAB ({\it Bi-conjugate gradient method stabilized}), the Triangle Algorithm is very competitive. In fact, when the iterates of BiCGSTAB do not converge, our algorithm can verify $Ax=b$ is unsolvable and approximate the minimum-norm least-squares solution. The Triangle Algorithm is robust, simple to implement, and requires no preconditioner, making it attractive to practitioners, as well as researchers and educators.


title: Low-rank representation of head impact kinematics: A data-driven emulator

abstract: Head motion induced by impacts has been deemed as one of the most important measures in brain injury prediction, given that the majority of brain injury metrics use head kinematics as input. Recently, researchers have focused on using fast approaches, such as machine learning, to approximate brain deformation in real-time for early brain injury diagnosis. However, those requires large number of kinematic measurements, and therefore data augmentation is required given the limited on-field measured data available. In this study we present a principal component analysis-based method that emulates an empirical low-rank substitution for head impact kinematics, while requiring low computational cost. In characterizing our existing data set of 537 head impacts, consisting of 6 degrees of freedom measurements, we found that only a few modes, e.g. 15 in the case of angular velocity, is sufficient for accurate reconstruction of the entire data set. Furthermore, these modes are predominantly low frequency since over 70% to 90% of the angular velocity response can be captured by modes that have frequencies under 40Hz. We compared our proposed method against existing impact parametrization methods and showed significantly better performance in injury prediction using a range of kinematic-based metrics -- such as head injury criterion and rotational injury criterion (RIC) -- and brain tissue deformation-metrics -- such as brain angle metric, maximum principal strain (MPS) and axonal fiber strains (FS). In all cases, our approach reproduced injury metrics similar to the ground truth measurements with no significant difference, whereas the existing methods obtained significantly different (p<0.01) values as well as poor injury classification sensitivity and specificity. This emulator will enable us to provide the necessary data augmentation to build a head impact kinematic data set of any size.


title: Nonlinear interaction of acoustic waves with a spheroidal particle: radiation force and torque effects

abstract: The nonlinear interaction of a time-harmonic acoustic wave with an anisotropic particle gives rise to the radiation force and torque effects. These phenomena are at the heart of the acoustofluidics technology, where microparticles such as cells and microorganisms are acoustically manipulated. We present a theoretical model considering a generic acoustic beam interacting with a subwavelength spheroidal particle in a nonviscous fluid. Concise analytical expressions of the radiation force and torque are obtained in the scattering dipole approximation. The radiation force is given in terms of a gradient and scattering force; while the radiation torque has two fundamental contributions, namely, the momentum arm and acoustic spin (spin-torque effect). As a practical example, we use the theory to describe the interaction of two crossed plane waves and a prolate spheroidal particle. The results reveal the particle is transversely trapped in a pressure node and is axially pushed by the radiation force. Also, the momentum arm aligns the particle in the axial direction. At certain specific positions, only the spin-torque occurs. Our findings are remarkably consistent with finite-element simulations. The success of our model enables its use as an investigation tool for the manipulation of anisotropic microparticles in acoustofluidics.


title: On the importance of lensing for galaxy clustering in photometric and spectroscopic surveys

abstract: We study the importance of gravitational lensing in the modelling of the number counts of galaxies. We confirm previous results for photometric surveys, showing that lensing cannot be neglected in a survey like LSST since it would infer a significant shift of cosmological parameters. For a spectroscopic survey like SKA2, we find that neglecting lensing in the monopole, quadrupole and hexadecapole of the correlation function also induces an important shift of parameters. For ${\Lambda}$CDM parameters, the shift is moderate, of the order of 0.6${\sigma}$ or less. However, for a model-independent analysis, that measures the growth rate of structure in each redshift bin, neglecting lensing introduces a shift of up to 2.3${\sigma}$ at high redshift. Since the growth rate is directly used to test the theory of gravity, such a strong shift would wrongly be interpreted as the breakdown of General Relativity. This shows the importance of including lensing in the analysis of future surveys. On the other hand, for a survey like DESI, we find that lensing is not important, mainly due to the value of the magnification bias parameter of DESI, $s(z)$, which strongly reduces the lensing contribution at high redshift. We also propose a way of improving the analysis of spectroscopic surveys, by including the cross-correlations between different redshift bins (which is neglected in spectroscopic surveys) from the spectroscopic survey or from a different photometric sample. We show that including the cross-correlations in the SKA2 analysis does not improve the constraints. On the other hand replacing the cross-correlations from SKA2 by cross-correlations measured with LSST improves the constraints by 10 to 20 %. Interestingly, for ${\Lambda}$CDM parameters, we find that LSST and SKA2 are highly complementary, since they are affected differently by degeneracies between parameters.


title: Timely Estimation Using Coded Quantized Samples

abstract: The effects of quantization and coding on the estimation quality of a Gauss-Markov, namely Ornstein-Uhlenbeck, process are considered. Samples are acquired from the process, quantized, and then encoded for transmission using either infinite incremental redundancy or fixed redundancy coding schemes. A fixed processing time is consumed at the receiver for decoding and sending feedback to the transmitter. Decoded messages are used to construct a minimum mean square error (MMSE) estimate of the process as a function of time. This is shown to be an increasing functional of the age-of-information, defined as the time elapsed since the sampling time pertaining to the latest successfully decoded message. Such (age-penalty) functional depends on the quantization bits, codeword lengths and receiver processing time. The goal, for each coding scheme, is to optimize sampling times such that the long term average MMSE is minimized. This is then characterized in the setting of general increasing age-penalty functionals, not necessarily corresponding to MMSE, which may be of independent interest in other contexts.


title: Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms

abstract: The information-theoretic framework of Russo and J. Zou (2016) and Xu and Raginsky (2017) provides bounds on the generalization error of a learning algorithm in terms of the mutual information between the algorithm's output and the training sample. In this work, we study the proposal, by Steinke and Zakynthinou (2020), to reason about the generalization error of a learning algorithm by introducing a super sample that contains the training sample as a random subset and computing mutual information conditional on the super sample. We first show that these new bounds based on the conditional mutual information are tighter than those based on the unconditional mutual information. We then introduce yet tighter bounds, building on the "individual sample" idea of Bu, S. Zou, and Veeravalli (2019) and the "data dependent" ideas of Negrea et al. (2019), using disintegrated mutual information. Finally, we apply these bounds to the study of Langevin dynamics algorithm, showing that conditioning on the super sample allows us to exploit information in the optimization trajectory to obtain tighter bounds based on hypothesis tests.


title: Holographic drag force in 5d Kerr-AdS black hole

abstract: We consider the 5d Kerr-AdS black hole as a gravity dual to rotating quark-gluon plasma. In the holographic prescription we calculate the drag force acting on a heavy quark. According to the holographic approach a heavy quark can be considered through the string in the gravity dual. We study the dynamics of the string for the Kerr-AdS backgrounds with one non-zero rotational parameter and two non-zero rotational parameters that are equal in magnitude. For the case of one non-zero rotational parameter we find good agreement with the prediction from the 4d case considered by arXiv:1012.3800).


title: El Bahr: A Prospective Impact Crater

abstract: This preliminary investigation addresses the discovery of an unidentified crater located south of the Sahara Desert between Qaret Had El Bahr and Qaret El Allafa, Egypt. The unidentified crater (hereafter tentatively named El Bahr Crater) was discovered during a terrain analysis of the Sahara Desert. El Bahr Crater is located Southwest Al-Jiza Giza and is approximately 327 meters across, has a rim with a circumference of approximately 1,027 meters, and occupies a surface area of approximately 83,981 square meters. Preliminary spectral and topographic analysis reveal features characteristic of an impact crater produced by a hypervelocity event of extraterrestrial origin, including a bowl-shaped rim and a crater wall. No proximal and/or distal ejecta, however, are visible from Landsat imagery. Moreover, the geomorphic features, along with the fact that the El Bahr basalts are known to be rich in orthopyroxene while the surrounding basalts are not, imply an impact as the most plausible explanation. The El Bahr Crater is not indexed in the Earth Impact Database, and an analysis of impact structures in Africa did not identify it as either a confirmed, proposed or disproved impact crater. In collaboration with the University of Cairo, therefore, an expedition has been organized to conduct an in-situ investigation of El Bahr Crater, to ascertain if planar formations, shatter cones, and shock metamorphic and or other meteoritic properties are present.


title: The effect of adding randomly weighted edges

abstract: We consider the following question. We have a dense regular graph $G$ with degree $\alpha n$, where $\alpha>0$ is a constant. We add $m=o(n^2)$ random edges. The edges of the augmented graph $G(m)$ are given independent edge weights $X(e)$, $e\in E(G(m))$. We estimate the minimum weight of some specified combinatorial structures. We show that in certain cases, we can obtain the same estimate as is known for the complete graph, but scaled by a factor $\alpha^{-1}$. We consider spanning trees, shortest paths, perfect matchings in (pseudo-random) bipartite graphs.


title: Moderate deviation and exit time estimates for stationary Last Passage Percolation

abstract: We consider planar stationary exponential Last Passage Percolation in the positive quadrant with boundary weights. For $\rho\in (0,1)$ and points $v_N=((1-\rho)^2 N,\rho^2 N)$ going to infinity along the characteristic direction, we establish right tail estimates with the optimal exponent for the exit time of the geodesic, along with optimal exponent estimates for the upper tail moderate deviations for the passage time. For the case $\rho=\frac{1}{2}$ in the stationary model, we establish the lower bound estimate with the optimal exponent for the lower tail of the passage time. Our arguments are based on moderate deviation estimates for point-to-point and point-to-line exponential Last Passage Percolation which are obtained via random matrix estimates.


title: Rank conditions on phylogenetic networks

abstract: Less rigid than phylogenetic trees, phylogenetic networks allow the description of a wider range of evolutionary events. In this note, we explain how to extend the rank invariants from phylogenetic trees to phylogenetic networks evolving under the general Markov model and the equivariant models.


title: CoReNet: Coherent 3D scene reconstruction from a single RGB image

abstract: Advances in deep learning techniques have allowed recent work to reconstruct the shape of a single object given only one RBG image as input. Building on common encoder-decoder architectures for this task, we propose three extensions: (1) ray-traced skip connections that propagate local 2D information to the output 3D volume in a physically correct manner; (2) a hybrid 3D volume representation that enables building translation equivariant models, while at the same time encoding fine object details without an excessive memory footprint; (3) a reconstruction loss tailored to capture overall object geometry. Furthermore, we adapt our model to address the harder task of reconstructing multiple objects from a single image. We reconstruct all objects jointly in one pass, producing a coherent reconstruction, where all objects live in a single consistent 3D coordinate frame relative to the camera and they do not intersect in 3D space. We also handle occlusions and resolve them by hallucinating the missing object parts in the 3D volume. We validate the impact of our contributions experimentally both on synthetic data from ShapeNet as well as real images from Pix3D. Our method improves over the state-of-the-art single-object methods on both datasets. Finally, we evaluate performance quantitatively on multiple object reconstruction with synthetic scenes assembled from ShapeNet objects.


title: A verifiably secure and proportional committee election rule

abstract: The property of proportional representation in approval-based committee elections has appeared in the social choice literature for over a century, and is typically understood as avoiding the underrepresentation of minorities. However, we argue that the security of some distributed systems is directly linked to the opposite goal of avoiding the overrepresentation of any minority, a goal not previously formalized that leads us to an optimization objective known as maximin support. After providing a thorough analysis of the computational complexity of this objective, we propose a new efficient election rule that simultaneously achieves a) a constant-factor approximation guarantee for it, and b) the property of proportional justified representation (PJR) - one of the strongest forms of proportional representation. However, the most striking feature of the new rule is that one can verify in linear time that the winning committee satisfies the two aforementioned guarantees, even when the algorithm is executed by an untrusted party who only communicates the output. As a result, the rule can be adapted into a verifiable computing scheme. Moreover, its verification procedure easily admits parallel processing for further efficiency. Our work is motivated by an application on blockchain networks that implement Nominated Proof-of-Stake, where the community elects a committee of validators to participate in the consensus protocol, and where preventing overrepresentation protects the network against attacks by an adversarial minority. Our election rule enables a validator selection protocol with formal guarantees on security and proportionality, and its adaptation as a verifiable computing scheme with a parallelized verification proves to be key for its successful implementation given the computationally limited nature of the blockchain architecture.


title: Any Two Qubit State Has Non Zero Quantum Discord Under Global Unitary Operations

abstract: Quantum discord is significant in analyzing quantum nonclassicality beyond the paradigm of entanglement. Presently we have explored the effectiveness of global unitary operations in manifesting quantum discord from a general two qubit zero discord state. Apart from the emergence of some obvious concepts such as absolute classical-quantum, absolute quantum-classical states, more interestingly, it is observed that set of states characterized by absoluteness contains only maximally mixed state. Consequently this marks the peak of effectiveness of global unitary operations in purview of manifesting nonclassicality from arbitrary two qubit state when other standard methods fail to do so. Set of effective global unitaries has been provided in this context. Our observations have direct implications in remote state preparation task.


title: MakeItTalk: Speaker-Aware Talking-Head Animation

abstract: We present a method that generates expressive talking heads from a single facial image with audio as the only input. In contrast to previous approaches that attempt to learn direct mappings from audio to raw pixels or points for creating talking faces, our method first disentangles the content and speaker information in the input audio signal. The audio content robustly controls the motion of lips and nearby facial regions, while the speaker information determines the specifics of facial expressions and the rest of the talking head dynamics. Another key component of our method is the prediction of facial landmarks reflecting speaker-aware dynamics. Based on this intermediate representation, our method is able to synthesize photorealistic videos of entire talking heads with full range of motion and also animate artistic paintings, sketches, 2D cartoon characters, Japanese mangas, stylized caricatures in a single unified framework. We present extensive quantitative and qualitative evaluation of our method, in addition to user studies, demonstrating generated talking heads of significantly higher quality compared to prior state-of-the-art.


title: DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference

abstract: Large-scale pre-trained language models such as BERT have brought significant improvements to NLP applications. However, they are also notorious for being slow in inference, which makes them difficult to deploy in real-time applications. We propose a simple but effective method, DeeBERT, to accelerate BERT inference. Our approach allows samples to exit earlier without passing through the entire model. Experiments show that DeeBERT is able to save up to ~40% inference time with minimal degradation in model quality. Further analyses show different behaviors in the BERT transformer layers and also reveal their redundancy. Our work provides new ideas to efficiently apply deep transformer-based models to downstream tasks. Code is available at https://github.com/castorini/DeeBERT.


title: Unequal Impact and Spatial Aggregation Distort COVID-19 Growth Rates

abstract: The COVID-19 pandemic has emerged as a global public health crisis. To make decisions about mitigation strategies and to understand the disease dynamics, policy makers and epidemiologists must know how the disease is spreading in their communities. We analyze confirmed infections and deaths over multiple geographic scales to show that COVID-19's impact is highly unequal: many subregions have nearly zero infections, and others are hot spots. We attribute the effect to a Reed-Hughes-like mechanism in which disease arrives at different times and grows exponentially. Hot spots, however, appear to grow faster than neighboring subregions and dominate spatially aggregated statistics, thereby amplifying growth rates. The staggered spread of COVID-19 can also make aggregated growth rates appear higher even when subregions grow at the same rate. Public policy, economic analysis and epidemic modeling need to account for potential distortions introduced by spatial aggregation.


title: Lower-dimensional Gauss-Bonnet Gravity and BTZ Black Holes

abstract: We consider the $D\to 3$ limit of Gauss-Bonnet gravity. We find two distinct but similar versions of the theory and obtain black hole solutions for each. For one theory the solution is an interesting generalization of the BTZ black hole that does not have constant curvature but whose thermodynamics is identical. The other theory admits a solution that is asymptotically AdS but does not approach the BTZ black hole in the limit of small Gauss-Bonnet coupling. We also discuss the distinction between our solutions and those obtained by taking a $D\to 3$ limit of solutions to $D$-dimensional Einstein Gauss-Bonnet gravity. We find that these latter metrics are not solutions of the theories we consider except for particular constraints on the parameters.


title: Col-OSSOS: Compositional homogeneity of three Kuiper belt binaries

abstract: The surface characterization of Trans-Neptunian Binaries (TNBs) is key to understanding the properties of the disk of planetesimals from which these objects formed. In the optical wavelengths, it has been demonstrated that most equal-sized component systems share similar colors, suggesting they have a similar composition. The color homogeneity of binary pairs contrasts with the overall diversity of colors in the Kuiper belt, which was interpreted as evidence that Trans-Neptunian Objects (TNOs) formed from a locally homogeneous and globally heterogeneous protoplanetary disk. In this paradigm, binary pairs must have formed early, before the dynamically hot TNOs were scattered out from their formation location. The latter inferences, however, relied on the assumption that the matching colors of the binary components imply matching composition. Here, we test this assumption by examining the component-resolved photometry of three TNBs found in the Outer Solar System Origins Survey: 505447 (2013 SQ99), 511551 (2014 UD225) and 506121 (2016 BP81), across the visible and J-band near-infrared wavelength range. We report similar colors within 2 sigma for the binary pairs suggestive of similar reflectance spectra and hence surface composition. This advocates for gravitational collapse of pebble clouds as a possible TNO formation route. We however stress that several similarly small TNOs, including at least one binary, have been shown to exhibit substantial spectral variability in the near-infrared, implying color equality of binary pairs is likely to be violated in some cases.


title: A New QoS-Guarantee Strategy for NOMA Assisted Semi-Grant-Free Transmission

abstract: Semi-grant-free (SGF) transmission has recently received significant attention due to its capability to accommodate massive connectivity and reduce access delay by admitting grant-free users to channels which would otherwise be solely occupied by grant-based users. In this paper, a new SGF transmission scheme that exploits the flexibility in choosing the decoding order in non-orthogonal multiple access (NOMA) is proposed. Compared to existing SGF schemes, this new scheme can ensure that admitting the grant-free users is completely transparent to the grant-based users, i.e., the grant-based users' quality-of-service experience is guaranteed to be the same as for orthogonal multiple access. In addition, compared to existing SGF schemes, the proposed SGF scheme can significantly improve the robustness of the grant-free users' transmissions and effectively avoid outage probability error floors. To facilitate the performance evaluation of the proposed SGF transmission scheme, an exact expression for the outage probability is obtained and an asymptotic analysis is conducted to show that the achievable multi-user diversity gain is proportional to the number of participating grant-free users. Computer simulation results demonstrate the performance of the proposed SGF transmission scheme and verify the accuracy of the developed analytical results.


title: Inconsistencies in four-dimensional Einstein-Gauss-Bonnet gravity

abstract: We attempt to clarify several aspects concerning the recently presented four-dimensional Einstein-Gauss-Bonnet gravity. We argue that the limiting procedure outlined in [Phys. Rev. Lett. 124, 081301 (2020)] generally involves ill-defined terms in the four dimensional field equations. Potential ways to circumvent this issue are discussed, alongside some remarks regarding specific solutions of the theory. We prove that, although linear perturbations are well behaved around maximally symmetric backgrounds, the equations for second-order perturbations are ill-defined even around a Minkowskian background. Additionally, we perform a detailed analysis of the spherically symmetric solutions, and find that the central curvature singularity can be reached within a finite proper time.


title: Constraining the delay time distribution of compact binary objects from the stochastic gravitational wave background searches

abstract: The initial separation of massive star binaries sets the timescale over which their compact remnants merge through the emission of gravitational waves. We show that the delay time distribution (DTD) of binary neutron stars or black holes can be inferred from the stochastic gravitational wave background (SGWB). If the DTD of a population is long, most of the mergers take place at low redshifts and the background would be rather quiet compared to a scenario in which the DTD is short leading to few individual detections at low redshift but a rather loud background. We show that different DTDs predict a factor of 5 difference in the magnitude of the gravitational wave background energy density ($\Omega_{\rm GW}$) and have the dominant effect on $\Omega_{\rm GW}$ over other factors such as the mass function of the primary BH mass, $p(m_1)$, the maximum considered BH mass ($M_{\rm max}$), and the effective spin of the black hole ($\chi_{\rm eff}$). A non-detection of such a background can rule out the short DTD scenario. We show that SGWB searches can rule out the short DTD scenario for the BBHs within about four years of observing time at advanced LIGO design sensitivty for a local merger rate of 30 $\rm Gpc^{-3} yr^{-1}$ assuming $p(m_1)\propto m_1^{-1}$, and $M_{\rm max}=50 M_{\odot}$.


title: Integrated Design of Unmanned Aerial Mobility Network: A Data-Driven Risk-Averse Approach

abstract: The real challenge in drone-logistics is to develop an economically-feasible Unmanned Aerial Mobility Network (UAMN). In this paper, we propose an integrated airport location (strategic decision) and routes planning (operational decision) optimization framework to minimize the total cost of the network, while guaranteeing flow constraints, capacity constraints, and electricity constraints. To facility expensive long-term infrastructure planning facing demand uncertainty, we develop a data-driven risk-averse two-stage stochastic optimization model based on the Wasserstein distance. We develop a reformulation technique which simplifies the worst-case expectation term in the original model, and obtain a fractable Min-Max solution procedure correspondingly. Using Lagrange multipliers, we successfully decompose decision variables and reduce the complexity of computation. To provide managerial insights, we design specific numerical examples. For example, we find that the optimal network configuration is affected by the "pooling effects" in channel capacities. A nice feature of our DRO framework is that the optimal network design is relatively robust under demand uncertainty. Interestingly, a candidate node without historical demand records can be chosen to locate an airport. We demonstrate the application of our model for a real medical resources transportation problem with our industry partner, collecting donated blood to a blood bank in Hangzhou, China.


title: Optical design of diffraction-limited X-ray telescopes

abstract: Astronomical imaging with micro-arcsecond ($\mu$as) angular resolution could enable breakthrough scientific discoveries. Previously-proposed $\mu$as X-ray imager designs have been interferometers with limited effective collecting area. Here we describe X-ray telescopes achieving diffraction-limited performance over a wide energy band with large effective area, employing a nested-shell architecture with grazing-incidence mirrors, while matching the optical path lengths between all shells. We present two compact nested-shell Wolter Type 2 grazing-incidence telescope designs for diffraction-limited X-ray imaging: a micro-arcsecond telescope design with 14 $\mu$as angular resolution and 2.9 m$^2$ of effective area at 5 keV photon energy ($\lambda$=0.25 nm), and a smaller milli-arcsecond telescope design with 525 $\mu$as resolution and 645 cm$^2$ effective area at 1 keV ($\lambda$=1.24 nm). We describe how to match the optical path lengths between all shells in a compact mirror assembly, and investigate chromatic and off-axis aberrations. Chromatic aberration results from total external reflection off of mirror surfaces, and we greatly mitigate its effects by slightly adjusting the path lengths in each mirror shell. The mirror surface height error and alignment requirements for diffraction-limited performance are challenging but arguably achieveable in the coming decades. Since the focal ratio for a diffraction-limited X-ray telescope is extremely large ($f/D$~10$^5$), the only important off-axis aberration is curvature of field, so a 1 arcsecond field of view is feasible with a flat detector. The detector must fly in formation with the mirror assembly, but relative positioning tolerances are on the order of 1 m over a distance of some tens to hundreds of kilometers. While there are many challenges to achieving diffraction-limited X-ray imaging, we did not find any fundamental barriers.


title: A Black-box Adversarial Attack Strategy with Adjustable Sparsity and Generalizability for Deep Image Classifiers

abstract: Constructing adversarial perturbations for deep neural networks is an important direction of research. Crafting image-dependent adversarial perturbations using white-box feedback has hitherto been the norm for such adversarial attacks. However, black-box attacks are much more practical for real-world applications. Universal perturbations applicable across multiple images are gaining popularity due to their innate generalizability. There have also been efforts to restrict the perturbations to a few pixels in the image. This helps to retain visual similarity with the original images making such attacks hard to detect. This paper marks an important step which combines all these directions of research. We propose the DEceit algorithm for constructing effective universal pixel-restricted perturbations using only black-box feedback from the target network. We conduct empirical investigations using the ImageNet validation set on the state-of-the-art deep neural classifiers by varying the number of pixels to be perturbed from a meagre 10 pixels to as high as all pixels in the image. We find that perturbing only about 10% of the pixels in an image using DEceit achieves a commendable and highly transferable Fooling Rate while retaining the visual quality. We further demonstrate that DEceit can be successfully applied to image dependent attacks as well. In both sets of experiments, we outperformed several state-of-the-art methods.


title: Corpus-level and Concept-based Explanations for Interpretable Document Classification

abstract: Using attention weights to identify information that is important for models' decision-making is a popular approach to interpret attention-based neural networks. This is commonly realized in practice through the generation of a heat-map for every single document based on attention weights. However, this interpretation method is fragile, and easy to find contradictory examples. In this paper, we propose a corpus-level explanation approach, which aims to capture causal relationships between keywords and model predictions via learning the importance of keywords for predicted labels across a training corpus based on attention weights. Based on this idea, we further propose a concept-based explanation method that can automatically learn higher-level concepts and their importance to model prediction tasks. Our concept-based explanation method is built upon a novel Abstraction-Aggregation Network, which can automatically cluster important keywords during an end-to-end training process. We apply these methods to the document classification task and show that they are powerful in extracting semantically meaningful keywords and concepts. Our consistency analysis results based on an attention-based Na\"ive Bayes classifier also demonstrate these keywords and concepts are important for model predictions.


title: ML-driven Malware that Targets AV Safety

abstract: Ensuring the safety of autonomous vehicles (AVs) is critical for their mass deployment and public adoption. However, security attacks that violate safety constraints and cause accidents are a significant deterrent to achieving public trust in AVs, and that hinders a vendor's ability to deploy AVs. Creating a security hazard that results in a severe safety compromise (for example, an accident) is compelling from an attacker's perspective. In this paper, we introduce an attack model, a method to deploy the attack in the form of smart malware, and an experimental evaluation of its impact on production-grade autonomous driving software. We find that determining the time interval during which to launch the attack is{ critically} important for causing safety hazards (such as collisions) with a high degree of success. For example, the smart malware caused 33X more forced emergency braking than random attacks did, and accidents in 52.6% of the driving simulations.


title: Cross-lingual Information Retrieval with BERT

abstract: Multiple neural language models have been developed recently, e.g., BERT and XLNet, and achieved impressive results in various NLP tasks including sentence classification, question answering and document ranking. In this paper, we explore the use of the popular bidirectional language model, BERT, to model and learn the relevance between English queries and foreign-language documents in the task of cross-lingual information retrieval. A deep relevance matching model based on BERT is introduced and trained by finetuning a pretrained multilingual BERT model with weak supervision, using home-made CLIR training data derived from parallel corpora. Experimental results of the retrieval of Lithuanian documents against short English queries show that our model is effective and outperforms the competitive baseline approaches.


title: NetML: A Challenge for Network Traffic Analytics

abstract: Classifying network traffic is the basis for important network applications. Prior research in this area has faced challenges on the availability of representative datasets, and many of the results cannot be readily reproduced. Such a problem is exacerbated by emerging data-driven machine learning based approaches. To address this issue, we provide three open datasets containing almost 1.3M labeled flows in total, with flow features and anonymized raw packets, for the research community. We focus on broad aspects in network traffic analysis, including both malware detection and application classification. We release the datasets in the form of an open challenge called NetML and implement several machine learning methods including random-forest, SVM and MLP. As we continue to grow NetML, we expect the datasets to serve as a common platform for AI driven, reproducible research on network flow analytics.


title: A session-based song recommendation approach involving user characterization along the play power-law distribution

abstract: In recent years, streaming music platforms have become very popular mainly due to the huge number of songs these systems make available to users. This enormous availability means that recommendation mechanisms that help users to select the music they like need to be incorporated. However, developing reliable recommender systems in the music field involves dealing with many problems, some of which are generic and widely studied in the literature, while others are specific to this application domain and are therefore less well-known. This work is focused on two important issues that have not received much attention: managing gray-sheep users and obtaining implicit ratings. The first one is usually addressed by resorting to content information that is often difficult to obtain. The other drawback is related to the sparsity problem that arises when there are obstacles to gather explicit ratings. In this work, the referred shortcomings are addressed by means of a recommendation approach based on the users' streaming sessions. The method is aimed at managing the well-known power-law probability distribution representing the listening behavior of users. This proposal improves the recommendation reliability of collaborative filtering methods while reducing the complexity of the procedures used so far to deal with the gray-sheep problem.


title: Econophysics Approach and Model on Mixed Economy

abstract: In this paper the general principles and categories of mixed economy that currently exist in almost all countries of the world are presented. The paper also presents an Advanced Model of Mixed Economy with Threshold (AMMET), which is characterized by a reduced value (approx. 10-15%) of the State and public sector participation in the national economy and proposes and analyzes an econophysics model for the mixed economy.


title: On the Chow ring of certain Fano fourfolds

abstract: We prove that certain Fano fourfolds of K3 type constructed by Fatighenti-Mongardi have a multiplicative Chow-K\"unneth decomposition. We present some consequences for the Chow ring of these fourfolds.


title: Pattern for a star filled with imperfect fluid

abstract: A static, spherically symmetric spacetime with negative pressures is conjectured inside a star. The gravitational field is repulsive and so a central singularity is avoided. The positive energy density and the pressures of the imperfect fluid are finite everywhere. The Tolman-Komar energy of the space is negative, as for a de Sitter geometry. From the Darmois-Israel junction conditions on the star surface one finds the constant length $b$ from the metric and the expression of the surface tension $\sigma$ of the thin shell separating the interior from the Schwarzschild exterior. Some properties of the timelike and null geodesics in the Painleve-Gullstrand coordinates are investigated.


title: A Perspective on Deep Learning for Molecular Modeling and Simulations

abstract: Deep learning is transforming many areas in science, and it has great potential in modeling molecular systems. However, unlike the mature deployment of deep learning in computer vision and natural language processing, its development in molecular modeling and simulations is still at an early stage, largely because the inductive biases of molecules are completely different from those of images or texts. Footed on these differences, we first reviewed the limitations of traditional deep learning models from the perspective of molecular physics, and wrapped up some relevant technical advancement at the interface between molecular modeling and deep learning. We do not focus merely on the ever more complex neural network models, instead, we emphasize the theories and ideas behind modern deep learning. We hope that transacting these ideas into molecular modeling will create new opportunities. For this purpose, we summarized several representative applications, ranging from supervised to unsupervised and reinforcement learning, and discussed their connections with the emerging trends in deep learning. Finally, we outlook promising directions which may help address the existing issues in the current framework of deep molecular modeling.


title: Choppy: Cut Transformer For Ranked List Truncation

abstract: Work in information retrieval has traditionally focused on ranking and relevance: given a query, return some number of results ordered by relevance to the user. However, the problem of determining how many results to return, i.e. how to optimally truncate the ranked result list, has received less attention despite being of critical importance in a range of applications. Such truncation is a balancing act between the overall relevance, or usefulness of the results, with the user cost of processing more results. In this work, we propose Choppy, an assumption-free model based on the widely successful Transformer architecture, to the ranked list truncation problem. Needing nothing more than the relevance scores of the results, the model uses a powerful multi-head attention mechanism to directly optimize any user-defined IR metric. We show Choppy improves upon recent state-of-the-art methods.


title: Harnessing adversarial examples with a surprisingly simple defense

abstract: I introduce a very simple method to defend against adversarial examples. The basic idea is to raise the slope of the ReLU function at the test time. Experiments over MNIST and CIFAR-10 datasets demonstrate the effectiveness of the proposed defense against a number of strong attacks in both untargeted and targeted settings. While perhaps not as effective as the state of the art adversarial defenses, this approach can provide insights to understand and mitigate adversarial attacks. It can also be used in conjunction with other defenses.


title: Scale-free Protocol Design for Output Synchronization of Heterogeneous Multi-agent subject to Unknown, Non-uniform and Arbitrarily Large Input Delays

abstract: This paper studies output synchronization problems for heterogeneous networks of continuous- or discrete-time right-invertible linear agents in presence of unknown, non-uniform and arbitrarily large input delay based on localized information exchange. It is assumed that all the agents are introspective, meaning that they have access to their own local measurements. Universal linear protocols are proposed for each agent to achieve output synchronizations. Proposed protocols are designed solely based on the agent models using no information about communication graph and the number of agents or other agent models information. Moreover, the protocols can tolerate arbitrarily large input delays.


title: Mobility Based SIR Model For Pandemics -- With Case Study Of COVID-19

abstract: In the last decade, humanity has faced many different pandemics such as SARS, H1N1, and presently novel coronavirus (COVID-19). On one side, scientists are focusing on vaccinations, and on the other side, there is a need to propose models that can help us in understanding the spread of these pandemics as it can help governmental and other concerned agencies to be well prepared, especially from pandemics, which spreads faster like COVID-19. The main reason for some epidemic turning into pandemics is the connectivity among different regions of the world, which makes it easier to affect a wider geographical area, often worldwide. In addition, the population distribution and social coherence in the different regions of the world is non-uniform. Thus, once the epidemic enters a region, then the local population distribution plays an important role. Inspired by these ideas, we proposed a mobility-based SIR model for epidemics, which especially takes into account pandemic situations. To the best of our knowledge, this model is first of its kind, which takes into account the population distribution and connectivity of different geographic locations across the globe. In addition to presenting the mathematical proof of our model, we have performed extensive simulations using synthetic data to demonstrate our model's generalizability. To demonstrate the wider scope of our model, we used our model to forecast the COVID-19 cases for Estonia.


title: Stable circular orbits of spinning test particles around accelerating Kerr black hole

abstract: We investigate the stable circular orbits of the spinning test particles around the accelerating Kerr black hole on the equatorial plane. To this end, we first calculate the equations of motion and analyze the parameter space for the particles. We study the effect of the particle's spin and the black hole's acceleration on the conserved angular momentum, conserved energy and radius of the spinning test particle on the innermost stable circular orbit. We find that the effect of the particle's spin on the orbit parameters is almost linear, the effect of the black hole's acceleration on those parameters is nonlinear. We also explore the effects of the particle's spin and the black hole's acceleration on the periastron shift for the spinning particle in the nearly stable circular orbit.


title: Second waves, social distancing, and the spread of COVID-19 across America

abstract: We recently described a dynamic causal model of a COVID-19 outbreak within a single region. Here, we combine several of these (epidemic) models to create a (pandemic) model of viral spread among regions. Our focus is on a second wave of new cases that may result from loss of immunity--and the exchange of people between regions--and how mortality rates can be ameliorated under different strategic responses. In particular, we consider hard or soft social distancing strategies predicated on national (Federal) or regional (State) estimates of the prevalence of infection in the population. The modelling is demonstrated using timeseries of new cases and deaths from the United States to estimate the parameters of a factorial (compartmental) epidemiological model of each State and, crucially, coupling between States. Using Bayesian model reduction, we identify the effective connectivity between States that best explains the initial phases of the outbreak in the United States. Using the ensuing posterior parameter estimates, we then evaluate the likely outcomes of different policies in terms of mortality, working days lost due to lockdown and demands upon critical care. The provisional results of this modelling suggest that social distancing and loss of immunity are the two key factors that underwrite a return to endemic equilibrium.


title: An Extension of Pl\"ucker Relations with Applications to Subdeterminant Maximization

abstract: Given a matrix $A$ and $k\geq 0$, we study the problem of finding the $k\times k$ submatrix of $A$ with the maximum determinant in absolute value. This problem is motivated by the question of computing the determinant-based lower bound of [LSV86] on hereditary discrepancy, which was later shown to be an approximate upper bound as well [Mat13]. The special case where $k$ coincides with one of the dimensions of $A$ has been extensively studied. [Nik15] gave a $2^{O(k)}$-approximation algorithm for this special case, matching known lower bounds; he also raised as an open problem the question of designing approximation algorithms for the general case. We make progress towards answering this question by giving the first efficient approximation algorithm for general $k\times k$ subdeterminant maximization with an approximation ratio that depends only on $k$. Our algorithm finds a $k^{O(k)}$-approximate solution by performing a simple local search. Our main technical contribution, enabling the analysis of the approximation ratio, is an extension of Pl\"ucker relations for the Grassmannian, which may be of independent interest; Pl\"ucker relations are quadratic polynomial equations involving the set of $k\times k$ subdeterminants of a $k\times n$ matrix. We find an extension of these relations to $k\times k$ subdeterminants of general $m\times n$ matrices.


title: A new weak gradient for the stabilizer free weak Galerkin method with polynomial reduction

abstract: The weak Galerkin (WG) finite element method is an effective and flexible general numerical technique for solving partial differential equations. It is a natural extension of the classic conforming finite element method for discontinuous approximations, which maintains simple finite element formulation. Stabilizer free weak Galerkin methods further simplify the WG methods and reduce computational complexity. This paper explores the possibility of optimal combination of polynomial spaces that minimize the number of unknowns in the stabilizer free WG schemes without compromising the accuracy of the numerical approximation. A new stabilizer free weak Galerkin finite element method is proposed and analyzed with polynomial degree reduction. To achieve such a goal, a new definition of weak gradient is introduced. Error estimates of optimal order are established for the corresponding WG approximations in both a discrete $H^1$ norm and the standard $L^2$ norm. The numerical examples are tested on various meshes and confirm the theory.


title: Fractional Fokker-Planck equations for subdiffusion and exceptional orthogonal polynomials

abstract: It is pointed out that, for the fractional Fokker-Planck equation for subdiffusion proposed by Metzler, Barkai, and Klafter [Phys. Rev. Lett. 82 (1999) 3563], there are four types of infinitely many exact solutions associated with the newly discovered exceptional orthogonal polynomials. They represent fractionally deformed versions of the Rayleigh process and the Jacobi process.

categories: cond-mat.stat-mech math-ph math.MP nlin.SI


title: Towards an Integrated Platform for Big Data Analysis

abstract: The amount of data in the world is expanding rapidly. Every day, huge amounts of data are created by scientific experiments, companies, and end users' activities. These large data sets have been labeled as "Big Data", and their storage, processing and analysis presents a plethora of new challenges to computer science researchers and IT professionals. In addition to efficient data management, additional complexity arises from dealing with semi-structured or unstructured data, and from time critical processing requirements. In order to understand these massive amounts of data, advanced visualization and data exploration techniques are required. Innovative approaches to these challenges have been developed during recent years, and continue to be a hot topic for re-search and industry in the future. An investigation of current approaches reveals that usually only one or two aspects are ad-dressed, either in the data management, processing, analysis or visualization. This paper presents the vision of an integrated plat-form for big data analysis that combines all these aspects. Main benefits of this approach are an enhanced scalability of the whole platform, a better parameterization of algorithms, a more efficient usage of system resources, and an improved usability during the end-to-end data analysis process.


title: Analysis and simulation of intervention strategies against bus bunching by means of an empirical agent-based model

abstract: In this paper, we propose an Empirically-based Monte Carlo Bus-network (EMB) model as a test bed to simulate intervention strategies to overcome the inefficiencies of bus bunching. The EMB model is an agent-based model which utilizes the positional and temporal data of the buses obtained from the Global Positioning System (GPS) to constitute: (1) a set of empirical velocity distributions of the buses, and (2) a set of exponential distributions of inter-arrival time of passengers at the bus stops. Monte Carlo sampling is then performed on these two derived probability distributions to yield the stochastic dynamics of both the buses' motion and passengers' arrival. Our EMB model is generic and can be applied to any real-world bus network system. In particular, we have validated the model against the Nanyang Technological University's Shuttle Bus System by demonstrating its accuracy in capturing the bunching dynamics of the shuttle buses. Furthermore, we have analyzed the efficacy of three intervention strategies: holding, no-boarding, and centralized-pulsing, against bus bunching by incorporating the rule-set of these strategies into the model. Under the scenario where the buses have the same velocity, we found that all three strategies improve both the waiting and travelling time of the commuters. However, when the buses have different velocities, only the centralized-pulsing scheme consistently outperform the control scenario where the buses periodically bunch together.


title: Efficient Inverse-Free Incremental and Decremental Algorithms for Multiple Hidden Nodes in Extreme Learning Machine

abstract: The inverse-free extreme learning machine (ELM) algorithm proposed in [4] was based on an inverse-free algorithm to compute the regularized pseudo-inverse, which was deduced from an inverse-free recursive algorithm to update the inverse of a Hermitian matrix. Before that recursive algorithm was applied in [4], its improved version had been utilized in previous literatures [9], [10]. Accordingly from the improved recursive algorithm [9], [10], several efficient inverse-free algorithms for ELM were proposed in [13] to reduce the computational complexity. In this paper, we propose two inverse-free algorithms for ELM with Tikhonov regularization, which can increase multiple hidden nodes in an iteration. On the other hand, we also propose two efficient decremental learning algorithms for ELM with Tikhonov regularization, which can remove multiple redundant nodes in an iteration.


title: Size and timescale of epidemics in the SIR framework

abstract: The most important features to assess the severity of an epidemic are its size and its timescale. We discuss these features in a systematic way in the context of SIR and SIR-type models. We investigate in detail how the size and timescale of the epidemic can be changed by acting on the parameters characterizing the model. Using these results and having as guideline the COVID-19 epidemic in Italy, we compare the efficiency of different containment strategies for contrasting an epidemic diffusion such as social distancing, lockdown, tracing, early detection and isolation.


title: The GLEAM 4-Jy (G4Jy) Sample: II. Host-galaxy identification for individual sources

abstract: The entire southern sky (Declination, $\delta <$ 30 deg) has been observed using the Murchison Widefield Array (MWA), which provides radio imaging of $\sim$2-arcmin resolution at low frequencies (72-231 MHz). This is the GaLactic and Extragalactic All-sky MWA (GLEAM) Survey, and we have previously used a combination of visual inspection, cross-checks against the literature, and internal matching to identify the 'brightest' radio-sources ($S_{\mathrm{151MHz}} >$ 4 Jy) in the extragalactic catalogue (Galactic latitude, $|b| >$ 10 deg). We refer to these 1,863 sources as the GLEAM 4-Jy (G4Jy) Sample, and use radio images (of $\leq$ 45-arcsec resolution), and multi-wavelength information, to assess their morphology and identify the galaxy that is hosting the radio emission (where appropriate). Details of how to access all of the overlays used for this work are available at https://github.com/svw26/G4Jy. Alongside this we conduct further checks against the literature, which we document in this paper for individual sources. Whilst the vast majority of the G4Jy Sample are active galactic nuclei with powerful radio-jets, we highlight that it also contains a nebula, two nearby, star-forming galaxies, a cluster relic, and a cluster halo. There are also three extended sources for which we are unable to infer the mechanism that gives rise to the low-frequency emission. In the G4Jy catalogue we provide mid-infrared identifications for 86% of the sources, and flag the remainder as: having an uncertain identification (129 sources), having a faint/uncharacterised mid-infrared host (126 sources), or it being inappropriate to specify a host (2 sources). For the subset of 129 sources, there is ambiguity concerning candidate host-galaxies, and this includes four sources (B0424$-$728, B0703$-$451, 3C 198, and 3C 403.1) where we question the existing identification.


title: The differences of damage initiation and accumulation of DP steels: a numerical and experimental analysis

abstract: Many studies have examined the damage behaviour of dual-phase steels already. It is a topic of high interest, since understanding the mechanisms of damage during forming processes enables the production of steels with improved properties and damage tolerance. However, the focus was rarely on the comparison between representatives of this steel class, and the numerical simulation for the quantification of damage states was not thoroughly used. Therefore, this study compares the damage initiation and accumulation of two dual-phase steels (DP800 and DP1000), which are used in the automotive industry. Additionally, parameter sets of a phenomenological damage mechanics model with coupled damage evolution are calibrated for each material. The combined analysis reveals an earlier initiation of damage for the DP800, where the damage accumulation phase is prolonged. For DP1000 the damage nucleates only shortly before material failure. The material model is able to correctly predict the behaviour, while experimental analysis confirms the prediction via light optical and SEM metallography.


title: FlexSA: Flexible Systolic Array Architecture for Efficient Pruned DNN Model Training

abstract: Modern deep learning models have high memory and computation cost. To make them fast and memory-cost efficient, structured model pruning is commonly used. We find that pruning a model using a common training accelerator with large systolic arrays is extremely performance-inefficient. To make a systolic array efficient for pruning and training, we propose FlexSA, a flexible systolic array architecture. FlexSA dynamically reconfigures the systolic array structure and offers multiple sub-systolic operating modes, which are designed for energy- and memory bandwidth-efficient processing of tensors with different sizes and shapes. We also present a compilation heuristic for tiling matrix-multiplication-and-accumulation operations in a training workload to best utilize the resources of FlexSA. Based on our evaluation, FlexSA with the proposed compilation heuristic improves compute resource utilization of pruning and training modern CNN models by 37% compared to a conventional training accelerator with a large systolic array. FlexSA also improves on-chip data reuse by 1.7X saving 28% energy compared to naive systolic array splitting.


title: Shock within a shock: revisiting the radio flares of NS merger ejecta and GRB-supernovae

abstract: Fast ejecta expelled in binary neutron star (NS) mergers or energetic supernovae (SNe) should produce late-time synchrotron radio emission as the ejecta shocks into the surrounding ambient medium. Models for such radio flares typically assume the ejecta expands into an unperturbed interstellar medium (ISM). However, it is also well-known that binary NS mergers and broad-lined Ic SNe can harbor relativistic jetted outflows. In this work, we show that such jets shock the ambient ISM ahead of the ejecta, thus evacuating the medium into which the ejecta subsequently collides. Using an idealized spherically-symmetric model, we illustrate that this inhibits the ejecta radio flare at early times $t < t_{\rm col} \approx 12 \, {\rm yr} \, (E_{\rm j}/10^{49} \, {\rm erg})^{1/3} (n/1 \, {\rm cm}^{-3})^{-1/3} (v_{\rm ej}/0.1c)^{-5/3}$ where $E_{\rm j}$ is the jet energy, $n$ the ISM density, and $v_{\rm ej}$ the ejecta velocity. We also show that this can produce a sharply peaked enhancement in the light-curve at $t = t_{\rm col}$. This has implications for radio observations of GW170817 and future binary NS mergers, gamma-ray burst (GRB) SNe, decade-long radio transients such as FIRST J1419, and possibly other events where a relativistic outflow precedes a slower-moving ejecta. Future numerical work will extend these analytic estimates and treat the multi-dimensional nature of the problem.