title: A nearby repeating fast radio burst in the direction of M81

abstract: We report on the discovery of FRB 20200120E, a repeating fast radio burst (FRB) with low dispersion measure (DM), detected by the Canadian Hydrogen Intensity Mapping Experiment (CHIME)/FRB project. The source DM of 87.82 pc cm$^{-3}$ is the lowest recorded from an FRB to date, yet is significantly higher than the maximum expected from the Milky Way interstellar medium in this direction (~ 50 pc cm$^{-3}$). We have detected three bursts and one candidate burst from the source over the period 2020 January-November. The baseband voltage data for the event on 2020 January 20 enabled a sky localization of the source to within $\simeq$ 14 sq. arcmin (90% confidence). The FRB localization is close to M81, a spiral galaxy at a distance of 3.6 Mpc. The FRB appears on the outskirts of M81 (projected offset $\sim$ 20 kpc) but well inside its extended HI and thick disks. We empirically estimate the probability of chance coincidence with M81 to be $< 10^{-2}$. However, we cannot reject a Milky Way halo origin for the FRB. Within the FRB localization region, we find several interesting cataloged M81 sources and a radio point source detected in the Very Large Array Sky Survey (VLASS). We searched for prompt X-ray counterparts in Swift/BAT and Fermi/GBM data, and for two of the FRB 20200120E bursts, we rule out coincident SGR 1806$-$20-like X-ray bursts. Due to the proximity of FRB 20200120E, future follow-up for prompt multi-wavelength counterparts and sub-arcsecond localization could be constraining of proposed FRB models.


title: Learning Multimodal Contact-Rich Skills from Demonstrations Without Reward Engineering

abstract: Everyday contact-rich tasks, such as peeling, cleaning, and writing, demand multimodal perception for effective and precise task execution. However, these present a novel challenge to robots as they lack the ability to combine these multimodal stimuli for performing contact-rich tasks. Learning-based methods have attempted to model multi-modal contact-rich tasks, but they often require extensive training examples and task-specific reward functions which limits their practicality and scope. Hence, we propose a generalizable model-free learning-from-demonstration framework for robots to learn contact-rich skills without explicit reward engineering. We present a novel multi-modal sensor data representation which improves the learning performance for contact-rich skills. We performed training and experiments using the real-life Sawyer robot for three everyday contact-rich skills -- cleaning, writing, and peeling. Notably, the framework achieves a success rate of 100\% for the peeling and writing skill, and 80\% for the cleaning skill. Hence, this skill learning framework can be extended for learning other physical manipulation skills.


title: Dynamics of a ring of three unidirectionally coupled Duffing oscillators with time-dependent damping

abstract: We study dynamics of a ring of three unidirectionally coupled double-well Duffing oscillators for three different values of the damping coefficient: fixed dumping, proportional to time, and inversely proportional to time. The dynamics in all cases is analyzed through time series, Fourier and Hilbert transforms, Poincar\'e sections, as well as bifurcation diagrams and Lyapunov exponents with respect to the coupling strength. In the first case, we observe a well-known route from a stable steady state to hyperchaos through Hopf bifurcation and a series of torus bifurcations, as the coupling strength is increased. In the second case, the system is highly dissipative and converges into one of stable equilibria. Finally, in the third case, transient toroidal hyperchaos takes place.


title: The Link-Indecomposable Components of Hopf Algebras and Their Products

abstract: The link relation on simple subcoalgebras is used for decompositions of coalgebras. In this paper, we provide more sufficient conditions for this link relation, and prove a formula on the products between link-indecomposable components of Hopf algebras with the dual Chevalley property. Furthermore, we show that each of its component is generated by a simple subcoalgebra, as a faithfully flat module (in fact, a projective generator) over a Hopf subalgebra which is the component containing the unit element. Our conclusions generalize some relevant results on pointed Hopf algebras, which were established by Montgomery in 1995.


title: Robust 3D U-Net Segmentation of Macular Holes

abstract: Macular holes are a common eye condition which result in visual impairment. We look at the application of deep convolutional neural networks to the problem of macular hole segmentation. We use the 3D U-Net architecture as a basis and experiment with a number of design variants. Manually annotating and measuring macular holes is time consuming and error prone. Previous automated approaches to macular hole segmentation take minutes to segment a single 3D scan. Our proposed model generates significantly more accurate segmentations in less than a second. We found that an approach of architectural simplification, by greatly simplifying the network capacity and depth, exceeds both expert performance and state-of-the-art models such as residual 3D U-Nets.


title: Understanding & Predicting User Lifetime with Machine Learning in an Anonymous Location-Based Social Network

abstract: In this work, we predict the user lifetime within the anonymous and location-based social network Jodel in the Kingdom of Saudi Arabia. Jodel's location-based nature yields to the establishment of disjoint communities country-wide and enables for the first time the study of user lifetime in the case of a large set of disjoint communities. A user's lifetime is an important measurement for evaluating and steering customer bases as it can be leveraged to predict churn and possibly apply suitable methods to circumvent potential user losses. We train and test off the shelf machine learning techniques with 5-fold crossvalidation to predict user lifetime as a regression and classification problem; identifying the Random Forest to provide very strong results. Discussing model complexity and quality trade-offs, we also dive deep into a time-dependent feature subset analysis, which does not work very well; Easing up the classification problem into a binary decision (lifetime longer than timespan $x$) enables a practical lifetime predictor with very good performance. We identify implicit similarities across community models according to strong correlations in feature importance. A single countrywide model generalizes the problem and works equally well for any tested community; the overall model internally works similar to others also indicated by its feature importances.


title: Multi-Objective Evolutionary Design of Composite Data-Driven Models

abstract: In this paper, a multi-objective approach for the design of composite data-driven mathematical models is proposed. It allows automating the identification of graph-based heterogeneous pipelines that consist of different blocks: machine learning models, data preprocessing blocks, etc. The implemented approach is based on a parameter-free genetic algorithm (GA) for model design called GPComp@Free. It is developed to be part of automated machine learning solutions and to increase the efficiency of the modeling pipeline automation. A set of experiments was conducted to verify the correctness and efficiency of the proposed approach and substantiate the selected solutions. The experimental results confirm that a multi-objective approach to the model design allows achieving better diversity and quality of obtained models. The implemented approach is available as a part of the open-source AutoML framework FEDOT.


title: Coarse-Fine Networks for Temporal Activity Detection in Videos

abstract: In this paper, we introduce Coarse-Fine Networks, a two-stream architecture which benefits from different abstractions of temporal resolution to learn better video representations for long-term motion. Traditional Video models process inputs at one (or few) fixed temporal resolution without any dynamic frame selection. However, we argue that, processing multiple temporal resolutions of the input and doing so dynamically by learning to estimate the importance of each frame can largely improve video representations, specially in the domain of temporal activity localization. To this end, we propose (1) Grid Pool, a learned temporal downsampling layer to extract coarse features, and, (2) Multi-stage Fusion, a spatio-temporal attention mechanism to fuse a fine-grained context with the coarse features. We show that our method outperforms the state-of-the-arts for action detection in public datasets including Charades with a significantly reduced compute and memory footprint. The code is available at https://github.com/kkahatapitiya/Coarse-Fine-Networks


title: Exploring the high dimensional geometry of HSI features

abstract: We explore feature space geometries induced by the 3-D Fourier scattering transform and deep neural network with extended attribute profiles on four standard hyperspectral images. We examine the distances and angles of class means, the variability of classes, and their low-dimensional structures. These statistics are compared to that of raw features, and our results provide insight into the vastly different properties of these two methods. We also explore a connection with the newly observed deep learning phenomenon of neural collapse.


title: Accelerating Distributed-Memory Autotuning via Statistical Analysis of Execution Paths

abstract: The prohibitive expense of automatic performance tuning at scale has largely limited the use of autotuning to libraries for shared-memory and GPU architectures. We introduce a framework for approximate autotuning that achieves a desired confidence in each algorithm configuration's performance by constructing confidence intervals to describe the performance of individual kernels (subroutines of benchmarked programs). Once a kernel's performance is deemed sufficiently predictable for a set of inputs, subsequent invocations are avoided and replaced with a predictive model of the execution time. We then leverage online execution path analysis to coordinate selective kernel execution and propagate each kernel's statistical profile. This strategy is effective in the presence of frequently-recurring computation and communication kernels, which is characteristic to algorithms in numerical linear algebra. We encapsulate this framework as part of a new profiling tool, Critter, that automates kernel execution decisions and propagates statistical profiles along critical paths of execution. We evaluate performance prediction accuracy obtained by our selective execution methods using state-of-the-art distributed-memory implementations of Cholesky and QR factorization on Stampede2, and demonstrate speed-ups of up to 7.1x with 98% prediction accuracy.


title: Quantifying experimental edge plasma evolution via multidimensional adaptive Gaussian process regression

abstract: The edge density and temperature of tokamak plasmas are strongly correlated with energy and particle confinement and their quantification is fundamental to understanding edge dynamics. These quantities exhibit behaviours ranging from sharp plasma gradients and fast transient phenomena (e.g. transitions between low and high confinement regimes) to nominal stationary phases. Analysis of experimental edge measurements therefore require robust fitting techniques to capture potentially stiff spatiotemporal evolution. Additionally, fusion plasma diagnostics inevitably involve measurement errors and data analysis requires a statistical framework to accurately quantify uncertainties. This paper outlines a generalized multidimensional adaptive Gaussian process routine capable of automatically handling noisy data and spatiotemporal correlations. We focus on the edge-pedestal region in order to underline advancements in quantifying time-dependent plasma profiles including transport barrier formation on the Alcator C-Mod tokamak.


title: Scalable Scene Flow from Point Clouds in the Real World

abstract: Autonomous vehicles operate in highly dynamic environments necessitating an accurate assessment of which aspects of a scene are moving and where they are moving to. A popular approach to 3D motion estimation, termed scene flow, is to employ 3D point cloud data from consecutive LiDAR scans, although such approaches have been limited by the small size of real-world, annotated LiDAR data. In this work, we introduce a new large-scale dataset for scene flow estimation derived from corresponding tracked 3D objects, which is $\sim$1,000$\times$ larger than previous real-world datasets in terms of the number of annotated frames. We demonstrate how previous works were bounded based on the amount of real LiDAR data available, suggesting that larger datasets are required to achieve state-of-the-art predictive performance. Furthermore, we show how previous heuristics for operating on point clouds such as down-sampling heavily degrade performance, motivating a new class of models that are tractable on the full point cloud. To address this issue, we introduce the FastFlow3D architecture which provides real time inference on the full point cloud. Additionally, we design human-interpretable metrics that better capture real world aspects by accounting for ego-motion and providing breakdowns per object type. We hope that this dataset may provide new opportunities for developing real world scene flow systems.


title: About solving the Fechner-Stevens problem

abstract: In this paper, we prove that the Fechner and Stevens laws are equivalent (coincide up to isomorphism). Therefore, the problem does not exist.


title: SWIS -- Shared Weight bIt Sparsity for Efficient Neural Network Acceleration

abstract: Quantization is spearheading the increase in performance and efficiency of neural network computing systems making headway into commodity hardware. We present SWIS - Shared Weight bIt Sparsity, a quantization framework for efficient neural network inference acceleration delivering improved performance and storage compression through an offline weight decomposition and scheduling algorithm. SWIS can achieve up to 54.3% (19.8%) point accuracy improvement compared to weight truncation when quantizing MobileNet-v2 to 4 (2) bits post-training (with retraining) showing the strength of leveraging shared bit-sparsity in weights. SWIS accelerator gives up to 6x speedup and 1.9x energy improvement overstate of the art bit-serial architectures.


title: Investigating the potential impact of values on requirements and software engineering

abstract: This paper describes an investigation into value-based software engineering and proposes a comprehensive value taxonomy with an interpretation of design feature implications. The value taxonomy is used to assess the design of Covid19 symptom tracker applications.


title: On the radiation of an arbitrary moving constant magnetic moment

abstract: It is demonstrated that a constant magnetic moment does not emit electo-magnetic radiation while moving in an arbitrary field


title: Controlling composition of coexisting phases via molecular transitions

abstract: Phase separation and transitions among different molecular states are ubiquitous in living cells. Such transitions can be governed by local equilibrium thermodynamics or by active processes controlled by biological fuel. It remains largely unexplored how the behavior of phase-separating systems with molecular transitions differs between thermodynamic equilibrium and cases where detailed balance of the molecular transition rates is broken due to the presence of fuel. Here, we present a model of a phase-separating ternary mixture where two components can convert into each other. At thermodynamic equilibrium, we find that molecular transitions can give rise to a lower dissolution temperature and thus reentrant phase behavior. Moreover, we find a discontinuous thermodynamic phase transition in the composition of the droplet phase if both converting molecules attract themselves with similar interaction strength. Breaking detailed-balance of the molecular transition leads to quasi-discontinuous changes in droplet composition by varying the fuel amount for a larger range of inter-molecular interactions. Our findings showcase that phase separation with molecular transitions provides a versatile mechanism to control properties of intra-cellular and synthetic condensates via discontinuous switches in droplet composition.


title: UCB Momentum Q-learning: Correcting the bias without forgetting

abstract: We propose UCBMQ, Upper Confidence Bound Momentum Q-learning, a new algorithm for reinforcement learning in tabular and possibly stage-dependent, episodic Markov decision process. UCBMQ is based on Q-learning where we add a momentum term and rely on the principle of optimism in face of uncertainty to deal with exploration. Our new technical ingredient of UCBMQ is the use of momentum to correct the bias that Q-learning suffers while, at the same time, limiting the impact it has on the second-order term of the regret. For UCBMQ, we are able to guarantee a regret of at most $O(\sqrt{H^3SAT}+ H^4 S A )$ where $H$ is the length of an episode, $S$ the number of states, $A$ the number of actions, $T$ the number of episodes and ignoring terms in poly-$\log(SAHT)$. Notably, UCBMQ is the first algorithm that simultaneously matches the lower bound of $\Omega(\sqrt{H^3SAT})$ for large enough $T$ and has a second-order term (with respect to the horizon $T$) that scales only linearly with the number of states $S$.


title: Towards Understanding the COVID-19 Case Fatality Rate

abstract: An important parameter for COVID-19 is the case fatality rate (CFR). It has been applied to wide applications, including the measure of the severity of the infection, the estimation of the number of infected cases, risk assessment etc. However, there remains a lack of understanding on several aspects of CFR, including population factors that are important to CFR, the apparent discrepancy of CFRs in different countries, and how the age effect comes into play. We analyze the CFRs at two different time snapshots, July 6 and Dec 28, 2020, with one during the first wave and the other a second wave of the COVID-19 pandemic. We consider two important population covariates, age and GDP as a proxy for the quality and abundance of public health. Extensive exploratory data analysis leads to some interesting findings. First, there is a clear exponential age effect among different age groups, and, more importantly, the exponential index is almost invariant across countries and time in the pandemic. Second, the roles played by the age and GDP are a little surprising: during the first wave, age is a more significant factor than GDP, while their roles have switched during the second wave of the pandemic, which may be partially explained by the delay in time for the quality and abundance of public health and medical research to factor in.


title: SWP: Microsecond Network SLOs Without Priorities

abstract: The increasing use of cloud computing for latency-sensitive applications has sparked renewed interest in providing tight bounds on network tail latency. Achieving this in practice at reasonable network utilization has proved elusive, due to a combination of highly bursty application demand, faster link speeds, and heavy-tailed message sizes. While priority scheduling can be used to reduce tail latency for some traffic, this comes at a cost of much worse delay behavior for all other traffic on the network. Most operators choose to run their networks at very low average utilization, despite the added cost, and yet still suffer poor tail behavior. This paper takes a different approach. We build a system, swp, to help operators (and network designers) to understand and control tail latency without relying on priority scheduling. As network workload changes, swp is designed to give real-time advice on the network switch configurations needed to maintain tail latency objectives for each traffic class. The core of swp is an efficient model for simulating the combined effect of traffic characteristics, end-to-end congestion control, and switch scheduling on service-level objectives (SLOs), along with an optimizer that adjusts switch-level scheduling weights assigned to each class. Using simulation across a diverse set of workloads with different SLOs, we show that to meet the same SLOs as swp provides, FIFO would require 65% greater link capacity, and 79% more for scenarios with tight SLOs on bursty traffic classes.


title: Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learning

abstract: In many real-world problems, collecting a large number of labeled samples is infeasible. Few-shot learning (FSL) is the dominant approach to address this issue, where the objective is to quickly adapt to novel categories in presence of a limited number of samples. FSL tasks have been predominantly solved by leveraging the ideas from gradient-based meta-learning and metric learning approaches. However, recent works have demonstrated the significance of powerful feature representations with a simple embedding network that can outperform existing sophisticated FSL algorithms. In this work, we build on this insight and propose a novel training mechanism that simultaneously enforces equivariance and invariance to a general set of geometric transformations. Equivariance or invariance has been employed standalone in the previous works; however, to the best of our knowledge, they have not been used jointly. Simultaneous optimization for both of these contrasting objectives allows the model to jointly learn features that are not only independent of the input transformation but also the features that encode the structure of geometric transformations. These complementary sets of features help generalize well to novel classes with only a few data samples. We achieve additional improvements by incorporating a novel self-supervised distillation objective. Our extensive experimentation shows that even without knowledge distillation our proposed method can outperform current state-of-the-art FSL methods on five popular benchmark datasets.


title: Increased isolation mass for pebble accreting planetary cores in pressure maxima of protoplanetary discs

abstract: The growth of a pebble accreting planetary core is stopped when reaching its \textit{isolation mass} that is due to a pressure maximum emerging at the outer edge of the gap opened in gas. This pressure maximum traps the inward drifting pebbles stopping the accretion of solids onto the core. On the other hand, a large amount of pebbles ($\sim 100M_\oplus$) should flow through the orbit of the core until reaching its isolation mass. The efficiency of pebble accretion increases if the core grows in a dust trap of the protoplanetary disc. Dust traps are observed as ring-like structures by ALMA suggesting the existence of global pressure maxima in discs that can also act as planet migration traps. This work aims to reveal how large a planetary core can grow in such a pressure maximum by pebble accretion. In our hydrodynamic simulations, pebbles are treated as a pressureless fluid mutually coupled to the gas via drag force. Our results show that in a global pressure maximum the pebble isolation mass for a planetary core is significantly larger than in discs with power-law surface density profile. An increased isolation mass shortens the formation time of giant planets.


title: High-sensitivity radio study of the non-thermal stellar bow shock EB27

abstract: We present a deep radio-polarimetric observation of the stellar bow shock EB27 associated to the massive star BD+43 3654. This is the only stellar bow shock confirmed to have non-thermal radio emission. We used the Jansky Very Large Array in S band (2 - 4GHz) to test whether this synchrotron emission is polarised. The unprecedented sensitivity achieved allowed us to map even the fainter regions of the bow shock, revealing that the more diffuse emission is steeper and the bow shock brighter than previously reported. No linear polarisation is detected in the bow shock above 0.5%, although we detected polarised emission from two southern sources, probably extragalactic in nature. We modeled the intensity and morphology of the radio emission to better constrain the magnetic field and injected power in relativistic electrons. Finally, we derived a set of more precise parameters for the system EB27-BD+43 3654 using Gaia Early Data Release 3, including the spatial velocity. The new trajectory, back in time, intersects the core of the Cyg OB2 association.


title: A dynamical dark energy solution to Hubble-Lema\^{i}tre tension in the light of the multimessenger era

abstract: We show that the gravitational waves measurements have raised the opportunity to measure $H_0$ with dark sirens to within 2$\sigma$, the accuracy required to resolve the \hubble tension. There are two principal reasons for our results: (1) upgrades to GW LIGO-Virgo transient catalogues GWTC-1 and GWTC-2 enhance their sensitive with only 10\% of contamination fraction, and (2) new dark sirens should help to constrain our dynamical EoS. In conjunction, sensitivity upgrades and a new dark energy model will facilitate an accurate inference of the \hubble constant $H_0$ to better with an $\pm 0.077$ error in comparison to the LIGO dark siren with $+14.0$/$-7.0$, which would further solidify the role of dark sirens in late dark energy for precision cosmology in the future.


title: Adversarial training in communication constrained federated learning

abstract: Federated learning enables model training over a distributed corpus of agent data. However, the trained model is vulnerable to adversarial examples, designed to elicit misclassification. We study the feasibility of using adversarial training (AT) in the federated learning setting. Furthermore, we do so assuming a fixed communication budget and non-iid data distribution between participating agents. We observe a significant drop in both natural and adversarial accuracies when AT is used in the federated setting as opposed to centralized training. We attribute this to the number of epochs of AT performed locally at the agents, which in turn effects (i) drift between local models; and (ii) convergence time (measured in number of communication rounds). Towards this end, we propose FedDynAT, a novel algorithm for performing AT in federated setting. Through extensive experimentation we show that FedDynAT significantly improves both natural and adversarial accuracy, as well as model convergence time by reducing the model drift.


title: Quenched law of large numbers and quenched central limit theorem for multi-player leagues with ergodic strengths

abstract: We propose and study a new model for competitions, specifically sports multi-player leagues where the initial strengths of the teams are independent i.i.d. random variables that evolve during different days of the league according to independent ergodic processes. The result of each match is random: the probability that a team wins against another team is determined by a function of the strengths of the two teams in the day the match is played. Our model generalizes some previous models studied in the physical and mathematical literature and is defined in terms of different parameters that can be statistically calibrated. We prove a quenched -- conditioning on the initial strengths of the teams -- law of large numbers and a quenched central limit theorem for the number of victories of a team according to its initial strength. To obtain our results, we prove a theorem of independent interest. For a stationary process $\xi=(\xi_i)_{i\in \mathbb{N}}$ satisfying a mixing condition and an independent sequence of i.i.d. random variables $(s_i)_{i\in \mathbb{N}}$, we prove a quenched -- conditioning on $(s_i)_{i\in\mathbb{N}}$ -- central limit theorem for sums of the form $\sum_{i=1}^{n}g\left(\xi_i,s_i\right)$, where $g$ is a bounded measurable function. We highlight that the random variables $g\left(\xi_i,s_i\right)$ are not stationary conditioning on $(s_i)_{i\in\mathbb{N}}$.


title: Black hole in asymmetric cosmological bounce

abstract: We determine the causal structure of the McVittie spacetime for a cosmological model with an asymmetric bounce. The analysis includes the computation of trapping horizons, regular, trapped, and anti-trapped regions, and the integration of the trajectories of radial null geodesics before, during, and after the bounce. We find a trapped region since the beginning of the contracting phase up to shortly before the bounce, thus showing the existence of a black hole. When the universe reaches a certain minimum scale in the contracting phase, the trapping horizons disappear and the central singularity becomes naked. These results suggest that neither a contracting nor an expanding universe can accommodate a black hole at all times.


title: Thinking Out of the Blocks: Holochain for Distributed Security in IoT Healthcare

abstract: The Internet-of-Things (IoT) is an emerging and cognitive technology which connects a massive number of smart physical devices with virtual objects operating in diverse platforms through the internet. IoT is increasingly being implemented in distributed settings, making footprints in almost every sector of our life. Unfortunately, for healthcare systems, the entities connected to the IoT networks are exposed to an unprecedented level of security threats. Relying on a huge volume of sensitive and personal data, IoT healthcare systems are facing unique challenges in protecting data security and privacy. Although blockchain has posed to be the solution in this scenario thanks to its inherent distributed ledger technology (DLT), it suffers from major setbacks of increasing storage and computation requirements with the network size. This paper proposes a holochain-based security and privacy-preserving framework for IoT healthcare systems that overcomes these challenges and is particularly suited for resource constrained IoT scenarios. The performance and thorough security analyses demonstrate that a holochain-based IoT healthcare system is significantly better compared to blockchain and other existing systems.


title: Estimate of Heat Kernel for Euler-Maruyama Scheme of SDEs Driven by {\alpha}-Stable Noise and Applications

abstract: In this paper, the discrete parameter expansion is adopted to investigate the estimation of heat kernel for Euler-Maruyama scheme of SDEs driven by {\alpha}-stable noise, which implies krylov's estimate and khasminskii's estimate. As an application, the convergence rate of Euler-Maruyama scheme of a class of multidimensional SDEs with singular drift( in aid of Zvonkin's transformation) is obtained.


title: General Feasibility Bounds for Sample Average Approximation via Vapnik-Chervonenkis Dimension

abstract: We investigate the feasibility of sample average approximation (SAA) for general stochastic optimization problems, including two-stage stochastic programming without the relatively complete recourse assumption. Instead of analyzing problems with specific structures, we utilize results from the Vapnik-Chervonenkis (VC) dimension and Probably Approximately Correct learning to provide a general framework that offers explicit feasibility bounds for SAA solutions under minimal structural or distributional assumption. We show that, as long as the hypothesis class formed by the feasbible region has a finite VC dimension, the infeasibility of SAA solutions decreases exponentially with computable rates and explicitly identifiable accompanying constants. We demonstrate how our bounds apply more generally and competitively compared to existing results.


title: Reeb flows transverse to foliations

abstract: Let $\mathcal F$ be a co-oriented $C^2$ foliation on a closed, oriented 3-manifold. We show that $T\mathcal F$ can be perturbed to a contact structure with Reeb flow transverse to $\mathcal F$ if and only if $\mathcal F$ does not support an invariant transverse measure. The resulting Reeb flow has no contractible orbits. This answers a question of Colin and Honda. The main technical tool in our proof is leafwise Brownian motion which we use to construct good transverse measures for $\mathcal F$; this gives a new perspective on the Eliashberg--Thurston theorem.


title: Green fields

abstract: We introduce {\em Green fields}, as commutative Green biset functors with no non-trivial ideals. We state some of their properties and give examples of known Green biset functors which are Green fields. Among the properties, we prove some criterions ensuring that a Green field is semisimple. Finally, we describe a type of Green field for which its category of modules is equivalent to a category of vector spaces over a field.


title: A practical tutorial on Variational Bayes

abstract: This tutorial gives a quick introduction to Variational Bayes (VB), also called Variational Inference or Variational Approximation, from a practical point of view. The paper covers a range of commonly used VB methods and an attempt is made to keep the materials accessible to the wide community of data analysis practitioners. The aim is that the reader can quickly derive and implement their first VB algorithm for Bayesian inference with their data analysis problem. An end-user software package in Matlab together with the documentation can be found at https://vbayeslab.github.io/VBLabDocs/


title: ToxCCIn: Toxic Content Classification with Interpretability

abstract: Despite the recent successes of transformer-based models in terms of effectiveness on a variety of tasks, their decisions often remain opaque to humans. Explanations are particularly important for tasks like offensive language or toxicity detection on social media because a manual appeal process is often in place to dispute automatically flagged content. In this work, we propose a technique to improve the interpretability of these models, based on a simple and powerful assumption: a post is at least as toxic as its most toxic span. We incorporate this assumption into transformer models by scoring a post based on the maximum toxicity of its spans and augmenting the training process to identify correct spans. We find this approach effective and can produce explanations that exceed the quality of those provided by Logistic Regression analysis (often regarded as a highly-interpretable model), according to a human study.


title: Active polymer rings: activity-induced collapse and dynamical arrest

abstract: We investigate, using numerical simulations, the conformations of isolated active ring polymers. We find that the their behaviour depends crucially on their size: short rings ($N \lesssim$ 100) are swelled whereas longer rings ($N \gtrsim$ 200) collapse, at sufficiently high activity. By investigating the non-equilibrium process leading to the steady state, we find a universal route driving both outcomes; we highlight the central role of steric interactions, at variance with linear chains, and of topology conservation. We further show that the collapsed rings are arrested by looking at different observables, all underlining the presence of an extremely long time scales at the steady state, associated with the internal dynamics of the collapsed section. Finally, we found that is some circumstances the collapsed state spins about its axis.


title: An exact lower bound within a 331 model closing solution

abstract: On this note we show how one specific proposal of solution to the problem of `closing' the well motivated 331 model to the Standard Model actually implies a lower bound for the otherwise theoretically free vacuum expectation value $v_\chi$.


title: The OPE meets semiclassics

abstract: We show that the correlator of three large charge operators with minimal scaling dimension can be computed semiclassically in CFTs with a $U(1)$ symmetry for arbitrary fixed values of the ratios of their charges. We obtain explicitly the OPE coefficient from the numerical solution of a nonlinear boundary value problem in the conformal superfluid EFT in $3d$. The result applies in all three-dimensional CFTs with a $U(1)$ symmetry whose large charge sector is a superfluid.


title: Directional ballistic transport in the two-dimensional metal PdCoO2

abstract: In an idealized infinite crystal, the material properties are constrained by the symmetries of its unit cell. Naturally, the point-group symmetry is broken by the sample shape of any finite crystal, yet this is commonly unobservable in macroscopic metals. To sense the shape-induced symmetry lowering in such metals, long-lived bulk states originating from anisotropic Fermi surfaces are needed. Here we show how strongly facetted Fermi surfaces and long quasiparticle mean free paths present in microstructures of PdCoO2 yield an in-plane resistivity anisotropy that is forbidden by symmetry on an infinite hexagonal lattice. Bar shaped transport devices narrower than the mean free path are carved from single crystals using focused ion beam (FIB) milling, such that the ballistic charge carriers at low temperatures frequently collide with both sidewalls defining a channel. Two symmetry-forbidden transport signatures appear: the in-plane resistivity anisotropy exceeds a factor of 2, and transverse voltages appear in zero magnetic field. We robustly identify the channel direction as the source of symmetry breaking via ballistic Monte- Carlo simulations and numerical solution of the Boltzmann equation.


title: LTO: Lazy Trajectory Optimization with Graph-Search Planning for High DOF Robots in Cluttered Environments

abstract: Although Trajectory Optimization (TO) is one of the most powerful motion planning tools, it suffers from expensive computational complexity as a time horizon increases in cluttered environments. It can also fail to converge to a globally optimal solution. In this paper, we present Lazy Trajectory Optimization (LTO) that unifies local short-horizon TO and global Graph-Search Planning (GSP) to generate a long-horizon global optimal trajectory. LTO solves TO with the same constraints as the original long-horizon TO with improved time complexity. We also propose a TO-aware cost function that can balance both solution cost and planning time. Since LTO solves many nearly identical TO in a roadmap, it can provide an informed warm-start for TO to accelerate the planning process. We also present proofs of the computational complexity and optimality of LTO. Finally, we demonstrate LTO's performance on motion planning problems for a 2 DOF free-flying robot and a 21 DOF legged robot, showing that LTO outperforms existing algorithms in terms of its runtime and reliability.


title: Deep Bag-of-Sub-Emotions for Depression Detection in Social Media

abstract: This paper presents the Deep Bag-of-Sub-Emotions (DeepBoSE), a novel deep learning model for depression detection in social media. The model is formulated such that it internally computes a differentiable Bag-of-Features (BoF) representation that incorporates emotional information. This is achieved by a reinterpretation of classical weighting schemes like term frequency-inverse document frequency into probabilistic deep learning operations. An important advantage of the proposed method is that it can be trained under the transfer learning paradigm, which is useful to enhance conventional BoF models that cannot be directly integrated into deep learning architectures. Experiments were performed in the eRisk17 and eRisk18 datasets for the depression detection task; results show that DeepBoSE outperforms conventional BoF representations and it is competitive with the state of the art, achieving a F1-score over the positive class of 0.64 in eRisk17 and 0.65 in eRisk18.


title: How Fair is Fairness-aware Representative Ranking and Methods for Fair Ranking

abstract: Rankings of people and items has been highly used in selection-making, match-making, and recommendation algorithms that have been deployed on ranging of platforms from employment websites to searching tools. The ranking position of a candidate affects the amount of opportunities received by the ranked candidate. It has been observed in several works that the ranking of candidates based on their score can be biased for candidates belonging to the minority community. In recent works, the fairness-aware representative ranking was proposed for computing fairness-aware re-ranking of results. The proposed algorithm achieves the desired distribution of top-ranked results with respect to one or more protected attributes. In this work, we highlight the bias in fairness-aware representative ranking for an individual as well as for a group if the group is sub-active on the platform. We define individual unfairness and group unfairness and propose methods to generate ideal individual and group fair representative ranking if the universal representation ratio is known or unknown. The simulation results show the quantified analysis of fairness in the proposed solutions. The paper is concluded with open challenges and further directions.


title: Observational properties of a general relativistic instability supernova from a primordial supermassive star

abstract: We present the expected observational properties of a general relativistic instability supernova (GRSN) from the 55,500 Msun primordial (Population III) star. Supermassive stars exceeding 1e4 Msun may exist in the early Universe. They are generally considered to collapse through the general relativistic instability to be seed black holes to form supermassive (~ 1e9 Msun) black holes observed as high-redshift quasars. Some of them, however, may explode as GRSNe if the explosive helium burning unbinds the supermassive stars following the collapse triggered by the general relativistic instability. We perform the radiation hydrodynamics simulation of the GRSN starting shortly before the shock breakout. We find that the GRSN is characterized by a long-lasting (550 d) luminous (1.5e44 erg/s) plateau phase with the photospheric temperature of around 5000 K in the rest frame. The plateau phase lasts for decades when it appears at high redshifts and it will likely be observed as a persistent source in the future deep near-infrared imaging surveys. Especially, the near-infrared images reaching 29 AB magnitude that can be obtained by Galaxy and Reionization EXplorer (G-REX) and James Webb Space Telescope (JWST) allow us to identify GRSNe up to z ~ 15. Deeper images enable us to discover GRSNe at even higher redshifts. Having extremely red color, they can be distinguished from other persistent sources such as high-redshift galaxies by using color information. We conclude that the deep near-infrared images are able to constrain the existence of GRSNe from the primordial supermassive stars in the Universe even without the time domain information.


title: Splitting the Sample at the Largest Uncensored Observation

abstract: We calculate finite sample and asymptotic distributions for the largest censored and uncensored survival times, and some related statistics, from a sample of survival data generated according to an iid censoring model. These statistics are important for assessing whether there is sufficient followup in the sample to be confident of the presence of immune or cured individuals in the population. A key structural result obtained is that, conditional on the value of the largest uncensored survival time, and knowing the number of censored observations exceeding this time, the sample partitions into two independent subsamples, each subsample having the distribution of an iid sample of censored survival times, of reduced size, from truncated random variables. This result provides valuable insight into the construction of censored survival data, and facilitates the calculation of explicit finite sample formulae. We illustrate for distributions of statistics useful for testing for sufficient followup in a sample, and apply extreme value methods to derive asymptotic distributions for some of those.


title: Acceleration via Fractal Learning Rate Schedules

abstract: In practical applications of iterative first-order optimization, the learning rate schedule remains notoriously difficult to understand and expensive to tune. We demonstrate the presence of these subtleties even in the innocuous case when the objective is a convex quadratic. We reinterpret an iterative algorithm from the numerical analysis literature as what we call the Chebyshev learning rate schedule for accelerating vanilla gradient descent, and show that the problem of mitigating instability leads to a fractal ordering of step sizes. We provide some experiments to challenge conventional beliefs about stable learning rates in deep learning: the fractal schedule enables training to converge with locally unstable updates which make negative progress on the objective.


title: Net convergence structures with applications to vector lattices

abstract: Convergence is a fundamental topic in analysis that is most commonly modelled using topology. However, there are many natural convergences that are not given by any topology; e.g., convergence almost everywhere of a sequence of measurable functions and order convergence of nets in vector lattices. The theory of convergence structures provides a framework for studying more general modes of convergence. It also has one particularly striking feature: it is formalized using the language of filters. This paper develops a general theory of convergence in terms of nets. We show that it is equivalent to the filter-based theory and present some translations between the two areas. In particular, we provide a characterization of pretopological convergence structures in terms of nets. We also use our results to unify certain topics in vector lattices with general convergence theory.


title: Reducing the Volatility of Cryptocurrencies -- A Survey of Stablecoins

abstract: In the wake of financial crises, stablecoins are gaining adoption among digital currencies. We discuss how stablecoins help reduce the volatility of cryptocurrencies by surveying different types of stablecoins and their stability mechanisms. We classify different approaches to stablecoins in three main categories i) fiat or asset backed, ii) crypto-collateralized and iii) algorithmic stablecoins, giving examples of concrete projects in each class. We assess the relative tradeoffs between the different approaches. We also discuss challenges associated with the future of stablecoins and their adoption, their adoption and point out future research directions.


title: What Are We Really Testing in Mutation Testing for Machine Learning? A Critical Reflection

abstract: Mutation testing is a well-established technique for assessing a test suite's quality by injecting artificial faults into production code. In recent years, mutation testing has been extended to machine learning (ML) systems, and deep learning (DL) in particular; researchers have proposed approaches, tools, and statistically sound heuristics to determine whether mutants in DL systems are killed or not. However, as we will argue in this work, questions can be raised to what extent currently used mutation testing techniques in DL are actually in line with the classical interpretation of mutation testing. We observe that ML model development resembles a test-driven development (TDD) process, in which a training algorithm (`programmer') generates a model (program) that fits the data points (test data) to labels (implicit assertions), up to a certain threshold. However, considering proposed mutation testing techniques for ML systems under this TDD metaphor, in current approaches, the distinction between production and test code is blurry, and the realism of mutation operators can be challenged. We also consider the fundamental hypotheses underlying classical mutation testing: the competent programmer hypothesis and coupling effect hypothesis. As we will illustrate, these hypotheses do not trivially translate to ML system development, and more conscious and explicit scoping and concept mapping will be needed to truly draw parallels. Based on our observations, we propose several action points for better alignment of mutation testing techniques for ML with paradigms and vocabularies of classical mutation testing.


title: Reinforcement Learning for Adaptive Mesh Refinement

abstract: Large-scale finite element simulations of complex physical systems governed by partial differential equations (PDE) crucially depend on adaptive mesh refinement (AMR) to allocate computational budget to regions where higher resolution is required. Existing scalable AMR methods make heuristic refinement decisions based on instantaneous error estimation and thus do not aim for long-term optimality over an entire simulation. We propose a novel formulation of AMR as a Markov decision process and apply deep reinforcement learning (RL) to train refinement policies directly from simulation. AMR poses a new problem for RL as both the state dimension and available action set changes at every step, which we solve by proposing new policy architectures with differing generality and inductive bias. The model sizes of these policy architectures are independent of the mesh size and hence can be deployed on larger simulations than those used at train time. We demonstrate in comprehensive experiments on static function estimation and time-dependent equations that RL policies can be trained on problems without using ground truth solutions, are competitive with a widely-used error estimator, and generalize to larger, more complex, and unseen test problems.


title: Splittings of triangle Artin groups

abstract: We show that a triangle Artin group $\text{Art}_{MNP}$ where $M\leq N\leq P$ splits as an amalgamated product or an HNN extension of finite rank free groups, provided that either $M>2$, or $N>3$. We also prove that all even three generator Artin groups are residually finite.


title: Multi-Party Proof Generation in QAP-based zk-SNARKs

abstract: Zero-knowledge succinct non-interactive argument of knowledge (zkSNARK) allows a party, known as the prover, to convince another party, known as the verifier, that he knows a private value $v$, without revealing it, such that $F(u,v)=y$ for some function $F$ and public values $u$ and $y$. There are various versions of zk-SNARK, among them, Quadratic Arithmetic Program (QAP)-based zk-SNARK has been widely used in practice, specially in Blockchain technology. This is attributed to two desirable features; its fixed-size proof and the very light computation load of the verifier. However, the computation load of the prover in QAP-based zkSNARKs, is very heavy, even-though it is designed to be very efficient. This load can be beyond the prover's computation power to handle, and has to be offloaded to some external servers. In the existing offloading solutions, either (i) the load of computation, offloaded to each sever, is a fraction of the prover's primary computation (e.g., DZIK), however the servers need to be trusted, (ii) the servers are not required to be trusted, but the computation complexity imposed to each one is the same as the prover's primary computation (e.g., Trinocchio). In this paper, we present a scheme, which has the benefits of both solutions. In particular, we propose a secure multi-party proof generation algorithm where the prover can delegate its task to $N $ servers, where (i) even if a group of $T \in \mathbb{N}$ servers, $T\le N$, collude, they cannot gain any information about the secret value $v$, (ii) the computation complexity of each server is less than $1/(N-T)$ of the prover's primary computation. The design is such that we don't lose the efficiency of the prover's algorithm in the process of delegating the tasks to external servers.


title: Emotion Dynamics in Movie Dialogues

abstract: Emotion dynamics is a framework for measuring how an individual's emotions change over time. It is a powerful tool for understanding how we behave and interact with the world. In this paper, we introduce a framework to track emotion dynamics through one's utterances. Specifically we introduce a number of utterance emotion dynamics (UED) metrics inspired by work in Psychology. We use this approach to trace emotional arcs of movie characters. We analyze thousands of such character arcs to test hypotheses that inform our broader understanding of stories. Notably, we show that there is a tendency for characters to use increasingly more negative words and become increasingly emotionally discordant with each other until about 90 percent of the narrative length. UED also has applications in behavior studies, social sciences, and public health.


title: Roosterize: Suggesting Lemma Names for Coq Verification Projects Using Deep Learning

abstract: Naming conventions are an important concern in large verification projects using proof assistants, such as Coq. In particular, lemma names are used by proof engineers to effectively understand and modify Coq code. However, providing accurate and informative lemma names is a complex task, which is currently often carried out manually. Even when lemma naming is automated using rule-based tools, generated names may fail to adhere to important conventions not specified explicitly. We demonstrate a toolchain, dubbed Roosterize, which automatically suggests lemma names in Coq projects. Roosterize leverages a neural network model trained on existing Coq code, thus avoiding manual specification of naming conventions. To allow proof engineers to conveniently access suggestions from Roosterize during Coq project development, we integrated the toolchain into the popular Visual Studio Code editor. Our evaluation shows that Roosterize substantially outperforms strong baselines for suggesting lemma names and is useful in practice. The demo video for Roosterize can be viewed at: https://youtu.be/HZ5ac7Q14rc.


title: Supporting a Crowd-powered Accessible Online Art Gallery for People with Visual Impairments: A Feasibility Study

abstract: While people with visual impairments are interested in artwork as much as their sighted peers, their experience is limited to few selective artworks that are exhibited at certain museums. To enable people with visual impairments to access and appreciate as many artworks as possible at ease, we propose an online art gallery that allows users to explore different parts of a painting displayed on their touchscreen-based devices while listening to corresponding verbal descriptions of the touched part on the screen. To investigate the scalability of our approach, we first explored if anonymous crowd who may not have expertise in art are capable of providing visual descriptions of artwork as a preliminary study. Then we conducted a user study with 9 participants with visual impairments to explore the potential of our system for independent artwork appreciation by assessing if and how well the system supports 4 steps of Feldman Model of Criticism. The findings suggest that visual descriptions of artworks produced by an anonymous crowd are sufficient for people with visual impairments to interpret and appreciate paintings with their own judgments which is different from existing approaches that focused on delivering descriptions and opinions written by art experts. Based on the lessons learned from the study, we plan to collect visual descriptions of a greater number of artwork and distribute our online art gallery publicly to make more paintings accessible for people with visual impairments.


title: Exploring Origins for Correlations between Flow Harmonics and Transverse Momentum in Small Collision Systems (Unambiguous Ambiguity)

abstract: High statistics data sets from experiments at the Relativistic Heavy Ion Collider (RHIC) and the Large Hadron Collider (LHC) with small and large collision species have enabled a wealth of new flow measurements, including the event-by-event correlation between observables. One exciting such observable $\rho(v^{2}_{n},[p_{T}])$ gauges the correlation between the mean transverse momentum of particles in an event and the various flow coefficients ($v_n$) in the same event [1]. Recently it has been proposed that very low multiplicity events may be sensitive to initial-state glasma correlations [2] rather than flow-related dynamics. We find utilizing the IP-JAZMA framework that the color domain explanation for the glasma results are incomplete. We then explore predictions from PYTHIA-8, and the version for including nuclear collisions called PYTHIA-ANGANTYR, which have only non-flow correlations and the AMPT model which has both non-flow and flow-type correlations. We find that PYTHIA-ANGANTYR has non-flow contributions to $\rho(v^{2}_{n},[p_{T}])$ in p+O, p+Pb, O+O collisions that are positive at low multiplicity and comparable to the glasma correlations. It is striking that in PYTHIA-8 in p+p collisions there is actually a sign-change from positive to negative $\rho(v^{2}_{n},[p_{T}])$ as a function of multiplicity. The AMPT results match the experimental data general trends in Pb+Pb collisions at the LHC, except at low multiplicity where AMPT has the opposite sign. In p+Pb collisions, AMPT has the opposite sign from experimental data and we explore this within the context of parton geometry. Predictions for p+O, O+O, and Xe+Xe are also presented.


title: Spin-half bosonic classification

abstract: In this paper, we define a new spinor classification that encompasses the recently proposed spin-half bosons with mass dimension three-half. As it will be shown, these particles, which are governed by a first-order equation and consequently provide a local theory, belong to a specific subclass of class-2 spinors within the bosonic classification, playing a similar role to Dirac spinors within the Lounesto classification. Such bosonic classification is shown to be closely connected with the usual fermionic Lounesto classification, and thus, evincing a symmetry between Dirac fermions and spin-half bosons.


title: Hierarchical and Partially Observable Goal-driven Policy Learning with Goals Relational Graph

abstract: We present a novel two-layer hierarchical reinforcement learning approach equipped with a Goals Relational Graph (GRG) for tackling the partially observable goal-driven task, such as goal-driven visual navigation. Our GRG captures the underlying relations of all goals in the goal space through a Dirichlet-categorical process that facilitates: 1) the high-level network raising a sub-goal towards achieving a designated final goal; 2) the low-level network towards an optimal policy; and 3) the overall system generalizing unseen environments and goals. We evaluate our approach with two settings of partially observable goal-driven tasks -- a grid-world domain and a robotic object search task. Our experimental results show that our approach exhibits superior generalization performance on both unseen environments and new goals.


title: Channel-Driven Monte Carlo Sampling for Bayesian Distributed Learning in Wireless Data Centers

abstract: Conventional frequentist learning, as assumed by existing federated learning protocols, is limited in its ability to quantify uncertainty, incorporate prior knowledge, guide active learning, and enable continual learning. Bayesian learning provides a principled approach to address all these limitations, at the cost of an increase in computational complexity. This paper studies distributed Bayesian learning in a wireless data center setting encompassing a central server and multiple distributed workers. Prior work on wireless distributed learning has focused exclusively on frequentist learning, and has introduced the idea of leveraging uncoded transmission to enable "over-the-air" computing. Unlike frequentist learning, Bayesian learning aims at evaluating approximations or samples from a global posterior distribution in the model parameter space. This work investigates for the first time the design of distributed one-shot, or "embarrassingly parallel", Bayesian learning protocols in wireless data centers via consensus Monte Carlo (CMC). Uncoded transmission is introduced not only as a way to implement "over-the-air" computing, but also as a mechanism to deploy channel-driven MC sampling: Rather than treating channel noise as a nuisance to be mitigated, channel-driven sampling utilizes channel noise as an integral part of the MC sampling process. A simple wireless CMC scheme is first proposed that is asymptotically optimal under Gaussian local posteriors. Then, for arbitrary local posteriors, a variational optimization strategy is introduced. Simulation results demonstrate that, if properly accounted for, channel noise can indeed contribute to MC sampling and does not necessarily decrease the accuracy level.


title: Local Change Point Detection and Cleaning of EEMD Signals with Application to Acoustic Shockwaves

abstract: The Ensemble Empirical Mode Decomposition (EEMD) has become a preferred technique to decompose nonlinear and non-stationary signals due to its ability to create time-varying basis functions. However, current EEMD signal cleaning techniques are unable to deal with situations where a signal only occurs for a portion of the entire recording length. By combining change point detection and statistical hypothesis testing, we demonstrate how to clean a signal to emphasize unique local changes within each basis function. This not only allows us to observe which frequency bands are undergoing a change, but also leads to improved recovery of the underlying information. Using this technique, we demonstrate improved signal cleaning performance for acoustic shockwave signal detection. The technique is implemented in R via the LCDSC package.


title: There is More than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking with Sound by Distilling Multimodal Knowledge

abstract: Attributes of sound inherent to objects can provide valuable cues to learn rich representations for object detection and tracking. Furthermore, the co-occurrence of audiovisual events in videos can be exploited to localize objects over the image field by solely monitoring the sound in the environment. Thus far, this has only been feasible in scenarios where the camera is static and for single object detection. Moreover, the robustness of these methods has been limited as they primarily rely on RGB images which are highly susceptible to illumination and weather changes. In this work, we present the novel self-supervised MM-DistillNet framework consisting of multiple teachers that leverage diverse modalities including RGB, depth and thermal images, to simultaneously exploit complementary cues and distill knowledge into a single audio student network. We propose the new MTA loss function that facilitates the distillation of information from multimodal teachers in a self-supervised manner. Additionally, we propose a novel self-supervised pretext task for the audio student that enables us to not rely on labor-intensive manual annotations. We introduce a large-scale multimodal dataset with over 113,000 time-synchronized frames of RGB, depth, thermal, and audio modalities. Extensive experiments demonstrate that our approach outperforms state-of-the-art methods while being able to detect multiple objects using only sound during inference and even while moving.


title: Aut-invariant quasimorphisms on free products

abstract: Let $G=A \ast B$ be a free product of freely indecomposable groups. We explicitly construct quasimorphisms on $G$ which are invariant with respect to all automorphisms of $G$. We also prove that the space of such quasimorphisms is infinite-dimensional whenever $G$ is not the infinite dihedral group. As an application we prove that an invariant analogue of stable commutator length recently introduced by Kawasaki and Kimura is non-trivial for these groups.


title: Dynamic estimation with random forests for discrete-time survival data

abstract: Time-varying covariates are often available in survival studies and estimation of the hazard function needs to be updated as new information becomes available. In this paper, we investigate several different easy-to-implement ways that random forests can be used for dynamic estimation of the survival or hazard function from discrete-time survival data. The results from a simulation study indicate that all methods can perform well, and that none dominates the others. In general, situations that are more difficult from an estimation point of view (such as weaker signals and less data) favour a global fit, pooling over all time points, while situations that are easier from an estimation point of view (such as stronger signals and more data) favor local fits.


title: Statistical learning and cross-validation for point processes

abstract: This paper presents the first general (supervised) statistical learning framework for point processes in general spaces. Our approach is based on the combination of two new concepts, which we define in the paper: i) bivariate innovations, which are measures of discrepancy/prediction-accuracy between two point processes, and ii) point process cross-validation (CV), which we here define through point process thinning. The general idea is to carry out the fitting by predicting CV-generated validation sets using the corresponding training sets; the prediction error, which we minimise, is measured by means of bivariate innovations. Having established various theoretical properties of our bivariate innovations, we study in detail the case where the CV procedure is obtained through independent thinning and we apply our statistical learning methodology to three typical spatial statistical settings, namely parametric intensity estimation, non-parametric intensity estimation and Papangelou conditional intensity fitting. Aside from deriving theoretical properties related to these cases, in each of them we numerically show that our statistical learning approach outperforms the state of the art in terms of mean (integrated) squared error.


title: Posterior consistency for the spectral density of non-Gaussian stationary time series

abstract: Various nonparametric approaches for Bayesian spectral density estimation of stationary time series have been suggested in the literature, mostly based on the Whittle likelihood approximation. A generalization of this approximation has been proposed in Kirch et al. who prove posterior consistency for spectral density estimation in combination with the Bernstein-Dirichlet process prior for Gaussian time series. In this paper, we will extend the posterior consistency result to non-Gaussian time series by employing a general consistency theorem of Shalizi for dependent data and misspecified models. As a special case, posterior consistency for the spectral density under the Whittle likelihood as proposed by Choudhuri, Ghosal and Roy is also extended to non-Gaussian time series. Small sample properties of this approach are illustrated with several examples of non-Gaussian time series.


title: Heading errors in all-optical alkali-vapor magnetometers in geomagnetic fields

abstract: Alkali-metal atomic magnetometers suffer from heading errors in geomagnetic fields as the measured magnetic field depends on the orientation of the sensor with respect to the field. In addition to the nonlinear Zeeman splitting, the difference between Zeeman resonances in the two hyperfine ground states can also generate heading errors depending on initial spin polarization. We examine heading errors in an all-optical scalar magnetometer that uses free precession of polarized $^{87}\text{Rb}$ atoms by varying the direction and magnitude of the magnetic field at different spin polarization regimes. In the high polarization limit where the lower hyperfine ground state $F = 1$ is almost depopulated, we show that heading errors can be corrected with an analytical expression, reducing the errors by two orders of magnitude in Earth's field. We also verify the linearity of the measured Zeeman precession frequency with the magnetic field. With lower spin polarization, we find that the splitting of the Zeeman resonances for the two hyperfine states causes beating in the precession signals and nonlinearity of the measured precession frequency with the magnetic field. We correct for the frequency shifts by using the unique probe geometry where two orthogonal probe beams measure opposite relative phases between the two hyperfine states during the spin precession.


title: Brain Programming is Immune to Adversarial Attacks: Towards Accurate and Robust Image Classification using Symbolic Learning

abstract: In recent years, the security concerns about the vulnerability of Deep Convolutional Neural Networks (DCNN) to Adversarial Attacks (AA) in the form of small modifications to the input image almost invisible to human vision make their predictions untrustworthy. Therefore, it is necessary to provide robustness to adversarial examples in addition to an accurate score when developing a new classifier. In this work, we perform a comparative study of the effects of AA on the complex problem of art media categorization, which involves a sophisticated analysis of features to classify a fine collection of artworks. We tested a prevailing bag of visual words approach from computer vision, four state-of-the-art DCNN models (AlexNet, VGG, ResNet, ResNet101), and the Brain Programming (BP) algorithm. In this study, we analyze the algorithms' performance using accuracy. Besides, we use the accuracy ratio between adversarial examples and clean images to measure robustness. Moreover, we propose a statistical analysis of each classifier's predictions' confidence to corroborate the results. We confirm that BP predictions' change was below 2\% using adversarial examples computed with the fast gradient sign method. Also, considering the multiple pixel attack, BP obtained four out of seven classes without changes and the rest with a maximum error of 4\% in the predictions. Finally, BP also gets four categories using adversarial patches without changes and for the remaining three classes with a variation of 1\%. Additionally, the statistical analysis showed that the predictions' confidence of BP were not significantly different for each pair of clean and perturbed images in every experiment. These results prove BP's robustness against adversarial examples compared to DCNN and handcrafted features methods, whose performance on the art media classification was compromised with the proposed perturbations.


title: Field-tunable toroidal moment in a chiral-lattice magnet

abstract: A toroidal dipole moment appears independent of the electric and magnetic dipole moment in the multipole expansion of electrodynamics. It arises naturally from vortex-like arrangements of spins. Observing and controlling spontaneous long-range orders of toroidal moments are highly promising for spintronics but remain challenging. Here we demonstrate that a vortex-like spin configuration with a staggered arrangement of toroidal moments, a ferritoroidal state, is realized in a chiral triangular-lattice magnet BaCoSiO4. Upon applying a magnetic field, we observe multi-stair toroidal transitions correlating directly with metamagnetic transitions. We establish a first-principles microscopic Hamiltonian that explains both the formation of toroidal states and the metamagnetic toroidal transition as a combined effect of the magnetic frustration and the Dzyaloshinskii-Moriya interactions allowed by the crystallographic chirality in BaCoSiO4.


title: Multiclass Burn Wound Image Classification Using Deep Convolutional Neural Networks

abstract: Millions of people are affected by acute and chronic wounds yearly across the world. Continuous wound monitoring is important for wound specialists to allow more accurate diagnosis and optimization of management protocols. Machine Learning-based classification approaches provide optimal care strategies resulting in more reliable outcomes, cost savings, healing time reduction, and improved patient satisfaction. In this study, we use a deep learning-based method to classify burn wound images into two or three different categories based on the wound conditions. A pre-trained deep convolutional neural network, AlexNet, is fine-tuned using a burn wound image dataset and utilized as the classifier. The classifier's performance is evaluated using classification metrics such as accuracy, precision, and recall as well as confusion matrix. A comparison with previous works that used the same dataset showed that our designed classifier improved the classification accuracy by more than 8%.


title: Operator inference of non-Markovian terms for learning reduced models from partially observed state trajectories

abstract: This work introduces a non-intrusive model reduction approach for learning reduced models from partially observed state trajectories of high-dimensional dynamical systems. The proposed approach compensates for the loss of information due to the partially observed states by constructing non-Markovian reduced models that make future-state predictions based on a history of reduced states, in contrast to traditional Markovian reduced models that rely on the current reduced state alone to predict the next state. The core contributions of this work are a data sampling scheme to sample partially observed states from high-dimensional dynamical systems and a formulation of a regression problem to fit the non-Markovian reduced terms to the sampled states. Under certain conditions, the proposed approach recovers from data the very same non-Markovian terms that one obtains with intrusive methods that require the governing equations and discrete operators of the high-dimensional dynamical system. Numerical results demonstrate that the proposed approach leads to non-Markovian reduced models that are predictive far beyond the training regime. Additionally, in the numerical experiments, the proposed approach learns non-Markovian reduced models from trajectories with only 20% observed state components that are about as accurate as traditional Markovian reduced models fitted to trajectories with 99% observed components.


title: Momentum-Resolved Visualization of Electronic Evolution in Doping a Mott Insulator

abstract: High temperature superconductivity in cuprates arises from doping a parent Mott insulator by electrons or holes. A central issue is how the Mott gap evolves and the low-energy states emerge with doping. Here we report angle-resolved photoemission spectroscopy measurements on a cuprate parent compound by sequential in situ electron doping. The chemical potential jumps to the bottom of the upper Hubbard band upon a slight electron doping, making it possible to directly visualize the charge transfer band and the full Mott gap region. With increasing doping, the Mott gap rapidly collapses due to the spectral weight transfer from the charge transfer band to the gapped region and the induced low-energy states emerge in a wide energy range inside the Mott gap. These results provide key information on the electronic evolution in doping a Mott insulator and establish a basis for developing microscopic theories for cuprate superconductivity.


title: Subprojectivity in abelian categories

abstract: In the last few years, Lopez-Permouth and several collaborators have introduced a new approach in the study of the classical projectivity, injectivity and flatness of modules. This way, they introduced subprojectivity domains of modules as a tool to measure, somehow, the projectivity level of such a module (so not just to determine whether or not the module is projective). In this paper we develop a new treatment of the subprojectivity in any abelian category which shed more light on some of its various important aspects. Namely, in terms of subprojectivity, some classical results are unified and some classical rings are characterized. It is also shown that, in some categories, the subprojectivity measures notions other than the projectivity. Furthermore, this new approach allows, in addition to establishing nice generalizations of known results, to construct various new examples such as the subprojectivity domain of the class of Gorenstein projective objects, the class of semi-projective complexes and particular types of representations of a finite linear quiver. The paper ends with a study showing that the fact that a subprojectivity domain of a class coincides with its first right Ext-orthogonal class can be characterized in terms of the existence of preenvelopes and precovers.


title: Window Function for Chirped Pulse Spectroscopy with Enhanced Signal-to-noise Ratio and Lineshape Correction

abstract: In chirped pulse experiments, magnitude Fourier transform is used to generate frequency domain spectra. The application of window function as a tool for lineshape correction and signal-to-noise ratio (SnR) enhancement is rarely discussed in chirped spectroscopy, with the only exception of using Kaiser-Bessel window and trivial rectangular window. We present a specific window function, called "Voigt-1D" window, designed for chirped pulse spectroscopy. The window function corrects the magnitude Fourier-transform spectra to Voigt lineshape, and offers wide tunability to control the SnR and lineshape of the final spectral lines. We derived the mathematical properties of the window function, and evaluated the performance of the window function in comparison to the Kaiser-Bessel window on experimental and simulated data sets. Our result shows that, compared with un-windowed spectra, the Voigt-1D window is able to produce 100 % SnR enhancement on average.


title: The Everett Interpretation: Structure

abstract: The Everett interpretation of quantum mechanics divides naturally into two parts: first, the interpretation of the structure of the quantum state, in terms of branching, and second, the interpretation of this branching structure in terms of probability. This is the first of two reviews of the Everett interpretation, and focuses on structure, with particular attention to the role of decoherence theory. Written in terms of the quantum histories formalism, decoherence theory just is the theory of branching structure, in Everett's sense.


title: The Future Of The Arecibo Observatory: The Next Generation Arecibo Telescope

abstract: The Arecibo Observatory (AO) is a multidisciplinary research and education facility that is recognized worldwide as a leading facility in astronomy, planetary, and atmospheric and space sciences. AO's cornerstone research instrument was the 305-m William E. Gordon telescope. On December 1, 2020, the 305-m telescope collapsed and was irreparably damaged. In the three weeks following the collapse, AO's scientific and engineering staff and the AO users community initiated extensive discussions on the future of the observatory. The community is in overwhelming agreement that there is a need to build an enhanced, next-generation radar-radio telescope at the AO site. From these discussions, we established the set of science requirements the new facility should enable. These requirements can be summarized briefly as: 5 MW of continuous wave transmitter power at 2 - 6 GHz, 10 MW of peak transmitter power at 430 MHz (also at 220MHz under consideration), zenith angle coverage 0 to 48 deg, frequency coverage 0.2 to 30 GHz and increased Field-of-View. These requirements determine the unique specifications of the proposed new instrument. The telescope design concept we suggest consists of a compact array of fixed dishes on a tiltable, plate-like structure with a collecting area equivalent to a 300m dish. This concept, referred to as the Next Generation Arecibo Telescope (NGAT), meets all of the desired specifications and provides significant new science capabilities to all three research groups at AO. This whitepaper presents a sample of the wide variety of the science that can be achieved with the NGAT, the details of the telescope design concept and the need for the new telescope to be located at the AO site. We also discuss other AO science activities that interlock with the NGAT in the white paper.

categories: astro-ph.IM astro-ph.EP astro-ph.SR physics.ao-ph physics.ins-det


title: Standing on the Shoulders of Machine Learning: Can We Improve Hypothesis Testing?

abstract: In this paper we have updated the hypothesis testing framework by drawing upon modern computational power and classification models from machine learning. We show that a simple classification algorithm such as a boosted decision stump can be used to fully recover the full size-power trade-off for any single test statistic. This recovery implies an equivalence, under certain conditions, between the basic building block of modern machine learning and hypothesis testing. Second, we show that more complex algorithms such as the random forest and gradient boosted machine can serve as mapping functions in place of the traditional null distribution. This allows for multiple test statistics and other information to be evaluated simultaneously and thus form a pseudo-composite hypothesis test. Moreover, we show how practitioners can make explicit the relative costs of Type I and Type II errors to contextualize the test into a specific decision framework. To illustrate this approach we revisit the case of testing for unit roots, a difficult problem in time series econometrics for which existing tests are known to exhibit low power. Using a simulation framework common to the literature we show that this approach can improve upon overall accuracy of the traditional unit root test(s) by seventeen percentage points, and the sensitivity by thirty six percentage points.


title: Algorithmic Obstructions in the Random Number Partitioning Problem

abstract: We consider the algorithmic problem of finding a near-optimal solution for the number partitioning problem (NPP). The NPP appears in many applications, including the design of randomized controlled trials, multiprocessor scheduling, and cryptography; and is also of theoretical significance. It possesses a so-called statistical-to-computational gap: when its input $X$ has distribution $\mathcal{N}(0,I_n)$, its optimal value is $\Theta(\sqrt{n}2^{-n})$ w.h.p.; whereas the best polynomial-time algorithm achieves an objective value of only $2^{-\Theta(\log^2 n)}$, w.h.p. In this paper, we initiate the study of the nature of this gap. Inspired by insights from statistical physics, we study the landscape of NPP and establish the presence of the Overlap Gap Property (OGP), an intricate geometric property which is known to be a rigorous evidence of an algorithmic hardness for large classes of algorithms. By leveraging the OGP, we establish that (a) any sufficiently stable algorithm, appropriately defined, fails to find a near-optimal solution with energy below $2^{-\omega(n \log^{-1/5} n)}$; and (b) a very natural MCMC dynamics fails to find near-optimal solutions. Our simulations suggest that the state of the art algorithm achieving $2^{-\Theta(\log^2 n)}$ is indeed stable, but formally verifying this is left as an open problem. OGP regards the overlap structure of $m-$tuples of solutions achieving a certain objective value. When $m$ is constant we prove the presence of OGP in the regime $2^{-\Theta(n)}$, and the absence of it in the regime $2^{-o(n)}$. Interestingly, though, by considering overlaps with growing values of $m$ we prove the presence of the OGP up to the level $2^{-\omega(\sqrt{n\log n})}$. Our proof of the failure of stable algorithms at values $2^{-\omega(n \log^{-1/5} n)}$ employs methods from Ramsey Theory from the extremal combinatorics, and is of independent interest.


title: Compact Spectroscopy of keV to MeV X-rays from a Laser Wakefield Accelerator

abstract: We reconstruct spectra of secondary X-rays from a tunable 250-350 MeV laser wakefield electron accelerator from single-shot X-ray depth-energy measurements in a compact (7.5 $\times$ 7.5 $\times$ 15 cm), modular X-ray calorimeter made of alternating layers of absorbing materials and imaging plates. X-rays range from few-keV betatron to few-MeV inverse Compton to >100 MeV bremsstrahlung emission, and are characterized both individually and in mixtures. Geant4 simulations of energy deposition of single-energy X-rays in the stack generate an energy-vs-depth response matrix for a given stack configuration. An iterative reconstruction algorithm based on analytic models of betatron, inverse Compton and bremsstrahlung photon energy distributions then unfolds X-ray spectra, typically within a minute. We discuss uncertainties, limitations and extensions of both measurement and reconstruction methods.


title: I'm all Ears! Listening to Software Developers on Putting GDPR Principles into Software Development Practice

abstract: Previous research has been carried out to identify the impediments that prevent developers from incorporating privacy protocols into software applications. No research has been carried out to find out why developers are not able to develop systems that preserve-privacy while specifically considering the General Data Protection Regulation principles (GDPR principles). Consequently, this paper aims to examine the issues, which prevent developers from creating applications, which consider and include GDPR principles into their software systems. From our research findings, we identified the lack of familiarity with GDPR principles by developers as one of the obstacles that prevent GDPR onboarding. Those who were familiar with the principles did not have the requisite knowledge about the principles including their techniques. Developers focused on functional than on privacy requirements. Unavailability of resourceful online tools and lack of support from institutions and clients were also identified as issues inimical to the onboarding of GDPR principles.


title: Wormholes and out-of-time ordered correlators in gauge/gravity duality

abstract: We calculate the four-wave scattering amplitude in the background of an AdS traversable wormhole in 2+1 dimensions created by a nonlocal coupling of AdS boundaries in the BTZ black hole background. The holographic dual of this setup is a pair of CFTs coupled via a double-trace deformation, the scattering amplitude giving the out-of-time ordered correlator (OTOC) in CFT. Short-living wormholes always exhibit a regime of fast scrambling, saturating the MSS bound for the Lyapunov exponent but in the early-time regime the scrambling can be slower, with a Lyapunov exponent linear in $T$ but below the MSS bound. For long-living (near-eternal) wormholes however the numerics suggests the existence of another regime, with a drastic (exponential) slowdown of scrambling and an exponentially small Lyapunov exponent. Our findings have parallels in the SYK model, and may indicate certain limitations of wormhole teleportation protocols previously studied in the literature.


title: DeepMerge II: Building Robust Deep Learning Algorithms for Merging Galaxy Identification Across Domains

abstract: In astronomy, neural networks are often trained on simulation data with the prospect of being used on telescope observations. Unfortunately, training a model on simulation data and then applying it to instrument data leads to a substantial and potentially even detrimental decrease in model accuracy on the new target dataset. Simulated and instrument data represent different data domains, and for an algorithm to work in both, domain-invariant learning is necessary. Here we employ domain adaptation techniques$-$ Maximum Mean Discrepancy (MMD) as an additional transfer loss and Domain Adversarial Neural Networks (DANNs)$-$ and demonstrate their viability to extract domain-invariant features within the astronomical context of classifying merging and non-merging galaxies. Additionally, we explore the use of Fisher loss and entropy minimization to enforce better in-domain class discriminability. We show that the addition of each domain adaptation technique improves the performance of a classifier when compared to conventional deep learning algorithms. We demonstrate this on two examples: between two Illustris-1 simulated datasets of distant merging galaxies, and between Illustris-1 simulated data of nearby merging galaxies and observed data from the Sloan Digital Sky Survey. The use of domain adaptation techniques in our experiments leads to an increase of target domain classification accuracy of up to ${\sim}20\%$. With further development, these techniques will allow astronomers to successfully implement neural network models trained on simulation data to efficiently detect and study astrophysical objects in current and future large-scale astronomical surveys.

categories: astro-ph.IM astro-ph.GA cs.AI cs.CV cs.LG


title: A Kernel Framework to Quantify a Model's Local Predictive Uncertainty under Data Distributional Shifts

abstract: Traditional Bayesian approaches for model uncertainty quantification rely on notoriously difficult processes of marginalization over each network parameter to estimate its probability density function (PDF). Our hypothesis is that internal layer outputs of a trained neural network contain all of the information related to both its mapping function (quantified by its weights) as well as the input data distribution. We therefore propose a framework for predictive uncertainty quantification of a trained neural network that explicitly estimates the PDF of its raw prediction space (before activation), p(y'|x,w), which we refer to as the model PDF, in a Gaussian reproducing kernel Hilbert space (RKHS). The Gaussian RKHS provides a localized density estimate of p(y'|x,w), which further enables us to utilize gradient based formulations of quantum physics to decompose the model PDF in terms of multiple local uncertainty moments that provide much greater resolution of the PDF than the central moments characterized by Bayesian methods. This provides the framework with a better ability to detect distributional shifts in test data away from the training data PDF learned by the model. We evaluate the framework against existing uncertainty quantification methods on benchmark datasets that have been corrupted using common perturbation techniques. The kernel framework is observed to provide model uncertainty estimates with much greater precision based on the ability to detect model prediction errors.


title: Ultra-Slow Acoustic Energy Transport in Dense Fish Aggregates

abstract: A dramatic slowing down of acoustic wave transport in dense fish shoals is observed in open-sea fish cages. By employing a multi-beam ultrasonic antenna, we observe the coherent backscattering (CBS) phenomenon. We extract key parameters of wave transport such as the transport mean free path and the energy transport velocity of diffusive waves from diffusion theory fits to the experimental data. The energy transport velocity is found to be about 10 times smaller than the speed of sound in water, a value that is exceptionally low compared with most observations in acoustics. By studying different models of the fish body, we explain the basic mechanism responsible for the observed very slow transport of ultrasonic waves in dense fish shoals. Our results show that, while the fish swim bladder plays an important role in wave scattering, other organs have to be considered to explain ultra-low energy transport velocities.

categories: cond-mat.soft physics.app-ph physics.bio-ph physics.flu-dyn


title: Interplay Between Hierarchy and Centrality in Complex Networks

abstract: Hierarchy and centrality are two popular notions used to characterize the importance of entities in complex systems. Indeed, many complex systems exhibit a natural hierarchical structure, and centrality is a fundamental characteristic allowing to identify key constituents. Several measures based on various aspects of network topology have been proposed in order to quantify these concepts. While numerous studies have investigated whether centrality measures convey redundant information, how centrality and hierarchy measures are related is still an open issue. In this paper, we investigate the interaction between centrality and hierarchy using several correlation and similarity evaluation measures. A series of experiments is performed in order to evaluate the combinations of 6 centrality measures with 4 hierarchy measures across 28 diverse real-world networks with varying topological characteristics. Results show that network density and transitivity play a key role in shaping the pattern of relations between centrality and hierarchy measures.


title: Explicit Relations of Some Variants of Convoluted Multiple Zeta Values

abstract: Kaneko and Yamamoto introduced a convoluted variant of multiple zeta values (MVZs) around 2016. In this paper, we will first establish some explicit formulas involving these values and their alternating version by using iterated integrals, which enable us to derive some explicit relations of the multiple polylogarithm (MPL) functions. Next, we define convoluted multiple $t$-values and multiple mixed values (MMVs) as level two analogs of convoluted MZVs, and, similar to convoluted MZVs, use iterated integrals to find some relations of these level two analogs. We will then consider the parametric MPLs and the parametric multiple harmonic (star) sums, and extend the Kaneko-Yamamoto's "integral-series" identity of MZVs to MPLs and MMVs. Finally, we will study multiple integrals of MPLs and MMVs by generalizing Yamamoto's graphical representations to multiple-labeled posets.


title: Contrastive Explanations for Model Interpretability

abstract: Contrastive explanations clarify why an event occurred in contrast to another. They are more inherently intuitive to humans to both produce and comprehend. We propose a methodology to produce contrastive explanations for classification models by modifying the representation to disregard non-contrastive information, and modifying model behavior to only be based on contrastive reasoning. Our method is based on projecting model representation to a latent space that captures only the features that are useful (to the model) to differentiate two potential decisions. We demonstrate the value of contrastive explanations by analyzing two different scenarios, using both high-level abstract concept attribution and low-level input token/span attribution, on two widely used text classification tasks. Specifically, we produce explanations for answering: for which label, and against which alternative label, is some aspect of the input useful? And which aspects of the input are useful for and against particular decisions? Overall, our findings shed light on the ability of label-contrastive explanations to provide a more accurate and finer-grained interpretability of a model's decision.


title: Practical Privacy Filters and Odometers with R\'enyi Differential Privacy and Applications to Differentially Private Deep Learning

abstract: Differential Privacy (DP) is the leading approach to privacy preserving deep learning. As such, there are multiple efforts to provide drop-in integration of DP into popular frameworks. These efforts, which add noise to each gradient computation to make it DP, rely on composition theorems to bound the total privacy loss incurred over this sequence of DP computations. However, existing composition theorems present a tension between efficiency and flexibility. Most theorems require all computations in the sequence to have a predefined DP parameter, called the privacy budget. This prevents the design of training algorithms that adapt the privacy budget on the fly, or that terminate early to reduce the total privacy loss. Alternatively, the few existing composition results for adaptive privacy budgets provide complex bounds on the privacy loss, with constants too large to be practical. In this paper, we study DP composition under adaptive privacy budgets through the lens of R\'enyi Differential Privacy, proving a simpler composition theorem with smaller constants, making it practical enough to use in algorithm design. We demonstrate two applications of this theorem for DP deep learning: adapting the noise or batch size online to improve a model's accuracy within a fixed total privacy loss, and stopping early when fine-tuning a model to reduce total privacy loss.


title: Task-parallel in-situ temporal compression of large-scale computational fluid dynamics data

abstract: Present day computational fluid dynamics simulations generate extremely large amounts of data, sometimes on the order of TB/s. Often, a significant fraction of this data is discarded because current storage systems are unable to keep pace. To address this, data compression algorithms can be applied to data arrays containing flow quantities of interest to reduce the overall amount of storage. Compression methods either exactly reconstruct the original dataset (lossless compression) or provide an approximate representation of the original dataset (lossy compression). The matrix column interpolative decomposition (ID) can be implemented as a type of lossy compression for data matrices that factors the original data matrix into a product of two smaller factor matrices. One of these matrices consists of a subset of the columns of the original data matrix, while the other is a coefficient matrix which approximates the columns of the original data matrix as linear combinations of the selected columns. Motivating this work is the observation that the structure of ID algorithms makes them a natural fit for the asynchronous nature of task-based parallelism; they are able to operate independently on sub-domains of the system of interest and, as a result, provide varied levels of compression. Using the task-based Legion programming model, a single-pass ID algorithm (SPID) for CFD applications is implemented. Performance studies, scalability, and the accuracy of the compression algorithms are presented for an analytical Taylor-Green vortex problem, followed by a large-scale implementation of a compressible Taylor-Green vortex using a high-order Navier-Stokes solver. In both cases, compression factors exceeding 100 are achieved with relative errors at or below 10e-3. Moreover, strong and weak scaling results demonstrate that introducing SPID to solvers leads to negligible increases in runtime.