title: Sharpness-Aware Training for Free

abstract: Modern deep neural networks (DNNs) have achieved state-of-the-art performances but are typically over-parameterized. The over-parameterization may result in undesirably large generalization error in the absence of other customized training strategies. Recently, a line of research under the name of Sharpness-Aware Minimization (SAM) has shown that minimizing a sharpness measure, which reflects the geometry of the loss landscape, can significantly reduce the generalization error. However, SAM-like methods incur a two-fold computational overhead of the given base optimizer (e.g. SGD) for approximating the sharpness measure. In this paper, we propose Sharpness-Aware Training for Free, or SAF, which mitigates the sharp landscape at almost zero additional computational cost over the base optimizer. Intuitively, SAF achieves this by avoiding sudden drops in the loss in the sharp local minima throughout the trajectory of the updates of the weights. Specifically, we suggest a novel trajectory loss, based on the KL-divergence between the outputs of DNNs with the current weights and past weights, as a replacement of the SAM's sharpness measure. This loss captures the rate of change of the training loss along the model's update trajectory. By minimizing it, SAF ensures the convergence to a flat minimum with improved generalization capabilities. Extensive empirical results show that SAF minimizes the sharpness in the same way that SAM does, yielding better results on the ImageNet dataset with essentially the same computational cost as the base optimizer.


title: UAlberta at SemEval 2022 Task 2: Leveraging Glosses and Translations for Multilingual Idiomaticity Detection

abstract: We describe the University of Alberta systems for the SemEval-2022 Task 2 on multilingual idiomaticity detection. Working under the assumption that idiomatic expressions are noncompositional, our first method integrates information on the meanings of the individual words of an expression into a binary classifier. Further hypothesizing that literal and idiomatic expressions translate differently, our second method translates an expression in context, and uses a lexical knowledge base to determine if the translation is literal. Our approaches are grounded in linguistic phenomena, and leverage existing sources of lexical knowledge. Our results offer support for both approaches, particularly the former.


title: Vehicle mission guidance by symbolic optimal control

abstract: Symbolic optimal control is a powerful method to synthesize algorithmically correct-by-design state-feedback controllers for nonlinear plants. Its solutions are (near-)optimal with respect to a given cost function. In this note, it is demonstrated how symbolic optimal control can be used to calculate controllers for an optimized routing guidance of vehicle systems in continuous state space. In fact, the capacitated vehicle routing problem and a variant of travelling salesman problem are investigated. The latter problem has a relevant application in case of loss of vehicles during mission. A goods delivery scenario and a reconnaissance mission, involving bicycle and aircraft dynamics respectively, are provided as examples.


title: Patching Leaks in the Charformer for Efficient Character-Level Generation

abstract: Character-based representations have important advantages over subword-based ones for morphologically rich languages. They come with increased robustness to noisy input and do not need a separate tokenization step. However, they also have a crucial disadvantage: they notably increase the length of text sequences. The GBST method from Charformer groups (aka downsamples) characters to solve this, but allows information to leak when applied to a Transformer decoder. We solve this information leak issue, thereby enabling character grouping in the decoder. We show that Charformer downsampling has no apparent benefits in NMT over previous downsampling methods in terms of translation quality, however it can be trained roughly 30% faster. Promising performance on English--Turkish translation indicate the potential of character-level models for morphologically-rich languages.


title: OpenCalib: A Multi-sensor Calibration Toolbox for Autonomous Driving

abstract: Accurate sensor calibration is a prerequisite for multi-sensor perception and localization systems for autonomous vehicles. The intrinsic parameter calibration of the sensor is to obtain the mapping relationship inside the sensor, and the extrinsic parameter calibration is to transform two or more sensors into a unified spatial coordinate system. Most sensors need to be calibrated after installation to ensure the accuracy of sensor measurements. To this end, we present OpenCalib, a calibration toolbox that contains a rich set of various sensor calibration methods. OpenCalib covers manual calibration tools, automatic calibration tools, factory calibration tools, and online calibration tools for different application scenarios. At the same time, to evaluate the calibration accuracy and subsequently improve the accuracy of the calibration algorithm, we released a corresponding benchmark dataset. This paper introduces various features and calibration methods of this toolbox. To our knowledge, this is the first open-sourced calibration codebase containing the full set of autonomous-driving-related calibration approaches in this area. We wish that the toolbox could be helpful to autonomous driving researchers. We have open-sourced our code on GitHub to benefit the community. Code is available at https://github.com/PJLab-ADG/SensorsCalibration.


title: Optimal mechanical interactions direct multicellular network formation on elastic substrates

abstract: Cells self-organize into functional, ordered structures during tissue morphogenesis, a process that is evocative of colloidal self-assembly into engineered soft materials. Understanding how inter-cellular mechanical interactions may drive the formation of ordered and functional multicellular structures is important in developmental biology and tissue engineering. Here, by combining an agent-based model for contractile cells on elastic substrates with endothelial cell culture experiments, we show that substrate deformation-mediated mechanical interactions between cells can cluster and align them into branched networks. Motivated by the structure and function of vasculogenic networks, we predict how measures of network connectivity like percolation and fractal dimension, as well as local morphological features including junctions, branches, and rings depend on cell contractility and density, and on substrate elastic properties including stiffness and compressibility. We predict and confirm with experiments that cell network formation is substrate stiffness-dependent, being optimal at intermediate stiffness. Overall, we show that long-range, mechanical interactions provide an optimal and general strategy for multi-cellular self-organization, leading to more robust and efficient realization of space-spanning networks than through just local inter-cellular interactions.


title: Numerical Simulations and Replica Symmetry Breaking

abstract: Use of dedicated computers in spin glass simulations allows one to equilibrate very large samples (of size as large as $L=32$) and to carry out "computer experiments" that can be compared to (and analyzed in combination with) laboratory experiments on spin-glass samples. In the absence of a magnetic field, the most economic conclusion of the combined analysis of equilibrium and non-equilibrium simulations is that an RSB spin glass phase is present in three spatial dimensions. However, in the presence of a field, the lower critical dimension for the de Almeida-Thouless transition seems to be larger than three.


title: Surrogate modeling for Bayesian optimization beyond a single Gaussian process

abstract: Bayesian optimization (BO) has well-documented merits for optimizing black-box functions with an expensive evaluation cost. Such functions emerge in applications as diverse as hyperparameter tuning, drug discovery, and robotics. BO hinges on a Bayesian surrogate model to sequentially select query points so as to balance exploration with exploitation of the search space. Most existing works rely on a single Gaussian process (GP) based surrogate model, where the kernel function form is typically preselected using domain knowledge. To bypass such a design process, this paper leverages an ensemble (E) of GPs to adaptively select the surrogate model fit on-the-fly, yielding a GP mixture posterior with enhanced expressiveness for the sought function. Acquisition of the next evaluation input using this EGP-based function posterior is then enabled by Thompson sampling (TS) that requires no additional design parameters. To endow function sampling with scalability, random feature-based kernel approximation is leveraged per GP model. The novel EGP-TS readily accommodates parallel operation. To further establish convergence of the proposed EGP-TS to the global optimum, analysis is conducted based on the notion of Bayesian regret for both sequential and parallel settings. Tests on synthetic functions and real-world applications showcase the merits of the proposed method.


title: Measuring Equality and Hierarchical Mobility on Abstract Complex Networks

abstract: The centrality of a node within a network, however it is measured, is a vital proxy for the importance or influence of that node, and the differences in node centrality generate hierarchies and inequalities. If the network is evolving in time, the influence of each node changes in time as well, and the corresponding hierarchies are modified accordingly. However, there is still a lack of systematic study into the ways in which the centrality of a node evolves when a graph changes. In this paper we introduce a taxonomy of metrics of equality and hierarchical mobility in networks that evolve in time. We propose an indicator of equality based on the classical Gini Coefficient from economics, and we quantify the hierarchical mobility of nodes, that is, how and to what extent the centrality of a node and its neighbourhood change over time. These measures are applied to a corpus of thirty time evolving network data sets from different domains. We show that the proposed taxonomy measures can discriminate between networks from different fields. We also investigate correlations between different taxonomy measures, and demonstrate that some of them have consistently strong correlations (or anti-correlations) across the entire corpus. The mobility and equality measures developed here constitute a useful toolbox for investigating the nature of network evolution, and also for discriminating between different artificial models hypothesised to explain that evolution.


title: Capturing Graphs with Hypo-Elliptic Diffusions

abstract: Convolutional layers within graph neural networks operate by aggregating information about local neighbourhood structures; one common way to encode such substructures is through random walks. The distribution of these random walks evolves according to a diffusion equation defined using the graph Laplacian. We extend this approach by leveraging classic mathematical results about hypo-elliptic diffusions. This results in a novel tensor-valued graph operator, which we call the hypo-elliptic graph Laplacian. We provide theoretical guarantees and efficient low-rank approximation algorithms. In particular, this gives a structured approach to capture long-range dependencies on graphs that is robust to pooling. Besides the attractive theoretical properties, our experiments show that this method competes with graph transformers on datasets requiring long-range reasoning but scales only linearly in the number of edges as opposed to quadratically in nodes.


title: Symmetries of the asymptotically de Sitter spacetimes

abstract: We start a systematic investigation of possible isometries of the asymptotically de Sitter solutions to Einstein equations. We reformulate the Killing equation as conformal equations for the initial data at $\mathcal{I}^+$. This allows for partial classification of possible symmetry algebras. In particular, if they are not maximal, they may be at most $4$-dimensional. We provide several examples. As a simple collorary it is shown that the only spacetime in which the Killing horizon intersects $\mathcal{I}^+$ (after a conformal completion) is locally the de Sitter universe.


title: Failure Detection in Medical Image Classification: A Reality Check and Benchmarking Testbed

abstract: Failure detection in automated image classification is a critical safeguard for clinical deployment. Detected failure cases can be referred to human assessment, ensuring patient safety in computer-aided clinical decision making. Despite its paramount importance, there is insufficient evidence about the ability of state-of-the-art confidence scoring methods to detect test-time failures of classification models in the context of medical imaging. This paper provides a reality check, establishing the performance of in-domain misclassification detection methods, benchmarking 9 widely used confidence scores on 6 medical imaging datasets with different imaging modalities, in multiclass and binary classification settings. Our experiments show that the problem of failure detection is far from being solved. We found that none of the benchmarked advanced methods proposed in the computer vision and machine learning literature can consistently outperform a simple softmax baseline, demonstrating that improved out-of-distribution detection or model calibration do not necessarily translate to improved in-domain misclassification detection. Our developed testbed facilitates future work in this important area


title: Is the $(g-2)_\mu$ anomaly a threat to Lepton Flavor Conservation?

abstract: Although the $(g-2)_\mu$ anomaly can be explained by New Physics (NP) involving only muons, a more general flavor structure is usually expected for NP operators in the Standard Model (SM) Effective Field Theory (SMEFT). In particular, if one wants to provide a combined explanation of several beyond the SM effects, like Lepton Flavor Universality (LFU) Violation, as indicated by the B anomalies, then a strong alignment of the NP operators in flavor space is required to satisfy the bounds from observables featuring Lepton Flavor Violation (LFV), like $\mu \to e \gamma$. We derived the tight bound of $10^{-5}$ on the flavor angle in the dipole operator in the charged-lepton mass basis in the SMEFT. We found that misalignment in several operators at high-scale could spoil the alignment at low-scale, through the Renormalization Group Evolution (RGE) of the SMEFT. In particular, it imposes constraints on some 4-fermions operators. We explored dynamical mechanisms as well as flavor symmetries to explain this flavor alignment, and illustrated the difficulty to reach it in an explicit NP model. If the $(g-2)_\mu$ anomaly is confirmed, the only natural explanation seems to lie in the individual lepton number conservation. If this accidental symmetry of the SM is also present in higher-order terms in the SMEFT, we are led to conclude that quark and lepton sectors behave quite differently beyond the SM. This proceeding is based on arXiv:2111.13724.


title: Anisotropic Magnetic Turbulence in the Inner Heliosphere -- Radial Evolution of Distributions observed by Parker Solar Probe

abstract: Observations from Parker Solar Probe's first five orbits are used to investigate the helioradial evolution of probability density functions (PDFs) of fluctuations of magnetic field components, between \(\sim 28\) - 200 \(\rs\). Transformation of the magnetic field vector to a local mean-field coordinate system permits examination of anisotropy relative to the mean magnetic field direction. Attention is given to effects of averaging-interval size. It is found that PDFs of the perpendicular fluctuations are well approximated by a Gaussian function, with the parallel fluctuations less so: kurtoses of the latter are generally larger than 10, and their PDFs indicate increasing skewness with decreasing distance \(r\) from the Sun, with the latter observation possibly explained by the increasing Alfv\'enicity of the fluctuations. The ratio of perpendicular to parallel variances is greater than unity; this variance anisotropy becomes stronger with decreasing \(r\). The ratio of the total rms fluctuation strength to the mean field magnitude decreases with decreasing \(r\), with a value \(\sim 0.8\) near 1 AU and \(\sim 0.5\) at 0.14 AU; the ratio is well approximated by a \(r^{1/4}\) power law. These findings improve our understanding of the radial evolution of turbulence in the solar wind, and have implications for related phenomena such as energetic-particle transport in the inner heliosphere.


title: On Graphs, Groups and Geometry

abstract: A metric space (X,d) is declared to be natural if (X,d) determines an up to isomorphism unique group structure (X,+) on the set X such that all the group translations and group inversion are isometries. A group is called natural if it emerges like this from a natural metric. A simple graph X is declared to be natural if (X,d) with geodesic metric d is natural. We look here at some examples and some general statements like that the graphical regular representations of a finite group is always a natural graphs or that the direct product on groups or the Shannon product of finite graphs preserves the property of being natural. The semi-direct product of finite natural groups is natural too as they are represented by Zig-Zag products of suitable Cayley graphs. It follows that wreath products preserve natural groups. The Rubik cube for example is natural. Also free products of finitely generated natural groups are natural. A major theme is that non-natural groups often can be upgraded to become natural by extending them to become Coxeter groups. Examples of non-natural groups are cyclic groups whose order is divisible by 4, the quaternion group, the integers, the lamplighter group, the free groups or the group of p-adic integers. The prototype feature is to extend the integers and get the infinite dihedral group, replacing the single generator by two free reflections. We conclude with a short discussion of the hypothesis of using the dihedral group as a physical time in dynamical system theory.


title: Solving infinite-horizon POMDPs with memoryless stochastic policies in state-action space

abstract: Reward optimization in fully observable Markov decision processes is equivalent to a linear program over the polytope of state-action frequencies. Taking a similar perspective in the case of partially observable Markov decision processes with memoryless stochastic policies, the problem was recently formulated as the optimization of a linear objective subject to polynomial constraints. Based on this we present an approach for Reward Optimization in State-Action space (ROSA). We test this approach experimentally in maze navigation tasks. We find that ROSA is computationally efficient and can yield stability improvements over other existing methods.


title: BURG-Toolkit: Robot Grasping Experiments in Simulation and the Real World

abstract: This paper presents BURG-Toolkit, a set of open-source tools for Benchmarking and Understanding Robotic Grasping. Our tools allow researchers to: (1) create virtual scenes for generating training data and performing grasping in simulation; (2) recreate the scene by arranging the corresponding objects accurately in the physical world for real robot experiments, supporting an analysis of the sim-to-real gap; and (3) share the scenes with other researchers to foster comparability and reproducibility of experimental results. We explain how to use our tools by describing some potential use cases. We further provide proof-of-concept experimental results quantifying the sim-to-real gap for robot grasping in some example scenes. The tools are available at: https://mrudorfer.github.io/burg-toolkit/


title: GIT: A Generative Image-to-text Transformer for Vision and Language

abstract: In this paper, we design and train a Generative Image-to-text Transformer, GIT, to unify vision-language tasks such as image/video captioning and question answering. While generative models provide a consistent network architecture between pre-training and fine-tuning, existing work typically contains complex structures (uni/multi-modal encoder/decoder) and depends on external modules such as object detectors/taggers and optical character recognition (OCR). In GIT, we simplify the architecture as one image encoder and one text decoder under a single language modeling task. We also scale up the pre-training data and the model size to boost the model performance. Without bells and whistles, our GIT establishes new state of the arts on 12 challenging benchmarks with a large margin. For instance, our model surpasses the human performance for the first time on TextCaps (138.2 vs. 125.5 in CIDEr). Furthermore, we present a new scheme of generation-based image classification and scene text recognition, achieving decent performance on standard benchmarks. Codes are released at \url{https://github.com/microsoft/GenerativeImage2Text}.


title: Adaptive Massively Parallel Algorithms for Cut Problems

abstract: We study the Weighted Min Cut problem in the Adaptive Massively Parallel Computation (AMPC) model. In 2019, Behnezhad et al. [3] introduced the AMPC model as an extension of the Massively Parallel Computation (MPC) model. In the past decade, research on highly scalable algorithms has had significant impact on many massive systems. The MPC model, introduced in 2010 by Karloff et al. [16], which is an abstraction of famous practical frameworks such as MapReduce, Hadoop, Flume, and Spark, has been at the forefront of this research. While great strides have been taken to create highly efficient MPC algorithms for a range of problems, recent progress has been limited by the 1-vs-2 Cycle Conjecture [20], which postulates that the simple problem of distinguishing between one and two cycles requires $\Omega(\log n)$ MPC rounds. In the AMPC model, each machine has adaptive read access to a distributed hash table even when communication is restricted (i.e., in the middle of a round). While remaining practical [4], this gives algorithms the power to bypass limitations like the 1-vs-2 Cycle Conjecture. We give the first sublogarithmic AMPC algorithm, requiring $O(\log\log n)$ rounds, for $(2+\epsilon)$-approximate weighted Min Cut. Our algorithm is inspired by the divide and conquer approach of Ghaffari and Nowicki [11], which solves the $(2+\epsilon)$-approximate weighted Min Cut problem in $O(\log n\log\log n)$ rounds of MPC using the classic result of Karger and Stein [15]. Our work is fully-scalable in the sense that the local memory of each machine is $O(n^\epsilon)$ for any constant $0 < \epsilon < 1$. There are no $o(\log n)$-round MPC algorithms for Min Cut in this memory regime assuming the 1-vs-2 Cycle Conjecture holds. The exponential speedup in AMPC is the result of decoupling the different layers of the divide and conquer algorithm and solving all layers in $O(1)$ rounds.


title: Group-level Brain Decoding with Deep Learning

abstract: Decoding brain imaging data are gaining popularity, with applications in brain-computer interfaces and the study of neural representations. Decoding is typicallysubject-specific and does not generalise well over subjects, due to high amounts ofbetween subject variability. Techniques that overcome this will not only providericher neuroscientific insights but also make it possible for group-level models to out-perform subject-specific models. Here, we propose a method that uses subjectembedding, analogous to word embedding in natural language processing, to learnand exploit the structure in between-subject variability as part of a decoding model,our adaptation of the WaveNet architecture for classification. We apply this to mag-netoencephalography data, where 15 subjects viewed 118 different images, with30 examples per image; to classify images using the entire 1 s window followingimage presentation. We show that the combination of deep learning and subjectembedding is crucial to closing the performance gap between subject- and group-level decoding models. Importantly, group models outperform subject models onlow-accuracy subjects (although slightly impair high-accuracy subjects) and can behelpful for initialising subject models. While we have not generally found group-levelmodels to perform better than subject-level models, the performance of groupmodelling is expected to be even higher with bigger datasets. In order to providephysiological interpretation at the group level, we make use of permutation featureimportance. This provides insights into the spatiotemporal and spectral informationencoded in the models. All code is available on GitHub (https://github.com/ricsinaruto/MEG-group-decode).


title: Star formation characteristics of CNN-identified post-mergers in the Ultraviolet Near Infrared Optical Northern Survey (UNIONS)

abstract: The importance of the post-merger epoch in galaxy evolution has been well-documented, but post-mergers are notoriously difficult to identify. While the features induced by mergers can sometimes be distinctive, they are frequently missed by visual inspection. In addition, visual classification efforts are highly inefficient because of the inherent rarity of post-mergers (~1% in the low-redshift Universe), and non-parametric statistical merger selection methods do not account for the diversity of post-mergers or the environments in which they appear. To address these issues, we deploy a convolutional neural network (CNN) which has been trained and evaluated on realistic mock observations of simulated galaxies from the IllustrisTNG simulations, to galaxy images from the Canada France Imaging Survey (CFIS), which is part of the Ultraviolet Near Infrared Optical Northern Survey (UNIONS). We present the characteristics of the galaxies with the highest CNN-predicted post-merger certainties, as well as a visually confirmed subset of 699 post-mergers. We find that post-mergers with high CNN merger probabilities (p(x)>0.8) have an average star formation rate that is 0.1 dex higher than a mass- and redshift-matched control sample. The SFR enhancement is even greater in the visually confirmed post-merger sample, a factor of two higher than the control sample.


title: Efficient Forecasting of Large Scale Hierarchical Time Series via Multilevel Clustering

abstract: We propose a novel approach to the problem of clustering hierarchically aggregated time-series data, which has remained an understudied problem though it has several commercial applications. We first group time series at each aggregated level, while simultaneously leveraging local and global information. The proposed method can cluster hierarchical time series (HTS) with different lengths and structures. For common two-level hierarchies, we employ a combined objective for local and global clustering over spaces of discrete probability measures, using Wasserstein distance coupled with Soft-DTW divergence. For multi-level hierarchies, we present a bottom-up procedure that progressively leverages lower-level information for higher-level clustering. Our final goal is to improve both the accuracy and speed of forecasts for a larger number of HTS needed for a real-world application. To attain this goal, each time series is first assigned the forecast for its cluster representative, which can be considered as a "shrinkage prior" for the set of time series it represents. Then this base forecast can be quickly fine-tuned to adjust to the specifics of that time series. We empirically show that our method substantially improves performance in terms of both speed and accuracy for large-scale forecasting tasks involving much HTS.


title: Learning to Solve Combinatorial Graph Partitioning Problems via Efficient Exploration

abstract: From logistics to the natural sciences, combinatorial optimisation on graphs underpins numerous real-world applications. Reinforcement learning (RL) has shown particular promise in this setting as it can adapt to specific problem structures and does not require pre-solved instances for these, often NP-hard, problems. However, state-of-the-art (SOTA) approaches typically suffer from severe scalability issues, primarily due to their reliance on expensive graph neural networks (GNNs) at each decision step. We introduce ECORD; a novel RL algorithm that alleviates this expense by restricting the GNN to a single pre-processing step, before entering a fast-acting exploratory phase directed by a recurrent unit. Experimentally, ECORD achieves a new SOTA for RL algorithms on the Maximum Cut problem, whilst also providing orders of magnitude improvement in speed and scalability. Compared to the nearest competitor, ECORD reduces the optimality gap by up to 73% on 500 vertex graphs with a decreased wall-clock time. Moreover, ECORD retains strong performance when generalising to larger graphs with up to 10000 vertices.


title: Service Composition in Opportunistic Networks: A Load and Mobility Aware Solution

abstract: Pervasive networks formed by users' mobile devices have the potential to exploit a rich set of distributed service components that can be composed to provide each user with a multitude of application level services. However, in many challenging scenarios, opportunistic networking techniques are required to enable communication as devices suffer from intermittent connectivity, disconnections and partitions. This poses novel challenges to service composition techniques. While several works have discussed middleware and architectures for service composition in well-connected wired networks and in stable MANET environments, the underlying mechanism for selecting and forwarding service requests in the significantly challenging networking environment of opportunistic networks has not been entirely addressed. The problem comprises three stages: i) selecting an appropriate service sequence set out of available services to obtain the required application level service; ii) routing results of a previous stage in the composition to the next one through a multi-hop opportunistic path; and iii) routing final service outcomes back to the requester. The proposed algorithm derives efficiency and effectiveness by taking into account the estimated load at service providers and expected time to opportunistically route information between devices. Based on this information the algorithm estimates the best composition to obtain a required service. It is shown that using only local knowledge collected in a distributed manner, performance close to a real-time centralized system can be achieved. Applicability and performance guarantee of the service composition algorithm in a range of mobility characteristics are established through extensive simulations on real/synthetic traces.


title: Spartan: Differentiable Sparsity via Regularized Transportation

abstract: We present Spartan, a method for training sparse neural network models with a predetermined level of sparsity. Spartan is based on a combination of two techniques: (1) soft top-k masking of low-magnitude parameters via a regularized optimal transportation problem and (2) dual averaging-based parameter updates with hard sparsification in the forward pass. This scheme realizes an exploration-exploitation tradeoff: early in training, the learner is able to explore various sparsity patterns, and as the soft top-k approximation is gradually sharpened over the course of training, the balance shifts towards parameter optimization with respect to a fixed sparsity mask. Spartan is sufficiently flexible to accommodate a variety of sparsity allocation policies, including both unstructured and block structured sparsity, as well as general cost-sensitive sparsity allocation mediated by linear models of per-parameter costs. On ImageNet-1K classification, Spartan yields 95% sparse ResNet-50 models and 90% block sparse ViT-B/16 models while incurring absolute top-1 accuracy losses of less than 1% compared to fully dense training.


title: Scalable Interpretability via Polynomials

abstract: Generalized Additive Models (GAMs) have quickly become the leading choice for inherently-interpretable machine learning. However, unlike uninterpretable methods such as DNNs, they lack expressive power and easy scalability, and are hence not a feasible alternative for real-world tasks. We present a new class of GAMs that use tensor rank decompositions of polynomials to learn powerful, {\em inherently-interpretable} models. Our approach, titled Scalable Polynomial Additive Models (SPAM) is effortlessly scalable and models {\em all} higher-order feature interactions without a combinatorial parameter explosion. SPAM outperforms all current interpretable approaches, and matches DNN/XGBoost performance on a series of real-world benchmarks with up to hundreds of thousands of features. We demonstrate by human subject evaluations that SPAMs are demonstrably more interpretable in practice, and are hence an effortless replacement for DNNs for creating interpretable and high-performance systems suitable for large-scale machine learning. Source code is available at https://github.com/facebookresearch/nbm-spam.


abstract: Graph Neural Networks (GNNs) have been widely used to learn node representations and with outstanding performance on various tasks such as node classification. However, noise, which inevitably exists in real-world graph data, would considerably degrade the performance of GNNs as the noise is easily propagated via the graph structure. In this work, we propose a novel and robust method, Bayesian Robust Graph Contrastive Learning (BRGCL), which trains a GNN encoder to learn robust node representations. The BRGCL encoder is a completely unsupervised encoder. Two steps are iteratively executed at each epoch of training the BRGCL encoder: (1) estimating confident nodes and computing robust cluster prototypes of node representations through a novel Bayesian nonparametric method; (2) prototypical contrastive learning between the node representations and the robust cluster prototypes. Experiments on public and large-scale benchmarks demonstrate the superior performance of BRGCL and the robustness of the learned node representations. The code of BRGCL is available at \url{https://github.com/BRGCL-code/BRGCL-code}.


title: Service Provisioning in Mobile Environments through Opportunistic Computing

abstract: Opportunistic computing is a paradigm for completely self-organised pervasive networks. Instead of relying only on fixed infrastructures as the cloud, users' devices act as service providers for each other. They use pairwise contacts to collect information about services provided and amount of time to provide them by the encountered nodes. At each node, upon generation of a service request, this information is used to choose the most efficient service, or composition of services, that satisfy that request, based on local knowledge. Opportunistic computing can be exploited in several scenarios, including mobile social networks, IoT and Internet 4.0. In this paper we propose an opportunistic computing algorithm based on an analytical model, which ranks the available (composition of) services, based on their expected completion time. Through the model, a service requesters picks the one that is expected to be the best. Experiments show that the algorithm is accurate in ranking services, thus providing an effective service-selection policy. Such a policy achieves significantly lower service provisioning times compared to other reference policies. Its performance is tested in a wide range of scenarios varying the nodes mobility, the size of input/output parameters, the level of resource congestion, the computational complexity of service executions.


title: Optimal polynomial meshes exist on any multivariate convex domain

abstract: We show that optimal polynomial meshes exist for every convex body in $\mathbb{R}^d$, confirming a conjecture by A. Kroo.


title: Improving Road Segmentation in Challenging Domains Using Similar Place Priors

abstract: Road segmentation in challenging domains, such as night, snow or rain, is a difficult task. Most current approaches boost performance using fine-tuning, domain adaptation, style transfer, or by referencing previously acquired imagery. These approaches share one or more of three significant limitations: a reliance on large amounts of annotated training data that can be costly to obtain, both anticipation of and training data from the type of environmental conditions expected at inference time, and/or imagery captured from a previous visit to the location. In this research, we remove these restrictions by improving road segmentation based on similar places. We use Visual Place Recognition (VPR) to find similar but geographically distinct places, and fuse segmentations for query images and these similar place priors using a Bayesian approach and novel segmentation quality metric. Ablation studies show the need to re-evaluate notions of VPR utility for this task. We demonstrate the system achieving state-of-the-art road segmentation performance across multiple challenging condition scenarios including night time and snow, without requiring any prior training or previous access to the same geographical locations. Furthermore, we show that this method is network agnostic, improves multiple baseline techniques and is competitive against methods specialised for road prediction.


title: Monte-Carlo Simulations of Superconducting Tunnel Junction Quantum Sensors for the BeEST Experiment

abstract: Superconducting Tunnel Junctions (STJs) are used as high-resolution quantum sensors to search for evidence of sterile neutrinos in the electron capture decay of $^7$Be. We are developing spatially-resolved Monte-Carlo simulations of the energy relaxation in superconductors to understand electron escape after the $^7$Be decay and distinguish details in the STJ response function from a possible sterile neutrino signal. Simulations of the charge generation and the Fano factor for different materials agree with the literature values. Initial simulations of the escape tail are consistent with observations, and contain fine structure in the line shape. The line shape will be refined as better experimental data become available.

categories: physics.comp-ph cond-mat.supr-con nucl-ex physics.ins-det


title: A unified approach of obstructions to small-time local controllability for scalar-input systems

abstract: We present a unified approach for determining and proving obstructions to small-time local controllability of scalar-input control systems. Our approach views obstructions to controllability as resulting from interpolation inequalities between the functionals associated with the formal Lie brackets of the system. Using this approach, we give compact unified proofs of all known necessary conditions, we prove a conjecture of 1986 due to Kawski, and we derive entirely new obstructions. Our work doubles the number of previously-known necessary conditions, all established in the 1980s. In particular, for the third quadratic bracket, we derive a new necessary condition which is complementary to the Agrachev-Gamkrelidze sufficient ones. We rely on a recent Magnus-type representation formula for the state, a new Hall basis of the free Lie algebra over two generators, an appropriate use of Sussmann's infinite product to compute the Magnus expansion, and Gagliardo-Nirenberg interpolation inequalities.


title: On series and integral representations of some NRQCD master integrals

abstract: We consider new ways of obtaining series and integral representations for master integrals arising in the process of matching of QCD to NRQCD. The latter results are exact in space-time dimension $d$. In addition, we discuss series expansion of the obtained results at fixed values of $d$.


title: Don't Explain Noise: Robust Counterfactuals for Randomized Ensembles

abstract: Counterfactual explanations describe how to modify a feature vector in order to flip the outcome of a trained classifier. Obtaining robust counterfactual explanations is essential to provide valid algorithmic recourse and meaningful explanations. We study the robustness of explanations of randomized ensembles, which are always subject to algorithmic uncertainty even when the training data is fixed. We formalize the generation of robust counterfactual explanations as a probabilistic problem and show the link between the robustness of ensemble models and the robustness of base learners. We develop a practical method with good empirical performance and support it with theoretical guarantees for ensembles of convex base learners. Our results show that existing methods give surprisingly low robustness: the validity of naive counterfactuals is below $50\%$ on most data sets and can fall to $20\%$ on problems with many features. In contrast, our method achieves high robustness with only a small increase in the distance from counterfactual explanations to their initial observations.


title: Wind--Pellet Shear Sailing

abstract: A propulsion concept in which a spacecraft interacts with high-velocity pellets and the interstellar medium is proposed. The pellets are slower than the spacecraft and are accelerated backwards as they are overtaken, imparting a forward acceleration on the spacecraft. This maneuver is possible due to the interaction with a fixed medium (interstellar medium, ISM); as the spacecraft travels through the medium, it is able to extract power from the relative wind. This concept relies upon the relative velocities (shear) between the pellet stream and the fixed medium in order to concentrate the energy of the pellets into the spacecraft and is thus termed wind-pellet shear sailing. The equations governing the mass ratio of pellets to the spacecraft and its dependence on the final spacecraft velocity are derived; the critical role of the efficiency of the power extraction and transfer process is identified. Natural sources of energy are considered as a means to accelerate the pellets to velocities of 1000 to 6000 km/s. Techniques for onboard generation of power via electromagnetic interaction with the ISM are reviewed, with a repetitively stroked plasma magnet being identified as a promising approach. The necessity of the spacecraft to detect and track the pellets as they are overtaken dictates the desired properties of the pellets. Pellet pushers (accelerators) on board the spacecraft are also preliminarily explored in their engineering considerations, with electric field accelerators of charged nanometric particles, Lorentz-force accelerated ionized pellets, or expansion of vaporized pellets via a nozzle being highlighted as potential approaches. A preliminary mission profile is defined in which a 500-kg scientific payload is delivered to orbit about alpha-Centauri within 30 years, using wind-pellet shear sailing as the intermediate stage to bring the spacecraft from 2% to 5.5% of c.


title: Efficient textual explanations for complex road and traffic scenarios based on semantic segmentation

abstract: The complex driving environment brings great challenges to the visual perception of autonomous vehicles. It's essential to extract clear and explainable information from the complex road and traffic scenarios and offer clues to decision and control. However, the previous scene explanation had been implemented as a separate model. The black box model makes it difficult to interpret the driving environment. It cannot detect comprehensive textual information and requires a high computational load and time consumption. Thus, this study proposed a comprehensive and efficient textual explanation model. From 336k video frames of the driving environment, critical images of complex road and traffic scenarios were selected into a dataset. Through transfer learning, this study established an accurate and efficient segmentation model to obtain the critical traffic elements in the environment. Based on the XGBoost algorithm, a comprehensive model was developed. The model provided textual information about states of traffic elements, the motion of conflict objects, and scenario complexity. The approach was verified on the real-world road. It improved the perception accuracy of critical traffic elements to 78.8%. The time consumption reached 13 minutes for each epoch, which was 11.5 times more efficient than the pre-trained network. The textual information analyzed from the model was also accordant with reality. The findings offer clear and explainable information about the complex driving environment, which lays a foundation for subsequent decision and control. It can improve the visual perception ability and enrich the prior knowledge and judgments of complex traffic situations.


title: The generation of narrow ultrarelativistic beams of positrons (electrons) in the process of resonant photogeneration of pairs on nuclei in a strong electromagnetic field

abstract: The generation of narrow beams of high-energy positrons (electrons) in the process of resonant photogeneration of ultrarelativistic electron-positron pairs by high-energy gamma quanta in the field of the nucleus and a strong electromagnetic wave is theoretically predicted. It is shown that if the energy of the initial gamma quanta significantly exceeds the characteristic energy of the process, then ultrarelativistic positrons (for channel A) or electrons (for channel B) are emitted with energies very close to the energy of gamma quanta. Moreover, the resonant differential cross-section of such processes can exceed the corresponding differential cross-section without an external field by thirteen orders of magnitude. This effect makes it possible to obtain narrow beams of ultrarelativistic positrons (electrons) in strong electromagnetic fields with high probability.


title: Neural Basis Models for Interpretability

abstract: Due to the widespread use of complex machine learning models in real-world applications, it is becoming critical to explain model predictions. However, these models are typically black-box deep neural networks, explained post-hoc via methods with known faithfulness limitations. Generalized Additive Models (GAMs) are an inherently interpretable class of models that address this limitation by learning a non-linear shape function for each feature separately, followed by a linear model on top. However, these models are typically difficult to train, require numerous parameters, and are difficult to scale. We propose an entirely new subfamily of GAMs that utilizes basis decomposition of shape functions. A small number of basis functions are shared among all features, and are learned jointly for a given task, thus making our model scale much better to large-scale data with high-dimensional features, especially when features are sparse. We propose an architecture denoted as the Neural Basis Model (NBM) which uses a single neural network to learn these bases. On a variety of tabular and image datasets, we demonstrate that for interpretable machine learning, NBMs are the state-of-the-art in accuracy, model size, and, throughput and can easily model all higher-order feature interactions. Source code is available at https://github.com/facebookresearch/nbm-spam.


title: AI-aided multiscale modeling of physiologically-significant blood clots

abstract: We have developed an AI-aided multiple time stepping (AI-MTS) algorithm and multiscale modeling framework (AI-MSM) and implemented them on the Summit-like supercomputer, AIMOS. AI-MSM is the first of its kind to integrate multi-physics, including intra-platelet, inter-platelet, and fluid-platelet interactions, into one system. It has simulated a record-setting multiscale blood clotting model of 102 million particles, of which 70 flowing and 180 aggregating platelets, under dissipative particle dynamics to coarse-grained molecular dynamics. By adaptively adjusting timestep sizes to match the characteristic time scales of the underlying dynamics, AI-MTS optimally balances speeds and accuracies of the simulations.


title: Writes Hurt: Lessons in Cache Design for Optane NVRAM

abstract: Intel OptaneTM DC Persistent Memory resides on the memory bus and approaches DRAM in access latency. One avenue for its adoption is to employ it in place of persistent storage; another is to use it as a cheaper and denser extension of DRAM. In pursuit of the latter goal, we present the design of a volatile Optane NVRAM cache as a component in a storage engine underlying MongoDB. The primary innovation in our design is a new cache admission policy. We discover that on Optane NVRAM, known for its limited write throughput, the presence of writes disproportionately affects the throughput of reads, much more so than on DRAM. Therefore, an admission policy that indiscriminately admits new data (and thus generates writes), severely limits the rate of data retrieval and results in exceedingly poor performance for the cache overall. We design an admission policy that balances the rate of admission with the rate of lookups using dynamically observed characteristics of the workload. Our implementation outperforms OpenCAS (an off-the-shelf Optane-based block cache) in all cases, and Intel Memory Mode in cases where the database size exceeds the available NVRAM. Our cache is decoupled from the rest of the storage engine and uses generic metrics to guide its admission policy; therefore our design can be easily adopted in other systems.


title: Dark Matter Pollution in the Diffuse Supernova Neutrino Background

abstract: The Hyper-Kamiokande (HyperK) experiment is expected to precisely measure the Diffuse Supernova Neutrino Background (DSNB). This requires that the backgrounds in the relevant energy range are well understood. One possible background that has not been considered thus far is the annihilation of low-mass dark matter (DM) to neutrinos. We conduct simulations of the DSNB signal and backgrounds in HyperK, and quantify the extent to which DM annihilation products can pollute the DSNB signal. We find that the presence of DM could affect the determination of the correct values of parameters of interest for DSNB physics, such as effective neutrino temperatures and star formation rates. While this opens the possibility of simultaneously characterising the DNSB and discovering dark matter via indirect detection, we argue that it would be hard to disentangle the two contributions due to the lack of angular information available at low energies.


title: The C(2)$^1\Pi_u$ state in Rb$_2$. Observation and deperturbation

abstract: We report a systematic study of the C(2)$^1\Pi_u$ electronic state in rubidium dimer, observed in polarization labelling spectroscopy experiment through the C $\leftarrow$ X$^{1}\Sigma^{+}_{g}$ transitions recorded under rotational resolution in two isotopologues $^{85}$Rb$_2$ and $^{85}$Rb$^{87}$Rb. Regularity of the vibrational progressions was distorted by numerous interactions with the surrounding 2$^1\Sigma^{+}_{\mathrm{u}}$, 2$^3\Pi_{\mathrm{u}}$ and 3$^3\Sigma^{+}_{\mathrm{u}}$ states. Deperturbation was performed by coupled-channels analysis taking into account spin-orbit and rotational interactions. Potential energy curves and parameters describing the off-diagonal matrix elements were determined as functions of internuclear distance. About 3000 line frequencies from the present study are reproduced with a standard deviation of 0.07 cm$^{-1}$, in agreement with the experimental accuracy. Along with this, the model is consistent with all high resolution experimental data on the involved electronic states, available in the literature.


title: Cycle Mutation: Evolving Permutations via Cycle Induction

abstract: Evolutionary algorithms solve problems by simulating the evolution of a population of candidate solutions. We focus on evolving permutations for ordering problems like the traveling salesperson problem (TSP), as well as assignment problems like the quadratic assignment problem (QAP) and largest common subgraph (LCS). We propose cycle mutation, a new mutation operator whose inspiration is the well known cycle crossover operator, and the concept of a permutation cycle. We use fitness landscape analysis to explore the problem characteristics for which cycle mutation works best. As a prerequisite, we develop new permutation distance measures: cycle distance, $k$-cycle distance, and cycle edit distance. The fitness landscape analysis predicts that cycle mutation is better suited for assignment and mapping problems than it is for ordering problems. We experimentally validate these findings showing cycle mutation's strengths on problems like QAP and LCS, and its limitations on problems like the TSP, while also showing that it is less prone to local optima than commonly used alternatives. We integrate cycle mutation into the open-source Chips-n-Salsa library, and the new distance metrics into the open-source JavaPermutationTools library.


title: New DA white dwarf models for asteroseismology of ZZ Ceti stars

abstract: Asteroseismology is a powerful tool to infer the evolutionary status and chemical stratification of white dwarf (WD) stars, and to explore the physical processes that lead to their formation. This is particularly true for the variable H-rich atmosphere (DA) WDs, known as DAV or ZZ Ceti stars. We present a new grid of DA WD models that take into account the last advances in the modeling and input physics of both the progenitor and the WD stars, thus avoiding and improving several shortcomings present in the set of DA WD models employed in the asteroseismological analyses of ZZ Ceti stars we carried out in our previous works. These new models are derived from a self-consistent way with the changes in the internal chemical distribution that result from the mixing of all the core chemical components induced by mean molecular-weight inversions, from $^{22}$Ne diffusion, Coulomb sedimentation, and from residual nuclearburning. In addition, the expected nuclear-burning history and mixing events along the progenitor evolution are accounted for, in particular the occurrence of third dredge-up, which determines the properties of the core and envelope of post-AGB and white dwarf stars, as well as the WD initial-final mass relation. The range of H envelopes of our new ZZ star models extends from log(M_H/M_*)= -4 to -5, to log(M_H/M_*)= -13.5. This allows, for the first time, to consider seismological solutions for ZZ Ceti stars with extremely thin H envelopes. Our new H-burning post-AGB models predict chemical profiles of O and C near the stellar centre of ZZ Ceti stars substantially different from those we used in our previous works. We find that the pulsation periods of $g$ modes and the mode-trapping properties of the new models differ significantly from those characterizing the ZZ Ceti models of our previous works, particularly for long periods.


title: A family of immersed finite element spaces and applications to three dimensional $\mathbf{H}(\text{curl})$ interface problems

abstract: Maxwell interface problems are of great importance in many electromagnetic applications. Unfitted mesh methods are especially attractive in 3D computation as they can circumvent generating complex 3D interface-fitted meshes. However, many unfitted mesh methods rely on non-conforming approximation spaces, which may cause a loss of accuracy for solving Maxwell equations, and the widely-used penalty techniques in the literature may not help in recovering the optimal convergence. In this article, we provide a remedy by developing N\'ed\'elec-type immersed finite element spaces with a Petrov-Galerkin scheme that is able to produce optimal-convergent solutions. To establish a systematic framework, we analyze all the $H^1$, $\mathbf{H}(\text{curl})$ and $\mathbf{H}(\text{div})$ IFE spaces and form a discrete de Rham complex. Based on these fundamental results, we further develop a fast solver using a modified Hiptmair-Xu preconditioner which works for both the GMRES and CG methods.


title: Meta-Learning Adversarial Bandits

abstract: We study online learning with bandit feedback across multiple tasks, with the goal of improving average performance across tasks if they are similar according to some natural task-similarity measure. As the first to target the adversarial setting, we design a unified meta-algorithm that yields setting-specific guarantees for two important cases: multi-armed bandits (MAB) and bandit linear optimization (BLO). For MAB, the meta-algorithm tunes the initialization, step-size, and entropy parameter of the Tsallis-entropy generalization of the well-known Exp3 method, with the task-averaged regret provably improving if the entropy of the distribution over estimated optima-in-hindsight is small. For BLO, we learn the initialization, step-size, and boundary-offset of online mirror descent (OMD) with self-concordant barrier regularizers, showing that task-averaged regret varies directly with a measure induced by these functions on the interior of the action space. Our adaptive guarantees rely on proving that unregularized follow-the-leader combined with multiplicative weights is enough to online learn a non-smooth and non-convex sequence of affine functions of Bregman divergences that upper-bound the regret of OMD.


title: Radiative Properties of an Artificial Atom coupled to a Josephson Junction Array

abstract: We study the radiative properties -- the Lamb shift, Purcell decay rate and the spontaneous emission dynamics -- of an artificial atom coupled to a long, multimode cavity formed by an array of Josephson junctions. Introducing a tunable coupling element between the atom and the array, we demonstrate that such a system can exhibit a crossover from a perturbative to non-perturbative regime of light-matter interaction as one strengthens the coupling between the atom and the Josephson junction array (JJA). As a consequence, the concept of spontaneous emission as the occupation of the local atomic site being governed by a single complex-valued exponent breaks down. This breakdown, we show, can be interpreted in terms of formation of hybrid atom-resonator modes with radiative losses that are non-trivially related to the effective coupling between individual modes. We develop a singular function expansion approach for the description of the open quantum system dynamics in such a multimode non-perturbative regime. This modal framework generalizes the normal mode description of quantum fields in a finite volume, incorporating exact radiative losses and incident quantum noise at the delimiting surface. Our results are pertinent to recent experiments with Josephson atoms coupled to high impedance Josephson junction arrays.


title: Ultimate stability of active optical frequency standards

abstract: Active optical frequency standards provide interesting alternatives to their passive counterparts. Particularly, such a clock alone continuously generates highly-stable narrow-line laser radiation. Thus a local oscillator is not required to keep the optical phase during a dead time between interrogations as in passive clocks, but only to boost the active clock's low output power to practically usable levels with the current state of technology. Here we investigate the spectral properties and the stability of active clocks, including homogeneous and inhomogeneous broadening effects. We find that for short averaging times the stability is limited by photon shot noise from the limited emitted laser power and at long averaging times by phase diffusion of the laser output. Operational parameters for best long-term stability were identified. Using realistic numbers for an active clock with $^{87}$Sr we find that an optimized stability of $\sigma_y(\tau) \approx 4\times10^{-18}/\sqrt{\tau [\mathrm{s}]}$ is achievable.


title: Rapoport-Zink uniformization for the moduli space of polarized K3 surfaces

abstract: We compute the image of the $p$-adic period map for polarized K3 surfaces with supersingular reduction. This gives rise to a Rapoport-Zink type uniformization of their moduli space by an explicit open rigid analytic subvariety of a local Shimura variety of orthogonal type. In contrast to the case of Rapoport-Zink uniformization of Shimura varieties and in analogy to the complex case, the uniformizing domain does not carry an action of a $p$-adic Lie group, but only of a discrete subgroup. We briefly sketch how the same arguments can be applied to obtain a uniformization for the moduli space of smooth cubic fourfolds with supersingular reduction.


title: The gap between a variational problem and its occupation measure relaxation

abstract: Recent works have proposed linear programming relaxations of variational optimization problems subject to nonlinear PDE constraints based on the occupation measure formalism. The main appeal of these methods is the fact that they rely on convex optimization, typically semidefinite programming. In this work we close an open question related to this approach. We prove that the classical and relaxed minima coincide when the dimension of the codomain of the unknown function equals one, both for calculus of variations and for optimal control problems, thereby complementing analogous results that existed for the case when the dimension of the domain equals one. In order to do so, we prove a generalization of the Hardt-Pitts decomposition of normal currents applicable in our setting. We also show by means of a counterexample that, if both the dimensions of the domain and of the codomain are greater than one, there may be a positive gap. The example we construct to show the latter serves also to show that sometimes relaxed occupation measures may represent a more conceptually-satisfactory "solution" than their classical counterparts, so that -- even though they may not be equivalent -- algorithms rendering accessible the minimum in the larger space of relaxed occupation measures remain extremely valuable. Finally, we show that in the presence of integral constraints, a positive gap may occur at any dimension of the domain and of the codomain.


title: The Derived Pure Spinor Formalism as an Equivalence of Categories

abstract: We construct a derived generalization of the pure spinor superfield formalism and prove that it exhibits an equivalence of dg-categories between multiplets for a supertranslation algebra and equivariant modules over its Chevalley-Eilenberg cochains. This equivalence is closely linked to Koszul duality for the supertranslation algebra. After introducing and describing the category of supermultiplets, we define the derived pure spinor construction explicitly as a dg-functor. We then show that the functor that takes the derived supertranslation invariants of any supermultiplet is a quasi-inverse to the pure spinor construction, using an explicit calculation. Finally, we illustrate our findings with examples and use insights from the derived formalism to answer some questions regarding the ordinary (underived) pure spinor superfield formalism.


title: Searching for dark energy with the Sun

abstract: General extensions of General Relativity (GR) based on bona fide degrees of freedom predict a fifth force which operates within massive objects, opening up an exciting opportunity to perform precision tests of gravity at stellar scales. Here, focusing on general scalar-tensor theories for dark energy, we utilize the Sun as our laboratory and search for imprints of the fifth-force effect on the solar equilibrium structure. With analytic results and numerical simulations, we explain how the different solar regions offer powerful ways to test gravity. Accounting for the delicate interplay between fifth force and solar microphysics such as opacity, diffusion, equation of state and metallicity, we demonstrate that the fifth force still leaves a sharp signature on the solar sound speed, in a region where simple estimates of input physics uncertainties become negligible. For general scalar-field extensions of GR, known as (U-)DHOST, based solely on the observational helioseismic errors, our analysis at the equilibrium level allows to place an approximate constraint on the fifth-force coupling strength of $-10^{-3} \lesssim \mathcal{Y} \lesssim 5\cdot 10^{-4}$ at $2\sigma$. This result improves previous stellar constraints by $\sim 3$ orders of magnitude, and should be confirmed and improved by future helioseismic inversions in modified gravity combined with an elaborate accounting of theoretical uncertainties. Our analysis can be applied to a wide set of theories beyond GR, and also paves the way for helioseismic analyses in this context. In this regard, we discuss how the solar radiative and convective zone can be employed as promising laboratories to test generic theories of gravity.


title: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

abstract: Transformers are slow and memory-hungry on long sequences, since the time and memory complexity of self-attention are quadratic in sequence length. Approximate attention methods have attempted to address this problem by trading off model quality to reduce the compute complexity, but often do not achieve wall-clock speedup. We argue that a missing principle is making attention algorithms IO-aware -- accounting for reads and writes between levels of GPU memory. We propose FlashAttention, an IO-aware exact attention algorithm that uses tiling to reduce the number of memory reads/writes between GPU high bandwidth memory (HBM) and GPU on-chip SRAM. We analyze the IO complexity of FlashAttention, showing that it requires fewer HBM accesses than standard attention, and is optimal for a range of SRAM sizes. We also extend FlashAttention to block-sparse attention, yielding an approximate attention algorithm that is faster than any existing approximate attention method. FlashAttention trains Transformers faster than existing baselines: 15% end-to-end wall-clock speedup on BERT-large (seq. length 512) compared to the MLPerf 1.1 training speed record, 3$\times$ speedup on GPT-2 (seq. length 1K), and 2.4$\times$ speedup on long-range arena (seq. length 1K-4K). FlashAttention and block-sparse FlashAttention enable longer context in Transformers, yielding higher quality models (0.7 better perplexity on GPT-2 and 6.4 points of lift on long-document classification) and entirely new capabilities: the first Transformers to achieve better-than-chance performance on the Path-X challenge (seq. length 16K, 61.4% accuracy) and Path-256 (seq. length 64K, 63.1% accuracy).


title: PSL is Dead. Long Live PSL

abstract: Property Specification Language (PSL) is a form of temporal logic that has been mainly used in discrete domains (e.g. formal hardware verification). In this paper, we show that by merging machine learning techniques with PSL monitors, we can extend PSL to work on continuous domains. We apply this technique in machine learning-based anomaly detection to analyze scenarios of real-time streaming events from continuous variables in order to detect abnormal behaviors of a system. By using machine learning with formal models, we leverage the strengths of both machine learning methods and formal semantics of time. On one hand, machine learning techniques can produce distributions on continuous variables, where abnormalities can be captured as deviations from the distributions. On the other hand, formal methods can characterize discrete temporal behaviors and relations that cannot be easily learned by machine learning techniques. Interestingly, the anomalies detected by machine learning and the underlying time representation used are discrete events. We implemented a temporal monitoring package (TEF) that operates in conjunction with normal data science packages for anomaly detection machine learning systems, and we show that TEF can be used to perform accurate interpretation of temporal correlation between events.


title: Digital Sovereignty and Software Engineering for the IoT-laden, AI/ML-driven Era

abstract: Today's software engineering already needs to deal with challenges originating from the multidisciplinarity that is required to realize IoT products: Many variants consist of sensor/actuator-powered systems that already today use AI/ML systems to better cope with the unstructuredness of their intended operational design domain (ODD), while, at the same time, such systems need to be monitored, diagnosed, maintained, and evolved using cloud-powered dashboards and data analytics pipelines that process, aggregate, and analyze countless data points preferably in real-time. This position paper discusses selected aspects related to Digital Sovereignty from a software engineering's perspective for the IoT-laden, AI/ML-driven era: While we can undeniably expect more and more benefits from such solutions, a specific light shall be shed in particular on challenges and responsibilities at design- and operation-time that, at minimum, prepare for and enable or, even better, preserve and extend digital sovereignty from a software engineering's perspective.


title: Mid-circuit cavity measurement in a neutral atom array

abstract: Subsystem readout during a quantum process, or mid-circuit measurement, is crucial for error correction in quantum computation, simulation, and metrology. Ideal mid-circuit measurement should be faster than the decoherence of the system, high-fidelity, and nondestructive to the unmeasured qubits. Here, we use a strongly coupled optical cavity to read out the state of a single tweezer-trapped 87Rb atom within a small tweezer array. Measuring either atomic fluorescence or the transmission of light through the cavity, we detect both the presence and the state of an atom in the tweezer, within only tens of microseconds, with state preparation and measurement infidelities of roughly 0.5% and atom loss probabilities of around 1%. Using a two-tweezer system, we find measurement on one atom within the cavity causes no observable hyperfine-state decoherence on a second atom located tens of microns from the cavity volume. This high-fidelity mid-circuit readout method is a substantial step towards quantum error correction in neutral atom arrays.


title: Learning Markovian Homogenized Models in Viscoelasticity

abstract: Fully resolving dynamics of materials with rapidly-varying features involves expensive fine-scale computations which need to be conducted on macroscopic scales. The theory of homogenization provides an approach to derive effective macroscopic equations which eliminates the small scales by exploiting scale separation. An accurate homogenized model avoids the computationally-expensive task of numerically solving the underlying balance laws at a fine scale, thereby rendering a numerical solution of the balance laws more computationally tractable. In complex settings, homogenization only defines the constitutive model implicitly, and machine learning can be used to learn the constitutive model explicitly from localized fine-scale simulations. In the case of one-dimensional viscoelasticity, the linearity of the model allows for a complete analysis. We establish that the homogenized constitutive model may be approximated by a recurrent neural network (RNN) that captures the memory. The memory is encapsulated in the evolution of an appropriate finite set of internal variables, discovered through the learning process and dependent on the history of the strain. Simulations are presented which validate the theory. Guidance for the learning of more complex models, such as arise in plasticity, by similar techniques, is given.


title: CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior

abstract: The increasing size and complexity of modern ML systems has improved their predictive capabilities but made their behavior harder to explain. Many techniques for model explanation have been developed in response, but we lack clear criteria for assessing these techniques. In this paper, we cast model explanation as the causal inference problem of estimating causal effects of real-world concepts on the output behavior of ML models given actual input data. We introduce CEBaB, a new benchmark dataset for assessing concept-based explanation methods in Natural Language Processing (NLP). CEBaB consists of short restaurant reviews with human-generated counterfactual reviews in which an aspect (food, noise, ambiance, service) of the dining experience was modified. Original and counterfactual reviews are annotated with multiply-validated sentiment ratings at the aspect-level and review-level. The rich structure of CEBaB allows us to go beyond input features to study the effects of abstract, real-world concepts on model behavior. We use CEBaB to compare the quality of a range of concept-based explanation methods covering different assumptions and conceptions of the problem, and we seek to establish natural metrics for comparative assessments of these methods.


title: Contrastive Learning Rivals Masked Image Modeling in Fine-tuning via Feature Distillation

abstract: Masked image modeling (MIM) learns representations with remarkably good fine-tuning performances, overshadowing previous prevalent pre-training approaches such as image classification, instance contrastive learning, and image-text alignment. In this paper, we show that the inferior fine-tuning performance of these pre-training approaches can be significantly improved by a simple post-processing in the form of feature distillation (FD). The feature distillation converts the old representations to new representations that have a few desirable properties just like those representations produced by MIM. These properties, which we aggregately refer to as optimization friendliness, are identified and analyzed by a set of attention- and optimization-related diagnosis tools. With these properties, the new representations show strong fine-tuning performance. Specifically, the contrastive self-supervised learning methods are made as competitive in fine-tuning as the state-of-the-art masked image modeling (MIM) algorithms. The CLIP models' fine-tuning performance is also significantly improved, with a CLIP ViT-L model reaching 89.0% top-1 accuracy on ImageNet-1K classification. On the 3-billion-parameter SwinV2-G model, the fine-tuning accuracy is improved by +1.5 mIoU / +1.1 mAP to 61.4 mIoU / 64.2 mAP on ADE20K semantic segmentation and COCO object detection, respectively, creating new records on both benchmarks. More importantly, our work provides a way for the future research to focus more effort on the generality and scalability of the learnt representations without being pre-occupied with optimization friendliness since it can be enhanced rather easily. The code will be available at https://github.com/SwinTransformer/Feature-Distillation.


title: Only Classical Parameterised States have Optimal Measurements under Least Squares Loss

abstract: Measurements of quantum states form a key component in quantum-information processing. It is therefore an important task to compare measurements and furthermore decide if a measurement strategy is optimal. Entropic quantities, such as the quantum Fisher information, capture asymptotic optimality but not optimality with finite resources. We introduce a framework that allows one to conclusively establish if a measurement is optimal in the non-asymptotic regime. Our method relies on the fundamental property of expected errors of estimators, known as risk, and it does not involve optimisation over entropic quantities. The framework applies to finite sample sizes and lack of prior knowledge, as well as to the asymptotic and Bayesian settings. We prove a no-go theorem that shows that only classical states admit optimal measurements under the most common choice of error measurement: least squares. We further consider the less restrictive notion of an approximately optimal measurement and give sufficient conditions for such measurements to exist. Finally, we generalise the notion of when an estimator is inadmissible (i.e. strictly worse than an alternative), and provide two sufficient conditions for a measurement to be inadmissible.


title: Cryogenic and hermetically sealed packaging of photonic chips for optomechanics

abstract: We demonstrate a hermetically sealed packaging system for integrated photonic devices at cryogenic temperatures with plug-and-play functionality. This approach provides the ability to encapsulate a controlled amount of gas into the optical package allowing helium to be used as a heat-exchange gas to thermalize photonic devices, or condensed into a superfluid covering the device. This packaging system was tested using a silicon-on-insulator slot waveguide resonator which fills with superfluid $^4$He below the transition temperature. To optimize the fiber-to-chip optical integration 690 tests were performed by thermally cycling optical fibers bonded to various common photonic chip substrates (silicon, silicon oxide and HSQ) with a range of glues (NOA 61, NOA 68, NOA 88, NOA 86H and superglue). This showed that NOA 86H (a UV curing optical adhesive with a latent heat catalyst) provided the best performance under cryogenic conditions for all the substrates tested. The technique is relevant to superfluid optomechanics experiments, as well as quantum photonics and quantum optomechanics applications.


title: Noise analysis, error estimates, and Gamma Radiation Measurement for limited detector computerized tomography application

abstract: Computed Tomography is one of the efficient and vital modalities of non-destructive techniques (NDT). Various factors influence the CT reconstruction result, including limited projection data, detector electronics optimization, background noise, detection noise, discretized nature of projection data, and many more. Radiation hardening and other aging factors that affect the operational settings may require recalibration of electronics parameters. Two well-known exercises are utilized with the motivation to improve reliability and accuracy in inverse recovery. The first exercise brute-forces an optimal candidate from the set of calibration methods for minimum error in inverse recovery. The second exercise, Kanpur Theorem-1 (KT-1) examines if optimal calibration sets electronics to impart minimum noise. The mutual conformity between statistics-derived CLT and Riemann integral transform-based KT-1 is shown first time using gamma radiation measurement. The analysis shows that measurement data with normal distribution inflicts the least noise in inverse recovery.


title: Liquid-cooled modular gas cell system for high-order harmonic generation using high average power laser systems

abstract: We present the design and implementation of a new, modular gas target suitable for high-order harmonic generation using high average power lasers. To ensure thermal stability in this high heat load environment, we implement an appropriate liquid cooling system. The system can be used in multiple-cell configurations allowing to control the cell length and aperture size. The cell design was optimized with heat and flow simulations for thermal characteristics, vacuum compatibility and generation medium properties. Finally, the cell system was experimentally validated by conducting high-order harmonic generation measurements using the 100 kHz high average power HR-1 laser system at the Extreme Light Infrastructure Attosecond Light Pulse Source (ELI ALPS) facility. Such a robust, versatile and stackable gas cell arrangement can easily be adapted to different experimental geometries in both table-top laboratory systems and user-oriented facilities, such as ELI ALPS.


title: Multi-Dimensional self-exciting NBD process and Default portfolios

abstract: In this study, we apply a multidimensional self-exciting negative binomial distribution (SE-NBD) process to default portfolios with 13 sectors. The SE-NBD process is a Poisson process with a gamma-distributed intensity function. We extend the SE-NBD process to a multidimensional process. Using the multidimensional SE-NBD process (MD-SE-NBD), we can estimate interactions between these 13 sectors as a network. By applying impact analysis, we can classify upstream and downstream sectors. The upstream sectors are real-estate and financial institution (FI) sectors. From these upstream sectors, shock spreads to the downstream sectors. This is an amplifier of the shock. This is consistent with the analysis of bubble bursts. We compare these results to the multidimensional Hawkes process (MD-Hawkes) that has a zero-variance intensity function.


title: FlowNet-PET: Unsupervised Learning to Perform Respiratory Motion Correction in PET Imaging

abstract: To correct for respiratory motion in PET imaging, an interpretable and unsupervised deep learning technique, FlowNet-PET, was constructed. The network was trained to predict the optical flow between two PET frames from different breathing amplitude ranges. The trained model aligns different retrospectively-gated PET images, providing a final image with similar counting statistics as a non-gated image, but without the blurring effects. FlowNet-PET was applied to anthropomorphic digital phantom data, which provided the possibility to design robust metrics to quantify the corrections. When comparing the predicted optical flows to the ground truths, the median absolute error was found to be smaller than the pixel and slice widths. The improvements were illustrated by comparing against images without motion and computing the intersection over union (IoU) of the tumors as well as the enclosed activity and coefficient of variation (CoV) within the no-motion tumor volume before and after the corrections were applied. The average relative improvements provided by the network were 64%, 89%, and 75% for the IoU, total activity, and CoV, respectively. FlowNet-PET achieved similar results as the conventional retrospective phase binning approach, but only required one sixth of the scan duration. The code and data have been made publicly available (https://github.com/teaghan/FlowNet_PET).


title: Enhanced physics-informed neural networks for hyperelasticity

abstract: Physics-informed neural networks have gained growing interest. Specifically, they are used to solve partial differential equations governing several physical phenomena. However, physics-informed neural network models suffer from several issues and can fail to provide accurate solutions in many scenarios. We discuss a few of these challenges and the techniques, such as the use of Fourier transform, that can be used to resolve these issues. This paper proposes and develops a physics-informed neural network model that combines the residuals of the strong form and the potential energy, yielding many loss terms contributing to the definition of the loss function to be minimized. Hence, we propose using the coefficient of variation weighting scheme to dynamically and adaptively assign the weight for each loss term in the loss function. The developed PINN model is standalone and meshfree. In other words, it can accurately capture the mechanical response without requiring any labeled data. Although the framework can be used for many solid mechanics problems, we focus on three-dimensional (3D) hyperelasticity, where we consider two hyperelastic models. Once the model is trained, the response can be obtained almost instantly at any point in the physical domain, given its spatial coordinates. We demonstrate the framework's performance by solving different problems with various boundary conditions.


title: Low-Drift-Rate External Cavity Diode Laser

abstract: We present the design, construction, and simulation of a simple, low-cost external cavity diode laser with a measured free-running frequency drift rate of 1.4(1)~MHz/h at 852 nm. This performance is achieved via a compact, nearly monolithic aluminum structure to minimize temperature gradients across the laser cavity. We present thermal finite element method simulations which quantify the effects of temperature gradients, and suggest that the drift rate is likely limited by laser-diode aging.


title: Improving the resolution of comb-based frequency measurements using a track and hold amplifier

abstract: The advent of optical frequency standards with ultimate uncertainties in the low 1x10$^{-18}$ requires femtosecond frequency combs to support a similar level of resolution in the spectral transfer and the computation of optical frequency ratios. The related experimental challenges grow together with the number of optical frequencies to be measured simultaneously, as in many cases the comb's optical power does not allow reliable beatnote counting or tracking in all the spectral regions of interest. Here we describe the use of a track-and-hold amplifier to implement the gated detection, a previously proposed technique for improving the signal-to-noise ratio of the beatnote between a low-power tooth of the frequency comb and a continuous wave laser. We demonstrate a 12dB improvement in the signal-to-noise ratio of beatnotes involving a broadband-spanning optical comb as compared to traditional detection schemes. Our approach enables reliable and cycle-slip-free spectral purity transfer and reduces the system sensitivity to power drops in the comb spectrum. Being based on a single chip, it is robust, versatile and easily embedded in more complex experimental schemes. Keywords: frequency comb, spectral purity transfer, gated detection, track and hold amplifier.


title: Interactive and Robust Mesh Booleans

abstract: Boolean operations are among the most used paradigms to create and edit digital shapes. Despite being conceptually simple, the computation of mesh Booleans is notoriously challenging. Main issues come from numerical approximations that make the detection and processing of intersection points inconsistent and unreliable, exposing implementations based on floating point arithmetic to many kinds of degeneracy and failure. Numerical methods based on rational numbers or exact geometric predicates have the needed robustness guarantees, that are achieved at the cost of increased computation times that, as of today, has always restricted the use of robust mesh Booleans to offline applications. We introduce the first algorithm for Boolean operations with robustness guarantees that is capable of operating at interactive frame rates on meshes with up to 200K triangles. We evaluate our tool thoroughly, considering not only interactive applications but also batch processing of large collections of meshes, processing of huge meshes containing millions of elements and variadic Booleans of hundreds of shapes altogether. In all these experiments, we consistently outperform prior art by at least one order of magnitude.


title: Relativistic variables for covariant, retardless wave equations

abstract: A reduced form of the Dirac equation has been previously introduced and studied in the Center of Mass reference frame. In this work we show that this equation can be written in a covariant form in a generic reference frame by using specific momentum variables. These variables are also consistent with the retardless form of the interaction of the model.


title: How have astronomers cited other fields in the last decade?

abstract: We present a citation pattern analysis between astronomical papers and 13 other disciplines, based on the arXiv database over the past decade ($2010 - 2020$). We analyze 12,600 astronomical papers citing over 14,531 unique publications outside astronomy. Two striking patterns are unraveled. First, general relativity recently became the most cited field by astronomers, a trend highly correlated with the discovery of gravitational waves. Secondly, the fast growth of referenced papers in computer science and statistics, the first with a notable 15-fold increase since 2015. Such findings confirm the critical role of interdisciplinary efforts involving astronomy, statistics, and computer science in recent astronomical research.


title: Compressed Parametric and Non-Parametric Approximations to the Gravitational Wave Likelihood

abstract: Gravitational-wave observations of quasicircular compact binary mergers imply complicated posterior measurements of their parameters. Though Gaussian approximations to the pertinent likelihoods have decades of history in the field, the relative generality and practical utility of these approximations hasn't been appreciated, given focus on careful, comprehensive generic Bayesian parameter inference. Building on our previous work in three dimensions, we demonstrate by example that bounded multivariate normal likelihood approximations are a sufficiently accurate representation of the full likelihood of observed gravitational-wave sources. Fits for each event published in the Gravitatinoal-Wave Transient Catalogs at https://gitlab.com/xevra/nal-data, along with a code release at https://gitlab.com/xevra/gwalk. We argue our approximations are more than accurate enough for popultion inference and introduce much smaller errors than waveform model systematics. To demonstrate the utility of these approximations as parametric models for the likelihood of individual gravitational-wave sources, we show examples of their application to modeling the population of observed gravitational-wave sources as well as low-latency parameter inference.


title: Charged Compact Stars in Extended $f(\mathcal{R},\mathcal{G},\mathcal{T})$ Gravity

abstract: The purpose of this paper is to study charged compact stars using extended gravitational theory, also known as $f(\mathcal{R}, \mathcal{G}, \mathcal{T})$ gravity. Alternatively, this theory is also called $f(\mathcal{R}, \mathcal{T}, \mathcal{G})$ gravity. The symbols $\mathcal{R}, \mathcal{G}$, and $\mathcal{T}$ denote the Ricci Scalar, the Gauss-Bonnet invariant, and the trace of the energy-momentum tensor, respectively. We suggested several plausible models in the framework of this new gravity theory, and then used these models to explore several physical properties of compact objects of relativistic nature. This research also takes into account three famous compact stars: Vela X-1 (CS1); SAXJ1808.4-3658 (CS2); and 4U1820-30 (CS3). Moreover, using the suggested models, the physical nature of anisotropic stress, energy density, various energy conditions (ECs), the state of equilibrium, interior stability, mass variations, compactness, anisotropy, electric charge, and electric field intensity are analysed for considered compact stars. Different plots of the above-mentioned quantities are presented for this analysis. Conclusively, the ECs are satisfied, and the compact stars have a significant dense core.


title: The Internet of People (IoP): A New Wave in Pervasive Mobile Computing

abstract: Cyber-Physical convergence, the fast expansion of the Internet at its edge, and tighter interactions between human users and their personal mobile devices push towards an Internet where the human user becomes more central than ever, and where their personal devices become their proxies in the cyber world, in addition to acting as a fundamental tool to sense the physical world. The current Internet paradigm, which is infrastructure-centric, is not the right one to cope with such emerging scenario with a wider range of applications. This calls for a radically new Internet paradigm, that we name the Internet of People (IoP), where the humans and their personal devices are not seen merely as end users of applications, but become active elements of the Internet. Note that IoP is not a replacement of the current Internet infrastructure, but it exploits legacy Internet services as (reliable) primitives to achieve end-to-end connectivity on a global-scale. In this visionary paper, we first discuss the key features of the IoP paradigm along with the underlying research issues and challenges. Then we present emerging networking and computing paradigms that are anticipating IoP


title: Fiber-tip endoscope for optical and microwave control

abstract: We present a robust, fiber based endoscope with a silver direct-laser-written (DLW) structure for radio frequency (RF) emission next to the optical fiber facet. Thereby, we are able to excite and probe a sample, such as nitrogen vacancy (NV) centers in diamond, with RF and optical signals simultaneously and specifically measure the fluorescence of the sample fully through the fiber. At our targeted frequency-range around 2.9 GHz the facet of the fiber-core is in the near-field of the RF-guiding silver-structure, which comes with the advantage of an optimal RF-intensity decreasing rapidly with the distance. By creating a silver structure on the cladding of the optical fiber we achieve the minimal possible distance between an optically excited and detected sample and an antenna structure without affecting the optical performance of the fiber. This allows us realizing a high RF-amplitude at the sample's position when considering an endoscope solution with integrated optical and RF access. The capabilities of the endoscope are quantified by optically detected magnetic resonance (ODMR) measurements of a NV-doped microdiamond that we probe as a practical use case. We demonstrate a magnetic sensitivity of our device of 17.8 nT/$\sqrt{\mathrm{Hz}}$ per when measuring the ODMR exclusively through our fiber and compare the sensitivity to a measurement using a confocal microscope. Moreover, such an endoscope could be used as a powerful tool for measuring a variety of fluorescent particles that can otherwise only be measured with bulky and large optical setups. Furthermore, our endoscope points toward precise distance measurements based on Rabi oscillations.

categories: physics.ins-det physics.app-ph physics.optics quant-ph


title: R-process viable outflows are suppressed in global alpha-viscosity models of collapsar disks

abstract: Collapsar disks have been proposed to be rich factories of heavy elements, but the major question of whether their outflows are neutron-rich, and could therefore represent significant sites of the rapid neutron-capture (r-) process, or dominated by iron-group elements remains unresolved. We present the first global models of collapsars that start from a stellar progenitor and self-consistently describe the evolution of the disk, its composition, and its outflows in response to the imploding stellar mantle, using energy-dependent M1 neutrino transport and an alpha-viscosity to approximate turbulent angular-momentum transport. We find that a neutron-rich, neutrino-dominated accretion flow (NDAF) is established only marginally--either for short times or relatively low viscosities--because the disk tends to disintegrate into an advective disk (ADAF) already at relatively high mass-accretion rates, launching powerful outflows but preventing it from developing a hot, dense, and therefore neutron-rich core. Viscous outflows disrupt the star within ~100s with explosion energies close to that of hypernovae. If viscosity is neglected, a stable NDAF with disk mass of about 1Msun is formed but is unable to release neutron-rich ejecta, while it produces a relatively mild explosion powered by a neutrino-driven wind blown off its surface. With ejecta electron fractions close to 0.5, all models presumably produce large amounts of Ni56. Our results suggest that collapsar models based on the alpha-viscosity are inefficient r-process sites and that genuinely magnetohydrodynamic effects may be required to generate neutron-rich outflows. A relatively weak effective viscosity generated by magnetohydrodynamic turbulence would improve the prospects for obtaining neutron-rich ejecta.


title: On the diversity of magnetar-driven kilonovae

abstract: A non-negligible fraction of binary neutron star mergers are expected to form long-lived neutron star remnants, dramatically altering the multi-messenger signatures of a merger. Here, we extend existing models for magnetar-driven kilonovae and explore the diversity of kilonovae and kilonova afterglows. Focusing on the role of the (uncertain) magnetic field strength, we study the resulting electromagnetic signatures as a function of the external dipolar and internal toroidal fields. These two parameters govern, respectively, the competition between magnetic-dipole spindown and gravitational-wave spindown (due to magnetic-field deformation) of the rapidly-rotating remnant. We find that even in the parameter space where gravitational-wave emission is dominant, a kilonova with a magnetar central engine will be significantly brighter than one without an engine, as this parameter space is where more of the spin-down luminosity is thermalised. In contrast, a system with minimal gravitational-wave emission will produce a kilonova that may be difficult to distinguish from ordinary kilonovae unless early-epoch observations are available. However, as the bulk of the energy in this parameter space goes into accelerating the ejecta, such a system will produce a brighter kilonova afterglow that will peak on shorter times. To effectively hide the presence of the magnetar from the kilonova and kilonova afterglow, the rotational energy inputted into the ejecta must be $\lesssim 10^{-3}-10^{-2} E_{\rm rot}$. We discuss the different diagnostics available to identify magnetar-driven kilonovae in serendipitous observations and draw parallels to other potential magnetar-driven explosions, such as superluminous supernovae and broad-line supernovae Ic.