title: Self-Supervised Graph Transformer on Large-Scale Molecular Data

abstract: How to obtain informative representations of molecules is a crucial prerequisite in AI-driven drug design and discovery. Recent researches abstract molecules as graphs and employ Graph Neural Networks (GNNs) for molecular representation learning. Nevertheless, two issues impede the usage of GNNs in real scenarios: (1) insufficient labeled molecules for supervised training; (2) poor generalization capability to new-synthesized molecules. To address them both, we propose a novel framework, GROVER, which stands for Graph Representation frOm self-superVised mEssage passing tRansformer. With carefully designed self-supervised tasks in node-, edge- and graph-level, GROVER can learn rich structural and semantic information of molecules from enormous unlabelled molecular data. Rather, to encode such complex information, GROVER integrates Message Passing Networks into the Transformer-style architecture to deliver a class of more expressive encoders of molecules. The flexibility of GROVER allows it to be trained efficiently on large-scale molecular dataset without requiring any supervision, thus being immunized to the two issues mentioned above. We pre-train GROVER with 100 million parameters on 10 million unlabelled molecules -- the biggest GNN and the largest training dataset in molecular representation learning. We then leverage the pre-trained GROVER for molecular property prediction followed by task-specific fine-tuning, where we observe a huge improvement (more than 6% on average) from current state-of-the-art methods on 11 challenging benchmarks. The insights we gained are that well-designed self-supervision losses and largely-expressive pre-trained models enjoy the significant potential on performance boosting.


title: Revisiting the relation between nonthermal line widths and transverse MHD wave amplitudes

abstract: Observations and 3D MHD simulations of the transverse MHD waves in the solar corona have established that true wave energies hide in the nonthermal line widths of the optically thin emission lines. This displays the need for a relation between the nonthermal line widths and transverse wave amplitudes for estimating the true wave energies. In the past decade, several studies have assumed that the root mean square (rms) wave amplitudes are larger than nonthermal line widths by a factor of $\sqrt{2}$. However, a few studies have ignored this factor while estimating rms wave amplitudes. Thus there appears to exist a discrepancy in this relation. In this study, we investigate the dependence of nonthermal line widths on wave amplitudes by constructing a simple mathematical model followed by 3D MHD simulations. We derive this relation for the linearly polarised, circularly polarised oscillations, and oscillations excited by multiple velocity drivers. We note a fairly good match between mathematical models and numerical simulations. We conclude that the rms wave amplitudes are never greater than the nonthermal line widths which raises questions about earlier studies claiming transverse waves carry enough energy to heat the solar corona.


title: Does imputation matter? Benchmark for predictive models

abstract: Incomplete data are common in practical applications. Most predictive machine learning models do not handle missing values so they require some preprocessing. Although many algorithms are used for data imputation, we do not understand the impact of the different methods on the predictive models' performance. This paper is first that systematically evaluates the empirical effectiveness of data imputation algorithms for predictive models. The main contributions are (1) the recommendation of a general method for empirical benchmarking based on real-life classification tasks and the (2) comparative analysis of different imputation methods for a collection of data sets and a collection of ML algorithms.


title: Comprehensive analysis of magnetospheric gaps around Kerr black holes using 1D GRPIC simulations

abstract: Spark gaps are likely the source of plasma in active black hole (BH) magnetospheres. In this paper, we present results of 1D general-relativistic particle-in-cell simulations of a starved BH magnetosphere with a realistic treatment of inverse Compton scattering and pair production, for a broad range of conditions, run times longer than in previous studies, and different setups. We find that following the initial discharge, the system undergoes gradual evolution over prolonged time until either, restoring the vacuum state or reaching a state of quasi-periodic oscillations, depending on the spectral shape and luminosity of the ambient radiation field. The oscillations occur near the null charge surface in cases where the global magnetospheric current is in the direction defined by the product of the asymptotic Goldreich-Julian charge density and the radial velocity, while they occur near the boundary of the simulation box when it is the opposite direction (return current). Their amplitude and the resultant luminosity of TeV photons emitted from the gap depend sensitively on the conditions; for the cases studied here the ratio of TeV luminosity to the Blandford-Znajek power ranges from $10^{-5}$ to $10^{-2}$, suggesting that strong flares may be generated by moderate changes in disk emission. We also examined the dependence of the solution on the initial number of particles per cell (PPC) and found convergence for PPC of about 50 for the cases examined. At lower PPC values the pair multiplicity is found to be artificially high, affecting the solution considerably.


title: Exploration of Optimized Semantic Segmentation Architectures for edge-Deployment on Drones

abstract: In this paper, we present an analysis on the impact of network parameters for semantic segmentation architectures in context of UAV data processing. We present the analysis on the DroneDeploy Segmentation benchmark. Based on the comparative analysis we identify the optimal network architecture to be FPN-EfficientNetB3 with pretrained encoder backbones based on Imagenet Dataset. The network achieves IoU score of 0.65 and F1-score of 0.71 over the validation dataset. We also compare the various architectures in terms of their memory footprint and inference latency with further exploration of the impact of TensorRT based optimizations. We achieve memory savings of ~4.1x and latency improvement of 10% compared to Model: FPN and Backbone: InceptionResnetV2.


title: N=2 Conformal SYM theories at large N

abstract: We consider a class of N=2 conformal SU(N) SYM theories in four dimensions with matter in the fundamental, two-index symmetric and anti-symmetric representations, and study the corresponding matrix model provided by localization on a sphere S4, which also encodes information on flat-space observables involving chiral operators and circular BPS Wilson loops. We review and improve known techniques for studying the matrix model in the large-N limit, deriving explicit expressions in perturbation theory for these observables. We exploit both recursive methods in the so-called full Lie algebra approach and the more standard Cartan sub-algebra approach based on the eigenvalue distribution. The sub-class of conformal theories for which the number of fundamental hypermultiplets does not scale with N differs in the planar limit from the N=4 SYM theory only in observables involving chiral operators of odd dimension. In this case we are able to derive compact expressions which allow to push the small 't Hooft coupling expansion to very high orders. We argue that the perturbative series have a finite radius of convergence and extrapolate them numerically to intermediate couplings. This is preliminary to an analytic investigation of the strong coupling behavior, which would be very interesting given that for such theories holographic duals have been proposed.


title: On-shot diagnostic of electron beam-laser pulse interaction based on stochastic quantum radiation reaction

abstract: Ultrarelativistic electron beam-laser pulse scattering experiments are the workhorse for the investigation of QED and of possible signatures of new physics in the still largely unexplored strong-field regime. However, shot-to-shot fluctuations both of the electron beam and of the laser pulse parameters render it difficult to discern the dynamics of the interaction. Consequently, the possibility of benchmarking theoretical predictions against experimental results, which is essential for validating theoretical models, is severely limited. Here we show that the stochastic nature of quantum emission events provides a unique route to the on-shot diagnostic of the electron beam-laser pulse interaction, therefore paving the way for accurate measurements of strong-field QED effects.


title: Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting

abstract: Modeling complex spatial and temporal correlations in the correlated time series data is indispensable for understanding the traffic dynamics and predicting the future status of an evolving traffic system. Recent works focus on designing complicated graph neural network architectures to capture shared patterns with the help of pre-defined graphs. In this paper, we argue that learning node-specific patterns is essential for traffic forecasting while the pre-defined graph is avoidable. To this end, we propose two adaptive modules for enhancing Graph Convolutional Network (GCN) with new capabilities: 1) a Node Adaptive Parameter Learning (NAPL) module to capture node-specific patterns; 2) a Data Adaptive Graph Generation (DAGG) module to infer the inter-dependencies among different traffic series automatically. We further propose an Adaptive Graph Convolutional Recurrent Network (AGCRN) to capture fine-grained spatial and temporal correlations in traffic series automatically based on the two modules and recurrent networks. Our experiments on two real-world traffic datasets show AGCRN outperforms state-of-the-art by a significant margin without pre-defined graphs about spatial connections.


title: The renormalization structure of $6D$, ${\cal N}=(1,0)$ supersymmetric higher-derivative gauge theory

abstract: We consider the harmonic superspace formulation of higher-derivative $6D$, ${\cal N}=(1,0)$ supersymmetric gauge theory and its minimal coupling to a hypermultiplet. In components, the kinetic term for the gauge field in such a theory involves four space-time derivatives.The theory is quantized in the framework of the superfield background method ensuring manifest $6D$, ${\cal N}=(1,0)$ supersymmetry and the classical gauge invariance of the quantum effective action. We evaluate the superficial degree of divergence and prove it to be independent of the number of loops. Using the regularization by dimensional reduction, we find possible counterterms and show that they can be removed by the coupling constant renormalization for any number of loops, while the divergences in the hypermultiplet sector are absent at all. Assuming that the deviation of the gauge-fixing term from that in the Feynman gauge is small, we explicitly calculate the divergent part of the one-loop effective action in the lowest order in this deviation. In the approximation considered, the result is independent of the gauge-fixing parameter and agrees with the earlier calculation for the theory without a hypermultiplet.


title: On optimal two-stage testing of multiple mediators

abstract: Mediation analysis in high-dimensional settings often involves identifying potential mediators among a large number of measured variables. For this purpose, a two-step familywise error rate procedure called ScreenMin has been recently proposed (Djordjilovi\'c et al. 2019). In ScreenMin, variables are first screened and only those that pass the screening are tested. The proposed threshold for selection has been shown to guarantee asymptotic familywise error rate. In this work, we investigate the impact of the selection threshold on the finite sample familywise error rate. We derive a power maximizing selection threshold and show that it is well approximated by an adaptive threshold of Wang et al. (2016). We illustrate the investigated procedures on a case-control study examining the effect of fish intake on the risk of colorectal adenoma.


title: Partially Conditioned Generative Adversarial Networks

abstract: Generative models are undoubtedly a hot topic in Artificial Intelligence, among which the most common type is Generative Adversarial Networks (GANs). These architectures let one synthesise artificial datasets by implicitly modelling the underlying probability distribution of a real-world training dataset. With the introduction of Conditional GANs and their variants, these methods were extended to generating samples conditioned on ancillary information available for each sample within the dataset. From a practical standpoint, however, one might desire to generate data conditioned on partial information. That is, only a subset of the ancillary conditioning variables might be of interest when synthesising data. In this work, we argue that standard Conditional GANs are not suitable for such a task and propose a new Adversarial Network architecture and training strategy to deal with the ensuing problems. Experiments illustrating the value of the proposed approach in digit and face image synthesis under partial conditioning information are presented, showing that the proposed method can effectively outperform the standard approach under these circumstances.


title: Point-Set Anchors for Object Detection, Instance Segmentation and Pose Estimation

abstract: A recent approach for object detection and human pose estimation is to regress bounding boxes or human keypoints from a central point on the object or person. While this center-point regression is simple and efficient, we argue that the image features extracted at a central point contain limited information for predicting distant keypoints or bounding box boundaries, due to object deformation and scale/orientation variation. To facilitate inference, we propose to instead perform regression from a set of points placed at more advantageous positions. This point set is arranged to reflect a good initialization for the given task, such as modes in the training data for pose estimation, which lie closer to the ground truth than the central point and provide more informative features for regression. As the utility of a point set depends on how well its scale, aspect ratio and rotation matches the target, we adopt the anchor box technique of sampling these transformations to generate additional point-set candidates. We apply this proposed framework, called Point-Set Anchors, to object detection, instance segmentation, and human pose estimation. Our results show that this general-purpose approach can achieve performance competitive with state-of-the-art methods for each of these tasks. Code is available at \url{https://github.com/FangyunWei/PointSetAnchor}


title: Explainable Depression Detection with Multi-Modalities Using a Hybrid Deep Learning Model on Social Media

abstract: Model interpretability has become important to engenders appropriate user trust by providing the insight into the model prediction. However, most of the existing machine learning methods provide no interpretability for depression prediction, hence their predictions are obscure to human. In this work, we propose interpretive Multi-Modal Depression Detection with Hierarchical Attention Network MDHAN, for detection depressed users on social media and explain the model prediction. We have considered user posts along with Twitter-based multi-modal features, specifically, we encode user posts using two levels of attention mechanisms applied at the tweet-level and word-level, calculate each tweet and words' importance, and capture semantic sequence features from the user timelines (posts). Our experiments show that MDHAN outperforms several popular and robust baseline methods, demonstrating the effectiveness of combining deep learning with multi-modal features. We also show that our model helps improve predictive performance when detecting depression in users who are posting messages publicly on social media. MDHAN achieves excellent performance and ensures adequate evidence to explain the prediction.


title: Weak SINDy For Partial Differential Equations

abstract: Sparse Identification of Nonlinear Dynamics (SINDy) is a method of system discovery that has been shown to successfully recover governing dynamical systems from data (Brunton et al., PNAS, '16; Rudy et al., Sci. Adv. '17). Recently, several groups have independently discovered that the weak formulation provides orders of magnitude better robustness to noise. Here we extend our Weak SINDy (WSINDy) framework introduced in (arXiv:2005.04339) to the setting of partial differential equations (PDEs). The elimination of pointwise derivative approximations via the weak form enables effective machine-precision recovery of model coefficients from noise-free data (i.e. below the tolerance of the simulation scheme) as well as robust identification of PDEs in the large noise regime (with signal-to-noise ratio approaching one in many well-known cases). This is accomplished by discretizing a convolutional weak form of the PDE and exploiting separability of test functions for efficient model identification using the Fast Fourier Transform. The resulting WSINDy algorithm for PDEs has a worst-case computational complexity of $\mathcal{O}(N^{D+1}\log(N))$ for datasets with $N$ points in each of $D+1$ dimensions (i.e. $\mathcal{O}(\log(N))$ operations per datapoint). Furthermore, our Fourier-based implementation reveals a connection between robustness to noise and the spectra of test functions, which we utilize in an \textit{a priori} selection algorithm for test functions. Finally, we introduce a learning algorithm for the threshold in sequential-thresholding least-squares (STLS) that enables model identification from large libraries, and we utilize scale-invariance at the continuum level to identify PDEs from poorly-scaled datasets. We demonstrate WSINDy's robustness, speed and accuracy on several challenging PDEs.


title: Tolerance versus synaptic noise in dense associative memories

abstract: The retrieval capabilities of associative neural networks can be impaired by different kinds of noise: the fast noise (which makes neurons more prone to failure), the slow noise (stemming from interference among stored memories), and synaptic noise (due to possible flaws during the learning or the storing stage). In this work we consider dense associative neural networks, where neurons can interact in $p$-plets, in the absence of fast noise, and we investigate the interplay of slow and synaptic noise. In particular, leveraging on the duality between associative neural networks and restricted Boltzmann machines, we analyze the effect of corrupted information, imperfect learning and storing errors. For $p=2$ (corresponding to the Hopfield model) any source of synaptic noise breaks-down retrieval if the number of memories $K$ scales as the network size. For $p>2$, in the relatively low-load regime $K \sim N$, synaptic noise is tolerated up to a certain bound, depending on the density of the structure.


title: Transverse and Longitudinal Spin-Torque Ferromagnetic Resonance for Improved Measurements of Spin-Orbit Torques

abstract: Spin-torque ferromagnetic resonance (ST-FMR) is a common method used to measure spin-orbit torques (SOTs) in heavy metal/ferromagnet bilayer structures. In the course of a measurement, other resonant processes such as spin pumping (SP) and heating can cause spin current or heat flows between the layers, inducing additional resonant voltage signals via the inverse spin Hall effect (ISHE) and Nernst effects (NE). In the standard ST-FMR geometry, these extra artifacts exhibit a dependence on the angle of an in-plane magnetic field that is identical to the rectification signal from the SOTs. We show experimentally that the rectification and artifact voltages can be quantified separately by measuring the ST-FMR signal transverse to the applied current (i.e., in a Hall geometry) in addition to the usual longitudinal geometry. We find that in Pt (6 nm)/CoFeB samples the contribution from the artifacts is small compared to the SOT rectification signal for CoFeB layers thinner than 6 nm, but can be significant for thicker magnetic layers. We observe a sign change in the artifact voltage as a function of CoFeB thickness that we suggest may be due to a competition between a resonant heating effect and the SP/ISHE contribution.


title: BMS Symmetry via AdS/CFT

abstract: With a view to understanding extended-BMS symmetries in the framework of the $AdS_4/CFT_3$ correspondence, asymptotically AdS geometries are constructed with null impulsive shockwaves involving a discontinuity in superrotation parameters. The holographic dual is proposed to be a two-dimensional Euclidean defect conformal field localized on a particular timeslice in a three-dimensional conformal field theory on de Sitter spacetime. The defect conformal field theory generates a natural action of the Virasoro algebra. The large radius of curvature limit $\ell\to\infty$ yields spacetimes with nontrivial extended-BMS charges.


title: Cross-Fitting and Averaging for Machine Learning Estimation of Heterogeneous Treatment Effects

abstract: We investigate the finite sample performance of sample splitting, cross-fitting and averaging for the estimation of the conditional average treatment effect. Recently proposed methods, so-called meta-learners, make use of machine learning to estimate different nuisance functions and hence allow for fewer restrictions on the underlying structure of the data. To limit a potential overfitting bias that may result when using machine learning methods, cross-fitting estimators have been proposed. This includes the splitting of the data in different folds to reduce bias and averaging over folds to restore efficiency. To the best of our knowledge, it is not yet clear how exactly the data should be split and averaged. We employ a Monte Carlo study with different data generation processes and consider twelve different estimators that vary in sample-splitting, cross-fitting and averaging procedures. We investigate the performance of each estimator independently on four different meta-learners: the doubly-robust-learner, R-learner, T-learner and X-learner. We find that the performance of all meta-learners heavily depends on the procedure of splitting and averaging. The best performance in terms of mean squared error (MSE) among the sample split estimators can be achieved when applying cross-fitting plus taking the median over multiple different sample-splitting iterations. Some meta-learners exhibit a high variance when the lasso is included in the ML methods. Excluding the lasso decreases the variance and leads to robust and at least competitive results.


title: Removal and Recovery of Ammonia from Wastewater using Ti$_3$C$_2$T$_x$ MXenes in Flow Electrode Capacitive Deionization

abstract: Flowing electrode capacitive deionization systems (FE-CDI) have recently garnered attention because of their ability to prevent cross contamination and operate in uninterrupted cycles ad infinitum. Typically, FE-CDI electrodes suffer from low conductivity, reducing deionization performance. Utilization of higher mass loadings to combat this leads to poor rheological properties. Herein, Ti$_3$C$_2$T$_x$ MXene was introduced as 1 mg/mL slurry electrodes in an FE-CDI system for the removal and recovery of ammonia from simulated agricultural wastewater. The electrode performance was evaluated by operating the FE-CDI system with a feed solution of 500 mg/L NH$_4$Cl running in batch mode at a constant voltage of 1.20 V and -1.20 V in charging and discharging modes, respectively. Despite the low loading, Ti$_3$C$_2$T$_x$ flowing electrodes showed markedly improved performance, achieving 60% ion removal efficiency in a saturation time of 115 minutes with an adsorption capacity of 460 mg/g. To understand the high adsorption performance of the electrodes, physiochemical and structural analysis was done via a variety of characterization techniques such as SEM, TEM, XRD, DLS, and Raman Spectroscopy. Cyclic Voltammetry and Galvanostatic charge/discharge profiles were obtained to evaluate the electrochemical properties of the electrodes. The system proved to be an energy-saving technology by exhibiting a charge efficiency of 58-70% while operating at an energy consumption of 0.45 kWh/kg. A 92% regeneration efficiency showed that the electrodes were stable and suitable for long term and scalable usage. The results demonstrate that MXenes have the potential to improve the FE-CDI process for energy-efficient removal and recovery of ammonia.


title: Diagnosis of Coronary Artery Disease Using Artificial Intelligence Based Decision Support System

abstract: This research is about the development a fuzzy decision support system for the diagnosis of coronary artery disease based on evidence. The coronary artery disease data sets taken from University California Irvine (UCI) are used. The knowledge base of fuzzy decision support system is taken by using rules extraction method based on Rough Set Theory. The rules then are selected and fuzzified based on information from discretization of numerical attributes. Fuzzy rules weight is proposed using the information from support of extracted rules. UCI heart disease data sets collected from U.S., Switzerland and Hungary, data from Ipoh Specialist Hospital Malaysia are used to verify the proposed system. The results show that the system is able to give the percentage of coronary artery blocking better than cardiologists and angiography. The results of the proposed system were verified and validated by three expert cardiologists and are considered to be more efficient and useful.


title: Effective epidemic model for COVID-19 using accumulated deaths

abstract: The severe acute respiratory syndrome COVID-19 has been in the center of the ongoing global health crisis in 2020. The high prevalence of mild cases facilitates sub-notification outside hospital environments and the number of those who are or have been infected remains largely unknown, leading to poor estimates of the crude mortality rate of the disease. Here we use a simple model to describe the number of accumulated deaths caused by COVID-19. The close connection between the proposed model and an approximate solution of the SIR model provides a system of equations whose solutions are robust estimates of epidemiological parameters. We find that the crude mortality varies between $10^{-4}$ and $10^{-3}$ depending on the severity of the outbreak which is lower than previous estimates obtained from laboratory confirmed patients. We also estimate quantities of practical interest such as the basic reproduction number and the expected number of deaths in the asymptotic limit with and without social distancing measures and lockdowns, which allow us to measure the efficiency of these interventions.


title: Propulsion and energetics of a minimal magnetic microswimmer

abstract: In this manuscript we describe the realization of a minimal hybrid microswimmer, composed of a ferromagnetic nanorod and a paramagnetic microsphere. The unbounded pair is propelled in water upon application of a swinging magnetic field that induces a periodic relative movement of the two composing elements, where the nanorod rotates and slides on the surface of the paramagnetic sphere. When taken together, the processes of rotation and sliding describe a finite area in the parameter space, which increases with the frequency of the applied field. We develop a theoretical approach and combine it with numerical simulations, which allow us to understand the dynamics of the propeller and explain the experimental observations. Furthermore, we demonstrate a reversal of the microswimmer velocity by varying the length of the nanorod, as predicted by the model. Finally, we determine theoretically and in experiments the Lighthill's energetic efficiency of this minimal magnetic microswimmer.


title: Stochastic Stein Discrepancies

abstract: Stein discrepancies (SDs) monitor convergence and non-convergence in approximate inference when exact integration and sampling are intractable. However, the computation of a Stein discrepancy can be prohibitive if the Stein operator - often a sum over likelihood terms or potentials - is expensive to evaluate. To address this deficiency, we show that stochastic Stein discrepancies (SSDs) based on subsampled approximations of the Stein operator inherit the convergence control properties of standard SDs with probability 1. Along the way, we establish the convergence of Stein variational gradient descent (SVGD) on unbounded domains, resolving an open question of Liu (2017). In our experiments with biased Markov chain Monte Carlo (MCMC) hyperparameter tuning, approximate MCMC sampler selection, and stochastic SVGD, SSDs deliver comparable inferences to standard SDs with orders of magnitude fewer likelihood evaluations.


title: The quantum kinetic equation and dynamical mass generation in 2+1 Dimensions

abstract: In this work, we study the relativistic quantum kinetic equations in 2+1 dimensions from Wigner function formalism by carrying out a systematic semi-classical expansion up to $\hbar$ order. The derived equations allow us to explore interesting transport phenomena in 2+1 dimensions. Within this framework, the parity-odd transport current induced by the external electromagnetic field is self-consistently derived. We also examine the dynamical mass generation by implementing four-fermion interaction with mean-field approximation. In this case, a new kind of transport current is found to be induced by the gradient of the mean-field condensate. Finally, we also utilize this framework to study the dynamical mass generation in an external magnetic field for the 2+1 dimensional system under equilibrium.


title: Describing quantum metrology with erasure errors using weight distributions of classical codes

abstract: Quantum sensors are expected to be a prominent use-case of quantum technologies, but in practice, noise easily degrades their performance. Quantum sensors can for instance be afflicted with erasure errors. Here, we consider using quantum probe states with a structure that corresponds to classical $[n,k,d]$ binary block codes of minimum distance $d \geq t+1$. We obtain bounds on the ultimate precision that these probe states can give for estimating the unknown magnitude of a classical field after at most $t$ qubits of the quantum probe state are erased. We show that the quantum Fisher information is proportional to the variances of the weight distributions of the corresponding $2^t$ shortened codes. If the shortened codes of a fixed code with $d \geq t+1$ have a non-trivial weight distribution, then the probe states obtained by concatenating this code with repetition codes of increasing length enable asymptotically optimal field-sensing that passively tolerates up to $t$ erasure errors.


title: Unstructured un-split geometrical Volume-of-Fluid methods -- A review

abstract: Geometrical Volume-of-Fluid (VoF) methods mainly support structured meshes, and only a small number of contributions in the scientific literature report results with unstructured meshes and three spatial dimensions. Unstructured meshes are traditionally used for handling geometrically complex solution domains that are prevalent when simulating problems of industrial relevance. However, three-dimensional geometrical operations are significantly more complex than their two-dimensional counterparts, which is confirmed by the ratio of publications with three-dimensional results on unstructured meshes to publications with two-dimensional results or support for structured meshes. Additionally, unstructured meshes present challenges in serial and parallel computational efficiency, accuracy, implementation complexity, and robustness. Ongoing research is still very active, focusing on different issues: interface positioning in general polyhedra, estimation of interface normal vectors, advection accuracy, and parallel and serial computational efficiency. This survey tries to give a complete and critical overview of classical, as well as contemporary geometrical VOF methods with concise explanations of the underlying ideas and sub-algorithms, focusing primarily on unstructured meshes and three dimensional calculations. Reviewed methods are listed in historical order and compared in terms of accuracy and computational efficiency.


title: Learning the Markov order of paths in a network

abstract: We study the problem of learning the Markov order in categorical sequences that represent paths in a network, i.e. sequences of variable lengths where transitions between states are constrained to a known graph. Such data pose challenges for standard Markov order detection methods and demand modelling techniques that explicitly account for the graph constraint. Adopting a multi-order modelling framework for paths, we develop a Bayesian learning technique that (i) more reliably detects the correct Markov order compared to a competing method based on the likelihood ratio test, (ii) requires considerably less data compared to methods using AIC or BIC, and (iii) is robust against partial knowledge of the underlying constraints. We further show that a recently published method that uses a likelihood ratio test has a tendency to overfit the true Markov order of paths, which is not the case for our Bayesian technique. Our method is important for data scientists analyzing patterns in categorical sequence data that are subject to (partially) known constraints, e.g. sequences with forbidden words, mobility trajectories and click stream data, or sequence data in bioinformatics. Addressing the key challenge of model selection, our work is further relevant for the growing body of research that emphasizes the need for higher-order models in network analysis.


title: Deterministic coloring of a family of complexes

abstract: This is the second paper devoted to construction of finitely presented infinite nil semigroup with identity $x^9=0$. This construction answers to the problem of Lev Shevrin and Mark Sapir. In the first part we constructed the sequence of complexes with some set of properties. Namely, all these complexes are uniform elliptic: any two points $A$ and $B$ with distance $d$ can be connected with a system of shortest paths forming a disk of width $ \lambda \cdot D $ for some global constant $ \lambda> 0 $. In the second part of the proof, a finite system of colors with determinism is introduced: for each minimum square that the complex consists of, the color of the three angles determines the color of the fourth corner. The present paper is devoted to the second part of the proof.


title: Counterfactual Data Augmentation using Locally Factored Dynamics

abstract: Many dynamic processes, including common scenarios in robotic control and reinforcement learning (RL), involve a set of interacting subprocesses. Though the subprocesses are not independent, their interactions are often sparse, and the dynamics at any given time step can often be decomposed into locally independent causal mechanisms. Such local causal structures can be leveraged to improve the sample efficiency of sequence prediction and off-policy reinforcement learning. We formalize this by introducing local causal models (LCMs), which are induced from a global causal model by conditioning on a subset of the state space. We propose an approach to inferring these structures given an object-oriented state representation, as well as a novel algorithm for Counterfactual Data Augmentation (CoDA). CoDA uses local structures and an experience replay to generate counterfactual experiences that are causally valid in the global model. We find that CoDA significantly improves the performance of RL agents in locally factored tasks, including the batch-constrained and goal-conditioned settings.


title: An introduction to geodesics: the shortest distance between two points

abstract: We give an accessible introduction and elaboration on the methods used in obtaining a geodesic, which is the curve of shortest length connecting two points lying on the surface of a function. This is found through computing what's known as the variation of a functional, a "function of functions" of sorts. Geodesics are of great importance with wide applications, e.g. dictating the path followed by aircraft (great-circles), how light travels through space, assist in the process of mapping a 2D image to a 3D surface, and robot motion planning.


title: Searching for dark energy in the matter-dominated era

abstract: Most efforts to detect signatures of dynamical dark energy are focused on late times, $z \lesssim 2$, where the dark energy component begins to dominate the cosmic energy density. Many theoretical models involving dynamical dark energy exhibit a 'freezing' equation of state however, where $w \to -1$ at late times, with a transition to a 'tracking' behaviour at earlier times (with $w \gg -1$ at sufficiently high redshift). In this paper, we study whether large-scale structure surveys in the post-reionisation matter-dominated regime, $2 \lesssim z \lesssim 6$, are sensitive to this behaviour, on the basis that the dark energy component should remain detectable (despite being strongly subdominant) in this redshift range given sufficiently precise observations. Using phenomenological models inspired by parameter space studies of Horndeski (generalised scalar-tensor) theories, we show how existing CMB and large-scale structure measurements constrain the dark energy equation of state in the matter-dominated era, and examine how forthcoming galaxy surveys and 21cm intensity mapping instruments can improve constraints in this regime. We also find that the combination of existing CMB and LSS constraints with DESI will already come close to offering the best possible constraints on $H_0$ using BAO/galaxy power spectrum measurements, and that either a spectroscopic follow-up of the LSST galaxy sample (e.g. along the lines of MegaMapper or SpecTel) or a Stage 2/PUMA-like intensity mapping survey, both at $z \gtrsim 2$, would offer better constraints on the class of dark energy models considered here than a comparable cosmic variance-limited galaxy survey at $z \lesssim 1.5$.


title: Ancilla mediated qubit readout and heralded entanglement between rare-earth dopant ions in crystals

abstract: Owing to their long excited state lifetimes, rare-earth ions in crystals are widely used in quantum applications. To allow optical readout of the qubit state of individual ions, we propose to dope the crystal with an additional nearby ancilla ion with a shorter radiative lifetime. We show how a Bayesian analysis exhausts the information about the state of the qubit from the optical signal of the ancilla ion. We study the effects of incoherent processes and propose ways to reduce their effect on the readout. Finally, we extend the architecture to ions residing in two remote cavities, and we show how continuous monitoring of fluorescence signals from the two ancilla ions leads to entanglement of the qubit ions.


title: Micro-slips inside a granular shear band as nano-earthquakes

abstract: We study experimentally the fluctuations of deformation along a shear fault naturally emerging within a compressed frictional granular medium. Using laser interferometry, we show that the deformation inside this granular gouge occurs as a succession of localized micro-slips distributed along the fault. The associated distributions of released seismic moments, the memory effects in strain fluctuations, as well as the time correlations between successive events, follow exactly the empirical laws of natural earthquakes. Using a methodology initially developed in seismology and social science, we reveal, for the first time at the laboratory scale, the underlying causal structure. This demonstrates that the spatio-temporal correlations of the slip dynamics effectively emerge from more fundamental triggering kernels. This formal analogy between natural faults and our experimentally controllable granular shear band opens the way towards a better understanding of earthquake physics. In particular, comparing experiments performed under different imposed deformation rates, we show that strain, not time, is the right parameter controlling the memory effects in the dynamics of our fault analog. This raises the fundamental question of the relative roles of strain-dependent structural rearrangements within the fault gouge vs that of truly time-dependent, thermally activated processes, in the emergence of spatio-temporal correlations of natural seismicity.


title: Graphop Mean-Field Limits for Kuramoto-Type Models

abstract: Originally arising in the context of interacting particle systems in statistical physics, dynamical systems and differential equations on networks/graphs have permeated into a broad number of mathematical areas as well as into many applications. One central problem in the field is to find suitable approximations of the dynamics as the number of nodes/vertices tends to infinity, i.e., in the large graph limit. A cornerstone in this context are Vlasov-Fokker-Planck equations (VFPEs) describing a particle density on a mean-field level. For all-to-all coupled systems, it is quite classical to prove the rigorous approximation by VFPEs for many classes of particle systems. For dense graphs converging to graphon limits, one also knows that mean-field approximation holds for certain classes of models, e.g., for the Kuramoto model on graphs. Yet, the space of intermediate density and sparse graphs is clearly extremely relevant. Here we prove that the Kuramoto model can be be approximated in the mean-field limit by far more general graph limits than graphons. In particular, our contributions are as follows. (I) We show, how to introduce operator theory more abstractly into VFPEs by considering graphops. Graphops have recently been proposed as a unifying approach to graph limit theory, and here we show that they can be used for differential equations on graphs. (II) For the Kuramoto model on graphs we rigorously prove that there is a VFPE equation approximating it in the mean-field sense. (III) This mean-field VFPE involves a graphop, and we prove the existence, uniqueness, and continuous graphop-dependence of weak solutions. (IV) On a technical level, our results rely on designing a new suitable metric of graphop convergence and on employing Fourier analysis on compact abelian groups to approximate graphops using summability kernels.


title: Toeplitz determinants associated with Ma-Minda classes of starlike and convex functions

abstract: A starlike function $f$ is characterized by the quantity $zf'(z)/f(z)$ lying in the right half-plane. This paper deals with sharp bounds for certain symmetric Toeplitz determinants whose entries are the coefficients of the functions $f$ for which the quantity $zf'(z)/f(z)$ takes values in certain specific subset in the right half-plane. The results obtained include several new special cases and some known results.


title: Non-Markovianity of Quantum Brownian Motion

abstract: We study quantum non-Markovian dynamics of the Caldeira-Leggett model, a prototypical model for quantum Brownian motion describing a harmonic oscillator linearly coupled to a reservoir of harmonic oscillators. Employing the exact analytical solution of this model one can determine the size of memory effects for arbitrary couplings, temperatures and frequency cutoffs. Here, quantum non-Markovianity is defined in terms of the flow of information between the open system and its environment, which is quantified through the Bures metric as distance measure for quantum states. This approach allows us to discuss quantum memory effects in the whole range from weak to strong dissipation for arbitrary Gaussian initial states. A comparison of our results with the corresponding results for the spin-boson problem show a remarkable similarity in the structure of non-Markovian behavior of the two paradigmatic models.


title: DART: Open-Domain Structured Data Record to Text Generation

abstract: We present DART, an open domain structured DAta Record to Text generation dataset with over 82k instances (DARTs). Data-to-Text annotations can be a costly process, especially when dealing with tables which are the major source of structured data and contain nontrivial structures. To this end, we propose a procedure of extracting semantic triples from tables that encodes their structures by exploiting the semantic dependencies among table headers and the table title. Our dataset construction framework effectively merged heterogeneous sources from open domain semantic parsing and dialogue-act-based meaning representation tasks by utilizing techniques such as: tree ontology annotation, question-answer pair to declarative sentence conversion, and predicate unification, all with minimum post-editing. We present systematic evaluation on DART as well as new state-of-the-art results on WebNLG 2017 to show that DART (1) poses new challenges to existing data-to-text datasets and (2) facilitates out-of-domain generalization. Our data and code can be found at https://github.com/Yale-LILY/dart.


title: Quantum coherence and speed limit in the mean-field Dicke model of superradiance

abstract: Dicke superrandiance is a cooperative phenomenon which arises from the collective coupling of an ensemble of atoms to the electromagnetic radiation. Here we discuss the quantifying of quantum coherence for the Dicke model of superradiance in the mean-field approximation. We found the single-atom $l_1$-norm of coherence is given by the square root of the normalized average intensity of radiation emitted by the superradiant system. This validates quantum coherence as a useful figure of merit towards the understanding of superradiance phenomenon in the mean-field approach. In particular, this result suggests probing the single-atom coherence through the radiation intensity in superradiant systems, which might be useful in experimental realizations where is unfeasible to address atoms individually. Furthermore, given the nonlinear unitary dynamics of the time-dependent single-atom state that effectively describes the system of $N$ atoms, we analyze the quantum speed limit time and its interplay with the $l_1$-norm of coherence. We verify the quantum coherence speeds up the evolution of the superradiant system, i.e., the more coherence stored on the single-atom state, the faster the evolution. These findings unveil the role played by quantum coherence in superradiant systems, which in turn could be of interest for communities of both condensed matter physics and quantum optics.


title: Measurements of $WH$ and $ZH$ production in the $H \rightarrow b\bar{b}$ decay channel in $pp$ collisions at 13 TeV with the ATLAS detector

abstract: Measurements of the Standard Model Higgs boson decaying into a $b\bar{b}$ pair and produced in association with a $W$ or $Z$ boson decaying into leptons, using proton-proton collision data collected between 2015 and 2018 by the ATLAS detector, are presented. The measurements use collisions produced by the Large Hadron Collider at a centre-of-mass energy of $\sqrt{s} = $13 TeV, corresponding to an integrated luminosity of 139 fb$^{-1}$. The production of a Higgs boson in association with a $W$ or $Z$ boson is established with observed (expected) significances of 4.0 (4.1) and 5.3 (5.1) standard deviations, respectively. Cross-sections of associated production of a Higgs boson decaying into bottom quark pairs with an electroweak gauge boson, $W$ or $Z$, decaying into leptons are measured as a function of the gauge boson transverse momentum in kinematic fiducial volumes. The cross-section measurements are all consistent with the Standard Model expectations, and the total uncertainties vary from 30% in the high gauge boson transverse momentum regions to 85% in the low regions. Limits are subsequently set on the parameters of an effective Lagrangian sensitive to modifications of the $WH$ and $ZH$ processes as well as the Higgs boson decay into $b\bar{b}$.


title: Fuzzy Integral = Contextual Linear Order Statistic

abstract: The fuzzy integral is a powerful parametric nonlin-ear function with utility in a wide range of applications, from information fusion to classification, regression, decision making,interpolation, metrics, morphology, and beyond. While the fuzzy integral is in general a nonlinear operator, herein we show that it can be represented by a set of contextual linear order statistics(LOS). These operators can be obtained via sampling the fuzzy measure and clustering is used to produce a partitioning of the underlying space of linear convex sums. Benefits of our approach include scalability, improved integral/measure acquisition, generalizability, and explainable/interpretable models. Our methods are both demonstrated on controlled synthetic experiments, and also analyzed and validated with real-world benchmark data sets.


title: DGLA Dg and BV formalism

abstract: Differrential Graded Lie Algebra Dg was previously introduced in the context of current algebras. We show that under some conditions, the problem of constructing equivariantly closed form from closed invariant form is reduces to construction of a representation of Dg. This includes equivariant BV formalism. In particular, an analogue of intertwiner between Weil and Cartan models allows to clarify the general relation between integrated and unintegrated vertex operators in string worldsheet theory.


title: A Mathematical Theory of Attention

abstract: Attention is a powerful component of modern neural networks across a wide variety of domains. However, despite its ubiquity in machine learning, there is a gap in our understanding of attention from a theoretical point of view. We propose a framework to fill this gap by building a mathematically equivalent model of attention using measure theory. With this model, we are able to interpret self-attention as a system of self-interacting particles, we shed light on self-attention from a maximum entropy perspective, and we show that attention is actually Lipschitz-continuous (with an appropriate metric) under suitable assumptions. We then apply these insights to the problem of mis-specified input data; infinitely-deep, weight-sharing self-attention networks; and more general Lipschitz estimates for a specific type of attention studied in concurrent work.


title: Sufficient conditions for strong starlikeness

abstract: Let $p$ be an analytic function defined on the open unit disc $\mathbb{D}$ with $p(0)=1$ and $0< \alpha \leq 1$. The conditions on complex valued functions $C$, $D$ and $E$ are obtained for $p$ to be subordinate to $((1+z)/(1-z))^{\alpha}$ when $C(z) z^{2}p''(z)+D(z)zp'(z) + E(z)p(z)=0$. Sufficient conditions for confluent (Kummer) hypergeometric function and generalized and normalized Bessel function of the first kind of complex order to be subordinate to $((1+z)/(1-z))^{\alpha}$ are obtained as applications. The conditions on $\alpha$ and $\beta$ are derived for $p$ to be subordinate to $((1+z)/(1-z))^{\alpha}$ when $1+\beta zp'(z)/p^{n}(z)$ with $n=1,2$ is subordinate to $1+4z/3+2z^{2}/3=:\varphi_{CAR}(z)$. Similar problems were investigated for $\RE p(z)>0$ when the functions $p(z)+\beta zp'(z)/p^{n}(z)$ with $n=0,2$ is subordinate to $\varphi_{CAR}(z)$. The condition on $\beta$ is determined for $p$ to be subordinate to $((1+z)/(1-z))^{\alpha}$ when $p(z)+\beta zp'(z)/p^{n}(z)$ with $n=0,1,2$ is subordinate to $((1+z)/(1-z))^{\alpha}$.


title: Quantum phase transitions in a spin-1 antiferromagnetic chain with long-range interactions and modulated single-ion anisotropy

abstract: We study the phase diagram of spin-1 antiferromagnetic chain with isotropic antiferromagnetic interactions decaying with a power-law $\propto r^{-\alpha}$ ($\alpha\ge 1$) accompanied by modulated single-ion anisotropy. Employing the techniques of the density-matrix renormalization group, effects of long-range interactions and single-ion anisotropy on a variety of correlations are investigated. In order to check the consistency, the fidelity susceptibilities are evaluated across quantum phase transitions. The quantum critical points are faithfully detected and orders of phase transitions are determined. The correlation-length critical exponent is extracted from scaling functions of the fidelity susceptibility. The presence of long-range interactions leads to quantitative change of the phase boundaries and reduces the order of phase transition under certain conditions. A direct first-order transition between the periodic N\'eel phase and the large-$D$ phase occurs for slowly decaying antiferromagnetic interactions.


title: Fast Adaptation via Policy-Dynamics Value Functions

abstract: Standard RL algorithms assume fixed environment dynamics and require a significant amount of interaction to adapt to new environments. We introduce Policy-Dynamics Value Functions (PD-VF), a novel approach for rapidly adapting to dynamics different from those previously seen in training. PD-VF explicitly estimates the cumulative reward in a space of policies and environments. An ensemble of conventional RL policies is used to gather experience on training environments, from which embeddings of both policies and environments can be learned. Then, a value function conditioned on both embeddings is trained. At test time, a few actions are sufficient to infer the environment embedding, enabling a policy to be selected by maximizing the learned value function (which requires no additional environment interaction). We show that our method can rapidly adapt to new dynamics on a set of MuJoCo domains. Code available at https://github.com/rraileanu/policy-dynamics-value-functions.


title: Contextualized Spoken Word Representations from Convolutional Autoencoders

abstract: A lot of work has been done to build text-based language models for performing different NLP tasks, but not much research has been done in the case of audio-based language models. This paper proposes a Convolutional Autoencoder based neural architecture to model syntactically and semantically adequate contextualized representations of varying length spoken words. The use of such representations can not only lead to great advances in the audio-based NLP tasks but can also curtail the loss of information like tone, expression, accent, etc while converting speech to text to perform these tasks. The performance of the proposed model is validated by (1) examining the generated vector space, and (2) evaluating its performance on three benchmark datasets for measuring word similarities, against existing widely used text-based language models that are trained on the transcriptions. The proposed model was able to demonstrate its robustness when compared to the other two language-based models.


title: Thermal inertias of pebble-pile comet 67P/Churyumov-Gerasimenko

abstract: The Rosetta mission to comet 67P/Churyumov-Gerasimenko has provided new data to better understand what comets are made of. The weak tensile strength of the cometary surface materials suggests that the comet is a hierarchical dust aggregate formed through gravitational collapse of a bound clump of small dust aggregates so-called ``pebbles'' in the gaseous solar nebula. Since pebbles are the building blocks of comets, which are the survivors of planetesimals in the solar nebula, estimating the size of pebbles using a combination of thermal observations and numerical calculations is of great importance to understand the planet formation in the outer solar system. In this study, we calculated the thermal inertias and thermal skin depths of the hierarchical aggregates of pebbles, for both diurnal and orbital variations of the temperature. We found that the thermal inertias of the comet 67P/Churyumov-Gerasimenko are consistent with the hierarchical aggregate of cm- to dm-sized pebbles. Our findings indicate that the icy planetesimals may have formed via accretion of cm- to dm-sized pebbles in the solar nebula.


title: Graph approach to quantum teleportation dynamics

abstract: Quantum teleportation plays a key role in modern quantum technologies. Thus, it is of much interest to generate alternative approaches or representations aimed at allowing us a better understanding of the physics involved in the process from different perspectives. With this purpose, here an approach based on graph theory is introduced and discussed in the context of some applications. Its main goal is to provide a fully symbolic framework for quantum teleportation from a dynamical viewpoint, which makes explicit at each stage of the process how entanglement and information swap among the qubits involved in it. In order to construct this dynamical perspective, it has been necessary to define some auxiliary elements, namely virtual nodes and edges, as well as an additional notation for nodes describing potential states (against nodes accounting for actual states). With these elements, not only the flow of the process can be followed step by step, but they allow us to establish a direct correspondence between this graph-based approach and the usual state vector description. To show the suitability and versatility of this graph-based approach, several particular teleportation examples are examined, which include bipartite, tripartite and tetrapartite maximally entangled states as quantum channels. From the analysis of these cases, a general protocol is discussed in the case of sharing a maximally entangled multi-qubit system.


title: Dark Sirens to Resolve the Hubble-Lema\^itre Tension

abstract: The planned sensitivity upgrades to the LIGO and Virgo facilities could uniquely identify host galaxies of dark sirens-compact binary coalescences without any electromagnetic counterparts-within a redshift of z = 0.1. This is aided by the higher order spherical harmonic modes present in the gravitational-wave signal, which also improve distance estimation. In conjunction, sensitivity upgrades and higher modes will facilitate an accurate, independent measurement of the host galaxy's redshift in addition to the luminosity distance from the gravitational wave observation to infer the Hubble-Lema\^itre constant H0 to better than a few percent in five years. A possible Voyager upgrade or third generation facilities would further solidify the role of dark sirens for precision cosmology in the future.


title: Augment Yourself: Mixed Reality Self-Augmentation Using Optical See-through Head-mounted Displays and Physical Mirrors

abstract: Optical see-though head-mounted displays (OST HMDs) are one of the key technologies for merging virtual objects and physical scenes to provide an immersive mixed reality (MR) environment to its user. A fundamental limitation of HMDs is, that the user itself cannot be augmented conveniently as, in casual posture, only the distal upper extremities are within the field of view of the HMD. Consequently, most MR applications that are centered around the user, such as virtual dressing rooms or learning of body movements, cannot be realized with HMDs. In this paper, we propose a novel concept and prototype system that combines OST HMDs and physical mirrors to enable self-augmentation and provide an immersive MR environment centered around the user. Our system, to the best of our knowledge the first of its kind, estimates the user's pose in the virtual image generated by the mirror using an RGBD camera attached to the HMD and anchors virtual objects to the reflection rather than the user directly. We evaluate our system quantitatively with respect to calibration accuracy and infrared signal degradation effects due to the mirror, and show its potential in applications where large mirrors are already an integral part of the facility. Particularly, we demonstrate its use for virtual fitting rooms, gaming applications, anatomy learning, and personal fitness. In contrast to competing devices such as LCD-equipped smart mirrors, the proposed system consists of only an HMD with RGBD camera and, thus, does not require a prepared environment making it very flexible and generic. In future work, we will aim to investigate how the system can be optimally used for physical rehabilitation and personal training as a promising application.


title: Converting translation operators into plane polar and spherical coordinates and their use in determining quantum-mechanical wavefunctions in a representation-independent fashion

abstract: Quantum mechanics is often developed in the position representation, but this is not necessary, and one can perform calculations in a representation-independent fashion, even for wavefunctions. In this work, we illustrate how one can determine wavefunctions, aside from normalization, using only operators and how those operators act on state vectors. To do this in plane polar and spherical coordinates requires one to convert the translation operator into those coordinates. As examples of this approach, we illustrate the solution of the Coulomb problem in two and three dimensions without needing to express any operators in position space.


title: Dispersion measure: Confusion, Constants & Clarity

abstract: The dispersion measure (DM) is one of the key attributes of radio pulsars and Fast Radio Bursts (FRBs). There is a mistaken view that the DM is an accurate measure of the column density of electrons between the observer and the source. To start with, the DM, unlike a true column density, is not a Lorentz invariant. Next, the DM also includes contribution from ions and is sensitive to the temperature of the plasma in the intervening clouds. Separately, the primary observable is the dispersion slope, $\mathcal{D}\equiv \Delta{(t)}/\Delta{(\nu^{-2}})$, where $t(\nu)$ is the arrival time at frequency, $\nu$. A scaling factor composed of physical and astronomical constants is needed to convert $\mathcal{D}$ to DM. In the early days of pulsar astronomy the relevant constants were defined to parts per million (ppm). As a result, a convention arose in which this conversion factor was fixed. Over time, several such conventions came about -- recipe for confusion. Meanwhile, over the past several years, the SI system has been restructured and the parsec is now exactly defined. As a result, the present accuracy of the conversion factor is below a part per billion -- many orders of magnitude better than the best measurement errors of $\mathcal{D}$. We are now in an awkward situation wherein the primary "observable", the DM, has incorrect scaling factor(s). To address these two concerns I propose that astronomers report the primary measurement, $\mathcal{D}$ (with a suggested normalization of $10^{15}\,$Hz), and not the DM. Interested users can convert $\mathcal{D}$ to DM without the need to know secret handshakes of the pulsar timing communities.


title: Probing the post-Minkowskian approximation using recursive addition of self-interactions

abstract: We address the problem of deriving the post-Minkowskian approximation, widely used in current gravitational wave literature by investigating a possible deduction out of the recursive N\"other coupling approach, from the Pauli-Fierz spin-2 theory in flat spacetime. We find that this approach yields the post-Minkowskian approximation correctly to the first three orders, without invoking any weak-field limit of general relativity. This connection thus establishes that the post-Minkowskian approximation has a connotation independent of a weak-field expansion of general relativity, which is the manner usually presented in the literature. As a consequence, a link manifests between the recursive N\"other coupling approach to deriving general relativity from a linear spin-2 theory in flat spacetime and theoretical analyses of recent detection of gravitational wave events.


title: The Gaia-ESO Survey: Galactic evolution of lithium at high metallicity

abstract: Reconstructing the Galactic evolution of lithium (Li) is the main tool used to constrain the source(s) of Li enrichment in the Galaxy. Recent results have suggested a decline in Li at supersolar metallicities, which may indicate reduced production. We exploit the unique characteristics of the Gaia-ESO Survey open star cluster sample to further investigate this issue and to better constrain the evolution of Li at high metallicity. We trace the the upper envelope of Li abundance versus metallicity evolution using 18 clusters and considering members that should not have suffered any Li depletion. At variance with previous claims, we do not find any evidence of a Li decrease at high metallicity. The most metal-rich clusters in the sample ([Fe/H] about 0.3) actually show the highest Li abundances, with A(Li) > 3.4. Our results clearly show that previous findings, which were based on field stars, were affected by selection effects. The metal-rich population in the solar neighbourhood is composed of relatively old and cool stars that have already undergone some Li depletion; hence, their measured Li does not represent the initial interstellar medium abundance, but a lower limit to it.


title: Wind-powered afterglows of gamma-ray bursts: flares, plateaus and steep decays

abstract: Afterglows of gamma-ray bursts often show flares, plateaus, and sudden intensity drops: these temporal features are difficult to explain as coming from the forward shock. We calculate radiative properties of early GRB afterglows with the dominant contribution from the reverse shock (RS) propagating in an ultra-relativistic (pulsar-like) wind produced by the long-lasting central engine. RS emission occurs in the fast cooling regime -- this ensures high radiative efficiency and allows fast intensity variations. We demonstrate that: (i) mild wind power, of the order of $\sim 10^{46}$ erg s$^{-1}$, can reproduce the afterglows' plateau phase; (ii) termination of the wind can produce sudden steep decays; (iii) mild variations in the wind luminosity can produce short-duration afterglow flares.


title: Fairness in machine learning: against false positive rate equality as a measure of fairness

abstract: As machine learning informs increasingly consequential decisions, different metrics have been proposed for measuring algorithmic bias or unfairness. Two popular fairness measures are calibration and equality of false positive rate. Each measure seems intuitively important, but notably, it is usually impossible to satisfy both measures. For this reason, a large literature in machine learning speaks of a fairness tradeoff between these two measures. This framing assumes that both measures are, in fact, capturing something important. To date, philosophers have not examined this crucial assumption, and examined to what extent each measure actually tracks a normatively important property. This makes this inevitable statistical conflict, between calibration and false positive rate equality, an important topic for ethics. In this paper, I give an ethical framework for thinking about these measures and argue that, contrary to initial appearances, false positive rate equality does not track anything about fairness, and thus sets an incoherent standard for evaluating the fairness of algorithms.


title: Hamiltonicity of random subgraphs of the hypercube

abstract: We study Hamiltonicity in random subgraphs of the hypercube $\mathcal{Q}^n$. Our first main theorem is an optimal hitting time result. Consider the random process which includes the edges of $\mathcal{Q}^n$ according to a uniformly chosen random ordering. Then, with high probability, as soon as the graph produced by this process has minimum degree $2k$, it contains $k$ edge-disjoint Hamilton cycles, for any fixed $k\in\mathbb{N}$. Secondly, we obtain a perturbation result: if $H\subseteq\mathcal{Q}^n$ satisfies $\delta(H)\geq\alpha n$ with $\alpha>0$ fixed and we consider a random binomial subgraph $\mathcal{Q}^n_p$ of $\mathcal{Q}^n$ with $p\in(0,1]$ fixed, then with high probability $H\cup\mathcal{Q}^n_p$ contains $k$ edge-disjoint Hamilton cycles, for any fixed $k\in\mathbb{N}$. In particular, both results resolve a long standing conjecture, posed e.g. by Bollob\'as, that the threshold probability for Hamiltonicity in the random binomial subgraph of the hypercube equals $1/2$. Our techniques also show that, with high probability, for all fixed $p\in(0,1]$ the graph $\mathcal{Q}^n_p$ contains an almost spanning cycle. Our methods involve branching processes, the R\"odl nibble, and absorption.


title: Uniqueness and nonuniqueness of fronts for degenerate diffusion-convection reaction equations

abstract: We consider a scalar parabolic equation in one spatial dimension. The equation is constituted by a convective term, a reaction term with one or two equilibria, and a positive diffusivity which can however vanish. We prove the existence and several properties of traveling-wave solutions to such an equation. In particular, we provide a sharp estimate for the minimal speed of the profiles and improve previous results about the regularity of wavefronts. Moreover, we show the existence of an infinite number of semi-wavefronts with the same speed.


title: Making Fair ML Software using Trustworthy Explanation

abstract: Machine learning software is being used in many applications (finance, hiring, admissions, criminal justice) having a huge social impact. But sometimes the behavior of this software is biased and it shows discrimination based on some sensitive attributes such as sex, race, etc. Prior works concentrated on finding and mitigating bias in ML models. A recent trend is using instance-based model-agnostic explanation methods such as LIME to find out bias in the model prediction. Our work concentrates on finding shortcomings of current bias measures and explanation methods. We show how our proposed method based on K nearest neighbors can overcome those shortcomings and find the underlying bias of black-box models. Our results are more trustworthy and helpful for the practitioners. Finally, We describe our future framework combining explanation and planning to build fair software.


title: Simplified Game of Life: Algorithms and Complexity

abstract: Game of Life is a simple and elegant model to study dynamical system over networks. The model consists of a graph where every vertex has one of two types, namely, dead or alive. A configuration is a mapping of the vertices to the types. An update rule describes how the type of a vertex is updated given the types of its neighbors. In every round, all vertices are updated synchronously, which leads to a configuration update. While in general, Game of Life allows a broad range of update rules, we focus on two simple families of update rules, namely, underpopulation and overpopulation, that model several interesting dynamics studied in the literature. In both settings, a dead vertex requires at least a desired number of live neighbors to become alive. For underpopulation (resp., overpopulation), a live vertex requires at least (resp. at most) a desired number of live neighbors to remain alive. We study the basic computation problems, e.g., configuration reachability, for these two families of rules. For underpopulation rules, we show that these problems can be solved in polynomial time, whereas for overpopulation rules they are PSPACE-complete.


title: Coronary Heart Disease Diagnosis Based on Improved Ensemble Learning

abstract: Accurate diagnosis is required before performing proper treatments for coronary heart disease. Machine learning based approaches have been proposed by many researchers to improve the accuracy of coronary heart disease diagnosis. Ensemble learning and cascade generalization are among the methods which can be used to improve the generalization ability of learning algorithm. The objective of this study is to develop heart disease diagnosis method based on ensemble learning and cascade generalization. Cascade generalization method with loose coupling strategy is proposed in this study. C4. 5 and RIPPER algorithm were used as meta-level algorithm and Naive Bayes was used as baselevel algorithm. Bagging and Random Subspace were evaluated for constructing the ensemble. The hybrid cascade ensemble methods are compared with the learning algorithms in non-ensemble mode and non-cascade mode. The methods are also compared with Rotation Forest. Based on the evaluation result, the hybrid cascade ensemble method demonstrated the best result for the given heart disease diagnosis case. Accuracy and diversity evaluation was performed to analyze the impact of the cascade strategy. Based on the result, the accuracy of the classifiers in the ensemble is increased but the diversity is decreased.


title: Multi-Objective DNN-based Precoder for MIMO Communications

abstract: This paper introduces a unified deep neural network (DNN)-based precoder for two-user multiple-input multiple-output (MIMO) networks with five objectives: data transmission, energy harvesting, simultaneous wireless information and power transfer, physical layer (PHY) security, and multicasting. First, a rotation-based precoding is developed to solve the above problems independently. Rotation-based precoding is new precoding and power allocation that beats existing solutions in PHY security and multicasting and is reliable in different antenna settings. Next, a DNN-based precoder is designed to unify the solution for all objectives. The proposed DNN concurrently learns the solutions given by conventional methods, i.e., analytical or rotation-based solutions. A binary vector is designed as an input feature to distinguish the objectives. Numerical results demonstrate that, compared to the conventional solutions, the proposed DNN-based precoder reduces on-the-fly computational complexity more than an order of magnitude while reaching near-optimal performance (99.45\% of the averaged optimal solutions). The new precoder is also more robust to the variations of the numbers of antennas at the receivers.


title: Stokes flow due to point torques and sources in a spherical geometry

abstract: Solutions to the Stokes equations written in terms of a small number of hydrodynamic image singularities have been a useful tool in theoretical and numerical computations for nearly fifty years. In this article, we extend the catalogue of known solutions by deriving the flow expressions due to a general point torque and point source in the presence of a stationary sphere with either a no-slip or a stress-free (no shear) boundary condition. For an axisymmetric point torque and a no-slip sphere the image system simplifies to a single image point torque, reminiscent of the solution for a point charge outside an equipotential sphere in electrostatics. By symmetry, this also gives a simple representation of the solution due to an axisymmetric point torque inside a rigid spherical shell. In all remaining cases, the solution can be described by a collection of physically intuitive point and line singularities. Our results will be useful for the theoretical modelling of the propulsion of microswimmers and efficient numerical implementation of far-field hydrodynamic interactions in this geometry.


title: Dark Matter $Z^\prime$ and XENON1T Excess from $U(1)_X$ Extended Standard Model

abstract: A gauged $U(1)_X$ symmetry appended to the Standard Model (SM) is particularly well-motivated since it can account for the light neutrino masses by the seesaw mechanism, explain the origin of baryon asymmetry of the universe via leptogenesis, and help implement successful cosmological inflation with the $U(1)_X$ breaking Higgs field as the inflaton. In this framework, we propose a light dark matter (DM) scenario in which the $U(1)_X$ gauge boson $Z^\prime$ behaves as a DM particle in the universe. We discuss how this scenario with $Z^\prime$ mass of a few keV and a $U(1)_X$ gauge coupling $g_X \simeq 10^{-16}$ can nicely fit the excess in the electronic recoil energy spectrum recently reported by the XENON1T collaboration. In order to reproduce the observed DM relic density in the presence of such a tiny gauge coupling, we propose an extension of the model to a two-component DM scenario. The $Z^\prime$ DM density can be comparable to the observed DM density by the freeze-in mechanism through the coupling of $Z^\prime$ boson to a partner Higgs-portal scalar DM with a large $U(1)_X$ charge.


title: The XMM-Newton serendipitous survey IX. The fourth XMM-Newton serendipitous source catalogue

abstract: Sky surveys produce enormous quantities of data on extensive regions of the sky. The easiest way to access this information is through catalogues of standardised data products. {\em XMM-Newton} has been surveying the sky in the X-ray, ultra-violet, and optical bands for 20 years. The {\em XMM-Newton} Survey Science Centre has been producing standardised data products and catalogues to facilitate access to the serendipitous X-ray sky. Using improved calibration and enhanced software, we re-reduced all of the 14041 {\em XMM-Newton} X-ray observations, of which 11204 observations contained data with at least one detection and with these we created a new, high quality version of the {\em XMM-Newton} serendipitous source catalogue, 4XMM-DR9. 4XMM-DR9 contains 810795 detections down to a detection significance of 3 $\sigma$, of which 550124 are unique sources, which cover 1152 degrees$^{2}$ (2.85\%) of the sky. Filtering 4XMM-DR9 to retain only the cleanest sources with at least a 5 $\sigma$ detection significance leaves 433612 detections. Of these detections, 99.6\% have no pileup. Furthermore, 336 columns of information on each detection are provided, along with images. The quality of the source detection is shown to have improved significantly with respect to previous versions of the catalogues. Spectra and lightcurves are also made available for more than 288000 of the brightest sources (36\% of all detections).


title: An interpretation of dependent type theory in a model category of locally cartesian closed categories

abstract: Locally cartesian closed (lcc) categories are natural categorical models of extensional dependent type theory. This paper introduces the "gros" semantics in the category of lcc categories: Instead of constructing an interpretation in a given individual lcc category, we show that also the category of all lcc categories can be endowed with the structure of a model of dependent type theory. The original interpretation in an individual lcc category can then be recovered by slicing. As in the original interpretation, we face the issue of coherence: Categorical structure is usually preserved by functors only up to isomorphism, whereas syntactic substitution commutes strictly with all type theoretic structure. Our solution involves a suitable presentation of the higher category of lcc categories as model category. To that end, we construct a model category of lcc sketches, from which we obtain by the formalism of algebraically (co)fibrant objects model categories of strict lcc categories and then algebraically cofibrant strict lcc categories. The latter is our model of dependent type theory.


title: Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networks

abstract: We present Wiki-CS, a novel dataset derived from Wikipedia for benchmarking Graph Neural Networks. The dataset consists of nodes corresponding to Computer Science articles, with edges based on hyperlinks and 10 classes representing different branches of the field. We use the dataset to evaluate semi-supervised node classification and single-relation link prediction models. Our experiments show that these methods perform well on a new domain, with structural properties different from earlier benchmarks. The dataset is publicly available, along with the implementation of the data pipeline and the benchmark experiments, at https://github.com/pmernyei/wiki-cs-dataset .


title: RapidBrachyMCTPS 2.0: A Comprehensive and Flexible Monte Carlo-Based Treatment Planning System for Brachytherapy Applications

abstract: We have previously described RapidBrachyMCTPS, a brachytherapy treatment planning toolkit consisting of a graphical user interface (GUI) and a Geant4-based Monte Carlo (MC) dose calculation engine. This work describes the tools that have recently been added to RapidBrachyMCTPS, such that it now serves as the first stand-alone application for MC-based brachytherapy treatment planning. Notable changes include updated applicator import and positioning, three-plane contouring tools, and updated dose optimization algorithms that, in addition to optimizing dwell position and dwell time, also optimize the rotating shield angles in intensity modulated brachytherapy. The main modules of RapidBrachyMCTPS were validated including DICOM import, applicator import and positioning, contouring, material assignment, source specification, catheter reconstruction, EGSphant generation, interface with the MC code, and dose optimization and analysis tools. Two patient cases were simulated to demonstrate these principles, illustrating the control and flexibility offered by RapidBrachyMCTPS for all steps of the treatment planning pathway. RapidBrachyMCTPS is now a stand-alone application for brachytherapy treatment planning, and offers a user-friendly interface to access powerful MC calculations. It can be used to validate dose distributions from clinical treatment planning systems or model-based dose calculation algorithms, and is also well suited to testing novel combinations of radiation sources and applicators, especially those shielded with high-Z materials.


title: Searching for missing D'Alembert waves in nonlinear system: Nizhnik-Novikov-Veselov equation

abstract: In linear science, the wave motion equation with general D'Alembert wave solutions is one of the fundamental models. The D'Alembert wave is an arbitrary travelling wave moving along one direction under a fixed model (material) dependent velocity. However, the D'Alembert waves are missed when nonlinear effects are introduced to wave motions. In this paper, we study the possible travelling wave solutions, multiple soliton solutions and soliton molecules for a special (2+1)-dimensional Koteweg-de Vries (KdV) equation, the so-called Nizhnik-Novikov-Veselov (NNV) equation. The missed D'Alembert wave is re-discovered from the NNV equation. By using the velocity resonance mechanism, the soliton molecules are found to be closely related to D'Alembert waves. In fact, the soliton molecules of the NNV equation can be viewed as special D'Alembert waves. The interaction solutions among special D'Alembert type waves ($n$-soliton molecules and soliton-solitoff molecules) and solitons are also discussed.


title: On the minmax regret for statistical manifolds: the role of curvature

abstract: Model complexity plays an essential role in its selection, namely, by choosing a model that fits the data and is also succinct. Two-part codes and the minimum description length have been successful in delivering procedures to single out the best models, avoiding overfitting. In this work, we pursue this approach and complement it by performing further assumptions in the parameter space. Concretely, we assume that the parameter space is a smooth manifold, and by using tools of Riemannian geometry, we derive a sharper expression than the standard one given by the stochastic complexity, where the scalar curvature of the Fisher information metric plays a dominant role. Furthermore, we derive the minmax regret for general statistical manifolds and apply our results to derive optimal dimensional reduction in the context of principal component analysis.

categories: math.ST cs.IT math.DG math.IT physics.data-an quant-ph stat.TH


title: Optimization of Scoring Rules

abstract: This paper introduces an objective for optimizing proper scoring rules. The objective is to maximize the increase in payoff of a forecaster who exerts a binary level of effort to refine a posterior belief from a prior belief. In this framework we characterize optimal scoring rules in simple settings, give efficient algorithms for computing optimal scoring rules in complex settings, and identify simple scoring rules that are approximately optimal. In comparison, standard scoring rules in theory and practice -- for example the quadratic rule, scoring rules for the expectation, and scoring rules for multiple tasks that are averages of single-task scoring rules -- can be very far from optimal.


title: Compact representation of temporal processes in echosounder time series via matrix decomposition

abstract: The recent explosion in the availability of echosounder data from diverse ocean platforms has created unprecedented opportunities to observe the marine ecosystems at broad scales. However, the critical lack of methods capable of automatically discovering and summarizing prominent spatio-temporal echogram structures has limited the effective and wider use of these rich datasets. To address this challenge, we develop a data-driven methodology based on matrix decomposition that builds compact representation of long-term echosounder time series using intrinsic features in the data. In a two-stage approach, we first remove noisy outliers from the data by Principal Component Pursuit, then employ a temporally smooth Nonnegative Matrix Factorization to automatically discover a small number of distinct daily echogram patterns, whose time-varying linear combination (activation) reconstructs the dominant echogram structures. This low-rank representation provides biological information that is more tractable and interpretable than the original data, and is suitable for visualization and systematic analysis with other ocean variables. Unlike existing methods that rely on fixed, handcrafted rules, our unsupervised machine learning approach is well-suited for extracting information from data collected from unfamiliar or rapidly changing ecosystems. This work forms the basis for constructing robust time series analytics for large-scale, acoustics-based biological observation in the ocean.


title: Including Image-based Perception in Disturbance Observer for Warehouse Drones

abstract: Grasping and releasing objects would cause oscillations to delivery drones in the warehouse. To reduce such undesired oscillations, this paper treats the to-be-delivered object as an unknown external disturbance and presents an image-based disturbance observer (DOB) to estimate and reject such disturbance. Different from the existing DOB technique that can only compensate for the disturbance after the oscillations happen, the proposed image-based one incorporates image-based disturbance prediction into the control loop to further improve the performance of the DOB. The proposed image-based DOB consists of two parts. The first one is deep-learning-based disturbance prediction. By taking an image of the to-be-delivered object, a sequential disturbance signal is predicted in advance using a connected pre-trained convolutional neural network (CNN) and a long short-term memory (LSTM) network. The second part is a conventional DOB in the feedback loop with a feedforward correction, which utilizes the deep learning prediction to generate a learning signal. Numerical studies are performed to validate the proposed image-based DOB regarding oscillation reduction for delivery drones during the grasping and releasing periods of the objects.


title: Laser-induced stress wave propagation through smooth and rough substrates

abstract: We investigate laser-induced acoustic wave propagation through smooth and roughened titanium-coated glass substrates. Acoustic waves are generated in a controlled manner via the laser spallation technique. Surface displacements are measured during stress wave loading by alignment of a Michelson-type interferometer. A reflective coverslip panel facilitates capture of surface displacements during loading of as-received smooth and roughened specimens. Through interferometric experiments we extract the substrate stress profile at each laser fluence (energy per area). The shape and amplitude of the substrate stress profile is analyzed at each laser fluence. Peak substrate stress is averaged and compared between smooth specimens with reflective panel and rough specimens with reflective panel. The reflective panel is necessary because the surface roughness of the rough specimens precludes in situ interferometry. Through these experiments we determine that the surface roughness employed has no significant effect on substrate stress propagation and smooth substrates are an appropriate surrogate to determine stress wave loading amplitude of roughened surfaces less than 1.2 {\mu}m average roughness (Ra). No significant difference was observed when comparing the average peak amplitude and loading slope in the stress wave profile for the smooth and rough configurations at each fluence.


title: The spontaneous symmetry breaking in Ta$_2$NiSe$_5$ is structural in nature

abstract: The excitonic insulator is an electronically-driven phase of matter that emerges upon the spontaneous formation and Bose condensation of excitons. Detecting this exotic order in candidate materials is a subject of paramount importance, as the size of the excitonic gap in the band structure establishes the potential of this collective state for superfluid energy transport. However, the identification of this phase in real solids is hindered by the coexistence of a structural order parameter with the same symmetry as the excitonic order. Only a few materials are currently believed to host a dominant excitonic phase, Ta$_2$NiSe$_5$ being the most promising. Here, we test this scenario by using an ultrashort laser pulse to quench the broken-symmetry phase of this transition metal chalcogenide. Tracking the dynamics of the material's electronic and crystal structure after light excitation reveals surprising spectroscopic fingerprints that are only compatible with a primary order parameter of phononic nature. We rationalize our findings through state-of-the-art calculations, confirming that the structural order accounts for most of the electronic gap opening. Not only do our results uncover the long-sought mechanism driving the phase transition of Ta$_2$NiSe$_5$, but they also conclusively rule out any substantial excitonic character in this instability.


title: A Weighted Randomized Kaczmarz Method for Solving Linear Systems

abstract: The Kaczmarz method for solving a linear system $Ax = b$ interprets such a system as a collection of equations $\left\langle a_i, x\right\rangle = b_i$, where $a_i$ is the $i-$th row of $A$, then picks such an equation and corrects $x_{k+1} = x_k + \lambda a_i$ where $\lambda$ is chosen so that the $i-$th equation is satisfied. Convergence rates are difficult to establish. Assuming the rows to be normalized, $\|a_i\|_{\ell^2}=1$, Strohmer \& Vershynin established that if the order of equations is chosen at random, $\mathbb{E}~ \|x_k - x\|_{\ell^2}$ converges exponentially. We prove that if the $i-$th row is selected with likelihood proportional to $\left|\left\langle a_i, x_k \right\rangle - b_i\right|^{p}$, where $0<p<\infty$, then $\mathbb{E}~\|x_k - x\|_{\ell^2}$ converges faster than the purely random method. As $p \rightarrow \infty$, the method de-randomizes and explains, among other things, why the maximal correction method works well. We empirically observe that the method computes approximations of small singular vectors of $A$ as a byproduct.


title: On LTL Model Checking for Low-Dimensional Discrete Linear Dynamical Systems

abstract: Consider a discrete dynamical system given by a square matrix $M \in \mathbb{Q}^{d \times d}$ and a starting point $s \in \mathbb{Q}^d$. The orbit of such a system is the infinite trajectory $\langle s, Ms, M^2s, \ldots\rangle$. Given a collection $T_1, T_2, \ldots, T_m \subseteq \mathbb{R}^d$ of semialgebraic sets, we can associate with each $T_i$ an atomic proposition $P_i$ which evaluates to true at time $n$ if, and only if, $M^ns \in T_i$. This gives rise to the LTL Model-Checking Problem for discrete linear dynamical systems: given such a system $(M,s)$ and an LTL formula over such atomic propositions, determine whether the orbit satisfies the formula. The main contribution of the present paper is to show that the LTL Model-Checking Problem for discrete linear dynamical systems is decidable in dimension 3 or less.


title: Meta-Learning Divergences of Variational Inference

abstract: Variational inference (VI) plays an essential role in approximate Bayesian inference due to its computational efficiency and broad applicability. Crucial to the performance of VI is the selection of the associated divergence measure, as VI approximates the intractable distribution by minimizing this divergence. In this paper we propose a meta-learning algorithm to learn the divergence metric suited for the task of interest, automating the design of VI methods. In addition, we learn the initialization of the variational parameters without additional cost when our method is deployed in the few-shot learning scenarios. We demonstrate our approach outperforms standard VI on Gaussian mixture distribution approximation, Bayesian neural network regression, image generation with variational autoencoders and recommender systems with a partial variational autoencoder.


title: Determinantal Expressions in Multi-Species TASEP

abstract: Consider an inhomogeneous multi-species TASEP with drift to the left, and define a height function which equals the maximum species number to the left of a lattice site. For each fixed time, the multi-point distributions of these height functions have a determinantal structure. In the homogeneous case and for certain initial conditions, the fluctuations of the height function converge to Gaussian random variables in the large-time limit. The proof utilizes a coupling between the multi-species TASEP and a coalescing random walk, and previously known results for coalescing random walks.


title: Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network Embedding

abstract: We study the problem of node classification on graphs with few-shot novel labels, which has two distinctive properties: (1) There are novel labels to emerge in the graph; (2) The novel labels have only a few representative nodes for training a classifier. The study of this problem is instructive and corresponds to many applications such as recommendations for newly formed groups with only a few users in online social networks. To cope with this problem, we propose a novel Meta Transformed Network Embedding framework (MetaTNE), which consists of three modules: (1) A \emph{structural module} provides each node a latent representation according to the graph structure. (2) A \emph{meta-learning module} captures the relationships between the graph structure and the node labels as prior knowledge in a meta-learning manner. Additionally, we introduce an \emph{embedding transformation function} that remedies the deficiency of the straightforward use of meta-learning. Inherently, the meta-learned prior knowledge can be used to facilitate the learning of few-shot novel labels. (3) An \emph{optimization module} employs a simple yet effective scheduling strategy to train the above two modules with a balance between graph structure learning and meta-learning. Experiments on four real-world datasets show that MetaTNE brings a huge improvement over the state-of-the-art methods.


title: Are Labels Always Necessary for Classifier Accuracy Evaluation?

abstract: To calculate the model accuracy on a computer vision task, e.g., object recognition, we usually require a test set composing of test samples and their ground truth labels. Whilst standard usage cases satisfy this requirement, many real-world scenarios involve unlabeled test data, rendering common model evaluation methods infeasible. We investigate this important and under-explored problem, Automatic model Evaluation (AutoEval). Specifically, given a labeled training set and a classifier, we aim to estimate the classification accuracy on unlabeled test datasets. We construct a meta-dataset: a dataset comprised of datasets generated from the original images via various transformations such as rotation, background substitution, foreground scaling, etc. As the classification accuracy of the model on each sample (dataset) is known from the original dataset labels, our task can be solved via regression. Using the feature statistics to represent the distribution of a sample dataset, we can train regression models (e.g., a regression neural network) to predict model performance. Using synthetic meta-dataset and real-world datasets in training and testing, respectively, we report a reasonable and promising prediction of the model accuracy. We also provide insights into the application scope, limitation, and potential future direction of AutoEval.


title: On the Asymptotic Linear Convergence Speed of Anderson Acceleration Applied to ADMM

abstract: Empirical results show that Anderson acceleration (AA) can be a powerful mechanism to improve the asymptotic linear convergence speed of the Alternating Direction Method of Multipliers (ADMM) when ADMM by itself converges linearly. However, theoretical results to quantify this improvement do not exist yet. In this paper we explain and quantify this improvement in linear asymptotic convergence speed for the special case of a stationary version of AA applied to ADMM. We do so by considering the spectral properties of the Jacobians of ADMM and the stationary version of AA evaluated at the fixed point, where the coefficients of the stationary AA method are computed such that its asymptotic linear convergence factor is optimal. The optimal linear convergence factors of this stationary AA-ADMM method are computed analytically or by optimization, based on previous work on optimal stationary AA acceleration. Using this spectral picture and those analytical results, our approach provides new insight into how and by how much the stationary AA method can improve the asymptotic linear convergence factor of ADMM. Numerical results also indicate that the optimal linear convergence factor of the stationary AA methods gives a useful estimate for the asymptotic linear convergence speed of the non-stationary AA method that is used in practice.