title: Diagnosing and Remedying Shot Sensitivity with Cosine Few-Shot Learners

abstract: Few-shot recognition involves training an image classifier to distinguish novel concepts at test time using few examples (shot). Existing approaches generally assume that the shot number at test time is known in advance. This is not realistic, and the performance of a popular and foundational method has been shown to suffer when train and test shots do not match. We conduct a systematic empirical study of this phenomenon. In line with prior work, we find that shot sensitivity is broadly present across metric-based few-shot learners, but in contrast to prior work, larger neural architectures provide a degree of built-in robustness to varying test shot. More importantly, a simple, previously known but greatly overlooked class of approaches based on cosine distance consistently and greatly improves robustness to shot variation, by removing sensitivity to sample noise. We derive cosine alternatives to popular and recent few-shot classifiers, broadening their applicability to realistic settings. These cosine models consistently improve shot-robustness, outperform prior shot-robust state of the art, and provide competitive accuracy on a range of benchmarks and architectures, including notable gains in the very-low-shot regime.


title: Notes on the arithmetic of Hecke L-functions

abstract: This is an expository article that concerns the various related notions of algebraic idele class characters, the Groessencharaktere of Hecke, and cohomological automorphic representations of GL(1), all under the general title of algebraic Hecke characters. The first part of the article systematically lays the foundations of algebraic Hecke characters. The only pre-requisites are: basic algebraic number theory, familiarity with the adelic language, and basic sheaf theory. Observations that play a crucial role in the arithmetic of automorphic L-functions are also discussed. The second part of the article, on the ratios of successive critical values of the Hecke L-function attached to an algebraic Hecke character, concerns certain variations on a theorem of Guenter Harder, especially drawing attention to a delicate signature that apparently has not been noticed before.


title: On the Relationship Between Adversarial Robustness and Decision Region in Deep Neural Network

abstract: In general, Deep Neural Networks (DNNs) are evaluated by the generalization performance measured on unseen data excluded from the training phase. Along with the development of DNNs, the generalization performance converges to the state-of-the-art and it becomes difficult to evaluate DNNs solely based on this metric. The robustness against adversarial attack has been used as an additional metric to evaluate DNNs by measuring their vulnerability. However, few studies have been performed to analyze the adversarial robustness in terms of the geometry in DNNs. In this work, we perform an empirical study to analyze the internal properties of DNNs that affect model robustness under adversarial attacks. In particular, we propose the novel concept of the Populated Region Set (PRS), where training samples are populated more frequently, to represent the internal properties of DNNs in a practical setting. From systematic experiments with the proposed concept, we provide empirical evidence to validate that a low PRS ratio has a strong relationship with the adversarial robustness of DNNs. We also devise PRS regularizer leveraging the characteristics of PRS to improve the adversarial robustness without adversarial training.


title: Minimum $2$-edge strongly biconnected spanning directed subgraph problem

abstract: Wu and Grumbach introduced the concept of strongly biconnected directed graphs. A directed graph $G=(V,E)$ is called strongly biconnected if the directed graph $G$ is strongly connected and the underlying undirected graph of $G$ is biconnected. A strongly biconnected directed graph $G=(V,E)$ is said to be $2$- edge strongly biconnected if it has at least three vertices and the directed subgraph $(V,E\setminus\left\lbrace e\right\rbrace )$ is strongly biconnected for all $e \in E$. Let $G=(V,E)$ be a $2$-edge-strongly biconnected directed graph. In this paper we study the problem of computing a minimum size subset $H \subseteq E$ such that the directed subgraph $(V,H)$ is $2$- edge strongly biconnected.


title: Scoped Capabilities for Polymorphic Effects

abstract: Type systems usually characterize the shape of values but not their free variables. However, many desirable safety properties could be guaranteed if one knew the free variables captured by values. We describe CCsubBox, a calculus where such captured variables are succinctly represented in types, and show it can be used to safely implement effects and effect polymorphism via scoped capabilities. We discuss how the decision to track captured variables guides key aspects of the calculus, and show that CCsubBox admits simple and intuitive types for common data structures and their typical usage patterns. We demonstrate how these ideas can be used to guide the implementation of capture checking in a practical programming language.


title: On the design and analysis of near-term quantum network protocols using Markov decision processes

abstract: The quantum internet is one of the frontiers of quantum information science research. It will revolutionize the way we communicate and do other tasks, and it will allow for tasks that are not possible using the current, classical internet. The backbone of a quantum internet is entanglement distributed globally in order to allow for such novel applications to be performed over long distances. Experimental progress is currently being made to realize quantum networks on a small scale, but much theoretical work is still needed in order to understand how best to distribute entanglement, especially with the limitations of near-term quantum technologies taken into account. This work provides an initial step towards this goal. In this work, we lay out a theory of near-term quantum networks based on Markov decision processes (MDPs), and we show that MDPs provide a precise and systematic mathematical framework to model protocols for near-term quantum networks that is agnostic to the specific implementation platform. We start by simplifying the MDP for elementary links introduced in prior work, and by providing new results on policies for elementary links. In particular, we show that the well-known memory-cutoff policy is optimal. Then we show how the elementary link MDP can be used to analyze a quantum network protocol in which we wait for all elementary links to be active before creating end-to-end links. We then provide an extension of the MDP formalism to two elementary links, which is useful for analyzing more sophisticated quantum network protocols. Here, as new results, we derive linear programs that give us optimal steady-state policies with respect to the expected fidelity and waiting time of the end-to-end link.


title: The Quantum Approximate Optimization Algorithm performance with low entanglement and high circuit depth

abstract: Variational quantum algorithms constitute one of the most widespread methods for using current noisy quantum computers. However, it is unknown if these heuristic algorithms provide any quantum-computational speedup, although we cannot simulate them classically for intermediate sizes. Since entanglement lies at the core of quantum computing power, we investigate its role in these heuristic methods for solving optimization problems. In particular, we use matrix product states to simulate the quantum approximate optimization algorithm with reduced bond dimensions $D$, a parameter bounding the system entanglement. Moreover, we restrict the simulation further by deterministically sampling solutions. We conclude that entanglement plays a minor role in the MaxCut and Exact Cover 3 problems studied here since the simulated algorithm analysis, with up to $60$ qubits and $p=100$ algorithm layers, shows that it provides solutions for bond dimension $D \approx 10$ and depth $p \approx 30$. Additionally, we study the classical optimization loop in the approximated algorithm simulation with $12$ qubits and depth up to $p=4$ and show that the approximated optimal parameters with low entanglement approach the exact ones.


title: Investigating the Effects of Mood & Usage Behaviour on Notification Response Time

abstract: Notifications are one of the most prevailing mechanisms on smartphones and personal computers to convey timely and important information. Despite these benefits, smartphone notifications demand individuals' attention and can cause stress and frustration when delivered at inopportune timings. This paper investigates the effect of individuals' smartphone usage behavior and mood on notification response time. We conduct an in-the-wild study with more than 18 participants for five weeks. Extensive experiment results show that the proposed regression model is able to accurately predict the response time of smartphone notifications using current user's mood and physiological signals. We explored the effect of different features for each participant to choose the most important user-oriented features in order to to achieve a meaningful and personalised notification response prediction. On average, our regression model achieved over all participants an MAE of 0.7764 ms and RMSE of 1.0527 ms. We also investigate how physiological signals (collected from E4 wristbands) are used as an indicator for mood and discuss the individual differences in application usage and categories of smartphone applications on the response time of notifications. Our research sheds light on the future intelligent notification management system.


title: Neural Stein critics with staged $L^2$-regularization

abstract: Learning to differentiate model distributions from observed data is a fundamental problem in statistics and machine learning, and high-dimensional data remains a challenging setting for such problems. Metrics that quantify the disparity in probability distributions, such as the Stein discrepancy, play an important role in high-dimensional statistical testing. In this paper, we investigate the role of $L^2$ regularization in training a neural network Stein critic so as to distinguish between data sampled from an unknown probability distribution and a nominal model distribution. Making a connection to the Neural Tangent Kernel (NTK) theory, we develop a novel staging procedure for the weight of regularization over training time, which leverages the advantages of highly-regularized training at early times. Theoretically, we prove the approximation of the training dynamic by the kernel optimization, namely the ``lazy training'', when the $L^2$ regularization weight is large, and training on $n$ samples converge at a rate of ${O}(n^{-1/2})$ up to a log factor. The result guarantees learning the optimal critic assuming sufficient alignment with the leading eigen-modes of the zero-time NTK. The benefit of the staged $L^2$ regularization is demonstrated on simulated high dimensional data and an application to evaluating generative models of image data.


title: Observation of low-field Feshbach resonances between $^{161}$Dy and $^{40}$K

abstract: We report on the observation of Feshbach resonances at low magnetic field strength (below 10 G) in the Fermi-Fermi mixture of $^{161}$Dy and $^{40}$K. We characterize five resonances by measurements of interspecies thermalization rates and molecular binding energies. As a case of particular interest for applications, we consider a resonance near 7.29 G, which combines accurate magnetic tunability and access to the universal regime of interactions with experimental simplicity. We show that lifetimes of a few 100 ms can be achieved for the optically trapped, resonantly interacting mixture. We also demonstrate the hydrodynamic expansion of the mixture in the strongly interacting regime and the formation of DyK Feshbach molecules. Our work opens up new experimental possibilities in view of mass-imbalanced superfluids and related phenomena.


title: Representation Learning in Continuous-Time Dynamic Signed Networks

abstract: Signed networks allow us to model conflicting relationships and interactions, such as friend/enemy and support/oppose. These signed interactions happen in real-time. Modeling such dynamics of signed networks is crucial to understanding the evolution of polarization in the network and enabling effective prediction of the signed structure (i.e., link signs and signed weights) in the future. However, existing works have modeled either (static) signed networks or dynamic (unsigned) networks but not dynamic signed networks. Since both sign and dynamics inform the graph structure in different ways, it is non-trivial to model how to combine the two features. In this work, we propose a new Graph Neural Network (GNN)-based approach to model dynamic signed networks, named SEMBA: Signed link's Evolution using Memory modules and Balanced Aggregation. Here, the idea is to incorporate the signs of temporal interactions using separate modules guided by balance theory and to evolve the embeddings from a higher-order neighborhood. Experiments on 4 real-world datasets and 4 different tasks demonstrate that SEMBA consistently and significantly outperforms the baselines by up to $80\%$ on the tasks of predicting signs of future links while matching the state-of-the-art performance on predicting the existence of these links in the future. We find that this improvement is due specifically to the superior performance of SEMBA on the minority negative class.


title: Robust Watermarking for Video Forgery Detection with Improved Imperceptibility and Robustness

abstract: Videos are prone to tampering attacks that alter the meaning and deceive the audience. Previous video forgery detection schemes find tiny clues to locate the tampered areas. However, attackers can successfully evade supervision by destroying such clues using video compression or blurring. This paper proposes a video watermarking network for tampering localization. We jointly train a 3D-UNet-based watermark embedding network and a decoder that predicts the tampering mask. The perturbation made by watermark embedding is close to imperceptible. Considering that there is no off-the-shelf differentiable video codec simulator, we propose to mimic video compression by ensembling simulation results of other typical attacks, e.g., JPEG compression and blurring, as an approximation. Experimental results demonstrate that our method generates watermarked videos with good imperceptibility and robustly and accurately locates tampered areas within the attacked version.


title: On Weak Lensing Response Functions

abstract: We introduce the response function (RFs) approach to model the weak lensing statistics in the context of separate universe formalism. Numerical results for the RFs are presented for various semi-analytical models that include perturbative modelling and variants of halo models. These results extend the recent studies of the Integrated Bispectrum (IB) and Trispectrum to arbitrary order. We find that due to the line-of-sight (los) projection effects, the expressions for RFs are not identical to the squeezed correlation functions of the same order. We compute the RFs in three-dimensions (3D) using the spherical Fourier-Bessel (sFB) formalism which provides a natural framework for incorporating photometric redshifts, and relate these expressions to tomographic and projected statistics. We generalise the concept of $k$-cut power spectrum to $k$-cut response functions. In addition to the response function for high-order spectra, we also define their counterparts in real space, since they are easier to estimate from surveys with low sky-coverage and non-trivial survey boundaries.


title: VecGAN: Image-to-Image Translation with Interpretable Latent Directions

abstract: We propose VecGAN, an image-to-image translation framework for facial attribute editing with interpretable latent directions. Facial attribute editing task faces the challenges of precise attribute editing with controllable strength and preservation of the other attributes of an image. For this goal, we design the attribute editing by latent space factorization and for each attribute, we learn a linear direction that is orthogonal to the others. The other component is the controllable strength of the change, a scalar value. In our framework, this scalar can be either sampled or encoded from a reference image by projection. Our work is inspired by the latent space factorization works of fixed pretrained GANs. However, while those models cannot be trained end-to-end and struggle to edit encoded images precisely, VecGAN is end-to-end trained for image translation task and successful at editing an attribute while preserving the others. Our extensive experiments show that VecGAN achieves significant improvements over state-of-the-arts for both local and global edits.


title: Estimation of Galactic Spiral Density Wave Parameters Based on the Velocities of OB2 stars from the Gaia EDR3 Catalogue

abstract: We have analyzed the kinematics of 9750 OB2 stars with proper motions and parallaxes selected by Xu et al. from the Gaia EDR3 catalogue. The relative parallax errors for these stars do not exceed 10\%. Based on the entire sample of stars, we have found the velocities $(U,V)_\odot=(7.17,7.37)\pm(0.16,0.24)$ km s$^{-1}$ and the components of the angular velocity of Galactic rotation: $\Omega_0 =29.700\pm0.076$ km s$^{-1}$ kpc$^{-1}$, $\Omega^{'}_0 =-4.008\pm0.022$ km s$^{-1}$ kpc$^{-2}$, and $\Omega^{''}_0 = 0.671\pm0.011$ km s$^{-1}$ kpc$^{-3}$, where the linear rotation velocity of the Galaxy at the solar distance is $V_0=240.6\pm3.0$ km s$^{-1}$ for the adopted $R_0=8.1\pm0.1$ kpc. There are 1812 OB2 stars with measured line-of-sight velocities, and the space velocities $V_R$ and $\Delta V_{circ}$ have been calculated from them. Based on a spectral analysis independently for the radial and residual tangential velocities, we have obtained the following estimates: $f_R=4.8\pm0.7$ km s$^{-1}$, $f_\theta=4.1\pm0.9$ km s$^{-1}$, $\lambda_R=2.1\pm0.2$ kpc, $\lambda_\theta=2.2\pm0.4$ kpc, $(\chi_\odot)_R=-116\pm12^\circ$, and $(\chi_\odot)_\theta=-156\pm14^\circ$ for the adopted four-armed ($m = 4$) spiral pattern. Thus, both velocity perturbation amplitudes are nonzero at a high significance level.


title: Identification based on random coding

abstract: Ahlswede and Dueck showed possibility to identify with high probability one out of $M$ messages by transmitting $1/C\log\log M$ bits only, where $C$ is the channel capacity. It is known that this identification can be based on error-correcting codes. We propose an identification procedure based on random codes that achieves channel capacity. Then we show that this procedure can be simplified using pseudo-random generators.


title: Domain Knowledge Driven 3D Dose Prediction Using Moment-Based Loss Function

abstract: Dose volume histogram (DVH) metrics are widely accepted evaluation criteria in the clinic. However, incorporating these metrics into deep learning dose prediction models is challenging due to their non-convexity and non-differentiability. We propose a novel moment-based loss function for predicting 3D dose distribution for the challenging conventional lung intensity modulated radiation therapy (IMRT) plans. The moment-based loss function is convex and differentiable and can easily incorporate DVH metrics in any deep learning framework without computational overhead. The moments can also be customized to reflect the clinical priorities in 3D dose prediction. For instance, using high-order moments allows better prediction in high-dose areas for serial structures. We used a large dataset of 360 conventional lung patients with 2Gy $\times$ 30 fractions to train the deep learning (DL) model using clinically treated plans. We trained a UNet-like CNN architecture using computed tomography (CT), planning target volume (PTV) and organ-at-risk contours (OAR) as input to infer corresponding voxel-wise 3D dose distribution. We evaluated three different loss functions: (1) Mean Absolute Error (MAE) Loss, (2) MAE + DVH Loss, and (3) the proposed MAE + Moments Loss. The quality of the predictions was compared using different DVH metrics as well as dose-score and DVH-score, recently introduced by the AAPM knowledge-based planning grand challenge. Model with (MAE + Moment) loss function outperformed the model with MAE loss by significantly improving the DVH-score (11%, p$<$0.01) while having similar computational cost. It also outperformed the model trained with (MAE+DVH) by significantly improving the computational cost (48%) and the DVH-score (8%, p$<$0.01). The code, models, docker container, and Google Colab project are available on our DoseRTX GitHub (https://github.com/nadeemlab/DoseRTX).


title: Asymptotics for minimizers of a Donaldson functional and mean curvature 1-immersions of surfaces into hyperbolic 3-manifolds

abstract: It has been shown in by Huang-Lucia-Tarantello [17] that, for given $\vert c \vert <1$, the moduli space of constant mean curvature (CMC) $c$-immersions of a closed orientable surface of genus $\mathfrak{g} \geq 2$ into a hyperbolic $3$-manifold can be parametrized by elements of the tangent bundle of the corresponding Teichm\"uller space. This is attained by showing the unique solvability of the Gauss-Codazzi equations governing (CMC) c-immersions. The corresponding unique solution is identified as the global minimum (and only critical point) of the Donaldson functional $D_t$ (introduced in [11]) given in (1.3) with $t=1-c^{2}$. When $\vert c \vert \geq 1$ (i.e. $t\leq 0$), so far nothing is known about the existence of analogous (CMC) c-immersions. Indeed, for $t\leq 0$ the functional $D_{t}$ may no longer be bounded from below and evident non-existence situations do occur. Already the case $\vert c \vert =1$ (i.e. $t=0$) appears rather involved and actually (CMC) 1-immersions can be attained only as "limits" of (CMC) c-immersions for $\vert c \vert \longrightarrow 1^{-}$. To handle this situation, here we analyse the asymptotic behaviour of minimizers of $D_{t}$ as $t \longrightarrow 0^{+}$. We use an accurate asymptotic analysis to describe possible blow-up phenomena. In this way, we can relate the existence of (CMC) 1-immersions to the Kodaira map. As a consequence, we obtain the first existence and uniqueness result about (CMC) 1-immersions of surfaces of genus $\mathfrak{g}=2$ into hyperbolic 3-manifolds.


title: Onsager's Conjecture for Subgrid Scale $\alpha$-Models of Turbulence

abstract: The first half of Onsager's conjecture states that the Euler equations of an ideal incompressible fluid conserve energy if $u (\cdot ,t) \in C^{0, \theta} (\mathbb{T}^3)$ with $\theta > \frac{1}{3}$. In this paper, we prove an analogue of Onsager's conjecture for several subgrid scale $\alpha$-models of turbulence. In particular we find the required H\"older regularity of the solutions that ensures the conservation of energy-like quantities (either the $H^1 (\mathbb{T}^3)$ or $L^2 (\mathbb{T}^3)$ norms) for these models. We establish such results for the Leray-$\alpha$ model, the Euler-$\alpha$ equations (also known as the inviscid Camassa-Holm equations or Lagrangian averaged Euler equations), the modified Leray-$\alpha$ model, the Clark-$\alpha$ model and finally the magnetohydrodynamic Leray-$\alpha$ model. In a sense, all these models are inviscid regularisations of the Euler equations; and formally converge to the Euler equations as the regularisation length scale $\alpha \rightarrow 0^+$. Different H\"older exponents, smaller than $1/3$, are found for the regularity of solutions of these models (they are also formulated in terms of Besov and Sobolev spaces) that guarantee the conservation of the corresponding energy-like quantity. This is expected due to the smoother nonlinearity compared to the Euler equations. These results form a contrast to the universality of the $1/3$ Onsager exponent found for general systems of conservation laws by (Gwiazda et al., 2018; Bardos et al., 2019).


title: Millimeter wave spectrum and search for vinyl isocyanate toward Sgr B2(N) with ALMA

abstract: The interstellar detections of isocyanic acid, methyl isocyanate, and very recently also ethyl isocyanate, open the question of the possible detection of vinyl isocyanate in the interstellar medium. The aim of this study is to extend the laboratory rotational spectrum of vinyl isocyanate into the millimeter wave region and to undertake a check for its presence in the high-mass star forming region Sgr B2. The rotational spectrum of vinyl isocyanate was recorded in the frequency regions 127.5-218 and 285-330 GHz using the Prague millimeter wave spectrometer. The spectral analysis was supported by high-level quantum-chemical calculations. We assumed local thermodynamic equilibrium to compute synthetic spectra of vinyl isocyanate and to search for it in the ReMoCA survey performed with ALMA toward Sgr B2(N). We also searched for ethyl isocyanate in the same source. Accurate values for the rotational and centrifugal distortion constants are reported for the ground vibrational states of trans and cis vinyl isocyanate. We report nondetections of vinyl and ethyl isocyanate toward the main hot core of Sgr B2(N). We find that vinyl and ethyl isocyanate are at least 11 and 3 times less abundant than methyl isocyanate in this source, respectively. Although the precise formation mechanism of interstellar methyl isocyanate itself remains uncertain, we infer from existing astrochemical models that our observational upper limit for the CH3NCO:C2H5NCO ratio in Sgr B2(N) is consistent with ethyl isocyanate being formed on dust grains via the abstraction or photodissociation of an H atom from methyl isocyanate, followed by the addition of a methyl radical. The dominance of such a process for ethyl isocyanate production, combined with the absence of an analogous mechanism for vinyl isocyanate, would indicate that the ratio C2H3NCO:C2H5NCO should be rather less than unity.


title: Parallel Dual-Numbers Reverse AD

abstract: Where dual-numbers forward-mode automatic differentiation (AD) pairs each scalar value with its tangent value, dual-numbers reverse-mode AD attempts to achieve reverse AD using a similarly simple idea: by pairing each scalar value with a backpropagator function. Its correctness and efficiency on higher-order input languages have been analysed by Brunel, Mazza and Pagani, but this analysis used a custom operational semantics for which it is unclear whether it can be implemented efficiently. We take inspiration from their use of linear factoring to optimise dual-numbers reverse-mode AD to an algorithm that has the correct complexity and enjoys an efficient implementation in a standard functional language with support for mutable arrays, such as Haskell. Aside from the linear factoring ingredient, our optimisation steps consist of well-known ideas from the functional programming community. We demonstrate the use of our technique by providing a practical implementation that differentiates most of Haskell98. Where previous work on dual numbers reverse AD has required sequentialisation to construct the reverse pass, we demonstrate that we can apply our technique to task-parallel source programs and generate a task-parallel derivative computation.


title: Injectives over Leavitt path algebras of graphs with disjoint cycles

abstract: Let $K$ be any field, and let $E$ be a finite graph with the property that every vertex in $E$ is the base of at most one cycle (we say such a graph satisfies Condition (AR)). We explicitly construct the injective envelope of each simple left module over the Leavitt path algebra $L_K(E)$. The main idea girding our construction is that of a "formal power series" extension of modules, thereby developing for all graphs satisfying Condition (AR) the understanding of injective envelopes of simple modules over $L_K(E)$ achieved previously for the simple modules over the Toeplitz algebra.


title: Asymptotics, trace, and density results for weighted Dirichlet spaces defined on the halfline

abstract: We give analytic description for the completion of $C_0^\infty ( \mathbf{R}_+)$ in Dirichlet space $D^{1,p}(\mathbf{R}_+, \omega):= \{ u:\mathbf{R}_+\rightarrow \mathbf{R}: u\ \hbox{ is locally absolutely continuous on} \ \mathbf{R}_+ \ {\rm and}\ \| u^{'}\|_{L^p(\mathbf{R}_+, \omega)}<\infty \}$, for given continuous weight $\omega$, in terms of the local $B_p$ conditions due to Kufner and Opic, where $1<p<\infty$. Moreover, we propose applications of our results to: analysis of Hardy inequalities, boundary value problems, complex interpolation theory, and to derivation of new Morrey type inequalities.


title: Paradoxes for Chromonic Liquid Crystal Droplets

abstract: Chromonic liquid crystals constitute a novel lyotropic phase, whose elastic properties have so far been modeled within the classical Oseen-Frank theory, provided that the twist constant is assumed to be considerably smaller than the saddle-splay constant, in violation of one Ericksen inequality. This paper shows that paradoxical consequences follow from such a violation for droplets of these materials surrounded by an isotropic fluid. For example, tactoids with a degenerate planar anchoring simply disintegrate indefinitely in myriads of smaller ones.


title: AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognition

abstract: We present the AsNER, a named entity annotation dataset for low resource Assamese language with a baseline Assamese NER model. The dataset contains about 99k tokens comprised of text from the speech of the Prime Minister of India and Assamese play. It also contains person names, location names and addresses. The proposed NER dataset is likely to be a significant resource for deep neural based Assamese language processing. We benchmark the dataset by training NER models and evaluating using state-of-the-art architectures for supervised named entity recognition (NER) such as Fasttext, BERT, XLM-R, FLAIR, MuRIL etc. We implement several baseline approaches with state-of-the-art sequence tagging Bi-LSTM-CRF architecture. The highest F1-score among all baselines achieves an accuracy of 80.69% when using MuRIL as a word embedding method. The annotated dataset and the top performing model are made publicly available.


title: Rigidities of Isoperimetric inequality under nonnegative Ricci curvature

abstract: The sharp isoperimetric inequality for non-compact Riemannian manifolds with non-negative Ricci curvature and Euclidean volume growth has been obtained in increasing generality with different approaches in a number of contributions [arXiv:1812.05022, arXiv:2012.09490, arXiv:2009.13717, arXiv:2103.08496] culminated by Balogh and Kristaly [arXiv:2012.11862] covering also m.m.s.'s verifying the non-negative Ricci curvature condition in the synthetic sense of Lott, Sturm and Villani. In sharp contrast with the compact case of positive Ricci curvature, for a large class of spaces including weighted Riemannian manifolds, no complete characterisation of the equality cases is present in the literature. The scope of this note is to settle this problem by proving, in the same generality of [arXiv:2012.11862], that the equality in the isoperimetric inequality can be attained only by metric balls. Whenever this happens the space is forced, in a measure theoretic sense, to be a cone. Our result applies to different frameworks yielding as corollaries new rigidity results: it extend to weighted Riemannian manifold the rigidity results of [arXiv:2009.13717], it extend to general $\mathsf{RCD}$ spaces the rigidity results of [arXiv:2201.04916] and finally applies also to the Euclidean setting by proving that that optimisers in the anisotropic and weighted isoperimetric inequality for Euclidean cones are necessarily the Wulff shapes.


title: Machine Learning to Predict Aerodynamic Stall

abstract: A convolutional autoencoder is trained using a database of airfoil aerodynamic simulations and assessed in terms of overall accuracy and interpretability. The goal is to predict the stall and to investigate the ability of the autoencoder to distinguish between the linear and non-linear response of the airfoil pressure distribution to changes in the angle of attack. After a sensitivity analysis on the learning infrastructure, we investigate the latent space identified by the autoencoder targeting extreme compression rates, i.e. very low-dimensional reconstructions. We also propose a strategy to use the decoder to generate new synthetic airfoil geometries and aerodynamic solutions by interpolation and extrapolation in the latent representation learned by the autoencoder.


title: Haros graphs: an exotic representation of real numbers

abstract: This paper introduces Haros graphs, a construction which provides a graph-theoretical representation of real numbers in the unit interval reached via paths in the Farey binary tree. We show how the topological structure of Haros graphs yields a natural classification of the reals numbers into a hierarchy of families. To unveil such classification, we introduce an entropic functional on these graphs and show that it can be expressed, thanks to its fractal nature, in terms of a generalised de Rham curve. We show that this entropy reaches a global maximum at the reciprocal of the Golden number and otherwise displays a rich hierarchy of local maxima and minima that relate to specific families of irrationals (noble numbers) and rationals, overall providing an exotic classification and representation of the reals numbers according to entropic principles. We close the paper with a number of conjectures and outline a research programme on Haros graphs.

categories: math.NT cond-mat.dis-nn math.CO physics.data-an physics.soc-ph


title: Generalized Minimizing Movements for the varifold Canham-Helfrich flow

abstract: The gradient flow of the Canham-Helfrich functional is tackled via the Generalized Minimizing Movements approach. We prove the existence of solutions in Wasserstein spaces of varifolds, as well as upper and lower diameter bounds. In the more regular setting of multiply covered $C^{1,1}$ surfaces, we provide a Li-Yau-type estimate for the Canham-Helfrich energy and prove the conservation of multiplicity along the evolution.


title: Binary Iterative Hard Thresholding Converges with Optimal Number of Measurements for 1-Bit Compressed Sensing

abstract: Compressed sensing has been a very successful high-dimensional signal acquisition and recovery technique that relies on linear operations. However, the actual measurements of signals have to be quantized before storing or processing. 1(One)-bit compressed sensing is a heavily quantized version of compressed sensing, where each linear measurement of a signal is reduced to just one bit: the sign of the measurement. Once enough of such measurements are collected, the recovery problem in 1-bit compressed sensing aims to find the original signal with as much accuracy as possible. The recovery problem is related to the traditional "halfspace-learning" problem in learning theory. For recovery of sparse vectors, a popular reconstruction method from 1-bit measurements is the binary iterative hard thresholding (BIHT) algorithm. The algorithm is a simple projected sub-gradient descent method, and is known to converge well empirically, despite the nonconvexity of the problem. The convergence property of BIHT was not theoretically justified, except with an exorbitantly large number of measurements (i.e., a number of measurement greater than $\max\{k^{10}, 24^{48}, k^{3.5}/\epsilon\}$, where $k$ is the sparsity, $\epsilon$ denotes the approximation error, and even this expression hides other factors). In this paper we show that the BIHT algorithm converges with only $\tilde{O}(\frac{k}{\epsilon})$ measurements. Note that, this dependence on $k$ and $\epsilon$ is optimal for any recovery method in 1-bit compressed sensing. With this result, to the best of our knowledge, BIHT is the only practical and efficient (polynomial time) algorithm that requires the optimal number of measurements in all parameters (both $k$ and $\epsilon$). This is also an example of a gradient descent algorithm converging to the correct solution for a nonconvex problem, under suitable structural conditions.


title: SC2EGSet: StarCraft II Esport Replay and Game-state Dataset

abstract: As a relatively new form of sport, esports offers unparalleled data availability. Despite the vast amounts of data that are generated by game engines, it can be challenging to extract them and verify their integrity for the purposes of practical and scientific use. Our work aims to open esports to a broader scientific community by supplying raw and pre-processed files from StarCraft II esports tournaments. These files can be used in statistical and machine learning modeling tasks and related to various laboratory-based measurements (e.g., behavioral tests, brain imaging). We have gathered publicly available game-engine generated "replays" of tournament matches and performed data extraction and cleanup using a low-level application programming interface (API) parser library. Additionally, we open-sourced and published all the custom tools that were developed in the process of creating our dataset. These tools include PyTorch and PyTorch Lightning API abstractions to load and model the data. Our dataset contains replays from major and premiere StarCraft II tournaments since 2016. To prepare the dataset, we processed 55 tournament "replaypacks" that contained 17930 files with game-state information. Based on initial investigation of available StarCraft II datasets, we observed that our dataset is the largest publicly available source of StarCraft II esports data upon its publication. Analysis of the extracted data holds promise for further Artificial Intelligence (AI), Machine Learning (ML), psychological, Human-Computer Interaction (HCI), and sports-related studies in a variety of supervised and self-supervised tasks.


title: Subtracting glitches from gravitational-wave detector data during the third observing run

abstract: Data from ground-based gravitational-wave detectors contains numerous short-duration instrumental artifacts, called "glitches." The high rate of these artifacts in turn results in a significant fraction of gravitational-wave signals from compact binary coalescences overlapping glitches. In LIGO-Virgo's third observing run, $\approx 20\%$ of signals required some form of mitigation due to glitches. This was the first observing run that glitch subtraction was included as a part of LIGO-Virgo-KAGRA data analysis methods for a large fraction of detected gravitational-wave events. This work describes the methods to identify glitches, the decision process for deciding if mitigation was necessary, and the two algorithms, BayesWave and gwsubtract, that were used to model and subtract glitches. Through case studies of two events, GW190424_180648 and GW200129_065458, we evaluate the effectiveness of the glitch subtraction, compare the statistical uncertainties in the relevant glitch models, and identify potential limitations in these glitch subtraction methods. We finally outline the lessons learned from this first-of-its-kind effort for future observing runs.


title: A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion

abstract: Multi-modal medical image completion has been extensively applied to alleviate the missing modality issue in a wealth of multi-modal diagnostic tasks. However, for most existing synthesis methods, their inferences of missing modalities can collapse into a deterministic mapping from the available ones, ignoring the uncertainties inherent in the cross-modal relationships. Here, we propose the Unified Multi-Modal Conditional Score-based Generative Model (UMM-CSGM) to take advantage of Score-based Generative Model (SGM) in modeling and stochastically sampling a target probability distribution, and further extend SGM to cross-modal conditional synthesis for various missing-modality configurations in a unified framework. Specifically, UMM-CSGM employs a novel multi-in multi-out Conditional Score Network (mm-CSN) to learn a comprehensive set of cross-modal conditional distributions via conditional diffusion and reverse generation in the complete modality space. In this way, the generation process can be accurately conditioned by all available information, and can fit all possible configurations of missing modalities in a single network. Experiments on BraTS19 dataset show that the UMM-CSGM can more reliably synthesize the heterogeneous enhancement and irregular area in tumor-induced lesions for any missing modalities.


title: Inverse design with flexible design targets via deep learning: Tailoring of electric and magnetic multipole scattering from nano-spheres

abstract: Deep learning is a promising, ultra-fast approach for inverse design in nano-optics, but despite fast advancement of the field, the computational cost of dataset generation, as well as of the training procedure itself remains a major bottleneck. This is particularly inconvenient because new data need to be generated and a new network needs to be trained for any modification of the problem. We propose a technique that allows to train a single neural network on a broad range of design targets without any re-training. The key idea of our method is to enrich existing data with random "regions of interest" (ROI) labels. A model trained on such ROI-decorated data becomes capable to operate on a broad range of physical targets, while it learns to focus its design effort on a user-defined ROI, ignoring the rest of the physical domain. We demonstrate the method by training a tandem-network on the design of dielectric core-shell nano-spheres for electric and magnetic dipole and quadrupole scattering over a broad spectral range. The network learns to tailor very distinct, flexible design targets like scattering due to specific multipoles in narrow spectral windows. Varying the design problem does not require any re-training. Our approach is very general and can be directly used with existing datasets. It can be straightforwardly applied to other network architectures and problems.


title: Standard Model predictions for Lepton Flavour Universality ratios of inclusive semileptonic $B$ decays

abstract: We present Standard Model predictions for lepton flavour universality ratios of inclusive $B\to X_{(c)} \ell \bar\nu_\ell$. For the $\ell=\mu,e$, these ratios are very close to unity as expected. For the $\tau$ mode, we update the SM prediction for the branching ratio including power-corrections in the heavy-quark expansion up to $1/m_b^3$. These inclusive ratios serve as an important cross-check of the exclusive $B\to D^{(*)}\ell\bar\nu_\ell$ modes, in which tensions exists between the predictions and measurements in those modes.


title: Semi-supervised Object Detection via Virtual Category Learning

abstract: Due to the costliness of labelled data in real-world applications, semi-supervised object detectors, underpinned by pseudo labelling, are appealing. However, handling confusing samples is nontrivial: discarding valuable confusing samples would compromise the model generalisation while using them for training would exacerbate the confirmation bias issue caused by inevitable mislabelling. To solve this problem, this paper proposes to use confusing samples proactively without label correction. Specifically, a virtual category (VC) is assigned to each confusing sample such that they can safely contribute to the model optimisation even without a concrete label. It is attributed to specifying the embedding distance between the training sample and the virtual category as the lower bound of the inter-class distance. Moreover, we also modify the localisation loss to allow high-quality boundaries for location regression. Extensive experiments demonstrate that the proposed VC learning significantly surpasses the state-of-the-art, especially with small amounts of available labels.


title: LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discovery

abstract: Creating high-quality articulated 3D models of animals is challenging either via manual creation or using 3D scanning tools. Therefore, techniques to reconstruct articulated 3D objects from 2D images are crucial and highly useful. In this work, we propose a practical problem setting to estimate 3D pose and shape of animals given only a few (10-30) in-the-wild images of a particular animal species (say, horse). Contrary to existing works that rely on pre-defined template shapes, we do not assume any form of 2D or 3D ground-truth annotations, nor do we leverage any multi-view or temporal information. Moreover, each input image ensemble can contain animal instances with varying poses, backgrounds, illuminations, and textures. Our key insight is that 3D parts have much simpler shape compared to the overall animal and that they are robust w.r.t. animal pose articulations. Following these insights, we propose LASSIE, a novel optimization framework which discovers 3D parts in a self-supervised manner with minimal user intervention. A key driving force behind LASSIE is the enforcing of 2D-3D part consistency using self-supervisory deep features. Experiments on Pascal-Part and self-collected in-the-wild animal datasets demonstrate considerably better 3D reconstructions as well as both 2D and 3D part discovery compared to prior arts. Project page: chhankyao.github.io/lassie/


title: Sociable and Ergonomic Human-Robot Collaboration through Action Recognition and Augmented Hierarchical Quadratic Programming

abstract: The recognition of actions performed by humans and the anticipation of their intentions are important enablers to yield sociable and successful collaboration in human-robot teams. Meanwhile, robots should have the capacity to deal with multiple objectives and constraints, arising from the collaborative task or the human. In this regard, we propose vision techniques to perform human action recognition and image classification, which are integrated into an Augmented Hierarchical Quadratic Programming (AHQP) scheme to hierarchically optimize the robot's reactive behavior and human ergonomics. The proposed framework allows one to intuitively command the robot in space while a task is being executed. The experiments confirm increased human ergonomics and usability, which are fundamental parameters for reducing musculoskeletal diseases and increasing trust in automation.


title: Cavity Induced Collective Behavior in the Polaritonic Ground State

abstract: Cavity quantum electrodynamics provides an ideal platform to engineer and control light-matter interactions with polariton quasiparticles. In this work, we investigate collective phenomena in a system of many particles in a harmonic trap coupled to a homogeneous quantum cavity field. The system couples collectively to the cavity field, through its center of mass, and collective polariton states emerge. The cavity field mediates pairwise long-range interactions and enhances the effective mass of the particles. This leads to an enhancement of localization in the matter ground state density, which features a maximum when light and matter are on resonance, and demonstrates a Dicke-like, collective behavior with the particle number. The light-matter interaction also modifies the photonic properties of the polariton system, as the ground state is populated with bunched photons. In addition, it is shown that the diamagnetic $\mathbf{A}^2$ term is necessary for the stability of the system, as otherwise the superradiant ground state instability occurs. We demonstrate that coherent transfer of polaritonic population is possbile with an external magnetic field and by monitoring the Landau-Zener transition probability.


title: Robustness of kinetic screening against matter coupling

abstract: We investigate neutron star solutions in scalar-tensor theories of gravity with first-order derivative self-interactions in the action and in the matter coupling. We assess the robustness of the kinetic screening mechanism present in these theories against general conformal couplings to matter. The latter include ones leading to the classical Damour-Esposito-Far\`ese scalarization, as well as ones depending on the kinetic term of the scalar field. We find that kinetic screening always prevails over scalarization, and that kinetic couplings with matter enhance the suppression of scalar gradients inside the star even more, without relying on the non-linear regime. Fine tuning the kinetic coupling with the derivative self-interactions in the action allows one to partially cancel the latter, resulting in a weakening of kinetic screening inside the star. This effect represents a novel way to break screening mechanisms inside matter sources, and provides new signatures that might be testable with astrophysical observations.


title: Minimizing the Repayment Cost of Federal Student Loans

abstract: Federal student loans are fixed-rate debt contracts with three main special features: (i) borrowers can use income-driven schemes to make payments proportional to their income above subsistence, (ii) after several years of good standing, the remaining balance is forgiven but taxed as ordinary income, and (iii) accrued interest is simple, i.e., not capitalized. For a very small loan, the cost-minimizing repayment strategy dictates maximum payments until full repayment, forgoing both income-driven schemes and forgiveness. For a very large loan, the minimal payments allowed by income-driven schemes are optimal. For intermediate balances, the optimal repayment strategy may entail an initial period of minimum payments to exploit the non-capitalization of accrued interest, but when the principal is being reimbursed maximal payments always precede minimum payments. Income-driven schemes and simple accrued interest mostly benefit borrowers with very large balances.


title: On Aggregation Performance in Privacy Conscious Hierarchical Flexibility Coordination Schemes

abstract: In this paper we introduce a method for performance quantification of flexibility aggregation in flexibility coordination schemes (FCS), with a focus on privacy preserving hierarchical FCS. The quantification is based on two performance metrics: The aggregation error and the aggregation efficiency. We present the simulation framework and the modelling of one complex type of flexibility providing units (FPUs), namely energy storage systems (ESS). ESS cause intertemporal constraints for flexibility coordination that lead to aggregation errors in case flexibility is aggregated from heterogeneous groups of FPUs. We identify one parameter responsible for the aggregation error to be the power-to-energy ratio of the ESS. A grouping of FPUs using similarity in their power-to-energy ratios is shown to improve the coordination performance. Additionally, we describe the influence of flexibility demand timeseries on the aggregation error, concluding that future assessments of aggregation errors should consider multiple representative demand timeseries, which is a non-trivial task. Finally, we discuss the applicability of the developed method to scenarios of larger system size.


title: The isovector axial form factor of the nucleon from lattice QCD

abstract: The isovector axial form factor of the nucleon plays a key role in interpreting data from long-baseline neutrino oscillation experiments. We perform a lattice-QCD based calculation of this form factor, introducing a new method to directly extract its $z$-expansion from lattice correlators. Our final parametrization of the form factor, which extends up to spacelike virtualities of $0.7\,{\rm GeV}^2$ with fully quantified uncertainties, agrees with previous lattice calculations but is significantly less steep than neutrino-deuterium scattering data suggests.


title: The TSP with drones: The benefits of retraversing the arcs

abstract: In the Traveling Salesman Problem with Drones (TSP-mD), a truck and multiple drones cooperate to serve customers in the minimum amount of time. The drones are launched and retrieved by the truck at customer locations, and each of their flights must not consume more energy than allowed by their batteries. Most problem settings in the literature restrict the feasible truck routes to cycles, i.e., closed paths, which never visit a node more than once. Revisiting a node, however, may lower the time required to serve all the customers. Additionally, we observe that optimal solutions for the TSP-mD may retraverse arcs, i.e., optimal truck routes may contain the same arcs multiple times. We refer to such solutions as arc-retraversing, and include them in our solution space by modeling the truck route as a closed walk. We describe Euclidean instances where all the optimal solutions are arc-retraversing. The necessity of arc retraversals does not seem to have been investigated in previous studies, and those that allow node revisits seem to assume that there always exists an optimal solution without arc retraversals. We prove that under certain conditions, which are commonly met in the literature, this assumption is correct. When these conditions are not met, however, excluding arc-retraversing solutions might result in an increase of the optimal value; we identify cases where a priori and a posteriori upper bounds hold on such increase. Finally, we prove that there is no polynomial-time heuristic that can approximate the metric TSP-mD within a constant factor, unless P=NP. We identify a (non-constant) approximation factor explicitly when the truck can visit all the nodes.


title: Back to the Source: Diffusion-Driven Test-Time Adaptation

abstract: Test-time adaptation harnesses test inputs to improve the accuracy of a model trained on source data when tested on shifted target data. Existing methods update the source model by (re-)training on each target domain. While effective, re-training is sensitive to the amount and order of the data and the hyperparameters for optimization. We instead update the target data, by projecting all test inputs toward the source domain with a generative diffusion model. Our diffusion-driven adaptation method, DDA, shares its models for classification and generation across all domains. Both models are trained on the source domain, then fixed during testing. We augment diffusion with image guidance and self-ensembling to automatically decide how much to adapt. Input adaptation by DDA is more robust than prior model adaptation approaches across a variety of corruptions, architectures, and data regimes on the ImageNet-C benchmark. With its input-wise updates, DDA succeeds where model adaptation degrades on too little data in small batches, dependent data in non-uniform order, or mixed data with multiple corruptions.


title: Centrifugal Barrier and Super-Keplerian Rotation in Protostellar Disk Formation

abstract: With the advent of ALMA, it is now possible to observationally constrain how disks form around deeply embedded protostars. In particular, the recent ALMA C3H2 line observations of the nearby protostar L1527 have been interpreted as evidence for the so-called "centrifugal barrier," where the protostellar envelope infall is gradually decelerated to a stop by the centrifugal force in a region of super-Keplerian rotation. To test the concept of centrifugal barrier, which was originally based on angular momentum conserving-collapse of a rotating test particle around a fixed point mass, we carry out simple axisymmetric hydrodynamic simulations of protostellar disk formation including a minimum set of ingredients: self-gravity, rotation, and a prescribed viscosity that enables the disk to accrete. We find that a super-Keplerian region can indeed exist when the viscosity is relatively large but, unlike the classic picture of centrifugal barrier, the infalling envelope material is not decelerated solely by the centrifugal force. The region has more specific angular momentum than its surrounding envelope material, which points to an origin in outward angular momentum transport in the disk (subject to the constraint of disk expansion by the infalling envelope), rather than the spin-up of the envelope material envisioned in the classic picture as it falls closer to the center in order to conserve angular momentum. For smaller viscosities, the super-Keplerian rotation is weaker or non-existing. We conclude that, despite the existence of super-Keplerian rotation in some parameter regime, the classic picture of centrifugal barrier is not supported by our simulations.


title: Fairness and Bias in Robot Learning

abstract: Machine learning has significantly enhanced the abilities of robots, enabling them to perform a wide range of tasks in human environments and adapt to our uncertain real world. Recent works in various machine learning domains have highlighted the importance of accounting for fairness to ensure that these algorithms do not reproduce human biases and consequently lead to discriminatory outcomes. With robot learning systems increasingly performing more and more tasks in our everyday lives, it is crucial to understand the influence of such biases to prevent unintended behavior toward certain groups of people. In this work, we present the first survey on fairness in robot learning from an interdisciplinary perspective spanning technical, ethical, and legal challenges. We propose a taxonomy for sources of bias and the resulting types of discrimination due to them. Using examples from different robot learning domains, we examine scenarios of unfair outcomes and strategies to mitigate them. We present early advances in the field by covering different fairness definitions, ethical and legal considerations, and methods for fair robot learning. With this work, we aim to pave the road for groundbreaking developments in fair robot learning.


title: Differentially Private Stochastic Linear Bandits: (Almost) for Free

abstract: In this paper, we propose differentially private algorithms for the problem of stochastic linear bandits in the central, local and shuffled models. In the central model, we achieve almost the same regret as the optimal non-private algorithms, which means we get privacy for free. In particular, we achieve a regret of $\tilde{O}(\sqrt{T}+\frac{1}{\epsilon})$ matching the known lower bound for private linear bandits, while the best previously known algorithm achieves $\tilde{O}(\frac{1}{\epsilon}\sqrt{T})$. In the local case, we achieve a regret of $\tilde{O}(\frac{1}{\epsilon}{\sqrt{T}})$ which matches the non-private regret for constant $\epsilon$, but suffers a regret penalty when $\epsilon$ is small. In the shuffled model, we also achieve regret of $\tilde{O}(\sqrt{T}+\frac{1}{\epsilon})$ %for small $\epsilon$ as in the central case, while the best previously known algorithm suffers a regret of $\tilde{O}(\frac{1}{\epsilon}{T^{3/5}})$. Our numerical evaluation validates our theoretical results.


title: Polychromatic Excitation of Delocalized Long-Lived Proton Spin States in Aliphatic Chains

abstract: Long-lived states (LLS) involving pairs of magnetically inequivalent but chemically equivalent proton spins in aliphatic (CH$_2$)$_n$ chains can be excited by simultaneous application of weak selective radio-frequency (RF) fields at n chemical shifts by polychromatic spin lock induced crossing (poly-SLIC). The LLS are delocalized throughout the aliphatic chain by mixing of intrapair singlet states and by excitation of LLS comprising products of four or six spins. The measured lifetimes T$_{LLS}$ in a model compound are about 5 times longer than T1, and are strongly affected by interactions with macromolecules.


title: Learning to restore images degraded by atmospheric turbulence using uncertainty

abstract: Atmospheric turbulence can significantly degrade the quality of images acquired by long-range imaging systems by causing spatially and temporally random fluctuations in the index of refraction of the atmosphere. Variations in the refractive index causes the captured images to be geometrically distorted and blurry. Hence, it is important to compensate for the visual degradation in images caused by atmospheric turbulence. In this paper, we propose a deep learning-based approach for restring a single image degraded by atmospheric turbulence. We make use of the epistemic uncertainty based on Monte Carlo dropouts to capture regions in the image where the network is having hard time restoring. The estimated uncertainty maps are then used to guide the network to obtain the restored image. Extensive experiments are conducted on synthetic and real images to show the significance of the proposed work. Code is available at : https://github.com/rajeevyasarla/AT-Net


title: Adaptive Personlization in Federated Learning for Highly Non-i.i.d. Data

abstract: Federated learning (FL) is a distributed learning method that offers medical institutes the prospect of collaboration in a global model while preserving the privacy of their patients. Although most medical centers conduct similar medical imaging tasks, their differences, such as specializations, number of patients, and devices, lead to distinctive data distributions. Data heterogeneity poses a challenge for FL and the personalization of the local models. In this work, we investigate an adaptive hierarchical clustering method for FL to produce intermediate semi-global models, so clients with similar data distribution have the chance of forming a more specialized model. Our method forms several clusters consisting of clients with the most similar data distributions; then, each cluster continues to train separately. Inside the cluster, we use meta-learning to improve the personalization of the participants' models. We compare the clustering approach with classical FedAvg and centralized training by evaluating our proposed methods on the HAM10k dataset for skin lesion classification with extreme heterogeneous data distribution. Our experiments demonstrate significant performance gain in heterogeneous distribution compared to standard FL methods in classification accuracy. Moreover, we show that the models converge faster if applied in clusters and outperform centralized training while using only a small subset of data.


title: Reinforcement Learning for Intra-and-Inter-Bank Borrowing and Lending Mean Field Control Game

abstract: We propose a mean field control game model for the intra-and-inter-bank borrowing and lending problem. This framework allows to study the competitive game arising between groups of collaborative banks. The solution is provided in terms of an asymptotic Nash equilibrium between the groups in the infinite horizon. A three-timescale reinforcement learning algorithm is applied to learn the optimal borrowing and lending strategy in a data driven way when the model is unknown. An empirical numerical analysis shows the importance of the three-timescale, the impact of the exploration strategy when the model is unknown, and the convergence of the algorithm.


title: TFCNs: A CNN-Transformer Hybrid Network for Medical Image Segmentation

abstract: Medical image segmentation is one of the most fundamental tasks concerning medical information analysis. Various solutions have been proposed so far, including many deep learning-based techniques, such as U-Net, FC-DenseNet, etc. However, high-precision medical image segmentation remains a highly challenging task due to the existence of inherent magnification and distortion in medical images as well as the presence of lesions with similar density to normal tissues. In this paper, we propose TFCNs (Transformers for Fully Convolutional denseNets) to tackle the problem by introducing ResLinear-Transformer (RL-Transformer) and Convolutional Linear Attention Block (CLAB) to FC-DenseNet. TFCNs is not only able to utilize more latent information from the CT images for feature extraction, but also can capture and disseminate semantic features and filter non-semantic features more effectively through the CLAB module. Our experimental results show that TFCNs can achieve state-of-the-art performance with dice scores of 83.72\% on the Synapse dataset. In addition, we evaluate the robustness of TFCNs for lesion area effects on the COVID-19 public datasets. The Python code will be made publicly available on https://github.com/HUANGLIZI/TFCNs.


title: Unitary Partitioning and the Contextual Subspace Variational Quantum Eigensolver

abstract: The contextual subspace variational quantum eigensolver (CS-VQE) is a hybrid quantum-classical algorithm that approximates the ground-state energy of a given qubit Hamiltonian. It achieves this by separating the Hamiltonian into contextual and noncontextual parts. The ground-state energy is approximated by classically solving the noncontextual problem, followed by solving the contextual problem using VQE, constrained by the noncontextual solution. In general, computation of the contextual correction needs fewer qubits and measurements compared with solving the full Hamiltonian via traditional VQE. We simulate CS-VQE on different tapered molecular Hamiltonians and apply the unitary partitioning measurement reduction strategy to further reduce the number of measurements required to obtain the contextual correction. Our results indicate that CS-VQE combined with measurement reduction is a promising approach to allow feasible eigenvalue computations on noisy intermediate-scale quantum devices. We also provide a modification to the CS-VQE algorithm; the CS-VQE algorithm previously could cause an exponential increase in Hamiltonian terms, but with this modification now at worst will scale quadratically.


title: On kinetic theories with color and spin from amplitudes

abstract: We extend a previously developed approach to relate thermal currents in the high temperature regime and classical limits of amplitudes. We consider the bi-adjoint scalar theory, which has the basic structure of a cubic theory and which is related to QCD and gravity through the double copy. In addition, we consider a generalization of scalar QED to model classical spin, where massive scalars are complex higher-spin fields. We derive Vlasov-type kinetic equations for bi-adjoint scalars and study their iterative solutions, while for QED we use well-known kinetic equations. In both cases we find consistency between these solutions and the amplitude-like approach.


title: Q-field from a 4D-brane: Cosmological constant cancellation and Minkowski attractor

abstract: A 4D-brane realization of $q$-theory has been proposed a few years ago. The present paper studies the corresponding late-time cosmology and establishes the dynamic cancellation of an initial cosmological constant and an attractor behavior towards Minkowski spacetime.


title: Relativistic distortions in galaxy density-ellipticity correlations: gravitational redshift and peculiar velocity effects

abstract: We study relativistic effects, arising from the light propagation in an inhomogeneous universe. We particularly investigate the effects imprinted in a cross-correlation function between galaxy positions and intrinsic galaxy shapes (GI correlation). Considering the Doppler and gravitational redshift effects as major relativistic effects, we present an analytical model of the GI correlation function, from which we find that the relativistic effects induce non-vanishing odd multipole anisotropies. Focusing particularly on the dipole anisotropy, we show that the Doppler effect dominates at large scales, while the gravitational redshift effect originated from the halo potential dominates at the scales below $10$-$30\, {\rm Mpc}/h$, with the amplitude of the dipole GI correlation being positive over all the scales. Also, we newly derive the covariance matrix for the modelled GI dipole. Taking into account the full covariance, we estimate the signal-to-noise ratio and show that the GI dipole induced by the relativistic effects is detectable in future large-volume galaxy surveys. We discuss how the measurement of dipole GI correlation could be helpful to detect relativistic effects in combination with the conventional galaxy-galaxy cross correlation.


title: Scaling limit of an adaptive contact process

abstract: We introduce and study an interacting particle system evolving on the $d$-dimensional torus $(\mathbb Z/N\mathbb Z)^d$. Each vertex of the torus can be either empty or occupied by an individual of type $\lambda \in (0,\infty)$. An individual of type $\lambda$ dies with rate one and gives birth at each neighboring empty position with rate $\lambda$; moreover, when the birth takes place, the newborn individual is likely to have the same type as the parent, but has a small probability of being a mutant. A mutant child of an individual of type $\lambda$ has type chosen according to a probability kernel. We consider the asymptotic behavior of this process when $N\to \infty$ and the parameter $\delta_N$ tends to zero fast enough that mutations are sufficiently separated in time, so that the amount of time spent on configurations with more than one type becomes negligible. We show that, after a suitable time scaling and deletion of the periods of time spent on configurations with more than one type, the process converges to a Markov jump process on $(0,\infty)$, whose rates we characterize.


title: Stochastic optimal well control in subsurface reservoirs using reinforcement learning

abstract: We present a case study of model-free reinforcement learning (RL) framework to solve stochastic optimal control for a predefined parameter uncertainty distribution and partially observable system. We focus on robust optimal well control problem which is a subject of intensive research activities in the field of subsurface reservoir management. For this problem, the system is partially observed since the data is only available at well locations. Furthermore, the model parameters are highly uncertain due to sparsity of available field data. In principle, RL algorithms are capable of learning optimal action policies -- a map from states to actions -- to maximize a numerical reward signal. In deep RL, this mapping from state to action is parameterized using a deep neural network. In the RL formulation of the robust optimal well control problem, the states are represented by saturation and pressure values at well locations while the actions represent the valve openings controlling the flow through wells. The numerical reward refers to the total sweep efficiency and the uncertain model parameter is the subsurface permeability field. The model parameter uncertainties are handled by introducing a domain randomisation scheme that exploits cluster analysis on its uncertainty distribution. We present numerical results using two state-of-the-art RL algorithms, proximal policy optimization (PPO) and advantage actor-critic (A2C), on two subsurface flow test cases representing two distinct uncertainty distributions of permeability field. The results were benchmarked against optimisation results obtained using differential evolution algorithm. Furthermore, we demonstrate the robustness of the proposed use of RL by evaluating the learned control policy on unseen samples drawn from the parameter uncertainty distribution that were not used during the training process.


title: NICER X-ray Observations of Eta Carinae During its Most Recent Periastron Passage

abstract: We report high-precision X-ray monitoring observations in the 0.4-10 keV band of the luminous, long-period colliding-wind binary Eta Carinae up to and through its most recent X-ray minimum/periastron passage in February 2020. Eta Carinae reached its observed maximum X-ray flux on 7 January 2020, at a flux level of $3.30 \times 10^{-10}$ ergs s$^{-1}$ cm$^{-2}$, followed by a rapid plunge to its observed minimum flux, $0.03 \times 10^{-10}$ ergs s$^{-1}$ cm$^{-2}$ near 17 February 2020. The NICER observations show an X-ray recovery from minimum of only $\sim$16 days, the shortest X-ray minimum observed so far. We provide new constraints of the "deep" and "shallow" minimum intervals. Variations in the characteristic X-ray temperature of the hottest observed X-ray emission indicate that the apex of the wind-wind "bow shock" enters the companion's wind acceleration zone about 81 days before the start of the X-ray minimum. There is a step-like increase in column density just before the X-ray minimum, probably associated with the presence of dense clumps near the shock apex. During recovery and after, the column density shows a smooth decline, which agrees with previous $N_{H}$ measurements made by SWIFT at the same orbital phase, indicating that changes in mass-loss rate are only a few percent over the two cycles. Finally, we use the variations in the X-ray flux of the outer ejecta seen by NICER to derive a kinetic X-ray luminosity of the ejecta of $\sim 10^{41}$ ergs s$^{-1}$ near the time of the "Great Eruption'.


title: Convergence of the dynamical discrete web to the dynamical Brownian web

abstract: In this paper we study the convergence of dynamical discrete web (DyDW) to the dynamical Brownian web (DyBW) in the path space topology. We show that almost surely the DyBW has RCLL paths taking values in an appropriate metric space and as a sequence of RCLL paths, the scaled dynamical discrete web converges to the DyBW. This proves weak convergence of the DyDW process to the DyBW process.


title: Fractional Quantum Zeno Effect Emerging from Non-Hermitian Physics

abstract: Exploring non-Hermitian phenomenology is an exciting frontier of modern physics. However, the demonstration of a non-Hermitian phenomenon that is quantum in nature has remained elusive. Here, we predict quantum non-Hermitian phenomena: the fractional quantum Zeno (FQZ) effect and FQZ-induced photon antibunching. We consider a quantum optics platform with reservoir engineering, where nonlinear emitters are coupled to a bath of decaying bosonic modes whose own decay rates form band structures. By engineering the dissipation band, the spontaneous emission of emitters can be suppressed by strong dissipation through an algebraic scaling with fractional exponents - the FQZ effect. This fractional scaling originates uniquely from the divergent dissipative density of states near the dissipation band edge, different from the traditional closed-bath context. We find FQZ-induced strong photon antibunching in the steady state of a driven emitter even for weak nonlinearities. Remarkably, we identify that the sub-Poissonian quantum statistics of photons, which has no classical analogs, stems here from the key role of non-Hermiticity. Our setup is experimentally feasible with the techniques used to design lattice models with dissipative couplings.


title: A Model-based Multi-agent Framework to Enable an Agile Response to Supply Chain Disruptions

abstract: Due to the COVID-19 pandemic, the global supply chain is disrupted at an unprecedented scale under uncertain and unknown trends of labor shortage, high material prices, and changing travel or trade regulations. To stay competitive, enterprises desire agile and dynamic response strategies to quickly react to disruptions and recover supply-chain functions. Although both centralized and multi-agent approaches have been studied, their implementation requires prior knowledge of disruptions and agent-rule-based reasoning. In this paper, we introduce a model-based multi-agent framework that enables agent coordination and dynamic agent decision-making to respond to supply chain disruptions in an agile and effective manner. Through a small-scale simulated case study, we showcase the feasibility of the proposed approach under several disruption scenarios that affect a supply chain network differently, and analyze performance trade-offs between the proposed distributed and centralized methods.


title: Regulators in the Arithmetic of Function Fields

abstract: As a natural sequel for the study of $A$-motivic cohomology, initiated in [Gaz], we develop a notion of regulator for rigid analytically trivial Anderson $A$-motives. In accordance with the conjectural number field picture, we define it as the morphism at the level of extension modules induced by the exactness of the Hodge-Pink realization functor. The purpose of this text is twofold: we first prove a finiteness result for $A$-motivic cohomology and, under a weight assumption, we then show that the source and the target of regulators have the same dimension. It came as a surprise to the author that the image of this regulator might not have full rank, preventing the analogue of a renowned conjecture of Beilinson to hold in our setting.


title: Endemic infectious states below the epidemic threshold and beyond herd immunity

abstract: In the recent COVID-19 pandemic we assisted at a sequence of epidemic waves intertwined by anomalous fade-outs with periods of low but persistent epidemic prevalence. These long-living epidemic states complicate epidemic control and challenge current modeling approaches as classical epidemic models fail to explain their emergence. Inspired by this phenomenon, we propose a simple mechanism able to reproduce several features observed in real data. Specifically, here we introduce a modification of the Susceptible-Infected-Recovered (SIR) model in a meta-population framework where a small inflow of infected individuals accounts for undetected internal or imported cases. Focusing on a regime where this external seeding is so small that cannot be detected from the analysis of epidemic curves, we find that outbreaks of finite duration percolate in time resulting in overall low but long-living epidemic states below and above the epidemic threshold. Using a two-state description of the local dynamics, we can extract analytical predictions for the phase space. The comparison with epidemic data demonstrates that our model is able to reproduce some critical signatures observed in COVID-19 spreading in England. Finally, our findings defy our understanding of the concept of epidemic threshold and its relationship with outbreaks survival for disease control.


title: The work of James Maynard

abstract: We give a brief account of some of the most spectacular results established by James Maynard for which he has been awarded the Fields Medal.


title: Quantum Symmetries and Conserved Charges of the Cosmological Friedmann-Robertson-Walker Model

abstract: We discuss both the off-shell nilpotent Becchi-Rouet-Stora-Tyutin (BRST) and anti-BRST symmetry transformations for the cosmological Friedmann-Robertson-Walker (FRW) model with a differential gauge condition in the extended phase space. In this discussion, the presence of anti-BRST symmetry provides the complete geometrical description of BRST within the ambit of the supervariable approach. We derive the conserved (anti-)BRST charges for the FRW model using the celebrated Noether theorem and show the nilpotency and absolute anti-commutativity properties of these conserved charges within the realm of BRST formalism. Finally, we prove the sanctity of (anti-)BRST symmetries through the derivation of these symmetry transformations within the framework of the (anti-)chiral supervariable approach (ACSA) to BRST formalism.


title: Role of conservation laws in the Density Matrix Renormalization Group

abstract: We explore matrix product state approximations to wavefunctions which have spontaneously broken symmetries or are critical. We are motivated by the fact that symmetries, and their associated conservation laws, lead to block-sparse matrix product states. Numerical calculations which take advantage of these symmetries run faster and require less memory. However, in symmetry-broken and critical phases the block sparse ansatz yields less accurate energies. We characterize the role of conservation laws in matrix product states and determine when it is beneficial to make use of them.


title: Data-Driven optimal shrinkage of singular values under high-dimensional noise with separable covariance structure with application

abstract: We develop a data-driven optimal shrinkage algorithm for matrix denoising in the presence of high-dimensional noise with a separable covariance structure; that is, the noise is colored and dependent across samples. The algorithm, coined {\em extended OptShrink} (eOptShrink) depends on the asymptotic behavior of singular values and singular vectors of the random matrix associated with the noisy data. Based on the developed theory, including the sticking property of non-outlier singular values and delocalization of the non-outlier singular vectors associated with weak signals with a convergence rate, and the spectral behavior of outlier singular values and vectors, we develop three estimators, each of these has its own interest. First, we design a novel rank estimator, based on which we provide an estimator for the spectral distribution of the pure noise matrix, and hence the optimal shrinker called eOptShrink. In this algorithm we do not need to estimate the separable covariance structure of the noise. A theoretical guarantee of these estimators with a convergence rate is given. On the application side, in addition to a series of numerical simulations with a comparison with various state-of-the-art optimal shrinkage algorithms, we apply eOptShrink to extract maternal and fetal electrocardiograms from the single channel trans-abdominal maternal electrocardiogram.


title: Mass, capacitary functions, and the mass-to-capacity ratio

abstract: We study connections among the ADM mass, positive harmonic functions tending to zero at infinity, and the capacity of the boundary of asymptotically flat $3$-manifolds with nonnegative scalar curvature. First we give new formulae that detect the ADM mass via harmonic functions. Then we derive a family of monotone quantities and geometric inequalities if the underlying manifold has simple topology. As an immediate application, we observe several additional proofs of the $3$-dimensional Riemannian positive mass theorem. One proof leads to new, sufficient conditions that imply positivity of the mass via $C^0$-geometry of regions separating the boundary and $\infty$. A special case of such sufficient conditions shows, if a region enclosing the boundary has relative small volume, then the mass is positive. As further applications, we obtain integral identities for the mass-to-capacity ratio. We also promote the inequalities to become equality on spatial Schwarzschild manifolds outside rotationally symmetric spheres. Among other things, we show the mass-to-capacity ratio is always bounded below by one minus the square root of the normalized Willmore functional of the boundary. Prompted by our findings, we carry out a study of manifolds satisfying a constraint on the mass-to-capacity ratio. We point out such manifolds satisfy improved inequalities, their mass has an upper bound depending only on the boundary data, there are no closed minimal surfaces enclosing the boundary, and these manifolds include static extensions in the context of the Bartnik quasi-local mass.


title: Conformal Carroll Scalars with Boosts

abstract: We construct two distinct actions for scalar fields that are invariant under local Carroll boosts and Weyl transformations. Conformal Carroll field theories were recently argued to be related to the celestial holography description of asymptotically flat spacetimes. However, only few explicit examples of such theories are known, and they lack local Carroll boost symmetry on a generic curved background. We derive two types of conformal Carroll scalar actions with boost symmetry on a curved background in any dimension and compute their energy-momentum tensors, which are traceless. In the first type of theories, time derivatives dominate and spatial derivatives are suppressed. In the second type, spatial derivatives dominate, and constraints are present to ensure local boost invariance. By integrating out these constraints, we show that the spatial conformal Carroll theories can be reduced to lower-dimensional Euclidean CFTs, which is reminiscent of the embedding space construction.


title: Linearized Physics-Based Lithium-Ion Battery Model for Power System Economic Studies

abstract: This paper proposes the linearized physics-based model of a lithium-ion battery that can be incorporated into the optimization framework for power system economic studies. The proposed model is a linear approximation of the single particle model and it allows to characterize dynamics of the physical processes inside the battery that impact the battery operation. There is a need for such model as a simplistic power-energy model that is widely employed in operation and planning studies with the lithium-ion battery energy storage system (LIBESS) results in infeasible operation and misleading economic assessment. The proposed linearized model is computationally beneficial compared with a recently used nonlinear physics-based model. The energy arbitrage application is used to assess the advantages of the proposed model over a simple power-energy model.


title: For Learning in Symmetric Teams, Local Optima are Global Nash Equilibria

abstract: Although it has been known since the 1970s that a globally optimal strategy profile in a common-payoff game is a Nash equilibrium, global optimality is a strict requirement that limits the result's applicability. In this work, we show that any locally optimal symmetric strategy profile is also a (global) Nash equilibrium. Furthermore, we show that this result is robust to perturbations to the common payoff and to the local optimum. Applied to machine learning, our result provides a global guarantee for any gradient method that finds a local optimum in symmetric strategy space. While this result indicates stability to unilateral deviation, we nevertheless identify broad classes of games where mixed local optima are unstable under joint, asymmetric deviations. We analyze the prevalence of instability by running learning algorithms in a suite of symmetric games, and we conclude by discussing the applicability of our results to multi-agent RL, cooperative inverse RL, and decentralized POMDPs.


title: Inferring Structural Parameters of Low-Surface-Brightness-Galaxies with Uncertainty Quantification using Bayesian Neural Networks

abstract: Measuring the structural parameters (size, total brightness, light concentration, etc.) of galaxies is a significant first step towards a quantitative description of different galaxy populations. In this work, we demonstrate that a Bayesian Neural Network (BNN) can be used for the inference, with uncertainty quantification, of such morphological parameters from simulated low-surface-brightness galaxy images. Compared to traditional profile-fitting methods, we show that the uncertainties obtained using BNNs are comparable in magnitude, well-calibrated, and the point estimates of the parameters are closer to the true values. Our method is also significantly faster, which is very important with the advent of the era of large galaxy surveys and big data in astrophysics.


title: Data-driven State of Risk Prediction and Mitigation in Support of the Net-zero Carbon Electric Grid

abstract: An approach for reaching the net-zero carbon electricity grid is to intensify the deployment of distributed renewable generation resources such as photovoltaic (PV) solar and wind generation, complemented with stationary and mobile (electric vehicle) battery energy storage systems (BESS). This paper assumes a scenario where the PV renewable generation and BESS are integrated into a nano-Grid (n-Grid), a prosumer-owned virtual power plant installed at the residential or commercial sites. To be profitable, this distributed energy resource (DER) needs to be managed effectively to support its own load and the wholesale and retail market services. Our paper introduces a risk-based, data-driven approach focused on predicting the State of Risk (SoR) of the utility grid outages. The SoR prediction enables the development of optimal mitigation strategies aiming at reducing the impact of the grid outages by harvesting the n-Grid flexibility. Several data analytics tools to assist the n-Grid operators and aggregators for n-Grid participation in the wholesale market ancillary service products are introduced, and some preliminary implementation results are demonstrated.


title: Simulating one-dimensional quantum chromodynamics on a quantum computer: Real-time evolutions of tetra- and pentaquarks

abstract: Quantum chromodynamics - the theory of quarks and gluons - has been known for decades, but it is yet to be fully understood. A recent example is the prediction and experimental discovery of tetraquarks, that opened a new research field. Crucially, numerous unsolved questions of the standard model can exclusively be addressed by nonperturbative calculations. Quantum computers can solve problems for which well established QCD methods are inapplicable, such as real-time evolution. We take a key step in exploring this possibility by performing a real-time evolution of tetraquark and pentaquark physics in one-dimensional SU(3) gauge theory on a superconducting quantum computer. Our experiment represents a first quantum computation involving quarks with three colour degrees of freedom, i.e. with the gauge group of QCD.


title: Killing Tensors in Koutras-McIntosh Spacetimes

abstract: The Koutras-McIntosh family of metrics include conformally flat pp-waves and the Wils metric. It appeared in a paper of 1996 by Koutras-McIntosh as an example of a pure radiation spacetime without scalar curvature invariants or infinitesimal symmetries. Here we demonstrate that these metrics have no "hidden symmetries", by which we mean Killing tensors of low degrees. For the particular case of Wils metrics we show the nonexistence of Killing tensors up to degree 6. The technique we use is the geometric theory of overdetermined PDEs and the Cartan prolongation-projection method. Application of those allows to prove the nonexistence of polynomial in momenta integrals for the equation of geodesics in a mathematical rigorous way. Using the same technique we can completely classify all lower degree Killing tensors and, in particular, prove that for generic pp-waves all Killing tensors of degree 3 and 4 are reducible.


title: Solution theory of fractional SDEs in complete subcritical regimes

abstract: We consider stochastic differential equations (SDEs) driven by a fractional Brownian motion with a drift coefficient that is allowed to be arbitrarily close to criticality in a scaling sense. We develop a comprehensive solution theory that includes strong existence, path-by-path uniqueness, existence of a solution flow of diffeomorphisms, Malliavin differentiability and $\rho$-irregularity. As a consequence, we can also treat McKean-Vlasov, transport and continuity equations.


title: Path-by-path regularisation through multiplicative noise in rough, Young, and ordinary differential equations

abstract: Differential equations perturbed by multiplicative fractional Brownian motions are considered. Depending on the value of the Hurst parameter $H$, the resulting equation is pathwise viewed as an ODE, YDE, or RDE. In all three regimes we show regularisation by noise phenomena by proving the strongest kind of well-posedness with irregular drift: strong existence and path-by-path uniqueness. In the Young and smooth regime $H>1/2$ the condition on the drift coefficient is optimal in the sense that it agrees with the one known for the additive case [CG16, Ger22]. In the rough regime $H\in(1/3,1/2)$ we assume positive but arbitrarily small drift regularity for strong well-posedness, while for distributional drift we obtain weak existence.


title: VeriDark: A Large-Scale Benchmark for Authorship Verification on the Dark Web

abstract: The DarkWeb represents a hotbed for illicit activity, where users communicate on different market forums in order to exchange goods and services. Law enforcement agencies benefit from forensic tools that perform authorship analysis, in order to identify and profile users based on their textual content. However, authorship analysis has been traditionally studied using corpora featuring literary texts such as fragments from novels or fan fiction, which may not be suitable in a cybercrime context. Moreover, the few works that employ authorship analysis tools for cybercrime prevention usually employ ad-hoc experimental setups and datasets. To address these issues, we release VeriDark: a benchmark comprised of three large scale authorship verification datasets and one authorship identification dataset obtained from user activity from either Dark Web related Reddit communities or popular illicit Dark Web market forums. We evaluate competitive NLP baselines on the three datasets and perform an analysis of the predictions to better understand the limitations of such approaches. We make the datasets and baselines publicly available at https://github.com/bit-ml/VeriDark


title: Red PANDA: Disambiguating Anomaly Detection by Removing Nuisance Factors

abstract: Anomaly detection methods strive to discover patterns that differ from the norm in a semantic way. This goal is ambiguous as a data point differing from the norm by an attribute e.g., age, race or gender, may be considered anomalous by some operators while others may consider this attribute irrelevant. Breaking from previous research, we present a new anomaly detection method that allows operators to exclude an attribute from being considered as relevant for anomaly detection. Our approach then learns representations which do not contain information over the nuisance attributes. Anomaly scoring is performed using a density-based approach. Importantly, our approach does not require specifying the attributes that are relevant for detecting anomalies, which is typically impossible in anomaly detection, but only attributes to ignore. An empirical investigation is presented verifying the effectiveness of our approach.


title: ACCESS: Confirmation of a Clear Atmosphere for WASP-96b and a Comparison of Light Curve Detrending Techniques

abstract: One of the strongest ${\rm Na~I}$ features was observed in WASP-96b. To confirm this novel detection, we provide a new 475-825nm transmission spectrum obtained with Magellan/IMACS, which indeed confirms the presence of a broad sodium absorption feature. We find the same result when reanalyzing the 400-825nm VLT/FORS2 data. We also utilize synthetic data to test the effectiveness of two common detrending techniques: (1) a Gaussian processes (GP) routine, and (2) common-mode correction followed by polynomial correction (CMC+Poly). We find that both methods poorly reproduce the absolute transit depths but maintain their true spectral shape. This emphasizes the importance of fitting for offsets when combining spectra from different sources or epochs. Additionally, we find that for our datasets both methods give consistent results, but CMC+Poly is more accurate and precise. We combine the Magellan/IMACS and VLT/FORS2 spectra with literature 800-1644nm HST/WFC3 spectra, yielding a global spectrum from 400-1644nm. We used the PLATON and Exoretrievals retrieval codes to interpret this spectrum, and find that both yield relatively deeper pressures where the atmosphere is optically thick at log-pressures between $1.3^{+1.0}_{-1.1}$ and 0.29$^{+1.86}_{-2.02}$ bars, respectively. Exoretrievals finds a solar to super-solar ${\rm Na~I}$ and ${\rm H_2O}$ log-mixing ratios of $-5.4^{+2.0}_{-1.9}$ and $-4.5^{+2.0}_{-2.0}$, respectively, while PLATON finds an overall metallicity of $log_{10}(Z/Z_{\odot}) = -0.49^{+1.0}_{-0.37}$dex. Therefore, our findings are in agreement with literature and support the inference that the terminator of WASP-96b has few aerosols obscuring prominent features in the optical to near-infrared (near-IR) spectrum.


title: Engines for predictive work extraction from memoryful quantum stochastic processes

abstract: Quantum information-processing techniques enable work extraction from a system's inherently quantum features, in addition to the classical free energy it contains. Meanwhile, the science of computational mechanics affords tools for the predictive modeling of non-Markovian classical and quantum stochastic processes. We combine tools from these two sciences to develop a technique for predictive work extraction from non-Markovian stochastic processes with quantum outputs. We demonstrate that this technique can extract more work than non-predictive quantum work extraction protocols, on one hand, and predictive work extraction without quantum information processing, on the other. We discover a phase transition in the efficacy of memory for work extraction from quantum processes, which is without classical precedent. Our work opens up the prospect of machines that harness environmental free energy in an essentially quantum, essentially time-varying form.


title: Training Transformers Together

abstract: The infrastructure necessary for training state-of-the-art models is becoming overly expensive, which makes training such models affordable only to large corporations and institutions. Recent work proposes several methods for training such models collaboratively, i.e., by pooling together hardware from many independent parties and training a shared model over the Internet. In this demonstration, we collaboratively trained a text-to-image transformer similar to OpenAI DALL-E. We invited the viewers to join the ongoing training run, showing them instructions on how to contribute using the available hardware. We explained how to address the engineering challenges associated with such a training run (slow communication, limited memory, uneven performance between devices, and security concerns) and discussed how the viewers can set up collaborative training runs themselves. Finally, we show that the resulting model generates images of reasonable quality on a number of prompts.