title: Frustratingly Easy Uncertainty Estimation for Distribution Shift

abstract: Distribution shift is an important concern in deep image classification, produced either by corruption of the source images, or a complete change, with the solution involving domain adaptation. While the primary goal is to improve accuracy under distribution shift, an important secondary goal is uncertainty estimation: evaluating the probability that the prediction of a model is correct. While improving accuracy is hard, uncertainty estimation turns out to be frustratingly easy. Prior works have appended uncertainty estimation into the model and training paradigm in various ways. Instead, we show that we can estimate uncertainty by simply exposing the original model to corrupted images, and performing simple statistical calibration on the image outputs. Our frustratingly easy methods demonstrate superior performance on a wide range of distribution shifts as well as on unsupervised domain adaptation tasks, measured through extensive experimentation.


title: Vanishing Curvature and the Power of Adaptive Methods in Randomly Initialized Deep Networks

abstract: This paper revisits the so-called vanishing gradient phenomenon, which commonly occurs in deep randomly initialized neural networks. Leveraging an in-depth analysis of neural chains, we first show that vanishing gradients cannot be circumvented when the network width scales with less than O(depth), even when initialized with the popular Xavier and He initializations. Second, we extend the analysis to second-order derivatives and show that random i.i.d. initialization also gives rise to Hessian matrices with eigenspectra that vanish as networks grow in depth. Whenever this happens, optimizers are initialized in a very flat, saddle point-like plateau, which is particularly hard to escape with stochastic gradient descent (SGD) as its escaping time is inversely related to curvature. We believe that this observation is crucial for fully understanding (a) historical difficulties of training deep nets with vanilla SGD, (b) the success of adaptive gradient methods (which naturally adapt to curvature and thus quickly escape flat plateaus) and (c) the effectiveness of modern architectural components like residual connections and normalization layers.


title: On the Expressive Power of Self-Attention Matrices

abstract: Transformer networks are able to capture patterns in data coming from many domains (text, images, videos, proteins, etc.) with little or no change to architecture components. We perform a theoretical analysis of the core component responsible for signal propagation between elements, i.e. the self-attention matrix. In practice, this matrix typically exhibits two properties: (1) it is sparse, meaning that each token only attends to a small subset of other tokens; and (2) it changes dynamically depending on the input to the module. With these considerations in mind, we ask the following question: Can a fixed self-attention module approximate arbitrary sparse patterns depending on the input? How small is the hidden size $d$ required for such approximation? We make progress in answering this question and show that the self-attention matrix can provably approximate sparse matrices, where sparsity is in terms of a bounded number of nonzero elements in each row and column. While the parameters of self-attention are fixed, various sparse matrices can be approximated by only modifying the inputs. Our proof is based on the random projection technique and uses the seminal Johnson-Lindenstrauss lemma. Our proof is constructive, enabling us to propose an algorithm for finding adaptive inputs and fixed self-attention parameters in order to approximate a given matrix. In particular, we show that, in order to approximate any sparse matrix up to a given precision defined in terms of preserving matrix element ratios, $d$ grows only logarithmically with the sequence length $L$ (i.e. $d = O(\log L)$).


title: On Inductive Biases for Heterogeneous Treatment Effect Estimation

abstract: We investigate how to exploit structural similarities of an individual's potential outcomes (POs) under different treatments to obtain better estimates of conditional average treatment effects in finite samples. Especially when it is unknown whether a treatment has an effect at all, it is natural to hypothesize that the POs are similar - yet, some existing strategies for treatment effect estimation employ regularization schemes that implicitly encourage heterogeneity even when it does not exist and fail to fully make use of shared structure. In this paper, we investigate and compare three end-to-end learning strategies to overcome this problem - based on regularization, reparametrization and a flexible multi-task architecture - each encoding inductive bias favoring shared behavior across POs. To build understanding of their relative strengths, we implement all strategies using neural networks and conduct a wide range of semi-synthetic experiments. We observe that all three approaches can lead to substantial improvements upon numerous baselines and gain insight into performance differences across various experimental settings.


title: Measurements of branching fractions and direct CP asymmetries in $B^{0}\to K^{+} \pi^{-}$, $B^+ \to K_{\rm S}^0\pi^+$ and $B^0 \to \pi^+\pi^-$ using 2019 and 2020 data

abstract: We report updated measurements of branching fractions ($\mathcal{B}$) and CP-violating charge asymmetries ($\mathcal{A_{\rm CP}}$) for charmless $B$ decays at Belle II, which operates on or near the $\Upsilon$(4S) resonance at the SuperKEKB asymmetric energy $e^{+}e^{-}$ collider. We use samples of 2019 and 2020 data corresponding to 62.8 fb$^{-1}$ of integrated luminosity. The samples are analysed using two-dimensional fits in $\Delta E$ and $M_{\it bc}$ to determine signal yields of approximately 568, 103, and 115 decays for the channels $B^0 \to K^+\pi^-$, $B^+ \to K_{\rm S}^0\pi^+$, and $B^0 \to \pi^+\pi^-$, respectively. Signal yields are corrected for efficiencies determined from simulation and control data samples to obtain branching fractions and CP-violating asymmetries for flavour-specific channels. The results are compatible with known determinations and contribute important information to an early assessment of Belle II detector performance.


title: Apparatus for Measuring Strength in Biaxial Compression

abstract: Most measurements of compressive strength of ductile materials have involved Hopkinson-Kolsky bars or Taylor anvils placing samples in uniaxial compression. In these geometries strain is limited by the tendency of the sample to petal, in analogy to necking in uniaxial tension. Estimation of strength for any other form of the stress tensor requires assuming a shape for the yield surface; because data exist only for uniaxial compression these assumptions are untested. In an imploding spherical shell compression is biaxial, the plastic strain may not be small and the material behavior may be nonlinear as a result of work hardening and heating by plastic work. We propose to measure the strengths of materials in biaxial compression,both quasistatically and dynamically, using the compression of thin spherical shells. We suggest surrounding the shell with an annulus filled with a mixture of H$_2$ and Cl$_2$ gases whose volumetric detonation is initiated by a flash of blue and near-ultraviolet light. Less promising approaches are described in appendices.


title: Insights on Rigidity and flexibility at the Global and Local Levels of Protein Structures and their Roles in Homologous Psychrophilic, Mesophilic and Thermophilic Proteins: A Computational Study

abstract: The rigidity and flexibility of homologous psychrophilic(P), mesophilic(M) and thermophilic(T) proteins have been investigated at the global and local levels in terms of packing factor and atomic fluctuations obtained from B-factors. For comparison of atomic fluctuations, correction of errors by considering errors in B-factors from all sources in a consolidated manner and conversion of the fluctuations to the same temperature have been suggested and validated. Results indicate no differences in the global values like average packing factor among the three classes of protein homologs but at local levels there are differences. Comparison of homologous proteins triplets show that the average atomic fluctuations at a given temperature obey the order P>M>T. Packing factors and the atomic fluctuations are anti-correlated suggesting that altering the rigidity of the active site might be a potential strategy to make tailor made psychrophilic or thermophilic proteins from their mesophilic homologs.


title: Simulating a measurement-induced phase transition for trapped ion circuits

abstract: The rise of programmable quantum devices has motivated the exploration of circuit models which could realize novel physics. A promising candidate is a class of hybrid circuits, where entangling unitary dynamics compete with disentangling measurements. Novel phase transitions between different entanglement regimes have been identified in their dynamical states, with universal properties hinting at unexplored critical phenomena. Trapped ion hardware is a leading contender for the experimental realization of such physics, which requires not only traditional two-qubit entangling gates, but a constant rate of local measurements accurately addressed throughout the circuit. Recent progress in engineering high-precision optical addressing of individual ions makes preparing a constant rate of measurements throughout a unitary circuit feasible. Using tensor network simulations, we show that the resulting class of hybrid circuits, prepared with native gates, exhibits a volume-law to area-law transition in the entanglement entropy. This displays universal hallmarks of a measurement-induced phase transition. Our simulations are able to characterize the critical exponents using circuit sizes with tens of qubits and thousands of gates. We argue that this transition should be robust against additional sources of experimental noise expected in modern trapped ion hardware, and will rather be limited by statistical requirements on post selection. Our work highlights the powerful role that tensor network simulations can play in advancing the theoretical and experimental frontiers of critical phenomena.


title: Few-Shot Unsupervised Image-to-Image Translation on complex scenes

abstract: Unsupervised image-to-image translation methods have received a lot of attention in the last few years. Multiple techniques emerged tackling the initial challenge from different perspectives. Some focus on learning as much as possible from several target style images for translations while other make use of object detection in order to produce more realistic results on content-rich scenes. In this work, we assess how a method that has initially been developed for single object translation performs on more diverse and content-rich images. Our work is based on the FUNIT[1] framework and we train it with a more diverse dataset. This helps understanding how such method behaves beyond their initial frame of application. We present a way to extend a dataset based on object detection. Moreover, we propose a way to adapt the FUNIT framework in order to leverage the power of object detection that one can see in other methods.


title: Traction chain networks: Insights beyond force chain networks for non-spherical particle systems

abstract: Force chain networks are generally applied in granular materials to gain insight into inter-particle granular contact. For conservative spherical particle systems, i.e. frictionless and undamped, force chains are information complete due to symmetries resulting from isotropy and constant curvature of a sphere. In fact, for conservative spherical particle systems, given the geometry and material, the force chain network uniquely defines the contact state that includes elastic forces, penetration distance, overlap volume, contact areas and contact pressures in a particle system. This is, however, not the case for conservative non-spherical particle systems. The reason is that a force chain network is not sufficient to uniquely define the contact state in a conservative non-spherical particle system. Additional information is required to define the contact state of non-spherical granular systems. Traction chain networks are proposed to complement force chain networks for the improved quantification of the state of contact of a granular system.


title: Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Tracking

abstract: Multi-person pose estimation and tracking serve as crucial steps for video understanding. Most state-of-the-art approaches rely on first estimating poses in each frame and only then implementing data association and refinement. Despite the promising results achieved, such a strategy is inevitably prone to missed detections especially in heavily-cluttered scenes, since this tracking-by-detection paradigm is, by nature, largely dependent on visual evidences that are absent in the case of occlusion. In this paper, we propose a novel online approach to learning the pose dynamics, which are independent of pose detections in current fame, and hence may serve as a robust estimation even in challenging scenarios including occlusion. Specifically, we derive this prediction of dynamics through a graph neural network~(GNN) that explicitly accounts for both spatial-temporal and visual information. It takes as input the historical pose tracklets and directly predicts the corresponding poses in the following frame for each tracklet. The predicted poses will then be aggregated with the detected poses, if any, at the same frame so as to produce the final pose, potentially recovering the occluded joints missed by the estimator. Experiments on PoseTrack 2017 and PoseTrack 2018 datasets demonstrate that the proposed method achieves results superior to the state of the art on both human pose estimation and tracking tasks.


title: Development of very-thick transparent GEMs with wavelength-shifting capability for noble element TPCs

abstract: A new concept for the simultaneous detection of primary and secondary scintillation in time projection chambers is proposed. Its core element is a type of very-thick GEM structure supplied with transparent electrodes and machined from a polyethylene naphthalate plate, a natural wavelength-shifter. Such a device has good prospects for scalability and, by virtue of its genuine optical properties, it can improve on the light collection efficiency, energy threshold and resolution of conventional micropattern gas detectors. This, together with the intrinsic radiopurity of its constituting elements, offers advantages for noble gas and liquid based time projection chambers, used for dark matter searches and neutrino experiments. Production, optical and electrical characterization, and first measurements performed with the new device are reported.

categories: physics.ins-det astro-ph.IM hep-ex nucl-ex


title: Digital Taxonomist: Identifying Plant Species in Community Scientists' Photographs

abstract: Automatic identification of plant specimens from amateur photographs could improve species range maps, thus supporting ecosystems research as well as conservation efforts. However, classifying plant specimens based on image data alone is challenging: some species exhibit large variations in visual appearance, while at the same time different species are often visually similar; additionally, species observations follow a highly imbalanced, long-tailed distribution due to differences in abundance as well as observer biases. On the other hand, most species observations are accompanied by side information about the spatial, temporal and ecological context. Moreover, biological species are not an unordered list of classes but embedded in a hierarchical taxonomic structure. We propose a multimodal deep learning model that takes into account these additional cues in a unified framework. Our Digital Taxonomist is able to identify plant species in photographs better than a classifier trained on the image content alone, the performance gained is over 6 percent points in terms of accuracy.


title: Explainable Artificial Intelligence (XAI) for Increasing User Trust in Deep Reinforcement Learning Driven Autonomous Systems

abstract: We consider the problem of providing users of deep Reinforcement Learning (RL) based systems with a better understanding of when their output can be trusted. We offer an explainable artificial intelligence (XAI) framework that provides a three-fold explanation: a graphical depiction of the systems generalization and performance in the current game state, how well the agent would play in semantically similar environments, and a narrative explanation of what the graphical information implies. We created a user-interface for our XAI framework and evaluated its efficacy via a human-user experiment. The results demonstrate a statistically significant increase in user trust and acceptance of the AI system with explanation, versus the AI system without explanation.


title: CDN-MEDAL: Two-stage Density and Difference Approximation Framework for Motion Analysis

abstract: Background modeling and subtraction is a promising research area with a variety of applications for video surveillance. Recent years have witnessed a proliferation of effective learning-based deep neural networks in this area. However, the techniques have only provided limited descriptions of scenes' properties while requiring heavy computations, as their single-valued mapping functions are learned to approximate the temporal conditional averages of observed target backgrounds and foregrounds. On the other hand, statistical learning in imagery domains has been a prevalent approach with high adaptation to dynamic context transformation, notably using Gaussian Mixture Models (GMM) with its generalization capabilities. By leveraging both, we propose a novel method called CDN-MEDAL-net for background modeling and subtraction with two convolutional neural networks. The first architecture, CDN-GM, is grounded on an unsupervised GMM statistical learning strategy to describe observed scenes' salient features. The second one, MEDAL-net, implements a light-weighted pipeline of online video background subtraction. Our two-stage architecture is small, but it is very effective with rapid convergence to representations of intricate motion patterns. Our experiments show that the proposed approach is not only capable of effectively extracting regions of moving objects in unseen cases, but it is also very efficient.


title: X2Parser: Cross-Lingual and Cross-Domain Framework for Task-Oriented Compositional Semantic Parsing

abstract: Task-oriented compositional semantic parsing (TCSP) handles complex nested user queries and serves as an essential component of virtual assistants. Current TCSP models rely on numerous training data to achieve decent performance but fail to generalize to low-resource target languages or domains. In this paper, we present X2Parser, a transferable Cross-lingual and Cross-domain Parser for TCSP. Unlike previous models that learn to generate the hierarchical representations for nested intents and slots, we propose to predict flattened intents and slots representations separately and cast both prediction tasks into sequence labeling problems. After that, we further propose a fertility-based slot predictor that first learns to dynamically detect the number of labels for each token, and then predicts the slot types. Experimental results illustrate that our model can significantly outperform existing strong baselines in cross-lingual and cross-domain settings, and our model can also achieve a good generalization ability on target languages of target domains. Furthermore, our model tackles the problem in an efficient non-autoregressive way that reduces the latency by up to 66% compared to the generative model.


title: Quantum transitions, ergodicity, and quantum scars in the coupled top model

abstract: We consider an interacting collective spin model known as coupled top (CT), exhibiting a rich variety of phenomena related to quantum transitions, ergodicity, and formation of quantum scars, discussed in [Phys. Rev. E 102, 020101(R) (2020)]. In this work, we present a detailed analysis of the different type of transitions in CT model, and find their connection with the underlying collective spin dynamics. Apart from the quantum scarring phenomena, we also identify another source of deviation from ergodicity due to the presence of non-ergodic multifractal states. The degree of ergodicity of the eigenstates across the energy band is quantified from the relative entanglement entropy as well as multifractal dimensions, which can be probed from non-equilibrium dynamics. Finally, we discuss the detection of non-ergodic behavior and different types of quantum scars using `out-of-time-order correlators', which has relevance in the recent experiments.


title: On the Antichain Tree Property

abstract: In this note, we investigate a new model theoretical tree property, called the antichain tree property (ATP). We develop combinatorial techniques for ATP. First, we show that ATP is always witnessed by a formula in a single free variable, and for formulas, not having ATP is closed under disjunction. Second, we show the equivalence of ATP and $k$-ATP, and provide a criterion for theories to have not ATP (being NATP). Using these combinatorial observations, we find algebraic examples of ATP and NATP, including pure group, pure fields, and valued fields. More precisely, we prove Mekler's construction for groups, Chatzidakis' style criterion for PAC fields, and the AKE-style principle for valued fields preserving NATP. And we give a construction of an antichain tree in the Skolem arithmetic and atomless Boolean algebras.


title: Learning Stochastic Optimal Policies via Gradient Descent

abstract: We systematically develop a learning-based treatment of stochastic optimal control (SOC), relying on direct optimization of parametric control policies. We propose a derivation of adjoint sensitivity results for stochastic differential equations through direct application of variational calculus. Then, given an objective function for a predetermined task specifying the desiderata for the controller, we optimize their parameters via iterative gradient descent methods. In doing so, we extend the range of applicability of classical SOC techniques, often requiring strict assumptions on the functional form of system and control. We verify the performance of the proposed approach on a continuous-time, finite horizon portfolio optimization with proportional transaction costs.


title: The episodic dust-making Wolf-Rayet star HD 38030 in the Large Magellanic Cloud

abstract: Mid-infrared photometry of the Wolf-Rayet star HD 38030 in the Large Magellanic Cloud from the NEOWISE-R mission show it to have undergone a dust-formation episode in 2018 and the dust to have cooled in 2019-20. New spectroscopy with the MagE spectrograph on the Magellan I Baade Telescope in 2019 and 2020 show absorption lines attributable to a companion of type near O9.7III-IV. We found a significant shift in the radial velocity of the C IV 5801-12 blend compared with the RVs measured in 1984 and 1993. The results combine to suggest that HD 38030 is a colliding-wind binary having short-lived dust formation episodes, like the Galactic systems WR 140 and WR 19, but at intervals in excess of 20 yr.


title: On the elementary theory of graph products of groups

abstract: In this paper we study the elementary theory of graph products of groups and show that under natural conditions on the vertex groups we can recover (the core of) the underlying graph and the associated vertex groups. More precisely, we require the vertex groups to satisfy a non-generic almost positive sentence, a condition which generalizes a range of natural ``non-freeness conditions" such as the satisfaction of a group law, having nontrivial center or being boundedly simple. As a corollary, we determine an invariant of the elementary theory of a right-angled Artin group, the core of the defining graph, which we conjecture to determine the elementary class of the RAAG. We further combine our results with the results of Sela on free products of groups to describe all finitely generated groups elementarily equivalent to certain RAAGs. We also deduce rigidity results on the elementary classification of graph products of groups for specific types of vertex groups, such as finite, nilpotent or classical linear groups.


title: An Information-theoretic Approach to Distribution Shifts

abstract: Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere, agents trained in a simulation can struggle to adapt when deployed in the real world or novel environments, and neural networks that are fit to a subset of the population might carry some selection bias into their decision process. In this work, we describe the problem of data shift from a novel information-theoretic perspective by (i) identifying and describing the different sources of error, (ii) comparing some of the most promising objectives explored in the recent domain generalization, and fair classification literature. From our theoretical analysis and empirical evaluation, we conclude that the model selection procedure needs to be guided by careful considerations regarding the observed data, the factors used for correction, and the structure of the data-generating process.


title: Addressable Graphene Encapsulation of Wet Specimens on a Chip for Combinatorial Optical, Electron, Infrared and X-ray based Spectromicroscopy Studies

abstract: Label-free spectromicroscopy methods offer the capability to examine complex cellular phenomena. Electron and X-ray-based spectromicroscopy methods, though powerful, have been hard to implement with hydrated objects due to the vacuum incompatibility of the samples and due to the parasitic signals from (or drastic attenuation by) the liquid matrix surrounding the biological object of interest. Similarly, for many techniques that operate at ambient pressure, such as Fourier Transform Infrared spectromicroscopy (FTIRM), the aqueous environment imposes severe limitations due to the strong absorption by liquid water in the infrared regime. Here we propose a microfabricated multi-compartmental and reusable hydrated sample platform suitable for use with several analytical techniques, which employs the conformal encapsulation of biological specimens by atomically thin graphene. Such an electron, X-ray, and infrared transparent, molecularly impermeable as well as mechanically robust enclosure preserve the hydrated environment around the object for a sufficient time to allow in-situ examination of hydrated bio-objects with techniques operating both in ambient or high vacuum conditions. An additional hydration source, made by hydrogel pads patterned near/around the specimen and co-encapsulated, has been added to further extend the hydration lifetime. Scanning electron and optical fluorescence microscopies, as well as synchrotron radiation-based FTIR and X-ray fluorescence microscopies, have been used to test the applicability of the platform and for its validation with yeast, A549 human carcinoma lung cells and micropatterned gels as biological object phantoms.


title: Generative Adversarial Networks: A Survey Towards Private and Secure Applications

abstract: Generative Adversarial Networks (GAN) have promoted a variety of applications in computer vision, natural language processing, etc. due to its generative model's compelling ability to generate realistic examples plausibly drawn from an existing distribution of samples. GAN not only provides impressive performance on data generation-based tasks but also stimulates fertilization for privacy and security oriented research because of its game theoretic optimization strategy. Unfortunately, there are no comprehensive surveys on GAN in privacy and security, which motivates this survey paper to summarize those state-of-the-art works systematically. The existing works are classified into proper categories based on privacy and security functions, and this survey paper conducts a comprehensive analysis of their advantages and drawbacks. Considering that GAN in privacy and security is still at a very initial stage and has imposed unique challenges that are yet to be well addressed, this paper also sheds light on some potential privacy and security applications with GAN and elaborates on some future research directions.


title: Probing pre-Recombination Physics by the Cross-Correlation of Stochastic Gravitational Waves and CMB Anisotropies

abstract: We study the effects of pre-recombination physics on the Stochastic Gravitational Wave Background (SGWB) anisotropies induced by the propagation of gravitons through the large-scale density perturbations and their cross-correlation with Cosmic Microwave Background (CMB) temperature and E-mode polarization ones. As examples of Early Universe extensions to the $\Lambda$CDM model, we consider popular models featuring extra relativistic degrees of freedom, a massless non-minimally coupled scalar field, and an Early Dark Energy component. Assuming the detection of a SGWB, we perform a Fisher analysis to assess in a quantitative way the capability of future gravitational wave interferometers (GWIs) in conjunction with a future large-scale CMB polarization experiment to constrain such variations. Our results show that the cross-correlation of CMB and SGWB anisotropies will help tighten the constraints obtained with CMB alone, with an improvement that significantly depends on the specific model as well as the maximum angular resolution $\ell_{\rm max}^{\rm GW}$ of the GWIs, their designed sensitivity, and the amplitude $A_*$ of the monopole of the SGWB.


title: Concave Utility Reinforcement Learning: the Mean-Field Game Viewpoint

abstract: Concave Utility Reinforcement Learning (CURL) extends RL from linear to concave utilities in the occupancy measure induced by the agent's policy. This encompasses not only RL but also imitation learning and exploration, among others. Yet, this more general paradigm invalidates the classical Bellman equations, and calls for new algorithms. Mean-field Games (MFGs) are a continuous approximation of many-agent RL. They consider the limit case of a continuous distribution of identical agents, anonymous with symmetric interests, and reduce the problem to the study of a single representative agent in interaction with the full population. Our core contribution consists in showing that CURL is a subclass of MFGs. We think this important to bridge together both communities. It also allows to shed light on aspects of both fields: we show the equivalence between concavity in CURL and monotonicity in the associated MFG, between optimality conditions in CURL and Nash equilibrium in MFG, or that Fictitious Play (FP) for this class of MFGs is simply Frank-Wolfe, bringing the first convergence rate for discrete-time FP for MFGs. We also experimentally demonstrate that, using algorithms recently introduced for solving MFGs, we can address the CURL problem more efficiently.


title: Positron elastic scattering by a semifilled-shell atom

abstract: We theoretically study the positron elastic scattering by an atom with a multielectron semifilled subshell in its structure. The positron scattering by the Mn($...3d^{5}4s^{2}$,$^{6}S)$ atom with a $3d^{5}$ semifilled subshell ($e^{+}+Mn$ scattering) is chosen as a case study. We account for both the electron correlation and the formation of a $e^{+}+e^{-}$ virtual positronium (Ps) in the intermediate states of the $e^{+}+Mn$ system. Electron correlation is taken into account in the framework of the self-energy part of the scattering positron Green function generalized for the application to semifilled-shell atoms. The influence of the virtual Ps formation on $e^{+}+Mn$ scattering is taken into account by the reduction of the energy of the virtual \textit{positron plus atomic-excited-configuration} states by the Ps-binding energy, to a reasonable approximation. We unravel the importance and specificity of the influence of both the virtual Ps and electron correlation on $e^{+}+Mn$ elastic scattering. We demonstrate spectacular differences between the electron and positron scattering processes.


title: Methods for estimating of continuants, corrected version

abstract: The purpose of [1] was as follows. ?We consider special sets of continuants which occur in applications. For these sets we solve the problem of finding maximal and minimal continuants. There are several methods for finding extremum such as thee: mathod of basic substitutions (section 4.1), method of quadratic irrationalities (section 4.2), majorizing inequalities (section 4.3) and unit variation (section 4.4).? Unfortunately, the text of [1] was littered with numerous typos, making it difficult to read. This defect is corrected in the present work. In addition, some of the statements are now provided with more detailed evidence.


title: Multi-armed Bandit Requiring Monotone Arm Sequences

abstract: In many online learning or multi-armed bandit problems, the taken actions or pulled arms are ordinal and required to be monotone over time. Examples include dynamic pricing, in which the firms use markup pricing policies to please early adopters and deter strategic waiting, and clinical trials, in which the dose allocation usually follows the dose escalation principle to prevent dose limiting toxicities. We consider the continuum-armed bandit problem when the arm sequence is required to be monotone. We show that when the unknown objective function is Lipschitz continuous, the regret is $O(T)$. When in addition the objective function is unimodal or quasiconcave, the regret is $\tilde O(T^{3/4})$ under the proposed algorithm, which is also shown to be the optimal rate. This deviates from the optimal rate $\tilde O(T^{2/3})$ in the continuous-armed bandit literature and demonstrates the cost to the learning efficiency brought by the monotonicity requirement.


title: Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions

abstract: Generalised linear models for multi-class classification problems are one of the fundamental building blocks of modern machine learning tasks. In this manuscript, we characterise the learning of a mixture of $K$ Gaussians with generic means and covariances via empirical risk minimisation (ERM) with any convex loss and regularisation. In particular, we prove exact asymptotics characterising the ERM estimator in high-dimensions, extending several previous results about Gaussian mixture classification in the literature. We exemplify our result in two tasks of interest in statistical learning: a) classification for a mixture with sparse means, where we study the efficiency of $\ell_1$ penalty with respect to $\ell_2$; b) max-margin multi-class classification, where we characterise the phase transition on the existence of the multi-class logistic maximum likelihood estimator for $K>2$. Finally, we discuss how our theory can be applied beyond the scope of synthetic data, showing that in different cases Gaussian mixtures capture closely the learning curve of classification tasks in real data sets.


title: Preference Discovery in Large Product Lines

abstract: When AI tools can generate many solutions, some human preference must be applied to determine which solution is relevant to the current project. One way to find those preferences is interactive search-based software engineering (iSBSE) where humans can influence the search process. Current iSBSE methods can lead to cognitive fatigue (when they overwhelm humans with too many overly elaborate questions). WHUN is an iSBSE algorithm that avoids that problem. Due to its recursive clustering procedure, WHUN only pesters humans for $O(log_2{N})$ interactions. Further, each interaction is mediated via a feature selection procedure that reduces the number of asked questions. When compared to prior state-of-the-art iSBSE systems, WHUN runs faster, asks fewer questions, and achieves better solutions that are within $0.1\%$ of the best solutions seen in our sample space. More importantly, WHUN scales to large problems (in our experiments, models with 1000 variables can be explored with half a dozen interactions where, each time, we ask only four questions). Accordingly, we recommend WHUN as a baseline against which future iSBSE work should be compared. To facilitate that, all our scripts are online at https://github.com/ai-se/whun.


title: Pointwise visual field estimation from optical coherence tomography in glaucoma: a structure-function analysis using deep learning

abstract: Background/Aims: Standard Automated Perimetry (SAP) is the gold standard to monitor visual field (VF) loss in glaucoma management, but is prone to intra-subject variability. We developed and validated a deep learning (DL) regression model that estimates pointwise and overall VF loss from unsegmented optical coherence tomography (OCT) scans. Methods: Eight DL regression models were trained with various retinal imaging modalities: circumpapillary OCT at 3.5mm, 4.1mm, 4.7mm diameter, and scanning laser ophthalmoscopy (SLO) en face images to estimate mean deviation (MD) and 52 threshold values. This retrospective study used data from patients who underwent a complete glaucoma examination, including a reliable Humphrey Field Analyzer (HFA) 24-2 SITA Standard VF exam and a SPECTRALIS OCT scan using the Glaucoma Module Premium Edition. Results: A total of 1378 matched OCT-VF pairs of 496 patients (863 eyes) were included for training and evaluation of the DL models. Average sample MD was -7.53dB (from -33.8dB to +2.0dB). For 52 VF threshold values estimation, the circumpapillary OCT scan with the largest radius (4.7mm) achieved the best performance among all individual models (Pearson r=0.77, 95% CI=[0.72-0.82]). For MD, prediction averaging of OCT-trained models (3.5mm, 4.1mm, 4.7mm) resulted in a Pearson r of 0.78 [0.73-0.83] on the validation set and comparable performance on the test set (Pearson r=0.79 [0.75-0.82]). Conclusion: DL on unsegmented OCT scans accurately predicts pointwise and mean deviation of 24-2 VF in glaucoma patients. Automated VF from unsegmented OCT could be a solution for patients unable to produce reliable perimetry results.


title: COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic

abstract: We introduce a FEVER-like dataset COVID-Fact of $4,086$ claims concerning the COVID-19 pandemic. The dataset contains claims, evidence for the claims, and contradictory claims refuted by the evidence. Unlike previous approaches, we automatically detect true claims and their source articles and then generate counter-claims using automatic methods rather than employing human annotators. Along with our constructed resource, we formally present the task of identifying relevant evidence for the claims and verifying whether the evidence refutes or supports a given claim. In addition to scientific claims, our data contains simplified general claims from media sources, making it better suited for detecting general misinformation regarding COVID-19. Our experiments indicate that COVID-Fact will provide a challenging testbed for the development of new systems and our approach will reduce the costs of building domain-specific datasets for detecting misinformation.


title: Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks

abstract: Neural network compression techniques have become increasingly popular as they can drastically reduce the storage and computation requirements for very large networks. Recent empirical studies have illustrated that even simple pruning strategies can be surprisingly effective, and several theoretical studies have shown that compressible networks (in specific senses) should achieve a low generalization error. Yet, a theoretical characterization of the underlying cause that makes the networks amenable to such simple compression schemes is still missing. In this study, we address this fundamental question and reveal that the dynamics of the training algorithm has a key role in obtaining such compressible networks. Focusing our attention on stochastic gradient descent (SGD), our main contribution is to link compressibility to two recently established properties of SGD: (i) as the network size goes to infinity, the system can converge to a mean-field limit, where the network weights behave independently, (ii) for a large step-size/batch-size ratio, the SGD iterates can converge to a heavy-tailed stationary distribution. In the case where these two phenomena occur simultaneously, we prove that the networks are guaranteed to be '$\ell_p$-compressible', and the compression errors of different pruning techniques (magnitude, singular value, or node pruning) become arbitrarily small as the network size increases. We further prove generalization bounds adapted to our theoretical framework, which indeed confirm that the generalization error will be lower for more compressible networks. Our theory and numerical study on various neural networks show that large step-size/batch-size ratios introduce heavy-tails, which, in combination with overparametrization, result in compressibility.


title: Enabling On-Device Self-Supervised Contrastive Learning With Selective Data Contrast

abstract: After a model is deployed on edge devices, it is desirable for these devices to learn from unlabeled data to continuously improve accuracy. Contrastive learning has demonstrated its great potential in learning from unlabeled data. However, the online input data are usually none independent and identically distributed (non-iid) and storages of edge devices are usually too limited to store enough representative data from different data classes. We propose a framework to automatically select the most representative data from the unlabeled input stream, which only requires a small data buffer for dynamic learning. Experiments show that accuracy and learning speed are greatly improved.


title: Drone-based AI and 3D Reconstruction for Digital Twin Augmentation

abstract: Digital Twin is an emerging technology at the forefront of Industry 4.0, with the ultimate goal of combining the physical space and the virtual space. To date, the Digital Twin concept has been applied in many engineering fields, providing useful insights in the areas of engineering design, manufacturing, automation, and construction industry. While the nexus of various technologies opens up new opportunities with Digital Twin, the technology requires a framework to integrate the different technologies, such as the Building Information Model used in the Building and Construction industry. In this work, an Information Fusion framework is proposed to seamlessly fuse heterogeneous components in a Digital Twin framework from the variety of technologies involved. This study aims to augment Digital Twin in buildings with the use of AI and 3D reconstruction empowered by unmanned aviation vehicles. We proposed a drone-based Digital Twin augmentation framework with reusable and customisable components. A proof of concept is also developed, and extensive evaluation is conducted for 3D reconstruction and applications of AI for defect detection.


title: DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering

abstract: We introduce DoubleField, a novel framework combining the merits of both surface field and radiance field for high-fidelity human reconstruction and rendering. Within DoubleField, the surface field and radiance field are associated together by a shared feature embedding and a surface-guided sampling strategy. Moreover, a view-to-view transformer is introduced to fuse multi-view features and learn view-dependent features directly from high-resolution inputs. With the modeling power of DoubleField and the view-to-view transformer, our method significantly improves the reconstruction quality of both geometry and appearance, while supporting direct inference, scene-specific high-resolution finetuning, and fast rendering. The efficacy of DoubleField is validated by the quantitative evaluations on several datasets and the qualitative results in a real-world sparse multi-view system, showing its superior capability for high-quality human model reconstruction and photo-realistic free-viewpoint human rendering. Data and source code will be made public for the research purpose. Please refer to our project page: http://www.liuyebin.com/dbfield/dbfield.html.


title: Deterministic Iteratively Built KD-Tree with KNN Search for Exact Applications

abstract: K-Nearest Neighbors (KNN) search is a fundamental algorithm in artificial intelligence software with applications in robotics, and autonomous vehicles. These wide-ranging applications utilize KNN either directly for simple classification or combine KNN results as input to other algorithms such as Locally Weighted Learning (LWL). Similar to binary trees, kd-trees become unbalanced as new data is added in online applications which can lead to rapid degradation in search performance unless the tree is rebuilt. Although approximate methods are suitable for graphics applications, which prioritize query speed over query accuracy, they are unsuitable for certain applications in autonomous systems, aeronautics, and robotic manipulation where exact solutions are desired. In this paper, we will attempt to assess the performance of non-recursive deterministic kd-tree functions and KNN functions. We will also present a "forest of interval kd-trees" which reduces the number of tree rebuilds, without compromising the exactness of query results.


title: Spatial non-locality of electronic correlations beyond GW approximation

abstract: The question of spatial locality of electronic correlations beyond GW approximation is one of the central issues of the famous combination of GW and dynamical mean field theory, GW+DMFT. In this work, the above question is addressed directly (for the first time) by performing calculations with and without assumption of locality of the corresponding diagrams. For this purpose we use sc(GW+G3W2) approach where the higher order part (G3W2) is evaluated with fully momentum dependent Green's function G and screened interaction W and with "local" variant, where the single site approximation is assumed for both G and W. For all three materials studied in this work (NiO, $\alpha$-Ce, LiFeAs), we have found the spatial non-locality effects to be strong. For NiO and LiFeAs they, in fact, are decisive for the proper evaluation of vertex corrections. The results of this study have direct impact on our understanding of approximations made in practical implementations of GW+DMFT method, where all diagrams beyond GW (DMFT part) are assumed to be local. Taking into account the fact that the first diagrams beyond GW represent the most important contribution also in GW+DMFT calculations, we conclude that the basic assumption of GW+DMFT, namely the locality of diagrams evaluated in the DMFT part, is not as good as it is believed to be.


title: Visual Transformer for Task-aware Active Learning

abstract: Pool-based sampling in active learning (AL) represents a key framework for an-notating informative data when dealing with deep learning models. In this paper, we present a novel pipeline for pool-based Active Learning. Unlike most previous works, our method exploits accessible unlabelled examples during training to estimate their co-relation with the labelled examples. Another contribution of this paper is to adapt Visual Transformer as a sampler in the AL pipeline. Visual Transformer models non-local visual concept dependency between labelled and unlabelled examples, which is crucial to identifying the influencing unlabelled examples. Also, compared to existing methods where the learner and the sampler are trained in a multi-stage manner, we propose to train them in a task-aware jointly manner which enables transforming the latent space into two separate tasks: one that classifies the labelled examples; the other that distinguishes the labelling direction. We evaluated our work on four different challenging benchmarks of classification and detection tasks viz. CIFAR10, CIFAR100,FashionMNIST, RaFD, and Pascal VOC 2007. Our extensive empirical and qualitative evaluations demonstrate the superiority of our method compared to the existing methods. Code available: https://github.com/razvancaramalau/Visual-Transformer-for-Task-aware-Active-Learning


title: Learning to Efficiently Sample from Diffusion Probabilistic Models

abstract: Denoising Diffusion Probabilistic Models (DDPMs) have emerged as a powerful family of generative models that can yield high-fidelity samples and competitive log-likelihoods across a range of domains, including image and speech synthesis. Key advantages of DDPMs include ease of training, in contrast to generative adversarial networks, and speed of generation, in contrast to autoregressive models. However, DDPMs typically require hundreds-to-thousands of steps to generate a high fidelity sample, making them prohibitively expensive for high dimensional problems. Fortunately, DDPMs allow trading generation speed for sample quality through adjusting the number of refinement steps as a post process. Prior work has been successful in improving generation speed through handcrafting the time schedule by trial and error. We instead view the selection of the inference time schedules as an optimization problem, and introduce an exact dynamic programming algorithm that finds the optimal discrete time schedules for any pre-trained DDPM. Our method exploits the fact that ELBO can be decomposed into separate KL terms, and given any computation budget, discovers the time schedule that maximizes the training ELBO exactly. Our method is efficient, has no hyper-parameters of its own, and can be applied to any pre-trained DDPM with no retraining. We discover inference time schedules requiring as few as 32 refinement steps, while sacrificing less than 0.1 bits per dimension compared to the default 4,000 steps used on ImageNet 64x64 [Ho et al., 2020; Nichol and Dhariwal, 2021].


title: A note on formal periods

abstract: We give an elementary description of the space of formal periods of a mixed motive. This allows for a simplified reformulation of the period conjectures of Grothendieck and Kontsevich-Zagier. Furthermore, we develop a machinery which in principle allows to determine the space of formal periods for an arbitrary mixed motive explicitly.


title: Deep Medial Fields

abstract: Implicit representations of geometry, such as occupancy fields or signed distance fields (SDF), have recently re-gained popularity in encoding 3D solid shape in a functional form. In this work, we introduce medial fields: a field function derived from the medial axis transform (MAT) that makes available information about the underlying 3D geometry that is immediately useful for a number of downstream tasks. In particular, the medial field encodes the local thickness of a 3D shape, and enables O(1) projection of a query point onto the medial axis. To construct the medial field we require nothing but the SDF of the shape itself, thus allowing its straightforward incorporation in any application that relies on signed distance fields. Working in unison with the O(1) surface projection supported by the SDF, the medial field opens the door for an entirely new set of efficient, shape-aware operations on implicit representations. We present three such applications, including a modification to sphere tracing that renders implicit representations with better convergence properties, a fast construction method for memory-efficient rigid-body collision proxies, and an efficient approximation of ambient occlusion that remains stable with respect to viewpoint variations.


title: 3DB: A Framework for Debugging Computer Vision Models

abstract: We introduce 3DB: an extendable, unified framework for testing and debugging vision models using photorealistic simulation. We demonstrate, through a wide range of use cases, that 3DB allows users to discover vulnerabilities in computer vision systems and gain insights into how models make decisions. 3DB captures and generalizes many robustness analyses from prior work, and enables one to study their interplay. Finally, we find that the insights generated by the system transfer to the physical world. We are releasing 3DB as a library (https://github.com/3db/3db) alongside a set of example analyses, guides, and documentation: https://3db.github.io/3db/ .


title: Deep Context- and Relation-Aware Learning for Aspect-based Sentiment Analysis

abstract: Existing works for aspect-based sentiment analysis (ABSA) have adopted a unified approach, which allows the interactive relations among subtasks. However, we observe that these methods tend to predict polarities based on the literal meaning of aspect and opinion terms and mainly consider relations implicitly among subtasks at the word level. In addition, identifying multiple aspect-opinion pairs with their polarities is much more challenging. Therefore, a comprehensive understanding of contextual information w.r.t. the aspect and opinion are further required in ABSA. In this paper, we propose Deep Contextualized Relation-Aware Network (DCRAN), which allows interactive relations among subtasks with deep contextual information based on two modules (i.e., Aspect and Opinion Propagation and Explicit Self-Supervised Strategies). Especially, we design novel self-supervised strategies for ABSA, which have strengths in dealing with multiple aspects. Experimental results show that DCRAN significantly outperforms previous state-of-the-art methods by large margins on three widely used benchmarks.


title: Analysis of Magnetohydrodynamic Perturbations in Radial-field Solar Wind from Parker Solar Probe Observations

abstract: We report analysis of sub-Alfv\'enic magnetohydrodynamic (MHD) perturbations in the low-\b{eta} radial-field solar wind using the Parker Solar Probe spacecraft data from 31 October to 12 November 2018. We calculate wave vectors using the singular value decomposition method and separate the MHD perturbations into three types of linear eigenmodes (Alfv\'en, fast, and slow modes) to explore the properties of the sub-Alfv\'enic perturbations and the role of compressible perturbations in solar wind heating. The MHD perturbations there show a high degree of Alfv\'enicity in the radial-field solar wind, with the energy fraction of Alfv\'en modes dominating (~45%-83%) over those of fast modes (~16%-43%) and slow modes (~1%-19%). We present a detailed analysis of a representative event on 10 November 2018. Observations show that fast modes dominate magnetic compressibility, whereas slow modes dominate density compressibility. The energy damping rate of compressible modes is comparable to the heating rate, suggesting the collisionless damping of compressible modes could be significant for solar wind heating. These results are valuable for further studies of the imbalanced turbulence near the Sun and possible heating effects of compressible modes at MHD scales in low-\b{eta} plasma.


title: Lipschitz Estimates for Conformal Maps from the Unit Disk to Convex Domains

abstract: We obtain an explicit uniform upper bound for the derivative of a conformal mapping of the unit disk onto a convex domain. This estimate depends only on the outer and inner radii of the domain, and on a curvature radius of its boundary. Its proof is based on a M\"obius invariant metric of hyperbolic type, introduced by Kulkarni and Pinkall in 1994.


title: Descent of equivalences for blocks with Klein four defect groups

abstract: We show that the splendid Rickard complexes for blocks with Klein four defect groups constructed by Rickard and Linckelmann descend to non-split fields. As a corollary, Navarro's refinement of the Alperin-McKay conjecture holds for blocks with a Klein four defect group. We also prove that splendid Morita equivalences between blocks and their Brauer correspondents (if exist) descend to non-split situations.


title: New applications to combinatorics and invariant matrix norms of an integral representation of natural powers of the numerical values

abstract: Let $\vee^k A$ be the $k$-th symmetric tensor power of $A\in M_n(\mathbb{C})$. In \cite{IAM}, we have expressed the normalized trace of $\vee^kA$ as an integral of the $k$-th powers of the numerical values of $A$ over the unit sphere $\mathbb{S}^{n}$ of $\mathbb{C}^{n}$ with respect to the normalized Euclidean surface measure $\sigma$. In this paper, we first use this integral representation to construct a family of unitarily invariant norms on $ M_n(\mathbb{C})$ and then explore their relations to Schatten-norms of $\vee^k A$. Another application yields a connection between the analysis of symmetric gauge functions with that of complete symmetric polynomials. Finally, motivated by the work of R. Bhatia and J. Holbrook in \cite{hol}, and as pointed out by R. Bhatia in \cite{bhatia} in the development of the theory of weakly unitarily invariant norms, we provide an explicit form for the weakly unitarily invariant norm corresponding to the $L^4$-norm on the space $C(\mathbb{S}^{n})$ of continuous functions on the sphere. Our result generalize those of R. Bhatia and J. Holbrook in different directions and pave the way to a technique for computing those weakly unitarily invariant norms on $ M_n(\mathbb{C})$ that are associated to $L^{2k}$-norms on $C(\mathbb{S}^{n})$.


title: Estimating the size of a closed population by modeling latent and observed heterogeneity

abstract: The paper describes a new class of capture-recapture models for closed populations when individual covariates are available. The novelty consists in combining a latent class model for the distribution of the capture history, where the class weights and the conditional distributions given the latent may depend on covariates, with a model for the marginal distribution of the available covariates as in \cite{Liu2017}. In addition, any general form of serial dependence is allowed when modeling capture histories conditionally on the latent and covariates. A Fisher-scoring algorithm for maximum likelihood estimation is proposed, and the Implicit Function Theorem is used to show that the mapping between the marginal distribution of the observed covariates and the probabilities of being never captured is one-to-one. Asymptotic results are outlined, and a procedure for constructing likelihood based confidence intervals for the population size is presented. Two examples based on real data are used to illustrate the proposed approach


title: Neural Monge Map estimation and its applications

abstract: Monge map refers to the optimal transport map between two probability distributions and provides a principled approach to transform one distribution to another. Neural network based optimal transport map solver has gained great attention in recent years. Along this line, we present a scalable algorithm for computing the neural Monge map between two probability distributions. Our algorithm is based on a weak form of the optimal transport problem, thus it only requires samples from the marginals instead of their analytic expressions, and can accommodate optimal transport between two distributions with different dimensions. Our algorithm is suitable for general cost functions, compared with other existing methods for estimating Monge maps using samples, which are usually for quadratic costs. The performance of our algorithms is demonstrated through a series of experiments with both synthetic and realistic data, including text-to-image generation and image inpainting tasks.


title: Index formula for Hamiltonian loop group spaces

abstract: We study K-theory classes of Hamiltonian loop group spaces represented by admissible Fredholm complexes. We prove various equivariant index formulae in this context. In a sequel to this article we show that, when specialized to a family of non-local elliptic boundary value problems over the moduli space of framed flat connections on a surface, one obtains a gauge theory analogue of the Teleman-Woodward index formula.


title: High Resolution Solar Image Generation using Generative Adversarial Networks

abstract: We applied Deep Learning algorithm known as Generative Adversarial Networks (GANs) to perform solar image-to-image translation. That is, from Solar Dynamics Observatory (SDO)/Helioseismic and Magnetic Imager(HMI) line of sight magnetogram images to SDO/Atmospheric Imaging Assembly(AIA) 0304-{\AA} images. The Ultraviolet(UV)/Extreme Ultraviolet(EUV) observations like the SDO/AIA0304-{\AA} images were only made available to scientists in the late 1990s even though the magenetic field observations like the SDO/HMI have been available since the 1970s. Therefore by leveraging Deep Learning algorithms like GANs we can give scientists access to complete datasets for analysis. For generating high resolution solar images we use the Pix2PixHD and Pix2Pix algorithms. The Pix2PixHD algorithm was specifically designed for high resolution image generation tasks, and the Pix2Pix algorithm is by far the most widely used image to image translation algorithm. For training and testing we used the data for the year 2012, 2013 and 2014. The results show that our deep learning models are capable of generating high resolution(1024 x 1024 pixels) AIA0304 images from HMI magnetograms. Specifically, the pixel-to-pixel Pearson Correlation Coefficient of the images generated by Pix2PixHD and original images is as high as 0.99. The number is 0.962 if Pix2Pix is used to generate images. The results we get for our Pix2PixHD model is better than the results obtained by previous works done by others to generate AIA0304 images. Thus, we can use these models to generate AIA0304 images when the AIA0304 data is not available which can be used for understanding space weather and giving researchers the capability to predict solar events such as Solar Flares and Coronal Mass Ejections. As far as we know, our work is the first attempt to leverage Pix2PixHD algorithm for SDO/HMI to SDO/AIA0304 image-to-image translation.


title: QKD based on symmetric entangled Bernstein-Vazirani

abstract: This paper introduces a novel entanglement-based QKD protocol, that makes use of a modified symmetric version of the Bernstein-Vazirani algorithm, in order to achieve a secure and efficient key distribution. Two variants of the protocol, one fully symmetric and one semi-symmetric, are presented. In both cases, the spatially separated Alice and Bob share multiple EPR pairs, one qubit of the pair each. The fully symmetric version allows both parties to input a secret key from the irrespective location and, finally, acquire in the end a totally new and original key, an idea which was inspired by the Diffie-Hellman key exchange protocol. In the semi-symmetric version, Alice sends her chosen secret key to Bob (or vice versa). Furthermore, their performance against an eavesdropper's attack is analyzed. Finally, in order to illustrate the operation of the protocols in practice, two small scale but detailed examples are given.


title: Diversity driven Query Rewriting in Search Advertising

abstract: Retrieving keywords (bidwords) with the same intent as query, referred to as close variant keywords, is of prime importance for effective targeted search advertising. For head and torso search queries, sponsored search engines use a huge repository of same intent queries and keywords, mined ahead of time. Online, this repository is used to rewrite the query and then lookup the rewrite in a repository of bid keywords contributing to significant revenue. Recently generative retrieval models have been shown to be effective at the task of generating such query rewrites. We observe two main limitations of such generative models. First, rewrites generated by these models exhibit low lexical diversity, and hence the rewrites fail to retrieve relevant keywords that have diverse linguistic variations. Second, there is a misalignment between the training objective - the likelihood of training data, v/s what we desire - improved quality and coverage of rewrites. In this work, we introduce CLOVER, a framework to generate both high-quality and diverse rewrites by optimizing for human assessment of rewrite quality using our diversity-driven reinforcement learning algorithm. We use an evaluation model, trained to predict human judgments, as the reward function to finetune the generation policy. We empirically show the effectiveness of our proposed approach through offline experiments on search queries across geographies spanning three major languages. We also perform online A/B experiments on Bing, a large commercial search engine, which shows (i) better user engagement with an average increase in clicks by 12.83% accompanied with an average defect reduction by 13.97%, and (ii) improved revenue by 21.29%.


title: Cayley-Klein Lie bialgebras: Noncommutative spaces, Drinfel'd doubles and kinematical applications

abstract: The Cayley-Klein (CK) formalism is applied to the real algebra ${so}(5)$ by making use of four graded contraction parameters describing in a unified setting 81 Lie algebras, which cover the (anti-)de Sitter, Poincar\'e, Newtonian and Carrollian algebras. Starting with the Drinfel'd-Jimbo real Lie bialgebra for ${so}(5)$ together with its Drinfel'd double structure, we obtain the corresponding CK bialgebra and the CK $r$-matrix coming from a Drinfel'd double. As a novelty, we construct the (first-order) noncommutative CK spaces of points, lines, 2-planes and 3-hyperplanes, studying their structural properties. By requiring to deal with real structures, it comes out that there exist 63 specific real Lie bialgebras together with their sets of four noncommutative spaces. Furthermore, we find 14 classical $r$-matrices coming from Drinfel'd doubles, obtaining new results for the de Sitter ${so}(4,1)$ and anti-de Sitter ${so}(3,2)$ and for some of their contractions. These geometric results are exhaustively applied onto the (3+1)D kinematical algebras, not only considering the usual (3+1)D spacetime but also the 6D space of lines. We establish different assignations between the geometrical CK generators and the kinematical ones which convey physical identifications for the CK contraction parameters in terms of the cosmological constant/curvature $\Lambda$ and speed of light $c$. We finally obtain four classes of kinematical $r$-matrices together with their noncommutative spacetimes and spaces of lines, comprising all $\kappa$-deformations as particular cases.


title: Ultrafast adsorbate excitation probed with sub-ps resolution XAS

abstract: We use a pump-probe scheme to measure the time evolution of the C K-edge X-ray absorption spectrum (XAS) from CO/Ru(0001) after excitation by an ultrashort high-intensity optical laser pulse. Due to the short duration of the X-ray probe pulse and precise control of the pulse delay, the excitation-induced dynamics during the first ps after the pump can be resolved with unprecedented time resolution. By comparing with theoretical (DFT) spectrum calculations we find high excitation of the internal stretch and frustrated rotation modes occurring within 200 fs of laser excitation, as well as thermalization of the system in the ps regime. The ~100 fs initial excitation of these CO vibrational modes is not readily rationalized by traditional theories of nonadiabatic coupling of adsorbates to metal surfaces, e. g. electronic frictions based on first order electron-phonon coupling or transient population of adsorbate resonances. We suggest that coupling of the adsorbate to non-thermalized electron-hole pairs is responsible for the ultrafast initial excitation of the modes.


title: A Semi-Personalized System for User Cold Start Recommendation on Music Streaming Apps

abstract: Music streaming services heavily rely on recommender systems to improve their users' experience, by helping them navigate through a large musical catalog and discover new songs, albums or artists. However, recommending relevant and personalized content to new users, with few to no interactions with the catalog, is challenging. This is commonly referred to as the user cold start problem. In this applied paper, we present the system recently deployed on the music streaming service Deezer to address this problem. The solution leverages a semi-personalized recommendation strategy, based on a deep neural network architecture and on a clustering of users from heterogeneous sources of information. We extensively show the practical impact of this system and its effectiveness at predicting the future musical preferences of cold start users on Deezer, through both offline and online large-scale experiments. Besides, we publicly release our code as well as anonymized usage data from our experiments. We hope that this release of industrial resources will benefit future research on user cold start recommendation.


title: Accurate Shapley Values for explaining tree-based models

abstract: Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive the correct approach for computing the SV of categorical variables that are particularly sensitive to the encoding used. In the case of tree-based models, we introduce two estimators of Shapley Values that exploit the tree structure efficiently and are more accurate than state-of-the-art methods. Simulations and comparisons are performed with state-of-the-art algorithms and show the practical gain of our approach. Finally, we discuss the limitations of Shapley Values as a local explanation. These methods are available as a Python package.


title: Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-based Multimodal Fusion

abstract: It is now well established from a variety of studies that there is a significant benefit from combining video and audio data in detecting active speakers. However, either of the modalities can potentially mislead audiovisual fusion by inducing unreliable or deceptive information. This paper outlines active speaker detection as a multi-objective learning problem to leverage best of each modalities using a novel self-attention, uncertainty-based multimodal fusion scheme. Results obtained show that the proposed multi-objective learning architecture outperforms traditional approaches in improving both mAP and AUC scores. We further demonstrate that our fusion strategy surpasses, in active speaker detection, other modality fusion methods reported in various disciplines. We finally show that the proposed method significantly improves the state-of-the-art on the AVA-ActiveSpeaker dataset.


title: Energy and Age Pareto Optimal Trajectories in UAV-assisted Wireless Data Collection

abstract: This paper studies an unmanned aerial vehicle (UAV)-assisted wireless network, where a UAV is dispatched to gather information from ground sensor nodes (SN) and transfer the collected data to the depot. The information freshness is captured by the age of information (AoI) metric, whilst the energy consumption of the UAV is seen as another performance criterion. Most importantly, the AoI and energy efficiency are inherently competing metrics, since decreasing the AoI requires the UAV returning to the depot more frequently, leading to a higher energy consumption. To this end, we design UAV paths that optimize these two competing metrics and reveal the Pareto frontier. To formulate this problem, a multi-objective mixed integer linear programming (MILP) is proposed with a flow-based constraint set and we apply Bender's decomposition on the proposed formulation. The overall outcome shows that the proposed method allows deriving non-dominated solutions for decision making for UAV based wireless data collection. Numerical results are provided to corroborate our study by presenting the Pareto front of the two objectives and the effect on the UAV trajectory.


title: Multivariate Probabilistic Regression with Natural Gradient Boosting

abstract: Many single-target regression problems require estimates of uncertainty along with the point predictions. Probabilistic regression algorithms are well-suited for these tasks. However, the options are much more limited when the prediction target is multivariate and a joint measure of uncertainty is required. For example, in predicting a 2D velocity vector a joint uncertainty would quantify the probability of any vector in the plane, which would be more expressive than two separate uncertainties on the x- and y- components. To enable joint probabilistic regression, we propose a Natural Gradient Boosting (NGBoost) approach based on nonparametrically modeling the conditional parameters of the multivariate predictive distribution. Our method is robust, works out-of-the-box without extensive tuning, is modular with respect to the assumed target distribution, and performs competitively in comparison to existing approaches. We demonstrate these claims in simulation and with a case study predicting two-dimensional oceanographic velocity data. An implementation of our method is available at https://github.com/stanfordmlgroup/ngboost.


title: Parallel Batch-Dynamic Algorithms for $k$-Core Decomposition and Related Graph Problems

abstract: Maintaining a $k$-core decomposition quickly in a dynamic graph has important applications in network analysis. The main challenge for designing efficient exact algorithms is that a single update to the graph can cause significant global changes. Our paper focuses on \emph{approximation} algorithms with small approximation factors that are much more efficient than what exact algorithms can obtain. We present the first parallel, batch-dynamic algorithm for approximate $k$-core decomposition that is efficient in both theory and practice. Our algorithm is based on our novel parallel level data structure, inspired by the sequential level data structures of Bhattacharya et al [STOC '15] and Henzinger et al [2020]. Given a graph with $n$ vertices and a batch of updates $\mathcal{B}$, our algorithm provably maintains a $(2 + \varepsilon)$-approximation of the coreness values of all vertices (for any constant $\varepsilon > 0$) in $O(|\mathcal{B}|\log^2 n)$ amortized work and $O(\log^2 n \log\log n)$ depth (parallel time) with high probability. As a by-product, our $k$-core decomposition algorithm also gives a batch-dynamic algorithm for maintaining an $O(\alpha)$ out-degree orientation, where $\alpha$ is the current arboricity of the graph. We demonstrate the usefulness of our low out-degree orientation algorithm by presenting a new framework to formally study batch-dynamic algorithms in bounded-arboricity graphs. Our framework obtains new provably-efficient parallel batch-dynamic algorithms for maximal matching, clique counting, and vertex coloring. We implemented and experimentally evaluated our $k$-core decomposition algorithm on a 30-core machine with two-way hyper-threading on $11$ graphs of varying densities and sizes. [...]


title: On the emergence of quantum Boltzmann fluctuation dynamics near a Bose-Einstein Condensate

abstract: In this work, we study the quantum fluctuation dynamics in a Bose gas on a torus $\Lambda=(L\mathbb{T})^3$ that exhibits Bose-Einstein condensation, beyond the leading order Hartree-Fock-Bogoliubov (HFB) fluctuations. Given a Bose-Einstein condensate (BEC) with density $N$ surrounded by thermal fluctuations with density $1$, we assume that the system is described by a mean-field Hamiltonian. We extract a quantum Boltzmann type dynamics from a second-order Duhamel expansion upon subtracting both the BEC dynamics and the HFB dynamics. Using a Fock-space approach, we provide explicit error bounds. It is known that the BEC and the HFB fluctuations both evolve at microscopic time scales $t\sim1$. Given a quasifree initial state, we determine the time evolution of the centered correlation functions $\langle a\rangle$, $\langle aa\rangle-\langle a\rangle^2$, $\langle a^+a\rangle-|\langle a\rangle|^2$ at mesoscopic time scales $t\sim\lambda^{-2}$, where $0<\lambda\ll1$ denotes the size of the HFB interaction. For large but finite $N$, we consider both the case of fixed system size $L\sim1$, and the case $L\sim \lambda^{-2-}$. In the case $L\sim1$, we show that the Boltzmann collision operator contains subleading terms that can become dominant, depending on time-dependent coefficients assuming particular values in $\mathbb{Q}$; this phenomenon is reminiscent of the Talbot effect. For the case $L\sim \lambda^{-2-}$, we prove that the collision operator is well approximated by the expression predicted in the literature. In either of those cases, we have $\lambda\sim \Big(\frac{\log \log N}{\log N}\Big)^{\alpha}$, for different values of $\alpha>0$.


title: Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study

abstract: Recent advancements in open-domain question answering (ODQA), i.e., finding answers from large open-domain corpus like Wikipedia, have led to human-level performance on many datasets. However, progress in QA over book stories (Book QA) lags behind despite its similar task formulation to ODQA. This work provides a comprehensive and quantitative analysis about the difficulty of Book QA: (1) We benchmark the research on the NarrativeQA dataset with extensive experiments with cutting-edge ODQA techniques. This quantifies the challenges Book QA poses, as well as advances the published state-of-the-art with a $\sim$7\% absolute improvement on Rouge-L. (2) We further analyze the detailed challenges in Book QA through human studies.\footnote{\url{https://github.com/gorov/BookQA}.} Our findings indicate that the event-centric questions dominate this task, which exemplifies the inability of existing QA models to handle event-oriented scenarios.


title: Stateful Strategic Regression

abstract: Automated decision-making tools increasingly assess individuals to determine if they qualify for high-stakes opportunities. A recent line of research investigates how strategic agents may respond to such scoring tools to receive favorable assessments. While prior work has focused on the short-term strategic interactions between a decision-making institution (modeled as a principal) and individual decision-subjects (modeled as agents), we investigate interactions spanning multiple time-steps. In particular, we consider settings in which the agent's effort investment today can accumulate over time in the form of an internal state - impacting both his future rewards and that of the principal. We characterize the Stackelberg equilibrium of the resulting game and provide novel algorithms for computing it. Our analysis reveals several intriguing insights about the role of multiple interactions in shaping the game's outcome: First, we establish that in our stateful setting, the class of all linear assessment policies remains as powerful as the larger class of all monotonic assessment policies. While recovering the principal's optimal policy requires solving a non-convex optimization problem, we provide polynomial-time algorithms for recovering both the principal and agent's optimal policies under common assumptions about the process by which effort investments convert to observable features. Most importantly, we show that with multiple rounds of interaction at her disposal, the principal is more effective at incentivizing the agent to accumulate effort in her desired direction. Our work addresses several critical gaps in the growing literature on the societal impacts of automated decision-making - by focusing on longer time horizons and accounting for the compounding nature of decisions individuals receive over time.


title: A $q$-deformation of an algebra of Klyachko and Macdonald's reduced word formula

abstract: There is a striking similarity between Macdonald's reduced word formula and the image of the Schubert class in the cohomology ring of the permutahedral variety $\mathrm{Perm}_n$ as computed by Klyachko. Toward understanding this better, we undertake an in-depth study of a $q$-deformation of the $\mathbb{S}_n$-invariant part of the rational cohomology ring of $\mathrm{Perm}_n$, which we call the $q$-Klyachko algebra. We uncover intimate links between expansions in the basis of squarefree monomials in this algebra and various notions in algebraic combinatorics, thereby connecting seemingly unrelated results by finding a common ground to study them. Our main results are as follows. 1) A $q$-analog of divided symmetrization ($q$-DS) using Yang-Baxter elements in the Hecke algebra. It is a linear form that picks up coefficients in the squarefree basis. 2) A relation between $q$-DS and the ideal of quasisymmetric polynomials involving work of Aval--Bergeron--Bergeron. 3) A family of polynomials in $q$ with nonnegative integral coefficients that specialize to Postnikov's mixed Eulerian numbers when $q=1$. We refer to these new polynomials as remixed Eulerian numbers. For $q>0$, their normalized versions occur as probabilities in the internal diffusion limited aggregation (IDLA) stochastic process. 4) A lift of Macdonald's reduced word identity in the $q$-Klyachko algebra. 5) The Schubert expansion of the Chow class of the standard split Deligne--Lusztig variety in type $A$, when $q$ is a prime power.


title: First detection of threshold crossing events under intermittent sensing

abstract: The time of the first occurrence of a threshold crossing event in a stochastic process, known as the first passage time, is of interest in many areas of sciences and engineering. Conventionally, there is an implicit assumption that the notional 'sensor' monitoring the threshold crossing event is always active. In many realistic scenarios, the sensor monitoring the stochastic process works intermittently. Then, the relevant quantity of interest is the $\textit{first detection time}$, which denotes the time when the sensor detects the threshold crossing event for the first time. In this work, a birth-death process monitored by a random intermittent sensor is studied, for which the first detection time distribution is obtained. In general, it is shown that the first detection time is related to, and is obtainable from, the first passage time distribution. Our analytical results display an excellent agreement with simulations. Further, this framework is demonstrated in several applications -- the SIS compartmental and logistic models, and birth-death processes with resetting. Finally, we solve the practically relevant problem of inferring the first passage time distribution from the first detection time.

categories: cond-mat.stat-mech math.PR physics.data-an physics.soc-ph


title: A Simple Recipe for Multilingual Grammatical Error Correction

abstract: This paper presents a simple recipe to train state-of-the-art multilingual Grammatical Error Correction (GEC) models. We achieve this by first proposing a language-agnostic method to generate a large number of synthetic examples. The second ingredient is to use large-scale multilingual language models (up to 11B parameters). Once fine-tuned on language-specific supervised sets we surpass the previous state-of-the-art results on GEC benchmarks in four languages: English, Czech, German and Russian. Having established a new set of baselines for GEC, we make our results easily reproducible and accessible by releasing a cLang-8 dataset. It is produced by using our best model, which we call gT5, to clean the targets of a widely used yet noisy lang-8 dataset. cLang-8 greatly simplifies typical GEC training pipelines composed of multiple fine-tuning stages -- we demonstrate that performing a single fine-tuning step on cLang-8 with the off-the-shelf language models yields further accuracy improvements over an already top-performing gT5 model for English.


title: Counterfactual Maximum Likelihood Estimation for Training Deep Networks

abstract: Although deep learning models have driven state-of-the-art performance on a wide array of tasks, they are prone to spurious correlations that should not be learned as predictive clues. To mitigate this problem, we propose a causality-based training framework to reduce the spurious correlations caused by observed confounders. We give theoretical analysis on the underlying general Structural Causal Model (SCM) and propose to perform Maximum Likelihood Estimation (MLE) on the interventional distribution instead of the observational distribution, namely Counterfactual Maximum Likelihood Estimation (CMLE). As the interventional distribution, in general, is hidden from the observational data, we then derive two different upper bounds of the expected negative log-likelihood and propose two general algorithms, Implicit CMLE and Explicit CMLE, for causal predictions of deep learning models using observational data. We conduct experiments on both simulated data and two real-world tasks: Natural Language Inference (NLI) and Image Captioning. The results show that CMLE methods outperform the regular MLE method in terms of out-of-domain generalization performance and reducing spurious correlations, while maintaining comparable performance on the regular evaluations.


title: Pattern Recognition on Oriented Matroids: Symmetric Cycles in the Hypercube Graphs. V

abstract: We consider decompositions of topes of the oriented matroid realizable as the arrangement of coordinate hyperplanes in $\mathbb{R}^{2^t}$, with respect to a distinguished symmetric $2\cdot 2^t$-cycle in its hypercube graph of topes $\boldsymbol{H}(2^t,2)$. We seek interpretations of such decompositions in the context of subset families on the ground set $E_t:=\{1,\ldots,t\}$ and of the families of their blocking sets, in the context of clutters on $E_t$ and of their blockers.


title: Learning without Knowing: Unobserved Context in Continuous Transfer Reinforcement Learning

abstract: In this paper, we consider a transfer Reinforcement Learning (RL) problem in continuous state and action spaces, under unobserved contextual information. For example, the context can represent the mental view of the world that an expert agent has formed through past interactions with this world. We assume that this context is not accessible to a learner agent who can only observe the expert data. Then, our goal is to use the context-aware expert data to learn an optimal context-unaware policy for the learner using only a few new data samples. Such problems are typically solved using imitation learning that assumes that both the expert and learner agents have access to the same information. However, if the learner does not know the expert context, using the expert data alone will result in a biased learner policy and will require many new data samples to improve. To address this challenge, in this paper, we formulate the learning problem as a causal bound-constrained Multi-Armed-Bandit (MAB) problem. The arms of this MAB correspond to a set of basis policy functions that can be initialized in an unsupervised way using the expert data and represent the different expert behaviors affected by the unobserved context. On the other hand, the MAB constraints correspond to causal bounds on the accumulated rewards of these basis policy functions that we also compute from the expert data. The solution to this MAB allows the learner agent to select the best basis policy and improve it online. And the use of causal bounds reduces the exploration variance and, therefore, improves the learning rate. We provide numerical experiments on an autonomous driving example that show that our proposed transfer RL method improves the learner's policy faster compared to existing imitation learning methods and enjoys much lower variance during training.


title: Khovanov homology for links in thickened multipunctured disks

abstract: We define a variant of Khovanov homology for links in thickened disks with multiple punctures. This theory is distinct from the one previously defined by Asaeda, Przytycki, and Sikora, but is related to it by a spectral sequence. Additionally, we show that there are spectral sequences induced by embeddings of thickened surfaces, which recover the spectral sequence from annular Khovanov homology to Khovanov homology as a special case.


title: Negative Times of the Davey-Stewartson Integrable Hierarchy

abstract: We use example of the Davey-Stewartson hierarchy to show that in addition to the standard equations given by Lax operator and evolutions of times with positive numbers, one can consider time evolutions with negative numbers and the same Lax operator. We derive corresponding Lax pairs and integrable equations.


title: Tunable Trajectory Planner Using G3 Curves

abstract: Trajectory planning is commonly used as part of a local planner in autonomous driving. This paper considers the problem of planning a continuous-curvature-rate trajectory between fixed start and goal states that minimizes a tunable trade-off between passenger comfort and travel time. The problem is an instance of infinite dimensional optimization over two continuous functions: a path, and a velocity profile. We propose a simplification of this problem that facilitates the discretization of both functions. This paper also proposes a method to quickly generate minimal-length paths between start and goal states based on a single tuning parameter: the second derivative of curvature. Furthermore, we discretize the set of velocity profiles along a given path into a selection of acceleration way-points along the path. Gradient-descent is then employed to minimize cost over feasible choices of the second derivative of curvature, and acceleration way-points, resulting in a method that repeatedly solves the path and velocity profiles in an iterative fashion. Numerical examples are provided to illustrate the benefits of the proposed methods.


title: MemStream: Memory-Based Streaming Anomaly Detection

abstract: Given a stream of entries over time in a multi-dimensional data setting where concept drift is present, how can we detect anomalous activities? Most of the existing unsupervised anomaly detection approaches seek to detect anomalous events in an offline fashion and require a large amount of data for training. This is not practical in real-life scenarios where we receive the data in a streaming manner and do not know the size of the stream beforehand. Thus, we need a data-efficient method that can detect and adapt to changing data trends, or concept drift, in an online manner. In this work, we propose MemStream, a streaming anomaly detection framework, allowing us to detect unusual events as they occur while being resilient to concept drift. We leverage the power of a denoising autoencoder to learn representations and a memory module to learn the dynamically changing trend in data without the need for labels. We prove the optimum memory size required for effective drift handling. Furthermore, MemStream makes use of two architecture design choices to be robust to memory poisoning. Experimental results show the effectiveness of our approach compared to state-of-the-art streaming baselines using $2$ synthetic datasets and $11$ real-world datasets.


title: The quantum $p$-spin glass model: A user manual for holographers

abstract: We study a large-$N$ bosonic quantum mechanical sigma-model with a spherical target space subject to disordered interactions, more colloquially known as the $p$-spin spherical model. Replica symmetry is broken at low temperatures and for sufficiently weak quantum fluctuations, which drives the system into a spin glass phase. The first half of this paper is dedicated to a discussion of this model's thermodynamics, with particular emphasis on the marginally stable spin glass. This phase exhibits an emergent conformal symmetry in the strong coupling regime, which dictates its thermodynamic properties. It is associated with an extensive number of nearby states in the free energy landscape. We discuss in detail an elegant approximate solution to the spin glass equations, which interpolates between the conformal regime and an ultraviolet-complete short distance solution. In the second half of this paper we explore the real-time dynamics of the model and uncover quantum chaos as measured by out-of-time-order four-point functions, both numerically and analytically. We find exponential Lyapunov growth, which intricately depends on the model's couplings and becomes strongest in the quantum critical regime. We emphasize that the spin glass phase also exhibits quantum chaos, albeit with parametrically smaller Lyapunov exponent than in the replica symmetric phase. An analytical calculation in the marginal spin glass phase suggests that this Lyapunov exponent vanishes in a particular infinite coupling limit. We comment on the potential meaning of these observations from the perspective of holography.

categories: hep-th cond-mat.dis-nn cond-mat.stat-mech cond-mat.str-el


title: NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Results

abstract: This paper reviews the NTIRE2021 challenge on burst super-resolution. Given a RAW noisy burst as input, the task in the challenge was to generate a clean RGB image with 4 times higher resolution. The challenge contained two tracks; Track 1 evaluating on synthetically generated data, and Track 2 using real-world bursts from mobile camera. In the final testing phase, 6 teams submitted results using a diverse set of solutions. The top-performing methods set a new state-of-the-art for the burst super-resolution task.


title: Balancing Garbage Collection vs I/O Amplification using hybrid Key-Value Placement in LSM-based Key-Value Stores

abstract: Key-value (KV) separation is a technique that introduces randomness in the I/O access patterns to reduce I/O amplification in LSM-based key-value stores for fast storage devices (NVMe). KV separation has a significant drawback that makes it less attractive: Delete and especially update operations that are important in modern workloads result in frequent and expensive garbage collection (GC) in the value log. In this paper, we design and implement Parallax, which proposes hybrid KV placement that reduces GC overhead significantly and maximizes the benefits of using a log. We first model the benefits of KV separation for different KV pair sizes. We use this model to classify KV pairs in three categories small, medium, and large. Then, Parallax uses different approaches for each KV category: It always places large values in a log and small values in place. For medium values it uses a mixed strategy that combines the benefits of using a log and eliminates GC overhead as follows: It places medium values in a log for all but the last few (typically one or two) levels in the LSM structure, where it performs a full compaction, merges values in place, and reclaims log space without the need for GC. We evaluate Parallax against RocksDB that places all values in place and BlobDB that always performs KV separation. We find that Parallax increases throughput by up to 12.4x and 17.83x, decreases I/O amplification by up to 27.1x and 26x, and increases CPU efficiency by up to 18.7x and 28x respectively, for all but scan-based YCSB workloads.


title: Toroidal Tidal Effects in Microstate Geometries

abstract: Tidal effects in capped geometries computed in previous literature display no dynamics along internal (toroidal) directions. However, the dual CFT picture suggests otherwise. To resolve this tension, we consider a set of infalling null geodesics in a family of black hole microstate geometries with a smooth cap at the bottom of a long BTZ-like throat. Using the Penrose limit, we show that a string following one of these geodesics feels tidal stresses along all spatial directions, including internal toroidal directions. We find that the tidal effects along the internal directions are of the same order of magnitude as those along other, non-internal, directions. Furthermore, these tidal effects oscillate as a function of the distance from the cap -- as a string falls down the throat it alternately experiences compression and stretching. We explain some physical properties of this oscillation and comment on the dual CFT interpretation.


title: Non-Abelian Hybrid Fracton Orders

abstract: We introduce lattice gauge theories which describe three-dimensional, gapped quantum phases exhibiting the phenomenology of both conventional three-dimensional topological orders and fracton orders, starting from a finite group $G$, a choice of an Abelian normal subgroup $N$, and a choice of foliation structure. These hybrid fracton orders -- examples of which were introduced in arXiv:2102.09555 -- can also host immobile, point-like excitations that are non-Abelian, and therefore give rise to a protected degeneracy. We construct solvable lattice models for these orders which interpolate between a conventional, three-dimensional $G$ gauge theory and a pure fracton order, by varying the choice of normal subgroup $N$. We demonstrate that certain universal data of the topological excitations and their mobilities are directly related to the choice of $G$ and $N$, and also present complementary perspectives on these orders: certain orders may be obtained by gauging a global symmetry which enriches a particular fracton order, by either fractionalizing on or permuting the excitations with restricted mobility, while certain hybrid orders can be obtained by condensing excitations in a stack of initially decoupled, two-dimensional topological orders.


title: Equivariant Graph Neural Networks for 3D Macromolecular Structure

abstract: Representing and reasoning about 3D structures of macromolecules is emerging as a distinct challenge in machine learning. Here, we extend recent work on geometric vector perceptrons and apply equivariant graph neural networks to a wide range of tasks from structural biology. Our method outperforms all reference architectures on three out of eight tasks in the ATOM3D benchmark, is tied for first on two others, and is competitive with equivariant networks using higher-order representations and spherical harmonic convolutions. In addition, we demonstrate that transfer learning can further improve performance on certain downstream tasks. Code is available at https://github.com/drorlab/gvp-pytorch.