title: Towards Dynamic Algorithm Selection for Numerical Black-Box Optimization: Investigating BBOB as a Use Case

abstract: One of the most challenging problems in evolutionary computation is to select from its family of diverse solvers one that performs well on a given problem. This algorithm selection problem is complicated by the fact that different phases of the optimization process require different search behavior. While this can partly be controlled by the algorithm itself, there exist large differences between algorithm performance. It can therefore be beneficial to swap the configuration or even the entire algorithm during the run. Long deemed impractical, recent advances in Machine Learning and in exploratory landscape analysis give hope that this dynamic algorithm configuration~(dynAC) can eventually be solved by automatically trained configuration schedules. With this work we aim at promoting research on dynAC, by introducing a simpler variant that focuses only on switching between different algorithms, not configurations. Using the rich data from the Black Box Optimization Benchmark~(BBOB) platform, we show that even single-switch dynamic Algorithm selection (dynAS) can potentially result in significant performance gains. We also discuss key challenges in dynAS, and argue that the BBOB-framework can become a useful tool in overcoming these.


title: AdaS: Adaptive Scheduling of Stochastic Gradients

abstract: The choice of step-size used in Stochastic Gradient Descent (SGD) optimization is empirically selected in most training procedures. Moreover, the use of scheduled learning techniques such as Step-Decaying, Cyclical-Learning, and Warmup to tune the step-size requires extensive practical experience--offering limited insight into how the parameters update--and is not consistent across applications. This work attempts to answer a question of interest to both researchers and practitioners, namely \textit{"how much knowledge is gained in iterative training of deep neural networks?"} Answering this question introduces two useful metrics derived from the singular values of the low-rank factorization of convolution layers in deep neural networks. We introduce the notions of \textit{"knowledge gain"} and \textit{"mapping condition"} and propose a new algorithm called Adaptive Scheduling (AdaS) that utilizes these derived metrics to adapt the SGD learning rate proportionally to the rate of change in knowledge gain over successive iterations. Experimentation reveals that, using the derived metrics, AdaS exhibits: (a) faster convergence and superior generalization over existing adaptive learning methods; and (b) lack of dependence on a validation set to determine when to stop training. Code is available at \url{https://github.com/mahdihosseini/AdaS}.


title: Insulating, metallic and superconducting behavior in a single nanowire

abstract: In systems with reduced dimensions quantum fluctuations have a strong influence on the electronic conduction, even at very low temperature. In superconductors this is especially interesting, since the coherent state of the superconducting electrons is strongly interacting with these fluctuations and therefore is a sensitive tool to study them. In this paper, we report on comprehensive measurements of superconducting nanowires in the quantum phase slip regime. Using an intrinsic electromigration process, we have developed a method to lower the resistance of lithographically fabricated highly resistive nanowires in situ and in small consecutive steps. At low temperature we observe critical (Coulomb) blockade voltages and superconducting critical currents, depending on the nanowire's normal-state resistance, in good agreement with theoretical models. Between these two regimes, we find a continuous transition displaying a nonlinear metallic-like behavior. The reported intrinsic electromigration technique is not limited to low temperatures as we find a similar change in resistance that spans over three orders of magnitude also at room temperature. Aside from superconducting quantum circuits, such a technique to reduce the resistance may also have applications in modern electronic circuits.


title: Randomized Fast Subspace Descent Methods

abstract: Randomized Fast Subspace Descent (RFASD) Methods are developed and analyzed for smooth and non-constraint convex optimization problems. The efficiency of the method relies on a space decomposition which is stable in $A$-norm, and meanwhile, the condition number $\kappa_A$ measured in $A$-norm is small. At each iteration, the subspace is chosen randomly either uniformly or by a probability proportional to the local Lipschitz constants. Then in each chosen subspace, a preconditioned gradient descent method is applied. RFASD converges sublinearly for convex functions and linearly for strongly convex functions. Comparing with the randomized block coordinate descent methods, the convergence of RFASD is faster provided $\kappa_A$ is small and the subspace decomposition is $A$-stable. This improvement is supported by considering a multilevel space decomposition for Nesterov's `worst' problem.


title: Mid-infrared Studies of HD 113766 and HD 172555: Assessing Variability in the Terrestrial Zone of Young Exoplanetary Systems

abstract: We present multi-epoch infrared photometry and spectroscopy obtained with warm Spitzer, Subaru and SOFIA to assess variability for the young ($\sim$20 Myr) and dusty debris systems around HD 172555 and HD 113766A. No variations (within 0.5%) were found for the former at either 3.6 or 4.5 $\mu$m, while significant non-periodic variations (peak-to-peak of $\sim$10-15% relative to the primary star) were detected for the latter. Relative to the Spitzer IRS spectra taken in 2004, multi-epoch mid-infrared spectra reveal no change in either the shape of the prominent 10 $\mu$m solid-state features or the overall flux levels (no more than 20%) for both systems, corroborating that the population of sub-$\mu$m-sized grains that produce the pronounced solid-state features is stable over a decadal timescale. We suggest that these sub-$\mu$m-sized grains were initially generated in an optically thick clump of debris of mm-sized vapor condensates resulting from a recent violent impact between large asteroidal or planetary bodies. Because of the shielding from the stellar photons provided by this clump, intense collisions led to an over-production of fine grains that would otherwise be ejected from the system by radiation pressure. As the clump is sheared by its orbital motion and becomes optically thin, a population of very fine grains could remain in stable orbits until Poynting-Robertson drag slowly spirals them into the star. We further suggest that the 3-5 $\mu$m disk variation around HD 113766A is consistent with a clump/arc of such fine grains on a modestly eccentric orbit in its terrestrial zone.


title: Relationship between grain boundary segregation and grain boundary diffusion in Cu-Ag alloys

abstract: While it is known that alloy components can segregate to grain boundaries (GBs), and that the atomic mobility in GBs greatly exceeds the atomic mobility in the lattice, little is known about the effect of GB segregation on GB diffusion. Atomistic computer simulations offer a means of gaining insights into the segregation-diffusion relationship by computing the GB diffusion coefficients of the alloy components as a function of their segregated amounts. In such simulations, thermodynamically equilibrium GB segregation is prepared by a semi-grand canonical Monte Carlo method, followed by calculation of the diffusion coefficients of all alloy components by molecular dynamics. As a demonstration, the proposed methodology is applied to a GB is the Cu-Ag system. The GB diffusivities obtained exhibit non-trivial composition dependencies that can be explained by site blocking, site competition, and the onset of GB disordering due to the premelting effect.


title: The Backbone Method for Ultra-High Dimensional Sparse Machine Learning

abstract: We present the backbone method, a generic framework that enables sparse and interpretable supervised machine learning methods to scale to ultra-high dimensional problems. We solve sparse regression problems with $10^7$ features in minutes and $10^8$ features in hours, as well as decision tree problems with $10^5$ features in minutes.The proposed method operates in two phases: we first determine the backbone set, consisting of potentially relevant features, by solving a number of tractable subproblems; then, we solve a reduced problem, considering only the backbone features. For the sparse regression problem, our theoretical analysis shows that, under certain assumptions and with high probability, the backbone set consists of the truly relevant features. Numerical experiments on both synthetic and real-world datasets demonstrate that our method outperforms or competes with state-of-the-art methods in ultra-high dimensional problems, and competes with optimal solutions in problems where exact methods scale, both in terms of recovering the truly relevant features and in its out-of-sample predictive performance.


title: Lagrangian tracking of colliding droplets

abstract: We introduce a new Lagrangian particle tracking algorithm that tracks particles in three dimensions to separations between trajectories approaching contact. The algorithm also detects low Weber number binary collisions that result in coalescence as well as droplet break-up. Particles are identified in two-dimensional high-resolution digital images by finding sets of circles to describe the edge of each body. This allows identification of particles that overlap in projection by over 80% even for noisy images and without invoking additional temporal data. The algorithm builds trajectories from three-dimensional particle coordinates by minimizing a penalty function that is a weighted sum of deviations from the expected particle coordinates using information from four moments in time. This new hybrid algorithm is validated against synthetic data and found to perfectly reproduce more trajectories than other commonly used methods. Collisions are detected with 95% accuracy for particles that move on average less than one tenth the distance to their nearest neighbor.


title: Mitigating the optical depth degeneracy using the kinematic Sunyaev-Zel'dovich effect with CMB-S4

abstract: The epoch of reionization is one of the major phase transitions in the history of the universe, and is a focus of ongoing and upcoming cosmic microwave background (CMB) experiments with improved sensitivity to small-scale fluctuations. Reionization also represents a significant contaminant to CMB-derived cosmological parameter constraints, due to the degeneracy between the Thomson-scattering optical depth, $\tau$, and the amplitude of scalar perturbations, $A_s$. This degeneracy subsequently hinders the ability of large-scale structure data to constrain the sum of the neutrino masses, a major target for cosmology in the 2020s. In this work, we explore the kinematic Sunyaev-Zel'dovich (kSZ) effect as a probe of reionization, and show that it can be used to mitigate the optical depth degeneracy with high-sensitivity, high-resolution data from the upcoming CMB-S4 experiment. We discuss the dependence of the kSZ power spectrum on physical reionization model parameters, as well as on empirical reionization parameters, namely $\tau$ and the duration of reionization, $\Delta z$. We show that by combining the kSZ two-point function and the reconstructed kSZ four-point function, degeneracies between $\tau$ and $\Delta z$ can be strongly broken, yielding tight constraints on both parameters. We forecast $\sigma(\tau) = 0.003$ and $\sigma(\Delta z) = 0.25$ for a combination of CMB-S4 and Planck data, including detailed treatment of foregrounds and atmospheric noise. The constraint on $\tau$ is nearly identical to the cosmic-variance limit that can be achieved from large-angle CMB polarization data. The kSZ effect thus promises to yield not only detailed information about the reionization epoch, but also to enable high-precision cosmological constraints on the neutrino mass.


title: Confidence sets for dynamic poverty indexes

abstract: In this study, we extend the research on the dynamic poverty indexes, namely the dynamic Headcount ratio, the dynamic income-gap ratio, the dynamic Gini and the dynamic Sen, proposed in D'Amico and Regnault (2018). The contribution is twofold. First, we extend the computation of the dynamic Gini index, thus the Sen index accordingly, with the inclusion of the inequality within each class of poverty where people are classified according to their income. Second, for each poverty index, we establish a central limit theorem that gives us the possibility to determine the confidence sets. An application to the Italian income data from 1998 to 2012 confirms the effectiveness of the considered approach and the possibility to determine the evolution of poverty and inequality in real economies.


title: Iterated $S^3$ Sasaki Joins and Bott Orbifolds

abstract: We present a categorical relationship between iterated $S^3$ Sasaki-joins and Bott orbifolds. Then we show how to construct smooth Sasaki-Einstein (SE) structures on the iterated joins. These become increasingly complicated as dimension grows. We give an explicit construction of (infinitely many) smooth SE structures up through dimension eleven, and conjecture the existence of smooth SE structures in all odd dimensions.


title: Quantum Phase Transition and Berry Phase in an Extended Dicke Model

abstract: We investigate quantum phase transitions, quantum criticality, and Berry phase for the ground state of an ensemble of non-interacting two-level atoms embedded in a non-linear optical medium, coupled to a single-mode quantized electromagnetic field. The optical medium is pumped externally through a classical electric field, so that there is a degenerate parametric amplification effect, which strongly modifies the field dynamics without affecting the atomic sector. Through a semiclassical description the different phases of this extended Dicke model are described. The quantum phase transition is characterized with the expectation values of some observables of the system as well as the Berry phase and its first derivative, where such quantities serve as order parameters. It is remarkable that the model allows the control of the quantum criticality through a suitable choice of the parameters of the non-linear optical medium, which could make possible the use of a low intensity laser to access the superradiant region experimentally.


title: Combinatorial Solution of the Syndrome Decoding Problem using Copula on Grassmann graph

abstract: Computational hardness assumption from the syndrome decoding problem has been useful in designing the security of code based cryptosystem that are safe against quantum computing. Due to complexities in solution using high degree linearized polynomial equations modeled from subspaces, we proposed exploiting the dependency between subspaces in a Grassmann graph constructed from Boundary measurement maps by using copula functions. We also used copula functions to estimate the marginal distribution in these subspaces. Thereafter, the Maximum likelihood based estimation approach was used to search the codeword that maximizes the conditional distribution and in the process approximate a solution to the problem. Results of the Bit Error Rate performance obtained from simulation shows that the proposed solution performs better than the information set decoding method.


title: Robust model training and generalisation with Studentising flows

abstract: Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how these methods can be further improved based on insights from robust (in particular, resistant) statistics. Specifically, we propose to endow flow-based models with fat-tailed latent distributions such as multivariate Student's $t$, as a simple drop-in replacement for the Gaussian distribution used by conventional normalising flows. While robustness brings many advantages, this paper explores two of them: 1) We describe how using fatter-tailed base distributions can give benefits similar to gradient clipping, but without compromising the asymptotic consistency of the method. 2) We also discuss how robust ideas lead to models with reduced generalisation gap and improved held-out data likelihood. Experiments on several different datasets confirm the efficacy of the proposed approach in both regards.


abstract: Policy gradient (PG) algorithms have been widely used in reinforcement learning (RL). However, PG algorithms rely on exploiting the value function being learned with the first-order update locally, which results in limited sample efficiency. In this work, we propose an alternative method called Zeroth-Order Supervised Policy Improvement (ZOSPI). ZOSPI exploits the estimated value function $Q$ globally while preserving the local exploitation of the PG methods based on zeroth-order policy optimization. This learning paradigm follows Q-learning but overcomes the difficulty of efficiently operating argmax in continuous action space. It finds max-valued action within a small number of samples. The policy learning of ZOSPI has two steps: First, it samples actions and evaluates those actions with a learned value estimator, and then it learns to perform the action with the highest value through supervised learning. We further demonstrate such a supervised learning framework can learn multi-modal policies. Experiments show that ZOSPI achieves competitive results on the continuous control benchmarks with a remarkable sample efficiency.


title: Spectral and transport properties of a half-filled Anderson impurity coupled to phase-biased superconducting and metallic leads

abstract: We derive and apply a general scheme for mapping a setup consisting of a half-filled single level quantum dot coupled to one normal metallic and two superconducting phase-biased leads onto an ordinary half-filled single impurity Anderson model with single modified tunneling density of states. The theory allows for the otherwise unfeasible application of the standard numerical renormalization group and enables to obtain phase-dependent local spectral properties as well as phase-dependent induced pairing and Josephson current. The resulting transport properties match well with the numerically exact continuous-time hybridization-expansion quantum Monte Carlo. For weakly coupled normal electrode, the spectral properties can be interpreted in terms of normal-electrode-broadened Andreev bound states with phase-dependent position analogous to the superconducting Anderson model, which coexist in the $\pi$-like phase with a Kondo peak whose phase-dependent Kondo temperature follows the form conjectured previously in Doma\'nski et al., Phys.~Rev.~B {\bf 95}, 045104 (2017)


title: Effects of long-range forces on the D-term and the energy-momentum structure

abstract: The hadronic form factors of the energy-momentum tensor (EMT) have attracted considerable interest in recent literature. This concerns especially the D-term form factor D(t) with its appealing interpretation in terms of internal forces. With their focus on hadron structure, theoretical studies so far have concentrated on strongly interacting systems with short-range forces. Effects on the EMT due to long-range forces like the electromagnetic interaction have not yet been studied. Electromagnetic forces play a small role in the balance of forces inside the proton, but their long-range nature introduces new features which are not present in systems with short-range forces. We use a simple but consistent classical field theoretical model of the proton to show how the presence of long-range forces alters some notions taken for granted in short-range systems. Our results imply that a more careful definition of the D-term is required when long-range forces are present.


title: Logarithmic Donaldson-Thomas theory

abstract: Let $X$ be a smooth threefold with a simple normal crossings divisor $D$. We construct the Donaldson-Thomas theory of the pair $(X|D)$ enumerating ideal sheaves on $X$ relative to $D$. These moduli spaces are compactified by studying subschemes in expansions of the target geometry, and the moduli space carries a virtual fundamental class leading to numerical invariants with expected properties. We formulate punctual evaluation, rationality and wall-crossing conjectures, in parallel with the standard theory. Our formalism specializes to the Li-Wu theory of relative ideal sheaves when the divisor is smooth, and is parallel to recent work on logarithmic Gromov-Witten theory with expansions.


title: Two species of semi-local cosmic strings in Abelian gauged $\mathbb{CP}^2$-sigma models coupled to gravity

abstract: We study a semi-local Abelian Higgs sigma model with $\mathbb{CP}^2$-valued scalar fields coupled to gravity. We establish the conditions needed for self-duality in this system and obtain cosmic strings, both of self-dual character and out of the self-dual point, in the reference chart of $\mathbb{CP}^2$. In any of the other two charts of a minimum atlas, the transition functions break the global $SU(2)$ symmetry to the Abelian subgroup $e^{i \sigma^3 \alpha}$. In this context, using the transition functions a new self-dual structure can be constructed, which defines a second species of cosmic strings. Because of the presence of a potential energy for the scalar fields, each species takes values in a different bounded region of the target space and is most naturally described using a particular chart of $\mathbb{CP}^2$.


title: On Granulation and Irregular Variation of Red Supergiants

abstract: The mechanism and characteristics of the irregular variations of red supergiants (RSGs) are studied based on the RSG samples in Small Magellanic Cloud (SMC), Large Magellanic Cloud (LMC) and M31. With the time-series data from All-Sky Automated Survey for SuperNovae (ASAS-SN) and Intermediate Palomar Transient Factory survey, we use the continuous time autoregressive moving average model to estimate the variability features of the light curves and their power spectral density. The characteristic evolution timescale and amplitude of granulations are further derived from fitting the posterior power spectral density with the COR function, which is a Harvey-like granulation model. The consistency of theoretical predictions and results is checked to verify the correctness of the assumption that granulations on RSGs contribute to irregular variation. The relations between granulation and stellar parameters are obtained and compared with the results of red giant branch stars and Betelgeuse. It is found that the relations are in agreement with predictions from basic physical process of granulation and fall close to the extrapolated relations of RGB stars. The granulations in most of the RSGs evolve at a timescale of several days to a year with the characteristic amplitude of 10-1000 mmag. The results imply that the irregular variations of RSGs can be attributed to the evolution of granulations. When comparing the results from SMC, LMC and M31, the timescale and amplitude of granulation seem to increase with metallicity. The analytical relations of the granulation parameters with stellar parameters are derived for the RSG sample of each galaxy.


title: What makes instance discrimination good for transfer learning?

abstract: Contrastive visual pretraining based on the instance discrimination pretext task has made significant progress. Notably, recent work on unsupervised pretraining has shown to surpass the supervised counterpart for finetuning downstream applications such as object detection and segmentation. It comes as a surprise that image annotations would be better left unused for transfer learning. In this work, we investigate the following problems: What makes instance discrimination pretraining good for transfer learning? What knowledge is actually learned and transferred from these models? From this understanding of instance discrimination, how can we better exploit human annotation labels for pretraining? Our findings are threefold. First, what truly matters for the transfer is low-level and mid-level representations, not high-level representations. Second, the intra-category invariance enforced by the traditional supervised model weakens transferability by increasing task misalignment. Finally, supervised pretraining can be strengthened by following an exemplar-based approach without explicit constraints among the instances within the same category.


title: Proof of a Momentum/Complexity Correspondence

abstract: We show that the holographic Complexity = Volume proposal satisfies a very general notion of Momentum/Complexity correspondence (PC), based on the Momentum Constraint of General Relativity. It relates the rate of complexity variation with an appropriate matter momentum flux through spacelike extremal surfaces. This formalizes the intuitive idea that `gravitational clumpling' of matter increases complexity, and the required notion of `infall momentum' is shown to have a Newtonian avatar which expresses this idea. The proposed form of the PC correspondence is found to be exact for any solution of Einstein's equations in 2+1 dimensions, and any spherically symmetric solution in arbitrary dimensions, generalizing all previous calculations using spherical thin shells. Gravitational radiation enters through a correction which does not have a straightforward interpretation as a PC correspondence. Other obstructions to an exact PC duality have a topological origin and arise in the presence of wormholes.


title: GNNAdvisor: An Adaptive and Efficient Runtime System for GNN Acceleration on GPUs

abstract: As the emerging trend of graph-based deep learning, Graph Neural Networks (GNNs) excel for their capability to generate high-quality node feature vectors (embeddings). However, the existing one-size-fits-all GNN implementations are insufficient to catch up with the evolving GNN architectures, the ever-increasing graph sizes, and the diverse node embedding dimensionalities. To this end, we propose \textbf{GNNAdvisor}, an adaptive and efficient runtime system to accelerate various GNN workloads on GPU platforms. First, GNNAdvisor explores and identifies several performance-relevant features from both the GNN model and the input graph, and uses them as a new driving force for GNN acceleration. Second, GNNAdvisor implements a novel and highly-efficient 2D workload management, tailored for GNN computation to improve GPU utilization and performance under different application settings. Third, GNNAdvisor capitalizes on the GPU memory hierarchy for acceleration by gracefully coordinating the execution of GNNs according to the characteristics of the GPU memory structure and GNN workloads. Furthermore, to enable automatic runtime optimization, GNNAdvisor incorporates a lightweight analytical model for an effective design parameter search. Extensive experiments show that GNNAdvisor outperforms the state-of-the-art GNN computing frameworks, such as Deep Graph Library ($3.02\times$ faster on average) and NeuGraph (up to $4.10\times$ faster), on mainstream GNN architectures across various datasets.


title: Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge

abstract: To what extent can a neural network systematically reason over symbolic facts? Evidence suggests that large pre-trained language models (LMs) acquire some reasoning capacity, but this ability is difficult to control. Recently, it has been shown that Transformer-based models succeed in consistent reasoning over explicit symbolic facts, under a "closed-world" assumption. However, in an open-domain setup, it is desirable to tap into the vast reservoir of implicit knowledge already encoded in the parameters of pre-trained LMs. In this work, we provide a first demonstration that LMs can be trained to reliably perform systematic reasoning combining both implicit, pre-trained knowledge and explicit natural language statements. To do this, we describe a procedure for automatically generating datasets that teach a model new reasoning skills, and demonstrate that models learn to effectively perform inference which involves implicit taxonomic and world knowledge, chaining and counting. Finally, we show that "teaching" models to reason generalizes beyond the training distribution: they successfully compose the usage of multiple reasoning skills in single examples. Our work paves a path towards open-domain systems that constantly improve by interacting with users who can instantly correct a model by adding simple natural language statements.


title: Classification of Hopf superalgebras associated with quantum special linear superalgebra at roots of unity using Weyl groupoid

abstract: We summarize the definition of the Weyl groupoid using supercategory approach in order to investigate quantum superalgebras at roots of unity. We show how the structure of a Hopf superalgebra on a quantum superalgebra is determined by the quantum Weyl groupoid. The Weyl groupoid of $\mathfrak{sl}(m|n)$ is constructed to this end as some supercategory. We prove that in this case quantum superalgebras associated with Dynkin diagrams are isomorphic as superalgebras. It is shown how these quantum superalgebras considered as Hopf superalgebras are connected via twists and isomorphisms. We explicitly construct these twists using the Lusztig isomorphisms considered as elements of the Weyl quantum groupoid. We build a PBW basis for each quantum superalgebra, and investigate how quantum superalgebras are connected with their classical limits, i. e. Lie superbialgebras. We find explicit multiplicative formulas for universal $R$-matrices, describe relations between them for each realization and classify Hopf superalgebras and triangular structures for the quantum superalgebra $U_q(\mathfrak{sl}(m|n))$.


title: Improving Deep Metric Learning with Virtual Classes and Examples Mining

abstract: In deep metric learning, the training procedure relies on sampling informative tuples. However, as the training procedure progresses, it becomes nearly impossible to sample relevant hard negative examples without proper mining strategies or generation-based methods. Recent work on hard negative generation have shown great promises to solve the mining problem. However, this generation process is difficult to tune and often leads to incorrectly labelled examples. To tackle this issue, we introduce MIRAGE, a generation-based method that relies on virtual classes entirely composed of generated examples that act as buffer areas between the training classes. We empirically show that virtual classes significantly improve the results on popular datasets (Cub-200-2011, Cars-196 and Stanford Online Products) compared to other generation methods.


title: Liouville results for fully nonlinear equations modeled on H\"ormander vector fields. I. The Heisenberg group

abstract: This paper studies Liouville properties for viscosity sub- and supersolutions of fully nonlinear degenerate elliptic PDEs, under the main assumption that the operator has a family of generalized subunit vector fields that satisfy the H\"ormander condition. A general set of sufficient conditions is given such that all subsolutions bounded above are constant; it includes the existence of a supersolution out of a big ball, that explodes at infinity. Therefore for a large class of operators the problem is reduced to finding such a Lyapunov-like function. This is done here for the vector fields that generate the Heisenberg group, giving explicit conditions on the sign and size of the first and zero-th order terms in the equation. The optimality of the conditions is shown via several examples. A sequel of this paper applies the methods to other Carnot groups and to Grushin geometries.


title: Statistical Efficiency of Thompson Sampling for Combinatorial Semi-Bandits

abstract: We investigate stochastic combinatorial multi-armed bandit with semi-bandit feedback (CMAB). In CMAB, the question of the existence of an efficient policy with an optimal asymptotic regret (up to a factor poly-logarithmic with the action size) is still open for many families of distributions, including mutually independent outcomes, and more generally the multivariate sub-Gaussian family. We propose to answer the above question for these two families by analyzing variants of the Combinatorial Thompson Sampling policy (CTS). For mutually independent outcomes in $[0,1]$, we propose a tight analysis of CTS using Beta priors. We then look at the more general setting of multivariate sub-Gaussian outcomes and propose a tight analysis of CTS using Gaussian priors. This last result gives us an alternative to the Efficient Sampling for Combinatorial Bandit policy (ESCB), which, although optimal, is not computationally efficient.


title: MatchGAN: A Self-Supervised Semi-Supervised Conditional Generative Adversarial Network

abstract: We present a novel self-supervised learning approach for conditional generative adversarial networks (GANs) under a semi-supervised setting. Unlike prior self-supervised approaches which often involve geometric augmentations on the image space such as predicting rotation angles, our pretext task leverages the label space. We perform augmentation by randomly sampling sensible labels from the label space of the few labelled examples available and assigning them as target labels to the abundant unlabelled examples from the same distribution as that of the labelled ones. The images are then translated and grouped into positive and negative pairs by their target labels, acting as training examples for our pretext task which involves optimising an auxiliary match loss on the discriminator's side. We tested our method on two challenging benchmarks, CelebA and RaFD, and evaluated the results using standard metrics including Fr\'{e}chet Inception Distance, Inception Score, and Attribute Classification Rate. Extensive empirical evaluation demonstrates the effectiveness of our proposed method over competitive baselines and existing arts. In particular, our method surpasses the baseline with only 20% of the labelled examples used to train the baseline.


title: Space Telescope and Optical Reverberation Mapping Project. XI. Disk-wind characteristics and contributions to the very broad emission lines of NGC 5548

abstract: In 2014 the NGC 5548 Space Telescope and Optical Reverberation Mapping campaign discovered a two-month anomaly when variations in the absorption and emission lines decorrelated from continuum variations. During this time the soft X-ray part of the intrinsic spectrum had been strongly absorbed by a line-of-sight (LOS) obscurer, which was interpreted as the upper part of a disk wind. Our first paper showed that changes in the LOS obscurer produce the decorrelation between the absorption lines and the continuum. A second study showed that the base of the wind shields the BLR, leading to the emission-line decorrelation. In that study, we proposed the wind is normally transparent with no effect on the spectrum. Changes in the wind properties alter its shielding and affect the SED striking the BLR, producing the observed decorrelations. In this work, we investigate the impact of a translucent wind on the emission lines. We simulate the obscuration using XMM-Newton, NuSTAR, and HST observations to determine the physical characteristics of the wind. We find that a translucent wind can contribute a part of the He II and Fe K? emission. It has a modest optical depth to electron scattering, which explains the fainter far-side emission in the observed velocity delay maps. The wind produces the very broad base seen in the UV emission lines and may also be present in the Fe K? line. Our results highlight the importance of accounting for the effects of such winds in the analysis of the physics of the central engine.


title: Generalized Sturmian Functions in prolate spheroidal coordinates

abstract: With the aim of describing bound and continuum states for diatomic molecules, we develop and implement a spectral method that makes use of Generalized Sturmian Functions (GSF) in prolate spheroidal coordinates. In order to master all computational issues, we apply here the method to one--electron molecular ions and compare it with benchmark data for both ground and excited states. We actually propose two different computational schemes to solve the two coupled differential equations. The first one is an iterative 1d procedure in which one solves alternately the angular and the radial equations, the latter yielding the state energy. The second, named direct $2d$ method, consists in representing the Hamiltonian matrix in a two--dimensional GSF basis set, and its further diagonalization. Both spectral schemes are timewise computationally efficient since the basis elements are such that no derivatives have to be calculated numerically. Moreover, very accurate results are obtained with minimal basis sets. This is related on one side to the use of the natural coordinate system and, on the other, to the intrinsic good property of all GSF basis elements that are constructed as to obey appropriate physical boundary conditions. The present implementation for bound states paves the way for the study of continuum states involved in ionization of one or two--electron diatomic targets.


title: Microheater actuators as a versatile platform for strain engineering in 2D materials

abstract: We present microfabricated thermal actuators to engineer the biaxial strain in two-dimensional (2D) materials. These actuators are based on microheater circuits patterned onto the surface of a polymer with a high thermal expansion coefficient. By running current through the microheater one can vary the temperature of the polymer and induce a controlled biaxial expansion of its surface. This controlled biaxial expansion can be transduced to biaxial strain to 2D materials, placed onto the polymer surface, which in turn induces a shift of the optical spectrum. Our thermal strain actuators can reach a maximum biaxial strain of 0.64 % and they can be modulated at frequencies up to 8 Hz. The compact geometry of these actuators results in a negligible spatial drift of 0.03 um/deg, which facilitates their integration in optical spectroscopy measurements. We illustrate the potential of this strain engineering platform to fabricate a strain-actuated optical modulator with single-layer MoS2.


title: CoinPress: Practical Private Mean and Covariance Estimation

abstract: We present simple differentially private estimators for the mean and covariance of multivariate sub-Gaussian data that are accurate at small sample sizes. We demonstrate the effectiveness of our algorithms both theoretically and empirically using synthetic and real-world datasets -- showing that their asymptotic error rates match the state-of-the-art theoretical bounds, and that they concretely outperform all previous methods. Specifically, previous estimators either have weak empirical accuracy at small sample sizes, perform poorly for multivariate data, or require the user to provide strong a priori estimates for the parameters.

categories: stat.ML cs.CR cs.DS cs.IT cs.LG math.IT math.ST stat.TH


title: Turing Patterning in Stratified Domains

abstract: Reaction-diffusion processes across layered media arise in several scientific domains such as pattern-forming E. coli on agar substrates, epidermal-mesenchymal coupling in development, and symmetry-breaking in cell polarisation. We develop a modelling framework for bi-layer reaction-diffusion systems and relate it to a range of existing models. We derive conditions for diffusion-driven instability of a spatially homogeneous equilibrium analogous to the classical conditions for a Turing instability in the simplest nontrivial setting where one domain has a standard reaction-diffusion system, and the other permits only diffusion. Due to the transverse coupling between these two regions, standard techniques for computing eigenfunctions of the Laplacian cannot be applied, and so we propose an alternative method to compute the dispersion relation directly. We compare instability conditions with full numerical simulations to demonstrate impacts of the geometry and coupling parameters on patterning, and explore various experimentally-relevant asymptotic regimes. In the regime where the first domain is suitably thin, we recover a simple modulation of the standard Turing conditions, and find that often the broad impact of the diffusion-only domain is to reduce the ability of the system to form patterns. We also demonstrate complex impacts of this coupling on pattern formation. For instance, we exhibit non-monotonicity of pattern-forming instabilities with respect to geometric and coupling parameters, and highlight an instability from a nontrivial interaction between kinetics in one domain and diffusion in the other. These results are valuable for informing design choices in applications such as synthetic engineering of Turing patterns, but also for understanding the role of stratified media in modulating pattern-forming processes in developmental biology and beyond.


title: From proprioception to long-horizon planning in novel environments: A hierarchical RL model

abstract: For an intelligent agent to flexibly and efficiently operate in complex environments, they must be able to reason at multiple levels of temporal, spatial, and conceptual abstraction. At the lower levels, the agent must interpret their proprioceptive inputs and control their muscles, and at the higher levels, the agent must select goals and plan how they will achieve those goals. It is clear that each of these types of reasoning is amenable to different types of representations, algorithms, and inputs. In this work, we introduce a simple, three-level hierarchical architecture that reflects these distinctions. The low-level controller operates on the continuous proprioceptive inputs, using model-free learning to acquire useful behaviors. These in turn induce a set of mid-level dynamics, which are learned by the mid-level controller and used for model-predictive control, to select a behavior to activate at each timestep. The high-level controller leverages a discrete, graph representation for goal selection and path planning to specify targets for the mid-level controller. We apply our method to a series of navigation tasks in the Mujoco Ant environment, consistently demonstrating significant improvements in sample-efficiency compared to prior model-free, model-based, and hierarchical RL methods. Finally, as an illustrative example of the advantages of our architecture, we apply our method to a complex maze environment that requires efficient exploration and long-horizon planning.


title: Dispersion relations and self-localization of quasiparticles in coupled elongated Bose-Einstein condensates

abstract: We present a detailed study of the spectrum and dispersion of Bogoliubov quasiparticles in two coupled elongated Bose-Einstein condensates. We develop an analytically solvable model that approximates two infinite homogeneous condensates and compare its predictions to a numerical simulation of a realistic trapped system. While the comparisons show a reasonable agreement between the two models, they also manifest the existence of several anomalous Bogoliubov modes in the spectrum. These modes show degeneracy in both energy and momentum together with self-localization in the coordinate space.


title: Stochastic approach to study control strategies of Covid-19 pandemic in India

abstract: India is one of the worst affected countries by the Covid-19 pandemic at present. We studied publicly available data of the Covid-19 patients in India and analyzed possible impacts of quarantine and social distancing within the stochastic framework of the SEQIR model to illustrate the controlling strategy of the pandemic. Our simulation results clearly show that proper quarantine and social distancing should be maintained from an early time just at the start of the pandemic and should be continued till its end to effectively control the pandemic. This calls for a more socially disciplined lifestyle in this perspective in future. The demographic stochasticity, which is quite visible in the system dynamics, has a critical role in regulating and controlling the pandemic.


title: From dwarf galaxies to galaxy clusters: Self-Interacting Dark Matter over 7 orders of magnitude in halo mass

abstract: In this paper we study the density profiles of self-interacting dark matter (SIDM) haloes spanning the full observable mass range, from dwarf galaxies to galaxy clusters. Using realistic simulations that model the baryonic physics relevant for galaxy formation, we compare the density profiles of haloes simulated with either SIDM or cold and collisionless dark matter (CDM) to those inferred from observations of stellar velocity dispersion, gas rotation curves, weak and strong gravitational lensing, and/or X-ray maps. We make our comparison in terms of the maximal surface density of haloes, circumventing the need for semi-analytic or parametric models for dark matter density profiles. We find that the maximal surface density as a function of halo mass is well reproduced by CDM simulations that include baryons, while for SIDM with a velocity-independent cross-section of 1 cm$^2/$g, the simulated galaxy clusters have mean maximal surface densities that are below those of observed systems by an amount greater than the standard deviation of the observed maximal surface density at fixed mass. For less massive systems both CDM and SIDM agree with the observation equally well.


title: SLIC-UAV: A Method for monitoring recovery in tropical restoration projects through identification of signature species using UAVs

abstract: Logged forests cover four million square kilometres of the tropics and restoring these forests is essential if we are to avoid the worst impacts of climate change, yet monitoring recovery is challenging. Tracking the abundance of visually identifiable, early-successional species enables successional status and thereby restoration progress to be evaluated. Here we present a new pipeline, SLIC-UAV, for processing Unmanned Aerial Vehicle (UAV) imagery to map early-successional species in tropical forests. The pipeline is novel because it comprises: (a) a time-efficient approach for labelling crowns from UAV imagery; (b) machine learning of species based on spectral and textural features within individual tree crowns, and (c) automatic segmentation of orthomosaiced UAV imagery into 'superpixels', using Simple Linear Iterative Clustering (SLIC). Creating superpixels reduces the dataset's dimensionality and focuses prediction onto clusters of pixels, greatly improving accuracy. To demonstrate SLIC-UAV, support vector machines and random forests were used to predict the species of hand-labelled crowns in a restoration concession in Indonesia. Random forests were most accurate at discriminating species for whole crowns, with accuracy ranging from 79.3% when mapping five common species, to 90.5% when mapping the three most visually-distinctive species. In contrast, support vector machines proved better for labelling automatically segmented superpixels, with accuracy ranging from 74.3% to 91.7% for the same species. Models were extended to map species across 100 hectares of forest. The study demonstrates the power of SLIC-UAV for mapping characteristic early-successional tree species as an indicator of successional stage within tropical forest restoration areas. Continued effort is needed to develop easy-to-implement and low-cost technology to improve the affordability of project management.


title: Cumulant GAN

abstract: In this paper, we propose a novel loss function for training Generative Adversarial Networks (GANs) aiming towards deeper theoretical understanding as well as improved stability and performance for the underlying optimization problem. The new loss function is based on cumulant generating functions giving rise to \emph{Cumulant GAN}. Relying on a recently-derived variational formula, we show that the corresponding optimization problem is equivalent to R{\'e}nyi divergence minimization, thus offering a (partially) unified perspective of GAN losses: the R{\'e}nyi family encompasses Kullback-Leibler divergence (KLD), reverse KLD, Hellinger distance and $\chi^2$-divergence. Wasserstein GAN is also a member of cumulant GAN. In terms of stability, we rigorously prove the linear convergence of cumulant GAN to the Nash equilibrium for a linear discriminator, Gaussian distributions and the standard gradient descent ascent algorithm. Finally, we experimentally demonstrate that image generation is more robust relative to Wasserstein GAN and it is substantially improved in terms of both inception score and Fr\'echet inception distance when both weaker and stronger discriminators are considered.


title: Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average Reward

abstract: It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we identify a rich class of networked MARL problems where the model exhibits a local dependence structure that allows it to be solved in a scalable manner. Specifically, we propose a Scalable Actor-Critic (SAC) method that can learn a near optimal localized policy for optimizing the average reward with complexity scaling with the state-action space size of local neighborhoods, as opposed to the entire network. Our result centers around identifying and exploiting an exponential decay property that ensures the effect of agents on each other decays exponentially fast in their graph distance.


title: Diagnosis and Analysis of Celiac Disease and Environmental Enteropathy on Biopsy Images using Deep Learning Approaches

abstract: Celiac Disease (CD) and Environmental Enteropathy (EE) are common causes of malnutrition and adversely impact normal childhood development. Both conditions require a tissue biopsy for diagnosis and a major challenge of interpreting clinical biopsy images to differentiate between these gastrointestinal diseases is striking histopathologic overlap between them. In the current study, we propose four diagnosis techniques for these diseases and address their limitations and advantages. First, the diagnosis between CD, EE, and Normal biopsies is considered, but the main challenge with this diagnosis technique is the staining problem. The dataset used in this research is collected from different centers with different staining standards. To solve this problem, we use color balancing in order to train our model with a varying range of colors. Random Multimodel Deep Learning (RMDL) architecture has been used as another approach to mitigate the effects of the staining problem. RMDL combines different architectures and structures of deep learning and the final output of the model is based on the majority vote. CD is a chronic autoimmune disease that affects the small intestine genetically predisposed children and adults. Typically, CD rapidly progress from Marsh I to IIIa. Marsh III is sub-divided into IIIa (partial villus atrophy), Marsh IIIb (subtotal villous atrophy), and Marsh IIIc (total villus atrophy) to explain the spectrum of villus atrophy along with crypt hypertrophy and increased intraepithelial lymphocytes. In the second part of this study, we proposed two ways for diagnosing different stages of CD. Finally, in the third part of this study, these two steps are combined as Hierarchical Medical Image Classification (HMIC) to have a model to diagnose the disease data hierarchically.


title: Real-Time Video Inference on Edge Devices via Adaptive Model Streaming

abstract: Real-time video inference on edge devices like mobile phones and drones is challenging due to the high computation cost of Deep Neural Networks. We present Adaptive Model Streaming (AMS), a new approach to improving performance of efficient lightweight models for video inference on edge devices. AMS uses a remote server to continually train and adapt a small model running on the edge device, boosting its performance on the live video using online knowledge distillation from a large, state-of-the-art model. We discuss the challenges of over-the-network model adaptation for video inference, and present several techniques to reduce communication cost of this approach: avoiding excessive overfitting, updating a small fraction of important model parameters, and adaptive sampling of training frames at edge devices. On the task of video semantic segmentation, our experimental results show 0.4--17.8 percent mean Intersection-over-Union improvement compared to a pre-trained model across several video datasets. Our prototype can perform video segmentation at 30 frames-per-second with 40 milliseconds camera-to-label latency on a Samsung Galaxy S10+ mobile phone, using less than 300 Kbps uplink and downlink bandwidth on the device.


title: Growing Artificial Neural Networks

abstract: Pruning is a legitimate method for reducing the size of a neural network to fit in low SWaP hardware, but the networks must be trained and pruned offline. We propose an algorithm, Artificial Neurogenesis (ANG), that grows rather than prunes the network and enables neural networks to be trained and executed in low SWaP embedded hardware. ANG accomplishes this by using the training data to determine critical connections between layers before the actual training takes place. Our experiments use a modified LeNet-5 as a baseline neural network that achieves a test accuracy of 98.74% using a total of 61,160 weights. An ANG grown network achieves a test accuracy of 98.80% with only 21,211 weights.


title: Petri Nets with Parameterised Data: Modelling and Verification (Extended Version)

abstract: During the last decade, various approaches have been put forward to integrate business processes with different types of data. Each of such approaches reflects specific demands in the whole process-data integration spectrum. One particular important point is the capability of these approaches to flexibly accommodate processes with multiple cases that need to co-evolve. In this work, we introduce and study an extension of coloured Petri nets, called catalog-nets, providing two key features to capture this type of processes. On the one hand, net transitions are equipped with guards that simultaneously inspect the content of tokens and query facts stored in a read-only, persistent database. On the other hand, such transitions can inject data into tokens by extracting relevant values from the database or by generating genuinely fresh ones. We systematically encode catalog-nets into one of the reference frameworks for the (parameterised) verification of data and processes. We show that fresh-value injection is a particularly complex feature to handle, and discuss strategies to tame it. Finally, we discuss how catalog nets relate to well-known formalisms in this area.


title: Unexpected Stein fillings, rational surface singularities, and plane curve arrangements

abstract: We compare Stein fillings and Milnor fibers for rational surface singularities with reduced fundamental cycle. Deformation theory for this class of singularities was studied by de Jong-van Straten in [dJvS98]; they associated a germ of a singular plane curve to each singularity and described Milnor fibers via deformations of this singular curve. We consider links of surface singularities, equipped with their canonical contact structures, and develop a symplectic analog of de Jong-van Straten's construction. Using planar open books and Lefschetz fibrations, we describe all Stein fillings of the links via certain arrangements of symplectic disks, related by a homotopy to the plane curve germ of the singularity. As a consequence, we show that many rational singularities in this class admit Stein fillings that are not strongly diffeomorphic to any Milnor fibers. This contrasts with previously known cases, such as simple and quotient surface singularities, where Milnor fibers are known to give rise to all Stein fillings. On the other hand, we show that if for a singularity with reduced fundamental cycle, the self-intersection of each exceptional curve is at most -5 in the minimal resolution, then the link has a unique Stein filling (given by a Milnor fiber).


title: Performance Analysis of Modified SRPT in Multiple-Processor Multitask Scheduling

abstract: In this paper we study the multiple-processor multitask scheduling problem in both deterministic and stochastic models, where each job have several tasks and is complete only when all its tasks are finished. We consider and analyze Modified Shortest Remaining Processing Time (M-SRPT) scheduling algorithm, a simple modification of SRPT, which always schedules jobs according to SRPT whenever possible, while processes tasks in an arbitrary order. The M-SRPT algorithm is proved to achieve a competitive ratio of $\Theta(\log \alpha +\beta)$ for minimizing response time, where $\alpha$ denotes the ratio between maximum job workload and minimum job workload, $\beta$ represents the ratio between maximum non-preemptive task workload and minimum job workload. In addition, the competitive ratio achieved is shown to be optimal (up to a constant factor), when there are constant number of machines. We further consider the problem under Poisson arrival and general workload distribution (\ie, M/GI/$N$ system), and show that M-SRPT achieves asymptotic optimal mean response time when the traffic intensity $\rho$ approaches $1$, if job size distribution has finite support. Beyond finite job workload, the asymptotic optimality of M-SRPT also holds for infinite job size distributions with certain probabilistic assumptions, for example, M/M/$N$ system with finite task workload. As a special case, we show that M-SRPT is asymptotic optimal in M/M/$1$ model, in which the task size distribution is allowed to have infinite support.


title: Spherical two-distance sets and eigenvalues of signed graphs

abstract: We study the problem of determining the maximum size of a spherical two-distance set with two fixed angles (one acute and one obtuse) in high dimensions. Let $N_{\alpha,\beta}(d)$ denote the maximum number of unit vectors in $\mathbb R^d$ where all pairwise inner products lie in $\{\alpha,\beta\}$. For fixed $-1\leq\beta<0\leq\alpha<1$, we propose a conjecture for the limit of $N_{\alpha,\beta}(d)/d$ as $d \to \infty$ in terms of eigenvalue multiplicities of signed graphs. We determine this limit when $\alpha+2\beta<0$ or $(1-\alpha)/(\alpha-\beta) \in \{1, \sqrt{2}, \sqrt{3}\}$. Our work builds on our recent resolution of the problem in the case of $\alpha = -\beta$ (corresponding to equiangular lines). It is the first determination of $\lim_{d \to \infty} N_{\alpha,\beta}(d)/d$ for any nontrivial fixed values of $\alpha$ and $\beta$ outside of the equiangular lines setting.


title: Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings

abstract: Many computer vision systems require users to upload image features to the cloud for processing and storage. These features can be exploited to recover sensitive information about the scene or subjects, e.g., by reconstructing the appearance of the original image. To address this privacy concern, we propose a new privacy-preserving feature representation. The core idea of our work is to drop constraints from each feature descriptor by embedding it within an affine subspace containing the original feature as well as adversarial feature samples. Feature matching on the privacy-preserving representation is enabled based on the notion of subspace-to-subspace distance. We experimentally demonstrate the effectiveness of our method and its high practical relevance for the applications of visual localization and mapping as well as face authentication. Compared to the original features, our approach makes it significantly more difficult for an adversary to recover private information.


title: Modeling Shared Responses in Neuroimaging Studies through MultiView ICA

abstract: Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization. However, the aggregation of data coming from multiple subjects is challenging, since it requires accounting for large variability in anatomy, functional topography and stimulus response across individuals. Data modeling is especially hard for ecologically relevant conditions such as movie watching, where the experimental setup does not imply well-defined cognitive operations. We propose a novel MultiView Independent Component Analysis (ICA) model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise. Contrary to most group-ICA procedures, the likelihood of the model is available in closed form. We develop an alternate quasi-Newton method for maximizing the likelihood, which is robust and converges quickly. We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects. Moreover, the sources recovered by our model exhibit lower between-session variability than other methods.On magnetoencephalography (MEG) data, our method yields more accurate source localization on phantom data. Applied on 200 subjects from the Cam-CAN dataset it reveals a clear sequence of evoked activity in sensor and source space. The code is freely available at https://github.com/hugorichard/multiviewica.


title: Slow manifold reduction for plasma science

abstract: The classical Chapman-Enskog procedure admits a substantial geometrical generalization known as slow manifold reduction. This generalization provides a paradigm for deriving and understanding most reduced models in plasma physics that are based on controlled approximations applied to problems with multiple timescales. In this Review we develop the theory of slow manifold reduction with a plasma physics audience in mind. In particular we illustrate (a) how the slow manifold concept may be used to understand \emph{breakdown} of a reduced model over sufficiently-long time intervals, and (b) how a discrete-time analogue of slow manifold theory provides a useful framework for developing implicit integrators for temporally-stiff plasma models. For readers with more advanced mathematical training we also use slow manifold reduction to explain the phenomenon of inheritance of Hamiltonian structure in dissipation-free reduced plasma models. Various facets of the theory are illustrated in the context of the Abraham-Lorentz model of a single charged particle experiencing its own radiation drag. As a culminating example we derive the slow manifold underlying kinetic quasineutral plasma dynamics up to first-order in perturbation theory. This first-order result incorporates several physical effects associated with small deviations from exact charge neutrality that lead to slow drift away from predictions based on the leading-order approximation $n_e = Z_i \,n_i$.


title: Exploring Weaknesses of VQA Models through Attribution Driven Insights

abstract: Deep Neural Networks have been successfully used for the task of Visual Question Answering for the past few years owing to the availability of relevant large scale datasets. However these datasets are created in artificial settings and rarely reflect the real world scenario. Recent research effectively applies these VQA models for answering visual questions for the blind. Despite achieving high accuracy these models appear to be susceptible to variation in input questions.We analyze popular VQA models through the lens of attribution (input's influence on predictions) to gain valuable insights. Further, We use these insights to craft adversarial attacks which inflict significant damage to these systems with negligible change in meaning of the input questions. We believe this will enhance development of systems more robust to the possible variations in inputs when deployed to assist the visually impaired.


title: A simple stress-dilatancy equation for sand

abstract: The stress-dilatancy relation is of critical importance for constitutive modelling of sand. A new fractional-order stress-dilatancy equation is analytically developed in this study, based on stress-fractional operators. An apparent linear response of the stress-dilatancy behaviour of soil after sufficient shearing is obtained. As the fractional order varies, the derived stress-dilatancy curve and the associated phase transformation state stress ratio shift. But, unlike existing researches, no other specific parameters, except the fractional order, concerning such shift and the state-dependence are required. The developed stress-dilatancy equation is then incorporated into an existing constitutive model for validation. Test results of different sands are simulated and compared, where a good model performance is observed.


title: PESummary: the code agnostic Parameter Estimation Summary page builder

abstract: PESummary is a Python software package for processing and visualising data from any parameter estimation code. The easy to use Python executable scripts and extensive online documentation has resulted in PESummary becoming a key component in the international gravitational-wave analysis toolkit. PESummary has been developed to be more than just a post-processing tool with all outputs fully self-contained. PESummary has become central to making gravitational-wave inference analysis open and easily reproducible.


title: Interpretable Visualizations with Differentiating Embedding Networks

abstract: We present a visualization algorithm based on a novel unsupervised Siamese neural network training regime and loss function, called Differentiating Embedding Networks (DEN). The Siamese neural network finds differentiating or similar features between specific pairs of samples in a dataset, and uses these features to embed the dataset in a lower dimensional space where it can be visualized. Unlike existing visualization algorithms such as UMAP or $t$-SNE, DEN is parametric, meaning it can be interpreted by techniques such as SHAP. To interpret DEN, we create an end-to-end parametric clustering algorithm on top of the visualization, and then leverage SHAP scores to determine which features in the sample space are important for understanding the structures shown in the visualization based on the clusters found. We compare DEN visualizations with existing techniques on a variety of datasets, including image and scRNA-seq data. We then show that our clustering algorithm performs similarly to the state of the art despite not having prior knowledge of the number of clusters, and sets a new state of the art on FashionMNIST. Finally, we demonstrate finding differentiating features of a dataset. Code available at https://github.com/isaacrob/DEN


title: Non-local self-healing of Higgs inflation

abstract: Higgs inflation is known to be a minimal extension of the Standard Model allowing for the description of the early Universe inflation. This model is considered as an effective field theory since it has a relatively low cutoff scale, thus requiring further extensions to be a valid description of the reheating phase. We present a novel unified approach to the problem of unitarization and UV completion of the Higgs inflation model without introducing new massive degrees of freedom. This approach is based on an analytic infinite derivative modification of the Higgs field kinetic term. We construct a unitary non-local UV completion of the original Higgs inflation model while the inflationary stage is kept stable with respect to quantum corrections.


title: The Epidemic-Driven Collapse in a System with Limited Economic Resource

abstract: We consider a possibility of socioeconomic collapse caused by the spread of epidemic in a basic dynamical model with negative feedback between the infected population size and a formal collective economic resource. The epidemic-resource coupling is supposed to be of activation type, with the recovery rate governed by the Arrhenius-like law and resource playing the role of temperature. Such a coupling can result in the collapsing effect opposite to thermal explosion because of the limited resource. In this case, the system can no longer stabilize and return to the stable pre- or post-epidemic states. We demonstrate that such a collapse can partially be mitigated by means of a negative resource or debt.


title: Smoothed Geometry for Robust Attribution

abstract: Feature attributions are a popular tool for explaining the behavior of Deep Neural Networks (DNNs), but have recently been shown to be vulnerable to attacks that produce divergent explanations for nearby inputs. This lack of robustness is especially problematic in high-stakes applications where adversarially-manipulated explanations could impair safety and trustworthiness. Building on a geometric understanding of these attacks presented in recent work, we identify Lipschitz continuity conditions on models' gradient that lead to robust gradient-based attributions, and observe that smoothness may also be related to the ability of an attack to transfer across multiple attribution methods. To mitigate these attacks in practice, we propose an inexpensive regularization method that promotes these conditions in DNNs, as well as a stochastic smoothing technique that does not require re-training. Our experiments on a range of image models demonstrate that both of these mitigations consistently improve attribution robustness, and confirm the role that smooth geometry plays in these attacks on real, large-scale models.


title: Relay Aided Intelligent Reconfigurable Surfaces: Achieving the Potential Without So Many Antennas

abstract: This paper proposes a novel relay-aided intelligent reconfigurable surface (IRS) architecture for future wireless communication systems. The proposed architecture, which consists of two side-by-side intelligent surfaces connected via a full-duplex relay, has the potential of achieving the promising gains of intelligent surfaces while requiring much smaller numbers of reflecting elements. Consequently, the proposed IRS architecture needs significantly less channel estimation and beam training overhead and provides higher robustness compared to classical IRS approaches. Further, thanks to dividing the IRS reflection process over two surfaces, the position and orientation of these surfaces can be optimized to extend the wireless communication coverage and enhance the system performance. In this paper, the achievable rates and required numbers of elements using the proposed relay-aided IRS architecture are first analytically characterized and then evaluated using numerical simulations. The results show that the proposed architecture can achieve the data rate targets with much smaller numbers of elements compared to typical IRS solutions, which highlights a promising path towards the practical deployment of these intelligent surfaces.


title: Regular Global Solutions for A Generalized KdV Equation Posed on A Half-Line

abstract: An initial-boundary value problem for a generalized KdV equation posed on a half-line is considered. Existence and uniqueness of global regular solutions for arbitrary smooth initial data are established.


title: NADS: Neural Architecture Distribution Search for Uncertainty Awareness

abstract: Machine learning (ML) systems often encounter Out-of-Distribution (OoD) errors when dealing with testing data coming from a distribution different from training data. It becomes important for ML systems in critical applications to accurately quantify its predictive uncertainty and screen out these anomalous inputs. However, existing OoD detection approaches are prone to errors and even sometimes assign higher likelihoods to OoD samples. Unlike standard learning tasks, there is currently no well established guiding principle for designing OoD detection architectures that can accurately quantify uncertainty. To address these problems, we first seek to identify guiding principles for designing uncertainty-aware architectures, by proposing Neural Architecture Distribution Search (NADS). NADS searches for a distribution of architectures that perform well on a given task, allowing us to identify common building blocks among all uncertainty-aware architectures. With this formulation, we are able to optimize a stochastic OoD detection objective and construct an ensemble of models to perform OoD detection. We perform multiple OoD detection experiments and observe that our NADS performs favorably, with up to 57% improvement in accuracy compared to state-of-the-art methods among 15 different testing configurations.


title: Massive black hole binary inspiral and spin evolution in a cosmological framework

abstract: Massive black hole (MBH) binary inspiral time scales are uncertain, and their spins are even more poorly constrained. Spin misalignment, along with unequal mass ratios and spin magnitudes, introduces asymmetry in the gravitational radiation, which imparts a recoil kick to the merged MBH. Understanding how MBH binary spins evolve is crucial for determining their recoil velocities, their gravitational wave (GW) waveforms detectable with LISA, as well as their post-merger retention rate in galaxies and thus their subsequent merger rate. Here we present a novel study that introduces a sub-resolution model for gas- and GW-driven MBH binary spin evolution using a population of accreting MBHs from the Illustris cosmological hydrodynamics simulations. We also model sub-resolution binary inspiral via dynamical friction, stellar scattering, viscous gas drag, and GW emission. Our model assumes differential accretion, which causes greater alignment of the secondary MBH spin in unequal-mass mergers. We find that 47% of the MBHs in our population merge by $z=0$. Of these, 19% have misaligned primaries and 10% have misaligned secondaries at the time of merger in our (conservative) fiducial model. The MBH misalignment fraction depends strongly on the accretion disc parameters, however. Reducing accretion rates by a factor of 100, in a thicker disc, yields 79% and 42% misalignment for primaries and secondaries, respectively. Even in the fiducial model, more than 12% of binaries experience recoils of $>500$ km s$^{-1}$, which could displace them at least temporarily from galactic nuclei. We additionally find that a significant number of systems experience strong precession.


title: Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction

abstract: Many practical graph problems, such as knowledge graph construction and drug-drug interaction prediction, require to handle multi-relational graphs. However, handling real-world multi-relational graphs with Graph Neural Networks (GNNs) is often challenging due to their evolving nature, as new entities (nodes) can emerge over time. Moreover, newly emerged entities often have few links, which makes the learning even more difficult. Motivated by this challenge, we introduce a realistic problem of few-shot out-of-graph link prediction, where we not only predict the links between the seen and unseen nodes as in a conventional out-of-knowledge link prediction task but also between the unseen nodes, with only few edges per node. We tackle this problem with a novel transductive meta-learning framework which we refer to as Graph Extrapolation Networks (GEN). GEN meta-learns both the node embedding network for inductive inference (seen-to-unseen) and the link prediction network for transductive inference (unseen-to-unseen). For transductive link prediction, we further propose a stochastic embedding layer to model uncertainty in the link prediction between unseen entities. We validate our model on multiple benchmark datasets for knowledge graph completion and drug-drug interaction prediction. The results show that our model significantly outperforms relevant baselines for out-of-graph link prediction tasks.


title: Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning

abstract: The goal of neural-symbolic computation is to integrate the connectionist and symbolist paradigms. Prior methods learn the neural-symbolic models using reinforcement learning (RL) approaches, which ignore the error propagation in the symbolic reasoning module and thus converge slowly with sparse rewards. In this paper, we address these issues and close the loop of neural-symbolic learning by (1) introducing the \textbf{grammar} model as a \textit{symbolic prior} to bridge neural perception and symbolic reasoning, and (2) proposing a novel \textbf{back-search} algorithm which mimics the top-down human-like learning procedure to propagate the error through the symbolic reasoning module efficiently. We further interpret the proposed learning framework as maximum likelihood estimation using Markov chain Monte Carlo sampling and the back-search algorithm as a Metropolis-Hastings sampler. The experiments are conducted on two weakly-supervised neural-symbolic tasks: (1) handwritten formula recognition on the newly introduced HWF dataset; (2) visual question answering on the CLEVR dataset. The results show that our approach significantly outperforms the RL methods in terms of performance, converging speed, and data efficiency. Our code and data are released at \url{https://liqing-ustc.github.io/NGS}.


title: Convergence of adaptive algorithms for weakly convex constrained optimization

abstract: We analyze the adaptive first order algorithm AMSGrad, for solving a constrained stochastic optimization problem with a weakly convex objective. We prove the $\mathcal{\tilde O}(t^{-1/4})$ rate of convergence for the norm of the gradient of Moreau envelope, which is the standard stationarity measure for this class of problems. It matches the known rates that adaptive algorithms enjoy for the specific case of unconstrained smooth stochastic optimization. Our analysis works with mini-batch size of $1$, constant first and second order moment parameters, and possibly unbounded optimization domains. Finally, we illustrate the applications and extensions of our results to specific problems and algorithms.


title: Creating Majorana modes from segmented Fermi surface

abstract: We present a new platform for creating Majorana bound states from 2D gapless superconducting state in spin-helical systems under the in-plane Zeeman field. Topological 1D channels are formed by quantum confinement of quasiparticles via Andreev reflection from the surrounding fully gapped superconducting region. Our proposal can be realized using narrow strips of magnetic insulators on top of proximitized 3D topological insulators. This setup has key advantages that include: small Zeeman fields, no required fine-tuning of chemical potential, removal of the low-energy detrimental states, and large attainable topological gap.


title: Dark energy loopholes some time after GW170817

abstract: We revisit the constraints on scalar tensor theories of modified gravity following the purge of GW170817. We pay particular attention to dynamical loopholes where the anomalous speed of propagation of the gravitational wave can vanish on-shell, when we impose the dynamical field equations. By working in the effective field theory formalism we are able to improve on previous analyses, scanning a much wider class of theories, including Beyond Horndeski and DHOST. Furthermore, the formalism is well adapted to consider the effect of inhomogeneous perturbations, where we explicitly take into account the fact that the galactic overdensities are pressureless to leading order.


title: All Tree-Level Correlators for M-theory on $AdS_7 \times S^4$

abstract: We present a constructive derivation of all four-point tree-level holographic correlators for eleven dimensional supergravity on $AdS_7 \times S^4$. These correlators correspond to four-point functions of arbitrary one-half BPS operators in the six-dimensional $(2,0)$ theory at large central charge. The crucial observation is that the polar part of the correlators in Mellin space is fully captured by a drastically simpler Maximally R-symmetry Violating (MRV) amplitude, while the contact part is fully fixed by superconformal Ward identities and the flat space limit.


title: Exponential decay of transverse correlations for O(N) spin systems and related models

abstract: We prove exponential decay of transverse correlations in the Spin O(N) model for arbitrary (non-zero) values of the external magnetic field and arbitrary spin dimension N > 1. Our result is new when N > 3, in which case no Lee-Yang theorem is available, it is an alternative to Lee-Yang when N = 2, 3, and also holds for a wide class of multi-component spin systems with continuous symmetry. The key ingredients are a representation of the model as a system of coloured random paths, a `colour-switch' lemma, and a sampling procedure which allows us to bound from above the `typical' length of the open paths.


title: $\tau$-Tilting Finite Algebras With Nonempty Left Or Right Parts Are Representation-Finite

abstract: Let $\Lambda$ be a finite dimensional algebra such that $\mathcal{L}_{\Lambda}$ or $\mathcal{R}_{\Lambda}\neq\emptyset$. Then $\Lambda$ is $\tau$-tilting finite if and only if $\Lambda$ is representation-finite.


title: Discrete spacetime symmetries and particle mixing in non-Hermitian scalar quantum field theories

abstract: We discuss second quantization, discrete symmetry transformations and inner products in free non-Hermitian scalar quantum field theories with PT symmetry, focusing on a prototype model of two complex scalar fields with anti-Hermitian mass mixing. Whereas the definition of the inner product is unique for theories described by Hermitian Hamiltonians, its formulation is not unique for non-Hermitian Hamiltonians. Energy eigenstates are not orthogonal with respect to the conventional Dirac inner product, so we must consider additional discrete transformations to define a positive-definite norm. We clarify the relationship between canonical-conjugate operators and introduce the additional discrete symmetry C', previously introduced for quantum-mechanical systems, and show that the C'PT inner product does yield a positive-definite norm, and hence is appropriate for defining the Fock space in non-Hermitian models with PT symmetry in terms of energy eigenstates. We also discuss similarity transformations between PT-symmetric non-Hermitian scalar quantum field theories and Hermitian theories, showing that they would require modification in the presence of interactions. As an illustration of our discussion, we compare particle mixing in a Hermitian theory and in the corresponding non-Hermitian model with PT symmetry, showing how the latter maintains unitarity and exhibits mixing between scalar and pseudoscalar bosons.


title: Directional convergence and alignment in deep learning

abstract: In this paper, we show that although the minimizers of cross-entropy and related classification losses are off at infinity, network weights learned by gradient flow converge in direction, with an immediate corollary that network predictions, training errors, and the margin distribution also converge. This proof holds for deep homogeneous networks -- a broad class of networks allowing for ReLU, max-pooling, linear, and convolutional layers -- and we additionally provide empirical support not just close to the theory (e.g., the AlexNet), but also on non-homogeneous networks (e.g., the DenseNet). If the network further has locally Lipschitz gradients, we show that these gradients also converge in direction, and asymptotically align with the gradient flow path, with consequences on margin maximization, convergence of saliency maps, and a few other settings. Our analysis complements and is distinct from the well-known neural tangent and mean-field theories, and in particular makes no requirements on network width and initialization, instead merely requiring perfect classification accuracy. The proof proceeds by developing a theory of unbounded nonsmooth Kurdyka-{\L}ojasiewicz inequalities for functions definable in an o-minimal structure, and is also applicable outside deep learning.


title: Robust Multi-object Matching via Iterative Reweighting of the Graph Connection Laplacian

abstract: We propose an efficient and robust iterative solution to the multi-object matching problem. We first clarify serious limitations of current methods as well as the inappropriateness of the standard iteratively reweighted least squares procedure. In view of these limitations, we suggest a novel and more reliable iterative reweighting strategy that incorporates information from higher-order neighborhoods by exploiting the graph connection Laplacian. We demonstrate the superior performance of our procedure over state-of-the-art methods using both synthetic and real datasets.


title: Energy-constrained discrimination of unitaries, quantum speed limits and a Gaussian Solovay-Kitaev theorem

abstract: We investigate the energy-constrained (EC) diamond norm distance between unitary channels acting on possibly infinite-dimensional quantum systems, and establish a number of results. Firstly, we prove that optimal EC discrimination between two unitary channels does not require the use of any entanglement. Extending a result by Ac\'in, we also show that a finite number of parallel queries suffices to achieve zero error discrimination even in this EC setting. Secondly, we employ EC diamond norms to study a novel type of quantum speed limits, which apply to pairs of quantum dynamical semigroups. We expect these results to be relevant for benchmarking internal dynamics of quantum devices. Thirdly, we establish a version of the Solovay--Kitaev theorem that applies to the group of Gaussian unitaries over a finite number of modes, with the approximation error being measured with respect to the EC diamond norm relative to the photon number Hamiltonian.


title: Strain engineering in single-, bi- and tri-layer MoS2, MoSe2, WS2 and WSe2

abstract: Strain is a powerful tool to modify the optical properties of semiconducting transition metal dichalcogenides like MoS2, MoSe2, WS2 and WSe2. In this work we provide a thorough description of the technical details to perform uniaxial strain measurements on these two-dimensional semiconductors and we provide a straightforward calibration method to determine the amount of applied strain with high accuracy. We then employ reflectance spectroscopy to analyze the strain tunability of the electronic properties of single-, bi- and tri-layer MoS2, MoSe2, WS2 and WSe2. Finally, we quantify the flake-to-flake variability by analyzing 15 different single-layer MoS2 flakes.


title: Coherent splitting of two-dimensional Bose gases in magnetic potentials

abstract: Investigating out-of-equilibrium dynamics with two-dimensional (2D) systems is of widespread theoretical interest, as these systems are strongly influenced by fluctuations and there exists a superfluid phase transition at a finite temperature. In this work, we realise matter-wave interference for degenerate Bose gases, including the first demonstration of coherent splitting of 2D Bose gases using magnetic trapping potentials. We improve the fringe contrast by imaging only a thin slice of the expanded atom clouds, which will be necessary for subsequent studies on the relaxation of the gas following a quantum quench.


title: Long-time estimates for heat flows on ALE manifolds

abstract: We consider the heat equation associated to Schr\"{o}dinger operators acting on vector bundles on asymptotically locally Euclidean (ALE) manifolds. Novel $L^p - L^q$ decay estimates are established, allowing the Schr\"{o}dinger operator to have a non-trivial $L^2$-kernel. We also prove new decay estimates for spatial derivatives of arbitrary order, in a general geometric setting. Our main motivation is the application to stability of non-linear geometric equations, primarily Ricci flow, which will be presented in a companion paper. The arguments in this paper use that many geometric Schr\"{o}dinger operators can be written as the square of Dirac type operators. By a remarkable result of Wang, this is even true for the Lichnerowicz Laplacian, under the assumption of a parallel spinor. Our analysis is based on a novel combination of the Fredholm theory for Dirac type operators on ALE manifolds and recent advances in the study of the heat kernel on non-compact manifolds.


title: Neural Ordinary Differential Equations on Manifolds

abstract: Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately current approaches fall short when the underlying space has a non trivial topology, and are only available for the most basic geometries. Recently normalizing flows in Euclidean space based on Neural ODEs show great promise, yet suffer the same limitations. Using ideas from differential geometry and geometric control theory, we describe how neural ODEs can be extended to smooth manifolds. We show how vector fields provide a general framework for parameterizing a flexible class of invertible mapping on these spaces and we illustrate how gradient based learning can be performed. As a result we define a general methodology for building normalizing flows on manifolds.


title: Quasi-Dense Similarity Learning for Multiple Object Tracking

abstract: Similarity learning has been recognized as a crucial step for object tracking. However, existing multiple object tracking methods only use sparse ground truth matching as the training objective, while ignoring the majority of the informative regions on the images. In this paper, we present Quasi-Dense Similarity Learning, which densely samples hundreds of region proposals on a pair of images for contrastive learning. We can directly combine this similarity learning with existing detection methods to build Quasi-Dense Tracking (QDTrack) without turning to displacement regression or motion priors. We also find that the resulting distinctive feature space admits a simple nearest neighbor search at the inference time. Despite its simplicity, QDTrack outperforms all existing methods on MOT, BDD100K, Waymo, and TAO tracking benchmarks. It achieves 68.7 MOTA at 20.3 FPS on MOT17 without using external training data. Compared to methods with similar detectors, it boosts almost 10 points of MOTA and significantly decreases the number of ID switches on BDD100K and Waymo datasets. Our code and trained models are available at http://vis.xyz/pub/qdtrack.


title: Tidal Effects in the Post-Minkowskian Expansion

abstract: Tools from scattering amplitudes and effective field theory have recently been repurposed to derive state-of-the-art results for the black hole binary inspiral in the post-Minkowskian expansion. In the present work we extend this approach to include the tidal effects of mass and current quadrupoles on the conservative dynamics of non-spinning neutron star mergers. We compute the leading and, for the first time, next-to-leading order post-Minkowskian finite size corrections to the conservative Hamiltonian, together with their associated scattering amplitudes and scattering angles. Our expressions are gauge invariant and, in the extreme mass ratio limit, consistent with the dynamics of a tidally deformed test body in a Schwarzschild background. Furthermore, they agree completely with existing results at leading post-Minkowskian and second post-Newtonian orders.


title: VirTex: Learning Visual Representations from Textual Annotations

abstract: The de-facto approach to many vision tasks is to start from pretrained visual representations, typically learned via supervised training on ImageNet. Recent methods have explored unsupervised pretraining to scale to vast quantities of unlabeled images. In contrast, we aim to learn high-quality visual representations from fewer images. To this end, we revisit supervised pretraining, and seek data-efficient alternatives to classification-based pretraining. We propose VirTex -- a pretraining approach using semantically dense captions to learn visual representations. We train convolutional networks from scratch on COCO Captions, and transfer them to downstream recognition tasks including image classification, object detection, and instance segmentation. On all tasks, VirTex yields features that match or exceed those learned on ImageNet -- supervised or unsupervised -- despite using up to ten times fewer images.


title: Synthesis of large-area rhombohedral few-layer graphene by chemical vapor deposition on copper

abstract: Rhombohedral-stacked few-layer graphene (FLG) has been receiving an ever-increasing attention owing to its peculiar electronic properties that could lead to enticing phenomena such as superconductivity and magnetic ordering. Up to now, experimental studies on such material have been mainly limited by the difficulty in isolating it in thickness exceeding 3 atomic layers with device-compatible size. In this work, rhombohedral graphene with thickness up to 9 layers and areas up to ~50 micrometers square is grown via chemical vapor deposition (CVD) on suspended Cu foils and transferred onto target substrates via etch-free delamination. The domains of rhombohedral FLG are identified by Raman spectroscopy and are found to alternate with domains of Bernal-stacked FLG within the same crystal in a stripe-like configuration. A combined analysis of micro-Raman mapping, atomic force microscopy and optical microscopy indicates that the formation of rhombohedral-stacked FLG is strongly correlated to the copper substrate morphology. Cu step bunching results in bending of FLG and interlayer displacement along preferential crystallographic orientations, as determined experimentally by electron microscopy, thus inducing the stripe-like domains. The growth and transfer of rhombohedral FLG with the reported thickness and size shall facilitate the observation of predicted unconventional physics and ultimately add to its technological relevance.


title: Disentangled Non-Local Neural Networks

abstract: The non-local block is a popular module for strengthening the context modeling ability of a regular convolutional neural network. This paper first studies the non-local block in depth, where we find that its attention computation can be split into two terms, a whitened pairwise term accounting for the relationship between two pixels and a unary term representing the saliency of every pixel. We also observe that the two terms trained alone tend to model different visual clues, e.g. the whitened pairwise term learns within-region relationships while the unary term learns salient boundaries. However, the two terms are tightly coupled in the non-local block, which hinders the learning of each. Based on these findings, we present the disentangled non-local block, where the two terms are decoupled to facilitate learning for both terms. We demonstrate the effectiveness of the decoupled design on various tasks, such as semantic segmentation on Cityscapes, ADE20K and PASCAL Context, object detection on COCO, and action recognition on Kinetics.


title: Understanding Human Hands in Contact at Internet Scale

abstract: Hands are the central means by which humans manipulate their world and being able to reliably extract hand state information from Internet videos of humans engaged in their hands has the potential to pave the way to systems that can learn from petabytes of video data. This paper proposes steps towards this by inferring a rich representation of hands engaged in interaction method that includes: hand location, side, contact state, and a box around the object in contact. To support this effort, we gather a large-scale dataset of hands in contact with objects consisting of 131 days of footage as well as a 100K annotated hand-contact video frame dataset. The learned model on this dataset can serve as a foundation for hand-contact understanding in videos. We quantitatively evaluate it both on its own and in service of predicting and learning from 3D meshes of human hands.


title: Dynamical masses for the Pleiades binary system HII-2147

abstract: We report our long-term spectroscopic monitoring of the Pleiades member HII-2147, which has previously been spatially resolved at radio wavelengths in VLBI observations. It has also been claimed to be a (presumably short-period) double-lined spectroscopic binary with relatively sharp lines, although no orbit has ever been published. Examination of our new spectroscopic material, and of the historical radial velocities, shows that the current and previous spectra are best interpreted as showing only a single set of lines of a moderately rapidly rotating star with slowly variable radial velocity, which is one of the sources detected by VLBI. We combine our own and other velocities with the VLBI measurements and new adaptive optics observations to derive the first astrometric-spectroscopic orbit of the G5 + G9 pair, with a period of 18.18 $\pm$ 0.11 years. We infer dynamical masses of 0.897 $\pm$ 0.022 MSun for the spectroscopically visible star and 0.978 $\pm$ 0.024 MSun for the other, along with a distance of 136.78 (+0.50/-0.46) pc. The lack of detection of the lines of the more massive component in our spectra can be adequately explained if it is rotating much more rapidly than the star we see. This is consistent with the observation that the lines of the secondary are shallower than expected for a star of its spectral type.


title: A device-independent protocol for XOR oblivious transfer

abstract: Oblivious transfer is a cryptographic primitive where Alice has two bits and Bob wishes to learn some function of them. Ideally, Alice should not learn Bob's desired function choice and Bob should not learn any more than what is logically implied by the function value. While decent quantum protocols for this task are known, many become completely insecure if an adversary were to control the quantum devices used in the implementation of the protocol. In this work we give a fully device-independent quantum protocol for XOR oblivious transfer.