title: Supersymmetric Janus solutions in $\omega$-deformed N=8 gauged supergravity

abstract: We give a large class of supersymmetric Janus solutions in $\omega$-deformed (dyonic) $SO(8)$ maximal gauged supergravity with $\omega=\frac{\pi}{8}$. Unlike the purely electric counterpart, the dyonic $SO(8)$ gauged supergravity exhibits a richer structure of $AdS_4$ vacua with $N=8,2,1,1$ supersymmetries and $SO(8)$, $U(3)$, $G_2$ and $SU(3)$ symmetries, respectively. Similarly, domain walls interpolating among these critical points show a very rich structure as well. In this paper, we show that this gauged supergravity also accommodates a number of interesting supersymmetric Janus solutions in the form of $AdS_3$-sliced domain walls asymptotically interpolating between the aforementioned $AdS_4$ geometries. These solutions could be holographically interpreted as two-dimensional conformal defects within the superconformal field theories (SCFTs) of ABJM type dual to the $AdS_4$ vacua. We also give a class of solutions interpolating among the $SO(8)$, $G_2$ and $U(3)$ $AdS_4$ vacua in the case of $\omega=0$ which have not previously appeared in the presently known Janus solutions of electric $SO(8)$ gauged supergravity.


title: Divergence Regulated Encoder Network for Joint Dimensionality Reduction and Classification

abstract: Feature representation is an important aspect of remote-sensing based image classification. While deep convolutional neural networks are able to effectively amalgamate information, large numbers of parameters often make learned features inscrutable and difficult to transfer to alternative models. In order to better represent statistical texture information for remote-sensing image classification, in this paper, we investigate performing joint dimensionality reduction and classification using a novel histogram neural network. Motivated by a popular dimensionality reduction approach, t-Distributed Stochastic Neighbor Embedding (t-SNE), our proposed method incorporates a classification loss computed on samples in a low-dimensional embedding space. We compare the learned sample embeddings against coordinates found by t-SNE in terms of classification accuracy and qualitative assessment. We also explore use of various divergence measures in the t-SNE objective. The proposed method has several advantages such as readily embedding out-of-sample points and reducing feature dimensionality while retaining class discriminability. Our results show that the proposed approach maintains and/or improves classification performance and reveals characteristics of features produced by neural networks that may be helpful for other applications.


title: On the Bombieri-Lang Conjecture over finitely generated fields

abstract: The strong Bombieri-Lang conjecture postulates that, for every variety $X$ of general type over a field $k$ finitely generated over $\mathbb{Q}$, there exists an open subset $U\subset X$ such that $U(K)$ is finite for every finitely generated extension $K/k$. The weak Bombieri-Lang conjecture postulates that, for every positive dimensional variety $X$ of general type over a field $k$ finitely generated over $\mathbb{Q}$, the rational points $X(k)$ are not dense. Furthermore, Lang conjectured that every variety of general type $X$ over a field of characteristic $0$ contains an open subset $U\subset X$ such that every subvariety of $U$ is of general type, this statement is usually called geometric Lang conjecture. We reduce the strong Bombieri-Lang conjecture to the case $k=\mathbb{Q}$. Assuming the geometric Lang conjecture, we reduce the weak Bombieri-Lang conjecture to $k=\mathbb{Q}$, too.


title: SelectScale: Mining More Patterns from Images via Selective and Soft Dropout

abstract: Convolutional neural networks (CNNs) have achieved remarkable success in image recognition. Although the internal patterns of the input images are effectively learned by the CNNs, these patterns only constitute a small proportion of useful patterns contained in the input images. This can be attributed to the fact that the CNNs will stop learning if the learned patterns are enough to make a correct classification. Network regularization methods like dropout and SpatialDropout can ease this problem. During training, they randomly drop the features. These dropout methods, in essence, change the patterns learned by the networks, and in turn, forces the networks to learn other patterns to make the correct classification. However, the above methods have an important drawback. Randomly dropping features is generally inefficient and can introduce unnecessary noise. To tackle this problem, we propose SelectScale. Instead of randomly dropping units, SelectScale selects the important features in networks and adjusts them during training. Using SelectScale, we improve the performance of CNNs on CIFAR and ImageNet.


title: The Obata first eigenvalue theorems on a seven dimensional quaternionic contact manifold

abstract: We show that a compact quaternionic contact manifold of dimension seven that satisfies a Lichnerowicz-type lower Ricci-type bound and has the $P$-function of any eigenfunction of the sub-Laplacian non-negative achieves its smallest possible eigenvalue only if the structure is qc-Einstein. In particular, under the stated conditions, the lowest eigenvalue is achieved if and only if the manifold is qc-equivalent to the standard $3$-Sasakian sphere.


title: Relativistic modeling of atmospheric occultations with time transfer functions

abstract: Context: Occultation experiments represent unique opportunities for probing remotely physical properties of atmospheres. The data processing requires one to properly account for refractivity while modeling the time/frequency transfers of an electromagnetic signal. On theoretical grounds, little work have been done concerning the elaboration of a covariant approach for modeling occultation data. Aims: We present an original method allowing one to derive up to the appropriate order fully analytical expressions for the covariant description of time/frequency transfers during an atmospheric occultation experiment. Methods: We make use of two independent powerful relativistic theoretical tools, namely the optical spacetime metric, and the time transfer functions formalism. The first one allows us to consider refractivity as spacetime curvature while the second one is used to determine the time/frequency transfers occurring in a curved spacetime. Results: We provide the integral form of the time transfer function up to any post-Minkowskian order. We specify the discussion to a stationary optical spacetime describing an occultation by a steady rotating and spherically symmetric atmosphere. Explicit analytical expressions for the time/frequency transfers are provided at the first post-Minkowskian order and their accuracy is assessed by comparing them to results of a numerical integration of the equations for optical rays. Conclusions: The method accurately describes vertical temperature gradients and properly accounts for light-dragging effect due to the motion of the optical medium. It can be pushed further in order to derive the explicit form of the time transfer function at higher order and beyond the spherical symmetry assumption.


title: The group structure of dynamical transformations between quantum reference frames

abstract: Recently, it was shown that when reference frames are associated to quantum systems, the transformation laws between such quantum reference frames need to be modified to take into account the quantum and dynamical features of the reference frames. This led to a relational description of the phase space variables of the quantum system of which the quantum reference frames are part of. While such transformations were shown to be symmetries of the system's Hamiltonian, the question remained unanswered as to whether they enjoy a group structure, similar to that of the Galilei group relating classical reference frames in quantum mechanics. In this work, we identify the canonical transformations on the phase space of the quantum systems comprising the quantum reference frames, and show that these transformations close a group structure defined by a Lie algebra, which is different from the usual Galilei algebra of quantum mechanics. We further find that the elements of this new algebra are in fact the building blocks of the quantum reference frames transformations previously identified, which we recover. Finally, we show how the transformations between classical reference frames described by the standard Galilei group symmetries can be obtained from the group of transformations between quantum reference frames by taking the zero limit of the parameter that governs the additional noncommutativity introduced by the quantum nature of inertial transformations.


title: Bayesian inference of three-dimensional gas maps: I. Galactic CO

abstract: Carbon monoxide (CO) is the best tracer of Galactic molecular hydrogen (H2). Its lowest rotational emission lines are in the radio regime and thanks to Galactic rotation emission at different distances is Doppler shifted. For a given gas flow model the observed spectra can thus be deprojected along the line of sight to infer the gas distribution. We use the CO line survey of Dame et al. (2001) to reconstruct the three-dimensional density of H2. We consider the deprojection as a Bayesian variational inference problem. The posterior distribution of the gas densities allows us to estimate both the mean and uncertainty of the reconstructed density. Unlike most of the previous attempts, we take into account the correlations of gas on a variety of scales which allows curing some of the well-known pathologies, like fingers-of-god effects. Both gas flow models that we adopt incorporate a Galactic bar which induces radial motions in the inner few kiloparsecs and thus offers spectral resolution towards the Galactic centre. We compare our gas maps with those of earlier studies and characterise their statistical properties, e.g. the radial profile of the average surface mass density. We have made our three-dimensional gas maps and their uncertainties available to the community at https://dx.doi.org/10.5281/zenodo.4405437 .


title: Color-octet scalars in Dirac gaugino models with broken $R$ symmetry

abstract: In this work we study the collider phenomenology of color-octet scalars (sgluons) in supersymmetric models with Dirac gaugino masses that feature an explicitly broken $R$ symmetry ($R$-broken models). We construct such models by augmenting minimal $R$-symmetric models with a fairly general set of supersymmetric and softly supersymmetry-breaking operators that explicitly break $R$ symmetry. We then compute the rates of all significant two-body decays and highlight new features that appear as a result of $R$ symmetry breaking, including enhancements to extant decay rates, novel tree- and loop-level decays, and improved cross sections of single sgluon production. We demonstrate in some detail how the familiar results from minimal $R$-symmetric models can be obtained by restoring $R$ symmetry. In parallel to this discussion, we explore constraints on these models from the Large Hadron Collider. We find that, in general, $R$ symmetry breaking quantitatively affects existing limits on color-octet scalars, perhaps closing loopholes for light CP-odd (pseudoscalar) sgluons while opening one for a light CP-even (scalar) particle. Qualitatively, however, we find that -- much as for minimal $R$-symmetric models, despite stark differences in phenomenology -- scenarios with broken $R$ symmetry and two sgluons below the TeV scale can be accommodated by existing searches.


title: Estimating Uncertainty in Neural Networks for Cardiac MRI Segmentation: A Benchmark Study

abstract: Objective: Convolutional neural networks (CNNs) have demonstrated promise in automated cardiac magnetic resonance image segmentation. However, when using CNNs in a large real-world dataset, it is important to quantify segmentation uncertainty and identify segmentations which could be problematic. In this work, we performed a systematic study of Bayesian and non-Bayesian methods for estimating uncertainty in segmentation neural networks. Methods: We evaluated Bayes by Backprop, Monte Carlo Dropout, Deep Ensembles, and Stochastic Segmentation Networks in terms of segmentation accuracy, probability calibration, uncertainty on out-of-distribution images, and segmentation quality control. Results: We observed that Deep Ensembles outperformed the other methods except for images with heavy noise and blurring distortions. We showed that Bayes by Backprop is more robust to noise distortions while Stochastic Segmentation Networks are more resistant to blurring distortions. For segmentation quality control, we showed that segmentation uncertainty is correlated with segmentation accuracy for all the methods. With the incorporation of uncertainty estimates, we were able to reduce the percentage of poor segmentation to 5% by flagging 31--48% of the most uncertain segmentations for manual review, substantially lower than random review without using neural network uncertainty (reviewing 75--78% of all images). Conclusion: This work provides a comprehensive evaluation of uncertainty estimation methods and showed that Deep Ensembles outperformed other methods in most cases. Significance: Neural network uncertainty measures can help identify potentially inaccurate segmentations and alert users for manual review.


title: The APOGEE Library of Infrared SSP Templates (A-LIST): High-Resolution Simple Stellar Population Spectral Models in the H-Band

abstract: Integrated light spectroscopy from galaxies can be used to study the stellar populations that cannot be resolved into individual stars. This analysis relies on stellar population synthesis (SPS) techniques to study the formation history and structure of galaxies. However, the spectral templates available for SPS are limited, especially in the near-infrared. We present A-LIST (APOGEE Library of Infrared SSP Templates), a new set of high-resolution, near-IR SSP spectral templates spanning a wide range of ages (2-12 Gyr), metallicities ($\rm -2.2 < [M/H] < +0.4$) and $\alpha$ abundances ($\rm -0.2 < [\alpha/M] < +0.4$). This set of SSP templates is the highest resolution ($R\sim22500$) available in the near infrared, and the first such based on an empirical stellar library. Our models are generated using spectra of $\sim$300,000 stars spread across the Milky Way, with a wide range of metallicities and abundances, from the APOGEE survey. We show that our model spectra provide accurate fits to M31 globular cluster spectra taken with APOGEE, with best-fit metallicities agreeing with those of previous estimates to within $\sim$0.1 dex. We also compare these model spectra to lower-resolution E-MILES models and demonstrate that we recover the ages of these models to within $\sim$1.5 Gyr. This library is available in https://github.com/aishashok/ALIST-library.


title: Multifusion Categories and Finite Semisimple 2-Categories

abstract: We give a 3-universal property for the Karoubi envelope of a 2-category. Using this, we show that the 3-categories of finite semisimple 2-categories (as introduced in arXiv:1812.11933) and of multifusion categories are equivalent.


title: A simple combinatorial algorithm for restricted 2-matchings in subcubic graphs -- via half-edges

abstract: We consider three variants of the problem of finding a maximum weight restricted $2$-matching in a subcubic graph $G$. (A $2$-matching is any subset of the edges such that each vertex is incident to at most two of its edges.) Depending on the variant a restricted $2$-matching means a $2$-matching that is either triangle-free or square-free or both triangle- and square-free. While there exist polynomial time algorithms for the first two types of $2$-matchings, they are quite complicated or use advanced methodology. For each of the three problems we present a simple reduction to the computation of a maximum weight $b$-matching. The reduction is conducted with the aid of half-edges. A half-edge of edge $e$ is, informally speaking, a half of $e$ containing exactly one of its endpoints. For a subset of triangles of $G$, we replace each edge of such a triangle with two half-edges. Two half-edges of one edge $e$ of weight $w(e)$ may get different weights, not necessarily equal to $\frac{1}{2}w(e)$. In the metric setting when the edge weights satisfy the triangle inequality, this has a geometric interpretation connected to how an incircle partitions the edges of a triangle. Our algorithms are additionally faster than those known before. The running time of each of them is $O(n^2\log{n})$, where $n$ denotes the number of vertices in the graph.


title: Technique for separating velocity and density contributions in spectroscopic data and its application to studying turbulence and magnetic fields

abstract: Based on the theoretical description of Position-Position-Velocity(PPV) statistics in Lazarian & Pogosyan(2000), we introduce a new technique called the Velocity Decomposition Algorithm(VDA) in separating the PPV fluctuations arising from velocity and density fluctuations. Using MHD turbulence simulations, we demonstrate its promise in retrieving the velocity fluctuations from PPV cube in various physical conditions and its prospects in accurately tracing the magnetic field. We find that for localized clouds, the velocity fluctuations are most prominent at the wing part of the spectral line, and they dominate the density fluctuations. The same velocity dominance applies to extended HI regions undergoing galactic rotation. Our numerical experiment demonstrates that velocity channels arising from the cold phase of atomic hydrogen (HI) are still affected by velocity fluctuations at small scales. We apply the VDA to HI GALFA-DR2 data corresponding to the high-velocity cloud HVC186+19-114 and high latitude galactic diffuse HI data. Our study confirms the crucial role of velocity fluctuations in explaining why linear structures are observed within PPV cubes. We discuss the implications of VDA for both magnetic field studies and predicting polarized galactic emission that acts as the foreground for the Cosmic Microwave Background studies. Additionally, we address the controversy related to the filamentary nature of the HI channel maps and explain the importance of velocity fluctuations in the formation of structures in PPV data cubes. VDA will allow astronomers to obtain velocity fluctuations from almost every piece of spectroscopic PPV data and allow direct investigations of the turbulent velocity field in observations.

categories: astro-ph.GA astro-ph.CO physics.data-an physics.flu-dyn


title: DC Resistance Degradation of SrTiO$_3$: The Role of Virtual-Cathode Needles and Oxygen Bubbles

abstract: This study of highly accelerated lifetime tests of SrTiO$_3$, a model semiconducting oxide, is motivated by the interest in reliable multilayer ceramic capacitors and resistance-switching thin-film devices. Our analytical solution to oxygen-vacancy migration under a DC voltage -- the cause of resistance degradation in SrTiO$_3$ -- agrees with previous numerical solutions. However, all solutions fail to explain why degradation kinetics feature a very strong voltage dependence, which we attribute to the nucleation and growth of cathode-initiated fast-conducting needles. While they have no color contrast in SrTiO$_3$ single crystals and are nominally invisible, needles presence in DC-degraded samples -- in silicone oil and in air -- was unambiguously revealed by in-situ hot-stage photography. Observations in silicone oil and thermodynamic considerations of voltage boundary conditions further revealed a cooccurrence of copious oxygen bubbling and the onset of final accelerating degradation, suggesting sudden oxygen loss is a precursor of final failure. Remarkably, both undoped and Fe-doped SrTiO$_3$ can emit electroluminescence at higher current densities, thus providing a vivid indicator of resistance degradation and a metal-to-insulator resistance transition during cooling. The implications of these findings to thin ceramic and thin film SrTiO$_3$ devices are discussed, along with connections to similar findings in likewise degraded fast-ion yttria-stabilized zirconia.


title: Metaplectic Iwahori Whittaker functions and supersymmetric lattice models

abstract: In this paper we compute new values of Iwahori Whittaker functions on $n$-fold metaplectic covers $\widetilde{G}$ of $\mathbf{G}(F)$ with $\mathbf{G}$ a split reductive group over a non-archimedean local field $F$. For every Iwahori Whittaker function $\phi$, and for every $g\in\widetilde{G}$, we evaluate $\phi(g)$ by recurrence relations over the Weyl group using novel "vector Demazure-Whittaker operators." The general formula and strategy of proof are inspired by ideas appearing in the theory of integrable systems. Specializing to the case of $\mathbf{G} = \mathbf{GL}_r$, we construct a solvable lattice model of a new type associated with the quantum affine super group $U_q(\widehat{\mathfrak{gl}}(r|n))$ and prove that its partition function equals $\phi(g)$. To prove this equality we match the recurrence relations on the lattice model side (obtained from the Yang-Baxter equation) to the recurrence relations for $\phi(g)$ derived by using the representation theory of $\widetilde{G}$. Remarkably, there is a bijection between the boundary data specifying the partition function and the data determining all values of the Whittaker functions.


title: Illumination Estimation Challenge: experience of past two years

abstract: Illumination estimation is the essential step of computational color constancy, one of the core parts of various image processing pipelines of modern digital cameras. Having an accurate and reliable illumination estimation is important for reducing the illumination influence on the image colors. To motivate the generation of new ideas and the development of new algorithms in this field, the 2nd Illumination estimation challenge~(IEC\#2) was conducted. The main advantage of testing a method on a challenge over testing in on some of the known datasets is the fact that the ground-truth illuminations for the challenge test images are unknown up until the results have been submitted, which prevents any potential hyperparameter tuning that may be biased. The challenge had several tracks: general, indoor, and two-illuminant with each of them focusing on different parameters of the scenes. Other main features of it are a new large dataset of images (about 5000) taken with the same camera sensor model, a manual markup accompanying each image, diverse content with scenes taken in numerous countries under a huge variety of illuminations extracted by using the SpyderCube calibration object, and a contest-like markup for the images from the Cube+ dataset that was used in IEC\#1. This paper focuses on the description of the past two challenges, algorithms which won in each track, and the conclusions that were drawn based on the results obtained during the 1st and 2nd challenge that can be useful for similar future developments.


title: Towards the Gravituhedron: New Expressions for NMHV Gravity Amplitudes

abstract: In this paper, we present new expressions for n-point NMHV tree-level gravity amplitudes. We introduce a method of factorization diagrams which is a simple graphical representation of R-invariants in Yang-Mills theory. We define the gravity analogues which we call G-invariants, and expand the NMHV gravity amplitudes in terms of these objects. We provide explicit formulas of NMHV gravity amplitudes up to eight points in terms of G-invariants, and give the general definition for any number of points. We discuss the connection to BCFW representation, special behavior under large momentum shift, the role of momentum twistors and the intricate web of spurious poles cancelation. Because of the close connection between R-invariants and the (tree-level) Amplituhedron for Yang-Mills amplitudes, we speculate that the new expansion for gravity amplitudes should correspond to the triangulation of the putative Gravituhedron geometry.


title: FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debugging

abstract: Influence functions approximate the "influences" of training data-points for test predictions and have a wide variety of applications. Despite the popularity, their computational cost does not scale well with model and training data size. We present FastIF, a set of simple modifications to influence functions that significantly improves their run-time. We use k-Nearest Neighbors (kNN) to narrow the search space down to a subset of good candidate data points, identify the configurations that best balance the speed-quality trade-off in estimating the inverse Hessian-vector product, and introduce a fast parallel variant. Our proposed method achieves about 80X speedup while being highly correlated with the original influence values. With the availability of the fast influence functions, we demonstrate their usefulness in four applications. First, we examine whether influential data-points can "explain" test time behavior using the framework of simulatability. Second, we visualize the influence interactions between training and test data-points. Third, we show that we can correct model errors by additional fine-tuning on certain influential data-points, improving the accuracy of a trained MultiNLI model by 2.5% on the HANS dataset. Finally, we experiment with a similar setup but fine-tuning on datapoints not seen during training, improving the model accuracy by 2.8% and 1.7% on HANS and ANLI datasets respectively. Overall, our fast influence functions can be efficiently applied to large models and datasets, and our experiments demonstrate the potential of influence functions in model interpretation and correcting model errors. Code is available at https://github.com/salesforce/fast-influence-functions


title: Collective treadmilling in fire ant rafts permits sustained protrusion growth

abstract: Condensed active matter is exemplary for its capacity to morph and exhibit internal flows despite remaining cohered. To facilitate understanding of this ability, we investigate the cause of finger-like protrusions that emerge from super-organismal, aggregated rafts of fire ants (Solenopsis invicta). While these features are easily observed, what permits their recuring initiation, growth, and recession is not immediately clear. Ants rafts are comprised of a floating, structural network of interconnected ants on which a layer of freely active ants walks. We show here that sustained shape evolution is permitted by treadmilling defined by the competition between perpetual raft contraction due to displacement of bulk structural ants into the active layer, and outwards raft expansion due to deposition of free ants into the structural network at the edges. Furthermore, we see that protrusions emerge due to asymmetries in the edge deposition rate of surface ants, and we provide strong evidence that these asymmetries occur stochastically due to wall accumulation effects and local alignment interactions. Together these effects permit the cooperative, yet spontaneous formation of protrusions that fire ants utilize for functional exploration and to escape flooded environments. Ant raft dynamics mirror the treadmilling that facilitates morphogenesis and motility of cytoskeletons, thus providing another example in which reshaping of condensed active matter is explained by free constituent transport, yet whose continuance relies on perpetual phase transition between structural and free members.


title: iGOS++: Integrated Gradient Optimized Saliency by Bilateral Perturbations

abstract: The black-box nature of the deep networks makes the explanation for "why" they make certain predictions extremely challenging. Saliency maps are one of the most widely-used local explanation tools to alleviate this problem. One of the primary approaches for generating saliency maps is by optimizing a mask over the input dimensions so that the output of the network is influenced the most by the masking. However, prior work only studies such influence by removing evidence from the input. In this paper, we present iGOS++, a framework to generate saliency maps that are optimized for altering the output of the black-box system by either removing or preserving only a small fraction of the input. Additionally, we propose to add a bilateral total variation term to the optimization that improves the continuity of the saliency map especially under high resolution and with thin object parts. The evaluation results from comparing iGOS++ against state-of-the-art saliency map methods show significant improvement in locating salient regions that are directly interpretable by humans. We utilized iGOS++ in the task of classifying COVID-19 cases from x-ray images and discovered that sometimes the CNN network is overfitted to the characters printed on the x-ray images when performing classification. Fixing this issue by data cleansing significantly improved the precision and recall of the classifier.


title: Understanding Politics via Contextualized Discourse Processing

abstract: Politicians often have underlying agendas when reacting to events. Arguments in contexts of various events reflect a fairly consistent set of agendas for a given entity. In spite of recent advances in Pretrained Language Models (PLMs), those text representations are not designed to capture such nuanced patterns. In this paper, we propose a Compositional Reader model consisting of encoder and composer modules, that attempts to capture and leverage such information to generate more effective representations for entities, issues, and events. These representations are contextualized by tweets, press releases, issues, news articles, and participating entities. Our model can process several documents at once and generate composed representations for multiple entities over several issues or events. Via qualitative and quantitative empirical analysis, we show that these representations are meaningful and effective.


title: Studying the onset of deconfinement with multi-messenger astronomy of neutron stars

abstract: With the first multi-messenger observation of a binary neutron star merger (GW170817) new constraints became available for masses and radii of neutron stars. We introduce a class of hybrid EoS that fulfils all these constraints and predicts a region in the mass-radius diagram that could be populated only by hybrid neutron stars with quark matter cores. A confirmation of this conjecture would be provided when the NICER radius measurement for the high-mass pulsar PSR J0740+6620 yields a radius less than 11 km. Would this radius measurement yield a result in excess of 12 km, this would allow for both, a purely hadronic and a hybrid nature of this star. In the latter case the maximum mass could reach $2.6~M_\odot$ so that the lighter object in the asymmetric binary merger GW190814 could have been a hybrid star. We demonstrate that this high mass can be compatible with an early onset of deconfinement at star masses below $1~M_\odot$ and the occurrence of low-mass twin stars. In such a case the remnant of GW170817 could be a long-lived hypermassive pulsar.


title: Conditional Generation of Temporally-ordered Event Sequences

abstract: Models of narrative schema knowledge have proven useful for a range of event-related tasks, but they typically do not capture the temporal relationships between events. We propose a single model that addresses both temporal ordering, sorting given events into the order they occurred, and event infilling, predicting new events which fit into an existing temporally-ordered sequence. We use a BART-based conditional generation model that can capture both temporality and common event co-occurrence, meaning it can be flexibly applied to different tasks in this space. Our model is trained as a denoising autoencoder: we take temporally-ordered event sequences, shuffle them, delete some events, and then attempt to recover the original event sequence. This task teaches the model to make inferences given incomplete knowledge about the events in an underlying scenario. On the temporal ordering task, we show that our model is able to unscramble event sequences from existing datasets without access to explicitly labeled temporal training data, outperforming both a BERT-based pairwise model and a BERT-based pointer network. On event infilling, human evaluation shows that our model is able to generate events that fit better temporally into the input events when compared to GPT-2 story completion models.


title: Classifications of $\Gamma$-colored minuscule posets and $P$-minuscule Kac--Moody representations

abstract: The $\Gamma$-colored $d$-complete and $\Gamma$-colored minuscule posets unify and generalize multiple classes of colored posets introduced by R.A. Proctor, J.R. Stembridge, and R.M. Green. In previous work, we showed that $\Gamma$-colored minuscule posets are necessary and sufficient to build from colored posets certain representations of Kac--Moody algebras that generalize minuscule representations of semisimple Lie algebras. In this paper we classify $\Gamma$-colored minuscule posets, which also classifies the corresponding representations. We show that $\Gamma$-colored minuscule posets are precisely disjoint unions of colored minuscule posets of Proctor and connected full heaps of Green. Connected finite $\Gamma$-colored minuscule posets can be realized as certain posets of coroots in the corresponding finite Lie type.


title: Evidence-based Factual Error Correction

abstract: This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to correct written texts that are refuted or only partially supported by evidence. We demonstrate that it is feasible to train factual error correction systems from existing fact checking datasets which only contain labeled claims accompanied by evidence, but not the correction. We achieve this by employing a two-stage distant supervision approach that incorporates evidence into masked claims when generating corrections. Our approach, based on the T5 transformer and using retrieved evidence, achieved better results than existing work which used a pointer copy network and gold evidence, producing accurate factual error corrections for 5x more instances in human evaluation and a .125 increase in SARI score. The evaluation is conducted on a dataset of 65,000 instances based on a recent fact verification shared task and we release it to enable further work on the task.


title: Near Optimal $L^p\rightarrow L^q$ Estimates for Euclidean Averages Over Prototypical Hypersurfaces in $\mathbb{R}^3$

abstract: We find the precise range of $(p,q)$ for which local averages along graphs of a class of two-variable polynomials in $\mathbb{R}^3$ are of restricted weak type $(p,q)$, given the hypersurfaces have Euclidean surface measure. We derive these results using non-oscillatory, geometric methods, for a model class of polynomials bearing a strong connection to the general real-analytic case.


title: Global Inverse Design Across Multiple Photonic Structure Classes Using Generative Deep Learning

abstract: Understanding how nano- or micro-scale structures and material properties can be optimally configured to attain specific functionalities remains a fundamental challenge. Photonic metasurfaces, for instance, can be spectrally tuned through material choice and structural geometry to achieve unique optical responses. However, existing numerical design methods require prior identification of specific material-structure combinations, or device classes, as the starting point for optimization. As such, a unified solution that simultaneously optimizes across materials and geometries has yet to be realized. To overcome these challenges, we present a global deep learning-based inverse design framework, where a conditional deep convolutional generative adversarial network is trained on colored images encoded with a range of material and structural parameters, including refractive index, plasma frequency, and geometric design. We demonstrate that, in response to target absorption spectra, the network can identify an effective metasurface in terms of its class, materials properties, and overall shape. Furthermore, the model can arrive at multiple design variants with distinct materials and structures that present nearly identical absorption spectra. Our proposed framework is thus an important step towards global photonics and materials design strategies that can identify combinations of device categories, material properties, and geometric parameters which algorithmically deliver a sought functionality.


title: Partially Observable Mean Field Reinforcement Learning

abstract: Traditional multi-agent reinforcement learning algorithms are not scalable to environments with more than a few agents, since these algorithms are exponential in the number of agents. Recent research has introduced successful methods to scale multi-agent reinforcement learning algorithms to many agent scenarios using mean field theory. Previous work in this field assumes that an agent has access to exact cumulative metrics regarding the mean field behaviour of the system, which it can then use to take its actions. In this paper, we relax this assumption and maintain a distribution to model the uncertainty regarding the mean field of the system. We consider two different settings for this problem. In the first setting, only agents in a fixed neighbourhood are visible, while in the second setting, the visibility of agents is determined at random based on distances. For each of these settings, we introduce a Q-learning based algorithm that can learn effectively. We prove that this Q-learning estimate stays very close to the Nash Q-value (under a common set of assumptions) for the first setting. We also empirically show our algorithms outperform multiple baselines in three different games in the MAgents framework, which supports large environments with many agents learning simultaneously to achieve possibly distinct goals.


title: Chiral correlators in $\mathcal{N}=2$ superconformal quivers

abstract: We consider a family of $\mathcal{N}=2$ superconformal field theories in four dimensions, defined as $\mathbb{Z}_q$ orbifolds of $\mathcal{N}=4$ Super Yang-Mills theory. We compute the chiral/anti-chiral correlation functions at a perturbative level, using both the matrix model approach arising from supersymmetric localisation on the four-sphere and explicit field theory calculations on the flat space using the $\mathcal{N}=1$ superspace formalism. We implement a highly efficient algorithm to produce a large number of results for finite values of $N$, exploiting the symmetries of the quiver to reduce the complexity of the mixing between the operators. Finally the interplay with the field theory calculations allows to isolate special observables which deviate from $\mathcal{N}=4$ only at high orders in perturbation theory.


title: Promoting Graph Awareness in Linearized Graph-to-Text Generation

abstract: Generating text from structured inputs, such as meaning representations or RDF triples, has often involved the use of specialized graph-encoding neural networks. However, recent applications of pretrained transformers to linearizations of graph inputs have yielded state-of-the-art generation results on graph-to-text tasks. Here, we explore the ability of these linearized models to encode local graph structures, in particular their invariance to the graph linearization strategy and their ability to reconstruct corrupted inputs. Our findings motivate solutions to enrich the quality of models' implicit graph encodings via scaffolding. Namely, we use graph-denoising objectives implemented in a multi-task text-to-text framework. We find that these denoising scaffolds lead to substantial improvements in downstream generation in low-resource settings.


title: Elliptic solutions of dynamical Lucas sequences

abstract: We study two types of dynamical extensions of Lucas sequences and give elliptic solutions for them. The first type concerns a level-dependent (or discrete time-dependent) version involving commuting variables. We show that a nice solution for this system is given by elliptic numbers. The second type involves a non-commutative version of Lucas sequences which defines the non-commutative (or abstract) Fibonacci polynomials introduced by Johann Cigler. If the non-commuting variables are specialized to be elliptic-commuting variables the abstract Fibonacci polynomials become non-commutative elliptic Fibonacci polynomials. Some properties we derive for these include their explicit expansion in terms of normalized monomials and a non-commutative elliptic Euler--Cassini identity.


title: The birational Lalanne-Kreweras involution

abstract: The Lalanne-Kreweras involution is an involution on the set of Dyck paths which combinatorially exhibits the symmetry of the number of valleys and major index statistics. We define piecewise-linear and birational extensions of the Lalanne-Kreweras involution. Actually, we show that the Lalanne-Kreweras involution is a special case of a more general operator, called rowvacuation, which acts on the antichains of any graded poset. Rowvacuation, like the closely related and more studied rowmotion operator, is a composition of toggles. We obtain the piecewise-linear and birational lifts of the Lalanne-Kreweras involution by using the piecewise-linear and birational toggles of Einstein and Propp. We show that the symmetry properties of the Lalanne-Kreweras involution extend to these piecewise-linear and birational lifts.


title: Spectral Causality and the Scattering of Waves

abstract: Causality - the principle stating that the output of a system cannot temporally precede the input - is a universal property of nature. Here, we show that analogous input-output relations can also be realized in the spectral domain by leveraging the peculiar properties of time-modulated non-Hermitian photonic systems. Specifically, we uncover the existence of a broad class of complex time-modulated metamaterials which obey the time-domain equivalent of the well-established frequency-domain Kramers-Kronig relations (a direct consequence of causality). We find that, in the scattering response of such time-modulated systems, the output frequencies are inherently prohibited from spectrally preceding the input frequencies, hence we refer to these systems as 'spectrally causal'. We explore the consequences of this newly introduced concept for several relevant applications, including broadband perfect absorption, temporal cloaking of an 'event', and truly unidirectional propagation along a synthetic dimension. By emulating the concept of causality in the spectral domain and providing new tools to extend the field of temporally modulated metamaterials ("chrono-metamaterials") into the complex realm, our findings may open unexplored opportunities and enable relevant technological advances in various areas of photonics and, more broadly, of wave physics and engineering.


title: A hybrid Fourier--Real Gaussian Mixture method for fast galaxy--PSF convolution

abstract: I present a method for the fast convolution of a model galaxy profile by a point-spread function (PSF) model represented as a pixel grid. The method relies upon three observations: First, most simple radial galaxy profiles of common interest (deVaucouleurs, exponential, Sersic) can be approximated as mixtures of Gaussians. Second, the Fourier transform of a Gaussian is a Gaussian, thus the Fourier transform of a mixture-of-Gausssian approximation of a galaxy can be directly evaluated as a mixture of Gaussians in Fourier space. Third, if a mixture component would result in Fourier-space aliasing, that component can be evaluated in real space. For mixture components to be evaluated in Fourier space, we use the FFT for the PSF model, direct evaluation of the Fourier transform for the galaxy, and the inverse-FFT to return the result to pixel space. For mixture components to be evaluated in real space---which only happens when the mixture components is much larger than the PSF---we use a simple Gaussian approximation of the PSF, perform the convolution analytically, and evaluate in real pixel space. The method is fast and exact (to the extent that the mixture-of-Gaussians approximation of the galaxy profile is exact) as long as the pixelized PSF model is well sampled. This Fourier method can be seen as a way of applying a perfect low-pass filter to the (typically strongly undersampled) galaxy profile before convolution by the PSF, at exactly the Nyquist frequency of the PSF pixel model grid. In this way, it avoids the computational expense of a traditional super-resolution approach. This method allows the efficient use of pixelized PSF models (ie, a PSF represented as a grid of pixel values) in galaxy forward model-fitting approaches such as the Tractor.


title: Rescuing a black hole in the large-$q$ coupled SYK model

abstract: In this paper, we develop a general effective theory for two copies of the Sachdev-Ye-Kitaev (SYK) model with a time-dependent bilinear coupling. For a quantum quench problem with an initial state of the thermofield double state, we show how the evolution of the system is described by a complex reparametrization field with a classical Hamiltonian. We study correlation functions in this system and compare the large-$q$ theory with the bulk low energy effective theory. In particular, we study the special case of a ``rescued black hole'', which describes how a time-evolved thermofield double state can evolve to the ground state of a coupled SYK model by a carefully tuned time-dependent coupling. In the low energy region, there is a holographic dual interpretation, which is a geometry that crosses over from an eternal black hole to a global AdS$_2$ vacuum. This family of geometries allow us to access the bulk region that would be the black hole interior without the rescue process. By comparing the large-$q$ and low energy theory, we find that even in the low energy region the deviation from the low energy theory cannot be neglected if the rescue process starts late. This provides evidence that the low energy effective theory of the bulk fails near the inner horizon of the black hole. We note the possibility of a connection to a two-dimensional analog of the higher-dimensional black hole singularity.


title: On the Construction of a Post-Quantum Blockchain for Smart City

abstract: Owing to some special characteristics and features, blockchain is a very useful technique that can securely organize diverse devices in a smart city. It finds wide applications, especially in distributed environments, where entities such as wireless sensors need to be certain of the authenticity of the server. As contemporary blockchain techniques that address post-quantum concerns have not been designed, in this study, we investigate a blockchain in the post-quantum setting and seek to discover how it can resist attacks from quantum computing. In addition, traditional proof of work (PoW)-based consensus protocols such as Bitcoin cannot supply memory mining, and the transaction capacity of each block in a blockchain is limited and needs to be expanded. Thus, a new post-quantum proof of work (post-quantum PoW) consensus algorithm for security and privacy of smart city applications is proposed. It can be used to not only protect a blockchain under a quantum computing attack compared to existing classical hash-based PoW algorithms but also to supply memory mining. Meanwhile, an identity-based post-quantum signature is embedded into a transaction process to construct lightweight transactions. Subsequently, we provide a detailed description on the execution of the post-quantum lightweight transaction in a blockchain. Overall, this work can help enrich the research on future post-quantum blockchain and support the construction or architecture of emerging blockchain-based smart cities.


title: A stable majority population protocol using logarithmic time and states

abstract: We study population protocols, a model of distributed computing appropriate for modeling well-mixed chemical reaction networks and other physical systems where agents exchange information in pairwise interactions, but have no control over their schedule of interaction partners. The well-studied *majority* problem is that of determining in an initial population of $n$ agents, each with one of two opinions $A$ or $B$, whether there are more $A$, more $B$, or a tie. A *stable* protocol solves this problem with probability 1 by eventually entering a configuration in which all agents agree on a correct consensus decision of $A$, $B$, or $T$, from which the consensus cannot change. We describe a protocol that solves this problem using $O(\log n)$ states ($\log \log n + O(1)$ bits of memory) and optimal expected time $O(\log n)$. The number of states $O(\log n)$ is known to be optimal for the class of stable protocols that are "output dominant" and "monotone". These are two natural constraints satisfied by our protocol, making it state-optimal for that class. We use, and develop novel analysis of, a key technique called a "fixed resolution clock" due to Gasieniec, Stachowiak, and Uznanski, who showed a majority protocol using $O(\log n)$ time and states that has a positive probability of error. Our protocol is *nonuniform*: the transition function has the value $\left \lceil {\log n} \right \rceil$ encoded in it. We show that the protocol can be modified to be uniform, while increasing the state complexity to $\Theta(\log n \log \log n)$.


title: Globally +-regular varieties and the minimal model program for threefolds in mixed characteristic

abstract: We establish the Minimal Model Program for arithmetic threefolds whose residue characteristics are greater than five. In doing this, we generalize the theory of global $F$-regularity to mixed characteristic and identify certain stable sections of adjoint line bundles. Finally, by passing to graded rings, we generalize a special case of Fujita's conjecture to mixed characteristic.


title: The Sample Complexity of Robust Covariance Testing

abstract: We study the problem of testing the covariance matrix of a high-dimensional Gaussian in a robust setting, where the input distribution has been corrupted in Huber's contamination model. Specifically, we are given i.i.d. samples from a distribution of the form $Z = (1-\epsilon) X + \epsilon B$, where $X$ is a zero-mean and unknown covariance Gaussian $\mathcal{N}(0, \Sigma)$, $B$ is a fixed but unknown noise distribution, and $\epsilon>0$ is an arbitrarily small constant representing the proportion of contamination. We want to distinguish between the cases that $\Sigma$ is the identity matrix versus $\gamma$-far from the identity in Frobenius norm. In the absence of contamination, prior work gave a simple tester for this hypothesis testing task that uses $O(d)$ samples. Moreover, this sample upper bound was shown to be best possible, within constant factors. Our main result is that the sample complexity of covariance testing dramatically increases in the contaminated setting. In particular, we prove a sample complexity lower bound of $\Omega(d^2)$ for $\epsilon$ an arbitrarily small constant and $\gamma = 1/2$. This lower bound is best possible, as $O(d^2)$ samples suffice to even robustly {\em learn} the covariance. The conceptual implication of our result is that, for the natural setting we consider, robust hypothesis testing is at least as hard as robust estimation.


title: Divergence of finitely presented subgroups of CAT(0) groups

abstract: We construct families of $CAT(0)$ groups containing finitely presented groups whose divergence functions are of the form $r^\alpha$ for a dense set of exponents $\alpha \in [2,\infty)$ and $r^q\log(r)$ for integers $q \geq 2$. The same construction also yields examples of $CAT(0)$ groups containing contracting elements which are not contracting in certain finitely presented subgroups.


title: Berry-phase induced entanglement of hole-spin qubits in a microwave cavity

abstract: Hole-spins localized in semiconductor structures, such as quantum dots or defects, serve to the realization of efficient gate-tunable solid-state quantum bits. Here we study two electrically driven spin $3/2$ holes coupled to the electromagnetic field of a microwave cavity. We show that the interplay between the non-Abelian Berry phases generated by local time-dependent electrical fields and the shared cavity photons allows for fast manipulation, detection, and long-range entanglement of the hole-spin qubits in the absence of any external magnetic field. Owing to its geometrical structure, such a scheme is more robust against external noises than the conventional hole-spin qubit implementations. These results suggest that hole-spins are favorable qubits for scalable quantum computing by purely electrical means.


title: Arithmetic properties of the Herglotz function

abstract: In this paper we study two functions $F(x)$ and $J(x)$, originally found by Herglotz in 1923 and later rediscovered and used by one of the authors in connection with the Kronecker limit formula for real quadratic fields. We discuss many interesting properties of these functions, including special values at rational or quadratic irrational arguments as rational linear combinations of dilogarithms and products of logarithms, functional equations coming from Hecke operators, and connections with Stark's conjecture. We also discuss connections with 1-cocycles for the modular group $\mathrm{PSL}(2,\mathbb{Z})$.


title: Symmetries versus the spectrum of $ J\bar T$-deformed CFTs

abstract: It has been recently shown that classical $J\bar T$ - deformed CFTs possess an infinite-dimensional Witt-Ka\v{c}-Moody symmetry, generated by certain field-dependent coordinate and gauge transformations. On a cylinder, however, the equal spacing of the descendants' energies predicted by such a symmetry algebra is inconsistent with the known finite-size spectrum of $J\bar T$ - deformed CFTs. Also, the associated quantum symmetry generators do not have a proper action on the Hilbert space. In this article, we resolve this tension by finding a new set of (classical) conserved charges, whose action is consistent with semi-classical quantization, and which are related to the previous symmetry generators by a type of energy-dependent spectral flow. The previous inconsistency between the algebra and the spectrum is resolved because the energy operator does not belong to the spectrally flowed sector.


title: Flat space holography in spin-2 extended dilaton-gravity

abstract: We present an interacting spin-2 gauge theory coupled to the two-dimensional dilaton-gravity in flat spacetime. The asymptotic symmetry group is enhanced to the central extension of Diff$(S^1)\ltimes C^\infty(S^1)\ltimes$Vec($S^1$) when the central element of the Heisenberg subgroup is zero (vanishing $U(1)$ level). Using the BF-formulation of the model we derive the corresponding boundary coadjoint action which is the spin-2 extension of the warped Schwarzian theory at vanishing $U(1)$ level. We also discuss the thermodynamics of black holes in this model.


title: Metastability and discrete spectrum of long-range systems

abstract: Long lived quasi-stationary states (QSSs) are a signature characteristic of long-range interacting systems both in the classical and in the quantum realms. Often, they emerge after a sudden quench of the Hamiltonian internal parameters and present a macroscopic life-time, which increases with the system size. Despite their ubiquity, the fundamental mechanism at their root remains unknown. Here, we show that the spectrum of systems with power-law decaying couplings remains discrete up to the thermodynamic limit. As a consequence, several traditional results on the chaotic nature of the spectrum in many-body quantum systems are not satisfied in presence of long-range interactions. In particular, the existence of QSSs may be traced back to the finiteness of Poincar\'e recurrence times. This picture justifies and extends known results on the anomalous magnetization dynamics in the quantum Ising model with power-law decaying couplings. The comparison between the discrete spectrum of long-range systems and more conventional examples of pure point spectra in the disordered case is also discussed.


title: Almost sure large fluctuations of random multiplicative functions

abstract: We prove that if $f(n)$ is a Steinhaus or Rademacher random multiplicative function, there almost surely exist arbitrarily large values of $x$ for which $|\sum_{n \leq x} f(n)| \geq \sqrt{x} (\log\log x)^{1/4+o(1)}$. This is the first such bound that grows faster than $\sqrt{x}$, answering a question of Hal\'asz and proving a conjecture of Erd\H{o}s. It is plausible that the exponent $1/4$ is sharp in this problem. The proofs work by establishing a multivariate Gaussian approximation for the sums $\sum_{n \leq x} f(n)$ at a sequence of $x$, conditional on the behaviour of $f(p)$ for all except the largest primes $p$. The most difficult aspect is showing that the conditional covariances of the sums are usually small, so the corresponding Gaussians are usually roughly independent. These covariances are related to an Euler product (or multiplicative chaos) type integral twisted by additive characters, which we study using various tools including mean value estimates for Dirichlet polynomials, high mixed moment estimates for random Euler products, and barrier arguments with random walks.


title: UCCA's Foundational Layer: Annotation Guidelines v2.1

abstract: This is the annotation manual for Universal Conceptual Cognitive Annotation (UCCA; Abend and Rappoport, 2013), specifically the Foundational Layer. UCCA is a graph-based semantic annotation scheme based on typological linguistic principles. It has been applied to several languages; for ease of exposition these guidelines give examples mainly in English. New annotators may wish to start with the tutorial on the UCCA framework (Abend et al., 2020). Further resources are available at the project homepage: https://universalconceptualcognitiveannotation.github.io


title: Statistics of non-polarized points in the CMB polarization maps

abstract: The non-polarized points (NPP) of the $Q$ and $U$ Stokes parameters of the CMB can be classified according to the geometry of the polarization field. We describe a procedure to identify these points in the pixelized sky and present the shape of the polarization angles in the vicinity of NPPs. We design a test of Gaussianity using the Kullback-Leibler divergence. We show that the total number density of non-polarized points of the E- and B-families is closely related to the presence of lensing and the tensor-to-scalar ratio $r$. We further show that in the absence of lensing, the total number of NPPs of all types does not depend on $r$, while the lensing effect removes this degeneracy. This analysis is applied to the CMB maps from the 2018 Planck release. We show that there is general consistency of SMICA and NILC maps compared to a reference set of Gaussian simulations. The strongest discrepancies are found in the Commander (with corresponding $p$-value $0.07$) and NILC ($p = 0.15$) maps.


title: Symbol Alphabets from Plabic Graphs II: Rational Letters

abstract: Symbol alphabets of n-particle amplitudes in N=4 super-Yang-Mills theory are known to contain certain cluster variables of Gr(4,n) as well as certain algebraic functions of cluster variables. The first paper arXiv:2007.00646 in this series focused on n=8 algebraic letters. In this paper we show that it is possible to obtain all rational symbol letters (in fact all cluster variables) by solving matrix equations of the form C Z = 0 if one allows C to be an arbitrary cluster parameterization of the top cell of Gr_+(n-4,n).


title: Bundle gerbes on supermanifolds

abstract: We show that every bundle gerbe on a supermanifold decomposes into a bundle gerbe over the underlying manifold and a 2-form on the supermanifold. This decomposition is not canonical, but is determined by the choice of a projection map to the underlying manifold. Along the way, we prove the familiar cohomological classification theorems for bundle gerbes and bundle gerbes with connection in the context of supermanifolds.


title: Language-Mediated, Object-Centric Representation Learning

abstract: We present Language-mediated, Object-centric Representation Learning (LORL), a paradigm for learning disentangled, object-centric scene representations from vision and language. LORL builds upon recent advances in unsupervised object discovery and segmentation, notably MONet and Slot Attention. While these algorithms learn an object-centric representation just by reconstructing the input image, LORL enables them to further learn to associate the learned representations to concepts, i.e., words for object categories, properties, and spatial relationships, from language input. These object-centric concepts derived from language facilitate the learning of object-centric representations. LORL can be integrated with various unsupervised object discovery algorithms that are language-agnostic. Experiments show that the integration of LORL consistently improves the performance of unsupervised object discovery methods on two datasets via the help of language. We also show that concepts learned by LORL, in conjunction with object discovery methods, aid downstream tasks such as referring expression comprehension.


title: Universal Adaptive Control of Nonlinear Systems

abstract: This work develops a new direct adaptive control framework that extends the certainty equivalence principle to general nonlinear systems with unmatched model uncertainties. The approach adjusts the rate of adaptation online to eliminate the effects of parameter estimation transients on closed-loop stability. The method can be immediately combined with a previously designed or learned feedback policy if a corresponding model-parameterized Lyapunov function or contraction metric is known. Simulation results of various nonlinear systems with unmatched uncertainties demonstrates the approach.


title: Fairness in Machine Learning

abstract: Machine learning based systems are reaching society at large and in many aspects of everyday life. This phenomenon has been accompanied by concerns about the ethical issues that may arise from the adoption of these technologies. ML fairness is a recently established area of machine learning that studies how to ensure that biases in the data and model inaccuracies do not lead to models that treat individuals unfavorably on the basis of characteristics such as e.g. race, gender, disabilities, and sexual or political orientation. In this manuscript, we discuss some of the limitations present in the current reasoning about fairness and in methods that deal with it, and describe some work done by the authors to address them. More specifically, we show how causal Bayesian networks can play an important role to reason about and deal with fairness, especially in complex unfairness scenarios. We describe how optimal transport theory can be used to develop methods that impose constraints on the full shapes of distributions corresponding to different sensitive attributes, overcoming the limitation of most approaches that approximate fairness desiderata by imposing constraints on the lower order moments or other functions of those distributions. We present a unified framework that encompasses methods that can deal with different settings and fairness criteria, and that enjoys strong theoretical guarantees. We introduce an approach to learn fair representations that can generalize to unseen tasks. Finally, we describe a technique that accounts for legal restrictions about the use of sensitive attributes.


title: Trading bits in the readout from a genetic network

abstract: In genetic networks, information of relevance to the organism is represented by the concentrations of transcription factor molecules. In order to extract this information the cell must effectively "measure"' these concentrations, but there are physical limits to the precision of these measurements. We explore this trading between bits of precision in measuring concentration and bits of relevant information that can be extracted, using the gap gene network in the early fly embryo as an example. We argue that cells in the embryo can extract all the available information about their position, but only if the concentration measurements approach the physical limits to information capacity. These limits necessitate the observed proliferation of enhancer elements with sensitivities to combinations of transcription factors, but fine tuning of the parameters of these multiple enhancers is not required.


title: On balanced and abelian properties of circular words over a ternary alphabet

abstract: We revisit the question of classification of balanced circular words and focus on the case of a ternary alphabet. We propose a $3$-dimensional generalisation of the discrete approximation representation of Christoffel words. By considering the minimal bound $3$ for abelian complexity of balanced circular words over a ternary alphabet, we provide a classification of all circular words over a ternary alphabet with abelian complexity subject to this bound. This result also allows us to construct an uncountable set of bi-infinite aperiodic words with abelian complexity equal to $3$.


title: Transcription-dependent spatial organization of a gene locus

abstract: There is growing appreciation that gene function is connected to the dynamic structure of the chromosome. Here we explore the interplay between three-dimensional structure and transcriptional activity at the single cell level. We show that inactive loci are spatially more compact than active ones, and that within active loci the enhancer driving transcription is closest to the promoter. On the other hand, even this shortest distance is too long to support direct physical contact between the enhancer-promoter pair when the locus is transcriptionally active. Artificial manipulation of genomic separations between enhancers and the promoter produces changes in physical distance and transcriptional activity, recapitulating the correlation seen in wild-type embryos, but disruption of topological domain boundaries has no effect. Our results suggest a complex interdependence between transcription and the spatial organization of cis-regulatory elements.


title: Constraints on quasinormal modes and bounds for critical points from pole-skipping

abstract: We consider a holographic thermal state and perturb it by a scalar operator whose associated real-time Green's function has only gapped poles. These gapped poles correspond to the non-hydrodynamic quasinormal modes of a massive scalar perturbation around a Schwarzschild black brane. Relations between pole-skipping points, critical points and quasinormal modes in general emerge when the mass of the scalar and hence the dual operator dimension is varied. First, this novel analysis reveals a relation between the location of a mode in the infinite tower of quasinormal modes and the number of pole-skipping points constraining its dispersion relation at imaginary momenta. Second, for the first time, we consider the radii of convergence of the derivative expansions about the gapped quasinormal modes. These convergence radii turn out to be bounded from above by the set of all pole-skipping points. Furthermore, a transition between two distinct classes of critical points occurs at a particular value for the conformal dimension, implying close relations between critical points and pole-skipping points in one of those two classes. We show numerically that all of our results are also true for gapped modes of vector and tensor operators.

categories: hep-th cond-mat.mes-hall cond-mat.str-el hep-ph nucl-th


title: Neural Network Approximations for Calabi-Yau Metrics

abstract: Ricci flat metrics for Calabi-Yau threefolds are not known analytically. In this work, we employ techniques from machine learning to deduce numerical flat metrics for the Fermat quintic, for the Dwork quintic, and for the Tian-Yau manifold. This investigation employs a single neural network architecture that is capable of approximating Ricci flat Kaehler metrics for several Calabi-Yau manifolds of dimensions two and three. We show that measures that assess the Ricci flatness of the geometry decrease after training by three orders of magnitude. This is corroborated on the validation set, where the improvement is more modest. Finally, we demonstrate that discrete symmetries of manifolds can be learned in the process of learning the metric.


title: Coherent scattering 2D cooling in levitated cavity optomechanics

abstract: The strong light-matter optomechanical coupling offered by Coherent Scattering (CS) set-ups have allowed the experimental realisation of quantum ground state cavity cooling of the axial motion of a levitated nanoparticle [U. Deli\'{c} et al., Science 367, 892 (2020)]. An appealing milestone is now quantum 2D cooling of the full in-plane motion, in any direction in the transverse plane. By a simple adjustment of the trap polarisation, one obtains two nearly equivalent modes, with similar frequencies $\omega_{x}\sim\omega_{y}$ and optomechanical couplings $g_{x}\simeq g_{y}$ -- in this experimental configuration we identify an optimal trap ellipticity, nanosphere size and cavity linewidth which allows for efficient 2D cooling. Moreover, we find that 2D cooling to occupancies $n_{x}+n_{y}\lesssim1$ at moderate vacuum ($10^{-6}$ mbar) is possible in a "Goldilocks" zone bounded by $\sqrt{\kappa\Gamma/4}\lesssim g_{x},g_{y}\lesssim|\omega_{x}-\omega_{y}|\lesssim\kappa$, where one balances the need to suppress dark modes whilst avoiding far-detuning of either mode or low cooperativities, and $\kappa$ ($\Gamma$) is the cavity decay rate (motional heating rate). With strong-coupling regimes $g_{x},g_{y}\gtrsim\kappa$ in view one must consider the genuine three-way hybridisation between $x$, $y$ and the cavity light mode resulting in hybridized bright/dark modes. Finally, we show that bright/dark modes in the levitated set-up have a simple geometrical interpretation, related by rotations in the transverse plane, with implications for directional sensing.


title: Binary Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have emerged as a powerful and flexible framework for representation learning on irregular data. As they generalize the operations of classical CNNs on grids to arbitrary topologies, GNNs also bring much of the implementation challenges of their Euclidean counterparts. Model size, memory footprint, and energy consumption are common concerns for many real-world applications. Network binarization allocates a single bit to parameters and activations, thus dramatically reducing the memory requirements (up to 32x compared to single-precision floating-point numbers) and maximizing the benefits of fast SIMD instructions on modern hardware for measurable speedups. However, in spite of the large body of work on binarization for classical CNNs, this area remains largely unexplored in geometric deep learning. In this paper, we present and evaluate different strategies for the binarization of graph neural networks. We show that through careful design of the models, and control of the training process, binary graph neural networks can be trained at only a moderate cost in accuracy on challenging benchmarks. In particular, we present the first dynamic graph neural network in Hamming space, able to leverage efficient k-NN search on binary vectors to speed-up the construction of the dynamic graph. We further verify that the binary models offer significant savings on embedded devices. Our code is publicly available on Github.


title: Backreaction of Schwinger pair creation in massive QED$_2$

abstract: Particle-antiparticle pairs can be produced by background electric fields via the Schwinger mechanism provided they are unconfined. If, as in QED in (3+1)-$d$ these particles are massive, the particle production rate is exponentially suppressed below a threshold field strength. Above this threshold, the energy for pair creation must come from the electric field itself which ought to eventually relax to the threshold strength. Calculating this relaxation in a self-consistent manner, however, is difficult. Chu and Vachaspati addressed this problem in the context of capacitor discharge in massless QED$_2$ [1] by utilizing bosonization in two-dimensions. When the bare fermions are massless, the dual bosonized theory is free and capacitor discharge can be analyzed exactly [1], however, special care is required in its interpretation given that the theory exhibits confinement. In this paper we reinterpret the findings of [1], where the capacitors Schwinger-discharge via electrically neutral dipolar meson-production, and generalize this to the case where the fermions have bare masses. Crucially, we note that when the initial charge of the capacitor is large compared to the charge of the fermions, $Q \gg e$, the classical equation of motion for the bosonized model accurately characterizes the dynamics of discharge. For massless QED$_2$, we find that the discharge is suppressed below a critical plate separation that is commensurate with the length scale associated with the meson dipole moment. For massive QED$_2$, we find in addition, a mass threshold familiar from (3+1)-$d$, and show the electric field relaxes to a final steady state with a magnitude proportional to the initial charge. We discuss the wider implications of our findings and identify challenges in extending this treatment to higher dimensions.


title: Fermion Sampling: a robust quantum computational advantage scheme using fermionic linear optics and magic input states

abstract: Fermionic Linear Optics (FLO) is a restricted model of quantum computation which in its original form is known to be efficiently classically simulable. We show that, when initialized with suitable input states, FLO circuits can be used to demonstrate quantum computational advantage with strong hardness guarantees. Based on this, we propose a quantum advantage scheme which is a fermionic analogue of Boson Sampling: Fermion Sampling with magic input states. We consider in parallel two classes of circuits: particle-number conserving (passive) FLO and active FLO that preserves only fermionic parity and is closely related to Matchgate circuits introduced by Valiant. Mathematically, these classes of circuits can be understood as fermionic representations of the Lie groups $U(d)$ and $SO(2d)$. This observation allows us to prove our main technical results. We first show anticoncentration for probabilities in random FLO circuits of both kind. Moreover, we prove robust average-case hardness of computation of probabilities. To achieve this, we adapt the worst-to-average-case reduction based on Cayley transform, introduced recently by Movassagh, to representations of low-dimensional Lie groups. Taken together, these findings provide hardness guarantees comparable to the paradigm of Random Circuit Sampling. Importantly, our scheme has also a potential for experimental realization. Both passive and active FLO circuits are relevant for quantum chemistry and many-body physics and have been already implemented in proof-of-principle experiments with superconducting qubit architectures. Preparation of the desired quantum input states can be obtained by a simple quantum circuit acting independently on disjoint blocks of four qubits and using 3 entangling gates per block. We also argue that due to the structured nature of FLO circuits, they can be efficiently certified.


title: Educational Content Linking for Enhancing Learning Need Remediation in MOOCs

abstract: Since its introduction in 2011, there have been over 4000 MOOCs on various subjects on the Web, serving over 35 million learners. MOOCs have shown the ability to democratize knowledge dissemination and bring the best education in the world to every learner. However, the disparate distances between participants, the size of the learner population, and the heterogeneity of the learners' backgrounds make it extremely difficult for instructors to interact with the learners in a timely manner, which adversely affects learning experience. To address the challenges, in this thesis, we propose a framework: educational content linking. By linking and organizing pieces of learning content scattered in various course materials into an easily accessible structure, we hypothesize that this framework can provide learners guidance and improve content navigation. Since most instruction and knowledge acquisition in MOOCs takes place when learners are surveying course materials, better content navigation may help learners find supporting information to resolve their confusion and thus improve learning outcome and experience. To support our conjecture, we present end-to-end studies to investigate our framework around two research questions: 1) can manually generated linking improve learning? 2) can learning content be generated with machine learning methods? For studying the first question, we built an interface that present learning materials and visualize the linking among them simultaneously. We found the interface enables users to search for desired course materials more efficiently, and retain more concepts more readily. For the second question, we propose an automatic content linking algorithm based on conditional random fields. We demonstrate that automatically generated linking can still lead to better learning, although the magnitude of the improvement over the unlinked interface is smaller.


title: A CNN Approach to Simultaneously Count Plants and Detect Plantation-Rows from UAV Imagery

abstract: In this paper, we propose a novel deep learning method based on a Convolutional Neural Network (CNN) that simultaneously detects and geolocates plantation-rows while counting its plants considering highly-dense plantation configurations. The experimental setup was evaluated in a cornfield with different growth stages and in a Citrus orchard. Both datasets characterize different plant density scenarios, locations, types of crops, sensors, and dates. A two-branch architecture was implemented in our CNN method, where the information obtained within the plantation-row is updated into the plant detection branch and retro-feed to the row branch; which are then refined by a Multi-Stage Refinement method. In the corn plantation datasets (with both growth phases, young and mature), our approach returned a mean absolute error (MAE) of 6.224 plants per image patch, a mean relative error (MRE) of 0.1038, precision and recall values of 0.856, and 0.905, respectively, and an F-measure equal to 0.876. These results were superior to the results from other deep networks (HRNet, Faster R-CNN, and RetinaNet) evaluated with the same task and dataset. For the plantation-row detection, our approach returned precision, recall, and F-measure scores of 0.913, 0.941, and 0.925, respectively. To test the robustness of our model with a different type of agriculture, we performed the same task in the citrus orchard dataset. It returned an MAE equal to 1.409 citrus-trees per patch, MRE of 0.0615, precision of 0.922, recall of 0.911, and F-measure of 0.965. For citrus plantation-row detection, our approach resulted in precision, recall, and F-measure scores equal to 0.965, 0.970, and 0.964, respectively. The proposed method achieved state-of-the-art performance for counting and geolocating plants and plant-rows in UAV images from different types of crops.


title: MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers

abstract: We generalize deep self-attention distillation in MiniLM (Wang et al., 2020) by only using self-attention relation distillation for task-agnostic compression of pretrained Transformers. In particular, we define multi-head self-attention relations as scaled dot-product between the pairs of query, key, and value vectors within each self-attention module. Then we employ the above relational knowledge to train the student model. Besides its simplicity and unified principle, more favorably, there is no restriction in terms of the number of student's attention heads, while most previous work has to guarantee the same head number between teacher and student. Moreover, the fine-grained self-attention relations tend to fully exploit the interaction knowledge learned by Transformer. In addition, we thoroughly examine the layer selection strategy for teacher models, rather than just relying on the last layer as in MiniLM. We conduct extensive experiments on compressing both monolingual and multilingual pretrained models. Experimental results demonstrate that our models distilled from base-size and large-size teachers (BERT, RoBERTa and XLM-R) outperform the state-of-the-art.


title: Continuity of Generalized Entropy and Statistical Learning

abstract: We study the continuity property of the generalized entropy as a function of the underlying probability distribution, defined with an action space and a loss function, and use this property to answer the basic questions in statistical learning theory: the excess risk analyses for various learning methods. We first derive upper and lower bounds for the entropy difference of two distributions in terms of several commonly used f-divergences, the Wasserstein distance, a distance that depends on the action space and the loss function, and the Bregman divergence generated by the entropy, which also induces bounds in terms of the Euclidean distance between the two distributions. Examples are given along with the discussion of each general result, comparisons are made with the existing entropy difference bounds, and new mutual information upper bounds are derived based on the new results. We then apply the entropy difference bounds to the theory of statistical learning. It is shown that the excess risks in the two popular learning paradigms, the frequentist learning and the Bayesian learning, both can be studied with the continuity property of different forms of the generalized entropy. The analysis is then extended to the continuity of generalized conditional entropy. The extension provides performance bounds for Bayes decision making with mismatched distributions. It also leads to excess risk bounds for a third paradigm of learning, where the decision rule is optimally designed under the projection of the empirical distribution to a predefined family of distributions. We thus establish a unified method of excess risk analysis for the three major paradigms of statistical learning, through the continuity of generalized entropy.


title: Comments on the holographic description of Narain theories

abstract: We discuss the holographic description of Narain $U(1)^c\times U(1)^c$ conformal field theories, and their potential similarity to conventional weakly coupled gravity in the bulk, in the sense that the effective IR bulk description includes "$U(1)$ gravity" amended with additional light degrees of freedom. Starting from this picture, we formulate the hypothesis that in the large central charge limit the density of states of any Narain theory is bounded by below by the density of states of $U(1)$ gravity. This immediately implies that the maximal value of the spectral gap for primary fields is $\Delta_1=c/(2\pi e)$. To test the self-consistency of this proposal, we study its implications using chiral lattice CFTs and CFTs based on quantum stabilizer codes. First we notice that the conjecture yields a new bound on quantum stabilizer codes, which is compatible with previously known bounds in the literature. We proceed to discuss the variance of the density of states, which for consistency must be vanishingly small in the large-$c$ limit. We consider ensembles of code and chiral theories and show that in both cases the density variance is exponentially small in the central charge.


title: Timely Communication in Federated Learning

abstract: We consider a federated learning framework in which a parameter server (PS) trains a global model by using $n$ clients without actually storing the client data centrally at a cloud server. Focusing on a setting where the client datasets are fast changing and highly temporal in nature, we investigate the timeliness of model updates and propose a novel timely communication scheme. Under the proposed scheme, at each iteration, the PS waits for $m$ available clients and sends them the current model. Then, the PS uses the local updates of the earliest $k$ out of $m$ clients to update the global model at each iteration. We find the average age of information experienced by each client and numerically characterize the age-optimal $m$ and $k$ values for a given $n$. Our results indicate that, in addition to ensuring timeliness, the proposed communication scheme results in significantly smaller average iteration times compared to random client selection without hurting the convergence of the global learning task.


title: Shortformer: Better Language Modeling using Shorter Inputs

abstract: Increasing the input length has been a driver of progress in language modeling with transformers. We identify conditions where shorter inputs are not harmful, and achieve perplexity and efficiency improvements through two new methods that decrease input length. First, we show that initially training a model on short subsequences before moving on to longer ones both reduces overall training time and, surprisingly, substantially improves perplexity. Second, we show how to improve the efficiency of recurrence methods in transformers, which let models condition on previously processed tokens when generating sequences that exceed the maximal length the transformer can handle at once. Existing methods require computationally expensive relative position embeddings; we introduce a simple alternative of adding absolute position embeddings to queries and keys instead of to word embeddings, which efficiently produces superior results. We show that these recurrent models also benefit from short input lengths. Combining these techniques speeds up training by a factor of 1.65, reduces memory usage, and substantially improves perplexity on WikiText-103, without adding any parameters.


title: Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade

abstract: Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously predict tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to the Transformer baseline. In this work, we target on closing the performance gap while maintaining the latency advantage. We first inspect the fundamental issues of fully NAT models, and adopt dependency reduction in the learning space of output tokens as the basic guidance. Then, we revisit methods in four different aspects that have been proven effective for improving NAT models, and carefully combine these techniques with necessary modifications. Our extensive experiments on three translation benchmarks show that the proposed system achieves the new state-of-the-art results for fully NAT models, and obtains comparable performance with the autoregressive and iterative NAT systems. For instance, one of the proposed models achieves 27.49 BLEU points on WMT14 En-De with approximately 16.5X speed up at inference time.


title: Topological obstructions in neural networks learning

abstract: We apply topological data analysis methods to loss functions to gain insights into learning of deep neural networks and deep neural networks generalization properties. We use the Morse complex of the loss function to relate the local behavior of gradient descent trajectories with global properties of the loss surface. We define the neural network Topological Obstructions score, "TO-score", with the help of robust topological invariants, barcodes of the loss function, that quantify the "badness" of local minima for gradient-based optimization. We have made experiments for computing these invariants for fully-connected, convolutional and ResNet-like neural networks on different datasets: MNIST, Fashion MNIST, CIFAR10, CIFAR100 and SVHN. Our two principal observations are as follows. Firstly, the neural network barcode and TO score decrease with the increase of the neural network depth and width, thus the topological obstructions to learning diminish. Secondly, in certain situations there is an intriguing connection between the lengths of minima segments in the barcode and the minima generalization errors.


title: Semantic Modeling with SUMO

abstract: We explore using the Suggested Upper Merged Ontology (SUMO) to develop a semantic simulation. We provide two proof-of-concept demonstrations modeling transitions in a simulated gasoline engine using a general-purpose programming language. Rather than focusing on computationally highly intensive techniques, we explore a less computationally intensive approach related to familiar software engineering testing procedures. In addition, we propose structured representations of terms based on linguistic approaches to lexicography.


title: Principled point-source detection in collections of astronomical images

abstract: We review the well-known matched filter method for the detection of point sources in astronomical images. This is shown to be optimal (that is, to saturate the Cramer--Rao bound) under stated conditions that are very strong: an isolated source in background-dominated imaging with perfectly known background level, point-spread function, and noise models. We show that the matched filter produces a maximum-likelihood estimate of the brightness of a purported point source, and this leads to a simple way to combine multiple images---taken through the same bandpass filter but with different noise levels and point-spread functions---to produce an optimal point source detection map. We then extend the approach to images taken through different bandpass filters, introducing the SED-matched filter, which allows us to combine images taken through different filters, but requires us to specify the colors of the objects we wish to detect. We show that this approach is superior to some methods traditionally employed, and that other traditional methods can be seen as instances of SED-matched filtering with implied (and often unreasonable) priors. We present a Bayesian formulation, including a flux prior that leads to a closed-form expression with low computational cost.


title: Using Natural Language Relations between Answer Choices for Machine Comprehension

abstract: When evaluating an answer choice for Reading Comprehension task, other answer choices available for the question and the answers of related questions about the same paragraph often provide valuable information. In this paper, we propose a method to leverage the natural language relations between the answer choices, such as entailment and contradiction, to improve the performance of machine comprehension. We use a stand-alone question answering (QA) system to perform QA task and a Natural Language Inference (NLI) system to identify the relations between the choice pairs. Then we perform inference using an Integer Linear Programming (ILP)-based relational framework to re-evaluate the decisions made by the standalone QA system in light of the relations identified by the NLI system. We also propose a multitask learning model that learns both the tasks jointly.


title: Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans

abstract: This paper addresses the challenge of novel view synthesis for a human performer from a very sparse set of camera views. Some recent works have shown that learning implicit neural representations of 3D scenes achieves remarkable view synthesis quality given dense input views. However, the representation learning will be ill-posed if the views are highly sparse. To solve this ill-posed problem, our key idea is to integrate observations over video frames. To this end, we propose Neural Body, a new human body representation which assumes that the learned neural representations at different frames share the same set of latent codes anchored to a deformable mesh, so that the observations across frames can be naturally integrated. The deformable mesh also provides geometric guidance for the network to learn 3D representations more efficiently. To evaluate our approach, we create a multi-view dataset named ZJU-MoCap that captures performers with complex motions. Experiments on ZJU-MoCap show that our approach outperforms prior works by a large margin in terms of novel view synthesis quality. We also demonstrate the capability of our approach to reconstruct a moving person from a monocular video on the People-Snapshot dataset. The code and dataset are available at https://zju3dv.github.io/neuralbody/.


title: Study of timing and spectral properties of the X-ray pulsar 1A 0535+262 during the giant outburst in 2020 November-December

abstract: We made a detailed study of the timing and spectral properties of the X-ray pulsar 1A 0535+262 during the recent giant outburst in 2020 November and December. The flux of the pulsar reached a record value of $\sim$12.5 Crab as observed by Swift/BAT (15--50 keV) and the corresponding mass accretion rate was $\sim6.67\times10^{17}$ g s$^{-1}$ near the peak of the outburst. There was a transition from the subcritical to the supercritical accretion regime which allows exploring different properties of the source in the supercritical regime. A q-like feature was detected in the hardness-intensity diagram during the outburst. We observed high variability and strong energy dependence of pulse profiles during the outburst. Cyclotron Resonant Scattering Feature (CRSF) was detected at $\sim44$ keV from the NuSTAR energy spectrum in the subcritical regime and the corresponding magnetic field was $B\simeq4.9\times10^{12}$ G. The energy of the CRSF was shifted towards lower energy in the supercritical regime. The luminosity dependence of the CRSF was studied and during the supercritical regime, a negative correlation was observed between the line energy and luminosity. The critical luminosity was $\sim6\times10^{37}$ erg s$^{-1}$ above which a state transition occurred. A reversal of correlation between the photon index and luminosity was observed near the critical luminosity. The NuSTAR spectra can be described by a composite model with two continuum components, a blackbody emission, cut-off power law, and a discrete component to account for the iron emission line at 6.4 keV. An additional cyclotron absorption feature was included in the model.


title: Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers

abstract: Most recent semantic segmentation methods adopt a fully-convolutional network (FCN) with an encoder-decoder architecture. The encoder progressively reduces the spatial resolution and learns more abstract/semantic visual concepts with larger receptive fields. Since context modeling is critical for segmentation, the latest efforts have been focused on increasing the receptive field, through either dilated/atrous convolutions or inserting attention modules. However, the encoder-decoder based FCN architecture remains unchanged. In this paper, we aim to provide an alternative perspective by treating semantic segmentation as a sequence-to-sequence prediction task. Specifically, we deploy a pure transformer (ie, without convolution and resolution reduction) to encode an image as a sequence of patches. With the global context modeled in every layer of the transformer, this encoder can be combined with a simple decoder to provide a powerful segmentation model, termed SEgmentation TRansformer (SETR). Extensive experiments show that SETR achieves new state of the art on ADE20K (50.28% mIoU), Pascal Context (55.83% mIoU) and competitive results on Cityscapes. Particularly, we achieve the first position in the highly competitive ADE20K test server leaderboard on the day of submission.


title: Extreme topological tunability of Weyl-Kondo semimetal to Zeeman coupling

abstract: There is considerable interest in the intersection of correlations and topology, especially in metallic systems. Among the outstanding questions are how strong correlations drive novel topological states and whether such states can be readily controlled. Here we study the effect of a Zeeman coupling on a Weyl-Kondo semimetal in a nonsymmorphic and noncentrosymmetric Kondo-lattice model. A sequence of distinct and topologically nontrivial semimetal regimes are found, each containing Kondo-driven and Fermi-energy-bound Weyl nodes. The nodes annihilate at a magnetic field that is smaller than what it takes to suppress the Kondo effect. As such, we demonstrate an extreme topological tunability that is isolated from the tuning of the strong correlations per se. Our results are important for experiments in strongly correlated systems, and set the stage for mapping out a global phase diagram for strongly correlated topology.


title: Precision test of statistical dynamics with state-to-state ultracold chemistry

abstract: Chemical reactions represent a class of quantum problems that challenge both the current theoretical understanding and computational capabilities. Reactions that occur at ultralow temperatures provide an ideal testing ground for quantum chemistry and scattering theories, as they can be experimentally studied with unprecedented control, yet display dynamics that are highly complex. Here, we report the full product state distribution for the reaction 2KRb $\rightarrow$ K$_2$ + Rb$_2$. Ultracold preparation of the reactants grants complete control over their initial quantum degrees of freedom, while state-resolved, coincident detection of both products enables the measurement of scattering probabilities into all 57 allowed rotational state-pairs. Our results show an overall agreement with a state-counting model based on statistical theory, but also reveal several deviating state-pairs. In particular, we observe a strong suppression of population in the state-pair closest to the exoergicity limit, which we precisely determine to be $9.7711^{+0.0007}_{-0.0005}$ cm$^{-1}$, as a result of the long-range potential inhibiting the escape of products. The completeness of our measurements provides a valuable benchmark for quantum dynamics calculations beyond the current state-of-the-art.