title: Decentralized Mean Field Games

abstract: Multiagent reinforcement learning algorithms have not been widely adopted in large scale environments with many agents as they often scale poorly with the number of agents. Using mean field theory to aggregate agents has been proposed as a solution to this problem. However, almost all previous methods in this area make a strong assumption of a centralized system where all the agents in the environment learn the same policy and are effectively indistinguishable from each other. In this paper, we relax this assumption about indistinguishable agents and propose a new mean field system known as Decentralized Mean Field Games, where each agent can be quite different from others. All agents learn independent policies in a decentralized fashion, based on their local observations. We define a theoretical solution concept for this system and provide a fixed point guarantee for a Q-learning based algorithm in this system. A practical consequence of our approach is that we can address a `chicken-and-egg' problem in empirical mean field reinforcement learning algorithms. Further, we provide Q-learning and actor-critic algorithms that use the decentralized mean field learning approach and give stronger performances compared to common baselines in this area. In our setting, agents do not need to be clones of each other and learn in a fully decentralized fashion. Hence, for the first time, we show the application of mean field learning methods in fully competitive environments, large-scale continuous action space environments, and other environments with heterogeneous agents. Importantly, we also apply the mean field method in a ride-sharing problem using a real-world dataset. We propose a decentralized solution to this problem, which is more practical than existing centralized training methods.


title: Revealing the Field Sub-subgiant Population Using a Catalog of Active Giant Stars and Gaia EDR3

abstract: Sub-subgiant stars (SSGs) fall below the subgiant branch and/or red of the giant branch in open and globular clusters, an area of the color-magnitude diagram (CMD) not populated by standard stellar evolution tracks. One hypothesis is that SSGs result from rapid rotation in subgiants or giants due to tidal synchronization in a close binary. The strong magnetic fields generated inhibit convection, which in turn produces large starspots, radius inflation, and lower-than-expected average surface temperatures and luminosities. Here we cross-reference a catalog of active giant binaries (RS CVns) in the field with Gaia EDR3. Using the Gaia photometry and parallaxes we precisely position the RS CVns in a CMD. We identify stars that fall below a 14 Gyr, metal-rich isochrone as candidate field SSGs. Out of a sample of 1723 RS CVn, we find 448 SSG candidates, a dramatic expansion from the 65 SSGs previously known. Most SSGs have rotation periods of 2-20 days, with the highest SSG fraction found among RS CVn with the shortest periods. The ubiquity of SSGs among this population indicates SSGs are a normal phase in evolution for RS CVn-type systems, not rare by-products of dynamical encounters found only in dense star clusters as some have suggested. We present our catalog of 1723 active giants, including Gaia photometry and astrometry, and rotation periods from TESS and VSX. This catalog can serve as an important sample to study the impacts of magnetic fields in evolved stars.


title: Higher Gaussian Maps on K3 surfaces

abstract: We give necessary conditions for the surjectivity of the higher Gaussian maps on a polarized K3 surface. As an application, we show that the higher $k$-th Gauss map for a general curve of genus $g$ (that depends quadratically with $k$) is surjective.


title: Entanglement entropy and localization in disordered quantum chains

abstract: This chapter addresses the question of quantum entanglement in disordered chains, focusing on the von-Neumann and R\'enyi entropies for three important classes of random systems: Anderson localized, infinite randomness criticality, and many-body localization (MBL). We review previous works, and also present new results for the entanglement entropy of random spin chains at low and high energy.


title: The Elusive Muonic WIMP

abstract: The Weakly Interacting Massive Particle (WIMP) paradigm is one of the most popular scenarios for Dark Matter (DM) theories that however is strongly constrained, in particular by direct detection experiments. We stick with the WIMP hypothesis and consider a Dirac fermion candidate for DM that interacts with the Standard Model (SM) via a spin-1 $Z'$, arising from the spontaneous breaking of an Abelian $U(1)'_{\mu}$ gauge symmetry, under which only second generation leptons and the DM are appropriately charged. Due to the charge assignment, the model is gauge anomalous and can only be interpreted as an effective field theory (EFT) at low energy. The $Z'$ couples at tree level only to the vector DM current, to the axial muon current and to left-handed muonic neutrinos, so the WIMP-nucleon cross section is beyond the experimental reach of spin-independent (SI) direct detection searches. We study the current bounds on this model coming from direct and indirect detection of DM, collider searches, contributions to $(g-2)_{\mu}$ and to neutrino trident production. We find that large regions of the parameter space remains to be explored. In the context of LHC searches, we study the impact of a muon-exclusive signal region for the $3\mu$ + ${E}^{{\rm miss}}_T$ channel with an invariant mass window around $m_{Z'}$. We show that this search can significantly improve the current collider bounds. Finally, from the anomalous nature of our EFT, there remain at low energy triboson anomalous interactions between the $Z'$ and the electroweak (EW) SM gauge bosons. We explore the possibilities of probing these interactions at the LHC and at a 100 TeV proton collider finding it extremely challenging. On the other hand, for a muon collider the resonant channel $\mu^{+}\mu^{-}\to Z'\to ZZ$ could be discovered in the most promising scenario with luminosity of $\mathcal{O}({\rm few}\; 10)$ ${\rm fb}^{-1}$.


title: Non-Gaussian Component Analysis via Lattice Basis Reduction

abstract: Non-Gaussian Component Analysis (NGCA) is the following distribution learning problem: Given i.i.d. samples from a distribution on $\mathbb{R}^d$ that is non-gaussian in a hidden direction $v$ and an independent standard Gaussian in the orthogonal directions, the goal is to approximate the hidden direction $v$. Prior work \cite{DKS17-sq} provided formal evidence for the existence of an information-computation tradeoff for NGCA under appropriate moment-matching conditions on the univariate non-gaussian distribution $A$. The latter result does not apply when the distribution $A$ is discrete. A natural question is whether information-computation tradeoffs persist in this setting. In this paper, we answer this question in the negative by obtaining a sample and computationally efficient algorithm for NGCA in the regime that $A$ is discrete or nearly discrete, in a well-defined technical sense. The key tool leveraged in our algorithm is the LLL method \cite{LLL82} for lattice basis reduction.


title: Evaluating Lyman-$\alpha$ Constraints for General Dark-Matter Velocity Distributions: Multiple Scales and Cautionary Tales

abstract: The Lyman-$\alpha$ absorption spectrum associated with photons traversing the intergalactic medium allows us to probe the linear matter power spectrum down to relatively small distance scales. Finding ways of accurately evaluating Lyman-$\alpha$ constraints across large classes of candidate models of dark-matter physics is thus of paramount importance. While such constraints have been evaluated for dark-matter models with relatively simple dark-matter velocity distributions, more complex models -- particularly those with dark-matter velocity distributions stretching across multiple scales -- are receiving increasing attention. In this paper, we undertake a study of the Lyman-$\alpha$ constraints associated with general dark-matter velocity distributions. Although these constraints are difficult to evaluate in principle, in practice there exist two ways of recasting them into forms which are easier to evaluate and which therefore allow a more rapid determination of whether a given dark-matter model is ruled in or out. We utilize both of these recasts in order to determine the Lyman-$\alpha$ bounds on different classes of dark-matter velocity distributions. We also develop a general method by which the results of these different recasts can be compared. For relatively simple dark-matter velocity distributions, we find that these two classes of recasts tend to align and give similar results. However, the situation is far more complex for distributions involving multiple velocity scales: while these two recasts continue to yield similar results within certain regions of parameter space, they nevertheless yield dramatically different results within precisely those regions of parameter space which are likely to be phenomenologically relevant. This, then, serves as a cautionary tale regarding the use of such recasts for complex dark-matter velocity distributions.


title: RegionCLIP: Region-based Language-Image Pretraining

abstract: Contrastive language-image pretraining (CLIP) using image-text pairs has achieved impressive results on image classification in both zero-shot and transfer learning settings. However, we show that directly applying such models to recognize image regions for object detection leads to poor performance due to a domain shift: CLIP was trained to match an image as a whole to a text description, without capturing the fine-grained alignment between image regions and text spans. To mitigate this issue, we propose a new method called RegionCLIP that significantly extends CLIP to learn region-level visual representations, thus enabling fine-grained alignment between image regions and textual concepts. Our method leverages a CLIP model to match image regions with template captions and then pretrains our model to align these region-text pairs in the feature space. When transferring our pretrained model to the open-vocabulary object detection tasks, our method significantly outperforms the state of the art by 3.8 AP50 and 2.2 AP for novel categories on COCO and LVIS datasets, respectively. Moreoever, the learned region representations support zero-shot inference for object detection, showing promising results on both COCO and LVIS datasets. Our code is available at https://github.com/microsoft/RegionCLIP.


Comment on the literature definition(s) of "dynamical phase transition"


title: On the Normalization and Density of 1D Scattering States

abstract: The normalization of scattering states is more than a rote step necessary to calculate expectation values. This normalization actually contains important information regarding the density of the scattering spectrum (along with useful details on the bound states). For many applications, this information is more useful than the wavefunctions themselves. In this paper we show that this correspondence between scattering state normalization and the density of states is a consequence of the completeness relation, and we present formulas for calculating the density of states which are applicable to certain potentials. We then apply these formulas to the delta function potential and the square well. We then illustrate how the density of states can be used to calculate the partition function for a system of two particles with a point-like (delta potential) interaction.


title: Chromatic Quasisymmetric Class Functions for combinatorial Hopf monoids

abstract: We study the chromatic quasisymmetric class function of a linearized combinatorial Hopf monoid. Given a linearized combinatorial Hopf monoid $H$, and an $H$-structure $h$ on a set $N$, there are proper colorings of $h$, generalizing graph colorings and poset partitions. We show that the automorphism group of $h$ acts on the set of proper colorings. The chromatic quasisymmetric class function enumerates the fixed points of this action, weighting each coloring with a monomial. For the Hopf monoid of graphs this invariant generalizes Stanley's chromatic symmetric function and specializes to the orbital chromatic polynomial of Cameron and Kayibi. We also introduce the flag quasisymmetric class function of a balanced relative simplicial complex equipped with a group action. We show that, under certain conditions, the chromatic quasisymmetric class function of $h$ is the flag quasisymmetric class function of a balanced relative simplicial complex that we call the coloring complex of $h$. We use this result to deduce various inequalities for the associated orbital polynomial invariants. We apply these results to several examples related to enumerating graph colorings, poset partitions, generic functions on matroids or generalized permutohedra, and others.


title: Split link detection for sl(P) link homology in characteristic P

abstract: If $P$ is a prime number, we show that reduced $\mathfrak{sl}(P)$ link homology with coefficients in $\mathbf{Z}/P$ detects split links. The argument uses Dowlin's spectral sequence and sutured Floer homology with twisted coefficients. When $P = 2$, we recover Lipshitz-Sarkar's split link detection result for Khovanov homology with $\mathbf{Z}/2$ coefficients.


title: Dark Matter interpretation of the neutron decay anomaly

abstract: We add to the Standard Model a new fermion $\chi$ with minimal baryon number 1/3. Neutron decay $n \to \chi\chi\chi$ into non-relativistic $\chi$ can account for the neutron decay anomaly, compatibly with bounds from neutron stars. $\chi$ can be Dark Matter, and its cosmological abundance can be generated by freeze-in dominated at $T \sim m_n$. The associated processes $n \to \chi\chi\chi \gamma$, hydrogen decay ${\rm H}\to \chi\chi \chi\nu(\gamma)$ and DM-induced neutron disappearance $\bar\chi n \to \chi \chi (\gamma)$ have rates below experimental bounds and can be of interest for future experiments.


title: Dynamical Tropicalisation

abstract: We analyse the dynamics of the pullback of the map $z \longmapsto z^m$ on the complex tori and toric varieties. We will observe that tropical objects naturally appear in the limit, and review several theorems in tropical geometry.


title: Eikonal amplitudes from curved backgrounds

abstract: Eikonal exponentiation in QFT describes the emergence of classical physics at long distances in terms of a non-trivial resummation of infinitely many diagrams. Long ago, 't Hooft proposed a beautiful correspondence between ultra-relativistic scalar eikonal scattering and one-to-one scattering in a background shockwave space-time, bypassing the need to resum. In this spirit, we propose here a covariant method for computing one-to-one amplitudes in curved background space-times which gives rise what we conjecture to be a general expression for the eikonal amplitude. We show how the one-to-one scattering amplitude for scalars on any stationary space-time reduces to a boundary term that captures the long-distance behavior of the background and has the structure of an exponentiated eikonal amplitude. In the case of scalar scattering on Schwarzschild, we recover the known results for gravitational scattering of massive scalars in the eikonal regime. For Kerr, we find a remarkable exponentiation of the tree-level amplitude for gravitational scattering between a massive scalar and a massive particle of infinite spin. This amplitude exhibits a Kawai-Lewellen-Tye-like factorization, which we use to evaluate the eikonal amplitude in momentum space, and study its analytic properties.


title: Measurement of the inclusive $\mathrm{t\bar{t}}$ production cross section in proton-proton collisions at $\sqrt{s} =$ 5.02 TeV

abstract: The top quark pair production cross section is measured in proton-proton collisions at a center-of-mass energy of 5.02 TeV. The data were collected in a special LHC low-energy and low-intensity run in 2017, and correspond to an integrated luminosity of 302 pb$^{-1}$. The measurement is performed using events with one electron and one muon of opposite charge, and at least two jets. The measured cross section is 60.7 $\pm$ 5.0 (stat) $\pm$ 2.8 (syst) $\pm$ 1.1 (lumi) pb. To reduce the statistical uncertainty, a combination with the result in the single lepton + jets channel, based on data collected in 2015 at the same center-of-mass energy and corresponding to an integrated luminosity of 27.4 pb$^{-1}$, is then performed. The resulting measured value is 63.0 $\pm$ 4.1 (stat) $\pm$ 3.0 (syst+lumi) pb, in agreement with the standard model prediction of 66.8 $^{+2.9}_{-3.1}$ pb.


title: Theory of zero-field superconducting diode effect in twisted trilayer graphene

abstract: In a recent experiment [Lin et al., arXiv:2112.07841], the superconducting phase hosted by a heterostructure of mirror-symmetric twisted trilayer graphene and WSe$_2$ was shown to exhibit significantly different critical currents in opposite directions in the absence of external magnetic fields. We here develop a microscopic theory and analyze necessary conditions for this zero-field superconducting diode effect. Taking into account the spin-orbit coupling induced in trilayer graphene via the proximity effect, we classify the pairing instabilities and normal-state orders and derive which combinations are consistent with the observed diode effect, in particular, its field trainability. We perform explicit calculations of the diode effect in several different models, including the full continuum model for the system, and illuminate the relation between the diode effect and finite-momentum pairing. Our theory also provides a natural explanation of the observed sign change of the current asymmetry with doping, which can be related to an approximate chiral symmetry of the system, and of the enhanced transverse resistance above the superconducting transition. Our findings not only elucidate the rich physics of trilayer graphene on WSe$_2$, but also establish a means to distinguish between various candidate interaction-induced orders in spin-orbit-coupled graphene moir\'e systems, and could therefore serve as a guide for future experiments as well.


title: Phase transition for level-set percolation of the membrane model in dimensions $d \geq 5$

abstract: We consider level-set percolation for the Gaussian membrane model on $\mathbb{Z}^d$, with $d \geq 5$, and establish that as $h \in \mathbb{R}$ varies, a non-trivial percolation phase transition for the level-set above level $h$ occurs at some finite critical level $h_\ast$, which we show to be positive in high dimensions. Along $h_\ast$, two further natural critical levels $h_{\ast\ast}$ and $\overline{h}$ are introduced, and we establish that $-\infty <\overline{h} \leq h_\ast \leq h_{\ast\ast} < \infty$, in all dimensions. For $h > h_{\ast\ast}$, we find that the connectivity function of the level-set above $h$ admits stretched exponential decay, whereas for $h < \overline{h}$, chemical distances in the (unique) infinite cluster of the level-set are shown to be comparable to the Euclidean distance, by verifying conditions identified by Drewitz, R\'ath and Sapozhnikov, see arXiv:1212.2885, for general correlated percolation models. As a pivotal tool to study its level-set, we prove novel decoupling inequalities for the membrane model.


title: Machine Learning Kreuzer--Skarke Calabi--Yau Threefolds

abstract: Using a fully connected feedforward neural network we study topological invariants of a class of Calabi--Yau manifolds constructed as hypersurfaces in toric varieties associated with reflexive polytopes from the Kreuzer--Skarke database. In particular, we find the existence of a simple expression for the Euler number that can be learned in terms of limited data extracted from the polytope and its dual.


title: Unsupervised Dense Information Retrieval with Contrastive Learning

abstract: Recently, information retrieval has seen the emergence of dense retrievers, using neural networks, as an alternative to classical sparse methods based on term-frequency. These models have obtained state-of-the-art results on datasets and tasks where large training sets are available. However, they do not transfer well to new applications with no training data, and are outperformed by unsupervised term-frequency methods such as BM25. In this work, we explore the limits of contrastive learning as a way to train unsupervised dense retrievers and show that it leads to strong performance in various retrieval settings. On the BEIR benchmark our unsupervised model outperforms BM25 on 11 out of 15 datasets for the Recall@100. When used as pre-training before fine-tuning, either on a few thousands in-domain examples or on the large MS~MARCO dataset, our contrastive model leads to improvements on the BEIR benchmark. Finally, we evaluate our approach for multi-lingual retrieval, where training data is even scarcer than for English, and show that our approach leads to strong unsupervised performance. Our model also exhibits strong cross-lingual transfer when fine-tuned on supervised English data only and evaluated on low resources language such as Swahili. We show that our unsupervised models can perform cross-lingual retrieval between different scripts, such as retrieving English documents from Arabic queries, which would not be possible with term matching methods.


title: The Propagator Matrix Reloaded

abstract: The standard way to perform calculations for quantum field theories involves the S-matrix and the assumption that the theory is free at past and future infinity. However, this assumption may not hold for field theories in non-trivial backgrounds such as curved spacetimes or finite temperature. In fact, even in the simple case of finite temperature Minkowski spacetime, there are a lot of misconceptions and confusion in the literature surrounding how to correctly take interactions into account when setting up the initial conditions. The objective of this work is to clear up these misconceptions and provide a clean and simple derivation of a formalism which includes interactions in the initial conditions and assesses whether or not it is legitimate to ignore them. The ultimate conclusion is that we cannot ignore them: quantum field theories at finite temperature are not free in the infinite past.


title: Human Hands as Probes for Interactive Object Understanding

abstract: Interactive object understanding, or what we can do to objects and how is a long-standing goal of computer vision. In this paper, we tackle this problem through observation of human hands in in-the-wild egocentric videos. We demonstrate that observation of what human hands interact with and how can provide both the relevant data and the necessary supervision. Attending to hands, readily localizes and stabilizes active objects for learning and reveals places where interactions with objects occur. Analyzing the hands shows what we can do to objects and how. We apply these basic principles on the EPIC-KITCHENS dataset, and successfully learn state-sensitive features, and object affordances (regions of interaction and afforded grasps), purely by observing hands in egocentric videos.


title: Q-balls in Non-Minimally Coupled Palatini Inflation and their Implications for Cosmology

abstract: We demonstrate the existence of Q-balls in non-minimally coupled inflation models with a complex inflaton in the Palatini formulation of gravity. We show that there exist Q-ball solutions which are compatible with inflation and we derive a window in the inflaton mass squared for which this is the case. In particular, we confirm the existence of Q-ball solutions with $\phi \sim 10^{17}-10^{18}$ GeV, consistent with the range of field values following the end of slow-roll Palatini inflation. We study the Q-balls and their properties both numerically and in an analytical approximation. The existence of such Q-balls suggests that the complex inflaton condensate can fragment into Q-balls, and that there may be an analogous process for the case of a real inflaton with fragmentation to neutral oscillons. We discuss the possible post-inflationary cosmology following the formation of Q-balls, including an early Q-ball matter domination (eMD) period and the effects of this on the reheating dynamics of the model, gravitational wave signatures which may be detectable in future experiments, and the possibility that Q-balls could lead to the formation of primordial black holes (PBHs). In particular, we show that Palatini Q-balls with field strengths typical of inflaton condensate fragmentation can directly form black holes with masses around 500 kg or more when the self-coupling is $\lambda = 0.1$, resulting in very low (less than 100 GeV) reheating temperatures from black hole decay, with smaller black hole masses and larger reheating temperatures possible for smaller values of $\lambda$. Q-ball dark matter from non-minimally coupled Palatini inflation may also be a direction for future work.


title: Reflected entropy in random tensor networks

abstract: In holographic theories, the reflected entropy has been shown to be dual to the area of the entanglement wedge cross section. We study the same problem in random tensor networks demonstrating an equivalent duality. For a single random tensor we analyze the important non-perturbative effects that smooth out the discontinuity in the reflected entropy across the Page phase transition. By summing over all such effects, we obtain the reflected entanglement spectrum analytically, which agrees well with numerical studies. This motivates a prescription for the analytic continuation required in computing the reflected entropy and its R\'enyi generalization which resolves an order of limits issue previously identified in the literature. We apply this prescription to hyperbolic tensor networks and find answers consistent with holographic expectations. In particular, the random tensor network has the same non-trivial tripartite entanglement structure expected from holographic states. We furthermore show that the reflected R\'enyi spectrum is not flat, in sharp contrast to the usual R\'enyi spectrum of these networks. We argue that the various distinct contributions to the reflected entanglement spectrum can be organized into approximate superselection sectors. We interpret this as resulting from an effective description of the canonically purified state as a superposition of distinct tensor network states. Each network is constructed by doubling and gluing various candidate entanglement wedges of the original network. The superselection sectors are labelled by the different cross-sectional areas of these candidate entanglement wedges.


title: Color-Kinematics Duality and Dual Conformal Symmetry for A Four-loop Form Factor in N=4 SYM

abstract: We obtain the full-color four-loop three-point form factor of the stress-tensor supermultiplet in N=4 SYM, based on the color-kinematics (CK) duality and generalized unitarity method. The CK-dual solution, while manifesting all dual Jacobi relations and satisfying the minimal power-counting of loop momenta, lies in a 133-dimensional solution space. We also show that the planar form factor integrand satisfies precisely a directional dual conformal symmetry in the lightlike limit of the operator momentum, which is supported by explicit four-loop calculations.


title: Sparse Euclidean Spanners with Tiny Diameter: A Tight Lower Bound

abstract: In STOC'95 [ADMSS'95] Arya et al. showed that any set of $n$ points in $\mathbb R^d$ admits a $(1+\epsilon)$-spanner with hop-diameter at most 2 (respectively, 3) and $O(n \log n)$ edges (resp., $O(n \log \log n)$ edges). They also gave a general upper bound tradeoff of hop-diameter at most $k$ and $O(n \alpha_k(n))$ edges, for any $k \ge 2$. The function $\alpha_k$ is the inverse of a certain Ackermann-style function at the $\lfloor k/2 \rfloor$th level of the primitive recursive hierarchy, where $\alpha_0(n) = \lceil n/2 \rceil$, $\alpha_1(n) = \left\lceil \sqrt{n} \right\rceil$, $\alpha_2(n) = \lceil \log{n} \rceil$, $\alpha_3(n) = \lceil \log\log{n} \rceil$, $\alpha_4(n) = \log^* n$, $\alpha_5(n) = \lfloor \frac{1}{2} \log^*n \rfloor$, \ldots. Roughly speaking, for $k \ge 2$ the function $\alpha_{k}$ is close to $\lfloor \frac{k-2}{2} \rfloor$-iterated log-star function, i.e., $\log$ with $\lfloor \frac{k-2}{2} \rfloor$ stars. Also, $\alpha_{2\alpha(n)+4}(n) \le 4$, where $\alpha(n)$ is the one-parameter inverse Ackermann function, which is an extremely slowly growing function. Whether or not this tradeoff is tight has remained open, even for the cases $k = 2$ and $k = 3$. Two lower bounds are known: The first applies only to spanners with stretch 1 and the second is sub-optimal and applies only to sufficiently large (constant) values of $k$. In this paper we prove a tight lower bound for any constant $k$: For any fixed $\epsilon > 0$, any $(1+\epsilon)$-spanner for the uniform line metric with hop-diameter at most $k$ must have at least $\Omega(n \alpha_k(n))$ edges.


title: On Atmospheric Retrievals of Exoplanets with Inhomogeneous Terminators

abstract: The complexity of atmospheric retrieval models is largely data-driven and one-dimensional models have generally been considered adequate with current data quality. However, recent studies have suggested that using 1D models in retrievals can result in anomalously cool terminator temperatures and biased abundance estimates even with existing transmission spectra of hot Jupiters. Motivated by these claims and upcoming high-quality transmission spectra we systematically explore the limitations of 1D models using synthetic and current observations. We use 1D models of varying complexity, both analytic and numerical, to revisit claims of biases when interpreting transmission spectra of hot Jupiters with inhomogeneous terminator compositions. Overall, we find the reported biases to be resulting from specific model assumptions rather than intrinsic limitations of 1D atmospheric models in retrieving current observations of asymmetric terminators. Additionally, we revise atmospheric retrievals of the hot Jupiter WASP-43b ($T_{\rm eq}=1440$ K) and the ultra-hot Jupiter WASP-103b ($T_{\rm eq}=2484$ K ) for which previous studies inferred abnormally cool atmospheric temperatures. We retrieve temperatures consistent with expectations. We note, however, that in the limit of extreme terminator inhomogeneities and high data quality some atmospheric inferences may conceivably be biased, although to a lesser extent than previously claimed. To address such cases, we implement a 2D retrieval framework for transmission spectra which allows accurate constraints on average atmospheric properties and provides insights into the spectral ranges where the imprints of atmospheric inhomogeneities are strongest. Our study highlights the need for careful considerations of model assumptions and data quality before attributing biases in retrieved estimates to unaccounted atmospheric inhomogeneities.


title: IS-COUNT: Large-scale Object Counting from Satellite Images with Covariate-based Importance Sampling

abstract: Object detection in high-resolution satellite imagery is emerging as a scalable alternative to on-the-ground survey data collection in many environmental and socioeconomic monitoring applications. However, performing object detection over large geographies can still be prohibitively expensive due to the high cost of purchasing imagery and compute. Inspired by traditional survey data collection strategies, we propose an approach to estimate object count statistics over large geographies through sampling. Given a cost budget, our method selects a small number of representative areas by sampling from a learnable proposal distribution. Using importance sampling, we are able to accurately estimate object counts after processing only a small fraction of the images compared to an exhaustive approach. We show empirically that the proposed framework achieves strong performance on estimating the number of buildings in the United States and Africa, cars in Kenya, brick kilns in Bangladesh, and swimming pools in the U.S., while requiring as few as 0.01% of satellite images compared to an exhaustive approach.


title: ICON: Implicit Clothed humans Obtained from Normals

abstract: Current methods for learning realistic and animatable 3D clothed avatars need either posed 3D scans or 2D images with carefully controlled user poses. In contrast, our goal is to learn an avatar from only 2D images of people in unconstrained poses. Given a set of images, our method estimates a detailed 3D surface from each image and then combines these into an animatable avatar. Implicit functions are well suited to the first task, as they can capture details like hair and clothes. Current methods, however, are not robust to varied human poses and often produce 3D surfaces with broken or disembodied limbs, missing details, or non-human shapes. The problem is that these methods use global feature encoders that are sensitive to global pose. To address this, we propose ICON ("Implicit Clothed humans Obtained from Normals"), which, instead, uses local features. ICON has two main modules, both of which exploit the SMPL(-X) body model. First, ICON infers detailed clothed-human normals (front/back) conditioned on the SMPL(-X) normals. Second, a visibility-aware implicit surface regressor produces an iso-surface of a human occupancy field. Importantly, at inference time, a feedback loop alternates between refining the SMPL(-X) mesh using the inferred clothed normals and then refining the normals. Given multiple reconstructed frames of a subject in varied poses, we use SCANimate to produce an animatable avatar from them. Evaluation on the AGORA and CAPE datasets shows that ICON outperforms the state of the art in reconstruction, even with heavily limited training data. Additionally, it is much more robust to out-of-distribution samples, e.g., in-the-wild poses/images and out-of-frame cropping. ICON takes a step towards robust 3D clothed human reconstruction from in-the-wild images. This enables creating avatars directly from video with personalized and natural pose-dependent cloth deformation.


title: The Early Dark Sector, the Hubble Tension, and the Swampland

abstract: We consider the interplay of the Early Dark Energy (EDE) model, the Swampland Distance Conjecture (SDC), and cosmological parameter tensions. EDE is a proposed resolution of the Hubble tension relying upon a near-Planckian scalar field excursion, while the SDC predicts an exponential sensitivity of masses of other fields to such an excursion, $m\propto e^{-c|\Delta \phi|/M_{\rm pl}}$ with $c\sim{\cal O}(1)$. Meanwhile, EDE is in tension with large-scale structure (LSS) data, due to shifts in the standard $\Lambda$CDM parameters necessary to fit the cosmic microwave background (CMB). One might hope that a proper treatment of the model, e.g., accounting for the SDC, may ameliorate the tension with LSS. Motivated by these considerations, we introduce the Early Dark Sector (EDS) model, wherein the mass of dark matter is exponentially sensitive to super-Planckian field excursions of the EDE scalar. The EDS model exhibits new phenomenology in both the early and late universe, the latter due to an EDE-mediated dark matter self-interaction. This dark matter-philic "fifth force", while constrained to be small, remains active in the late universe and is not screened in virialized halos. We find that the new interaction with dark matter partially resolves the LSS tension. However, the marginalized posteriors are nonetheless consistent with $f_{\rm EDE}=0$ at 95$\%$ CL once the Dark Energy Survey Year 3 measurement of $S_8$ is included. We study constraints on the model from Atacama Cosmology Telescope data, and find a factor of two improvement on the error bar on the SDC parameter $c$, along with an increased preference for the EDE component. We discuss the implications of these constraints for the SDC, and find the tightest observational constraints to date on a swampland parameter, suggesting that an EDE description of cosmological data is in tension with the SDC.


title: Decoupling and Recoupling Spatiotemporal Representation for RGB-D-based Motion Recognition

abstract: Decoupling spatiotemporal representation refers to decomposing the spatial and temporal features into dimension-independent factors. Although previous RGB-D-based motion recognition methods have achieved promising performance through the tightly coupled multi-modal spatiotemporal representation, they still suffer from (i) optimization difficulty under small data setting due to the tightly spatiotemporal-entangled modeling;(ii) information redundancy as it usually contains lots of marginal information that is weakly relevant to classification; and (iii) low interaction between multi-modal spatiotemporal information caused by insufficient late fusion. To alleviate these drawbacks, we propose to decouple and recouple spatiotemporal representation for RGB-D-based motion recognition. Specifically, we disentangle the task of learning spatiotemporal representation into 3 sub-tasks: (1) Learning high-quality and dimension independent features through a decoupled spatial and temporal modeling network. (2) Recoupling the decoupled representation to establish stronger space-time dependency. (3) Introducing a Cross-modal Adaptive Posterior Fusion (CAPF) mechanism to capture cross-modal spatiotemporal information from RGB-D data. Seamless combination of these novel designs forms a robust spatialtemporal representation and achieves better performance than state-of-the-art methods on four public motion datasets. Our code is available at https://github.com/damo-cv/MotionRGBD.


title: Ensembling Off-the-shelf Models for GAN Training

abstract: The advent of large-scale training has produced a cornucopia of powerful visual recognition models. However, generative models, such as GANs, have traditionally been trained from scratch in an unsupervised manner. Can the collective "knowledge" from a large bank of pretrained vision models be leveraged to improve GAN training? If so, with so many models to choose from, which one(s) should be selected, and in what manner are they most effective? We find that pretrained computer vision models can significantly improve performance when used in an ensemble of discriminators. Notably, the particular subset of selected models greatly affects performance. We propose an effective selection mechanism, by probing the linear separability between real and fake samples in pretrained model embeddings, choosing the most accurate model, and progressively adding it to the discriminator ensemble. Interestingly, our method can improve GAN training in both limited data and large-scale settings. Given only 10k training samples, our FID on LSUN Cat matches the StyleGAN2 trained on 1.6M images. On the full dataset, our method improves FID by 1.5x to 2x on cat, church, and horse categories of LSUN.


title: HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images

abstract: Existing state-of-the-art methods for Video Object Segmentation (VOS) learn low-level pixel-to-pixel correspondences between frames to propagate object masks across video. This requires a large amount of densely annotated video data, which is costly to annotate, and largely redundant since frames within a video are highly correlated. In light of this, we propose HODOR: a novel method that tackles VOS by effectively leveraging annotated static images for understanding object appearance and scene context. We encode object instances and scene information from an image frame into robust high-level descriptors which can then be used to re-segment those objects in different frames. As a result, HODOR achieves state-of-the-art performance on the DAVIS and YouTube-VOS benchmarks compared to existing methods trained without video annotations. Without any architectural modification, HODOR can also learn from video context around single annotated video frames by utilizing cyclic consistency, whereas other methods rely on dense, temporally consistent annotations. Source code is available at: https://github.com/Ali2500/HODOR


title: Entanglement Phase Structure of a Holographic BCFT in a Black Hole Background

abstract: We compute holographic entanglement entropy for subregions of a BCFT thermal state living on a nongravitating black hole background. The system we consider is doubly holographic and dual to an eternal black string with an embedded Karch-Randall brane that is parameterized by its angle. Entanglement islands are conventionally expected to emerge at late times to preserve unitarity at finite temperature, but recent calculations at zero temperature have shown such islands do not exist when the brane lies below a critical angle. When working at finite temperature in the context of a black string, we find that islands exist even when the brane lies below the critical angle. We note that although these islands exist when they are needed to preserve unitarity, they are restricted to a finite connected region on the brane which we call the atoll. Depending on two parameters -- the size of the subregion and the brane angle -- the entanglement entropy either remains constant in time or follows a Page curve. We discuss this rich phase structure in the context of bulk reconstruction.


title: Masked Feature Prediction for Self-Supervised Visual Pre-Training

abstract: We present Masked Feature Prediction (MaskFeat) for self-supervised pre-training of video models. Our approach first randomly masks out a portion of the input sequence and then predicts the feature of the masked regions. We study five different types of features and find Histograms of Oriented Gradients (HOG), a hand-crafted feature descriptor, works particularly well in terms of both performance and efficiency. We observe that the local contrast normalization in HOG is essential for good results, which is in line with earlier work using HOG for visual recognition. Our approach can learn abundant visual knowledge and drive large-scale Transformer-based models. Without using extra model weights or supervision, MaskFeat pre-trained on unlabeled videos achieves unprecedented results of 86.7% with MViT-L on Kinetics-400, 88.3% on Kinetics-600, 80.4% on Kinetics-700, 39.8 mAP on AVA, and 75.0% on SSv2. MaskFeat further generalizes to image input, which can be interpreted as a video with a single frame and obtains competitive results on ImageNet.


title: Semiconductor-Dielectric-Metal Solar Absorbers with High Spectral Selectivity

abstract: An ideal solar thermal absorber has a sharp transition between high and low absorptance at the wavelength where the blackbody emissive power begins to exceed the solar irradiance. However, most real selective absorbers have a fairly broad transition, leading to both solar absorption and thermal emission losses. Here, we model, fabricate, and characterize a highly selective semiconductor-dielectric-metal (Ga0.46In0.54As - MgF2 - Ag) solar absorber with an extremely sharp transition from high to low absorptance. The thin semiconductor serves as a selective filter, absorbing photons with wavelengths shorter than the bandgap and transmitting those with longer wavelengths. The highly reflective dielectric-metal rear mirror allows the structure to have very low emittance for longer wavelengths. These characteristics provide the absorber with a measured solar absorptance >91% below the bandgap wavelength and infrared emittance <5% at 100 C above the bandgap wavelength. This transition wavelength can be tuned by modifying the semiconductor composition, and modeling indicates that the absorber's optical properties should be stable at high temperatures, making the structure a good candidate for unconcentrated to highly concentrated solar thermal energy conversion.


title: ASC-Net: Unsupervised Medical Anomaly Segmentation Using an Adversarial-based Selective Cutting Network

abstract: In this paper we consider the problem of unsupervised anomaly segmentation in medical images, which has attracted increasing attention in recent years due to the expensive pixel-level annotations from experts and the existence of a large amount of unannotated normal and abnormal image scans. We introduce a segmentation network that utilizes adversarial learning to partition an image into two cuts, with one of them falling into a reference distribution provided by the user. This Adversarial-based Selective Cutting network (ASC-Net) bridges the two domains of cluster-based deep segmentation and adversarial-based anomaly/novelty detection algorithms. Our ASC-Net learns from normal and abnormal medical scans to segment anomalies in medical scans without any masks for supervision. We evaluate this unsupervised anomly segmentation model on three public datasets, i.e., BraTS 2019 for brain tumor segmentation, LiTS for liver lesion segmentation, and MS-SEG 2015 for brain lesion segmentation, and also on a private dataset for brain tumor segmentation. Compared to existing methods, our model demonstrates tremendous performance gains in unsupervised anomaly segmentation tasks. Although there is still room to further improve performance compared to supervised learning algorithms, the promising experimental results and interesting observations shed light on building an unsupervised learning algorithm for medical anomaly identification using user-defined knowledge.


title: Membrane Limits in Quantum Gravity

abstract: It is expected that infinite distance limits in the moduli space of quantum gravity are accompanied by a tower of light states. In view of the emergent string conjecture, this tower must either induce a decompactification or correspond to the emergence of a tensionless critical string. We study the consistency conditions implied by this conjecture on the asymptotic behavior of quantum gravity under dimensional reduction. If the emergent string descends from a (2+1)-dimensional membrane in a higher-dimensional theory, we find that such a membrane must parametrically decouple from the Kaluza-Klein scale. We verify this censorship against emergent membrane limits, where the membrane would sit at the Kaluza-Klein scale, in the hypermultiplet moduli space of Calabi-Yau 3-fold compactifications of string/M-theory. At the classical level, a putative membrane limit arises, up to duality, from an M5-brane wrapping the asymptotically shrinking special Lagrangian 3-cycle corresponding to the Strominger-Yau-Zaslow fiber of the Calabi-Yau. We show how quantum corrections in the moduli space obstruct such a limit and instead lead to a decompactification to 11 dimensions, where the role of the M5- and M2-branes are interchanged.


title: Cosmological constraints on the decay of heavy relics into neutrinos

abstract: A massive particle decaying into neutrinos in the early Universe is known to be less constrained than if it was decaying into other standard model particles. However, even if the decay proceeds into neutrinos, the latter still inevitably emit secondary particles undergoing electromagnetic interactions that can be probed. We analyse in details how sensitive various cosmological probes are to such secondary particles, namely CMB anisotropies, CMB spectral distortions, and Big Bang Nucleosynthesis. For relics whose lifetime is shorter than the age of the Universe, this leads to original and stringent bounds on the particle's lifetime as a function of its abundance and mass.


title: The DESI $N$-body Simulation Project I: Testing the Robustness of Simulations for the DESI Dark Time Survey

abstract: Analysis of large galaxy surveys requires confidence in the robustness of numerical simulation methods. The simulations are used to construct mock galaxy catalogs to validate data analysis pipelines and identify potential systematics. We compare three $N$-body simulation codes, ABACUS, GADGET, and SWIFT, to investigate the regimes in which their results agree. We run $N$-body simulations at three different mass resolutions, $6.25\times10^{8}$, $2.11\times10^{9}$, and $5.00\times10^{9}~h^{-1}$M$_{\odot}$, matching phases to reduce the noise within the comparisons. We find systematic errors in the halo clustering between different codes are smaller than the DESI statistical error for $s > 20\, h^{-1}$Mpc in the correlation function in redshift space. Through the resolution comparison we find that simulations run with a mass resolution of $2.1\times10^{9}~h^{-1}$M$_{\odot}$ are sufficiently converged for systematic effects in the halo clustering to be smaller than the DESI statistical error at scales larger than $20 \, h^{-1}$Mpc. These findings show that the simulations are robust for extracting cosmological information from large scales which is the key goal of the DESI survey. Comparing matter power spectra, we find the codes agree to within 1% for $k \leq 10~h$Mpc$^{-1}$. We also run a comparison of three initial condition generation codes and find good agreement. In addition, we include a quasi-$N$-body code, FastPM, since we plan use it for certain DESI analyses. The impact of the halo definition and galaxy-halo relation will be presented in a follow up study.


title: The muon g-2 anomaly confronts new physics in $e^\pm$ and $\mu^\pm$ final states scattering

abstract: The 4.2$\sigma$ discrepancy between the standard model prediction for the muon anomalous magnetic moment $a_\mu$ and the experimental result is accompanied by other anomalies. A crucial input for the prediction is the hadronic vacuum polarization $a_\mu^{\rm HVP}$ inferred from $\sigma_{\rm had} =\sigma(e^+e^- \to\,$hadrons) data. However, the two most accurate determinations of $\sigma_{\rm had}$ from KLOE and BaBar disagree by almost 3$\,\sigma$. Additionally, the combined data-driven result disagrees with the most precise lattice determination of $a_{\mu}^{\rm HVP}$ by $2.1\,\sigma$. We show that all these discrepancies could be accounted for by a new boson produced resonantly around the KLOE centre of mass energy and decaying promptly yielding $e^+e^-$ and $\mu^+\mu^-$ pairs in the final states. This gives rise to three different effects: (i) the additional $e^+e^-$ events will affect the KLOE luminosity determination based on measurements of the Bhabha cross section, and in turn the inferred value of $\sigma_{\rm had}$; (ii) the additional $\mu^+\mu^-$ events will affect the determination of $\sigma_{\rm had}$ via the (luminosity independent) measurement of the ratio of $\pi^+\pi^-\gamma$ versus $\mu^+\mu^-\gamma$ events; (iii) loops involving the new boson would contribute directly to the prediction for $a_\mu$. We discuss in detail this possibility, and we present a simple model that can reconcile the KLOE and BaBar results for $\sigma_{\rm had}$, the data-driven and the lattice determinations of $a_\mu^{\rm HVP}$, the predicted and measured values of $a_\mu$, while complying with all phenomenological constraints.


title: Quarks and gluons in the Lund plane

abstract: Discriminating quark and gluon jets is a long-standing topic in collider phenomenology. In this paper, we address this question using the Lund jet plane substructure technique introduced in recent years. We present two complementary approaches: one where the quark/gluon likelihood ratio is computed analytically, to single-logarithmic accuracy, in perturbative QCD, and one where the Lund declusterings are used to train a neural network. For both approaches, we either consider only the primary Lund plane or the full clustering tree. The analytic and machine-learning discriminants are shown to be equivalent on a toy event sample resumming exactly leading collinear single logarithms, where the analytic calculation corresponds to the exact likelihood ratio. On a full Monte Carlo event sample, both approaches show a good discriminating power, with the machine-learning models usually being superior. We carry on a study in the asymptotic limit of large logarithm, allowing us to gain confidence that this superior performance comes from effects that are subleading in our analytic approach. We then compare our approach to other quark-gluon discriminants in the literature. Finally, we study the resilience of our quark-gluon discriminants against the details of the event sample and observe that the analytic and machine-learning approaches show similar behaviour.


title: A Search for H-Dropout Lyman Break Galaxies at z~12-16

abstract: We present two bright galaxy candidates at z~12-13 identified in our H-dropout Lyman break selection with 2.3 deg2 near-infrared deep imaging data. These galaxy candidates, selected after careful screening of foreground interlopers, have spectral energy distributions showing a sharp discontinuity around 1.7 um, a flat continuum at 2-5 um, and non-detections at <1.2 um in the available photometric datasets, all of which are consistent with z>12 galaxy. An ALMA program targeting one of the candidates shows a tentative 4sigma [OIII]88um line at z=13.27, in agreement with its photometric redshift estimate. The number density of the z~12-13 candidates is comparable to that of bright z~10 galaxies, and is consistent with a recently proposed double power-law luminosity function rather than the Schechter function, indicating little evolution in the abundance of bright galaxies from z~4 to 13. Comparisons with theoretical models show that the models cannot reproduce the bright end of rest-frame ultraviolet luminosity functions at z~10-13. Combined with recent studies reporting similarly bright galaxies at z~9-11 and mature stellar populations at z~6-9, our results indicate the existence of a number of star-forming galaxies at z>10, which will be detected with upcoming space missions such as James Webb Space Telescope, Nancy Grace Roman Space Telescope, and GREX-PLUS.


title: On the Formation and Interaction of Multiple Supermassive Stars in Cosmological Flows

abstract: Supermassive primordial stars with masses exceeding $\sim10^5\,M_{\odot}$ that form in atomically cooled halos are the leading candidates for the origin of high-redshift quasars with $z>6$. Recent numerical simulations, however, find that multiple accretion disks can form within a halo, each of which can host a supermassive star. Tidal interactions between the disks can gravitationally torque gas onto their respective stars and alter their evolution. Later, when two satellite disks collide, the two stars can come into close proximity. This may induce additional mass exchange between them. We investigate the co-evolution of supermassive stars in atomically-cooled halos driven by gravitational interactions between their disks. We find a remarkable diversity of evolutionary outcomes. The results depend on these interactions and how the formation and collapse times of the stars in the two disks are correlated. They range from co-evolution as main sequence stars to main sequence -- black hole pairs and black hole -- black hole mergers. We examine the evolution of these secondary supermassive stars in detail and discuss the prospects for binary interactions on much smaller scales after the disks merge within their host halos.


title: OPE statistics from higher-point crossing

abstract: We present new asymptotic formulas for the distribution of OPE coefficients in conformal field theories. These formulas involve products of four or more coefficients and include light-light-heavy as well as heavy-heavy-heavy contributions. They are derived from crossing symmetry of the six and higher point functions on the plane and should be interpreted as non-Gaussianities in the statistical distribution of the OPE coefficients. We begin with a formula for arbitrary operator exchanges (not necessarily primary) valid in any dimension. This is the first asymptotic formula constraining heavy-heavy-heavy OPE coefficients in $d>2$. For two-dimensional CFTs, we present refined asymptotic formulas stemming from exchanges of quasi-primaries as well as Virasoro primaries.


title: Curved-space Dirac description of elastically deformed monolayer graphene is generally incorrect

abstract: Undistorted monolayer graphene has energy bands which cross at protected Dirac points. It elastically deforms and much research has assumed the Dirac description persists, now in a curved space and coupled to a gauge field related to lattice strain. We show this is incorrect by using a real space gradient expansion to study how the Dirac equation derives from the tight binding model. Generic spatially varying hopping functions give rise to large magnetic fields which spoil the truncation in derivatives. In the perturbative regime, the only consistent truncation to Dirac is one with nontrivial gauge field but in flat space. One can instead fine tune the magnetic field to be small, and we derive the resulting differential condition that the hopping functions must satisfy to yield a consistent truncation to Dirac in curved space. We consider whether mechanical effects might impose this fine tuning, but find this is not the case for a simple elastic membrane model.


title: Targeting Multi-Loop Integrals with Neural Networks

abstract: Numerical evaluations of Feynman integrals often proceed via a deformation of the integration contour into the complex plane. While valid contours are easy to construct, the numerical precision for a multi-loop integral can depend critically on the chosen contour. We present methods to optimize this contour using a combination of optimized, global complex shifts and a normalizing flow. They can lead to a significant gain in precision.


title: Rapid bursts of magnetically gated accretion in the intermediate polar V1025 Cen

abstract: Magnetically gated accretion has emerged as a proposed mechanism for producing extremely short, repetitive bursts of accretion onto magnetized white dwarfs in intermediate polars (IPs), but this phenomenon has not been detected previously in a confirmed IP. We report the 27-day TESS light curve of V1025 Cen, an IP that shows a remarkable series of twelve bursts of accretion, each lasting for less than six hours. The extreme brevity of the bursts and their short recurrence times (~1-3 days) are incompatible with the dwarf-nova instability, but they are natural consequences of the magnetic gating mechanism developed by Spruit & Taam to explain the Type II bursts of the accreting neutron star known as the Rapid Burster. In this model, the accretion flow piles up at the magnetospheric boundary and presses inward until it couples with the star's magnetic field, producing an abrupt burst of accretion. After each burst, the reservoir of matter at the edge of the magnetosphere is replenished, leading to cyclical bursts of accretion. A pair of recent studies applied this instability to the suspected IPs MV Lyr and TW Pic, but the magnetic nature of these two systems has not been independently confirmed. In contrast, previous studies have unambiguously established the white dwarf in V1025 Cen to be significantly magnetized. The detection of magnetically gated bursts in a confirmed IP therefore validates the extension of the Spruit & Taam instability to magnetized white dwarfs.


title: Binary Collisions of Dark Matter Blobs

abstract: We describe the model-independent mechanism by which dark matter and dark matter structures heavier than $\sim 8\times 10^{11}$ GeV form binary pairs in the early Universe that spin down and merge both in the present and throughout the Universe's history, producing potentially observable signals. Sufficiently dense dark objects will dominantly collide through binary mergers instead of random collisions. We detail how one would estimate the merger rate accounting for finite size effects, multibody interactions, and friction with the thermal bath. We predict how mergers of dark dense objects could be detected through gravitational and electromagnetic signals, noting that such mergers could be a unique source of high frequency gravitational waves. We rule out objects whose presence would contradict observations of the CMB and diffuse gamma-rays.


title: Probing the Inflaton Potential with SKA

abstract: SKA will be a major step forward not only in astrophysics, but also in precision cosmology. We show how the neutral hydrogen intensity map can be combined with the Planck measurements of the CMB power spectrum, to provide a precision test of the inflaton potential. For a conservative range of redshifts we find that SKA can significantly improve current constraints on the Hubble slow-roll parameters.


title: Quenched randomness, thermal fluctuations and reentrant superconductivity: application to UTe$_2$

abstract: Reentrant superconductivity has been observed in the candidate spin-triplet superconductor UTe$_2$ as a function of the magnetic field applied along the hard axis. Resistivity measurements have shown, a broadened superconducting transition appears near the minimal $T_c$, highlighting the importance of superconducting fluctuations in this regime. We present a phenomenological study assuming a field-driven first-order transition between two superconducting states. We show that with quenched randomness, inhomogeneity-enhanced superconducting fluctuations near the transition could naturally account for both the reentrant superconductivity as well as the broadened superconducting transition.


title: A comparative study of the physical properties for a representative sample of Narrow and Broad-line Seyfert galaxies

abstract: We present a comparative study of the physical properties of a homogeneous sample of 144 Narrow line Seyfert 1 (NLSy1) and 117 Broad-line Seyfert 1 (BLSy1) galaxies. These two samples are in a similar luminosity and redshift range and have optical spectra available in the 16$^{th}$ data release of Sloan Digital Sky Survey (SDSS-DR16) and X-ray spectra in either XMM-NEWTON or ROSAT. Direct correlation analysis and a Principal Component Analysis (PCA) have been performed using ten observational and physical parameters obtained by fitting the optical spectra and the soft X-ray photon indices as another parameter. We confirm that the established correlations for the general quasar population hold for both types of galaxies in this sample despite significant differences in the physical properties. We characterize the sample also using the line shape parameters, namely the asymmetry and kurtosis indices. We find that the fraction of NLSy1 galaxies showing outflow signatures, characterized by blue asymmetries, is higher by a factor of about 3 compared to the corresponding fraction in BLSy1 galaxies. The presence of high iron content in the broad-line region of NLSy1 galaxies in conjunction with higher Eddington ratios can be the possible reason behind this phenomenon. We also explore the possibility of using asymmetry in the emission lines as a tracer of outflows in the inner regions of Active Galactic Nuclei. The PCA results point to the NLSy1 and BLSy1 galaxies occupying different parameter spaces, which challenges the notion that NLSy1 galaxies are a subclass of BLSy1 galaxies.


title: TAFIM: Targeted Adversarial Attacks against Facial Image Manipulations

abstract: Face manipulation methods can be misused to affect an individual's privacy or to spread disinformation. To this end, we introduce a novel data-driven approach that produces image-specific perturbations which are embedded in the original images. The key idea is that these protected images prevent face manipulation by causing the manipulation model to produce a predefined manipulation target (uniformly colored output image in our case) instead of the actual manipulation. In addition, we propose to leverage differentiable compression approximation, hence making generated perturbations robust to common image compression. In order to prevent against multiple manipulation methods simultaneously, we further propose a novel attention-based fusion of manipulation-specific perturbations. Compared to traditional adversarial attacks that optimize noise patterns for each image individually, our generalized model only needs a single forward pass, thus running orders of magnitude faster and allowing for easy integration in image processing stacks, even on resource-constrained devices like smartphones.


title: Dark Matter Freeze-out during $\mathrm{SU}(2)_{\rm L}$ Confinement

abstract: We explore the possibility that dark matter is a pair of vector-like fermionic $\mathrm{SU}(2)_{\rm L}$ doublets and propose a novel mechanism of dark matter production that proceeds through the confinement of the weak sector of the Standard Model. This confinement phase causes the Standard Model doublets and dark matter to confine into pions. The dark pions freeze-out before the weak sector deconfines and generate a relic abundance of dark matter. We solve the Boltzmann equations for this scenario to determine the scale of confinement and constituent dark matter mass required to produce the observed relic density. We determine which regions of this parameter space evade direct detection, collider bounds, and successfully produce the observed relic density of dark matter. For a TeV scale pair of vector-like fermionic $\mathrm{SU}(2)_{\rm L}$ doublets, we find the weak confinement scale to be $\sim 700$ TeV.


title: An Empirical Investigation of the Role of Pre-training in Lifelong Learning

abstract: The lifelong learning paradigm in machine learning is an attractive alternative to the more prominent isolated learning scheme not only due to its resemblance to biological learning but also its potential to reduce energy waste by obviating excessive model re-training. A key challenge to this paradigm is the phenomenon of catastrophic forgetting. With the increasing popularity and success of pre-trained models in machine learning, we pose the question: What role does pre-training play in lifelong learning, specifically with respect to catastrophic forgetting? We investigate existing methods in the context of large, pre-trained models and evaluate their performance on a variety of text and image classification tasks, including a large-scale study using a novel data set of 15 diverse NLP tasks. Across all settings, we observe that generic pre-training implicitly alleviates the effects of catastrophic forgetting when learning multiple tasks sequentially compared to randomly initialized models. We then further investigate why pre-training alleviates forgetting in this setting. We study this phenomenon by analyzing the loss landscape, finding that pre-trained weights appear to ease forgetting by leading to wider minima. Based on this insight, we propose jointly optimizing for current task loss and loss basin sharpness to explicitly encourage wider basins during sequential fine-tuning. We show that this optimization approach outperforms several state-of-the-art task-sequential continual learning algorithms across multiple settings, occasionally even without retaining a memory that scales in size with the number of tasks.


title: The Full Quadratic Metric-Affine Gravity (Including Parity Odd Terms): Exact solutions for the Affine-Connection

abstract: We consider the most general Quadratic Metric-Affine Gravity setup in the presence of generic matter sources with non-vanishing hypermomentum. The gravitational action consists of all $17$ quadratic invariants (both parity even and odd) in torsion and non-metricity as well as their mixings, along with the terms that are linear in the curvature namely the Ricci scalar and the totally antisymmetric Riemann piece. Adding also a matter sector to the latter we first obtain the field equations for the generalized quadratic Theory. Then, using a recent Theorem, we successfully find the exact form of the affine connection under some quite general non-degeneracy conditions. Having obtained the exact and unique solution of the affine connection we subsequently derive the closed forms of spacetime torsion and non-metricity and also recast the metric field equations into a GR form with modified source terms that are quadratic in the hypermomentum and linear in its derivatives. We also study the vacuum quadratic Theory and prove that in this instance, or more generally for vanishing hypermomentum, the connection becomes the Levi-Civita one. Therefore, we also find exactly to what does the quadratic vacuum Theory correspond to. Finally, we generalize our result even further and also discuss the physical consequences and applications of our study.


title: Flavor Seesaw Mechanism

abstract: In the Standard Model, Yukawa couplings parametrize the fermion masses and mixing angles with the exception of neutrino masses. The hierarchies and apparent regularities among the quark and lepton masses are, however, otherwise a mystery. We propose a new class of models having vector-like fermions that can potentially address this problem and provide a new mechanism for fermion mass generation. The masses of the third and second generations of quarks and leptons arise at tree level via the seesaw mechanism from new physics at moderately higher scales, while loop corrections produce the masses for the first generation. This mechanism has a number of interesting and testable consequences. Among them are unavoidable flavor-violating signals at the upcoming experiments and the fact that neutrinos have naturally only Dirac masses.


title: On the dynamical evolution of Cepheids in star clusters

abstract: We investigate the occurrence of classical (type-I) Cepheid variable stars (henceforth: Cepheids) in dynamically evolving star clusters from birth to an age of approximately 300 Myr. The clusters are modelled by the Aarseth code nbody6, and they feature a realistic stellar initial mass function and initial binary star population, single star and binary star evolution, expulsion of the primordial gas, and the tidal field of the galaxy. Our simulations provide the first detailed dynamical picture of how frequently Cepheids remain gravitationally bound to their birth clusters versus how frequently they occur in the field. They allow us to quantify the relevance of various cluster escape mechanisms and how they depend on stellar mass. Overall, the simulations agree with the empirical picture that a small fraction ($\approx 10\%$) of Cepheids reside in clusters, that cluster halo membership is relatively common, and that the majority of Cepheid hosting clusters have only a single Cepheid member. Additionally, the simulations predict that a) Cepheid progenitors are much more likely to escape from low-mass than higher-mass clusters; b) higher-mass (long-period) Cepheids are $\approx 30\%$ more likely to be found in clusters than low-mass (short-period) Cepheids; c) the clustered Cepheid fraction increases with galactocentric radius since cluster dispersal is less efficient at greater radii; d) a lower metallicity reduces the overall clustered Cepheid fraction; e) high-mass clusters are much more likely to have more than one Cepheid member at any given time, in particular at a lower metallicity. We interpret the results as outcomes of various aspects of star cluster dynamics. The comparison of predicted and observed clustered Cepheid fractions, $f_{\rm CC}$, highlights the need for additional cluster disruption mechanisms, most likely encounters with giant molecular clouds.


title: Disordered vector models: from higher spins to incipient strings

abstract: We present a one-parameter family of large $N$ disordered models, with and without supersymmetry, in three spacetime dimensions. They interpolate from the critical large $N$ vector model dual to a classical higher spin theory, towards a theory with a classical string dual. We analyze the spectrum and OPE data of the theories. While the supersymmetric model is always well-behaved the non-supersymmetric model is unitary only over a small parameter range. We offer some speculations on the origin of strings from the higher spins.


title: Supersymmetry with Cadabra

abstract: This article provides a quick guide to the implementation of supersymmetry with Cadabra, a symbolic computer algebra system. Details are provided on the implementation of Grassmann variables, fermionic fields, supercharges, and superderivatives and the treatment of superfield expressions and supersymmetric Lagrangians. Finally, the automation of supersymmetric Lagrangian generation in the Cadabra programming framework is discussed.


title: Implementation of a Binary Neural Network on a Passive Array of Magnetic Tunnel Junctions

abstract: The increasing scale of neural networks and their growing application space have produced demand for more energy- and memory-efficient artificial-intelligence-specific hardware. Avenues to mitigate the main issue, the von Neumann bottleneck, include in-memory and near-memory architectures, as well as algorithmic approaches. Here we leverage the low-power and the inherently binary operation of magnetic tunnel junctions (MTJs) to demonstrate neural network hardware inference based on passive arrays of MTJs. In general, transferring a trained network model to hardware for inference is confronted by degradation in performance due to device-to-device variations, write errors, parasitic resistance, and nonidealities in the substrate. To quantify the effect of these hardware realities, we benchmark 300 unique weight matrix solutions of a 2-layer perceptron to classify the Wine dataset for both classification accuracy and write fidelity. Despite device imperfections, we achieve software-equivalent accuracy of up to 95.3 % with proper tuning of network parameters in 15 x 15 MTJ arrays having a range of device sizes. The success of this tuning process shows that new metrics are needed to characterize the performance and quality of networks reproduced in mixed signal hardware.

categories: cs.ET cond-mat.dis-nn cond-mat.mtrl-sci cs.LG physics.app-ph


title: Meteorites and the RNA World: Synthesis of Nucleobases in Carbonaceous Planetesimals and the Role of Initial Volatile Content

abstract: Prebiotic molecules, fundamental building blocks for the origin of life, have been found in carbonaceous chondrites. The exogenous delivery of these organic molecules onto the Hadean Earth could have sparked the polymerization of the first RNA molecules in Darwinian ponds during wet-dry cycles. Here, we investigate the formation of the RNA and DNA nucleobases adenine, uracil, cytosine, guanine, and thymine inside parent body planetesimals of carbonaceous chondrites. An up-to-date thermochemical equilibrium model coupled with a 1D thermodynamic planetesimal model is used to calculate the nucleobase concentrations. Different from the previous study (Pearce & Pudritz 2016), we assume initial volatile concentrations more appropriate for the formation zone of carbonaceous chondrite parent bodies. This represents more accurately cosmochemical findings that these bodies have formed inside the inner, $\sim 2\mathrm{-}5\,\mathrm{au}$, warm region of the solar system. Due to these improvements, our model represents the concentrations of adenine and guanine measured in carbonaceous chondrites. Our model did not reproduce per se the measurements of uracil, cytosine, and thymine in these meteorites. This can be explained by transformation reactions between nucleobases and potential decomposition of thymine. The synthesis of prebiotic organic matter in carbonaceous asteroids could be well explained by a combination of i) radiogenic heating, ii) aqueous chemistry involving a few key processes at a specific range of radii inside planetesimals where water can exist in the liquid phase, and iii) a reduced initial volatile content (H$_2$, CO, HCN, CH$_2$O) of the protoplanetary disk material in the parent body region compared to the outer region of comets.


title: Constraint-based graph network simulator

abstract: In the area of physical simulations, nearly all neural-network-based methods directly predict future states from the input states. However, many traditional simulation engines instead model the constraints of the system and select the state which satisfies them. Here we present a framework for constraint-based learned simulation, where a scalar constraint function is implemented as a graph neural network, and future predictions are computed by solving the optimization problem defined by the learned constraint. Our model achieves comparable or better accuracy to top learned simulators on a variety of challenging physical domains, and offers several unique advantages. We can improve the simulation accuracy on a larger system by applying more solver iterations at test time. We also can incorporate novel hand-designed constraints at test time and simulate new dynamics which were not present in the training data. Our constraint-based framework shows how key techniques from traditional simulation and numerical methods can be leveraged as inductive biases in machine learning simulators.


title: Nonparametric Two-Sample Testing by Betting

abstract: We study the problem of designing consistent sequential two-sample tests in a nonparametric setting. Guided by the principle of testing by betting, we reframe this task into that of selecting a sequence of payoff functions that maximize the wealth of a fictitious bettor, betting against the null in a repeated game. In this setting, the relative increase in the bettor's wealth has a precise interpretation as the measure of evidence against the null, and thus our sequential test rejects the null when the wealth crosses an appropriate threshold. We develop a general framework for setting up the betting game for two-sample testing, in which the payoffs are selected by a prediction strategy as data-driven predictable estimates of the witness function associated with the variational representation of some statistical distance measures, such as integral probability metrics (IPMs). We then formally relate the statistical properties of the test~(such as consistency, type-II error exponent and expected sample size) to the regret of the corresponding prediction strategy. We construct a practical sequential two-sample test by instantiating our general strategy with the kernel-MMD metric, and demonstrate its ability to adapt to the difficulty of the unknown alternative through theoretical and empirical results. Our framework is versatile, and easily extends to other problems; we illustrate this by applying our approach to construct consistent tests for the following problems: (i) time-varying two-sample testing with non-exchangeable observations, and (ii) an abstract class of "invariant" testing problems, including symmetry and independence testing.


title: Nonvolatile plasmonics based on optically reprogrammable phase change materials

abstract: We propose here a new platform for a realization of novel nonvolatile optical switching devices that takes an advantage of high field confinement provided by plasmonics and multi-state programming capabilities of chalcogenide phase change materials. A high reduction in the overall energy consumption consists of a high field enhancement provided by plasmonic that allow to lower the switching energies and implementation of phase change materials that allow to operate under a zero-static power consumption. A combination of plasmonics and phase change materials provide additionally an essential improvement in terms of a switching time, attenuation contrast and possibility to perform a phase shift with the wide bandgap phase change materials. In most of the all-optical switching photonic devices, a switching mechanism is realized optically through heating of phase change materials. Here, two stage heating process is proposed that is based on the absorption of light by phase change materials itself, and a heat transfer from the metal stripe under an absorption of light by a metal. Thus, compared to any other previously presented optical switches, even a wide bandgap phase change materials that show zero absorption of light can be implemented in the proposed structure. The proposed plasmonic waveguide arrangement is extremely sensitive to any changes of the phase change material properties, thus, even a minor change of temperature provides an essential change in the transmitted light.


title: High Fidelity Visualization of What Your Self-Supervised Representation Knows About

abstract: Discovering what is learned by neural networks remains a challenge. In self-supervised learning, classification is the most common task used to evaluate how good a representation is. However, relying only on such downstream task can limit our understanding of what information is retained in the representation of a given input. In this work, we showcase the use of a Representation Conditional Diffusion Model (RCDM) to visualize in data space the representations learned by self-supervised models. The use of RCDM is motivated by its ability to generate high-quality samples -- on par with state-of-the-art generative models -- while ensuring that the representations of those samples are faithful i.e. close to the one used for conditioning. By using RCDM to analyze self-supervised models, we are able to clearly show visually that i) SSL (backbone) representation are not invariant to the data augmentations they were trained with -- thus debunking an often restated but mistaken belief; ii) SSL post-projector embeddings appear indeed invariant to these data augmentation, along with many other data symmetries; iii) SSL representations appear more robust to small adversarial perturbation of their inputs than representations trained in a supervised manner; and iv) that SSL-trained representations exhibit an inherent structure that can be explored thanks to RCDM visualization and enables image manipulation.


title: ALEBk: Feasibility Study of Attention Level Estimation via Blink Detection applied to e-Learning

abstract: This work presents a feasibility study of remote attention level estimation based on eye blink frequency. We first propose an eye blink detection system based on Convolutional Neural Networks (CNNs), very competitive with respect to related works. Using this detector, we experimentally evaluate the relationship between the eye blink rate and the attention level of students captured during online sessions. The experimental framework is carried out using a public multimodal database for eye blink detection and attention level estimation called mEBAL, which comprises data from 38 students and multiples acquisition sensors, in particular, i) an electroencephalogram (EEG) band which provides the time signals coming from the student's cognitive information, and ii) RGB and NIR cameras to capture the students face gestures. The results achieved suggest an inverse correlation between the eye blink frequency and the attention level. This relation is used in our proposed method called ALEBk for estimating the attention level as the inverse of the eye blink frequency. Our results open a new research line to introduce this technology for attention level estimation on future e-learning platforms, among other applications of this kind of behavioral biometrics based on face analysis.


title: Locating the special point of hybrid neutron stars

abstract: The special point is a feature unique to models of hybrid neutron stars. It represents a location on their mass--radius sequences that is insensitive to the phase transition density. We consider hybrid neutron stars with a core of deconfined quark matter that obeys a constant--sound--speed (CSS) equation of state model and provide a fit formula for the coordinates of the special point as functions of the squared sound speed ($c_s^2$) and pressure scale ($A$) parameters. Using the special point mass as a proxy for the maximum mass of the hybrid stars we derive limits for the CSS model parameters based on the recent NICER constraint on mass and radius of pulsar PSR J0740+6620, $0.36 < {c^2_s}_{\rm min} < 0.43$ and $80<A [{\rm MeV/fm}^3]<160$. The upper limit for the maximum mass of hybrid stars depends on the upper limit for $c_s^2$ so that choosing $c^2_{s,max} = 0.6$ results in $M_{\rm max}<2.7~M_\odot$, within the mass range of GW190814.


title: From $\beta$ to $\eta$: a new cohomology for deformed Sasaki-Einstein manifolds

abstract: We discuss in detail the different analogues of Dolbeault cohomology groups on Sasaki-Einstein manifolds and prove a new vanishing result for the transverse Dolbeault cohomology groups $H_{\bar\partial}^{(p,0)}(k)$ graded by their charge under the Reeb vector. We then introduce a new cohomology, $\eta$-cohomology, which is defined by a CR structure and a holomorphic function $f$ with non-vanishing $\eta\equiv \mathrm{d}f$. It is the natural cohomology associated to a class of supersymmetric type IIB flux backgrounds that generalise the notion of a Sasaki-Einstein manifold. These geometries are dual to finite deformations of the 4d $\mathcal{N}=1$ SCFTs described by conventional Sasaki-Einstein manifolds. As such, they are associated to Calabi-Yau algebras with a deformed superpotential. We show how to compute the $\eta$-cohomology in terms of the transverse Dolbeault cohomology of the undeformed Sasaki-Einstein space. The gauge-gravity correspondence implies a direct relation between the cyclic homologies of the Calabi-Yau algebra, or equivalently the counting of short multiplets in the deformed SCFT, and the $\eta$-cohomology groups. We verify that this relation is satisfied in the case of S$^5$, and use it to predict the reduced cyclic homology groups in the case of deformations of regular Sasaki-Einstein spaces. The corresponding Calabi-Yau algebras describe non-commutative deformations of $\mathbb{P}^2$, $\mathbb{P}^1\times\mathbb{P}^1$ and the del Pezzo surfaces.


title: Towards Probing the Diffuse Supernova Neutrino Background in All Flavors

abstract: Fully understanding the average core-collapse supernova requires detecting the diffuse supernova neutrino background (DSNB) in all flavors. While the DSNB $\bar{\nu}_e$ flux is near detection, and the DSNB $\nu_e$ flux has a good upper limit and prospects for improvement, the DSNB $\nu_x$ (each of $\nu_\mu, \nu_\tau, \bar{\nu}_\mu, \bar{\nu}_\tau$) flux has a poor limit and heretofore had no clear path for improved sensitivity. We show that a succession of xenon-based dark matter detectors -- XENON1T (completed), XENONnT/LUX-ZEPLIN (running), and DARWIN (proposed) -- can dramatically improve sensitivity to DSNB $\nu_x$ the neutrino-nucleus coherent scattering channel. XENON1T could match the present sensitivity of $\sim 10^3 \; \mathrm{cm}^{-2}~\mathrm{s}^{-1}$ per $\nu_x$ flavor, XENONnT/LUX-ZEPLIN would have linear improvement of sensitivity with exposure, and a long run of DARWIN could reach a flux sensitivity of $\sim 10 \; \mathrm{cm}^{-2}~\mathrm{s}^{-1}$. Together, these would also contribute to greatly improve bounds on non-standard scenarios. Ultimately, to reach the standard flux range of $\sim 1 \; \mathrm{cm}^{-2}~\mathrm{s}^{-1}$, even larger exposures will be needed, which we show may be possible with the series of proposed lead-based RES-NOVA detectors.


title: On Optimizing Interventions in Shared Autonomy

abstract: Shared autonomy refers to approaches for enabling an autonomous agent to collaborate with a human with the aim of improving human performance. However, besides improving performance, it may often also be beneficial that the agent concurrently accounts for preserving the user's experience or satisfaction of collaboration. In order to address this additional goal, we examine approaches for improving the user experience by constraining the number of interventions by the autonomous agent. We propose two model-free reinforcement learning methods that can account for both hard and soft constraints on the number of interventions. We show that not only does our method outperform the existing baseline, but also eliminates the need to manually tune a black-box hyperparameter for controlling the level of assistance. We also provide an in-depth analysis of intervention scenarios in order to further illuminate system understanding.


title: Reinforcing RCTs with Multiple Priors while Learning about External Validity

abstract: This paper presents a framework for how to incorporate prior sources of information into the design of a sequential experiment. These sources can include previous experiments, expert opinions, or the experimenter's own introspection. We formalize this problem using a Bayesian approach that maps each source to a Bayesian model. These models are aggregated according to their associated posterior probabilities. We evaluate a broad class of policy rules according to three criteria: whether the experimenter learns the parameters of the payoff distributions, the probability that the experimenter chooses the wrong treatment when deciding to stop the experiment, and the average rewards. We show that our framework exhibits several nice finite sample theoretical guarantees, including robustness to any source that is not externally valid.


title: Causal Modeling With Infinitely Many Variables

abstract: Structural-equations models (SEMs) are perhaps the most commonly used framework for modeling causality. However, as we show, naively extending this framework to infinitely many variables, which is necessary, for example, to model dynamical systems, runs into several problems. We introduce GSEMs (generalized SEMs), a flexible generalization of SEMs that directly specify the results of interventions, in which (1) systems of differential equations can be represented in a natural and intuitive manner, (2) certain natural situations, which cannot be represented by SEMs at all, can be represented easily, (3) the definition of actual causality in SEMs carries over essentially without change.


title: An Audio-Visual Dataset and Deep Learning Frameworks for Crowded Scene Classification

abstract: This paper presents a task of audio-visual scene classification (SC) where input videos are classified into one of five real-life crowded scenes: 'Riot', 'Noise-Street', 'Firework-Event', 'Music-Event', and 'Sport-Atmosphere'. To this end, we firstly collect an audio-visual dataset (videos) of these five crowded contexts from Youtube (in-the-wild scenes). Then, a wide range of deep learning frameworks are proposed to deploy either audio or visual input data independently. Finally, results obtained from high-performed deep learning frameworks are fused to achieve the best accuracy score. Our experimental results indicate that audio and visual input factors independently contribute to the SC task's performance. Significantly, an ensemble of deep learning frameworks exploring either audio or visual input data can achieve the best accuracy of 95.7%.


title: Production of charged Higgs $H^\pm$ through $cb$-fusion at LHC

abstract: Considering the framework of the 2-Higgs Doublet Model Type III (2HDM-III), wherein two doublets are coupled both to up as down fermions, and the Flavour Changin Currents (FCNCs) is controlled by a four-zero Texture approach in the Yukawa matrices. We study the production of charged Higgs ($H^\pm$) by means of $cb$ quark fusion followed by channel decay $H^\pm \to \tau^\pm \nu$ : $ c b \to H^\pm \to \tau^\pm \bar \nu $. Taking in account the experimental bounds, as well as the theoretical constraints analysed in previous work arXiv:2003.06263[hep-ph]. One can show that in a lepton-specific-like incarnation of the model, we obtain a significant sensitivity for the LHC machine. We consider in the aforementioned study to both irreducible and reducible backgrounds of the SM.


title: Learning Bounded Context-Free-Grammar via LSTM and the Transformer:Difference and Explanations

abstract: Long Short-Term Memory (LSTM) and Transformers are two popular neural architectures used for natural language processing tasks. Theoretical results show that both are Turing-complete and can represent any context-free language (CFL).In practice, it is often observed that Transformer models have better representation power than LSTM. But the reason is barely understood. We study such practical differences between LSTM and Transformer and propose an explanation based on their latent space decomposition patterns. To achieve this goal, we introduce an oracle training paradigm, which forces the decomposition of the latent representation of LSTM and the Transformer and supervises with the transitions of the Pushdown Automaton (PDA) of the corresponding CFL. With the forced decomposition, we show that the performance upper bounds of LSTM and Transformer in learning CFL are close: both of them can simulate a stack and perform stack operation along with state transitions. However, the absence of forced decomposition leads to the failure of LSTM models to capture the stack and stack operations, while having a marginal impact on the Transformer model. Lastly, we connect the experiment on the prototypical PDA to a real-world parsing task to re-verify the conclusions


title: Effective prevention of semantic drift as angular distance in memory-less continual deep neural networks

abstract: Lifelong machine learning or continual learning models attempt to learn incrementally by accumulating knowledge across a sequence of tasks. Therefore, these models learn better and faster. They are used in various intelligent systems that have to interact with humans or any dynamic environment e.g., chatbots and self-driving cars. Memory-less approach is more often used with deep neural networks that accommodates incoming information from tasks within its architecture. It allows them to perform well on all the seen tasks. These models suffer from semantic drift or the plasticity-stability dilemma. The existing models use Minkowski distance measures to decide which nodes to freeze, update or duplicate. These distance metrics do not provide better separation of nodes as they are susceptible to high dimensional sparse vectors. In our proposed approach, we use angular distance to evaluate the semantic drift in individual nodes that provide better separation of nodes and thus better balancing between stability and plasticity. The proposed approach outperforms state-of-the art models by maintaining higher accuracy on standard datasets.


title: High-resolution images of two wiggling stellar jets, MHO 1502 and MHO 2147, obtained with GSAOI+GeMS

abstract: We investigated the possible cause-effect relation between the wiggling shape of two stellar jets, MHO 1502 and MHO 2147, and the potential binarity of the respective driving stars. We present high-angular-resolution H$_2$ (2.122 $\mu$m) and K-band images obtained with the Gemini South Adaptive Optics Imager (GSAOI) and the Gemini Multi-conjugate Adaptive Optics System (GeMS). The profiles of the jets are depicted in detail by the H$_2$ images. We used K-band data to search for potential close companions to the previously suggested exciting sources, and used archive data to investigate these sources and the environments in which the jets are located. We also applied a model to reproduce the wiggling profiles of the jets. MHO~1502 is composed of a chain of knots delineating the wiggling jet, suggesting that the driving source emitted them in an intermittent manner. Our K-band image of the previously proposed exciting star, IRAC 18064, shows two sources separated by $\sim240$ AU, hinting at its binarity. However, as IRAC 18064 is located off the jet axis at $\sim2064$ AU, it is questionable as to whether this source is the true exciting star. Moreover, the orbital model centred on IRAC 18064 suggests a binary companion at a much greater distance ($\sim2200$ AU) than the nearby star (at $\sim$240 AU). On the other hand, the orbital model centred on the axis provides the best fits. Nevertheless, the precession model centred on the axis cannot be discarded, despite having larger residuals and $\chi^2$. MHO 2147 displays an S-shaped gentle continuous emission in H$_2$. We identify two other jets in the field of MHO 2147: a previously reported quasi-perpendicular jet, MHO 2148, and a third jet adjacent to MHO 2147. The model that best fits the morphology of the MHO 2147 jet and that of its adjacent jet is precession. The exciting source of MHO 2147 may be a triple system.


title: Coherence Learning using Keypoint-based Pooling Network for Accurately Assessing Radiographic Knee Osteoarthritis

abstract: Knee osteoarthritis (OA) is a common degenerate joint disorder that affects a large population of elderly people worldwide. Accurate radiographic assessment of knee OA severity plays a critical role in chronic patient management. Current clinically-adopted knee OA grading systems are observer subjective and suffer from inter-rater disagreements. In this work, we propose a computer-aided diagnosis approach to provide more accurate and consistent assessments of both composite and fine-grained OA grades simultaneously. A novel semi-supervised learning method is presented to exploit the underlying coherence in the composite and fine-grained OA grades by learning from unlabeled data. By representing the grade coherence using the log-probability of a pre-trained Gaussian Mixture Model, we formulate an incoherence loss to incorporate unlabeled data in training. The proposed method also describes a keypoint-based pooling network, where deep image features are pooled from the disease-targeted keypoints (extracted along the knee joint) to provide more aligned and pathologically informative feature representations, for accurate OA grade assessments. The proposed method is comprehensively evaluated on the public Osteoarthritis Initiative (OAI) data, a multi-center ten-year observational study on 4,796 subjects. Experimental results demonstrate that our method leads to significant improvements over previous strong whole image-based deep classification network baselines (like ResNet-50).