title: From Merging Frameworks to Merging Stars: Experiences using HPX, Kokkos and SIMD Types

abstract: Octo-Tiger, a large-scale 3D AMR code for the merger of stars, uses a combination of HPX, Kokkos and explicit SIMD types, aiming to achieve performance-portability for a broad range of heterogeneous hardware. However, on A64FX CPUs, we encountered several missing pieces, hindering performance by causing problems with the SIMD vectorization. Therefore, we add std::experimental::simd as an option to use in Octo-Tiger's Kokkos kernels alongside Kokkos SIMD, and further add a new SVE (Scalable Vector Extensions) SIMD backend. Additionally, we amend missing SIMD implementations in the Kokkos kernels within Octo-Tiger's hydro solver. We test our changes by running Octo-Tiger on three different CPUs: An A64FX, an Intel Icelake and an AMD EPYC CPU, evaluating SIMD speedup and node-level performance. We get a good SIMD speedup on the A64FX CPU, as well as noticeable speedups on the other two CPU platforms. However, we also experience a scaling issue on the EPYC CPU.


title: The Devil is in the Details: On Models and Training Regimes for Few-Shot Intent Classification

abstract: Few-shot Intent Classification (FSIC) is one of the key challenges in modular task-oriented dialog systems. While advanced FSIC methods are similar in using pretrained language models to encode texts and nearest neighbour-based inference for classification, these methods differ in details. They start from different pretrained text encoders, use different encoding architectures with varying similarity functions, and adopt different training regimes. Coupling these mostly independent design decisions and the lack of accompanying ablation studies are big obstacle to identify the factors that drive the reported FSIC performance. We study these details across three key dimensions: (1) Encoding architectures: Cross-Encoder vs Bi-Encoders; (2) Similarity function: Parameterized (i.e., trainable) functions vs non-parameterized function; (3) Training regimes: Episodic meta-learning vs the straightforward (i.e., non-episodic) training. Our experimental results on seven FSIC benchmarks reveal three important findings. First, the unexplored combination of the cross-encoder architecture (with parameterized similarity scoring function) and episodic meta-learning consistently yields the best FSIC performance. Second, Episodic training yields a more robust FSIC classifier than non-episodic one. Third, in meta-learning methods, splitting an episode to support and query sets is not a must. Our findings paves the way for conducting state-of-the-art research in FSIC and more importantly raise the community's attention to details of FSIC methods. We release our code and data publicly.


title: How Much Data Are Augmentations Worth? An Investigation into Scaling Laws, Invariance, and Implicit Regularization

abstract: Despite the clear performance benefits of data augmentations, little is known about why they are so effective. In this paper, we disentangle several key mechanisms through which data augmentations operate. Establishing an exchange rate between augmented and additional real data, we find that in out-of-distribution testing scenarios, augmentations which yield samples that are diverse, but inconsistent with the data distribution can be even more valuable than additional training data. Moreover, we find that data augmentations which encourage invariances can be more valuable than invariance alone, especially on small and medium sized training sets. Following this observation, we show that augmentations induce additional stochasticity during training, effectively flattening the loss landscape.


title: Can Pretrained Language Models (Yet) Reason Deductively?

abstract: Acquiring factual knowledge with Pretrained Language Models (PLMs) has attracted increasing attention, showing promising performance in many knowledge-intensive tasks. Their good performance has led the community to believe that the models do possess a modicum of reasoning competence rather than merely memorising the knowledge. In this paper, we conduct a comprehensive evaluation of the learnable deductive (also known as explicit) reasoning capability of PLMs. Through a series of controlled experiments, we posit two main findings. (i) PLMs inadequately generalise learned logic rules and perform inconsistently against simple adversarial surface form edits. (ii) While the deductive reasoning fine-tuning of PLMs does improve their performance on reasoning over unseen knowledge facts, it results in catastrophically forgetting the previously learnt knowledge. Our main results suggest that PLMs cannot yet perform reliable deductive reasoning, demonstrating the importance of controlled examinations and probing of PLMs' reasoning abilities; we reach beyond (misleading) task performance, revealing that PLMs are still far from human-level reasoning capabilities, even for simple deductive tasks.


title: On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning

abstract: Rehearsal approaches enjoy immense popularity with Continual Learning (CL) practitioners. These methods collect samples from previously encountered data distributions in a small memory buffer; subsequently, they repeatedly optimize on the latter to prevent catastrophic forgetting. This work draws attention to a hidden pitfall of this widespread practice: repeated optimization on a small pool of data inevitably leads to tight and unstable decision boundaries, which are a major hindrance to generalization. To address this issue, we propose Lipschitz-DrivEn Rehearsal (LiDER), a surrogate objective that induces smoothness in the backbone network by constraining its layer-wise Lipschitz constants w.r.t. replay examples. By means of extensive experiments, we show that applying LiDER delivers a stable performance gain to several state-of-the-art rehearsal CL methods across multiple datasets, both in the presence and absence of pre-training. Through additional ablative experiments, we highlight peculiar aspects of buffer overfitting in CL and better characterize the effect produced by LiDER. Code is available at https://github.com/aimagelab/LiDER


title: Entity Tracking via Effective Use of Multi-Task Learning Model and Mention-guided Decoding

abstract: Cross-task knowledge transfer via multi-task learning has recently made remarkable progress in general NLP tasks. However, entity tracking on the procedural text has not benefited from such knowledge transfer because of its distinct formulation, i.e., tracking the event flow while following structural constraints. State-of-the-art entity tracking approaches either design complicated model architectures or rely on task-specific pre-training to achieve good results. To this end, we propose MeeT, a Multi-task learning-enabled entity Tracking approach, which utilizes knowledge gained from general domain tasks to improve entity tracking. Specifically, MeeT first fine-tunes T5, a pre-trained multi-task learning model, with entity tracking-specialized QA formats, and then employs our customized decoding strategy to satisfy the structural constraints. MeeT achieves state-of-the-art performances on two popular entity tracking datasets, even though it does not require any task-specific architecture design or pre-training.


title: Hydrodynamic Entropy and Emergence of Order in Two-dimensional Euler Turbulence

abstract: Using numerical simulations, we show that the asymptotic states of two-dimensional (2D) Euler turbulence exhibit large-scale flow structures due to nonzero energy transfers among small wavenumber modes. These asymptotic states, which depend on the initial conditions, are out of equilibrium, and they are different from the predictions of Onsager and Kraichnan. We propose ``hydrodynamic entropy'' to quantify order in 2D Euler turbulence; we show that this entropy decreases with time, even though the system is isolated with no dissipation and no contact with a heat bath.

categories: cond-mat.stat-mech nlin.CD physics.flu-dyn physics.plasm-ph


title: Equilibrium States Corresponding to Targeted Hyperuniform Nonequilibrium Pair Statistics

abstract: The Zhang-Torquato conjecture [Phys. Rev. E 101, 032124 (2020)] states that any realizable pair correlation function $g_2({\bf r})$ or structure factor $S({\bf k})$ of a translationally invariant nonequilibrium system can be attained by an equilibrium ensemble involving only (up to) effective two-body interactions. To test this conjecture, we consider two singular nonequilibrium models of recent interest that also have the exotic hyperuniformity property: a 2D "perfect glass" and a 3D critical absorbing-state model. We find that each nonequilibrium target can be achieved accurately by equilibrium states with effective one- and two-body potentials, lending further support to the conjecture. To characterize the structural degeneracy of such nonequilibrium-equilibrium correspondence, we compute higher-order statistics for both models, as well as those for a hyperuniform 3D uniformly randomized lattice (URL), whose higher-order statistics can be very precisely ascertained. Interestingly, we find that the differences in the higher-order statistics between nonequilibrium and equilibrium systems with matching pair statistics, as measured by the "hole" probability distribution, provides measures of the degree to which a system is out of equilibrium. We show that all three systems studied possess the \textit{bounded-hole} property, and that holes near the maximum hole size in the URL are much rarer than those in the underlying simple cubic lattice. Remarkably, upon quenching, the effective potentials for all three systems possess local energy minima with stronger forms of hyperuniformity compared to their target counterparts. Our work is expected to facilitate the self-assembly of tunable hyperuniform soft-matter systems.


title: Sampling in Constrained Domains with Orthogonal-Space Variational Gradient Descent

abstract: Sampling methods, as important inference and learning techniques, are typically designed for unconstrained domains. However, constraints are ubiquitous in machine learning problems, such as those on safety, fairness, robustness, and many other properties that must be satisfied to apply sampling results in real-life applications. Enforcing these constraints often leads to implicitly-defined manifolds, making efficient sampling with constraints very challenging. In this paper, we propose a new variational framework with a designed orthogonal-space gradient flow (O-Gradient) for sampling on a manifold $\mathcal{G}_0$ defined by general equality constraints. O-Gradient decomposes the gradient into two parts: one decreases the distance to $\mathcal{G}_0$ and the other decreases the KL divergence in the orthogonal space. While most existing manifold sampling methods require initialization on $\mathcal{G}_0$, O-Gradient does not require such prior knowledge. We prove that O-Gradient converges to the target constrained distribution with rate $\widetilde{O}(1/\text{the number of iterations})$ under mild conditions. Our proof relies on a new Stein characterization of conditional measure which could be of independent interest. We implement O-Gradient through both Langevin dynamics and Stein variational gradient descent and demonstrate its effectiveness in various experiments, including Bayesian deep neural networks.


title: Debiased inference for a covariate-adjusted regression function

abstract: In this article, we study nonparametric inference for a covariate-adjusted regression function. This parameter captures the average association between a continuous exposure and an outcome after adjusting for other covariates. In particular, under certain causal conditions, this parameter corresponds to the average outcome had all units been assigned to a specific exposure level, known as the causal dose-response curve. We propose a debiased local linear estimator of the covariate-adjusted regression function, and demonstrate that our estimator converges pointwise to a mean-zero normal limit distribution. We use this result to construct asymptotically valid confidence intervals for function values and differences thereof. In addition, we use approximation results for the distribution of the supremum of an empirical process to construct asymptotically valid uniform confidence bands. Our methods do not require undersmoothing, permit the use of data-adaptive estimators of nuisance functions, and our estimator attains the optimal rate of convergence for a twice differentiable function. We illustrate the practical performance of our estimator using numerical studies and an analysis of the effect of air pollution exposure on cardiovascular mortality.


title: To the kinetic theory of dense gases and liquids. Calculation of quasi-equilibrium particle distribution functions by the method of collective variables

abstract: Based on a chain of BBGKI equations with a modified boundary condition that takes into account multiparticle correlations, kinetic equations in the approximate "pairs" collisions and in the polarization approximation, taking into account the interaction through the third particle, obtained. The specifics of the model representation of the pair potential of particle interaction through short-range and long-range parts were taken into account. In the case of the short-range potential in the form of the potential of solid spheres, the contribution of Enskog's revised theory to the complete integration of the collision of the kinetic equation is obtained. The collision integrals include paired quasi-equilibrium distribution functions that depend on the nonequilibrium mean values of the particle number density and the inverse temperature. The method of collective variables Yukhnovskii is applied for the calculation of pair quasi-equilibrium distribution function with an allocation of short-range and long-range parts in the potential of the interaction of particles. In this case, the system with short-range interaction is considered as a frame of reference.


title: Machine learning-based jet and event classification at the Electron-Ion Collider with applications to hadron structure and spin physics

abstract: We explore machine learning-based jet and event identification at the future Electron-Ion Collider (EIC). We study the effectiveness of machine learning-based classifiers at relatively low EIC energies, focusing on (i) identifying the flavor of the jet and (ii) identifying the underlying hard process of the event. We propose applications of our machine learning-based jet identification in the key research areas at the future EIC and current Relativistic Heavy Ion Collider program, including enhancing constraints on (transverse momentum dependent) parton distribution functions, improving experimental access to transverse spin asymmetries, studying photon structure, and quantifying the modification of hadrons and jets in the cold nuclear matter environment in electron-nucleus collisions. We establish first benchmarks and contrast the estimated performance of flavor tagging at the EIC with that at the Large Hadron Collider. We perform studies relevant to aspects of detector design including particle identification, charge information, and minimum transverse momentum capabilities. Additionally, we study the impact of using full event information instead of using only information associated with the identified jet. These methods can be deployed either on suitably accurate Monte Carlo event generators, or, for several applications, directly on experimental data. We provide an outlook for ultimately connecting these machine learning-based methods with first principles calculations in quantum chromodynamics.


title: Linear Response, Hamiltonian and Radiative Spinning Two-Body Dynamics

abstract: Using the spinning, supersymmetric Worldline Quantum Field Theory formalism we compute the momentum impulse and spin kick from a scattering of two spinning black holes or neutron stars up to quadratic order in spin at third post-Minkowskian (PM) order, including radiation-reaction effects and with arbitrarily mis-aligned spin directions. Parts of these observables, both conservative and radiative, are also inferred from lower-PM scattering data by extending Bini and Damour's linear response formula to include mis-aligned spins. By solving Hamilton's equations of motion we also use a conservative scattering angle to infer a complete 3PM two-body Hamiltonian including finite-size corrections and mis-aligned spin-spin interactions. Finally, we describe mappings to the bound two-body dynamics for aligned spin vectors: including a numerical plot of the binding energy for circular orbits compared with numerical relativity, analytic confirmation of the NNLO PN binding energy and the energy loss over successive orbits.


title: Nested Dust Shells around the Wolf-Rayet Binary WR 140 observed with JWST

abstract: Massive colliding-wind binaries that host a Wolf-Rayet (WR) star present a potentially important source of dust and chemical enrichment in the interstellar medium (ISM). However, the chemical composition and survival of dust formed from such systems is not well understood. The carbon-rich WR (WC) binary WR~140 presents an ideal astrophysical laboratory for investigating these questions given its well-defined orbital period and predictable dust-formation episodes every 7.93 years around periastron passage. We present observations from our Early Release Science program (ERS1349) with the James Webb Space Telescope (JWST) Mid-Infrared Instrument (MIRI) Medium-Resolution Spectrometer (MRS) and Imager that reveal the spectral and spatial signatures of nested circumstellar dust shells around WR~140. MIRI MRS spectroscopy of the second dust shell and Imager detections of over 17 shells formed throughout the past $\gtrsim130$ years confirm the survival of carbonaceous dust grains from WR~140 that are likely carriers of "unidentified infrared" (UIR)-band features at 6.4 and 7.7 $\mu$m. The observations indicate that dust-forming WC binaries can enrich the ISM with organic compounds and carbonaceous dust.


title: Emergent scale-free networks

abstract: Many complex systems--from social and communication networks to biological networks and the Internet--are thought to exhibit scale-free structure. However, prevailing explanations rely on the constant addition of new nodes, an assumption that fails dramatically in some real-world settings. Here, we propose a model in which nodes are allowed to die, and their connections rearrange under a mixture of preferential and random attachment. With these simple dynamics, we show that networks self-organize towards scale-free structure, with a power-law exponent $\gamma = 1 + \frac{1}{p}$ that depends only on the proportion $p$ of preferential (rather than random) attachment. Applying our model to several real networks, we infer $p$ directly from data, and predict the relationship between network size and degree heterogeneity. Together, these results establish that realistic scale-free structure can emerge naturally in networks of constant size and density, with broad implications for the structure and function of complex systems.


title: Quantum Depth in the Random Oracle Model

abstract: We give a comprehensive characterization of the computational power of shallow quantum circuits combined with classical computation. Specifically, for classes of search problems, we show that the following statements hold, relative to a random oracle: (a) $\mathsf{BPP}^{\mathsf{QNC}^{\mathsf{BPP}}} \neq \mathsf{BQP}$. This refutes Jozsa's conjecture [QIP 05] in the random oracle model. As a result, this gives the first instantiatable separation between the classes by replacing the oracle with a cryptographic hash function, yielding a resolution to one of Aaronson's ten semi-grand challenges in quantum computing. (b) $\mathsf{BPP}^{\mathsf{QNC}} \nsubseteq \mathsf{QNC}^{\mathsf{BPP}}$ and $\mathsf{QNC}^{\mathsf{BPP}} \nsubseteq \mathsf{BPP}^{\mathsf{QNC}}$. This shows that there is a subtle interplay between classical computation and shallow quantum computation. In fact, for the second separation, we establish that, for some problems, the ability to perform adaptive measurements in a single shallow quantum circuit, is more useful than the ability to perform polynomially many shallow quantum circuits without adaptive measurements. (c) There exists a 2-message proof of quantum depth protocol. Such a protocol allows a classical verifier to efficiently certify that a prover must be performing a computation of some minimum quantum depth. Our proof of quantum depth can be instantiated using the recent proof of quantumness construction by Yamakawa and Zhandry [STOC 22].


title: Token-Label Alignment for Vision Transformers

abstract: Data mixing strategies (e.g., CutMix) have shown the ability to greatly improve the performance of convolutional neural networks (CNNs). They mix two images as inputs for training and assign them with a mixed label with the same ratio. While they are shown effective for vision transformers (ViTs), we identify a token fluctuation phenomenon that has suppressed the potential of data mixing strategies. We empirically observe that the contributions of input tokens fluctuate as forward propagating, which might induce a different mixing ratio in the output tokens. The training target computed by the original data mixing strategy can thus be inaccurate, resulting in less effective training. To address this, we propose a token-label alignment (TL-Align) method to trace the correspondence between transformed tokens and the original tokens to maintain a label for each token. We reuse the computed attention at each layer for efficient token-label alignment, introducing only negligible additional training costs. Extensive experiments demonstrate that our method improves the performance of ViTs on image classification, semantic segmentation, objective detection, and transfer learning tasks. Code is available at: https://github.com/Euphoria16/TL-Align.


title: Are Sample-Efficient NLP Models More Robust?

abstract: Recent results in image classification and extractive question answering have observed that pre-trained models trained on less in-distribution data have better out-of-distribution performance. However, it is unclear how broadly these trends hold. We conduct a large empirical study across three tasks, three broadly-applicable modeling interventions (increasing model size, using a different adaptation method, and pre-training on more data), and 14 diverse datasets to investigate the relationship between sample efficiency (amount of data needed to reach a given ID accuracy) and robustness (how models fare on OOD evaluation). We find that higher sample efficiency is only correlated with better average OOD robustness on some modeling interventions and tasks, but not others. On individual datasets, models with lower sample efficiency can even be more robust. These results suggest that general-purpose methods for improving sample efficiency are unlikely to yield universal OOD robustness improvements, since such improvements are highly dataset- and task-dependent. Even in an era of large, multi-purpose pretrained models, task-specific decisions may often be necessary for OOD generalization.


title: An explicit Vinogradov-Korobov zero-free region for Dirichlet L-functions

abstract: We establish the first explicit form of the Vinogradov--Korobov zero-free region for Dirichlet $L$-functions.


title: Efficient Knowledge Distillation from Model Checkpoints

abstract: Knowledge distillation is an effective approach to learn compact models (students) with the supervision of large and strong models (teachers). As empirically there exists a strong correlation between the performance of teacher and student models, it is commonly believed that a high performing teacher is preferred. Consequently, practitioners tend to use a well trained network or an ensemble of them as the teacher. In this paper, we make an intriguing observation that an intermediate model, i.e., a checkpoint in the middle of the training procedure, often serves as a better teacher compared to the fully converged model, although the former has much lower accuracy. More surprisingly, a weak snapshot ensemble of several intermediate models from a same training trajectory can outperform a strong ensemble of independently trained and fully converged models, when they are used as teachers. We show that this phenomenon can be partially explained by the information bottleneck principle: the feature representations of intermediate models can have higher mutual information regarding the input, and thus contain more "dark knowledge" for effective distillation. We further propose an optimal intermediate teacher selection algorithm based on maximizing the total task-related mutual information. Experiments verify its effectiveness and applicability.


title: Differentially private multivariate medians

abstract: Statistical tools which satisfy rigorous privacy guarantees are necessary for modern data analysis. It is well-known that robustness against contamination is linked to differential privacy. Despite this fact, using multivariate medians for differentially private and robust multivariate location estimation has not been systematically studied. We develop novel finite-sample performance guarantees for differentially private multivariate depth-based medians, which are essentially sharp. Our results cover commonly used depth functions, such as the halfspace (or Tukey) depth, spatial depth, and the integrated dual depth. We show that under Cauchy marginals, the cost of heavy-tailed location estimation outweighs the cost of privacy. We demonstrate our results numerically using a Gaussian contamination model in dimensions up to d = 100, and compare them to a state-of-the-art private mean estimation algorithm. As a by-product of our investigation, we prove concentration inequalities for the output of the exponential mechanism about the maximizer of the population objective function. This bound applies to objective functions that satisfy a mild regularity condition.


title: Asymptotics for the least trimmed squares estimator

abstract: Despite the empirical version of least trimmed squares (LTS) in regression (Rousseeuw \cite{R84}) having been repeatedly studied in the literature, the population version of LTS has never been introduced. Novel properties of the objective function in both empirical and population settings of the LTS, along with other properties, are established for the first time in this article. The primary properties of the objective function facilitate the establishment of other original results, including the influence function and Fisher consistency. The strong consistency is established with the help of a generalized Glivenko-Cantelli Theorem over a class of functions. Differentiability and stochastic equicontinuity promote the establishment of asymptotic normality with a concise and novel approach.


title: Better Smatch = Better Parser? AMR evaluation is not so simple anymore

abstract: Recently, astonishing advances have been observed in AMR parsing, as measured by the structural Smatch metric. In fact, today's systems achieve performance levels that seem to surpass estimates of human inter annotator agreement (IAA). Therefore, it is unclear how well Smatch (still) relates to human estimates of parse quality, as in this situation potentially fine-grained errors of similar weight may impact the AMR's meaning to different degrees. We conduct an analysis of two popular and strong AMR parsers that -- according to Smatch -- reach quality levels on par with human IAA, and assess how human quality ratings relate to Smatch and other AMR metrics. Our main findings are: i) While high Smatch scores indicate otherwise, we find that AMR parsing is far from being solved: we frequently find structurally small, but semantically unacceptable errors that substantially distort sentence meaning. ii) Considering high-performance parsers, better Smatch scores may not necessarily indicate consistently better parsing quality. To obtain a meaningful and comprehensive assessment of quality differences of parse(r)s, we recommend augmenting evaluations with macro statistics, use of additional metrics, and more human analysis.


title: Self-Guided Diffusion Models

abstract: Diffusion models have demonstrated remarkable progress in image generation quality, especially when guidance is used to control the generative process. However, guidance requires a large amount of image-annotation pairs for training and is thus dependent on their availability, correctness and unbiasedness. In this paper, we eliminate the need for such annotation by instead leveraging the flexibility of self-supervision signals to design a framework for self-guided diffusion models. By leveraging a feature extraction function and a self-annotation function, our method provides guidance signals at various image granularities: from the level of holistic images to object boxes and even segmentation masks. Our experiments on single-label and multi-label image datasets demonstrate that self-labeled guidance always outperforms diffusion models without guidance and may even surpass guidance based on ground-truth labels, especially on unbalanced data. When equipped with self-supervised box or mask proposals, our method further generates visually diverse yet semantically consistent images, without the need for any class, box, or segment label annotation. Self-guided diffusion is simple, flexible and expected to profit from deployment at scale. Source code will be at: https://taohu.me/sgdm/


title: Holo-Dex: Teaching Dexterity with Immersive Mixed Reality

abstract: A fundamental challenge in teaching robots is to provide an effective interface for human teachers to demonstrate useful skills to a robot. This challenge is exacerbated in dexterous manipulation, where teaching high-dimensional, contact-rich behaviors often require esoteric teleoperation tools. In this work, we present Holo-Dex, a framework for dexterous manipulation that places a teacher in an immersive mixed reality through commodity VR headsets. The high-fidelity hand pose estimator onboard the headset is used to teleoperate the robot and collect demonstrations for a variety of general-purpose dexterous tasks. Given these demonstrations, we use powerful feature learning combined with non-parametric imitation to train dexterous skills. Our experiments on six common dexterous tasks, including in-hand rotation, spinning, and bottle opening, indicate that Holo-Dex can both collect high-quality demonstration data and train skills in a matter of hours. Finally, we find that our trained skills can exhibit generalization on objects not seen in training. Videos of Holo-Dex are available at https://holo-dex.github.io.


title: Predictive Querying for Autoregressive Neural Sequence Models

abstract: In reasoning about sequential events it is natural to pose probabilistic queries such as "when will event A occur next" or "what is the probability of A occurring before B", with applications in areas such as user modeling, medicine, and finance. However, with machine learning shifting towards neural autoregressive models such as RNNs and transformers, probabilistic querying has been largely restricted to simple cases such as next-event prediction. This is in part due to the fact that future querying involves marginalization over large path spaces, which is not straightforward to do efficiently in such models. In this paper we introduce a general typology for predictive queries in neural autoregressive sequence models and show that such queries can be systematically represented by sets of elementary building blocks. We leverage this typology to develop new query estimation methods based on beam search, importance sampling, and hybrids. Across four large-scale sequence datasets from different application domains, as well as for the GPT-2 language model, we demonstrate the ability to make query answering tractable for arbitrary queries in exponentially-large predictive path-spaces, and find clear differences in cost-accuracy tradeoffs between search and sampling methods.


title: AniFaceGAN: Animatable 3D-Aware Face Image Generation for Video Avatars

abstract: Although 2D generative models have made great progress in face image generation and animation, they often suffer from undesirable artifacts such as 3D inconsistency when rendering images from different camera viewpoints. This prevents them from synthesizing video animations indistinguishable from real ones. Recently, 3D-aware GANs extend 2D GANs for explicit disentanglement of camera pose by leveraging 3D scene representations. These methods can well preserve the 3D consistency of the generated images across different views, yet they cannot achieve fine-grained control over other attributes, among which facial expression control is arguably the most useful and desirable for face animation. In this paper, we propose an animatable 3D-aware GAN for multiview consistent face animation generation. The key idea is to decompose the 3D representation of the 3D-aware GAN into a template field and a deformation field, where the former represents different identities with a canonical expression, and the latter characterizes expression variations of each identity. To achieve meaningful control over facial expressions via deformation, we propose a 3D-level imitative learning scheme between the generator and a parametric 3D face model during adversarial training of the 3D-aware GAN. This helps our method achieve high-quality animatable face image generation with strong visual 3D consistency, even though trained with only unstructured 2D images. Extensive experiments demonstrate our superior performance over prior works. Project page: https://yuewuhkust.github.io/AniFaceGAN


title: Prompt Generation Networks for Input-based Adaptation of Frozen Vision Transformers

abstract: With the introduction of the transformer architecture in computer vision, increasing model scale has been demonstrated as a clear path to achieving performance and robustness gains. However, with model parameter counts reaching the billions, classical finetuning approaches are becoming increasingly limiting and even unfeasible when models become hosted as inference APIs, as in NLP. To this end, visual prompt learning, whereby a model is adapted by learning additional inputs, has emerged as a potential solution for adapting frozen and cloud-hosted models: During inference, this neither requires access to the internals of models' forward pass function, nor requires any post-processing. In this work, we propose the Prompt Generation Network (PGN) that generates high performing, input-dependent prompts by sampling from an end-to-end learned library of tokens. We further introduce the "prompt inversion" trick, with which PGNs can be efficiently trained in a latent space but deployed as strictly input-only prompts for inference. We show the PGN is effective in adapting pre-trained models to various new datasets: It surpasses previous methods by a large margin on 12/12 datasets and even outperforms full-finetuning on 5/12, while requiring 100x less parameters.


title: Against Interaction Design

abstract: Against Interaction Design is a short manifesto that distils a position that's emerged through a decade of creating interactive art. I intend it here as a provocation and a speculation on an alternative future relationship between people and machines.


title: Contrastive Multimodal Learning for Emergence of Graphical Sensory-Motor Communication

abstract: In this paper, we investigate whether artificial agents can develop a shared language in an ecological setting where communication relies on a sensory-motor channel. To this end, we introduce the Graphical Referential Game (GREG) where a speaker must produce a graphical utterance to name a visual referent object while a listener has to select the corresponding object among distractor referents, given the delivered message. The utterances are drawing images produced using dynamical motor primitives combined with a sketching library. To tackle GREG we present CURVES: a multimodal contrastive deep learning mechanism that represents the energy (alignment) between named referents and utterances generated through gradient ascent on the learned energy landscape. We demonstrate that CURVES not only succeeds at solving the GREG but also enables agents to self-organize a language that generalizes to feature compositions never seen during training. In addition to evaluating the communication performance of our approach, we also explore the structure of the emerging language. Specifically, we show that the resulting language forms a coherent lexicon shared between agents and that basic compositional rules on the graphical productions could not explain the compositional generalization.


title: Participatory Design for Mental Health Data Visualization on a Social Robot

abstract: The intersection of data visualization and human-robot interaction (HRI) is a burgeoning field. Understanding, communicating, and processing different kinds of data for creating versatile visualizations can benefit HRI. Conversely, expressing different kinds of data generated from HRI through effective visualizations can provide interesting insights. Our work adds to the literature of this growing domain. In this paper, we present our exploratory work on visualizing mental health data on a social robot. Particularly, we discuss development of mental health data visualizations using a participatory design (PD) approach. As a first step with mental health data visualization on a social robot, this work paves the way for relevant further work and using social robots as data visualization tools.


title: Who Wrote this? How Smart Replies Impact Language and Agency in the Workplace

abstract: AI-mediated communication is designed to help us do our work more quickly and efficiently. But does it come at a cost? This study uses smart replies (SRs) to show how AI influences humans without any intent on the part of the developer - the very use of AI is sufficient. I propose a loss of agency theory as a viable approach for studying the impact of AI on human agency. This theory focusses on the transfer of agency that is forced by circumstances (such as time pressure), human weaknesses (such as complacency), and conceptual priming. Mixed methods involving a crowdsourced experiment test that theory. The quantitative results reveal that machine agency affects the content we author and the behavior we generate. But it is a non-zero-sum game. The transfers between human and machine agency are fluid; they complement, replace, and reinforce each other at the same time.


title: Subject-specific quantitative susceptibility mapping using patch based deep image priors

abstract: Quantitative Susceptibility Mapping is a parametric imaging technique to estimate the magnetic susceptibilities of biological tissues from MRI phase measurements. This problem of estimating the susceptibility map is ill posed. Regularized recovery approaches exploiting signal properties such as smoothness and sparsity improve reconstructions, but suffer from over-smoothing artifacts. Deep learning approaches have shown great potential and generate maps with reduced artifacts. However, for reasonable reconstructions and network generalization, they require numerous training datasets resulting in increased data acquisition time. To overcome this issue, we proposed a subject-specific, patch-based, unsupervised learning algorithm to estimate the susceptibility map. We make the problem well-posed by exploiting the redundancies across the patches of the map using a deep convolutional neural network. We formulated the recovery of the susceptibility map as a regularized optimization problem and adopted an alternating minimization strategy to solve it. We tested the algorithm on a 3D invivo dataset and, qualitatively and quantitatively, demonstrated improved reconstructions over competing methods.


title: Inner speech recognition through electroencephalographic signals

abstract: This work focuses on inner speech recognition starting from EEG signals. Inner speech recognition is defined as the internalized process in which the person thinks in pure meanings, generally associated with an auditory imagery of own inner "voice". The decoding of the EEG into text should be understood as the classification of a limited number of words (commands) or the presence of phonemes (units of sound that make up words). Speech-related BCIs provide effective vocal communication strategies for controlling devices through speech commands interpreted from brain signals, improving the quality of life of people who have lost the capability to speak, by restoring communication with their environment. Two public inner speech datasets are analysed. Using this data, some classification models are studied and implemented starting from basic methods such as Support Vector Machines, to ensemble methods such as the eXtreme Gradient Boosting classifier up to the use of neural networks such as Long Short Term Memory (LSTM) and Bidirectional Long Short Term Memory (BiLSTM). With the LSTM and BiLSTM models, generally not used in the literature of inner speech recognition, results in line with or superior to those present in the stateof-the-art are obtained.


title: Astrometric and photometric standard candidates for the upcoming 4-m ILMT survey

abstract: The International Liquid Mirror Telescope (ILMT) is a 4-meter class survey telescope that has recently achieved first light and is expected to swing into full operations by 1st January 2023. It scans the sky in a fixed 22' wide strip centered at the declination of $+29^o21'41''$ and works in Time Delay Integration (TDI) mode. We present a full catalog of sources in the ILMT strip that can serve as astrometric calibrators. The characteristics of the sources for astrometric calibration are extracted from Gaia EDR3 as it provides a very precise measurement of astrometric properties such as RA ($\alpha$), Dec ($\delta$), parallax ($\pi$), and proper motions ($\mu_{\alpha^{*}}$ & $\mu_{\delta}$). We have crossmatched the Gaia EDR3 with SDSS DR17 and PanSTARRS-1 (PS1) and supplemented the catalog with apparent magnitudes of these sources in g, r, and i filters. We also present a catalog of spectroscopically confirmed white dwarfs with SDSS magnitudes that may serve as photometric calibrators. The catalogs generated are stored in a SQLite database for query-based access. We also report the offsets in equatorial positions compared to Gaia for an astrometrically calibrated TDI frame observed with the ILMT.


title: VR-SFT: Reproducing Swinging Flashlight Test in Virtual Reality to Detect Relative Afferent Pupillary Defect

abstract: The relative afferent asymmetry between two eyes can be diagnosed using swinging flashlight test, also known as the alternating light test. This remains one of the most used clinical tests to this day. Despite the swinging flashlight test's straightforward approach, a number of factors can add variability into the clinical methodology and reduce the measurement's validity and reliability. This includes small and poorly responsive pupils, dark iris, anisocoria, uneven illumination in both eyes. Due to these limitations, the true condition of relative afferent asymmetry may create confusion and various observers may quantify the relative afferent pupillary defect differently. Consequently, the results of the swinging flashlight test are subjective and ambiguous. In order to eliminate the limitations of traditional swinging flashlight test and introduce objectivity, we propose a novel approach to the swinging flashlight exam, VR-SFT, by making use of virtual reality (VR). We suggest that the clinical records of the subjects and the results of VR-SFT are comparable. In this paper, we describe how we exploit the features of immersive VR experience to create a reliable and objective swinging flashlight test.


title: Equi-Tuning: Group Equivariant Fine-Tuning of Pretrained Models

abstract: We introduce equi-tuning, a novel fine-tuning method that transforms (potentially non-equivariant) pretrained models into group equivariant models while incurring minimum $L_2$ loss between the feature representations of the pretrained and the equivariant models. Large pretrained models can be equi-tuned for different groups to satisfy the needs of various downstream tasks. Equi-tuned models benefit from both group equivariance as an inductive bias and semantic priors from pretrained models. We provide applications of equi-tuning on three different tasks: image classification, compositional generalization in language, and fairness in natural language generation (NLG). We also provide a novel group-theoretic definition for fairness in NLG. The effectiveness of this definition is shown by testing it against a standard empirical method of fairness in NLG. We provide experimental results for equi-tuning using a variety of pretrained models: Alexnet, Resnet, VGG, and Densenet for image classification; RNNs, GRUs, and LSTMs for compositional generalization; and GPT2 for fairness in NLG. We test these models on benchmark datasets across all considered tasks to show the generality and effectiveness of the proposed method.


title: Connecting Solar and Stellar Flares/CMEs: Expanding Heliophysics to Encompass Exoplanetary Space Weather

abstract: The aim of this white paper is to briefly summarize some of the outstanding gaps in the observations and modeling of stellar flares, CMEs, and exoplanetary space weather, and to discuss how the theoretical and computational tools and methods that have been developed in heliophysics can play a critical role in meeting these challenges. The maturity of data-inspired and data-constrained modeling of the Sun-to-Earth space weather chain provides a natural starting point for the development of new, multidisciplinary research and applications to other stars and their exoplanetary systems. Here we present recommendations for future solar CME research to further advance stellar flare and CME studies. These recommendations will require institutional and funding agency support for both fundamental research (e.g. theoretical considerations and idealized eruptive flare/CME numerical modeling) and applied research (e.g. data inspired/constrained modeling and estimating exoplanetary space weather impacts). In short, we recommend continued and expanded support for: (1.) Theoretical and numerical studies of CME initiation and low coronal evolution, including confinement of "failed" eruptions; (2.) Systematic analyses of Sun-as-a-star observations to develop and improve stellar CME detection techniques and alternatives; (3.) Improvements in data-inspired and data-constrained MHD modeling of solar CMEs and their application to stellar systems; and (4.) Encouraging comprehensive solar--stellar research collaborations and conferences through new interdisciplinary and multi-agency/division funding mechanisms.


title: Corrected thermodynamics of $(2+1)D$ black hole conformally coupled to a massless scalar

abstract: We study the corrected entropy due to thermal fluctuation and their effect on the thermodynamics of a conformally dressed black hole in three dimensions. We find that the thermal fluctuation affects the entropy significantly for small black holes. Various corrected thermodynamical variables are also calculated for this black hole. We observe that thermal fluctuation on the thermodynamics of a small conformal black hole has a significant effect. We also analyse the stability of black hole under the effect of thermal fluctuation. Due to thermal fluctuation, instability occurs in the system of small conformal black holes. Isothermal compressibility is also studied for this black hole which diverges for the equilibrium state of the system.


title: Attention-Based Generative Neural Image Compression on Solar Dynamics Observatory

abstract: NASA's Solar Dynamics Observatory (SDO) mission gathers 1.4 terabytes of data each day from its geosynchronous orbit in space. SDO data includes images of the Sun captured at different wavelengths, with the primary scientific goal of understanding the dynamic processes governing the Sun. Recently, end-to-end optimized artificial neural networks (ANN) have shown great potential in performing image compression. ANN-based compression schemes have outperformed conventional hand-engineered algorithms for lossy and lossless image compression. We have designed an ad-hoc ANN-based image compression scheme to reduce the amount of data needed to be stored and retrieved on space missions studying solar dynamics. In this work, we propose an attention module to make use of both local and non-local attention mechanisms in an adversarially trained neural image compression network. We have also demonstrated the superior perceptual quality of this neural image compressor. Our proposed algorithm for compressing images downloaded from the SDO spacecraft performs better in rate-distortion trade-off than the popular currently-in-use image compression codecs such as JPEG and JPEG2000. In addition we have shown that the proposed method outperforms state-of-the art lossy transform coding compression codec, i.e., BPG.


title: Real World Offline Reinforcement Learning with Realistic Data Source

abstract: Offline reinforcement learning (ORL) holds great promise for robot learning due to its ability to learn from arbitrary pre-generated experience. However, current ORL benchmarks are almost entirely in simulation and utilize contrived datasets like replay buffers of online RL agents or sub-optimal trajectories, and thus hold limited relevance for real-world robotics. In this work (Real-ORL), we posit that data collected from safe operations of closely related tasks are more practical data sources for real-world robot learning. Under these settings, we perform an extensive (6500+ trajectories collected over 800+ robot hours and 270+ human labor hour) empirical study evaluating generalization and transfer capabilities of representative ORL methods on four real-world tabletop manipulation tasks. Our study finds that ORL and imitation learning prefer different action spaces, and that ORL algorithms can generalize from leveraging offline heterogeneous data sources and outperform imitation learning. We release our dataset and implementations at URL: https://sites.google.com/view/real-orl


title: Field theory approach to eigenstate thermalization in random quantum circuits

abstract: We use field-theoretic methods to explore the statistics of eigenfunctions of the Floquet operator for a large family of Floquet random quantum circuits. The correlation function of the quasienergy eigenstates is calculated and shown to exhibit random matrix circular unitary ensemble statistics, which is consistent with the analogue of Berry's conjecture for quantum circuits. This quantity determines all key metrics of quantum chaos, such as the spectral form factor and thermalizing time-dependence of the expectation value of an arbitrary observable. It also allows us to explicitly show that the matrix elements of local operators satisfy the eigenstate thermalization hypothesis (ETH); i.e., the variance of the off-diagonal matrix elements of such operators is exponentially small in the system size. These results represent a proof of ETH for the family of Floquet random quantum circuits at a physical level of rigor. An outstanding open question for this and most of other sigma-model calculations is a mathematically rigorous proof of the validity of the saddle-point approximation in the large-N limit.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech hep-th math-ph math.MP


title: On the Sensitivity of Spin-Precession Axion Experiments

abstract: A leading direction in the hunt for axion dark matter is to search for its influence on nuclear spins. The detection scheme involves polarizing a sample of nuclei within a strong static magnetic field and then looking for a spin precession induced by the oscillating axion field. We study the axion signal and background contributions that arise in such experiments (a prominent example being CASPEr), finding key differences with the existing literature. Most importantly, in the limit where the transverse spin-relaxation time of the material is the largest timescale of the problem, we show that the induced signal continues to grow even beyond the coherence time of the axion field. As a result, we find that spin-precession instruments are much more sensitive than what has been previously estimated in a sizable range of axion masses, with sensitivity improvement of up to a factor of 100 at an axion mass of 100 neV using a Xenon-129 sample. This improves the detection prospects for the QCD axion, and we estimate the experimental requirements to reach this motivated target. Our results apply to both the axion electric and magnetic dipole moment operators.


title: PAH emission from star-forming galaxies in JWST mid-infrared imaging of the lensing cluster SMACS J0723.3$-$7327

abstract: The mid-infrared spectra of star-forming galaxies (SFGs) are characterized by characteristic broad PAH emission features at 3-20 $\mu$m. As these features are redshifted, they are predicted to dominate the flux at specific mid-infrared wavelengths, leading to substantial redshift-dependent color variations in broad-band photometry. The advent of JWST for the first time allows the study of this effect for normal SFGs. Based on spectral energy distribution templates, we here present tracks in mid-infrared (4.4, 7.7, 10, 15, and 18 $\mu$m) color-color diagrams describing the redshift dependence of SFG colors. In addition, we present simulated color-color diagrams by populating these tracks using the cosmic star-formation history and the star-formation rate function. Depending on redshift, we find that SFGs stand out in the color-color diagrams by several magnitudes. We provide the first observational demonstration of this effect for galaxies detected in the JWST Early Release Observations of the field towards the lensing cluster SMACS J0723.3$-$7327. While the distribution of detected galaxies is consistent with the simulations, the numbers are substantially boosted by lensing effects. The PAH emitter with the highest spectroscopic redshift, detected in all bands, is a multiply-imaged galaxy at $z=1.45$. There is also a substantial number of cluster members, which do not exhibit PAH emission, except for one SFG at $z=0.38$. Future wider-field observations will further populate mid-infrared color-color diagrams and provide insight into the evolution of typical SFGs.


title: Non-BPS Bubbling Geometries in AdS$_3$

abstract: We construct large classes of non-BPS smooth horizonless geometries that are asymptotic to AdS$_3\times$S$^3\times$T$^4$ in type IIB supergravity. These geometries are supported by electromagnetic flux corresponding to D1-D5 charges. We show that Einstein equations for systems with eight commuting Killing vectors decompose into a set of Ernst equations, thereby admitting an integrable structure. This feature, which can a priori be applied to other AdS$_D\times\mathcal{C}$ settings in supergravity, allows us to use solution-generating techniques associated with the Ernst formalism. We explicitly derive solutions by applying the charged Weyl formalism that we have previously developed. These are sourced internally by a chain of bolts that correspond to regions where the orbits of the commuting Killing vectors collapse smoothly. We show that these geometries can be interpreted as non-BPS T$^4$ and S$^3$ deformations on global AdS$_3\times$S$^3\times$T$^4$ that are located at the center of AdS$_3$. These non-BPS deformations can be made arbitrarily small and should therefore correspond to non-supersymmetric operators in the D1-D5 CFT. Finally, we also construct interesting bound states of non-extremal BTZ black holes connected by regular bolts.


title: Fast gradient estimation for variational quantum algorithms

abstract: Many optimization methods for training variational quantum algorithms are based on estimating gradients of the cost function. Due to the statistical nature of quantum measurements, this estimation requires many circuit evaluations, which is a crucial bottleneck of the whole approach. We propose a new gradient estimation method to mitigate this measurement challenge and reduce the required measurement rounds. Within a Bayesian framework and based on the generalized parameter shift rule, we use prior information about the circuit to find an estimation strategy that minimizes expected statistical and systematic errors simultaneously. We demonstrate that this approach can significantly outperform traditional gradient estimation methods, reducing the required measurement rounds by up to an order of magnitude for a common QAOA setup. Our analysis also shows that an estimation via finite differences can outperform the parameter shift rule in terms of gradient accuracy for small and moderate measurement budgets.


title: Unveiling the formation of NGC 2915 with MUSE: A counter-rotating stellar disk embedded in a disordered gaseous environment

abstract: NGC 2915 is a unique nearby galaxy that is classified as an isolated blue compact dwarf based on its optical appearance but has an extremely extended H i gas disk with prominent Sd-type spiral arms. To unveil the starburst-triggering mystery of NGC 2915, we performed a comprehensive analysis of deep VLT/MUSE integral field spectroscopic observations that cover the star-forming region in the central kiloparsec of the galaxy. We find that episodes of bursty star formation have recurred in different locations throughout the central region, and the most recent one peaked around 50 Myr ago. The bursty star formation has significantly disturbed the kinematics of the ionized gas but not the neutral atomic gas, which implies that the two gas phases are largely spatially decoupled along the line of sight. No evidence for an active galactic nucleus is found based on the classical line-ratio diagnostic diagrams. The ionized gas metallicities have a positive radial gradient, which confirms the previous study based on several individual H ii regions and may be attributed to both the stellar feedback-driven outflows and metal-poor gas inflow. Evidence for metal-poor gas infall or inflow includes discoveries of high-speed collisions between gas clouds of different metallicities, localized gas metallicity drops and unusually small metallicity differences between gas and stars. The central stellar disk appears to be counter-rotating with respect to the extended H i disk, implying that the recent episodes of bursty star formation have been sustained by externally accreted gas.


title: The Value-Added Catalog of ASAS-SN Eclipsing Binaries II: Properties of Extra-Physics Systems

abstract: Detached eclipsing binaries are the primary tool used to measure precise masses and radii of stars. In our previous paper estimating the parameters of more than 30,000 detached eclipsing binaries, we identified 766 eclipsing binaries with additional features in their All-Sky Automated Survey for Supernovae (ASAS-SN) and Transiting Exoplanet Survey Satellite (TESS) light curves. Here, we characterize these "extra-physics" systems, identifying eclipsing binaries with spotted stars, pulsating components, and candidate triple/quadruple systems. We use the Gaia, ATLAS, ZTF, and ASAS-SN variable star catalogs to consider possible blends. We use MIST isochrones and evolutionary tracks to identify systems with main sequence, subgiant, and giant primaries and highlight systems in sparsely populated regions of the color-magnitude diagram. We find that the orbital period distribution of spotted binaries is divided by evolutionary state and find 68 with X-ray detections. For the candidate triple/quadruples and pulsating systems, we calculate the extra orbital/pulsational period and identify systems with resonances. Finally, we highlight a number of exotic systems, including eclipsing CVs, subdwarfs, and binaries with disks.


title: Freezing In Vector Dark Matter Through Magnetic Dipole Interactions

abstract: We study a simple model of vector dark matter that couples to Standard Model particles via magnetic dipole interactions. In this scenario, the cosmological abundance arises through the freeze-in mechanism and depends on the dipole coupling, the vector mass, and the reheat temperature. To ensure cosmological metastability, the vector must be lighter than the fermions to which it couples, but rare decays can still produce observable 3$\gamma$ final states; two-body decays can also occur at one-loop with additional weak suppression, but are subdominant if the vector couples mainly to light fermions. For sufficiently heavy vectors, induced kinetic mixing with the photon can also yield additional two body decays to lighter fermions and predict indirect detection signals through final state radiation. We explore the implications of couplings to various flavors of visible particles and emphasize leptophilic dipoles involving electrons, muons, and taus, which offer the most promising indirect detection signatures through 3$\gamma$, $e^+ e^- \gamma$, and $\mu^+ \mu^- \gamma$ decay channels. We also present constraints from current and past telescopes, and sensitivity projections for future missions including e-ASTROGAM and AMEGO.


title: Elliptic homogenization from qualitative to quantitative

abstract: We give a self-contained introduction of the theory of elliptic homogenization for random coefficient fields, starting from classical qualitative homogenization. Our exposition of the quantitative theory is greatly compressed and much more readable compared to what has appeared previously. Our presentation also contains new results, such as optimal estimates (both in terms of stochastic moments and scaling of the error) for coefficient fields which are local functions of Gaussian random fields.


title: Suppression of $1/f$ noise in quantum simulators of gauge theories

abstract: In the current drive to quantum-simulate evermore complex gauge-theory phenomena, it is necessary to devise schemes allowing for the control and suppression of unavoidable gauge-breaking errors on different experimental platforms. Although there have been several successful approaches to tackle coherent errors, comparatively little has been done in the way of decoherence. By numerically solving the corresponding Bloch--Redfield equations, we show that the recently developed method of \textit{linear gauge protection} suppresses the growth of gauge violations due to $1/f^\beta$ noise as $1/V^\beta$, where $V$ is the protection strength and $\beta>0$, in Abelian lattice gauge theories, as we show through exemplary results for $\mathrm{U}(1)$ quantum link models and $\mathbb{Z}_2$ lattice gauge theories. We support our numerical findings with analytic derivations through time-dependent perturbation theory. Our findings are of immediate applicability in modern analog quantum simulators and digital NISQ devices.

categories: quant-ph cond-mat.quant-gas cond-mat.str-el hep-lat


title: The Migdal Effect in Semiconductors for Dark Matter with Masses below $\sim \,$100 MeV

abstract: Dark matter scattering off a nucleus has a small probability of inducing an observable ionization through the inelastic excitation of an electron, called the Migdal effect. We use an effective field theory to extend the computation of the Migdal effect in semiconductors to regions of small momentum transfer to the nucleus, where the final state of the nucleus is no longer well described by a plane wave. Our analytical result can be fully quantified by the measurable dynamic structure factor of the semiconductor, which accounts for the vibrational degrees of freedom (phonons) in a crystal. We show that, due to the sum rules obeyed by the structure factor, the inclusive Migdal rate and the shape of the electron recoil spectrum is well captured by approximating the nuclei in the crystal as free ions; however, the exclusive differential rate with respect to energy depositions to the crystal depends on the phonon dynamics encoded in the dynamic structure function of the specific material. Our results now allow the Migdal effect in semiconductors to be evaluated even for the lightest dark matter candidates ($m_\chi \gtrsim 1$ MeV) that can kinematically excite electrons.


title: Tidal perturbations and eclipse mapping in the pulsations in the hierarchical triple system U~Gru

abstract: Context. Unambiguous examples of the influence of tides on self-excited, free stellar pulsations have recently been observationally detected in space-based photometric data. Aims. We aim to investigate U Gru and contextualise it within the growing class of tidally influenced pulsators. Initial analysis of U Gru revealed frequencies spaced by the orbital frequency that are difficult to explain by currently proposed tidal mechanisms. Methods. We re-investigate the TESS photometry of U Gru alongside new uves spectroscopy. We analyse the uves spectroscopy with least-squares deconvolution and spectral disentangling techniques, and perform an atmospheric analysis. We remove the binary signature from the light curve using an effective model in order to investigate the pulsation signal in the residuals. We track the amplitudes and phases of the residual pulsations as a function of the orbital period to reveal their tidal influence. Results. We establish that U Gru is likely a hierarchical triple system. We identify a single p mode oscillation to exhibit amplitude and phase variation over the binary orbit. We propose a toy model to demonstrate that the series of frequencies separated by the orbital frequency can be reproduced by eclipse mapping. We find no evidence of modulation to the other independent oscillation modes. Conclusions. We demonstrate that U Gru hosts at least one tidally perturbed pulsation. Additionally we argue that eclipse mapping of the dominant, tidally perturbed mode can produce the series of frequencies separated by the observed orbital frequency. Our simulations show that the effects of eclipse mapping are mode dependent, and are not expected to produce an observable signature for all pulsation modes in an eclipse binary.


title: The ASAS-SN Bright Supernova Catalog -- V. 2018-2020

abstract: We catalog the 443 bright supernovae discovered by the All-Sky Automated Survey for Supernovae (ASAS-SN) in $2018-2020$ along with the 519 supernovae recovered by ASAS-SN and 516 additional $m_{peak}\leq18$ mag supernovae missed by ASAS-SN. Our statistical analysis focuses primarily on the 984 supernovae discovered or recovered in ASAS-SN $g$-band observations. The complete sample of 2427 ASAS-SN supernovae includes earlier $V$-band samples and unrecovered supernovae. For each supernova, we identify the host galaxy, its UV to mid-IR photometry, and the offset of the supernova from the center of the host. Updated light curves, redshifts, classifications, and host galaxy identifications supersede earlier results. With the increase of the limiting magnitude to $g\leq18$ mag, the ASAS-SN sample is roughly complete up to $m_{peak}=16.7$ mag and is $90\%$ complete for $m_{peak}\leq17.0$ mag. This is an increase from the $V$-band sample where it was roughly complete up to $m_{peak}=16.2$ mag and $70\%$ complete for $m_{peak}\leq17.0$ mag.


title: Cloudy with A Chance of Rain: Accretion Braking of Cold Clouds

abstract: Understanding the survival, growth and dynamics of cold gas is fundamental to galaxy formation. While there has been a plethora of work on `wind tunnel' simulations that study such cold gas in winds, the infall of this gas under gravity is at least equally important, and fundamentally different since cold gas can never entrain. Instead, velocity shear increases and remains unrelenting. If these clouds are growing, they can experience a drag force due to the accretion of low momentum gas, which dominates over ram pressure drag. This leads to sub-virial terminal velocities, in line with observations. We develop simple analytic theory and predictions based on turbulent radiative mixing layers. We test these scalings in 3D hydrodynamic simulations, both for an artificial constant background, as well as a more realistic stratified background. We find that the survival criterion for infalling gas is more stringent than in a wind, requiring that clouds grow faster than they are destroyed ($t_{\rm grow} < 4\,t_{\rm cc} $). This can be translated to a critical pressure, which for Milky Way like conditions is $P \sim 3000 {\rm k}_B {\rm K}\,{\rm cm}^{-3}$ . Cold gas which forms via linear thermal instability ($t_{\rm cool}/t_{\rm ff} < 1$) in planar geometry meets the survival threshold. In stratified environments, larger clouds need only survive infall until cooling becomes effective. We discuss applications to high velocity clouds and filaments in galaxy clusters.


title: Open-system spin transport and operator weight dissipation in spin chains

abstract: We use non-equilibrium steady states to study the effect of dissipation-assisted operator evolution (DAOE) on the scaling behavior of transport in one-dimensional spin chains. We consider three models in the XXZ family: the XXZ model with staggered anisotropy, which is chaotic; XXZ model with no external field and tunable interaction, which is Bethe ansatz integrable and (in the zero interaction limit) free fermion integrable; and the disordered XY model, which is free-fermion integrable and Anderson localized. We find evidence that DAOE's effect on transport is controlled by its effect on the system's conserved quantities. To the extent that DAOE preserves those symmetries, it preserves the scaling of the system's transport properties; to the extent it breaks those conserved quantities, it pushes the system towards diffusive scaling of transport.


title: Flag Integrable Models and Generalized Graded Algebras

abstract: We introduce new classes of integrable models that exhibit a structure similar to that of flag vector spaces. We present their Hamiltonians, R-matrices and Bethe-ansatz solutions. These models have a new type of generalized graded algebra symmetry.


title: SUMBot: Summarizing Context in Open-Domain Dialogue Systems

abstract: In this paper, we investigate the problem of including relevant information as context in open-domain dialogue systems. Most models struggle to identify and incorporate important knowledge from dialogues and simply use the entire turns as context, which increases the size of the input fed to the model with unnecessary information. Additionally, due to the input size limitation of a few hundred tokens of large pre-trained models, regions of the history are not included and informative parts from the dialogue may be omitted. In order to surpass this problem, we introduce a simple method that substitutes part of the context with a summary instead of the whole history, which increases the ability of models to keep track of all the previous relevant information. We show that the inclusion of a summary may improve the answer generation task and discuss some examples to further understand the system's weaknesses.


title: Operator spectroscopy for 4d SCFTs with a=c

abstract: We study a rich set of four-dimensional superconformal field theories (SCFTs) with both central charges identical: $a = c$. These are constructed via the diagonal $\mathcal{N}=2$ or $\mathcal{N}=1$ gauging of the flavor symmetry $G$ of a collection of $\mathcal{N}=2$ Argyres-Douglas theories of type $\mathcal{D}_p(G)$, with or without adjoint chiral multiplets, in arXiv:2106.12579 and arXiv:2111.12092. We compute superconformal indices of some theories where the rank of $G$ is low, performing a refined test for unitarity, and further determine the relevant and marginal operator content in detail. We find that most of these theories flow to interacting SCFTs with $a=c$ in the infrared.


title: The local dark matter distribution in self-interacting dark matter halos

abstract: We study the effects of dark matter self-interactions on the local dark matter distribution in selected Milky Way-like galaxies in the EAGLE hydrodynamical simulations. The simulations were run with two different self-interacting dark matter models, a constant and velocity-dependent self-interaction cross-section. We find that the local dark matter velocity distribution of the Milky Way-like halos in the simulations with dark matter self-interactions and baryons are generally similar to those extracted from cold collisionless dark matter simulations with baryons. In both cases, the local dark matter speed distributions agree well with their best fit Maxwellian distributions. Including baryons in the simulations with or without dark matter self-interactions increases the local dark matter density and shifts the dark matter speed distributions to higher speeds. To study the implications for direct detection, we compute the dark matter halo integrals obtained directly from the simulations and compare them to those obtained from the best fit Maxwellian velocity distribution. We find that a Maxwellian distribution provides a good fit to the halo integrals of most halos, without any significant difference between the results of different dark matter self-interaction models.


title: JWST Imaging of the Cartwheel Galaxy Reveals Dust Associated with SN 2021afdx

abstract: We present near- and mid-infrared (0.9-18 $\mu$m) photometry of supernova (SN) 2021afdx, which was imaged serendipitously with the James Webb Space Telescope (JWST) as part of its Early Release Observations of the Cartwheel Galaxy. Our ground-based optical observations show it is likely to be a Type IIb SN, the explosion of a yellow supergiant, and its infrared spectral energy distribution (SED) $\approx$200 days after explosion shows two distinct components, which we attribute to hot ejecta and warm dust. By fitting models of dust emission to the SED, we derive a dust mass of $(3.8_{-0.3}^{+0.5}) \times 10^{-3}\ M_\odot$, which is the highest yet observed in a Type IIb SN but consistent with other Type II SNe observed by the Spitzer Space Telescope. We also find that the radius of the dust is significantly larger than the radius of the ejecta, as derived from spectroscopic velocities during the photospheric phase, which implies that we are seeing an infrared echo off of preexisting dust in the progenitor environment, rather than dust newly formed by the SN. Our results show the power of JWST to address questions of dust formation in SNe, and therefore the presence of dust in the early universe, with much larger samples than have been previously possible.


title: Determining the spin of light primordial black holes with Hawking radiation

abstract: We propose a method to determine the mass and spin of primordial black holes (PBHs) in the mass range $5\times 10^7-10^{12}$ kg (Hawking temperatures $\sim10$ MeV $-200$ GeV), based on measuring the energy of specific features in the photon Hawking emission spectrum, including both primary and secondary components. This is motivated by scenarios where PBHs in this mass range spin up as they evaporate, namely the string axiverse, where dimensionless spin parameters $\tilde{a}\sim 0.1-0.5$ can be achieved through the Hawking emission of hundreds or even thousands of light axion-like particles. Measuring the present PBH mass-spin distribution may thus be an important probe of physics beyond the Standard Model. Since the proposed method relies on the energy of the photons emitted by a given PBH, rather than on the associated flux, it is independent of the PBH-Earth distance and, as a byproduct, can also be used to infer the latter.


title: Robust Action Segmentation from Timestamp Supervision

abstract: Action segmentation is the task of predicting an action label for each frame of an untrimmed video. As obtaining annotations to train an approach for action segmentation in a fully supervised way is expensive, various approaches have been proposed to train action segmentation models using different forms of weak supervision, e.g., action transcripts, action sets, or more recently timestamps. Timestamp supervision is a promising type of weak supervision as obtaining one timestamp per action is less expensive than annotating all frames, but it provides more information than other forms of weak supervision. However, previous works assume that every action instance is annotated with a timestamp, which is a restrictive assumption since it assumes that annotators do not miss any action. In this work, we relax this restrictive assumption and take missing annotations for some action instances into account. We show that our approach is more robust to missing annotations compared to other approaches and various baselines.


title: Evolution of ${4\pi}$-periodic Supercurrent in the Presence of In-plane Magnetic Field

abstract: In the presence of a 4$\pi$-periodic contribution to the current phase relation, for example in topological Josephson junctions, odd Shapiro steps are expected to be missing. While missing odd Shapiro steps have been observed in several material systems and interpreted in the context of topological superconductivity, they have also been observed in topologically trivial junctions. Here, we study the evolution of such trivial missing odd Shapiro steps in Al-InAs junctions in the presence of an in-plane magnetic field $B^{\theta}$. We find that the odd steps reappear at a crossover $B^{\theta}$ value, exhibiting an in-plane field angle anisotropy that depends on spin-orbit coupling effects. We interpret this behavior by theoretically analyzing the Andreev bound state spectrum and the transitions induced by the non-adiabatic dynamics of the junction. Our results highlight the complex phenomenology of missing Shapiro steps and the underlying current phase relations in planar Josephson junctions designed to realize Majorana states.


title: Novae in M51: a New, Much Higher Rate from Multi-epoch HST Data

abstract: Accurate determination of the rates of nova eruptions in different kinds of galaxies give us strong constraints on those galaxies' underlying white dwarf and binary populations, and those stars' spatial distributions. Until 2016, limitations inherent in ground-based surveys of external galaxies - and dust extinction in the Milky Way - significantly hampered the determination of those rates and how much they differ between different types of galaxies. Infrared Galactic surveys and dense cadence Hubble Space Telescope (HST)-based surveys are overcoming these limitations, leading to sharply increased nova-in-galaxy rates relative to those previously claimed. Here we present 14 nova candidates that were serendipitously observed during a year-long HST survey of the massive spiral galaxy M51 (the "Whirlpool Galaxy"). We use simulations based on observed nova light curves to model the incompleteness of the HST survey in unprecedented detail, determining a nova detection efficiency $\epsilon = 20.3$ percent. The survey's M51 area coverage, combined with $\epsilon$, indicates a conservative M51 nova rate of $172^{+46}_{-37}$ novae yr$^{-1}$, corresponding to a luminosity-specific nova rate (LSNR) of $\sim10.4^{+2.8}_{-2.2}$ novae yr$^{-1}$/$10^{10} L_{\odot,K}$. Both these rates are approximately an order of magnitude higher than those estimated by ground-based studies, contradicting claims of universal low nova rates in all types of galaxies determined by low cadence, ground-based surveys. They demonstrate that, contrary to theoretical models, the HST-determined LSNR in a giant elliptical galaxy (M87) and a giant spiral galaxy (M51) likely do not differ by an order of magnitude or more, and may in fact be quite similar.


title: Lyman-alpha Emitters in Ionized Bubbles: Constraining the Environment and Ionized Fraction

abstract: Lyman-alpha emitters (LAEs) are excellent probes of the reionization process, as they must be surrounded by large ionized bubbles in order to be visible during the reionization era. Large ionized regions are thought to correspond to over-dense regions and may be protoclusters, making them interesting test-beds for early massive structures. Close associations containing several LAEs are often assumed to mark over-dense, ionized bubbles. Here, we develop the first framework to quantify the ionization and density fields of high-z galaxy associations. We explore the interplay between (i) the large-scale density of a survey field, (ii) Poisson noise due to the small number density of bright sources at high redshifts (z~7), and (iii) the effects of the ionized fraction on the observation of LAEs. We use Bayesian statistics, a simple model of reionization, and a Monte-Carlo simulation to construct a more comprehensive method for calculating the large-scale density of LAE regions than previous works. We find that Poisson noise has a strong effect on the inferred density of a region and show how the ionized fraction can be inferred. We then apply our framework to the strongest association yet identified: Hu et al. (2021) found 14 LAEs in a volume of ~50,000 cMpc^3 inside the COSMOS field at z~7. We show that this is most likely a 2.5-sigma over-density inside of an ionized or nearly ionized bubble. We also show that this LAE association implies that the global ionized fraction is Q = 0.60 (+0.08,-0.09), within the context of a simple reionization model.


title: About some generalizations trigonometric splines

abstract: Methods of constructing trigonometric fundamental splines with constant sign and sign-changing convergence factors are given. An example and graphics illustrating the concepts of convergence and interpolation grids are given. Some methods of constructing constant-sign and sign-changing coefficients of convergence of trigonometric splines are considered.


title: Local spectroscopy of a gate-switchable moir\'e quantum anomalous Hall insulator

abstract: In recent years, correlated insulating states, unconventional superconductivity, and topologically non-trivial phases have all been observed in several moir\'e heterostructures. However, understanding of the physical mechanisms behind these phenomena is hampered by the lack of local electronic structure data. Here, we use scanning tunnelling microscopy and spectroscopy to demonstrate how the interplay between correlation, topology, and local atomic structure determines the behaviour of electron-doped twisted monolayer-bilayer graphene. Through gate- and magnetic field-dependent measurements, we observe local spectroscopic signatures indicating a quantum anomalous Hall insulating state with a total Chern number of $\pm 2$ at a doping level of three electrons per moir\'e unit cell. We show that the sign of the Chern number and associated magnetism can be electrostatically switched only over a limited range of twist angle and sample hetero-strain values. This results from a competition between the orbital magnetization of filled bulk bands and chiral edge states, which is sensitive to strain-induced distortions in the moir\'e superlattice.


title: Better Approximation for Interdependent SOS Valuations

abstract: Submodular over signal (SOS) defines a family of interesting functions for which there exist truthful mechanisms with constant approximation to the social welfare for agents with interdependent valuations. The best-known truthful auction is of $4$-approximation and a lower bound of 2 was proved. We propose a new and simple truthful mechanism to achieve an approximation ratio of 3.315.


title: Superconductivity from a melted insulator

abstract: Quantum phase transitions typically result in a broadened critical or crossover region at nonzero temperature. Josephson arrays are a model of this phenomenon, exhibiting a superconductor-insulator transition at a critical wave impedance, and a well-understood insulating phase. Yet high-impedance arrays used in quantum computing and metrology apparently evade this transition, displaying superconducting behavior deep into the nominally insulating regime. The absence of critical behavior in such devices is not well understood. Here we show that, unlike the typical quantum-critical broadening scenario, in Josephson arrays temperature dramatically shifts the critical region. This shift leads to a regime of superconductivity at high temperature, arising from the melted zero-temperature insulator. Our results quantitatively explain the low-temperature onset of superconductivity in nominally insulating regimes, and the transition to the strongly insulating phase. We further present, to our knowledge, the first understanding of the onset of anomalous-metallic resistance saturation. This work demonstrates a non-trivial interplay between thermal effects and quantum criticality. A practical consequence is that, counterintuitively, the coherence of high-impedance quantum circuits is expected to be stabilized by thermal fluctuations.


title: Understanding Impacts of Task Similarity on Backdoor Attack and Detection

abstract: With extensive studies on backdoor attack and detection, still fundamental questions are left unanswered regarding the limits in the adversary's capability to attack and the defender's capability to detect. We believe that answers to these questions can be found through an in-depth understanding of the relations between the primary task that a benign model is supposed to accomplish and the backdoor task that a backdoored model actually performs. For this purpose, we leverage similarity metrics in multi-task learning to formally define the backdoor distance (similarity) between the primary task and the backdoor task, and analyze existing stealthy backdoor attacks, revealing that most of them fail to effectively reduce the backdoor distance and even for those that do, still much room is left to further improve their stealthiness. So we further design a new method, called TSA attack, to automatically generate a backdoor model under a given distance constraint, and demonstrate that our new attack indeed outperforms existing attacks, making a step closer to understanding the attacker's limits. Most importantly, we provide both theoretic results and experimental evidence on various datasets for the positive correlation between the backdoor distance and backdoor detectability, demonstrating that indeed our task similarity analysis help us better understand backdoor risks and has the potential to identify more effective mitigations.


title: Unscented Kalman Filtering on Manifolds for AUV Navigation -- Experimental Results

abstract: In this work, we present an aided inertial navigation system for an autonomous underwater vehicle (AUV) using an unscented Kalman filter on manifolds (UKF-M). The inertial navigation estimate is aided by a Doppler velocity log (DVL), depth sensor, acoustic range and, while on the surface, GPS. The sensor model for each navigation sensor on the AUV is explicitly described, including compensation for lever arm offsets between the IMU and each sensor. Additionally, an outlier rejection step is proposed to reject measurement outliers that would degrade navigation performance. The UKF-M for AUV navigation is implemented for real-time navigation on the Virginia Tech 690 AUV and validated in the field. Finally, by post-processing the navigation sensor data, we show experimentally that the UKF-M is able to converge to the correct heading in the presence of arbitrarily large initial heading error.


title: Evaluated CMI Bounds for Meta Learning: Tightness and Expressiveness

abstract: Recent work has established that the conditional mutual information (CMI) framework of Steinke and Zakynthinou (2020) is expressive enough to capture generalization guarantees in terms of algorithmic stability, VC dimension, and related complexity measures for conventional learning (Harutyunyan et al., 2021, Haghifam et al., 2021). Hence, it provides a unified method for establishing generalization bounds. In meta learning, there has so far been a divide between information-theoretic results and results from classical learning theory. In this work, we take a first step toward bridging this divide. Specifically, we present novel generalization bounds for meta learning in terms of the evaluated CMI (e-CMI). To demonstrate the expressiveness of the e-CMI framework, we apply our bounds to a representation learning setting, with $n$ samples from $\hat n$ tasks parameterized by functions of the form $f_i \circ h$. Here, each $f_i \in \mathcal F$ is a task-specific function, and $h \in \mathcal H$ is the shared representation. For this setup, we show that the e-CMI framework yields a bound that scales as $\sqrt{ \mathcal C(\mathcal H)/(n\hat n) + \mathcal C(\mathcal F)/n} $, where $\mathcal C(\cdot)$ denotes a complexity measure of the hypothesis class. This scaling behavior coincides with the one reported in Tripuraneni et al. (2020) using Gaussian complexity.


title: Quantifying U-Net Uncertainty in Multi-Parametric MRI-based Glioma Segmentation by Spherical Image Projection

abstract: The projection of planar MRI data onto a spherical surface is equivalent to a nonlinear image transformation that retains global anatomical information. By incorporating this image transformation process in our proposed spherical projection-based U-Net (SPU-Net) segmentation model design, multiple independent segmentation predictions can be obtained from a single MRI. The final segmentation is the average of all available results, and the variation can be visualized as a pixel-wise uncertainty map. An uncertainty score was introduced to evaluate and compare the performance of uncertainty measurements. The proposed SPU-Net model was implemented on the basis of 369 glioma patients with MP-MRI scans (T1, T1-Ce, T2, and FLAIR). Three SPU-Net models were trained to segment enhancing tumor (ET), tumor core (TC), and whole tumor (WT), respectively. The SPU-Net model was compared with (1) the classic U-Net model with test-time augmentation (TTA) and (2) linear scaling-based U-Net (LSU-Net) segmentation models in terms of both segmentation accuracy (Dice coefficient, sensitivity, specificity, and accuracy) and segmentation uncertainty (uncertainty map and uncertainty score). The developed SPU-Net model successfully achieved low uncertainty for correct segmentation predictions (e.g., tumor interior or healthy tissue interior) and high uncertainty for incorrect results (e.g., tumor boundaries). This model could allow the identification of missed tumor targets or segmentation errors in U-Net. Quantitatively, the SPU-Net model achieved the highest uncertainty scores for three segmentation targets (ET/TC/WT): 0.826/0.848/0.936, compared to 0.784/0.643/0.872 using the U-Net with TTA and 0.743/0.702/0.876 with the LSU-Net (scaling factor = 2). The SPU-Net also achieved statistically significantly higher Dice coefficients, underscoring the improved segmentation accuracy.


title: Nearly Critical Holographic Superfluids

abstract: We study the nearly critical behaviour of holographic superfluids at finite temperature and chemical potential in their probe limit. This allows us to examine the coupled dynamics of the full complex order parameter with the charge density of the system. We derive an effective theory for the long wavelength limit of the gapless and pseudo-gapped modes by using analytic techniques in the bulk. We match our construction with Model F in the classification of Hohenberg and Halperin and compute the complex dissipative kinetic transport coefficient in terms of thermodynamics and black hole horizon data. We carry out an analysis of the corresponding modes and argue that at finite density the dispersion relations are discontinuous between the normal and the broken phase. We compare and contrast our results with earlier numerical work.


title: JWST's PEARLS: a new lens model for ACT-CL J0102$-$4915, "EL Gordo'', and the first red supergiant star at cosmological distances discovered by JWST

abstract: The first JWST data on the massive colliding cluster El Gordo confirm 23 known families of multiply lensed images and identify 8 new members of these families. Based on these families, which have been confirmed spectroscopically by MUSE, we derived an initial lens model. This model guided the identification of 37 additional families of multiply lensed galaxies, among which 28 are entirely new systems, and 9 were previously known. The initial lens model determined geometric redshifts for the 37 new systems. The geometric redshifts agree reasonably well with spectroscopic or photometric redshifts when those are available. The geometric redshifts enable two additional models that include all 60 families of multiply lensed galaxies spanning a redshift range $2<z<6$. The derived dark-matter distribution confirms the double-peak configuration of mass found by earlier work with the southern and northern clumps having similar masses. We confirm that El Gordo is the most massive known cluster at $z>0.8$ and has an estimated virial mass close the maximum mass allowed by standard cosmological models. The JWST images also reveal the presence of small-mass perturbers that produce small lensing distortions. The smallest of these is consistent with being a dwarf galaxy at $z=0.87$ and has an estimated mass of $3.8\times10^9$~\Msol, making it the smallest substructure found at $z>0.5$. The JWST images also show several candidate caustic-crossing events. One of them is detected at high significance at the expected position of the critical curve and is likely a red supergiant star at $z=2.1878$. This would be the first red supergiant found at cosmological distances. The cluster lensing should magnify background objects at $z>6$, making more of them visible than in blank fields of similar size, but there appears to be a deficiency of such objects.


title: Investigation of Core Transport Barriers in DIII-D Discharges with off-axis Te Profile Peaks

abstract: DIII-D discharges that transition to H-mode solely with off-axis electron cyclotron heating (ECH) often exhibit strong off-axis peaking of electron temperature profiles at the heating location. Electron heat transport properties near these off-axis temperature peaks have been studied using modulated ECH. The Fourier analyzed electron temperature data have been used to infer electron thermal diffusivity. Comparisons with numerical solutions of the time-dependent electron thermal equation find that the data are consistent with a narrow region with electron diffusivity $\chi_e$ an order of magnitude lower than the average value across the plasma, suggesting an electron internal transport barrier (ITB) near the ECH heating location. Detailed profile analysis and equilibrium reconstructions suggest that the formation of these ITBs are correlated with off-axis values of the safety factor $q$ being near 1. Furthermore, the ECH driven H-mode discharges demonstrate more rapid electron heating rate near the ECH deposition location than L-mode discharges with higher auxiliary ECH heating power. Additional modeling attributes this difference to the modification of electron heat transport in the core at the L-H transition, which also sustains the off-axis electron temperature peaks.


title: How to Sift Out a Clean Data Subset in the Presence of Data Poisoning?

abstract: Given the volume of data needed to train modern machine learning models, external suppliers are increasingly used. However, incorporating external data poses data poisoning risks, wherein attackers manipulate their data to degrade model utility or integrity. Most poisoning defenses presume access to a set of clean data (or base set). While this assumption has been taken for granted, given the fast-growing research on stealthy poisoning attacks, a question arises: can defenders really identify a clean subset within a contaminated dataset to support defenses? This paper starts by examining the impact of poisoned samples on defenses when they are mistakenly mixed into the base set. We analyze five defenses and find that their performance deteriorates dramatically with less than 1% poisoned points in the base set. These findings suggest that sifting out a base set with high precision is key to these defenses' performance. Motivated by these observations, we study how precise existing automated tools and human inspection are at identifying clean data in the presence of data poisoning. Unfortunately, neither effort achieves the precision needed. Worse yet, many of the outcomes are worse than random selection. In addition to uncovering the challenge, we propose a practical countermeasure, Meta-Sift. Our method is based on the insight that existing attacks' poisoned samples shifts from clean data distributions. Hence, training on the clean portion of a dataset and testing on the corrupted portion will result in high prediction loss. Leveraging the insight, we formulate a bilevel optimization to identify clean data and further introduce a suite of techniques to improve efficiency and precision. Our evaluation shows that Meta-Sift can sift a clean base set with 100% precision under a wide range of poisoning attacks. The selected base set is large enough to give rise to successful defenses.


title: Connected sum for modular operads and Beilinson-Drinfeld algebras

abstract: Modular operads relevant to string theory can be equipped with an additional structure, coming from the connected sum of surfaces. Motivated by this example, we introduce a notion of connected sum for general modular operads. We show that a connected sum induces a commutative product on the space of functions associated to the modular operad. Moreover, we combine this product with Barannikov's non-commutative Batalin-Vilkovisky structure present on this space of functions, obtaining a Beilinson-Drinfeld algebra. Finally, we study the quantum master equation using the exponential defined using this commutative product.