title: 4DHands: Reconstructing Interactive Hands in 4D with Transformers

abstract: In this paper, we introduce 4DHands, a robust approach to recovering interactive hand meshes and their relative movement from monocular inputs. Our approach addresses two major limitations of previous methods: lacking a unified solution for handling various hand image inputs and neglecting the positional relationship of two hands within images. To overcome these challenges, we develop a transformer-based architecture with novel tokenization and feature fusion strategies. Specifically, we propose a Relation-aware Two-Hand Tokenization (RAT) method to embed positional relation information into the hand tokens. In this way, our network can handle both single-hand and two-hand inputs and explicitly leverage relative hand positions, facilitating the reconstruction of intricate hand interactions in real-world scenarios. As such tokenization indicates the relative relationship of two hands, it also supports more effective feature fusion. To this end, we further develop a Spatio-temporal Interaction Reasoning (SIR) module to fuse hand tokens in 4D with attention and decode them into 3D hand meshes and relative temporal movements. The efficacy of our approach is validated on several benchmark datasets. The results on in-the-wild videos and real-world scenarios demonstrate the superior performances of our approach for interactive hand reconstruction. More video results can be found on the project page: https://4dhands.github.io.


title: CoSy: Evaluating Textual Explanations of Neurons

abstract: A crucial aspect of understanding the complex nature of Deep Neural Networks (DNNs) is the ability to explain learned concepts within their latent representations. While various methods exist to connect neurons to textual descriptions of human-understandable concepts, evaluating the quality of these explanation methods presents a major challenge in the field due to a lack of unified, general-purpose quantitative evaluation. In this work, we introduce CoSy (Concept Synthesis) -- a novel, architecture-agnostic framework to evaluate the quality of textual explanations for latent neurons. Given textual explanations, our proposed framework leverages a generative model conditioned on textual input to create data points representing the textual explanation. Then, the neuron's response to these explanation data points is compared with the response to control data points, providing a quality estimate of the given explanation. We ensure the reliability of our proposed framework in a series of meta-evaluation experiments and demonstrate practical value through insights from benchmarking various concept-based textual explanation methods for Computer Vision tasks, showing that tested explanation methods significantly differ in quality.


title: Taxonomy of Infinite Distance Limits

abstract: The Emergent String Conjecture constrains the possible types of light towers in infinite-distance limits in quantum gravity moduli spaces. In this paper, we use these constraints to restrict the geometry of the scalar charge-to-mass vectors $(-\vec{\nabla}\log m)$ of the light towers and the analogous vector $(-\vec{\nabla}\log\Lambda_{\text{QG}})$ of the species scale. We derive taxonomic rules that these vectors must satisfy in each duality frame. Under certain assumptions, this allows us to classify the ways in which different duality frames can fit together globally in the moduli space in terms of a finite list of polytopes. Many of these polytopes arise in known string theory compactifications, while others suggest either undiscovered corners of the landscape or new swampland constraints.


title: SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videos

abstract: Accurate tool tracking is essential for the success of computer-assisted intervention. Previous efforts often modeled tool trajectories rigidly, overlooking the dynamic nature of surgical procedures, especially tracking scenarios like out-of-body and out-of-camera views. Addressing this limitation, the new CholecTrack20 dataset provides detailed labels that account for multiple tool trajectories in three perspectives: (1) intraoperative, (2) intracorporeal, and (3) visibility, representing the different types of temporal duration of tool tracks. These fine-grained labels enhance tracking flexibility but also increase the task complexity. Re-identifying tools after occlusion or re-insertion into the body remains challenging due to high visual similarity, especially among tools of the same category. This work recognizes the critical role of the tool operators in distinguishing tool track instances, especially those belonging to the same tool category. The operators' information are however not explicitly captured in surgical videos. We therefore propose SurgiTrack, a novel deep learning method that leverages YOLOv7 for precise tool detection and employs an attention mechanism to model the originating direction of the tools, as a proxy to their operators, for tool re-identification. To handle diverse tool trajectory perspectives, SurgiTrack employs a harmonizing bipartite matching graph, minimizing conflicts and ensuring accurate tool identity association. Experimental results on CholecTrack20 demonstrate SurgiTrack's effectiveness, outperforming baselines and state-of-the-art methods with real-time inference capability. This work sets a new standard in surgical tool tracking, providing dynamic trajectories for more adaptable and precise assistance in minimally invasive surgeries.


title: VividDream: Generating 3D Scene with Ambient Dynamics

abstract: We introduce VividDream, a method for generating explorable 4D scenes with ambient dynamics from a single input image or text prompt. VividDream first expands an input image into a static 3D point cloud through iterative inpainting and geometry merging. An ensemble of animated videos is then generated using video diffusion models with quality refinement techniques and conditioned on renderings of the static 3D scene from the sampled camera trajectories. We then optimize a canonical 4D scene representation using an animated video ensemble, with per-video motion embeddings and visibility masks to mitigate inconsistencies. The resulting 4D scene enables free-view exploration of a 3D scene with plausible ambient scene dynamics. Experiments demonstrate that VividDream can provide human viewers with compelling 4D experiences generated based on diverse real images and text prompts.


title: Xwin-LM: Strong and Scalable Alignment Practice for LLMs

abstract: In this work, we present Xwin-LM, a comprehensive suite of alignment methodologies for large language models (LLMs). This suite encompasses several key techniques, including supervised finetuning (SFT), reward modeling (RM), rejection sampling finetuning (RS), and direct preference optimization (DPO). The key components are as follows: (1) Xwin-LM-SFT, models initially finetuned with high-quality instruction data; (2) Xwin-Pair, a large-scale, multi-turn preference dataset meticulously annotated using GPT-4; (3) Xwin-RM, reward models trained on Xwin-Pair, developed at scales of 7B, 13B, and 70B parameters; (4) Xwin-Set, a multiwise preference dataset in which each prompt is linked to 64 unique responses generated by Xwin-LM-SFT and scored by Xwin-RM; (5) Xwin-LM-RS, models finetuned with the highest-scoring responses from Xwin-Set; (6) Xwin-LM-DPO, models further optimized on Xwin-Set using the DPO algorithm. Our evaluations on AlpacaEval and MT-bench demonstrate consistent and significant improvements across the pipeline, demonstrating the strength and scalability of Xwin-LM. The repository https://github.com/Xwin-LM/Xwin-LM will be continually updated to foster community research.


title: RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text

abstract: In this work, we introduce a challenging task for simultaneously generating 3D holistic body motions and singing vocals directly from textual lyrics inputs, advancing beyond existing works that typically address these two modalities in isolation. To facilitate this, we first collect the RapVerse dataset, a large dataset containing synchronous rapping vocals, lyrics, and high-quality 3D holistic body meshes. With the RapVerse dataset, we investigate the extent to which scaling autoregressive multimodal transformers across language, audio, and motion can enhance the coherent and realistic generation of vocals and whole-body human motions. For modality unification, a vector-quantized variational autoencoder is employed to encode whole-body motion sequences into discrete motion tokens, while a vocal-to-unit model is leveraged to obtain quantized audio tokens preserving content, prosodic information, and singer identity. By jointly performing transformer modeling on these three modalities in a unified way, our framework ensures a seamless and realistic blend of vocals and human motions. Extensive experiments demonstrate that our unified generation framework not only produces coherent and realistic singing vocals alongside human motions directly from textual inputs but also rivals the performance of specialized single-modality generation systems, establishing new benchmarks for joint vocal-motion generation. The project page is available for research purposes at https://vis-www.cs.umass.edu/RapVerse.


title: OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Driving

abstract: Understanding the evolution of 3D scenes is important for effective autonomous driving. While conventional methods mode scene development with the motion of individual instances, world models emerge as a generative framework to describe the general scene dynamics. However, most existing methods adopt an autoregressive framework to perform next-token prediction, which suffer from inefficiency in modeling long-term temporal evolutions. To address this, we propose a diffusion-based 4D occupancy generation model, OccSora, to simulate the development of the 3D world for autonomous driving. We employ a 4D scene tokenizer to obtain compact discrete spatial-temporal representations for 4D occupancy input and achieve high-quality reconstruction for long-sequence occupancy videos. We then learn a diffusion transformer on the spatial-temporal representations and generate 4D occupancy conditioned on a trajectory prompt. We conduct extensive experiments on the widely used nuScenes dataset with Occ3D occupancy annotations. OccSora can generate 16s-videos with authentic 3D layout and temporal consistency, demonstrating its ability to understand the spatial and temporal distributions of driving scenes. With trajectory-aware 4D generation, OccSora has the potential to serve as a world simulator for the decision-making of autonomous driving. Code is available at: https://github.com/wzzheng/OccSora.


title: Mixed finite element methods for fourth order obstacle problems in linearised elasticity

abstract: This paper is devoted to the study of a novel mixed Finite Element Method for approximating the solutions of fourth order variational problems subjected to a constraint. The first problem we consider consists in establishing the convergence of the error of the numerical approximation of the solution of a biharmonic obstacle problem. The contents of this section are meant to generalise the approach originally proposed by Ciarlet \& Raviart, and then complemented by Ciarlet \& Glowinski. The second problem we consider amounts to studying a two-dimensional variational problem for linearly elastic shallow shells subjected to remaining confined in a prescribed half-space. We first study the case where the parametrisation of the middle surface for the linearly elastic shallow shell under consideration has non-zero curvature, and we observe that the numerical approximation of this model via a mixed Finite Element Method based on conforming elements requires the implementation of the additional constraint according to which the gradient matrix of the dual variable has to be symmetric. However, differently from the biharmonic obstacle problem previously studied, we show that the numerical implementation of this result cannot be implemented by solely resorting to Courant triangles. Finally, we show that if the middle surface of the linearly elastic shallow shell under consideration is flat, the symmetry constraint required for formulating the constrained mixed variational problem announced in the second part of the paper is not required, and the solution can thus be approximated by solely resorting to Courant triangles. The theoretical results we derived are complemented by a series of numerical experiments.


title: Visual Perception by Large Language Model's Weights

abstract: Existing Multimodal Large Language Models (MLLMs) follow the paradigm that perceives visual information by aligning visual features with the input space of Large Language Models (LLMs), and concatenating visual tokens with text tokens to form a unified sequence input for LLMs. These methods demonstrate promising results on various vision-language tasks but are limited by the high computational effort due to the extended input sequence resulting from the involvement of visual tokens. In this paper, instead of input space alignment, we propose a novel parameter space alignment paradigm that represents visual information as model weights. For each input image, we use a vision encoder to extract visual features, convert features into perceptual weights, and merge the perceptual weights with LLM's weights. In this way, the input of LLM does not require visual tokens, which reduces the length of the input sequence and greatly improves efficiency. Following this paradigm, we propose VLoRA with the perceptual weights generator. The perceptual weights generator is designed to convert visual features to perceptual weights with low-rank property, exhibiting a form similar to LoRA. The experimental results show that our VLoRA achieves comparable performance on various benchmarks for MLLMs, while significantly reducing the computational costs for both training and inference. The code and models will be made open-source.


title: MotionLLM: Understanding Human Behaviors from Human Motions and Videos

abstract: This study delves into the realm of multi-modality (i.e., video and motion modalities) human behavior understanding by leveraging the powerful capabilities of Large Language Models (LLMs). Diverging from recent LLMs designed for video-only or motion-only understanding, we argue that understanding human behavior necessitates joint modeling from both videos and motion sequences (e.g., SMPL sequences) to capture nuanced body part dynamics and semantics effectively. In light of this, we present MotionLLM, a straightforward yet effective framework for human motion understanding, captioning, and reasoning. Specifically, MotionLLM adopts a unified video-motion training strategy that leverages the complementary advantages of existing coarse video-text data and fine-grained motion-text data to glean rich spatial-temporal insights. Furthermore, we collect a substantial dataset, MoVid, comprising diverse videos, motions, captions, and instructions. Additionally, we propose the MoVid-Bench, with carefully manual annotations, for better evaluation of human behavior understanding on video and motion. Extensive experiments show the superiority of MotionLLM in the caption, spatial-temporal comprehension, and reasoning ability.


title: From Zero to Hero: Cold-Start Anomaly Detection

abstract: When first deploying an anomaly detection system, e.g., to detect out-of-scope queries in chatbots, there are no observed data, making data-driven approaches ineffective. Zero-shot anomaly detection methods offer a solution to such "cold-start" cases, but unfortunately they are often not accurate enough. This paper studies the realistic but underexplored cold-start setting where an anomaly detection model is initialized using zero-shot guidance, but subsequently receives a small number of contaminated observations (namely, that may include anomalies). The goal is to make efficient use of both the zero-shot guidance and the observations. We propose ColdFusion, a method that effectively adapts the zero-shot anomaly detector to contaminated observations. To support future development of this new setting, we propose an evaluation suite consisting of evaluation protocols and metrics.


title: Evaluating Approximations of Count Distributions and Forecasts for Poisson-Lindley Integer Autoregressive Processes

abstract: Although many time series are realizations from discrete processes, it is often that a continuous Gaussian model is implemented for modeling and forecasting the data, resulting in incoherent forecasts. Forecasts using a Poisson-Lindley integer autoregressive (PLINAR) model are compared to variations of Gaussian forecasts via simulation by equating relevant moments of the marginals of the PLINAR to the Gaussian AR. To illustrate utility, the methods discussed are applied and compared using a discrete series with model parameters being estimated using each of conditional least squares, Yule-Walker, and maximum likelihood.


title: Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image

abstract: In this work, we introduce Unique3D, a novel image-to-3D framework for efficiently generating high-quality 3D meshes from single-view images, featuring state-of-the-art generation fidelity and strong generalizability. Previous methods based on Score Distillation Sampling (SDS) can produce diversified 3D results by distilling 3D knowledge from large 2D diffusion models, but they usually suffer from long per-case optimization time with inconsistent issues. Recent works address the problem and generate better 3D results either by finetuning a multi-view diffusion model or training a fast feed-forward model. However, they still lack intricate textures and complex geometries due to inconsistency and limited generated resolution. To simultaneously achieve high fidelity, consistency, and efficiency in single image-to-3D, we propose a novel framework Unique3D that includes a multi-view diffusion model with a corresponding normal diffusion model to generate multi-view images with their normal maps, a multi-level upscale process to progressively improve the resolution of generated orthographic multi-views, as well as an instant and consistent mesh reconstruction algorithm called ISOMER, which fully integrates the color and geometric priors into mesh results. Extensive experiments demonstrate that our Unique3D significantly outperforms other image-to-3D baselines in terms of geometric and textural details.


title: Landscapes of the Octahedron

abstract: The landscapes of a polyhedron are subsets of its nets one must consider to identify all shortest paths. Landscapes of cubes and tetrahedra have been used to identify coordinate based formulas for the lengths of the shortest paths between points on these surfaces. We extend these results to develop formulas for the lengths of the shortest paths between points on the surface of octahedra.


title: Bifurcation and Local Rigidity of Homogeneous Solutions to the Yamabe Problem on Aloff-Wallach Spaces

abstract: We construct 1-parameter families of well-known solutions to the Yamabe problem defined on Aloff-Wallach Spaces to determine bifurcation instants for these homogeneous spaces by examining changes in the Morse index of these metrics as the parameter varies over the positive real numbers. A bifurcation point for such families is an accumulation point of other solutions to the Yamabe problem, while a local rigidity point is an isolated solution of this problem, i.e., it is not a bifurcation point.


title: Identifying high resolution benchmark data needs and Novel data-driven methodologies for Climate Downscaling

abstract: We address the essential role of information retrieval in enhancing climate downscaling, focusing on the need for high-resolution datasets and the application of deep learning models. We explore the requirements for acquiring detailed spatial and temporal climate data, crucial for accurate local forecasts, and discuss how deep learning (DL) techniques can significantly improve downscaling precision by modelling the complex relationships between climate variables. Additionally, we examine the specific challenges related to the retrieval of relevant climatic data, emphasizing methods for efficient data extraction and utilization to support advanced model training. This research underscores an integrated approach, combining information retrieval, deep learning, and climate science to refine the process of climate downscaling, aiming to produce more accurate and actionable local climate projections.


title: Small Language Models for Application Interactions: A Case Study

abstract: We study the efficacy of Small Language Models (SLMs) in facilitating application usage through natural language interactions. Our focus here is on a particular internal application used in Microsoft for cloud supply chain fulfilment. Our experiments show that small models can outperform much larger ones in terms of both accuracy and running time, even when fine-tuned on small datasets. Alongside these results, we also highlight SLM-based system design considerations.


title: Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Models

abstract: This paper demonstrates that pre-trained language models (PLMs) are strong foundation models for on-device meteorological variables modeling. We present LM-Weather, a generic approach to taming PLMs, that have learned massive sequential knowledge from the universe of natural language databases, to acquire an immediate capability to obtain highly customized models for heterogeneous meteorological data on devices while keeping high efficiency. Concretely, we introduce a lightweight personalized adapter into PLMs and endows it with weather pattern awareness. During communication between clients and the server, low-rank-based transmission is performed to effectively fuse the global knowledge among devices while maintaining high communication efficiency and ensuring privacy. Experiments on real-wold dataset show that LM-Weather outperforms the state-of-the-art results by a large margin across various tasks (e.g., forecasting and imputation at different scales). We provide extensive and in-depth analyses experiments, which verify that LM-Weather can (1) indeed leverage sequential knowledge from natural language to accurately handle meteorological sequence, (2) allows each devices obtain highly customized models under significant heterogeneity, and (3) generalize under data-limited and out-of-distribution (OOD) scenarios.


title: Charged particle geodesics and closed timelike curves in an electromagnetic universe

abstract: The spinning electromagnetic universe, known also as the Rotating Bertotti-Robinson(RBR) spacetime is considered as a model to represent our cosmos. The model derives from different physical considerations, such as colliding waves, throat region, and near horizon geometry of the Kerr-Newman black hole. Our interest is whether such a singularity-free spinning cosmology gives rise to a natural direction of flow, a 'chirality' for charged particles. Homochiral structures are known to be crucial for biology to start. Our concern here is cosmology rather than biology, but as in biology, the stable structures in cosmology may also rely on homochiral elements. We show the occurrence of closed timelike curves a 'la' G{\"o}del. Such curves, however, seem possible only at localized cell structures, not at large scales, but according to our prescription of near horizon geometry, they arise in the vicinity of any charged, spinning black hole.


title: Linear Function Approximation as a Computationally Efficient Method to Solve Classical Reinforcement Learning Challenges

abstract: Neural Network based approximations of the Value function make up the core of leading Policy Based methods such as Trust Regional Policy Optimization (TRPO) and Proximal Policy Optimization (PPO). While this adds significant value when dealing with very complex environments, we note that in sufficiently low State and action space environments, a computationally expensive Neural Network architecture offers marginal improvement over simpler Value approximation methods. We present an implementation of Natural Actor Critic algorithms with actor updates through Natural Policy Gradient methods. This paper proposes that Natural Policy Gradient (NPG) methods with Linear Function Approximation as a paradigm for value approximation may surpass the performance and speed of Neural Network based models such as TRPO and PPO within these environments. Over Reinforcement Learning benchmarks Cart Pole and Acrobot, we observe that our algorithm trains much faster than complex neural network architectures, and obtains an equivalent or greater result. This allows us to recommend the use of NPG methods with Linear Function Approximation over TRPO and PPO for both traditional and sparse reward low dimensional problems.


title: ADR-BC: Adversarial Density Weighted Regression Behavior Cloning

abstract: Typically, traditional Imitation Learning (IL) methods first shape a reward or Q function and then use this shaped function within a reinforcement learning (RL) framework to optimize the empirical policy. However, if the shaped reward/Q function does not adequately represent the ground truth reward/Q function, updating the policy within a multi-step RL framework may result in cumulative bias, further impacting policy learning. Although utilizing behavior cloning (BC) to learn a policy by directly mimicking a few demonstrations in a single-step updating manner can avoid cumulative bias, BC tends to greedily imitate demonstrated actions, limiting its capacity to generalize to unseen state action pairs. To address these challenges, we propose ADR-BC, which aims to enhance behavior cloning through augmented density-based action support, optimizing the policy with this augmented support. Specifically, the objective of ADR-BC shares the similar physical meanings that matching expert distribution while diverging the sub-optimal distribution. Therefore, ADR-BC can achieve more robust expert distribution matching. Meanwhile, as a one-step behavior cloning framework, ADR-BC avoids the cumulative bias associated with multi-step RL frameworks. To validate the performance of ADR-BC, we conduct extensive experiments. Specifically, ADR-BC showcases a 10.5% improvement over the previous state-of-the-art (SOTA) generalized IL baseline, CEIL, across all tasks in the Gym-Mujoco domain. Additionally, it achieves an 89.5% improvement over Implicit Q Learning (IQL) using real rewards across all tasks in the Adroit and Kitchen domains. On the other hand, we conduct extensive ablations to further demonstrate the effectiveness of ADR-BC.


title: Adapting Quantile Mapping to Bias Correct Solar Radiation Data

abstract: Bias correction is a common pre-processing step applied to climate model data before it is used for further analysis. This article introduces an efficient adaptation of a well-established bias-correction method - quantile mapping - for global horizontal irradiance (GHI) that ensures corrected data is physically plausible through incorporating measurements of clearsky GHI. The proposed quantile mapping method is fit on reanalysis data to first bias correct for regional climate models (RCMs) and is tested on RCMs forced by general circulation models (GCMs) to understand existing biases directly from GCMs. Additionally, we adapt a functional analysis of variance methodology that analyzes sources of remaining biases after implementing the proposed quantile mapping method and considered biases by climate region. This analysis is applied to four sets of climate model output from NA-CORDEX and compared against data from the National Solar Radiation Database produced by the National Renewable Energy Lab.


title: Teaching ideal quantum measurement, from dynamics to interpretation

abstract: We present a graduate course on ideal measurements, analyzed as dynamical processes of interaction between the tested system S and an apparatus A, described by quantum statistical mechanics. The apparatus A=M+B involves a macroscopic measuring device M and a bath B. The requirements for ideality of the measurement allow us to specify the Hamiltonian of the isolated compound system S+M+B. The resulting dynamical equations may be solved for simple models. Conservation laws are shown to entail two independent relaxation mechanisms: truncation and registration. Approximations, justified by the large size of M and of B, are needed. The final density matrix $\hat{\cal D}(t_f)$ of S+A has an equilibrium form. It describes globally the outcome of a large set of runs of the measurement. The measurement problem, i.e., extracting physical properties of individual runs from $\hat{\cal D}(t_f)$, then arises due to the ambiguity of its splitting into parts associated with subsets of runs. To deal with this ambiguity, we postulate that each run ends up with a distinct pointer value $A_i$ of the macroscopic M. This is compatible with the principles of quantum mechanics. Born's rule then arises from the conservation law for the tested observable; it expresses the frequency of occurrence of the final indications $A_i$ of M in terms of the initial state of S. Von Neumann's reduction amounts to updating of information due to selection of $A_i$. We advocate the terms $q$-probabilities and $q$-correlations when analyzing measurements of non-commuting observables. These ideas may be adapted to different types of courses.


title: Literature Filtering for Systematic Reviews with Transformers

abstract: Identifying critical research within the growing body of academic work is an essential element of quality research. Systematic review processes, used in evidence-based medicine, formalise this as a procedure that must be followed in a research program. However, it comes with an increasing burden in terms of the time required to identify the important articles of research for a given topic. In this work, we develop a method for building a general-purpose filtering system that matches a research question, posed as a natural language description of the required content, against a candidate set of articles obtained via the application of broad search terms. Our results demonstrate that transformer models, pre-trained on biomedical literature then fine tuned for the specific task, offer a promising solution to this problem. The model can remove large volumes of irrelevant articles for most research questions.


title: Enhancing Adversarial Robustness in SNNs with Sparse Gradients

abstract: Spiking Neural Networks (SNNs) have attracted great attention for their energy-efficient operations and biologically inspired structures, offering potential advantages over Artificial Neural Networks (ANNs) in terms of energy efficiency and interpretability. Nonetheless, similar to ANNs, the robustness of SNNs remains a challenge, especially when facing adversarial attacks. Existing techniques, whether adapted from ANNs or specifically designed for SNNs, exhibit limitations in training SNNs or defending against strong attacks. In this paper, we propose a novel approach to enhance the robustness of SNNs through gradient sparsity regularization. We observe that SNNs exhibit greater resilience to random perturbations compared to adversarial perturbations, even at larger scales. Motivated by this, we aim to narrow the gap between SNNs under adversarial and random perturbations, thereby improving their overall robustness. To achieve this, we theoretically prove that this performance gap is upper bounded by the gradient sparsity of the probability associated with the true label concerning the input image, laying the groundwork for a practical strategy to train robust SNNs by regularizing the gradient sparsity. We validate the effectiveness of our approach through extensive experiments on both image-based and event-based datasets. The results demonstrate notable improvements in the robustness of SNNs. Our work highlights the importance of gradient sparsity in SNNs and its role in enhancing robustness.


title: From Density Response to Energy Functionals and Back: An ab initio perspective on Matter Under Extreme Conditions

abstract: Energy functionals serve as the basis for different models and methods in quantum and classical many-particle physics. Arguably, one of the most successful and widely used approaches in material science at both ambient and extreme conditions is density functional theory (DFT). Various flavors of DFT methods are being actively used to study material properties at extreme conditions, such as in warm dense matter, dense plasmas, and nuclear physics applications. In this review, we focus on the warm dense matter regime, which occurs in the core of giant planets and stellar atmospheres, and as a transient state in inertial confinement fusion experiments. We discuss the connection between linear density response functions and free energy functionals as well as the utility of the linear response formalism for the construction of advanced functionals. As a new result, we derive the stiffness theorem linking the change in the intrinsic free energy to the density response properties of electrons. We review and summarize recent works that assess various exchange-correlation (XC) functionals for an inhomogeneous electron gas that is perturbed by a harmonic external field and for warm dense hydrogen using exact path integral quantum Monte Carlo data as an unassailable benchmark. This constitutes a valuable guide for selecting an appropriate XC functional for DFT calculations in the context of investigating the inhomogeneous electronic structure of warm dense matter. We stress that correctly simulating the strongly perturbed electron gas necessitates the correct UEG limit of the XC and non-interacting free-energy functionals.


title: Encryption in ghost imaging with Kronecker products of random matrices

abstract: By forming measurement matrices with the Kronecker product of two random matrices, image encryption in computational ghost imaging is investigated. The two-dimensional images are conveniently reconstructed with the pseudo-inverse matrices of the two random matrices. To suppress the noise, the method of truncated singular value decomposition can be applied to either or both of the two pseudo-inverse matrices. Further, our proposal facilitates for image encryption since more matrices can be involved in forming the measurement matrix. Two permutation matrices are inserted into the matrix sequence. The image information can only be reconstructed with the correct permutation matrices and the matrix sequence in image decryption. The experimental results show the facilitations our proposal. The technique paves the way for the practicality and flexibility of computational ghost imaging.


title: Medication Recommendation via Dual Molecular Modalities and Multi-Substructure Distillation

abstract: Medication recommendation combines patient medical history with biomedical knowledge to assist doctors in determining medication combinations more accurately and safely. Existing approaches based on molecular knowledge overlook the atomic geometric structure of molecules, failing to capture the high-dimensional characteristics and intrinsic physical properties of medications, leading to structural confusion and the inability to extract useful substructures from individual patient visits. To address these limitations, we propose BiMoRec, which overcomes the inherent lack of molecular essential information in 2D molecular structures by incorporating 3D molecular structures and atomic properties. To retain the fast response required of recommendation systems, BiMoRec maximizes the mutual information between the two molecular modalities through bimodal graph contrastive learning, achieving the integration of 2D and 3D molecular graphs, and finally distills substructures through interaction with single patient visits. Specifically, we use deep learning networks to construct a pre-training method to obtain representations of 2D and 3D molecular structures and substructures, and we use contrastive learning to derive mutual information. Subsequently, we generate fused molecular representations through a trained GNN module, re-determining the relevance of substructure representations in conjunction with the patient's clinical history information. Finally, we generate the final medication combination based on the extracted substructure sequences. Our implementation on the MIMIC-III and MIMIC-IV datasets demonstrates that our method achieves state-of-the-art performance. Compared to the next best baseline, our model improves accuracy by 1.8\% while maintaining the same level of DDI as the baseline.


title: Life history shapes variation in egg composition in the blue tit Cyanistes caeruleus

abstract: Maternal investment directly shapes early developmental conditions and therefore has longterm fitness consequences for the offspring. In oviparous species prenatal maternal investment is fixed at the time of laying. To ensure the best survival chances for most of their offspring, females must equip their eggs with the resources required to perform well under various circumstances, yet the actual mechanisms remain unknown. Here we describe the blue tit egg albumen and yolk proteomes and evaluate their potential to mediate maternal effects. We show that variation in egg composition (proteins, lipids, carotenoids) primarily depends on laying order and female age. Egg proteomic profiles are mainly driven by laying order, and investment in the egg proteome is functionally biased among eggs. Our results suggest that maternal effects on egg composition result from both passive and active (partly compensatory) mechanisms, and that variation in egg composition creates diverse biochemical environments for embryonic development.


title: A note on the dual of $L_1$ for general measure spaces

abstract: This note takes forward a comment made in Dunford and Schwartz (LInear operators, Part 1 and describes dual of $L_1$ for general measure spaces.


title: HST SHEL: Enabling Comparative Exoplanetology with HST/STIS

abstract: The Hubble Space Telescope (HST) has been our most prolific tool to study exoplanet atmospheres. As the age of JWST begins, there is a wealth of HST archival data that is useful to strengthen our inferences from JWST. Notably, HST/STIS and its 0.3-1 $\mu$m wavelength coverage extends past JWST's 0.6 $\mu$m wavelength cutoff and holds an abundance of potential information: alkali (Na, K) and molecular (TiO, VO) species opacities, aerosol information, and the presence of stellar contamination. However, time series observations with HST suffer from significant instrumental systematics and can be highly dependent on choices made during the transit fitting process. This makes comparing transmission spectra of planets with different data reduction methodologies challenging, as it is difficult to discern if an observed trend is caused by differences in data reduction or underlying physical processes. Here, we present the Sculpting Hubble's Exoplanet Legacy (SHEL) program, which aims to build a consistent data reduction and light curve analysis methodology and associated database of transmission spectra from archival HST observations. In this paper, we present the SHEL analysis framework for HST/STIS and its low-resolution spectroscopy modes, G430L and G750L. We apply our methodology to four notable hot Jupiters: WASP-39 b, WASP-121 b, WASP-69 b, and WASP-17 b, and use these examples to discuss nuances behind analysis with HST/STIS. Our results for WASP-39 b, WASP-121 b, and WASP-17 b are consistent with past publications, but our analysis of WASP-69 b differs and shows evidence of either a strong scattering slope or stellar contamination. The data reduction pipeline and tutorials are available on Github.


title: Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools

abstract: Legal practice has witnessed a sharp rise in products incorporating artificial intelligence (AI). Such tools are designed to assist with a wide range of core legal tasks, from search and summarization of caselaw to document drafting. But the large language models used in these tools are prone to "hallucinate," or make up false information, making their use risky in high-stakes domains. Recently, certain legal research providers have touted methods such as retrieval-augmented generation (RAG) as "eliminating" (Casetext, 2023) or "avoid[ing]" hallucinations (Thomson Reuters, 2023), or guaranteeing "hallucination-free" legal citations (LexisNexis, 2023). Because of the closed nature of these systems, systematically assessing these claims is challenging. In this article, we design and report on the first preregistered empirical evaluation of AI-driven legal research tools. We demonstrate that the providers' claims are overstated. While hallucinations are reduced relative to general-purpose chatbots (GPT-4), we find that the AI research tools made by LexisNexis (Lexis+ AI) and Thomson Reuters (Westlaw AI-Assisted Research and Ask Practical Law AI) each hallucinate between 17% and 33% of the time. We also document substantial differences between systems in responsiveness and accuracy. Our article makes four key contributions. It is the first to assess and report the performance of RAG-based proprietary legal AI tools. Second, it introduces a comprehensive, preregistered dataset for identifying and understanding vulnerabilities in these systems. Third, it proposes a clear typology for differentiating between hallucinations and accurate legal responses. Last, it provides evidence to inform the responsibilities of legal professionals in supervising and verifying AI outputs, which remains a central open question for the responsible integration of AI into law.


title: LLMGeo: Benchmarking Large Language Models on Image Geolocation In-the-wild

abstract: Image geolocation is a critical task in various image-understanding applications. However, existing methods often fail when analyzing challenging, in-the-wild images. Inspired by the exceptional background knowledge of multimodal language models, we systematically evaluate their geolocation capabilities using a novel image dataset and a comprehensive evaluation framework. We first collect images from various countries via Google Street View. Then, we conduct training-free and training-based evaluations on closed-source and open-source multi-modal language models. we conduct both training-free and training-based evaluations on closed-source and open-source multimodal language models. Our findings indicate that closed-source models demonstrate superior geolocation abilities, while open-source models can achieve comparable performance through fine-tuning.


title: Learning 3D Robotics Perception using Inductive Priors

abstract: Recent advances in deep learning have led to a data-centric intelligence i.e. artificially intelligent models unlocking the potential to ingest a large amount of data and be really good at performing digital tasks such as text-to-image generation, machine-human conversation, and image recognition. This thesis covers the topic of learning with structured inductive bias and priors to design approaches and algorithms unlocking the potential of principle-centric intelligence. Prior knowledge (priors for short), often available in terms of past experience as well as assumptions of how the world works, helps the autonomous agent generalize better and adapt their behavior based on past experience. In this thesis, I demonstrate the use of prior knowledge in three different robotics perception problems. 1. object-centric 3D reconstruction, 2. vision and language for decision-making, and 3. 3D scene understanding. To solve these challenging problems, I propose various sources of prior knowledge including 1. geometry and appearance priors from synthetic data, 2. modularity and semantic map priors and 3. semantic, structural, and contextual priors. I study these priors for solving robotics 3D perception tasks and propose ways to efficiently encode them in deep learning models. Some priors are used to warm-start the network for transfer learning, others are used as hard constraints to restrict the action space of robotics agents. While classical techniques are brittle and fail to generalize to unseen scenarios and data-centric approaches require a large amount of labeled data, this thesis aims to build intelligent agents which require very-less real-world data or data acquired only from simulation to generalize to highly dynamic and cluttered environments in novel simulations (i.e. sim2sim) or real-world unseen environments (i.e. sim2real) for a holistic scene understanding of the 3D world.


title: Breaking into the window of primordial black hole dark matter with x-ray microlensing

abstract: Primordial black holes (PBHs) in the mass range $10^{-16}-10^{-11}~M_\odot$ may constitute all the dark matter. We show that gravitational microlensing of bright x-ray pulsars provide the most robust and immediately implementable opportunity to uncover PBH dark matter in this mass window. As proofs of concept, we show that the currently operational NICER telescope can probe this window near $10^{-14}~M_\odot$ with just two months of exposure on the x-ray pulsar SMC-X1, and that the forthcoming STROBE-X telescope can probe complementary regions in only a few weeks. These times are much shorter than the year-long exposures obtained by NICER on some individual sources. We take into account the effects of wave optics and the finite extent of the source, which become important for the mass range of our PBHs. We also provide a spectral diagnostic to distinguish microlensing from transient background events and to broadly mark the PBH mass if true microlensing events are observed. In light of the powerful science case, i.e., the imminent discovery of dark matter searchable over multiple decades of PBH masses with achievable exposures, we strongly urge the commission of a dedicated large broadband telescope for x-ray microlensing. We derive the microlensing reach of such a telescope by assuming sensitivities of detector components of proposed missions, and find that with hard x-ray pulsar sources PBH masses down to a few $10^{-17}~M_\odot$ can be probed.


title: Bulk derivation of TQFT gravity

abstract: We outline a general derivation of holographic duality between "TQFT gravity" - the path integral of a 3d TQFT summed over different topologies - and an ensemble of boundary 2d CFTs. The key idea is to place the boundary ensemble on a Riemann surface of very high genus, where the duality trivializes. The duality relation at finite genus is then obtained by genus reduction. Our derivation is generic and does not rely on an explicit form of the bulk or boundary partition functions. It guarantees unitarity and suggests that the bulk sum should include all possible topologies. In the case of Abelian Chern-Simons theory with compact gauge group we show that the weights of the boundary ensemble are equal, while the bulk sum reduces to a finite sum over equivalence classes of topologies, represented by handlebodies with possible line defects.


title: The Effects of Cooling on Boundary Layer Accretion

abstract: In many cases accretion proceeds from disks onto planets, stars, white dwarfs, and neutron stars via a boundary layer, a region of intense shear where gas transitions from a near-Keplerian speed to that of the surface. These regions are \textit{not} susceptible to the common magnetorotational and Kelvin-Helmholtz instabilities, and instead global modes generated by supersonic shear instabilities are a leading candidate to govern transport in these regions. This work investigates the dynamics of these systems under a range of thermodynamic conditions, surveying both disk sound speeds and cooling rates. Very fast or very slow cooling has little effect on wave dynamics: in the fast-cooling limit, waves propagate in an effectively isothermal manner, and in the slow limit wave propagation is effectively adiabatic. However, when the cooling timescale is comparable to the wave period, wave damping becomes extreme. In cases with intermediate cooling rates, mass and angular momentum transport can be suppressed by orders of magnitude compared to isothermal and uncooled cases. Cooling in accretion disks leads to a preference for wavenumbers near and below the Mach number of the disk; the corresponding lower frequencies can (in non-isothermal systems) couple to gravity modes within the star, potentially causing low-frequency variability such as dwarf nova and quasi-periodic oscillations in accreting systems.


title: Sphere packing proper colorings of an expander graph

abstract: We introduce a new notion of error-correcting codes on $[q]^n$ where a code is a set of proper $q$-colorings of some fixed $n$-vertex graph $G$. For a pair of proper $q$-colorings $X, Y$ of $G$, we define their distance as the minimum Hamming distance between $X$ and $\sigma(Y)$ over all $\sigma \in S_q$. We then say that a set of proper $q$-colorings of $G$ is $\delta$-distinct if any pair of colorings in the set have distance at least $\delta n$. We investigate how one-sided spectral expansion relates to the largest possible set of $\delta$-distinct colorings on a graph. For fixed $(\delta, \lambda) \in [0, 1] \times [-1, 1]$ and positive integer $d$, let $f_{\delta, \lambda, d}(n)$ denote the maximal size of a set of $\delta$-distinct colorings of any $d$-regular graph on at most $n$ vertices with normalized second eigenvalue at most $\lambda$. We study the growth of $f$ as $n$ goes to infinity. We partially characterize regimes of $(\delta, \lambda)$ where $f$ grows exponentially, is finite, and is at most $1$, respectively. We also prove several sharp phase transitions between these regimes.


title: On the contributions of extragalactic CO emission lines to ground-based CMB observations

abstract: We investigate the potential of CO rotational lines at redshifts $z\sim 0-6$ being an appreciable source of extragalactic foreground anisotropies in the cosmic microwave background. Motivated by previous investigations, we specifically focus on the frequency bands and small scales probed by ground-based surveys. Using an empirical parameterization for the relation between the infrared luminosity of galaxies and their CO line luminosity, conditioned on sub-mm observations of CO luminosity functions from $J=1$ to $J=7$ at $\nu = \{100,250\}$ GHz, we explore how uncertainty in the CO luminosity function translates into uncertainty in the signature of CO emission in the CMB. We find that at $\ell = 3000$ the amplitude of both CO autocorrelation and cross-correlation with the CIB could be detectable in an ACT-like experiment with 90, 150 and 220 GHz bands, even in the scenarios with the lowest amplitude consistent with sub-mm data. We also investigate, for the first time, the amplitude of the CO$\times$CIB correlation between different frequency bands and find that our model predicts that this signal could be comparable to the amplitude of the cosmic infrared background frequency cross-correlation at certain wavelengths. This implies current observations can potentially be used to constrain the bright end of CO luminosity functions, which are difficult to probe with current sub-mm telescopes due to the small volumes they survey. Our findings corroborate past results and have significant implications in template-based searches for CMB secondaries, such as the kinetic Sunyaev Zel'dovich effect, using the frequency-dependent high-$\ell$ TT power spectrum.


title: The eventful life of GS-z14-0, the most distant galaxy at redshift $z=14.32$

abstract: We developed a model for the star formation history (SFH) of super-early galaxies and applied it to GS-z14-0, the most distant galaxy known, located at $z=14.32$ (294 million years after the Big Bang). The SFH, starting at $z=26.7$, is complex. Initially ($z>18$), the galaxy experiences feedback-regulated phases that are bursty, relatively faint (reaching $M_{\rm UV}=-18.4$), and unattenuated. When dust shielding allows for a smooth star formation rate (SFR), the galaxy quickly becomes heavily obscured. During this obscured phase, which lasts for approximately 20% of the total star-forming time, 70% of the observed stars are formed. Super-early galaxies in this phase should be detectable by ALMA. Twenty-six million years before observation, as the galaxy becomes super-Eddington, a powerful radiation-driven outflow clears most of the dust and significantly reduces the SFR by a factor of seven, from $100 \to 15\ M_\odot \rm yr^{-1}$. The galaxy transitions into a "blue monster" dominating the bright end of the UV luminosity function. When the outflow ceases due to decreased dust opacity, the galaxy relaxes into a post-starburst phase, in which it is currently observed. Our model accurately reproduces all the observed and inferred properties of the galaxy. The analysis of this extreme system opens exciting opportunities for studying the beginnings of the luminous Universe.


title: A log story short: running contributions to radiative Higgs decays in the SMEFT

abstract: We investigate the renormalization of the radiative decays of the Higgs to two gauge bosons in the Standard Model Effective Field Theory at mass dimension eight. Given that these are loop-level processes, their one-loop renormalization can be phenomenologically important when triggered by operators generated through the tree-level exchange of heavy particles (assuming a weakly coupled UV model). By computing the tree-level matching conditions of all relevant extensions of the Standard Model, we demonstrate that this effect is indeed present in the $h\to \gamma Z$ decay at dimension eight, even though it is absent at dimension six. In contrast, the $h\to gg$ and $h\to \gamma\gamma$ decays can only be renormalized by operators generated by one-loop processes. For UV models with heavy vectors, this conclusion hinges on the specific form of their interaction with massless gauge bosons which is required for perturbative unitarity. We study the quantitative impact of the possible logarithmic enhancement of $h\to \gamma Z$, and we propose an observable to boost the sensitivity to this effect. Given the expected increased precision of next-generation high-energy experiments, this dimension-eight contribution could be large enough to be probed and could therefore give valuable clues about new physics by revealing some of its structural features manifesting first at dimension eight.


title: Three-loop corrections to Higgs boson pair production: reducible contribution

abstract: We compute three-loop corrections to the process $gg\to HH$ originating from one-particle reducible diagrams. This requires the computation of two-loop corrections to the gluon-gluon-Higgs vertex with an off-shell gluon. We describe in detail our approach to obtain semi-analytic results for the vertex form factors and present results for the two form factors contributing to Higgs boson pair production.


title: Parity nonconservation induced by spacetime geometry

abstract: The interaction of fermion spin with spacetime can be non-universal, leading to a new interaction beyond the Standard Model, independent of gravitation. Fermions generate spacetime torsion, which can be integrated out in favor of a four-fermion interaction in a torsion-free background. This is a current-current interaction which involves all fermions and generically has different coupling constants for different chiralities and species of fermions. It does not vanish when curvature goes to zero, so accelerator experiments should be able to see its effect. We calculate the contribution of this geometrical interaction to parity nonconservation in $e^-e^-$ and $e^-D$ scattering and compare with known observations. This provides an estimate of an upper bound on the coupling constants, suggesting that the strength of the ``new physics'' can be as large as only one order of magnitude smaller than that of weak interactions.


title: Dwarf galaxies imply dark matter is heavier than $\mathbf{2.2 \times 10^{-21}} \, \mathbf{eV}$

abstract: Folk wisdom dictates that a lower bound on the dark matter particle mass, $m$, can be obtained by demanding that the de Broglie wavelength in a given galaxy must be smaller than the virial radius of the galaxy, leading to $m\gtrsim 10^{-22}\text{ eV}$ when applied to typical dwarf galaxies. This lower limit has never been derived precisely or rigorously. We use stellar kinematical data for the Milky Way satellite galaxy Leo II to self-consistently reconstruct a statistical ensemble of dark matter wavefunctions and corresponding density profiles. By comparison to a data-driven, model-independent reconstruction, and using a variant of the maximum mean discrepancy as a statistical measure, we determine that a self-consistent description of dark matter in the local Universe requires $m>2.2 \times 10^{-21}\,\mathrm{eV}\;\mathrm{(CL>95\%)}$. This lower limit is free of any assumptions pertaining to cosmology, microphysics (including spin), or dynamics of dark matter, and only assumes that it is predominantly composed of a single bosonic particle species.


title: Waves and strings in an interacting conformal chiral 2-form theory in six dimensions

abstract: In six dimensions there exists a unique one-parameter family of non-linear conformal electrodynamics for a chiral 2-form gauge field which includes (in a free-field limit) the linear chiral 2-form theory and is related, by dimensional reduction, to the four-dimensional ModMax electrodynamics. In this work, we present the first exact solutions of this theory in presence of gravity. In particular, we will consider plane-wave, Robinson-Trautman, and self-dual dyonic string configurations, generalizing well-known solutions of this type in six-dimensional supergravities with linear chiral 2-form multiplets.


title: Unraveling hydrodynamization using ultracold 1D gases

abstract: We study the quantum evolution of 1D Bose gases immediately after several variants of high-energy quenches, both experimentally and theoretically. Using the advantages conveyed by the relative simplicity of these nearly integrable many-body systems, we are able to differentiate the behavior of two distinct but often temporally overlapping processes, hydrodynamization and local prethermalization. There is a universal character to our findings, which can be applied to the short-time behavior of any interacting many-body quantum system after a sudden high-energy quench. We specifically discuss its potential relevance to heavy-ion collisions.

categories: cond-mat.quant-gas nucl-th physics.atom-ph quant-ph


title: Analytical models for secular descents in hierarchical triple systems

abstract: Triple body systems are prevalent in nature, from planetary to stellar to supermassive black hole scales. In a hierarchical triple system, oscillations of the inner orbit's eccentricity and inclination can be induced on secular timescales. Over many cycles, the octupole-level terms in the secular equations of motion can drive the system to extremely high eccentricities via the Eccentric Kozai-Lidov (EKL) mechanism. The overall decrease in the inner orbit's pericenter distance has potentially dramatic effects for realistic systems, such as tidal disruption. We present an analytical approximation in the test particle limit to describe the step-wise eccentricity evolution of the inner orbit. We also integrate the equations of motion and present approximations in both the test particle limit and in the general case to describe the overall octupole-level time evolution of the eccentricity. The analytical approximations are compared to numerical simulations to show that the models accurately describe the form and timescale of the secular descent from large distances to a close-encounter distance (e.g., the Roche limit). By circumventing the need for numerical simulations to obtain the long-term behavior, these approximations can be used to readily estimate descent timescales for populations of systems. We demonstrate by calculating rates of EKL-driven migration for Hot Jupiters in stellar binaries.


title: The eclectic flavor symmetries of $\mathbb{T}^2/\mathbb{Z}_K$ orbifolds

abstract: Only four $\mathbb{T}^2/\mathbb{Z}_K$ orbifold building blocks are admissible in heterotic string compactifications. We investigate the flavor properties of all of these building blocks. In each case, we identify the traditional and modular flavor symmetries, and determine the corresponding representations and (fractional) modular weights of the available massless matter states. The resulting finite flavor symmetries include Abelian and non-Abelian traditional symmetries, discrete $R$ symmetries, as well as the double-covered finite modular groups $(S_3\times S_3)\rtimes\mathbb{Z}_4$, $T'$, $2D_3$ and $S_3\times T'$. Our findings provide restrictions for bottom-up model building with consistent ultraviolet embeddings.


title: Fate of many-body localization in an Abelian lattice gauge theory

abstract: We address the fate of many-body localization (MBL) of mid-spectrum eigenstates of a matter-free $U(1)$ quantum-link gauge theory Hamiltonian with random couplings on ladder geometries. We specifically consider an intensive estimator, $\mathcal{D} \in [0,1/4]$, that acts as a measure of elementary plaquettes on the lattice being active or inert in mid-spectrum eigenstates as well as the concentration of these eigenstates in Fock space, with $\mathcal{D}$ being equal to its maximum value of $1/4$ for Fock states in the electric flux basis. We calculate its distribution, $p(\mathcal{D})$, for $L_x \times L_y$ lattices, with $L_y=2$ and $4$, as a function of (a dimensionless) disorder strength $\alpha$ ($\alpha=0$ implies zero disorder) using exact diagonalization on many disorder realizations. Analyzing the skewness of $p(\mathcal{D})$ shows that the finite-size estimate of the critical disorder strength, beyond which MBL sets in for thin ladders with $L_y=2$, increases linearly with $L_x$ while the behavior of the full distribution with increasing $L_x$ at fixed $\alpha$ shows that $\alpha_c (L_y=2) >40$, if at all finite, based on data for $L_x \leq 12$. $p(\mathcal{D})$ for wider ladders with $L_y=4$ show their lower tendency to localize, suggesting a lack of MBL in two dimensions. A remarkable observation is the resolution of the (monotonic) infinite temperature autocorrelation function of single plaquette diagonal operators in typical high-energy Fock states into a plethora of emergent timescales of increasing spatio-temporal heterogeneity as the disorder is increased even before MBL sets in. At intermediate and large $\alpha$, but below $\alpha_c (L_y)$, certain randomly selected initial Fock states display striking oscillatory temporal behavior of such plaquette operators dominated by only a few frequencies, reminiscent of oscillations induced by quantum many-body scars.

categories: cond-mat.dis-nn cond-mat.str-el hep-lat quant-ph


title: Gradient Inversion of Federated Diffusion Models

abstract: Diffusion models are becoming defector generative models, which generate exceptionally high-resolution image data. Training effective diffusion models require massive real data, which is privately owned by distributed parties. Each data party can collaboratively train diffusion models in a federated learning manner by sharing gradients instead of the raw data. In this paper, we study the privacy leakage risk of gradient inversion attacks. First, we design a two-phase fusion optimization, GIDM, to leverage the well-trained generative model itself as prior knowledge to constrain the inversion search (latent) space, followed by pixel-wise fine-tuning. GIDM is shown to be able to reconstruct images almost identical to the original ones. Considering a more privacy-preserving training scenario, we then argue that locally initialized private training noise $\epsilon$ and sampling step t may raise additional challenges for the inversion attack. To solve this, we propose a triple-optimization GIDM+ that coordinates the optimization of the unknown data, $\epsilon$ and $t$. Our extensive evaluation results demonstrate the vulnerability of sharing gradient for data protection of diffusion models, even high-resolution images can be reconstructed with high quality.


title: Classical and Quantum Properties of the Spin-Boson Dicke Model: Chaos, Localization, and Scarring

abstract: This review article describes major advances associated with the Dicke model, starting in the 1950s when it was introduced to explain the transition from a normal to a superradiant phase. Since then, this spin-boson interacting model has raised significant theoretical and experimental interest in various contexts. The present review focuses on the isolated version of the model and covers properties and phenomena that are better understood when seen from both the classical and quantum perspectives, in particular, the onset of chaos, localization, and scarring.


title: Dipole-dipole interactions mediated by a photonic flat band

abstract: Flat bands (FBs) are energy bands with zero group velocity, which in electronic systems were shown to favor strongly correlated phenomena. Indeed, a FB can be spanned with a basis of strictly localized states, the so called "compact localized states" (CLSs), which are yet generally non-orthogonal. Here, we study emergent dipole-dipole interactions between emitters dispersively coupled to the photonic analogue of a FB, a setup within reach in state-of the-art experimental platforms. We show that the strength of such photon-mediated interactions decays exponentially with distance with a characteristic localization length which, unlike typical behaviours with standard bands, saturates to a finite value as the emitter's energy approaches the FB. Remarkably, we find that the localization length grows with the overlap between CLSs according to an analytically-derived universal scaling law valid for a large class of FBs both in 1D and 2D. Using giant atoms (non-local atom-field coupling) allows to tailor interaction potentials having the same shape of a CLS or a superposition of a few of these.


title: HOLISMOKES XIII: Strong-lens candidates at all mass scales and their environments from the Hyper-Suprime Cam and deep learning

abstract: We have performed a systematic search for galaxy-scale strong lenses using Hyper Suprime-Cam imaging data, focusing on lenses in overdense environments. To identify these lens candidates, we exploit our neural network from HOLISMOKES VI, which is trained on realistic gri mock-images as positive examples, and real images as negative examples. Compared to our previous work, we lower the i-Kron radius limit to >0.5". This results in an increase by around 73 million sources to more than 135 million images. During our visual multi-stage grading of the network candidates, we now inspect simultaneously larger stamps (80"x80") to identify large, extended arcs cropped in the 10"x10" cutouts, and classify additionally their overall environment. Here we also reinspect our previous lens candidates and classify their environment. Using these 546 visually identified lens candidates, we further define various criteria by exploiting extensive and complementary photometric redshift catalogs, to select the candidates in overdensities. In total, we identified 24 grade-A and 138 grade-B candidates with either spatially-resolved multiple images or extended, distorted arcs in the new sample. Furthermore, with our different techniques, we identify in total 237/546 lens candidates in a cluster-like or overdense environment, containing only 49 group- or cluster-scale re-discoveries. These results demonstrate the feasibility of downloading and applying network classifiers to hundreds of million cutouts, necessary in the upcoming era of big data from deep, wide-field imaging surveys like Euclid and the Rubin Observatory Legacy Survey of Space and Time, while leading to a sample size that can be inspected by humans. These networks, with false-positive rates of ~0.01%, are very powerful tools to identify such rare galaxy-scale strong lensing systems, while also aiding in the discovery of new strong lensing clusters.


title: Recurrent neural network wave functions for Rydberg atom arrays on kagome lattice

abstract: Rydberg atom array experiments have demonstrated the ability to act as powerful quantum simulators, preparing strongly-correlated phases of matter which are challenging to study for conventional computer simulations. A key direction has been the implementation of interactions on frustrated geometries, in an effort to prepare exotic many-body states such as spin liquids and glasses. In this paper, we apply two-dimensional recurrent neural network (RNN) wave functions to study the ground states of Rydberg atom arrays on the kagome lattice. We implement an annealing scheme to find the RNN variational parameters in regions of the phase diagram where exotic phases may occur, corresponding to rough optimization landscapes. For Rydberg atom array Hamiltonians studied previously on the kagome lattice, our RNN ground states show no evidence of exotic spin liquid or emergent glassy behavior. In the latter case, we argue that the presence of a non-zero Edwards-Anderson order parameter is an artifact of the long autocorrelations times experienced with quantum Monte Carlo simulations. This result emphasizes the utility of autoregressive models, such as RNNs, to explore Rydberg atom array physics on frustrated lattices and beyond.

categories: cond-mat.quant-gas cond-mat.dis-nn cond-mat.str-el cs.LG quant-ph


title: The PAU Survey: galaxy stellar population properties estimate with narrow-band data

abstract: Narrowband galaxy surveys have recently gained interest as a promising method to achieve the necessary accuracy on the photometric redshift estimate of individual galaxies for stage-IV cosmological surveys. One key advantage is the ability to provide higher spectral resolution information about galaxies that should allow a more accurate and precise estimation of galaxy stellar population properties. However, the impact of adding narrow-band photometry on the stellar population properties estimate is largely unexplored. The scope of this work is two-fold: on one side, leveraging the predictive power of broad-band and narrow-band data to infer galaxy physical properties such as stellar masses, ages, star formation rates and metallicities. On the other hand, evaluating the improvement of performance in estimating galaxy properties when we use narrow-band data instead of broad-band. In this work we measure the stellar population properties of a sample of galaxies in the COSMOS field for which both narrowband and broadband data are available. In particular, we employ narrowband data from PAUS and broad-band data from CFHTLS. We use two different spectral energy distribution fitting codes to measure galaxy properties, namely CIGALE and Prospector. We find that the increased spectral resolution of narrow-band photometry does not yield a substantial improvement on constraining galaxy properties using spectral energy distribution fitting. Still we find that we obtain a more diverse distribution of metallicities and dust optical depths with cigale when employing the narrowband data. The effect is not as prominent as expected, which we relate this to the low narrowband SNR of a majority of the galaxies, the respective drawbacks of both codes as well as the coverage only in the optical regime. The measured properties are afterwards compared to the COSMOS2020 catalogue, showing good agreement.


title: The Absolute Swampland

abstract: The ``Swampland Program'' aims to discriminate consistent-looking effective field theories that do not admit a UV completion in quantum gravity from those that do. While most often developed under the umbrella of string theory, several swampland criteria have been explored also in other contexts, especially asymptotically safe gravity. A comparison between different approaches can help to clarify the dependence of low-energy constraints on UV physics and thereby shed light on the universality of quantum gravity itself. In this short review we summarise what is known about three important swampland conjectures in string theory and in asymptotic safety. We point out future lines of research that can help to understand to what extent swampland conjectures are absolute, i.e. hold in quantum gravity in general, or relative, i.e. belong only to a specific UV framework.


title: Sensitivity Analysis for Piecewise-Affine Approximations of Nonlinear Programs with Polytopic Constraints

abstract: Nonlinear Programs (NLPs) are prevalent in optimization-based control of nonlinear systems. Solving general NLPs is computationally expensive, necessitating the development of fast hardware or tractable suboptimal approximations. This paper investigates the sensitivity of the solutions of NLPs with polytopic constraints when the nonlinear continuous objective function is approximated by a PieceWise-Affine (PWA) counterpart. By leveraging perturbation analysis using a convex modulus, we derive guaranteed bounds on the distance between the optimal solution of the original polytopically-constrained NLP and that of its approximated formulation. Our approach aids in determining criteria for achieving desired solution bounds. Two case studies on the Eggholder function and nonlinear model predictive control of an inverted pendulum demonstrate the theoretical results.


title: Constraining Post-Newtonian Parameters with the Cosmic Microwave Background

abstract: The Parameterised Post-Newtonian (PPN) approach is the default framework for performing precision tests of gravity in nearby astrophysical systems. In recent works we have extended this approach for cosmological applications, and in this paper we use observations of the anisotropies in the Cosmic Microwave Background to constrain the time variation of the PPN parameters $\alpha$ and $\gamma$ between last scattering and the present day. We find their time-averages over cosmological history should be within $\sim 20\%$ of their values in GR, with $\bar{\alpha}=0.89^{+0.08}_{-0.09}$ and $\bar{\gamma}=0.90^{+0.07}_{-0.08}$ at the $68\%$ confidence level. We also constrain the time derivatives of these parameters, and find that their present-day values should be within a factor of two of the best Solar System constraints. Many of these results have no counter-part from Solar System observations, and are entirely new constraints on the gravitational interaction. In all cases, we find that the data strongly prefer $\bar{\alpha}\simeq \bar{\gamma}$, meaning that observers would typically find local gravitational physics to be compatible with GR, despite considerable variation of $\alpha$ and $\gamma$ being allowed over cosmic history. This study lays the groundwork for future precision tests of gravity that combine observations made over all cosmological and astrophysical scales of length and time.


title: Designing an Evaluation Framework for Large Language Models in Astronomy Research

abstract: Large Language Models (LLMs) are shifting how scientific research is done. It is imperative to understand how researchers interact with these models and how scientific sub-communities like astronomy might benefit from them. However, there is currently no standard for evaluating the use of LLMs in astronomy. Therefore, we present the experimental design for an evaluation study on how astronomy researchers interact with LLMs. We deploy a Slack chatbot that can answer queries from users via Retrieval-Augmented Generation (RAG); these responses are grounded in astronomy papers from arXiv. We record and anonymize user questions and chatbot answers, user upvotes and downvotes to LLM responses, user feedback to the LLM, and retrieved documents and similarity scores with the query. Our data collection method will enable future dynamic evaluations of LLM tools for astronomy.


title: Quantitative Convergences of Lie Group Momentum Optimizers

abstract: Explicit, momentum-based dynamics that optimize functions defined on Lie groups can be constructed via variational optimization and momentum trivialization. Structure preserving time discretizations can then turn this dynamics into optimization algorithms. This article investigates two types of discretization, Lie Heavy-Ball, which is a known splitting scheme, and Lie NAG-SC, which is newly proposed. Their convergence rates are explicitly quantified under $L$-smoothness and local strong convexity assumptions. Lie NAG-SC provides acceleration over the momentumless case, i.e. Riemannian gradient descent, but Lie Heavy-Ball does not. When compared to existing accelerated optimizers for general manifolds, both Lie Heavy-Ball and Lie NAG-SC are computationally cheaper and easier to implement, thanks to their utilization of group structure. Only gradient oracle and exponential map are required, but not logarithm map or parallel transport which are computational costly.


title: On the D5-brane description of $\frac{1}{4}$-BPS Wilson loops in $\mathcal{N}=4$ super Yang-Mills theory

abstract: We construct the probe D5-brane solution in $AdS_5\times S^5$ dual to the $\frac{1}{4}$-BPS latitude Wilson loop in $\mathcal{N}=4$ super Yang-Mills theory in the $k$-antisymmetric representation of $SU(N)$. The solution is exact in the latitude parameter $\theta_0$ and correctly reproduces the $\frac{1}{2}$-BPS limit. We compute the string charge $k$ and the renormalized on-shell action perturbatively to order $\mathcal{O}\left(\theta_0^{10}\right)$ and find full agreement with the expectation value of the Wilson loop predicted by the Gaussian matrix model in the limit $N\sim k\to\infty$, $\lambda\to\infty$.


title: Can No-Reference Quality-Assessment Methods Serve as Perceptual Losses for Super-Resolution?

abstract: Perceptual losses play an important role in constructing deep-neural-network-based methods by increasing the naturalness and realism of processed images and videos. Use of perceptual losses is often limited to LPIPS, a fullreference method. Even though deep no-reference image-qualityassessment methods are excellent at predicting human judgment, little research has examined their incorporation in loss functions. This paper investigates direct optimization of several video-superresolution models using no-reference image-quality-assessment methods as perceptual losses. Our experimental results show that straightforward optimization of these methods produce artifacts, but a special training procedure can mitigate them.


title: Coulomb drag in graphene/hBN/graphene moir\'e heterostructures

abstract: We report on the observation of Coulomb drag between graphene-hexagonal boron nitride (hBN) moir\'{e} heterostructure with a moir\'{e} wavelength of $\sim$14 nm and an intrinsic graphene with a lattice constant of $\sim$0.25 nm. By tuning carrier densities of each graphene layer independently, we find that the charge carriers in moir\'{e} mini-bands, i.e., near the satellite Dirac point (sDP), can be coupled with the massless Fermions near the original Dirac point (oDP), strongly enough to generate a finite drag resistivity. At high temperature ($T$) and large density ($n$), the drag resistivities near both oDP and sDP follow a typical $n^{-\alpha}$ ($\alpha=1.3\sim1.7$) and $T^2$ power law dependence as expected for the momentum transfer process and it also satisfies the layer reciprocity. In contrast, at low $T$, the layer reciprocity is broken in both oDP-oDP and sDP-oDP coupled regions that suggest dominant energy drag. Furthermore, quantitatively, the drag resistivities near sDPs are smaller than those near oDP and they deviate from $T^2$ dependence below $\sim$100 K. These results suggest that the coupling between the carriers in moir\'{e} mini-bands and those in original Dirac bands may not be of a simple Fermi liquid nature.


title: Monodromy groups and exceptional Hodge classes

abstract: Denote by $J_m$ the Jacobian variety of the hyperelliptic curve defined by the affine equation $y^2=x^m+1$ over $\mathbb{Q}$, where $m \geq 3$ is a fixed positive integer. We compute several interesting arithmetic invariants of $J_m$: its decomposition up to isogeny into simple abelian varieties, the minimal field $\mathbb{Q}(\operatorname{End}(J_m))$ over which its endomorphisms are defined, its connected monodromy field $\mathbb{Q}(\varepsilon_{J_m})$, and its Sato-Tate group. Currently, there is no general algorithm that computes these last two invariants. Furthermore, for large enough values of $m$, the abelian varieties $J_m$ provide non-trivial examples of high-dimensional phenomena, such as degeneracy and the non-triviality of the extension $\mathbb{Q}(\varepsilon_{J_m})/\mathbb{Q}(\operatorname{End}(J_m))$. Finally, we describe the Sato-Tate group of an abelian variety, generalizing existing results that apply only to non-degenerate varieties.


title: The bounded cohomology of transformation groups of Euclidean spaces and discs

abstract: We prove that the groups of orientation-preserving homeomorphisms and diffeomorphisms of $\mathbb{R}^n$ are boundedly acyclic, in all regularities. This is the first full computation of the bounded cohomology of a transformation group that is not compactly supported, and it implies that many characteristic classes of flat $\mathbb{R}^n$- and $S^n$-bundles are unbounded. We obtain the same result for the group of homeomorphisms of the disc that restrict to the identity on the boundary, and for the homeomorphism group of the non-compact Cantor set. In the appendix, Alexander Kupers proves a controlled version of the annulus theorem which we use to study the bounded cohomology of the homeomorphism group of the discs.


title: Using the COSMIC Population Synthesis Code to Investigate How Metallicity Affects the Rates of Interacting Binaries

abstract: We use COSMIC, a galaxy population synthesis code, to investigate how metallicity affects the rate of formation of massive stars with a closely orbiting compact object companion, the suggested progenitors of radio loud long gamma-ray bursts. We present the evolution time of these systems at different metallicities, and how the formation rates of these systems are anti-correlated with metallicity. In particular, these systems occur about 10 times more frequently in at metallicities between $Z = 2\times 10^{-4}$ and $2 \times 10^{-3}$, compared to those between $Z = 2\times 10^{-3}$ and $2 \times 10^{-2}$. This work serves as a prerequisite to predicting the global rates of these systems as a function of redshift, ultimately giving crucial insight into our understanding of the progenitors of long gamma-ray bursts and their evolution over cosmic time.


title: Explainable Data-driven Modeling of Adsorption Energy in Heterogeneous Catalysis

abstract: The increasing popularity of machine learning (ML) in catalysis has spurred interest in leveraging these techniques to enhance catalyst design. Our study aims to bridge the gap between physics-based studies and data-driven methodologies by integrating ML techniques with eXplainable AI (XAI). Specifically, we employ two XAI techniques: Post-hoc XAI analysis and Symbolic Regression. These techniques help us unravel the correlation between adsorption energy and the properties of the adsorbate-catalyst system. Leveraging a large dataset such as the Open Catalyst Dataset (OC20), we employ a combination of shallow ML techniques and XAI methodologies. Our investigation involves utilizing multiple shallow machine learning techniques to predict adsorption energy, followed by post-hoc analysis for feature importance, inter-feature correlations, and the influence of various feature values on the prediction of adsorption energy. The post-hoc analysis reveals that adsorbate properties exert a greater influence than catalyst properties in our dataset. The top five features based on higher Shapley values are adsorbate electronegativity, the number of adsorbate atoms, catalyst electronegativity, effective coordination number, and the sum of atomic numbers of the adsorbate molecule. There is a positive correlation between catalyst and adsorbate electronegativity with the prediction of adsorption energy. Additionally, symbolic regression yields results consistent with SHAP analysis. It deduces a mathematical relationship indicating that the square of the catalyst electronegativity is directly proportional to the adsorption energy. These consistent correlations resemble those derived from physics-based equations in previous research. Our work establishes a robust framework that integrates ML techniques with XAI, leveraging large datasets like OC20 to enhance catalyst design through model explainability.


title: Scattering and dynamical capture of two black holes: synergies between numerical and analytical methods

abstract: We study initially unbound systems of two black holes using numerical relativity (NR) simulations performed with GR-Athena++. We focus on regions of the parameter space close to the transition from scatterings to dynamical captures, considering equal mass and spin-aligned configurations, as well as unequal mass and nonspinning ones. The numerical results are then used to validate the effective-one-body (EOB) model TEOBResumS-Dal\'i for dynamical captures and scatterings. We find good agreement for the waveform phenomenologies, scattering angles, mismatches, and energetics in the low energy regime ($E_0\lesssim 1.02\,M$). In particular, mismatches are typically below or around the $1\%$ level, with only a few cases -- corresponding to spinning binaries -- slightly above the $3\%$ threshold. We also discuss dynamical captures in the test-mass limit by solving numerically the Zerilli equation with the time domain code RWZHyp. The latter analysis provides valuable insights into both the analytical noncircular corrections of the EOB waveform and the integration of NR Weyl scalars.


title: AI Diffusion to Low-Middle Income Countries; A Blessing or a Curse?

abstract: Rapid advancements in AI have sparked significant research into its impacts on productivity and labor, which can be profoundly positive or negative. Often overlooked in this debate is understanding of how AI technologies spread across and within economies. Equally ignored are developing economies facing substantial labor market impacts from rapid, and a loss in competitiveness, from slow AI diffusion. This paper reviews literature on technology diffusion and proposes a three-way framework for understanding AI diffusion: global value chains, research collaboration, and inter-firm knowledge transfers. This is used to measure AI diffusion in sixteen low-middle-income, and four developed economies, as well as to evaluate dependence on China and the USA for access to AI technologies. The study finds a significant gap in diffusion rates between the two groups, but current trends indicate it is narrowing. China is identified as a crucial future source of AI diffusion through value chains, while the USA is more influential in research and knowledge transfers. The paper's limitations include the omission of additional data sources and countries, and the lack of investigation into the relationship between diffusion and technology intensity. Nonetheless, it raises salient macro-level questions about AI diffusion and suggests emphasis on redistribution mechanisms of AI induced economic gains, and bilateral agreements as a complement to international accords, to address diverse needs and corresponding risks faced by economies transitioning into an AI-dominated era. Additionally, it highlights the need for research into the links between AI diffusion, technology intensity, and productivity; case studies combined with targeted policy recommendations; more accurate methods for measuring AI diffusion; and a deeper investigation into its labor market impacts particular to LMICs.


title: Fast leave-one-cluster-out cross-validation by clustered Network Information Criteria (NICc)

abstract: This paper introduced a clustered estimator of the Network Information Criterion (NICc) to approximate leave-one-cluster-out cross-validated deviance, which can be used as an alternative to cluster-based cross-validation when modeling clustered data. Stone proved that Akaike Information Criterion (AIC) is an asymptotic equivalence to leave-one-observation-out cross-validation if the parametric model is true. Ripley pointed out that the Network Information Criterion (NIC) derived in Stone's proof, is a better approximation to leave-one-observation-out cross-validation when the model is not true. For clustered data, we derived a clustered estimator of NIC, referred to as NICc, by substituting the Fisher information matrix in NIC with its estimator that adjusts for clustering. This adjustment imposes a larger penalty in NICc than the unclustered estimator of NIC when modeling clustered data, thereby preventing overfitting more effectively. In a simulation study and an empirical example, we used linear and logistic regression to model clustered data with Gaussian or binomial response, respectively. We showed that NICc is a better approximation to leave-one-cluster-out deviance and prevents overfitting more effectively than AIC and Bayesian Information Criterion (BIC). NICc leads to more accurate model selection, as determined by cluster-based cross-validation, compared to AIC and BIC.


title: Fractionalization of Coset Non-Invertible Symmetry and Exotic Hall Conductance

abstract: We investigate fractionalization of non-invertible symmetry in (2+1)D topological orders. We focus on coset non-invertible symmetries obtained by gauging non-normal subgroups of invertible $0$-form symmetries. These symmetries can arise as global symmetries in quantum spin liquids, given by the quotient of the projective symmetry group by a non-normal subgroup as invariant gauge group. We point out that such coset non-invertible symmetries in topological orders can exhibit symmetry fractionalization: each anyon can carry a "fractional charge" under the coset non-invertible symmetry given by a gauge invariant superposition of fractional quantum numbers. We present various examples using field theories and quantum double lattice models, such as fractional quantum Hall systems with charge conjugation symmetry gauged and finite group gauge theory from gauging a non-normal subgroup. They include symmetry enriched $S_3$ and $O(2)$ gauge theories. We show that such systems have a fractionalized continuous non-invertible coset symmetry and a well-defined electric Hall conductance. The coset symmetry enforces a gapless edge state if the boundary preserves the continuous non-invertible symmetry. We propose a general approach for constructing coset symmetry defects using a "sandwich" construction: non-invertible symmetry defects can generally be constructed from an invertible defect sandwiched by condensation defects. The anomaly free condition for finite coset symmetry is also identified.


title: Cross-Talk Reduction

abstract: While far-field multi-talker mixtures are recorded, each speaker can wear a close-talk microphone so that close-talk mixtures can be recorded at the same time. Although each close-talk mixture has a high signal-to-noise ratio (SNR) of the wearer, it has a very limited range of applications, as it also contains significant cross-talk speech by other speakers and is not clean enough. In this context, we propose a novel task named cross-talk reduction (CTR) which aims at reducing cross-talk speech, and a novel solution named CTRnet which is based on unsupervised or weakly-supervised neural speech separation. In unsupervised CTRnet, close-talk and far-field mixtures are stacked as input for a DNN to estimate the close-talk speech of each speaker. It is trained in an unsupervised, discriminative way such that the DNN estimate for each speaker can be linearly filtered to cancel out the speaker's cross-talk speech captured at other microphones. In weakly-supervised CTRnet, we assume the availability of each speaker's activity timestamps during training, and leverage them to improve the training of unsupervised CTRnet. Evaluation results on a simulated two-speaker CTR task and on a real-recorded conversational speech separation and recognition task show the effectiveness and potential of CTRnet.


title: The Primordial Inflation Explorer (PIXIE): Mission Design and Science Goals

abstract: The Primordial Inflation Explorer (PIXIE) is an Explorer-class mission concept to measure the energy spectrum and linear polarization of the cosmic microwave background (CMB). A single cryogenic Fourier transform spectrometer compares the sky to an external blackbody calibration target, measuring the Stokes I, Q, U parameters to levels ~200 Jy/sr in each 2.65 degree diameter beam over the full sky, in each of 300 frequency channels from 28 GHz to 6 THz. With sensitivity over 1000 times greater than COBE/FIRAS, PIXIE opens a broad discovery space for the origin, contents, and evolution of the universe. Measurements of small distortions from a CMB blackbody spectrum provide a robust determination of the mean electron pressure and temperature in the universe while constraining processes including dissipation of primordial density perturbations, black holes, and the decay or annihilation of dark matter. Full-sky maps of linear polarization measure the optical depth to reionization at nearly the cosmic variance limit and constrain models of primordial inflation. Spectra with sub-percent absolute calibration spanning microwave to far-IR wavelengths provide a legacy data set for analyses including line intensity mapping of extragalactic emission and the cosmic infrared background amplitude and anisotropy. We describe the PIXIE instrument sensitivity, foreground subtraction, and anticipated science return from both the baseline 2-year mission and a potential extended mission.


title: XPrompt:Explaining Large Language Model's Generation via Joint Prompt Attribution

abstract: Large Language Models (LLMs) have demonstrated impressive performances in complex text generation tasks. However, the contribution of the input prompt to the generated content still remains obscure to humans, underscoring the necessity of elucidating and explaining the causality between input and output pairs. Existing works for providing prompt-specific explanation often confine model output to be classification or next-word prediction. Few initial attempts aiming to explain the entire language generation often treat input prompt texts independently, ignoring their combinatorial effects on the follow-up generation. In this study, we introduce a counterfactual explanation framework based on joint prompt attribution, XPrompt, which aims to explain how a few prompt texts collaboratively influences the LLM's complete generation. Particularly, we formulate the task of prompt attribution for generation interpretation as a combinatorial optimization problem, and introduce a probabilistic algorithm to search for the casual input combination in the discrete space. We define and utilize multiple metrics to evaluate the produced explanations, demonstrating both faithfulness and efficiency of our framework.


title: Private Mean Estimation with Person-Level Differential Privacy

abstract: We study differentially private (DP) mean estimation in the case where each person holds multiple samples. Commonly referred to as the "user-level" setting, DP here requires the usual notion of distributional stability when all of a person's datapoints can be modified. Informally, if $n$ people each have $m$ samples from an unknown $d$-dimensional distribution with bounded $k$-th moments, we show that \[n = \tilde \Theta\left(\frac{d}{\alpha^2 m} + \frac{d }{ \alpha m^{1/2} \varepsilon} + \frac{d}{\alpha^{k/(k-1)} m \varepsilon} + \frac{d}{\varepsilon}\right)\] people are necessary and sufficient to estimate the mean up to distance $\alpha$ in $\ell_2$-norm under $\varepsilon$-differential privacy (and its common relaxations). In the multivariate setting, we give computationally efficient algorithms under approximate DP (with slightly degraded sample complexity) and computationally inefficient algorithms under pure DP, and our nearly matching lower bounds hold for the most permissive case of approximate DP. Our computationally efficient estimators are based on the well known noisy-clipped-mean approach, but the analysis for our setting requires new bounds on the tails of sums of independent, vector-valued, bounded-moments random variables, and a new argument for bounding the bias introduced by clipping.


title: Bijective solutions to the Pentagon Equation

abstract: A complete classification of all finite bijective set-theoretic solutions $(S,s)$ to the Pentagon Equation is obtained. First, it is shown that every such a solution determines a semigroup structure on the set $S$ that is the direct product $E\times G$ of a semigroup of left zeros $E$ and a group $G$. Next, we prove that this leads to a decomposition of the set $S$ as a Cartesian product $X\times A\times G$, for some sets $X,A$ and to a discovery of a hidden group structure on $A$. Then an unexpected structure of a matched product of groups $A,G$ is found such that the solution $(S,s)$ can be explicitly described as a lift of a solution determined on the set $A\times G$ by this matched product of groups. Conversely, every matched product of groups leads to a family of solutions arising in this way. Moreover, a simple criterion for the isomorphism of two solutions is obtained. The results provide a far reaching extension of the results of Colazzo, Jespers and Kubat, dealing with the special case of the so called involutive solutions. Connections to the solutions to the Yang--Baxter equation and to the theory of skew braces are derived.