title: Unveiling LLM Mechanisms Through Neural ODEs and Control Theory

abstract: This study presents a novel approach that leverages Neural Ordinary Differential Equations (Neural ODEs) to unravel the intricate relationships between inputs and outputs in Large Language Models (LLMs), and employs robust control to fine-tune outputs to meet predefined standards. Central to our methodology is the transformation of LLM inputs and outputs into a lower-dimensional latent space, facilitating a detailed examination of the information processing pathways within LLMs. Neural ODEs play a pivotal role in this investigation by providing a dynamic model that captures the continuous evolution of data within the LLMs. Additionally, robust control mechanisms are applied to strategically adjust the model's outputs, ensuring they not only maintain high quality and reliability but also adhere to specific performance criteria. This fusion of Neural ODEs and robust control represents a significant advancement in LLM interpretability, offering a comprehensive framework that elucidates the previously opaque mechanisms of these complex models. Our empirical results validate the effectiveness of this integrated approach, making a substantial contribution to the field of explainable AI by merging advanced machine learning techniques with the critical need for transparency and control in AI outputs.


title: Machine Unlearning with Minimal Gradient Dependence for High Unlearning Ratios

abstract: In the context of machine unlearning, the primary challenge lies in effectively removing traces of private data from trained models while maintaining model performance and security against privacy attacks like membership inference attacks. Traditional gradient-based unlearning methods often rely on extensive historical gradients, which becomes impractical with high unlearning ratios and may reduce the effectiveness of unlearning. Addressing these limitations, we introduce Mini-Unlearning, a novel approach that capitalizes on a critical observation: unlearned parameters correlate with retrained parameters through contraction mapping. Our method, Mini-Unlearning, utilizes a minimal subset of historical gradients and leverages this contraction mapping to facilitate scalable, efficient unlearning. This lightweight, scalable method significantly enhances model accuracy and strengthens resistance to membership inference attacks. Our experiments demonstrate that Mini-Unlearning not only works under higher unlearning ratios but also outperforms existing techniques in both accuracy and security, offering a promising solution for applications requiring robust unlearning capabilities.


title: AI for Equitable Tennis Training: Leveraging AI for Equitable and Accurate Classification of Tennis Skill Levels and Training Phases

abstract: Numerous studies have demonstrated the manifold benefits of tennis, such as increasing overall physical and mental health. Unfortunately, many children and youth from low-income families are unable to engage in this sport mainly due to financial constraints such as private lesson expenses as well as logistical concerns to and back from such lessons and clinics. While several tennis self-training systems exist, they are often tailored for professionals and are prohibitively expensive. The present study aims to classify tennis players' skill levels and classify tennis strokes into phases characterized by motion attributes for a future development of an AI-based tennis self-training model for affordable and convenient applications running on devices used in daily life such as an iPhone or an Apple Watch for tennis skill improvement. We collected motion data, including Motion Yaw, Roll and Pitch from inertial measurement units (IMUs) worn by participating junior tennis players. For this pilot study, data from twelve participants were processed using Support Vector Machine (SVM) algorithms. The SVM models demonstrated an overall accuracy of 77% in classifying players as beginners or intermediates, with low rates of false positives and false negatives, effectively distinguishing skill levels. Additionally, the tennis swings were successfully classified into five phases based on the collected motion data. These findings indicate that SVM-based classification can be a reliable foundation for developing an equitable and accessible AI-driven tennis training system.


title: MD tree: a model-diagnostic tree grown on loss landscape

abstract: This paper considers "model diagnosis", which we formulate as a classification problem. Given a pre-trained neural network (NN), the goal is to predict the source of failure from a set of failure modes (such as a wrong hyperparameter, inadequate model size, and insufficient data) without knowing the training configuration of the pre-trained NN. The conventional diagnosis approach uses training and validation errors to determine whether the model is underfitting or overfitting. However, we show that rich information about NN performance is encoded in the optimization loss landscape, which provides more actionable insights than validation-based measurements. Therefore, we propose a diagnosis method called MD tree based on loss landscape metrics and experimentally demonstrate its advantage over classical validation-based approaches. We verify the effectiveness of MD tree in multiple practical scenarios: (1) use several models trained on one dataset to diagnose a model trained on another dataset, essentially a few-shot dataset transfer problem; (2) use small models (or models trained with small data) to diagnose big models (or models trained with big data), essentially a scale transfer problem. In a dataset transfer task, MD tree achieves an accuracy of 87.7%, outperforming validation-based approaches by 14.88%. Our code is available at https://github.com/YefanZhou/ModelDiagnosis.


title: Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning

abstract: Low-Rank Adaptation (LoRA) offers an efficient way to fine-tune large language models (LLMs). Its modular and plug-and-play nature allows the integration of various domain-specific LoRAs, enhancing LLM capabilities. Open-source platforms like Huggingface and Modelscope have introduced a new computational paradigm, Uploadable Machine Learning (UML). In UML, contributors use decentralized data to train specialized adapters, which are then uploaded to a central platform to improve LLMs. This platform uses these domain-specific adapters to handle mixed-task requests requiring personalized service. Previous research on LoRA composition either focuses on specific tasks or fixes the LoRA selection during training. However, in UML, the pool of LoRAs is dynamically updated with new uploads, requiring a generalizable selection mechanism for unseen LoRAs. Additionally, the mixed-task nature of downstream requests necessitates personalized services. To address these challenges, we propose Retrieval-Augmented Mixture of LoRA Experts (RAMoLE), a framework that adaptively retrieves and composes multiple LoRAs based on input prompts. RAMoLE has three main components: LoraRetriever for identifying and retrieving relevant LoRAs, an on-the-fly MoLE mechanism for coordinating the retrieved LoRAs, and efficient batch inference for handling heterogeneous requests. Experimental results show that RAMoLE consistently outperforms baselines, highlighting its effectiveness and scalability.


title: AND: Audio Network Dissection for Interpreting Deep Acoustic Models

abstract: Neuron-level interpretations aim to explain network behaviors and properties by investigating neurons responsive to specific perceptual or structural input patterns. Although there is emerging work in the vision and language domains, none is explored for acoustic models. To bridge the gap, we introduce $\textit{AND}$, the first $\textbf{A}$udio $\textbf{N}$etwork $\textbf{D}$issection framework that automatically establishes natural language explanations of acoustic neurons based on highly-responsive audio. $\textit{AND}$ features the use of LLMs to summarize mutual acoustic features and identities among audio. Extensive experiments are conducted to verify $\textit{AND}$'s precise and informative descriptions. In addition, we demonstrate a potential use of $\textit{AND}$ for audio machine unlearning by conducting concept-specific pruning based on the generated descriptions. Finally, we highlight two acoustic model behaviors with analysis by $\textit{AND}$: (i) models discriminate audio with a combination of basic acoustic features rather than high-level abstract concepts; (ii) training strategies affect model behaviors and neuron interpretability -- supervised training guides neurons to gradually narrow their attention, while self-supervised learning encourages neurons to be polysemantic for exploring high-level features.


title: Why Quantum-like Models of Cognition Work

abstract: It is shown that Brownian motions executed by state points of neural membranes generate a Schr\"{o}dinger-like equation with $\hbar/m$ replaced by the coefficient of diffusion $\sigma$ of the substrates.


title: Make Graph Neural Networks Great Again: A Generic Integration Paradigm of Topology-Free Patterns for Traffic Speed Prediction

abstract: Urban traffic speed prediction aims to estimate the future traffic speed for improving urban transportation services. Enormous efforts have been made to exploit Graph Neural Networks (GNNs) for modeling spatial correlations and temporal dependencies of traffic speed evolving patterns, regularized by graph topology.While achieving promising results, current traffic speed prediction methods still suffer from ignoring topology-free patterns, which cannot be captured by GNNs. To tackle this challenge, we propose a generic model for enabling the current GNN-based methods to preserve topology-free patterns. Specifically, we first develop a Dual Cross-Scale Transformer (DCST) architecture, including a Spatial Transformer and a Temporal Transformer, to preserve the cross-scale topology-free patterns and associated dynamics, respectively. Then, to further integrate both topology-regularized/-free patterns, we propose a distillation-style learning framework, in which the existing GNN-based methods are considered as the teacher model, and the proposed DCST architecture is considered as the student model. The teacher model would inject the learned topology-regularized patterns into the student model for integrating topology-free patterns. The extensive experimental results demonstrated the effectiveness of our methods.


title: Are Vision xLSTM Embedded UNet More Reliable in Medical 3D Image Segmentation?

abstract: The advancement of developing efficient medical image segmentation has evolved from initial dependence on Convolutional Neural Networks (CNNs) to the present investigation of hybrid models that combine CNNs with Vision Transformers. Furthermore, there is an increasing focus on creating architectures that are both high-performing in medical image segmentation tasks and computationally efficient to be deployed on systems with limited resources. Although transformers have several advantages like capturing global dependencies in the input data, they face challenges such as high computational and memory complexity. This paper investigates the integration of CNNs and Vision Extended Long Short-Term Memory (Vision-xLSTM) models by introducing a novel approach called UVixLSTM. The Vision-xLSTM blocks captures temporal and global relationships within the patches extracted from the CNN feature maps. The convolutional feature reconstruction path upsamples the output volume from the Vision-xLSTM blocks to produce the segmentation output. Our primary objective is to propose that Vision-xLSTM forms a reliable backbone for medical image segmentation tasks, offering excellent segmentation performance and reduced computational complexity. UVixLSTM exhibits superior performance compared to state-of-the-art networks on the publicly-available Synapse dataset. Code is available at: https://github.com/duttapallabi2907/UVixLSTM


title: Quantum Multi-Agent Reinforcement Learning for Cooperative Mobile Access in Space-Air-Ground Integrated Networks

abstract: Achieving global space-air-ground integrated network (SAGIN) access only with CubeSats presents significant challenges such as the access sustainability limitations in specific regions (e.g., polar regions) and the energy efficiency limitations in CubeSats. To tackle these problems, high-altitude long-endurance unmanned aerial vehicles (HALE-UAVs) can complement these CubeSat shortcomings for providing cooperatively global access sustainability and energy efficiency. However, as the number of CubeSats and HALE-UAVs, increases, the scheduling dimension of each ground station (GS) increases. As a result, each GS can fall into the curse of dimensionality, and this challenge becomes one major hurdle for efficient global access. Therefore, this paper provides a quantum multi-agent reinforcement Learning (QMARL)-based method for scheduling between GSs and CubeSats/HALE-UAVs in order to improve global access availability and energy efficiency. The main reason why the QMARL-based scheduler can be beneficial is that the algorithm facilitates a logarithmic-scale reduction in scheduling action dimensions, which is one critical feature as the number of CubeSats and HALE-UAVs expands. Additionally, individual GSs have different traffic demands depending on their locations and characteristics, thus it is essential to provide differentiated access services. The superiority of the proposed scheduler is validated through data-intensive experiments in realistic CubeSat/HALE-UAV settings.


title: A large language model for predicting T cell receptor-antigen binding specificity

abstract: The human immune response depends on the binding of T-cell receptors (TCRs) to antigens (pTCR), which elicits the T cells to eliminate viruses, tumor cells, and other pathogens. The ability of human immunity system responding to unknown viruses and bacteria stems from the TCR diversity. However, this vast diversity poses challenges on the TCR-antigen binding prediction methods. In this study, we propose a Masked Language Model (MLM), referred to as tcrLM, to overcome limitations in model generalization. Specifically, we randomly masked sequence segments and train tcrLM to infer the masked segment, thereby extract expressive feature from TCR sequences. Meanwhile, we introduced virtual adversarial training techniques to enhance the model's robustness. We built the largest TCR CDR3 sequence dataset to date (comprising 2,277,773,840 residuals), and pre-trained tcrLM on this dataset. Our extensive experimental results demonstrate that tcrLM achieved AUC values of 0.937 and 0.933 on independent test sets and external validation sets, respectively, which remarkably outperformed four previously published prediction methods. On a large-scale COVID-19 pTCR binding test set, our method outperforms the current state-of-the-art method by at least 8%, highlighting the generalizability of our method. Furthermore, we validated that our approach effectively predicts immunotherapy response and clinical outcomes on a clinical cohorts. These findings clearly indicate that tcrLM exhibits significant potential in predicting antigenic immunogenicity.


title: Study of Heavy Quarkonia in the presence of magnetic field by Nikiforov Uvarov method

abstract: The N-dimensional radial Schrodinger equation has been solved using the Nikiforov Uvarov (NU) method, in which we used the medium modified form of Cornell potential and quasi-particle Debye mass with strong magnetic field background. The binding energies and the mass spectra of heavy quarkonium have been studied in the N-dimensional space for different values of magnetic field, the binding energy decreases with increasing magnetic field, which shows early dissociation of heavy quarkonium system. The influence of dimensionality number has also been discussed on binding energies of J/{\psi} and {\Upsilon} for fixed value of magnetic field. It is found that with an increase in dimensionality, the binding energy starts decreasing from a higher initial value. The results obtained are quite consistent with recent studies.


title: Wavelet Attention GRU for Efficient Industrial Gas Recognition with Novel Metrics

abstract: Gas recognition technology has received considerable attention from researchers in recent years. Nevertheless, the gas recognition area has faced obstacles in implementing deep learning-based recognition solutions due to the absence of standardized protocols. To tackle this problem, we suggest using two sets of specialized evaluation measures for gas recognition algorithms. These metrics will make it easier to examine the performance of these algorithms on various datasets. In addition, we provide a new model called the Wavelet Attention GRU (WAG), which is based on the wavelet attention mechanism. This method facilitates the more efficient retrieval of sensor signals. Compared to other models, WAG significantly decreases the number of sensors needed by 75% while obtaining an identification accuracy of 98.33%. This suggests that WAG is a potential approach for advancing gas recognition algorithms.


title: Efficient real space formalism for hybrid density functionals

abstract: We present an efficient real space formalism for hybrid exchange-correlation functionals in generalized Kohn-Sham density functional theory (DFT). In particular, we develop an efficient representation for any function of the real space finite-difference Laplacian matrix by leveraging its Kronecker product structure, thereby enabling the time to solution of associated linear systems to be highly competitive with the fast Fourier transform scheme, while not imposing any restrictions on the boundary conditions. We implement this formalism for both the unscreened and range-separated variants of hybrid functionals. We verify its accuracy and efficiency through comparisons with established planewave codes for isolated as well as bulk systems. In particular, we demonstrate up to an order-of-magnitude speedup in time to solution for the real space method. We also apply the framework to study the structure of liquid water using ab initio molecular dynamics, where we find good agreement with literature. Overall, the current formalism provides an avenue for efficient real space DFT calculations with hybrid density functionals.


title: Identifying Easy Instances to Improve Efficiency of ML Pipelines for Algorithm-Selection

abstract: Algorithm-selection (AS) methods are essential in order to obtain the best performance from a portfolio of solvers over large sets of instances. However, many AS methods rely on an analysis phase, e.g. where features are computed by sampling solutions and used as input in a machine-learning model. For AS to be efficient, it is therefore important that this analysis phase is not computationally expensive. We propose a method for identifying easy instances which can be solved quickly using a generalist solver without any need for algorithm-selection. This saves computational budget associated with feature-computation which can then be used elsewhere in an AS pipeline, e.g., enabling additional function evaluations on hard problems. Experiments on the BBOB dataset in two settings (batch and streaming) show that identifying easy instances results in substantial savings in function evaluations. Re-allocating the saved budget to hard problems provides gains in performance compared to both the virtual best solver (VBS) computed with the original budget, the single best solver (SBS) and a trained algorithm-selector.


title: Forecast measurement of the 21 cm global spectrum from Lunar orbit with the Vari-Zeroth-Order Polynomial (VZOP) method

abstract: The cosmic 21 cm signal serves as a crucial probe for studying the evolutionary history of the Universe. However, detecting the 21 cm signal poses significant challenges due to its extremely faint nature. To mitigate the interference from the Earth's radio frequency interference (RFI), the ground and the ionospheric effects, the Discovering the Sky at the Longest Wavelength (DSL) project will deploy a constellation of satellites in Lunar orbit, with its high-frequency daughter satellite tasked with detecting the global 21 cm signal from cosmic dawn and reionization era (CD/EoR). We intend to employ the Vari-Zeroth-Order Polynomial (VZOP) for foreground fitting and subtracting. We have studied the effect of thermal noise, thermal radiation from the Moon, the Lunar reflection, anisotropic frequency-dependent beam, inaccurate antenna beam pattern, and RFI contamination. We discovered that the RFI contamination can significantly affect the fitting process and thus prevent us from detecting the signal. Therefore, experimenting on the far side of the moon is crucial. We also discovered that using VZOP together with DSL, after 1080 orbits around the Moon, which takes about 103 days, we can successfully detect the CD/EoR 21 cm signal.


title: Deep Learning for Prediction and Classifying the Dynamical behaviour of Piecewise Smooth Maps

abstract: This paper explores the prediction of the dynamics of piecewise smooth maps using various deep learning models. We have shown various novel ways of predicting the dynamics of piecewise smooth maps using deep learning models. Moreover, we have used machine learning models such as Decision Tree Classifier, Logistic Regression, K-Nearest Neighbor, Random Forest, and Support Vector Machine for predicting the border collision bifurcation in the 1D normal form map and the 1D tent map. Further, we classified the regular and chaotic behaviour of the 1D tent map and the 2D Lozi map using deep learning models like Convolutional Neural Network (CNN), ResNet50, and ConvLSTM via cobweb diagram and phase portraits. We also classified the chaotic and hyperchaotic behaviour of the 3D piecewise smooth map using deep learning models such as the Feed Forward Neural Network (FNN), Long Short-Term Memory (LSTM), and Recurrent Neural Network (RNN). Finally, deep learning models such as Long Short-Term Memory (LSTM) and Recurrent Neural Network (RNN) are used for reconstructing the two parametric charts of 2D border collision bifurcation normal form map.


title: Benchmarking mortality risk prediction from electrocardiograms

abstract: Several recent high-impact studies leverage large hospital-owned electrocardiographic (ECG) databases to model and predict patient mortality. MIMIC-IV, released September 2023, is the first comparable public dataset and includes 800,000 ECGs from a U.S. hospital system. Previously, the largest public ECG dataset was Code-15, containing 345,000 ECGs collected during routine care in Brazil. These datasets now provide an excellent resource for a broader audience to explore ECG survival modeling. Here, we benchmark survival model performance on Code-15 and MIMIC-IV with two neural network architectures, compare four deep survival modeling approaches to Cox regressions trained on classifier outputs, and evaluate performance at one to ten years. Our results yield AUROC and concordance scores comparable to past work (circa 0.8) and reasonable AUPRC scores (MIMIC-IV: 0.4-0.5, Code-15: 0.05-0.13) considering the fraction of ECG samples linked to a mortality (MIMIC-IV: 27\%, Code-15: 4\%). When evaluating models on the opposite dataset, AUROC and concordance values drop by 0.1-0.15, which may be due to cohort differences. All code and results are made public.


title: A Page-Rank-like Approach to Optimal Placement of Charging Stations in a Warehouse

abstract: In this paper we describe an approach to the problem of finding optimal positions for charging stations (CS) in a warehouse, where a fleet of electrical industrial trucks/forklifts is employed. Our procedure is motivated by Googles Page-Ranking. The graph model underlying our method is easily extensible from simple distance based criteria, relevant for choosing optimal CS-positions, to more complex criteria taking into account, e.g., the ''state of charge'' (SOC) of the individual trucks battery.


title: Fair game: Urban free-ranging dogs balance resource use and risk aversion at seasonal fairs

abstract: Seasonal fairs, bustling with human activity, provide a unique environment for exploring the intricate interplay between humans and free-ranging dogs. This study investigated these interactions during seasonal fairs in Nadia and Bardhaman districts, West Bengal, India. Across 13 fairground sites, we explore how human footfall and resource availability impact dog behavior, with a particular emphasis on cognitive mechanisms. Data collection occurred from December to March, comprising three sessions - initial, middle, and end, each on three randomly selected days. Employing spot census and scan sampling methods, observers documented GPS locations, sex, and behaviors of free-ranging dogs. Videos captured interactions within the fair environment, revealing cognitive processes. Our analysis revealed a notable increase in human activity during the middle phase, coinciding with a rise in dog abundance. Dogs predominantly foraged, exhibited gait, and remained vigilant, their numbers positively associated with resource availability. Proximity to the fairground significantly shaped dog behavior, indicating cognitive processes in decision-making. Dogs closer to the fair demonstrated consistent behavior, likely due to immediate resource access, implying sophisticated cognitive mapping and resource utilization. Conversely, dogs from farther distances exhibited lower consistency and heightened aggression, intensifying foraging, gait, and vigilance activities, suggesting cognitive adaptations to resource scarcity and competition. These findings underscore the intricate relationship between human activity, resource availability, and the behavior and cognition of free-ranging dogs during seasonal fairs. They offer insights into the ecological dynamics of free-ranging dogs in human-influenced landscapes, emphasizing the necessity for comprehensive management strategies in urban and peri-urban environments.


title: PVUW 2024 Challenge on Complex Video Understanding: Methods and Results

abstract: Pixel-level Video Understanding in the Wild Challenge (PVUW) focus on complex video understanding. In this CVPR 2024 workshop, we add two new tracks, Complex Video Object Segmentation Track based on MOSE dataset and Motion Expression guided Video Segmentation track based on MeViS dataset. In the two new tracks, we provide additional videos and annotations that feature challenging elements, such as the disappearance and reappearance of objects, inconspicuous small objects, heavy occlusions, and crowded environments in MOSE. Moreover, we provide a new motion expression guided video segmentation dataset MeViS to study the natural language-guided video understanding in complex environments. These new videos, sentences, and annotations enable us to foster the development of a more comprehensive and robust pixel-level understanding of video scenes in complex environments and realistic scenarios. The MOSE challenge had 140 registered teams in total, 65 teams participated the validation phase and 12 teams made valid submissions in the final challenge phase. The MeViS challenge had 225 registered teams in total, 50 teams participated the validation phase and 5 teams made valid submissions in the final challenge phase.


title: Probing the nature of the $\chi_{c1}(3872)$ state using radiative decays

abstract: The radiative decays $\chi_{c1}(3872)\rightarrow\psi(2S)\gamma$ and $\chi_{c1}(3872)\rightarrow J/\psi\gamma$ are used to probe the~nature of the~$\chi_{c1}(3872)$ state using proton-proton collision data collected with the LHCb detector, corresponding to an~integrated luminosity of~9fb$^{-1}$. Using the~$B^+\rightarrow \chi_{c1}(3872)K^+$decay, the $\chi_{c1}(3872)\rightarrow \psi(2S)\gamma$ process is observed for the first time and the ratio of its partial width to that of the $\chi_{c1}(3872)\rightarrow J/\psi\gamma$ decay is measured to be $$ \frac{\Gamma_{\chi_{c1}(3872)\rightarrow \psi(2S)\gamma}} {\Gamma_{\chi_{c1}(3872)\rightarrow J/\psi\gamma}} = 1.67 \pm 0.21 \pm 0.12 \pm0.04 , $$ where the first uncertainty is statistical, the second systematic and the third is due to the uncertainties on the branching fractions of the $\psi(2S)$ and $J/\psi$ mesons. The measured ratio makes the interpretation of the $\chi_{c1}(3872)$ state as a~pure $D^0\bar{D}^{*0}+\bar{D}^0D^{*0}$ molecule questionable and strongly indicates a sizeable compact charmonium or tetraquark component within the $\chi_{c1}(3872)$ state.


title: A No-Go Theorem of Analytical Mechanics for the Second Law Violation

abstract: We follow the Boltzmann-Clausius-Maxwell (BCM) proposal to solve a long-standing problem of identifying the underlying cause of the second law (SL) of spontaneous irreversibility, a stochastic universal principle, as the mechanical equilibrium (stable or unstable) principle (Mec-EQ-P) of analytical mechanics of an isolated nonequilibrium system of any size. The principle leads to nonnegative system intrinsic (SI) microwork and SI-average macrowork dW during any spontaneous process. In conjuction with the first law, Mec-EQ-P leads to a generalized second law (GSL) dQ=dW>0, where dQ=TdS is the purely stochastic SI-macroheat that corresponds to dS>0 for T>0 and dS<0 for T<0, where T is the temperature. The GSL supercedes the conventional SL formulation that is valid only for a macroscopic system for positive temperatures temperatures, but reformulates it to dS<0 for negative temperatures. It is quite surprising that GSL is not only a direct consequence of intertwined mechanical and stochastic macroquantities through the first law but also remains valid for any arbitrary irreversible process in a system of any size as an identity for positive and negative temperatures. It also becomes a no-go theorem for GSL-violation unless we abandon Mec-EQ-P of analytical mechanics used in the BCM proposal, which will be catastrophic for theoretical physics. In addition, Mec-EQ-P also provides new insights into the roles of spontaneity, nonspontaneity, negative temperatures, instability, and the significance of dS<0 due to nonspontaneity and inserting internal constraints.

categories: cond-mat.stat-mech math-ph math.MP physics.class-ph


title: Meta-learning and Data Augmentation for Stress Testing Forecasting Models

abstract: The effectiveness of univariate forecasting models is often hampered by conditions that cause them stress. A model is considered to be under stress if it shows a negative behaviour, such as higher-than-usual errors or increased uncertainty. Understanding the factors that cause stress to forecasting models is important to improve their reliability, transparency, and utility. This paper addresses this problem by contributing with a novel framework called MAST (Meta-learning and data Augmentation for Stress Testing). The proposed approach aims to model and characterize stress in univariate time series forecasting models, focusing on conditions where they exhibit large errors. In particular, MAST is a meta-learning approach that predicts the probability that a given model will perform poorly on a given time series based on a set of statistical time series features. MAST also encompasses a novel data augmentation technique based on oversampling to improve the metadata concerning stress. We conducted experiments using three benchmark datasets that contain a total of 49.794 time series to validate the performance of MAST. The results suggest that the proposed approach is able to identify conditions that lead to large errors. The method and experiments are publicly available in a repository.


title: Optimizing measurement tradeoffs in multiparameter spatial superresolution

abstract: The quantum Cram\'er-Rao bound for the joint estimation of the centroid and the separation between two incoherent point sources cannot be saturated. As such, the optimal measurements for extracting maximal information about both at the same time are not known. In this work, we ascertain these optimal measurements for an arbitrary point spread function, in the most relevant regime of a small separation between the sources. Our measurement can be adjusted within a set of tradeoffs, allowing more information to be extracted from the separation or the centroid while ensuring that the total information is the maximum possible.


title: The distribution of the gravitational-wave background from supermassive black holes

abstract: The recent detection of gravitational waves (GWs) by pulsar timing array (PTA) collaborations spurred a variety of questions regarding the origin of the signal and the properties of its sources. The amplitude of a GW background produced by inspiralling supermassive black holes (SMBHs) can be predicted in a relatively robust manner from the present-day merged remnants, observed as single SMBHs at the centers of galaxies, but falls short of the signal measured by PTAs by a significant amount, requiring equal mass mergers, extremely short delay times, and no accretion in order to achieve a modest consistency. In this work, we revisit NANOGrav's 15-yr data set and reassess the aforementioned discrepancy using the full spectral information captured by PTA data. As previously noted in the literature, the discrete number of point sources contributing to the background may lead to deviations in the observed spectrum relative to the average ($h^2_c \propto f^{-4/3}$) due to Poisson fluctuations, providing additional information about the source population beyond the background amplitude. We derive a simple expression for the characteristic strain distribution given a SMBH model, which is generally applicable regardless of the method used to model the black hole population. We then refit the NANOGrav free spectrum using a minimal model based on the local mass function, showing that the current GW measurement requires roughly $\sim 10$ times more black holes than suggested by local observations and disfavors mass functions dominated by few very heavy sources, with the typical mass that contributes to the background $\lesssim 10^{10}M_{\odot}$. Given the range of SMBH models found to be consistent with the isotropic background, we address what is the typical number sources that would be individually detectable, given the current sensitivity.


title: Four-point functions and contact terms from higher-spin Ward identities of Chern-Simons-matter theory

abstract: Large $N$ quasifermionic Chern-Simons-matter theories exhibit weakly-broken higher-spin symmetry and contain an infinite-dimensional algebra of almost-conserved higher-spin currents. By analyzing local higher-spin Ward identities, we constrain the higher-spin algebra of this theory, for operators of spin $s<4$. The solution interpolates smoothly between Ward identities of free fermionic and critical bosonic $U(N)$ models, in accordance with the bosonization duality. At finite 't Hooft coupling, we decompose four-point current correlators involving $(\partial\cdot J_3)^{QF}$ in terms of free theory structures. Additionally, we find that higher correlators of the theory develop scheme-independent higher-spin contact terms, stemming from the presence of a background Chern-Simons term in the effective action. These terms are related to similar contact terms of the associated quasibosonic Chern-Simons-matter theory via Legendre transform. The results are supplemented by perturbative checks, including collinear limit computations of $\langle T_{--}J_+J_+\rangle_{QF}$, $\langle T_{--}J_+J_+O\rangle_{QF}$ and $\langle J_{ -- }J_+J_+J_+\rangle_{QF}$.


title: The HYENAS project: a prediction for the X-ray undetected galaxy groups

abstract: Galaxy groups contain the majority of bound mass with a significant portion of baryons due to the combination of halo mass and abundance (Cui 2024). Hence they serve as a crucial missing piece in the puzzle of galaxy formation and the evolution of large-scale structures in the Universe. In observations, mass-complete group catalogues are normally derived from galaxy redshift surveys detected through various three-dimensional group-finding algorithms. Confirming the reality of such groups, particularly in the X-rays, is critical for ensuring robust studies of galaxy evolution in these environments. Recent works have reported numerous optical groups that are X-ray undetected (see, e.g., Popesso et al. 2024), sparking debates regarding the reasons for the unexpectedly low hot gas fraction in galaxy groups. To address this issue, we utilise zoomed-in simulations of galaxy groups from the novel HYENAS project to explore the range of hot gas fractions within galaxy groups and investigate the intrinsic factors behind the observed variability in X-ray emission. We find that the halo formation time can play a critical role -- we see that groups in halos that formed earlier exhibit up to an order of magnitude brighter X-ray luminosities compared to those formed later. This suggests that undetected X-ray groups are preferentially late-formed halos and highlights the connection between gas fraction and halo formation time in galaxy groups. Accounting for these biases in galaxy group identification is essential for advancing our understanding of galaxy formation and achieving precision in cosmological studies.


title: Spurious gauge-invariance and $\gamma_5$ in Dimensional Regularization

abstract: Dimensional regularization is arguably the most popular and efficient scheme for multi-loop calculations. Yet, when applied to chiral (gauge) theories like the Standard Model and its extensions, one is forced to deal with the infamous "$\gamma_5$ problem". The only formulation that has been demonstrated to be consistent at all orders in perturbation theory, known as Breiteinlhoner-Maison-'t Hooft-Veltman scheme, is rather cumbersome because of the lack of manifest chiral gauge-invariance. In this paper we point out that this drawback can be alleviated by the introduction of auxiliary fields that restore a spurious version of gauge-invariance. If combined with the background field method, all 1PI amplitudes and the associated counterterms are formally covariant and thus severely constrained by the symmetries. As an illustration we evaluate the symmetry-restoring counterterms at 1-loop in the most general renormalizable gauge theory with Dirac fermions and scalar fields, the Standard Model representing a particular example.


title: Explaining PTA Results by Metastable Cosmic Strings from SO(10) GUT

abstract: In a recent paper (see https://doi.org/10.1103/PhysRevD.108.095053), we have demonstrated that the 2023 PTA results, which hint at a stochastic gravitational wave (GW) background at nanohertz frequencies, point towards a promising model-building route for realizing $SO(10)$ Grand Unification with embedded inflation. The proposed supersymmetric scenario solves the doublet-triplet splitting without fine-tuning, accounts for charged fermion and neutrino masses, avoids conflicts with current proton decay bounds, and includes only representations no larger than the adjoint. It features multi-step breaking of $SO(10)$ to the Standard Model gauge symmetry, with inflation embedded such that metastable cosmic strings are produced at the end of inflation. This cosmic string network generates a stochastic GW background that can explain the PTA results. In this paper, we provide a detailed analysis of the singled out GUT model class, focusing on how the gauge coupling unification condition affects the scales of multi-step $SO(10)$ breaking and the preferred GW spectra. The lowest breaking scale, linked to inflation, the generation of right-handed neutrino masses for the seesaw mechanism, and metastable cosmic string production, coincides with the range suggested by the PTA results.


title: The neutrino roof: Single-scatter ceilings in dark matter direct detection

abstract: We identify the maximum cross sections probed by single-scatter ``WIMP" searches in dark matter direct detection. Due to Poisson fluctuations in scatter multiplicity, these ceilings scale logarithmically with mass for heavy dark matter and often lie in regions probed by multiscatter searches. Using a generalized formula for single-scatter event rates we recast WIMP searches by the quintal-to-tonne scale detectors XENON1T, XENONnT, LZ, PANDAX-II, PANDAX-4T, DarkSide-50 and DEAP-3600 to obtain ceilings and floors up to a few $10^{17}$ GeV mass and $10^{-22}$ cm$^2$ per-nucleus cross section. We do this for coherent, geometric, isospin-violating xenophobic and argophobic spin-independent scattering, and neutron-only and proton-only spin-dependent scattering. Future large-exposure detectors would register an almost irreducible background of atmospheric neutrinos that would determine a dark matter sensitivity ceiling that we call the ``neutrino roof", in analogy with the well-studied ``neutrino floor". Accounting for this background, we estimate the reaches of the 10$-$100 tonne scale DarkSide-20k, DARWIN/XLZD, PANDAX-xT, and Argo, which would probe many decades of unconstrained parameter space up to the Planck mass, as well as of $10^3-10^4$ tonne scale noble liquid detectors that have been proposed in synergy with neutrino experiments.


title: Phenomenology of ultralight bosons around compact objects: in-medium suppression

abstract: Mixing between ultralight bosons and the Standard Model photon may allow access to the hitherto invisible Universe. In the presence of plasma, photons are dressed with an effective mass which will influence the conversion between the two. We study this phenomenon, known as in-medium suppression, in the context of black hole physics. We consider both axion-photon mixing around charged black holes and dark photon-photon mixing around neutral black holes. We find that the presence of plasma indeed influences the conversion rate, possibly quenching it altogether for large plasma densities, and discuss implications for superradiance and observational signatures.


title: Continuous-Spin Particles, On Shell

abstract: We study on-shell scattering amplitudes for continuous-spin particles. Poincar\'e invariance, little-group $ISO(2)$ covariance, analyticity, and on-shell factorization (unitarity) impose stringent conditions on these amplitudes. We solve them by realizing a non-trivial representation for all little-group generators on the space of functions of bi-spinors. The three-point amplitudes are uniquely determined by matching their high-energy limit to that of definite-helicity (ordinary) massless particles. Four-point amplitudes are then bootstrapped using consistency conditions, allowing us to analyze the theory in a very transparent way, without relying on any off-shell Lagrangian formulation. We present several examples that highlight the main features of the resulting scattering amplitudes. Finally, we explore under which conditions it is possible to relax some assumptions, such as strict on-shell factorization, analyticity, or others. We show that continuous-spin particle dynamics may approximate gravity and electromagnetism in a loose version of $S$-matrix principles.


title: Inspiral-inherited ringdown tails

abstract: We study the late-time relaxation of a perturbed Schwarzschild black hole, driven by a source term representing an infalling particle in generic orbits. We consider quasi-circular and eccentric binaries, dynamical captures and radial infalls, with orbital dynamics driven by an highly accurate analytical radiation reaction. After reviewing the description of the late-time behaviour as an integral over the whole inspiral history, we derive an analytical expression exactly reproducing the slow relaxation observed in our numerical evolutions, obtained with a hyperboloidal compactified grid, for a given particle trajectory. We find this signal to be a superposition of an infinite number of power-laws, the slowest decaying term being Price's law. Next, we use our model to explain the several orders-of-magnitude enhancement of tail terms for binaries in non-circular orbits, shedding light on recent unexpected results obtained in numerical evolutions. In particular, we show the dominant terms controlling the enhancement to be activated when the particle is far from the BH, with small tangential and radial velocities soon before the plunge. As we corroborate with semi-analytical calculations, this implies that for large eccentricities the tail amplitude can be correctly extracted even when starting to evolve only from the last apastron before merger. We discuss the implications of these findings on the extraction of late-time tail terms in non-linear evolutions, and possible observational consequences. We also briefly comment on the scattering scenario, and on the connection with the soft graviton theorem.


title: Constraining galaxy properties with complete samples of lenses

abstract: The statistics of Einstein radii for a sample of strong lenses can provide valuable constraints on the underlying mass distribution. The correct interpretation, however, relies critically on the modelling of the selection of the sample, which has proven to be a limiting factor. This may change thanks to upcoming uniform high-resolution imaging surveys that cover a large fraction of the sky, because they can provide complete lens samples, with well understood selection criteria. To explore how the observed distribution of Einstein radii depends on the galaxy properties, we simulated a realistic complete sample of strong lenses, predicting a number density of lenses of about 2.5 deg$^{-2}$ for a \Euclid-like setup. Such data can break the degeneracy between the stellar initial mass function (IMF) and the inner slope of the density profile of dark matter, without having to rely on additional information from stellar dynamics. We found that a survey covering only 50 deg$^2$ can already provide tight constraints: assuming that the cosmology is known, the dark matter slope is recovered with an uncertainty of $3.5\%$, while the uncertainty in the ratio between the true stellar mass and that inferred from stellar population modelling was found to be $10\%$. These findings highlight the potential of this method when applied to samples of lenses with well-understood selection functions.


title: Ticking away: the long-term X-ray timing and spectral evolution of eRO-QPE2

abstract: Quasi-periodic eruptions (QPEs) are repeated X-ray flares from galactic nuclei. Despite some diversity in the recurrence and amplitude of eruptions, their striking regularity has motivated theorists to associate QPEs with orbital systems. Among the known QPE sources, eRO-QPE2 has shown the most regular flare timing and luminosity since its discovery. We report here on its long-term evolution over $\sim3.3\,$yr from discovery and find that: i) the average QPE recurrence time per epoch has decreased over time, albeit not at a uniform rate; ii) the distinct alternation between consecutive long and short recurrence times found at discovery has not been significant since; iii) the spectral properties, namely flux and temperature of both eruptions and quiescence components, have remained remarkably consistent within uncertainties. We attempted to interpret these results as orbital period and eccentricity decay coupled with orbital and disk precession. However, since gaps between observations are too long, we are not able to distinguish between an evolution dominated by just a decreasing trend, or by large modulations (e.g. due to the precession frequencies at play). In the former case, the observed period decrease is roughly consistent with that of a star losing orbital energy due to hydrodynamic gas drag from disk collisions, although the related eccentricity decay is too fast and additional modulations have to contribute too. In the latter case, no conclusive remarks are possible on the orbital evolution and the nature of the orbiter due to the many effects at play. However, these two cases come with distinctive predictions for future X-ray data: in the former, we expect all future observations to show a shorter recurrence time than the latest epoch, while in the latter we expect some future observations to be found with a larger recurrence, hence an apparent temporary period increase.


title: A CFT dual for evaporating black holes: boundary continuous matrix product states

abstract: Tensor network states, especially Matrix Product States (MPS), are crucial tools for studying how particles in large quantum systems are entangled with each other. MPS are particularly effective for modeling systems in one-dimensional space. Their continuous version, known as continuous Matrix Product States (cMPS), extends this approach to more complex quantum field theories that describe systems with an infinite number of interacting particles. This paper introduces a novel extension, boundary continuous Matrix Product States (BCMPS), which incorporate boundary states from conformal field theory (CFT). We construct BCMPS and explore their potential holographic duals, linking them to black hole microstates with end-of-the-world branes in AdS/CFT. This connection hints at a deeper relationship between tensor networks and spacetime geometry, potentially offering new insights into the interplay between quantum information and gravity.


title: The Relation Between Variances of a 3D Density and Its 2D Column Density Revisited

abstract: We revisit the relation between the variance of three-dimensional (3D) density ($\sigma^{2}_{\rho}$) and that of the projected two-dimensional (2D) column density ($\sigma^{2}_{\Sigma}$) in turbulent media, which is of great importance in obtaining turbulence properties from observations. Earlier studies showed that $\sigma^{2}_{\Sigma / \Sigma_{0}}/\sigma^{2}_{\rho / \rho_{0}} = \mathcal{R}$, where $\Sigma/\Sigma_0$ and $\rho/\rho_0$ are 2D column and 3D volume densities normalized by their mean values, respectively. The factor $\mathcal{R}$ depends only on the density spectrum for isotropic turbulence in a cloud that has similar dimensions along and perpendicular to the line of sight. Our major findings in this paper are as follows. First, we show that the factor $\mathcal{R}$ can be expressed in terms of $N$, the number of independent eddies along the line of sight. To be specific, $\sigma^{2}_{\Sigma / \Sigma_{0}}/\sigma^{2}_{\rho/\rho_{0}}$ is proportional to $\sim 1/N$, due to the averaging effect arising from independent eddies along the line of sight. Second, we show that the factor $\mathcal{R}$ needs to be modified if the dimension of the cloud in the line-of-sight direction is different from that in the perpendicular direction. However, if we express $\sigma^{2}_{\Sigma / \Sigma_{0}}/\sigma^{2}_{\rho / \rho_{0}}$ in terms of $N$, the expression remains same even in the case the cloud has different dimensions along and perpendicular to the line of sight. Third, when we plot $N\sigma^{2}_{\Sigma / \Sigma_{0}}$ against $\sigma^{2}_{\rho / \rho_{0}}$, two quantities roughly lie on a single curve regardless of the sonic Mach number, which implies that we can directly obtain the latter from the former. We discuss observational implications of our findings.


title: Quantum Geometry and Entanglement in Two-dimensional Insulators: A View from the Corner Charge Fluctuation

abstract: Measuring bipartite fluctuations of a conserved charge, such as the particle number, within a finite region is a powerful approach to characterizing quantum systems. When the measured region has sharp corners, the bipartite fluctuation receives an additional contribution known to exhibit universal angle-dependence in 2D isotropic and uniform systems. Here we establish that the corner charge fluctuation reveals universal information even for generic $\textit{lattice}$ systems of non-interacting electrons. We first prove that universal angle-dependence can be recovered in the $\textit{small-angle}$ limit for proper partitions of the lattice, from which the integrated Fubini-Study quantum metric can be extracted. A model of a compact obstructed atomic insulator is introduced to illustrate this effect analytically. Numerical verification is presented for various Chern insulator models, demonstrating the experimental relevance of the corner charge fluctuation in a finite-size quantum simulator as a probe of quantum geometry. Last but not least, we highlight a remarkable connection between quantum geometry and quantum information through the lens of corner entanglement entropies.

categories: cond-mat.mes-hall cond-mat.quant-gas cond-mat.stat-mech hep-th quant-ph


title: Self-Interacting Dark Matter, Core Collapse and the Galaxy-Galaxy Strong Lensing Discrepancy

abstract: Gravitational lensing by galaxy clusters has emerged as a powerful tool to probe the standard Cold Dark Matter (CDM) paradigm of structure formation in the Universe. Despite the remarkable explanatory power of CDM on large scales, tensions with observations on small scales have been reported. Recent studies find that the observational cross-section for Galaxy-Galaxy Strong Lensing (GGSL) in clusters exceeds the CDM prediction by more than an order of magnitude, and persists even after rigorous examination of various possible systematics. We investigate the impact of modifying the internal structure of cluster dark matter sub-halos on GGSL and report that altering the inner density profile, given by $r^{\gamma}$, to steeper slopes with $\gamma > 2.5$ can alleviate the GGSL discrepancy. Deviating from the $\gamma \sim 1.0$ cusps that CDM predicts, these steeper slopes could arise in models of self-interacting dark matter undergoing core collapse. Our results motivate additional study of sub-halo core collapse in dense cluster environments.


title: Time Non-locality in Dark Matter and LSS

abstract: We explore the intriguing phenomenon of time non-locality in the evolution of dark matter and Large Scale Structure (LSS). Recently in\,\cite{Donath:2023sav}, it was shown that time non-locality emerges in bias tracer fluctuations, which are $SO(3)$ scalars in real space, at fifth order in the perturbation expansion in dark matter overdensity. We demonstrate that by breaking the symmetry down to $SO(2)$, which is the case whenever line-of-sight effects become important, such as for flux fluctuations in the Lyman $\alpha$ forest, the temporal non-locality appears at the third order in expansion. Additionally, within the framework of EFTofLSS, we demonstrate that time non-locality manifests in the effective stress tensor of dark matter, which is a second rank tensor under $SO(3)$ transformations, again at the third order in dark matter overdensity. Furthermore, we highlight the effectiveness of the standard $\Pi$ basis\,\cite{Mirbabayi:2014zca} in handling time non-local operators.


title: The true nature of HE0057-5959, the most metal-poor Li-rich star

abstract: The Li-rich stars are a class of rare objects with A(Li) higher than that of other stars in the same evolutionary stage. Their origin is still debated and valuable routes are the Cameron-Fowler mechanism, mass transfer process in a binary system or engulfment of small bodies. Metal-poor ([Fe/H]<-1 dex) stars are only a small fraction of the entire population of Li-rich stars. We observed with MIKE at the Magellan Telescope the metal-poor ([Fe/H]=-3.95+-0.11 dex) giant star HE0057-5959, deriving A(Li)=+2.09+-0.07 dex. Such A(Li) is higher by about 1 dex than that of other stars in the same evolutionary stage. A previous analysis of the same target suggested that its high A(Li) reflects a still ongoing First Dredge-Up process. We revise the nature of HE0057-5959 by comparing its stellar parameters and A(Li) with appropriate stellar evolution models. This comparison rules out that HE0057-5959 is caught during its First Dredge-Up, being this latter already ended according to the parameters of this star. Its A(Li), remarkably higher than the typical lithium plateau drawn by similar giant stars, demonstrates that HE0057-5959 joins the class of the rare metal-poor Li-rich stars. HE0057-5959 is the most metal-poor Li-rich star discovered so far. We consider different scenarios to explain this star. No internal mixing able to activate the Cameron-Fowler mechanism is known for metal-poor stars at this evolutionary stage. Also the engulfment of planets is disfavored because such metal-poor stars should not host planets. Finally, HE0057-5959 is one of the most Na-rich among the Li-rich stars and we found that a strong excess of Na is common to the three Li-rich stars with [Fe/H]<-3 dex. This finding could support the scenario of mass transfer from a massive companion star in a binary system, even if we found no evidence of radial velocity variations.


title: Caustic area biases and how to deal with them

abstract: Quadruply-imaged strongly lensed quasars (quads) are routinely used for measurements of the expansion rate of the Universe with time delays. It has recently been suggested that any quad lens is subject to a Malmquist-like bias that causes the inferred area enclosed within the tangential caustic to be systematically underestimated, and that such a bias might translate into a corresponding bias on the expansion parameter. In this work we extended that analysis by also considering the effect of Eddington bias. We found that the sign and amplitude of the combined bias depend on the functional form of the caustic area distribution of the lens population and on the noise associated with the caustic area estimation process. Based on simulations, we estimated that the corresponding impact on $H_0$ is on the order of a percent or smaller. If the likelihood of the lensing data is known, then the bias can be accounted for when modelling the lens population. However, ignoring the criteria used to select a quad might lead to a bias at the lens modelling stage that causes the inferred caustic area to be overestimated. Such a bias disappears for lens models that are well constrained by the data.


title: Cosmic Stability of Dark Matter from Pauli Blocking

abstract: Why does dark matter (DM) live longer than the age of the Universe? Here we study a novel sub-eV scalar DM candidate whose stability is due to the Pauli exclusion of its fermionic decay products. We analyze the stability of the DM condensate against decays, scatterings (i.e., evaporation), and parametric resonance, delineating the viable parameter regions in which DM is cosmologically stable. In a minimal scenario in which the scalar DM decays to a pair of new exotic fermions, we find that scattering can populate an interacting thermal dark sector component to energies far above the DM mass. This self-interacting dark radiation may potentially alleviate the Hubble tensions. Furthermore, our scenario can be probed through precise measurements of the halo mass function or the masses of dwarf spheroidal galaxies since scattering prevents the DM from becoming too dense. On the other hand, if the lightest neutrino stabilizes the DM, the cosmic neutrino background (C$\nu$B) can be significantly altered from the $\Lambda$CDM prediction and thus be probed in the future by C$\nu$B detection experiments.


title: Unconventional superconductivity from electronic dipole fluctuations

abstract: We study electron-electron Coulomb interactions in electronic systems whose Fermi surfaces possess a finite electric dipole density. Although this dipole density averages to zero over the Fermi surface, electric monopole-dipole interactions can become sufficiently strong in quasi-2D Dirac metals with spin-orbit coupling to induce unconventional odd-parity superconductivity, similar to the Balian-Werthamer state of ${}^{3}$He-B. Hence materials with spin-orbit-induced band inversion, such as the doped topological insulators Bi${}_{2}$Se${}_{3}$, Bi${}_{2}$Te${}_{3}$, and SnTe, are natural candidate materials where our theory could be relevant. We discuss the conditions for an electric dipole density to appear on the Fermi surface and develop the formalism to describe its coupling to the plasmon field which mediates the Coulomb interaction. A mechanism for the enhancement of dipolar coupling is then provided for quasi-2D Dirac systems. Within a large-N renormalization group treatment, we show that the out-of-plane electric dipole moment is marginally relevant, in contrast to the monopole coupling constant which is marginally irrelevant. For physically realistic parameters, we find that dipole fluctuations can get sufficiently enhanced to result in Cooper pairing.


title: Analytic bounds on late-time axion-scalar cosmologies

abstract: The cosmological dynamics of multiple scalar/pseudoscalar fields are difficult to solve, especially when the field-space metric is curved. This presents a challenge in determining whether a given model can support cosmic acceleration, without solving for the on-shell solution. In this work, we present bounds on late-time FLRW-cosmologies in classes of theories that involve arbitrary numbers of scalar and pseudoscalar fields coupled both kinetically (leading to a curved field space metric) and through scalar potentials. Such bounds are proven analytically, independently of initial conditions, with no approximation in the field equations and without referring to explicit solutions. Besides their broad applications to cosmological model building, our bounds can be applied to studying asymptotic cosmologies of certain classes of string compactifications.


title: Impact of extragalactic point sources on the low-frequency sky spectrum and cosmic dawn global 21-cm measurements

abstract: Contribution of resolved and unresolved extragalactic point sources to the low-frequency sky spectrum is a potentially non-negligible part of the astrophysical foregrounds for cosmic dawn 21-cm experiments. The clustering of such point sources on the sky, combined with the frequency-dependence of the antenna beam, can also make this contribution chromatic. By combining low-frequency measurements of the luminosity function and the angular correlation function of extragalactic point sources, we develop a model for the contribution of these sources to the low-frequency sky spectrum. Using this model, we find that the contribution of sources with flux density $>10^{-6}\,$Jy to the sky-averaged spectrum is smooth and of the order of a few kelvins at 50 - $200\,$MHz. We combine this model with measurements of the galactic foreground spectrum and convolve the result with the beam of the conical log-spiral antenna planned as part of the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH) project. We find that the contribution of point sources to resultant spectrum is $\sim0.4\%$ of the total foregrounds, but still larger by at least an order of magnitude than the standard predictions for the cosmological 21-cm signal. As a result, not accounting for the point-source contribution leads to a systematic bias in 21-cm signal recovery. We show, however, that in the REACH case, this reconstruction bias can be removed by modelling the point-source contribution as a power law with a running spectral index. We make our code publicly available as a Python package labelled epspy.


title: Dwarf: Disease-weighted network for attention map refinement

abstract: The interpretability of deep learning is crucial for evaluating the reliability of medical imaging models and reducing the risks of inaccurate patient recommendations. This study addresses the "human out of the loop" and "trustworthiness" issues in medical image analysis by integrating medical professionals into the interpretability process. We propose a disease-weighted attention map refinement network (Dwarf) that leverages expert feedback to enhance model relevance and accuracy. Our method employs cyclic training to iteratively improve diagnostic performance, generating precise and interpretable feature maps. Experimental results demonstrate significant improvements in interpretability and diagnostic accuracy across multiple medical imaging datasets. This approach fosters effective collaboration between AI systems and healthcare professionals, ultimately aiming to improve patient outcomes


title: Generalized Gibbs ensembles in weakly interacting dissipative systems and digital quantum computers

abstract: Digital quantum computers promise to solve important and challenging problems in many-body quantum physics. However, at least for the superconducting platforms, their current limitation is the noise level. It thus seems more reasonable to presently use them to model dissipative systems, where platforms' native noise is not that crucial. Here, we propose using a digital quantum computer to showcase the activation of integrability by realizing exotic generalized Gibbs ensembles in weakly dissipative integrable systems. Dissipation is realized by coupling system's qubits to periodically reset ancilla ones, like in the protocol recently used to realize dissipative cooling. We derive the effective equations of motion for trotterized dynamics and contrast such a setup to the usual Lindblad continuous evolution. For simplicity, we consider and compare different approaches to calculating steady-states of non-interacting integrable systems weakly coupled to baths, where thermodynamic results can be obtained via a generalized scattering theory between the Bogoliubov quasiparticles. Corresponding quantum computer implementation would illuminate the possibilities of realizing similar exotic states in nearly integrable quantum materials.


title: A solvable embedding mechanism for one-dimensional spinless and Majorana fermions in higher-dimensional spin-1/2 magnets

abstract: We write down a class of two-dimensional quantum spin-1/2 Hamiltonians whose eigenspectra are exactly solvable via the Jordan-Wigner transformation. The general structure corresponds to a suitable grid composed of XY or XX-Ising spin chains and ZZ-Ising spin chains and is generalizable to higher dimensions. They can host stacks of one-dimensional spinless fermion liquids with gapless excitations and power-law correlations coexisting with ordered spin moments (localized spinless fermions). Bond-dependent couplings thus can be an alternate mechanism than geometric frustration of SU(2)-symmetric couplings to obtain spinless fermionic excitations. Put in a different way, bond-dependent couplings allow for an embedding of one-dimensional spinless fermion (Tomonoga-Luttinger) liquids and solids and also Majorana excitations in higher dimensions. They can accommodate a simpler set of site-local conserved quantities apart from the more intricate, interlocked set of plaquette-local or bond-local conserved quantities in Kitaev's honeycomb model with Majorana excitations. The proposed grid structure may provide an architecture for quantum engineering with controllable qubits.


title: High-definition imaging of an extended filament connecting active quasars at cosmic noon

abstract: Filaments connecting halos are a long-standing prediction of cold dark matter theories. We present a novel detection of the cosmic web emission connecting two massive quasar-host galaxies at cosmic noon in the MUSE Ultra Deep Field (MUDF) using unprecedentedly deep observations that unlock a high-definition view of the filament morphology, a measure of the transition radius between the intergalactic and circumgalactic medium, and the characterization of the surface brightness profiles along the filament and in the transverse direction. Through systematic comparisons with simulations, we validate the filaments' typical density predicted in the current cold dark matter model. Our analysis of the MUDF field, an excellent laboratory for quantitatively studying filaments in emission, opens a new avenue to understanding the cosmic web that, being a fundamental prediction of cosmology, bears key information on the essence of dark matter.


title: Superconductivity from spin-canting fluctuations in rhombohedral graphene

abstract: Rhombohedral graphene multilayers host various broken-symmetry metallic phases as well as superconductors whose pairing mechanism and order parameter symmetry remain unsettled. Strikingly, experiments have revealed prominent new superconducting regions in rhombohedral bilayer and trilayer graphene devices with proximity-induced Ising spin-orbit coupling. We propose that these superconductors descend from a common spin-canted normal state that spontaneously breaks a U(1) spin symmetry and thus supports a gapless (Goldstone) magnon mode. In particular, we develop a scenario wherein pairing in the spin-canted state emerges from a novel type of magnon-mediated attraction: Contrary to conventional mechanisms that involve the exchange of a single boson, we show that second-order processes that exchange two magnons are dominant and produce an $s$-wave pairing interaction featuring a unique logarithmic low-frequency divergence. This low-frequency divergence disappears when spin-orbit coupling vanishes, providing a promising explanation for spin-orbit-enabled pairing. Numerous other experimental observations -- including nontrivial dependence of superconductivity on the spin-orbit coupling strength, in-plane magnetic fields, and Fermi surface structure -- also naturally follow from our scenario.


title: Cheaper and more noise-resilient quantum state preparation using eigenvector continuation

abstract: Subspace methods are powerful, noise-resilient methods that can effectively prepare ground states on quantum computers. The challenge is to get a subspace with a small condition number that spans the states of interest using minimal quantum resources. In this work, we will use eigenvector continuation (EC) to build a subspace from the low-lying states of a set of Hamiltonians. The basis vectors are prepared using truncated versions of standard state preparation methods such as imaginary time evolution (ITE) and adiabatic state preparation (ASP). By using these truncated methods combined with eigenvector continuation, we can directly improve upon them, obtaining more accurate ground state energies at a reduced cost. We use several spin systems to demonstrate convergence even when methods like ITE and ASP fail, such as ASP in the presence of level crossings and ITE with vanishing energy gaps. We also showcase the noise resilience of this approach beyond the gains already made by having a shallower quantum circuit. Our findings suggest that eigenvector continuation can be used to improve existing state preparation methods in the near term.


title: modeLing: A Novel Dataset for Testing Linguistic Reasoning in Language Models

abstract: We introduce modeLing, a novel benchmark of Linguistics Olympiad-style puzzles which tests few-shot reasoning in AI systems. Solving these puzzles necessitates inferring aspects of a language's grammatical structure from a small number of examples. Such puzzles provide a natural testbed for language models, as they require compositional generalization and few-shot inductive reasoning. Consisting solely of new puzzles written specifically for this work, modeLing has no risk of appearing in the training data of existing AI systems: this ameliorates the risk of data leakage, a potential confounder for many prior evaluations of reasoning. Evaluating several large open source language models and GPT on our benchmark, we observe non-negligible accuracy, demonstrating few-shot emergent reasoning ability which cannot merely be attributed to shallow memorization. However, imperfect model performance suggests that modeLing can be used to measure further progress in linguistic reasoning.


title: Thermal Dark Matter with Low-Temperature Reheating

abstract: We explore the production of thermal dark matter (DM) candidates (WIMPs, SIMPs, ELDERs and Cannibals) during cosmic reheating. Assuming a general parametrization for the scaling of the inflaton energy density and the standard model (SM) temperature, we study the requirements for kinetic and chemical DM freeze-out in a model-independent way. For each of the mechanisms, up to two solutions that fit the entire observed DM relic density exist, for a given reheating scenario and DM mass. As an example, we assume a simple particle physics model in which DM interacts with itself and with SM through contact interactions. We find that low-temperature reheating can accommodate a wider range of couplings and larger masses than those permitted in the usual instantaneous high-temperature reheating. This results in DM solutions for WIMPs reaching masses as high as $10^{14}$~GeV, whereas for SIMPs and ELDERs, we can reach masses of $10^{13}$~GeV. Interestingly, current experimental data already constrain the enlarged parameter space of these models with low-reheating temperatures. Next-generation experiments could further probe these scenarios.


title: Lepton Flavor-Violating Higgs Decays Mediated by Ultralight Gauge Boson

abstract: We present an analysis of the lepton-flavor violating decay of the Higgs boson mediated by an ultralight gauge boson, $\chi$. Our analysis matches a model generating the lepton flavor-violating interaction $\bar{\ell}_i\ell_j\chi$ at tree level with an effective field theory, safeguarding the $\chi$-boson mass as it tends to zero. By utilizing the upper bounds on $H\to\ell_i \bar\ell_j$ decays from CMS and ATLAS Collaborations, we establish an indirect upper limit on the nonstandard decay $H\to\ell_i \bar\ell_j\chi$. The analysis encompasses various observables such as the lepton energy spectrum, Dalitz plot distribution, and Lepton Charge and Forward-Backward Asymmetries.


title: A New Gravitational Wave Probe to the Nature of Dark Energy from the Aging of the Universe: Can Future Detectors Achieve it?

abstract: One of the most dominant energy budget of the Universe is Dark Energy, which remains enigmatic since the claim of its existence from the observation of late-time cosmic acceleration. We propose a new way of inferring this by measuring the aging of the Universe using only gravitational wave (GW) signals from coalescing binary compact objects of any masses. We show that the aging of the Universe will lead to a change in the observed chirp mass of the GW sources inferred from different stages of its coalesces by monitoring a coherent source from two far-apart GW frequencies for a few years. We show that coordinated GW detectors which can reach a relative uncertainty on chirp mass measurement of about $10^{-9}$, can measure a tiny departure of about $2\%$ from the dark energy equation of state parameter $w_0=-1$ and its variation with cosmic time by using stellar origin binary black holes up to redshift $z=5$ in 10 years of observation time without using any external calibrator. If the next generation of GW detectors can achieve this precision, then it can open a new window to discover the fundamental nature of dark energy.


title: Critical properties of metallic and deconfined quantum critical points in Dirac systems

abstract: We use large-scale fermion quantum Monte Carlo simulations to study metallic and deconfined quantum phase transitions in a bilayer honeycomb model, focusing on their quantum critical and finite-temperature properties. At weak interaction, a fully symmetric Dirac semimetal state is realized. At intermediate and strong interaction, respectively, two long-range-ordered phases that break different symmetries are stabilized. The ordered phases feature partial and full, respectively, gap openings in the fermion spectrum. We clarify the symmetries of the different zero-temperature phases and the symmetry breaking patterns across the two quantum phase transitions between them. The first transition between the disordered and long-range-ordered semimetallic phases has previously been argued to be described by the $(2+1)$-dimensional Gross-Neveu-SO(3) field theory. By performing simulations with an improved symmetric Trotter decomposition, we further substantiate this claim by computing the critical exponents $1/\nu$, $\eta_\phi$, and $\eta_\psi$, which turn out to be consistent with the field-theoretical expectation within numerical and analytical uncertainties. The second transition between the two long-range-ordered phases has previously been proposed as a possible instance of a metallic deconfined quantum critical point. We further develop this scenario by analyzing the spectral functions in the single-particle, particle-hole, and particle-particle channels. Our results indicate gapless excitations with a unique velocity, supporting the emergence of Lorentz symmetry at criticality. We also determine the finite-temperature phase boundaries above the fully gapped state at large interaction, which smoothly vanish near the putative metallic deconfined quantum critical point, consistent with a continuous or weakly first-order transition.


title: The hidden architecture of connections: How do multidimensional identities shape our social networks?

abstract: Our multidimensional identities determine how we interact with each other, shaping social networks through group-based connection preferences. While interactions along single dimensions have been extensively studied, the dynamics driving multidimensional connection preferences remain largely unexplored. In this work, we develop a network model of multidimensional social interactions to tackle two crucial questions: What is the structure of our latent connection preferences, and how do we integrate information from our multidimensional identities to connect with others? To answer these questions, we systematically model different latent preference structures and preference aggregation mechanisms. Then, we compare them using Bayesian model selection by fitting empirical data from high school friendship networks. We find that a simple latent preference model consistently outperforms more complex alternatives. The calibrated model provides robust measures of latent connection preferences in real-world networks, bringing insights into how one- and multidimensional groups interact. Finally, we develop natural operationalizations of dimension salience, revealing which aspects of identity are most relevant for individuals when forming connections.


title: Fault-tolerant embedding of quantum circuits on hardware architectures via swap gates

abstract: In near-term quantum computing devices, connectivity between qubits remain limited by architectural constraints. A computational circuit with given connectivity requirements necessary for multi-qubit gates have to be embedded within physical hardware with fixed connectivity. Long-distance gates have to be done by first routing the relevant qubits together. The simplest routing strategy involves the use of swap gates to swap the information carried by two unconnected qubits to connected ones. Ideal swap gates just permute the qubits; real swap gates, however, have the added possibilities of causing simultaneous errors on the qubits involved and spreading errors across the circuit. A general swap scheme thus changes the error-propagation properties of a circuit, including those necessary for fault-tolerant functioning of a circuit. Here, we present a simple strategy to design the swap scheme needed to embed an abstract circuit onto a physical hardware with constrained connectivity, in a manner that preserves the fault-tolerant properties of the abstract circuit. The embedded circuit will, of course, be noisier, compared to a native implementation of the abstract circuit, but we show in the examples of embedding surface codes on heavy-hexagonal and hexagonal lattices that the deterioration is not severe. This then offers a straightforward solution to implementing circuits with fault-tolerance properties on current hardware.


title: Topological Data Analysis via Undergraduate Linear Algebra

abstract: Topological Data Analysis has grown in popularity in recent years as a way to apply tools from algebraic topology to large data sets. One of the main tools in topological data analysis is persistent homology. This paper uses undergraduate linear algebra to provide explicit methods for, and examples of, computing persistent (co)homology.


title: Superconducting diode effect in diffusive superconductors and Josephson junctions with Rashba spin-orbit coupling

abstract: We characterize the superconducting diode effect (SDE) in two-dimensional diffusive structures with Rashba spin-orbit coupling using the quasiclassical formalism. We consider both homogeneous superconductors and Josephson junctions. In the first case, the diode effect monotonically increases as the magnetic field is increased and the temperature is reduced, in contrast to the non-monotonic behavior found in clean structures. In Josephson junctions, SDE dramatically increases and changes its sign close to the $0-\pi$ transition of the junction, which occurs at specific junction lengths and strengths of the magnetic field. We show that the SDE is strongly suppressed in narrow junctions. Our results are relevant for understanding recent experiments that measure SDE in mesoscopic nanostructures, where significant disorder is unavoidable.


title: Enhancing Scientific Figure Captioning Through Cross-modal Learning

abstract: Scientific charts are essential tools for effectively communicating research findings, serving as a vital medium for conveying information and revealing data patterns. With the rapid advancement of science and technology, coupled with the advent of the big data era, the volume and diversity of scientific research data have surged, leading to an increase in the number and variety of charts. This trend presents new challenges for researchers, particularly in efficiently and accurately generating appropriate titles for these charts to better convey their information and results. Automatically generated chart titles can enhance information retrieval systems by providing precise data for detailed chart classification. As research in image captioning and text summarization matures, the automatic generation of scientific chart titles has gained significant attention. By leveraging natural language processing, machine learning, and multimodal techniques, it is possible to automatically extract key information from charts and generate accurate, concise titles that better serve the needs of researchers. This paper presents a novel approach to scientific chart title generation, demonstrating its effectiveness in improving the clarity and accessibility of research data.


title: Junction conditions in a general field theory

abstract: It is well-known in the modified gravity scene that the calculation of junction conditions in certain complicated theories leads to ambiguities and conflicts between the various formulations. This paper introduces a general framework to compute junction conditions in any reasonable classical field theory and analyzes their properties. We prove that in any variational field theory, it is possible to define unambiguous and mathematically well-defined junction conditions either by interpreting the Euler-Lagrange differential equation as a distribution or as the extremals of a variational functional and these two coincide. We provide an example calculation which highlights why ambiguities in the existing formalisms have arisen, essentially due to incorrect usage of distributions. Relations between junction conditions, the boundary value problem of variational principles and Gibbons--Hawking--York-like surface terms are examined. The methods presented herein relies on the use of coordinates adapted to represent the junction surface as a leaf in a foliation and a technique for reducing the order of Lagrangians to the lowest possible in the foliation parameter. We expect that the reduction theorem can generate independent interest from the rest of the topics considered in the paper.


title: Fast Switching Serial and Parallel Paradigms of SNN Inference on Multi-core Heterogeneous Neuromorphic Platform SpiNNaker2

abstract: With serial and parallel processors are introduced into Spiking Neural Networks (SNNs) execution, more and more researchers are dedicated to improving the performance of the computing paradigms by taking full advantage of strengths of the available processor. In this paper, we compare and integrate serial and parallel paradigms into one SNN compiling system. For a faster switching between them in the layer granularity, we train the classifier to prejudge a better paradigm before compiling instead of making decision afterwards, saving a great amount of compiling time and RAM space on host PC. The classifier Adaptive Boost with the highest accuracy (91.69 percent) among 12 classifiers is integrated into the switching system, which utilizes less memory and processors on the multi-core neuromorphic hardware backend SpiNNaker2 than two individual paradigms. To the best of our knowledge, it is the first fast switching compiling system for SNN simulation.


title: Pressure-induced exciton formation and superconductivity in platinum-based mineral Sperrylite

abstract: We report a comprehensive study of Sperrylite (PtAs2), the main platinum source in natural minerals, as a function of applied pressures up to 150 GPa. While no structural phase transition was detected from pressure-dependent X-ray measurements, the unit cell volume shrinks monotonically with pressure following the third-order Birch-Murnaghan equation of state. The mildly semiconducting behavior found in pure synthesized crystals at ambient pressures becomes more insulating upon increasing applied pressure before metalizing at higher pressures, giving way to the appearance of an abrupt decrease in resistance near 3 K at pressures above 92 GPa consistent with the onset of a superconducing phase. The pressure evolution of the calculated electronic band structure reveals the same physical trend as our transport measurements, with a non-monotonic evolution explained by a hole band that is pushed below the Fermi energy and an electron band that approaches it as a function of pressure, both reaching a touching point suggestive of an excitonic state. A topological Lifshitz transition of the electronic structure and an increase in the density of states may naturally explain the onset of superconductivity in this material


title: Leveraging Knowledge Distillation for Lightweight Skin Cancer Classification: Balancing Accuracy and Computational Efficiency

abstract: Skin cancer is a major concern to public health, accounting for one-third of the reported cancers. If not detected early, the cancer has the potential for severe consequences. Recognizing the critical need for effective skin cancer classification, we address the limitations of existing models, which are often too large to deploy in areas with limited computational resources. In response, we present a knowledge distillation based approach for creating a lightweight yet high-performing classifier. The proposed solution involves fusing three models, namely ResNet152V2, ConvNeXtBase, and ViT Base, to create an effective teacher model. The teacher model is then employed to guide a lightweight student model of size 2.03 MB. This student model is further compressed to 469.77 KB using 16-bit quantization, enabling smooth incorporation into edge devices. With six-stage image preprocessing, data augmentation, and a rigorous ablation study, the model achieves an impressive accuracy of 98.75% on the HAM10000 dataset and 98.94% on the Kaggle dataset in classifying benign and malignant skin cancers. With its high accuracy and compact size, our model appears to be a potential choice for accurate skin cancer classification, particularly in resource-constrained settings.


title: Formation of Sub-Chandrasekhar Mass Black Holes and Red Stragglers via Hawking Stars in Ultra-Faint Dwarf Galaxies

abstract: Presently, primordial black holes (PBHs) in the asteroid-mass window from $10^{-16}$ M$_\odot$ to $10^{-10}$ M$_\odot$ are a popular dark matter candidate. If they exist, some stars would capture them upon formation, and they would slowly accrete the star over gigayears. Such Hawking stars -- stars with a central PBH -- provide a novel channel for the formation of both sub-Chandrasekhar mass black holes as well as red straggler stars. Here we report on stellar evolution models that extend our previous work to Hawking stars with masses between 0.5 and 1.4 M$_\odot$. We explore three accretion schemes, and find that a wide range of PBHs in the asteroid-mass window can robustly accrete stars as small as 1 M$_{\odot}$ within the age of the Universe. This mechanism of producing sub-solar mass black holes is highly dependent on the assumed accretion physics and stellar metallicity. Lower-metallicity stars are generally accreted more rapidly, suggesting that it may be more likely for sub-Chandrasekhar mass Hawking stars formed in the early universe, such as those in ultra-faint dwarf (UFD) galaxies, to transmute their star into a sub-Chandrasekhar mass black hole within a Hubble time. We present a stellar population synthesis of a Draco II-like UFD galaxy containing Hawking stars and show that the number of red stragglers they produce can qualitatively match the observed population.


title: Revisiting evolution of domain walls and their gravitational radiation with CosmoLattice

abstract: Employing the publicly available CosmoLattice code, we conduct numerical simulations of a domain wall network and the resulting gravitational waves (GWs) in a radiation-dominated Universe in the $Z_2$-symmetric scalar field model. In particular, the domain wall evolution is investigated in detail both before and after reaching the scaling regime, using the combination of numerical and theoretical methods. We demonstrate that the total area of closed walls is negligible compared to that of a single long wall stretching throughout the simulation box. Therefore, the closed walls are unlikely to have a significant impact on the overall network evolution. This is in contrast with the case of cosmic strings, where formation of loops is crucial for maintaining the system in the scaling regime. To obtain the GW spectrum, we develop a technique that separates physical effects from numerical artefacts arising due to finite box size and non-zero lattice spacing. Our results on the GW spectrum agree well with Refs. [29, 30], which use different codes. Notably, we observe a peak at the Hubble scale, an exponential falloff at scales shorter than the wall width, and a plateau/bump at intermediate scales. We also study sensitivity of obtained results on the choice of initial conditions. We find that different types of initial conditions lead to qualitatively similar domain wall evolution in the scaling regime, but with important variations translating into different intensities of GWs.


title: Mean-Field Langevin Dynamics for Signed Measures via a Bilevel Approach

abstract: Mean-field Langevin dynamics (MLFD) is a class of interacting particle methods that tackle convex optimization over probability measures on a manifold, which are scalable, versatile, and enjoy computational guarantees. However, some important problems -- such as risk minimization for infinite width two-layer neural networks, or sparse deconvolution -- are originally defined over the set of signed, rather than probability, measures. In this paper, we investigate how to extend the MFLD framework to convex optimization problems over signed measures. Among two known reductions from signed to probability measures -- the lifting and the bilevel approaches -- we show that the bilevel reduction leads to stronger guarantees and faster rates (at the price of a higher per-iteration complexity). In particular, we investigate the convergence rate of MFLD applied to the bilevel reduction in the low-noise regime and obtain two results. First, this dynamics is amenable to an annealing schedule, adapted from Suzuki et al. (2023), that results in improved convergence rates to a fixed multiplicative accuracy. Second, we investigate the problem of learning a single neuron with the bilevel approach and obtain local exponential convergence rates that depend polynomially on the dimension and noise level (to compare with the exponential dependence that would result from prior analyses).


title: Large Language Models Assume People are More Rational than We Really are

abstract: In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language Models (LLMs) must account for this. Previous empirical evidence seems to suggest that these implicit models are accurate -- LLMs offer believable proxies of human behavior, acting how we expect humans would in everyday interactions. However, by comparing LLM behavior and predictions to a large dataset of human decisions, we find that this is actually not the case: when both simulating and predicting people's choices, a suite of cutting-edge LLMs (GPT-4o & 4-Turbo, Llama-3-8B & 70B, Claude 3 Opus) assume that people are more rational than we really are. Specifically, these models deviate from human behavior and align more closely with a classic model of rational choice -- expected value theory. Interestingly, people also tend to assume that other people are rational when interpreting their behavior. As a consequence, when we compare the inferences that LLMs and people draw from the decisions of others using another psychological dataset, we find that these inferences are highly correlated. Thus, the implicit decision-making models of LLMs appear to be aligned with the human expectation that other people will act rationally, rather than with how people actually act.


title: Efficient two-sample instrumental variable estimators with change points and near-weak identification

abstract: We consider estimation and inference in a linear model with endogenous regressors where the parameters of interest change across two samples. If the first-stage is common, we show how to use this information to obtain more efficient two-sample GMM estimators than the standard split-sample GMM, even in the presence of near-weak instruments. We also propose two tests to detect change points in the parameters of interest, depending on whether the first-stage is common or not. We derive the limiting distribution of these tests and show that they have non-trivial power even under weaker and possibly time-varying identification patterns. The finite sample properties of our proposed estimators and testing procedures are illustrated in a series of Monte-Carlo experiments, and in an application to the open-economy New Keynesian Phillips curve. Our empirical analysis using US data provides strong support for a New Keynesian Phillips curve with incomplete pass-through and reveals important time variation in the relationship between inflation and exchange rate pass-through.


title: At First Sight: Zero-Shot Classification of Astronomical Images with Large Multimodal Models

abstract: Vision-Language multimodal Models (VLMs) offer the possibility for zero-shot classification in astronomy: i.e. classification via natural language prompts, with no training. We investigate two models, GPT-4o and LLaVA-NeXT, for zero-shot classification of low-surface brightness galaxies and artifacts, as well as morphological classification of galaxies. We show that with natural language prompts these models achieved significant accuracy (above 80 percent typically) without additional training/fine tuning. We discuss areas that require improvement, especially for LLaVA-NeXT, which is an open source model. Our findings aim to motivate the astronomical community to consider VLMs as a powerful tool for both research and pedagogy, with the prospect that future custom-built or fine-tuned models could perform better.


title: Bayesian Deep ICE

abstract: Deep Independent Component Estimation (DICE) has many applications in modern day machine learning as a feature engineering extraction method. We provide a novel latent variable representation of independent component analysis that enables both point estimates via expectation-maximization (EM) and full posterior sampling via Markov Chain Monte Carlo (MCMC) algorithms. Our methodology also applies to flow-based methods for nonlinear feature extraction. We discuss how to implement conditional posteriors and envelope-based methods for optimization. Through this representation hierarchy, we unify a number of hitherto disjoint estimation procedures. We illustrate our methodology and algorithms on a numerical example. Finally, we conclude with directions for future research.


title: Exactly solvable non-unitary time evolution in quantum critical systems I: Effect of complex spacetime metrics

abstract: In this series of works, we study exactly solvable non-unitary time evolutions in one-dimensional quantum critical systems ranging from quantum quenches to time-dependent drivings. In this part I, we are motivated by the recent works of Kontsevich and Segal [1] and Witten [2] on allowable complex spacetime metrics in quantum field theories. In general, such complex spacetime metrics will lead to non-unitary time evolutions. In this work, we study the universal features of such non-unitary time evolutions based on exactly solvable setups. Various physical quantities including entanglement Hamiltonian and entanglement spectrum, entanglement entropy, and energy density at an arbitrary time can be exactly solved. Due to the damping effect introduced by the complex time, the excitations in the initial state are gradually damped out in time. The non-equilibrium dynamics exhibits universal features that are qualitatively different from the case of real-time evolutions. For instance, for an infinite system after a global quench, the entanglement entropy of the semi-infinite subsystem will grow logarithmically in time, in contrast to the linear growth in a real-time evolution. Moreover, we study numerically the time-dependent driven quantum critical systems with allowable complex spacetime metrics. It is found that the competition between driving and damping leads to a steady state with an interesting entanglement structure.

categories: cond-mat.stat-mech hep-th math-ph math.MP quant-ph