title: Self-supervised Dataset Distillation: A Good Compression Is All You Need

abstract: Dataset distillation aims to compress information from a large-scale original dataset to a new compact dataset while striving to preserve the utmost degree of the original data informational essence. Previous studies have predominantly concentrated on aligning the intermediate statistics between the original and distilled data, such as weight trajectory, features, gradient, BatchNorm, etc. In this work, we consider addressing this task through the new lens of model informativeness in the compression stage on the original dataset pretraining. We observe that with the prior state-of-the-art SRe$^2$L, as model sizes increase, it becomes increasingly challenging for supervised pretrained models to recover learned information during data synthesis, as the channel-wise mean and variance inside the model are flatting and less informative. We further notice that larger variances in BN statistics from self-supervised models enable larger loss signals to update the recovered data by gradients, enjoying more informativeness during synthesis. Building on this observation, we introduce SC-DD, a simple yet effective Self-supervised Compression framework for Dataset Distillation that facilitates diverse information compression and recovery compared to traditional supervised learning schemes, further reaps the potential of large pretrained models with enhanced capabilities. Extensive experiments are conducted on CIFAR-100, Tiny-ImageNet and ImageNet-1K datasets to demonstrate the superiority of our proposed approach. The proposed SC-DD outperforms all previous state-of-the-art supervised dataset distillation methods when employing larger models, such as SRe$^2$L, MTT, TESLA, DC, CAFE, etc., by large margins under the same recovery and post-training budgets. Code is available at https://github.com/VILA-Lab/SRe2L/tree/main/SCDD/.


title: Gaga: Group Any Gaussians via 3D-aware Memory Bank

abstract: We introduce Gaga, a framework that reconstructs and segments open-world 3D scenes by leveraging inconsistent 2D masks predicted by zero-shot segmentation models. Contrasted to prior 3D scene segmentation approaches that heavily rely on video object tracking, Gaga utilizes spatial information and effectively associates object masks across diverse camera poses. By eliminating the assumption of continuous view changes in training images, Gaga demonstrates robustness to variations in camera poses, particularly beneficial for sparsely sampled images, ensuring precise mask label consistency. Furthermore, Gaga accommodates 2D segmentation masks from diverse sources and demonstrates robust performance with different open-world zero-shot segmentation models, enhancing its versatility. Extensive qualitative and quantitative evaluations demonstrate that Gaga performs favorably against state-of-the-art methods, emphasizing its potential for real-world applications such as scene understanding and manipulation.


title: On average output entropy of a quantum channel

abstract: We describe analytical properties of the average output entropy of a quantum channel as a function of a pair (channel, input ensemble). In particular, tight semicontinuity bounds for this function with the rank/energy constraints are obtained by using the modified semicontinuity bounds for the quantum conditional entropy of quantum-classical states and a special approximation technique. Several applications are considered. New semicontinuity and continuity bounds for the output Holevo information of a channel as a function of a pair (channel, input ensemble) are obtained. The semicontinuity bound for the entanglement of formation with the rank constraint obtained in [1] is improved. In the preliminary part, some results concerning ensembles of quantum states are presented. In particular, a new useful metric on the set of generalized ensembles is proposed and explored. The concept of passive energy of an ensemble introduced here plays an important role in the article.


title: LLoCO: Learning Long Contexts Offline

abstract: Processing long contexts remains a challenge for large language models (LLMs) due to the quadratic computational and memory overhead of the self-attention mechanism and the substantial KV cache sizes during generation. We propose a novel approach to address this problem by learning contexts offline through context compression and in-domain parameter-efficient finetuning. Our method enables an LLM to create a concise representation of the original context and efficiently retrieve relevant information to answer questions accurately. We introduce LLoCO, a technique that combines context compression, retrieval, and parameter-efficient finetuning using LoRA. Our approach extends the effective context window of a 4k token LLaMA2-7B model to handle up to 128k tokens. We evaluate our approach on several long-context question-answering datasets, demonstrating that LLoCO significantly outperforms in-context learning while using $30\times$ fewer tokens during inference. LLoCO achieves up to $7.62\times$ speed-up and substantially reduces the cost of long document question answering, making it a promising solution for efficient long context processing. Our code is publicly available at https://github.com/jeffreysijuntan/lloco.


title: ISCOs and the weak gravity conjecture bound in Gauss-Bonnet gravity

abstract: We study circular orbits of charged particles in spherically symmetric AdS black holes in Gauss-Bonnet gravity in arbitrary dimensions, and their limiting ISCOs (innermost stable circular orbits). The dual interpretation is in terms of certain conformal field theory (CFT) operators, whose anomalous dimensions can be extracted from the binding energy of charged probes in the bulk, in a large radius limit. The charge to mass ratio of particles in the black hole background is found to increase with the Gauss-Bonnet coupling parameter $\widetilde{\alpha}$, consistent with the Weak Gravity Conjecture (WGC) bound known for self-repulsive particles. The radius of the ISCOs decreases with $\widetilde{\alpha}$, existing until the limit set by the WGC bound.


title: Manipulating Large Language Models to Increase Product Visibility

abstract: Large language models (LLMs) are increasingly being integrated into search engines to provide natural language responses tailored to user queries. Customers and end-users are also becoming more dependent on these models for quick and easy purchase decisions. In this work, we investigate whether recommendations from LLMs can be manipulated to enhance a product's visibility. We demonstrate that adding a strategic text sequence (STS) -- a carefully crafted message -- to a product's information page can significantly increase its likelihood of being listed as the LLM's top recommendation. To understand the impact of STS, we use a catalog of fictitious coffee machines and analyze its effect on two target products: one that seldom appears in the LLM's recommendations and another that usually ranks second. We observe that the strategic text sequence significantly enhances the visibility of both products by increasing their chances of appearing as the top recommendation. This ability to manipulate LLM-generated search responses provides vendors with a considerable competitive advantage and has the potential to disrupt fair market competition. Just as search engine optimization (SEO) revolutionized how webpages are customized to rank higher in search engine results, influencing LLM recommendations could profoundly impact content optimization for AI-driven search services. Code for our experiments is available at https://github.com/aounon/llm-rank-optimizer.


title: Language Imbalance Can Boost Cross-lingual Generalisation

abstract: Multilinguality is crucial for extending recent advancements in language modelling to diverse linguistic communities. To maintain high performance while representing multiple languages, multilingual models ideally align representations, allowing what is learned in one language to generalise to others. Prior research has emphasised the importance of parallel data and shared vocabulary elements as key factors for such alignment. In this study, we investigate an unintuitive novel driver of cross-lingual generalisation: language imbalance. In controlled experiments on perfectly equivalent cloned languages, we observe that the existence of a predominant language during training boosts the performance of less frequent languages and leads to stronger alignment of model representations across languages. Furthermore, we find that this trend is amplified with scale: with large enough models or long enough training, we observe that bilingual training data with a 90/10 language split yields better performance on both languages than a balanced 50/50 split. Building on these insights, we design training schemes that can improve performance in all cloned languages, even without altering the training data. As we extend our analysis to real languages, we find that infrequent languages still benefit from frequent ones, yet whether language imbalance causes cross-lingual generalisation there is not conclusive.


title: Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Representation Learning

abstract: Contrastive vision-language models like CLIP have gained popularity for their versatile applicable learned representations in various downstream tasks. Despite their successes in some tasks, like zero-shot image recognition, they also perform surprisingly poor on other tasks, like attribute detection. Previous work has attributed these challenges to the modality gap, a separation of image and text in the shared representation space, and a bias towards objects over other factors, such as attributes. In this work we investigate both phenomena. We find that only a few embedding dimensions drive the modality gap. Further, we propose a measure for object bias and find that object bias does not lead to worse performance on other concepts, such as attributes. But what leads to the emergence of the modality gap and object bias? To answer this question we carefully designed an experimental setting which allows us to control the amount of shared information between the modalities. This revealed that the driving factor behind both, the modality gap and the object bias, is the information imbalance between images and captions.


title: View Selection for 3D Captioning via Diffusion Ranking

abstract: Scalable annotation approaches are crucial for constructing extensive 3D-text datasets, facilitating a broader range of applications. However, existing methods sometimes lead to the generation of hallucinated captions, compromising caption quality. This paper explores the issue of hallucination in 3D object captioning, with a focus on Cap3D method, which renders 3D objects into 2D views for captioning using pre-trained models. We pinpoint a major challenge: certain rendered views of 3D objects are atypical, deviating from the training data of standard image captioning models and causing hallucinations. To tackle this, we present DiffuRank, a method that leverages a pre-trained text-to-3D model to assess the alignment between 3D objects and their 2D rendered views, where the view with high alignment closely represent the object's characteristics. By ranking all rendered views and feeding the top-ranked ones into GPT4-Vision, we enhance the accuracy and detail of captions, enabling the correction of 200k captions in the Cap3D dataset and extending it to 1 million captions across Objaverse and Objaverse-XL datasets. Additionally, we showcase the adaptability of DiffuRank by applying it to pre-trained text-to-image models for a Visual Question Answering task, where it outperforms the CLIP model.


title: WaveMo: Learning Wavefront Modulations to See Through Scattering

abstract: Imaging through scattering media is a fundamental and pervasive challenge in fields ranging from medical diagnostics to astronomy. A promising strategy to overcome this challenge is wavefront modulation, which induces measurement diversity during image acquisition. Despite its importance, designing optimal wavefront modulations to image through scattering remains under-explored. This paper introduces a novel learning-based framework to address the gap. Our approach jointly optimizes wavefront modulations and a computationally lightweight feedforward "proxy" reconstruction network. This network is trained to recover scenes obscured by scattering, using measurements that are modified by these modulations. The learned modulations produced by our framework generalize effectively to unseen scattering scenarios and exhibit remarkable versatility. During deployment, the learned modulations can be decoupled from the proxy network to augment other more computationally expensive restoration algorithms. Through extensive experiments, we demonstrate our approach significantly advances the state of the art in imaging through scattering media. Our project webpage is at https://wavemo-2024.github.io/.


title: Trading Determinism for Noncommutativity in Edmonds' Problem

abstract: Let $X=X_1\sqcup X_2\sqcup\ldots\sqcup X_k$ be a partitioned set of variables such that the variables in each part $X_i$ are noncommuting but for any $i\neq j$, the variables $x\in X_i$ commute with the variables $x'\in X_j$. Given as input a square matrix $T$ whose entries are linear forms over $\mathbb{Q}\langle{X}\rangle$, we consider the problem of checking if $T$ is invertible or not over the universal skew field of fractions of the partially commutative polynomial ring $\mathbb{Q}\langle{X}\rangle$ [Klep-Vinnikov-Volcic (2020)]. In this paper, we design a deterministic polynomial-time algorithm for this problem for constant $k$. The special case $k=1$ is the noncommutative Edmonds' problem (NSINGULAR) which has a deterministic polynomial-time algorithm by recent results [Garg-Gurvits-Oliveira-Wigderson (2016), Ivanyos-Qiao-Subrahmanyam (2018), Hamada-Hirai (2021)]. En-route, we obtain the first deterministic polynomial-time algorithm for the equivalence testing problem of $k$-tape \emph{weighted} automata (for constant $k$) resolving a long-standing open problem [Harju and Karhum"{a}ki(1991), Worrell (2013)]. Algebraically, the equivalence problem reduces to testing whether a partially commutative rational series over the partitioned set $X$ is zero or not [Worrell (2013)]. Decidability of this problem was established by Harju and Karhum\"{a}ki (1991). Prior to this work, a \emph{randomized} polynomial-time algorithm for this problem was given by Worrell (2013) and, subsequently, a deterministic quasipolynomial-time algorithm was also developed [Arvind et al. (2021)].


title: ControlNet++: Improving Conditional Controls with Efficient Consistency Feedback

abstract: To enhance the controllability of text-to-image diffusion models, existing efforts like ControlNet incorporated image-based conditional controls. In this paper, we reveal that existing methods still face significant challenges in generating images that align with the image conditional controls. To this end, we propose ControlNet++, a novel approach that improves controllable generation by explicitly optimizing pixel-level cycle consistency between generated images and conditional controls. Specifically, for an input conditional control, we use a pre-trained discriminative reward model to extract the corresponding condition of the generated images, and then optimize the consistency loss between the input conditional control and extracted condition. A straightforward implementation would be generating images from random noises and then calculating the consistency loss, but such an approach requires storing gradients for multiple sampling timesteps, leading to considerable time and memory costs. To address this, we introduce an efficient reward strategy that deliberately disturbs the input images by adding noise, and then uses the single-step denoised images for reward fine-tuning. This avoids the extensive costs associated with image sampling, allowing for more efficient reward fine-tuning. Extensive experiments show that ControlNet++ significantly improves controllability under various conditional controls. For example, it achieves improvements over ControlNet by 7.9% mIoU, 13.4% SSIM, and 7.6% RMSE, respectively, for segmentation mask, line-art edge, and depth conditions.


title: QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer

abstract: We explore the dexterous manipulation transfer problem by designing simulators. The task wishes to transfer human manipulations to dexterous robot hand simulations and is inherently difficult due to its intricate, highly-constrained, and discontinuous dynamics and the need to control a dexterous hand with a DoF to accurately replicate human manipulations. Previous approaches that optimize in high-fidelity black-box simulators or a modified one with relaxed constraints only demonstrate limited capabilities or are restricted by insufficient simulation fidelity. We introduce parameterized quasi-physical simulators and a physics curriculum to overcome these limitations. The key ideas are 1) balancing between fidelity and optimizability of the simulation via a curriculum of parameterized simulators, and 2) solving the problem in each of the simulators from the curriculum, with properties ranging from high task optimizability to high fidelity. We successfully enable a dexterous hand to track complex and diverse manipulations in high-fidelity simulated environments, boosting the success rate by 11\%+ from the best-performed baseline. The project website is available at https://meowuu7.github.io/QuasiSim/.


title: Any2Point: Empowering Any-modality Large Models for Efficient 3D Understanding

abstract: Large foundation models have recently emerged as a prominent focus of interest, attaining superior performance in widespread scenarios. Due to the scarcity of 3D data, many efforts have been made to adapt pre-trained transformers from vision to 3D domains. However, such 2D-to-3D approaches are still limited, due to the potential loss of spatial geometries and high computation cost. More importantly, their frameworks are mainly designed for 2D models, lacking a general any-to-3D paradigm. In this paper, we introduce Any2Point, a parameter-efficient method to empower any-modality large models (vision, language, audio) for 3D understanding. Given a frozen transformer from any source modality, we propose a 3D-to-any (1D or 2D) virtual projection strategy that correlates the input 3D points to the original 1D or 2D positions within the source modality. This mechanism enables us to assign each 3D token with a positional encoding paired with the pre-trained model, which avoids 3D geometry loss caused by the true projection and better motivates the transformer for 3D learning with 1D/2D positional priors. Then, within each transformer block, we insert an any-to-3D guided adapter module for parameter-efficient fine-tuning. The adapter incorporates prior spatial knowledge from the source modality to guide the local feature aggregation of 3D tokens, compelling the semantic adaption of any-modality transformers. We conduct extensive experiments to showcase the effectiveness and efficiency of our method. Code and models are released at https://github.com/Ivan-Tang-3D/Any2Point.


title: OpenBias: Open-set Bias Detection in Text-to-Image Generative Models

abstract: Text-to-image generative models are becoming increasingly popular and accessible to the general public. As these models see large-scale deployments, it is necessary to deeply investigate their safety and fairness to not disseminate and perpetuate any kind of biases. However, existing works focus on detecting closed sets of biases defined a priori, limiting the studies to well-known concepts. In this paper, we tackle the challenge of open-set bias detection in text-to-image generative models presenting OpenBias, a new pipeline that identifies and quantifies the severity of biases agnostically, without access to any precompiled set. OpenBias has three stages. In the first phase, we leverage a Large Language Model (LLM) to propose biases given a set of captions. Secondly, the target generative model produces images using the same set of captions. Lastly, a Vision Question Answering model recognizes the presence and extent of the previously proposed biases. We study the behavior of Stable Diffusion 1.5, 2, and XL emphasizing new biases, never investigated before. Via quantitative experiments, we demonstrate that OpenBias agrees with current closed-set bias detection methods and human judgement.


title: GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh

abstract: We introduce GoMAvatar, a novel approach for real-time, memory-efficient, high-quality animatable human modeling. GoMAvatar takes as input a single monocular video to create a digital avatar capable of re-articulation in new poses and real-time rendering from novel viewpoints, while seamlessly integrating with rasterization-based graphics pipelines. Central to our method is the Gaussians-on-Mesh representation, a hybrid 3D model combining rendering quality and speed of Gaussian splatting with geometry modeling and compatibility of deformable meshes. We assess GoMAvatar on ZJU-MoCap data and various YouTube videos. GoMAvatar matches or surpasses current monocular human modeling algorithms in rendering quality and significantly outperforms them in computational efficiency (43 FPS) while being memory-efficient (3.63 MB per subject).


title: GoMVS: Geometrically Consistent Cost Aggregation for Multi-View Stereo

abstract: Matching cost aggregation plays a fundamental role in learning-based multi-view stereo networks. However, directly aggregating adjacent costs can lead to suboptimal results due to local geometric inconsistency. Related methods either seek selective aggregation or improve aggregated depth in the 2D space, both are unable to handle geometric inconsistency in the cost volume effectively. In this paper, we propose GoMVS to aggregate geometrically consistent costs, yielding better utilization of adjacent geometries. More specifically, we correspond and propagate adjacent costs to the reference pixel by leveraging the local geometric smoothness in conjunction with surface normals. We achieve this by the geometric consistent propagation (GCP) module. It computes the correspondence from the adjacent depth hypothesis space to the reference depth space using surface normals, then uses the correspondence to propagate adjacent costs to the reference geometry, followed by a convolution for aggregation. Our method achieves new state-of-the-art performance on DTU, Tanks & Temple, and ETH3D datasets. Notably, our method ranks 1st on the Tanks & Temple Advanced benchmark.


title: Connecting NeRFs, Images, and Text

abstract: Neural Radiance Fields (NeRFs) have emerged as a standard framework for representing 3D scenes and objects, introducing a novel data type for information exchange and storage. Concurrently, significant progress has been made in multimodal representation learning for text and image data. This paper explores a novel research direction that aims to connect the NeRF modality with other modalities, similar to established methodologies for images and text. To this end, we propose a simple framework that exploits pre-trained models for NeRF representations alongside multimodal models for text and image processing. Our framework learns a bidirectional mapping between NeRF embeddings and those obtained from corresponding images and text. This mapping unlocks several novel and useful applications, including NeRF zero-shot classification and NeRF retrieval from images or text.


title: The Choquet-like operator with respect to an admissible order as a tool for aggregating multivalued data

abstract: In this paper, we propose a new generalization of the classical discrete Choquet integral to the multivalued framework in terms of an admissible order that refines the natural partial order on the considered value set. The new Choquet-like operator takes as input a finite number of values of a given type, in particular real numbers, intervals, and vectors, and returns a~single output value of the same type as the input values. We give necessary and sufficient conditions for the operator to be monotone with respect to the admissible order. We then provide a complete characterization of the Choquet-like operator as an aggregation function with respect to the admissible order and study its selected special cases.


title: On the covariant coefficients of geodesic sprays on Finsler manifolds

abstract: For a Finsler metric $F$, we introduce the notion of $F$-covariant coefficients $H_i$ of the geodesic spray of $F$ (Def. 3.1). We study some geometric consequences concerning the objects $H_i$. If the $F$-covariant coefficients $H_i$ are written in the form $H_i={\dot{\partial}}_iH$, for some smooth function $H$ on ${\mathcal T\hspace{-1pt}M}$, positively 3-homogeneous in y, then $H$ is called spray scalar or simply $S$-scalar. We prove that if the $S$-scalar exists, then it is of the form $H=\frac{1}{12}\,y^i\partial_iF^2$ and this expression is unique up to a function of position only. We prove also that on a Finsler maifold $(M,F)$, the $S$-scalar $H$ exists if and only if $(M,F)$ is dually flat. Generally, the $n^3$ functions $H^h_{ij}$ resulting from the $F$-covariant coefficients do not form a linear connection. We find out that in the case of projectively flat metrics, the $n^3$ functions $H^h_{ij}$ are coefficients of a linear connection. We introduce two new special Finsler spaces, namely, the $H$-Berwald and the $H$-Landsberg spaces and show that every $H$-Berwald metric is $H$-Landsbergian but the converse is not necessarily true. Also, we study the $F$-covariant coefficients $H_i$ of projectivly flat and dually flat spherically symmetric Finsler metrics and provide a solution of the "$H$-unicorn" Landsberg problem. Finally, we give some examples of $H$-Berwald and $H$-Landsberg metrics and an example of $H$-Landsberg metric which is not $H$-Berwaldian.


title: Fractal Calculus to Derive Fractal Frenet Equations for Fractal Curves

abstract: This paper introduces the concept of Fractal Frenet equations, a set of differential equations used to describe the behavior of vectors along fractal curves. The study explores the analogue of arc length for fractal curves, providing a measure to quantify their length. It also discusses fundamental mathematical constructs, such as the analogue of the unit tangent vector, which indicates the curve's direction at different points, and the analogue of curvature vector or fractal curvature vector, which characterizes its curvature at various locations. The concept of torsion, describing the twisting and turning of fractal curves in three-dimensional space, is also explored. Specific examples, like the fractal helix and the fractal snowflake, illustrate the application and significance of the Fractal Frenet equations.


title: Asymptotic Behavior of a transmission Heat/Piezoelectric smart material with internal fractional dissipation law

abstract: In this paper, we examine the stability of a heat-conducting copper rod and a magnetizable piezoelectric beam, with fractional damping affecting the longitudinal displacement of the piezoelectric material's centerline. We establish a polynomial stability result that is dependent on the order of the fractional derivative.


title: Viscosity solutions for mean field optimal switching with a two-time-scale Markov chain

abstract: In this paper, we consider the mean field optimal switching problem with a Markov chain under viscosity solution notion. Based on the conditional distribution of the Markov chain, the value function and corresponding dynamic programming principle (DPP) are established. The switching problem is characterized by an obstacle equation on the Wasserstein space, and the existence, stability, and comparison principle are obtained in the sense of viscosity solution. In particular, we consider a two-time-scale structure and obtain the convergence of the limit system. As an application of our theoretical results, an innovative example concerning the stock trading problem in a regime switching market is solved.


title: A Multi-Level Framework for Accelerating Training Transformer Models

abstract: The fast growing capabilities of large-scale deep learning models, such as Bert, GPT and ViT, are revolutionizing the landscape of NLP, CV and many other domains. Training such models, however, poses an unprecedented demand for computing power, which incurs exponentially increasing energy cost and carbon dioxide emissions. It is thus critical to develop efficient training solutions to reduce the training costs. Motivated by a set of key observations of inter- and intra-layer similarities among feature maps and attentions that can be identified from typical training processes, we propose a multi-level framework for training acceleration. Specifically, the framework is based on three basic operators, Coalescing, De-coalescing and Interpolation, which can be orchestrated to build a multi-level training framework. The framework consists of a V-cycle training process, which progressively down- and up-scales the model size and projects the parameters between adjacent levels of models via coalescing and de-coalescing. The key idea is that a smaller model that can be trained for fast convergence and the trained parameters provides high-qualities intermediate solutions for the next level larger network. The interpolation operator is designed to break the symmetry of neurons incurred by de-coalescing for better convergence performance. Our experiments on transformer-based language models (e.g. Bert, GPT) as well as a vision model (e.g. DeiT) prove that the proposed framework reduces the computational cost by about 20% on training BERT/GPT-Base models and up to 51.6% on training the BERT-Large model while preserving the performance.


title: Perspectives from a cold antideuteron beam in the AD/ELENA facility

abstract: The perspectives opened by the development of a low-energy antideuteron beam are here reviewed: precision measurements of the antideuteron properties; formation and spectroscopic analysis of antideuteronic atoms and antideuterium; the pioneering synthesis of heavier anti-elements in particle traps and at low energies. Some practical aspects of generating a low-energy antideuteron beam in the existing AD/ELENA facility are discussed.

categories: hep-ph nucl-ex physics.acc-ph physics.atom-ph


title: Xiwu: A Basis Flexible and Learnable LLM for High Energy Physics

abstract: Large Language Models (LLMs) are undergoing a period of rapid updates and changes, with state-of-the-art (SOTA) model frequently being replaced. When applying LLMs to a specific scientific field, it's challenging to acquire unique domain knowledge while keeping the model itself advanced. To address this challenge, a sophisticated large language model system named as Xiwu has been developed, allowing you switch between the most advanced foundation models and quickly teach the model domain knowledge. In this work, we will report on the best practices for applying LLMs in the field of high-energy physics (HEP), including: a seed fission technology is proposed and some data collection and cleaning tools are developed to quickly obtain domain AI-Ready dataset; a just-in-time learning system is implemented based on the vector store technology; an on-the-fly fine-tuning system has been developed to facilitate rapid training under a specified foundation model. The results show that Xiwu can smoothly switch between foundation models such as LLaMA, Vicuna, ChatGLM and Grok-1. The trained Xiwu model is significantly outperformed the benchmark model on the HEP knowledge question-and-answering and code generation. This strategy significantly enhances the potential for growth of our model's performance, with the hope of surpassing GPT-4 as it evolves with the development of open-source models. This work provides a customized LLM for the field of HEP, while also offering references for applying LLM to other fields, the corresponding codes are available on Github.

categories: hep-ph cs.AI cs.CL cs.LG hep-ex physics.comp-ph


title: ApproxDARTS: Differentiable Neural Architecture Search with Approximate Multipliers

abstract: Integrating the principles of approximate computing into the design of hardware-aware deep neural networks (DNN) has led to DNNs implementations showing good output quality and highly optimized hardware parameters such as low latency or inference energy. In this work, we present ApproxDARTS, a neural architecture search (NAS) method enabling the popular differentiable neural architecture search method called DARTS to exploit approximate multipliers and thus reduce the power consumption of generated neural networks. We showed on the CIFAR-10 data set that the ApproxDARTS is able to perform a complete architecture search within less than $10$ GPU hours and produce competitive convolutional neural networks (CNN) containing approximate multipliers in convolutional layers. For example, ApproxDARTS created a CNN showing an energy consumption reduction of (a) $53.84\%$ in the arithmetic operations of the inference phase compared to the CNN utilizing the native $32$-bit floating-point multipliers and (b) $5.97\%$ compared to the CNN utilizing the exact $8$-bit fixed-point multipliers, in both cases with a negligible accuracy drop. Moreover, the ApproxDARTS is $2.3\times$ faster than a similar but evolutionary algorithm-based method called EvoApproxNAS.


title: Asynchronous Federated Reinforcement Learning with Policy Gradient Updates: Algorithm Design and Convergence Analysis

abstract: To improve the efficiency of reinforcement learning, we propose a novel asynchronous federated reinforcement learning framework termed AFedPG, which constructs a global model through collaboration among $N$ agents using policy gradient (PG) updates. To handle the challenge of lagged policies in asynchronous settings, we design delay-adaptive lookahead and normalized update techniques that can effectively handle the heterogeneous arrival times of policy gradients. We analyze the theoretical global convergence bound of AFedPG, and characterize the advantage of the proposed algorithm in terms of both the sample complexity and time complexity. Specifically, our AFedPG method achieves $\mathcal{O}(\frac{{\epsilon}^{-2.5}}{N})$ sample complexity at each agent on average. Compared to the single agent setting with $\mathcal{O}(\epsilon^{-2.5})$ sample complexity, it enjoys a linear speedup with respect to the number of agents. Moreover, compared to synchronous FedPG, AFedPG improves the time complexity from $\mathcal{O}(\frac{t_{\max}}{N})$ to $\mathcal{O}(\frac{1}{\sum_{i=1}^{N} \frac{1}{t_{i}}})$, where $t_{i}$ denotes the time consumption in each iteration at the agent $i$, and $t_{\max}$ is the largest one. The latter complexity $\mathcal{O}(\frac{1}{\sum_{i=1}^{N} \frac{1}{t_{i}}})$ is always smaller than the former one, and this improvement becomes significant in large-scale federated settings with heterogeneous computing powers ($t_{\max}\gg t_{\min}$). Finally, we empirically verify the improved performances of AFedPG in three MuJoCo environments with varying numbers of agents. We also demonstrate the improvements with different computing heterogeneity.


title: GRANP: A Graph Recurrent Attentive Neural Process Model for Vehicle Trajectory Prediction

abstract: As a vital component in autonomous driving, accurate trajectory prediction effectively prevents traffic accidents and improves driving efficiency. To capture complex spatial-temporal dynamics and social interactions, recent studies developed models based on advanced deep-learning methods. On the other hand, recent studies have explored the use of deep generative models to further account for trajectory uncertainties. However, the current approaches demonstrating indeterminacy involve inefficient and time-consuming practices such as sampling from trained models. To fill this gap, we proposed a novel model named Graph Recurrent Attentive Neural Process (GRANP) for vehicle trajectory prediction while efficiently quantifying prediction uncertainty. In particular, GRANP contains an encoder with deterministic and latent paths, and a decoder for prediction. The encoder, including stacked Graph Attention Networks, LSTM and 1D convolutional layers, is employed to extract spatial-temporal relationships. The decoder is used to learn a latent distribution and thus quantify prediction uncertainty. To reveal the effectiveness of our model, we evaluate the performance of GRANP on the highD dataset. Extensive experiments show that GRANP achieves state-of-the-art results and can efficiently quantify uncertainties. Additionally, we undertake an intuitive case study that showcases the interpretability of the proposed approach. The code is available at https://github.com/joy-driven/GRANP.


title: Accel-NASBench: Sustainable Benchmarking for Accelerator-Aware NAS

abstract: One of the primary challenges impeding the progress of Neural Architecture Search (NAS) is its extensive reliance on exorbitant computational resources. NAS benchmarks aim to simulate runs of NAS experiments at zero cost, remediating the need for extensive compute. However, existing NAS benchmarks use synthetic datasets and model proxies that make simplified assumptions about the characteristics of these datasets and models, leading to unrealistic evaluations. We present a technique that allows searching for training proxies that reduce the cost of benchmark construction by significant margins, making it possible to construct realistic NAS benchmarks for large-scale datasets. Using this technique, we construct an open-source bi-objective NAS benchmark for the ImageNet2012 dataset combined with the on-device performance of accelerators, including GPUs, TPUs, and FPGAs. Through extensive experimentation with various NAS optimizers and hardware platforms, we show that the benchmark is accurate and allows searching for state-of-the-art hardware-aware models at zero cost.


title: Learning Efficient and Fair Policies for Uncertainty-Aware Collaborative Human-Robot Order Picking

abstract: In collaborative human-robot order picking systems, human pickers and Autonomous Mobile Robots (AMRs) travel independently through a warehouse and meet at pick locations where pickers load items onto the AMRs. In this paper, we consider an optimization problem in such systems where we allocate pickers to AMRs in a stochastic environment. We propose a novel multi-objective Deep Reinforcement Learning (DRL) approach to learn effective allocation policies to maximize pick efficiency while also aiming to improve workload fairness amongst human pickers. In our approach, we model the warehouse states using a graph, and define a neural network architecture that captures regional information and effectively extracts representations related to efficiency and workload. We develop a discrete-event simulation model, which we use to train and evaluate the proposed DRL approach. In the experiments, we demonstrate that our approach can find non-dominated policy sets that outline good trade-offs between fairness and efficiency objectives. The trained policies outperform the benchmarks in terms of both efficiency and fairness. Moreover, they show good transferability properties when tested on scenarios with different warehouse sizes. The implementation of the simulation model, proposed approach, and experiments are published.


title: Interpretable Neural Temporal Point Processes for Modelling Electronic Health Records

abstract: Electronic Health Records (EHR) can be represented as temporal sequences that record the events (medical visits) from patients. Neural temporal point process (NTPP) has achieved great success in modeling event sequences that occur in continuous time space. However, due to the black-box nature of neural networks, existing NTPP models fall short in explaining the dependencies between different event types. In this paper, inspired by word2vec and Hawkes process, we propose an interpretable framework inf2vec for event sequence modelling, where the event influences are directly parameterized and can be learned end-to-end. In the experiment, we demonstrate the superiority of our model on event prediction as well as type-type influences learning.


title: Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition

abstract: The past years have witnessed a proliferation of large language models (LLMs). Yet, automated and unbiased evaluation of LLMs is challenging due to the inaccuracy of standard metrics in reflecting human preferences and the inefficiency in sampling informative and diverse test examples. While human evaluation remains the gold standard, it is expensive and time-consuming, especially when dealing with a large number of testing samples. To address this problem, we propose a sample-efficient human evaluation method based on MAximum Discrepancy (MAD) competition. MAD automatically selects a small set of informative and diverse instructions, each adapted to two LLMs, whose responses are subject to three-alternative forced choice by human subjects. The pairwise comparison results are then aggregated into a global ranking using the Elo rating system. We select eight representative LLMs and compare them in terms of four skills: knowledge understanding, mathematical reasoning, writing, and coding. Experimental results show that the proposed method achieves a reliable and sensible ranking of LLMs' capabilities, identifies their relative strengths and weaknesses, and offers valuable insights for further LLM advancement.


title: Resolving the paradox of the Dirac equation: phenomenology

abstract: Based on the results of F. Wilf on the need to take into account the quantum-mechanical correspondence rules in the Dirac equation for an electron, it was shown that the equation obtained by giving physical meaning to $\alpha$-Dirac operators should be considered as a phenomenological equation for a particle of non-zero size - the EM polaron, previously introduced by the author. This allows a solution to be found to the inherent paradox of the Dirac equation, which consists of the equality of the velocity of the moving particles to the speed of light $c$ in a vacuum, which is a priori unobtainable, and to understand the physical essence of spin as the intrinsic mechanical moment of an EM polaron. It is also shown that the Dirac-Wilf equation for a single spatial dimension can be considered a generalization of the Schrodinger equation for relativistic energies.


title: Differentiable Search for Finding Optimal Quantization Strategy

abstract: To accelerate and compress deep neural networks (DNNs), many network quantization algorithms have been proposed. Although the quantization strategy of any algorithm from the state-of-the-arts may outperform others in some network architectures, it is hard to prove the strategy is always better than others, and even cannot judge that the strategy is always the best choice for all layers in a network. In other words, existing quantization algorithms are suboptimal as they ignore the different characteristics of different layers and quantize all layers by a uniform quantization strategy. To solve the issue, in this paper, we propose a differentiable quantization strategy search (DQSS) to assign optimal quantization strategy for individual layer by taking advantages of the benefits of different quantization algorithms. Specifically, we formulate DQSS as a differentiable neural architecture search problem and adopt an efficient convolution to efficiently explore the mixed quantization strategies from a global perspective by gradient-based optimization. We conduct DQSS for post-training quantization to enable their performance to be comparable with that in full precision models. We also employ DQSS in quantization-aware training for further validating the effectiveness of DQSS. To circumvent the expensive optimization cost when employing DQSS in quantization-aware training, we update the hyper-parameters and the network parameters in a single forward-backward pass. Besides, we adjust the optimization process to avoid the potential under-fitting problem. Comprehensive experiments on high level computer vision task, i.e., image classification, and low level computer vision task, i.e., image super-resolution, with various network architectures show that DQSS could outperform the state-of-the-arts.


title: An inclusive review on deep learning techniques and their scope in handwriting recognition

abstract: Deep learning expresses a category of machine learning algorithms that have the capability to combine raw inputs into intermediate features layers. These deep learning algorithms have demonstrated great results in different fields. Deep learning has particularly witnessed for a great achievement of human level performance across a number of domains in computer vision and pattern recognition. For the achievement of state-of-the-art performances in diverse domains, the deep learning used different architectures and these architectures used activation functions to perform various computations between hidden and output layers of any architecture. This paper presents a survey on the existing studies of deep learning in handwriting recognition field. Even though the recent progress indicates that the deep learning methods has provided valuable means for speeding up or proving accurate results in handwriting recognition, but following from the extensive literature survey, the present study finds that the deep learning has yet to revolutionize more and has to resolve many of the most pressing challenges in this field, but promising advances have been made on the prior state of the art. Additionally, an inadequate availability of labelled data to train presents problems in this domain. Nevertheless, the present handwriting recognition survey foresees deep learning enabling changes at both bench and bedside with the potential to transform several domains as image processing, speech recognition, computer vision, machine translation, robotics and control, medical imaging, medical information processing, bio-informatics, natural language processing, cyber security, and many others.


title: Some questions of connection between summation functions and the corresponding Dirichlet series

abstract: The paper proves a generalization of Wintner's theorem on the asymptotics of summation functions to the case of summation functions with nonlinear asymptotics. The class of arithmetic functions that have a logarithmic asymptotic mean is studied. The Kronecker lemma is generalized to the case when the corresponding Dirichlet series diverges. Several assertions are proven and illustrative examples are given.


title: Enhanced Cooperative Perception for Autonomous Vehicles Using Imperfect Communication

abstract: Sharing and joint processing of camera feeds and sensor measurements, known as Cooperative Perception (CP), has emerged as a new technique to achieve higher perception qualities. CP can enhance the safety of Autonomous Vehicles (AVs) where their individual visual perception quality is compromised by adverse weather conditions (haze as foggy weather), low illumination, winding roads, and crowded traffic. To cover the limitations of former methods, in this paper, we propose a novel approach to realize an optimized CP under constrained communications. At the core of our approach is recruiting the best helper from the available list of front vehicles to augment the visual range and enhance the Object Detection (OD) accuracy of the ego vehicle. In this two-step process, we first select the helper vehicles that contribute the most to CP based on their visual range and lowest motion blur. Next, we implement a radio block optimization among the candidate vehicles to further improve communication efficiency. We specifically focus on pedestrian detection as an exemplary scenario. To validate our approach, we used the CARLA simulator to create a dataset of annotated videos for different driving scenarios where pedestrian detection is challenging for an AV with compromised vision. Our results demonstrate the efficacy of our two-step optimization process in improving the overall performance of cooperative perception in challenging scenarios, substantially improving driving safety under adverse conditions. Finally, we note that the networking assumptions are adopted from LTE Release 14 Mode 4 side-link communication, commonly used for Vehicle-to-Vehicle (V2V) communication. Nonetheless, our method is flexible and applicable to arbitrary V2V communications.


title: Tetragonal modular quotients $X_0^{+d}(N)$

abstract: Let $N$ be a positive integer. For every $d | N$ such that $(d, N/d) = 1$ there exists an Atkin-Lehner involution $w_d$ of a modular curve $X_0(N)$. In this paper we determine all quotient curves $X_0(N)/w_d$ whose $\mathbb{Q}$-gonality is equal to $4$ and all quotient curves $X_0(N)/w_d$ whose $\mathbb{C}$-gonality is equal to $4$.


title: Secrets and Quantifiers

abstract: A close look at double-quantified statements in a playful setting.


title: ONNXPruner: ONNX-Based General Model Pruning Adapter

abstract: Recent advancements in model pruning have focused on developing new algorithms and improving upon benchmarks. However, the practical application of these algorithms across various models and platforms remains a significant challenge. To address this challenge, we propose ONNXPruner, a versatile pruning adapter designed for the ONNX format models. ONNXPruner streamlines the adaptation process across diverse deep learning frameworks and hardware platforms. A novel aspect of ONNXPruner is its use of node association trees, which automatically adapt to various model architectures. These trees clarify the structural relationships between nodes, guiding the pruning process, particularly highlighting the impact on interconnected nodes. Furthermore, we introduce a tree-level evaluation method. By leveraging node association trees, this method allows for a comprehensive analysis beyond traditional single-node evaluations, enhancing pruning performance without the need for extra operations. Experiments across multiple models and datasets confirm ONNXPruner's strong adaptability and increased efficacy. Our work aims to advance the practical application of model pruning.


title: AI-Guided Feature Segmentation Techniques to Model Features from Single Crystal Diamond Growth

abstract: Process refinement to consistently produce high-quality material over a large area of the grown crystal, enabling various applications from optics crystals to quantum detectors, has long been a goal for diamond growth. Machine learning offers a promising path toward this goal, but faces challenges such as the complexity of features within datasets, their time-dependency, and the volume of data produced per growth run. Accurate spatial feature extraction from image to image for real-time monitoring of diamond growth is crucial yet complicated due to the low-volume and high feature complexity nature of the datasets. This paper compares various traditional and machine learning-driven approaches for feature extraction in the diamond growth domain, proposing a novel deep learning-driven semantic segmentation approach to isolate and classify accurate pixel masks of geometric features like diamond, pocket holder, and background, along with their derivative features based on shape and size. Using an annotation-focused human-in-the-loop software architecture for training datasets, with modules for selective data labeling using active learning, data augmentations, and model-assisted labeling, our approach achieves effective annotation accuracy and drastically reduces labeling time and cost. Deep learning algorithms prove highly efficient in accurately learning complex representations from datasets with many features. Our top-performing model, based on the DeeplabV3plus architecture, achieves outstanding accuracy in classifying features of interest, with accuracies of 96.31% for pocket holder, 98.60% for diamond top, and 91.64% for diamond side features.


title: Analyzing the Performance of Large Language Models on Code Summarization

abstract: Large language models (LLMs) such as Llama 2 perform very well on tasks that involve both natural language and source code, particularly code summarization and code generation. We show that for the task of code summarization, the performance of these models on individual examples often depends on the amount of (subword) token overlap between the code and the corresponding reference natural language descriptions in the dataset. This token overlap arises because the reference descriptions in standard datasets (corresponding to docstrings in large code bases) are often highly similar to the names of the functions they describe. We also show that this token overlap occurs largely in the function names of the code and compare the relative performance of these models after removing function names versus removing code structure. We also show that using multiple evaluation metrics like BLEU and BERTScore gives us very little additional insight since these metrics are highly correlated with each other.


title: Learning Chemotherapy Drug Action via Universal Physics-Informed Neural Networks

abstract: Quantitative systems pharmacology (QSP) is widely used to assess drug effects and toxicity before the drug goes to clinical trial. However, significant manual distillation of the literature is needed in order to construct a QSP model. Parameters may need to be fit, and simplifying assumptions of the model need to be made. In this work, we apply Universal Physics-Informed Neural Networks (UPINNs) to learn unknown components of various differential equations that model chemotherapy pharmacodynamics. We learn three commonly employed chemotherapeutic drug actions (log-kill, Norton-Simon, and E_max) from synthetic data. Then, we use the UPINN method to fit the parameters for several synthetic datasets simultaneously. Finally, we learn the net proliferation rate in a model of doxorubicin (a chemotherapeutic) pharmacodynamics. As these are only toy examples, we highlight the usefulness of UPINNs in learning unknown terms in pharmacodynamic and pharmacokinetic models.


title: Augmenting Knowledge Graph Hierarchies Using Neural Transformers

abstract: Knowledge graphs are useful tools to organize, recommend and sort data. Hierarchies in knowledge graphs provide significant benefit in improving understanding and compartmentalization of the data within a knowledge graph. This work leverages large language models to generate and augment hierarchies in an existing knowledge graph. For small (<100,000 node) domain-specific KGs, we find that a combination of few-shot prompting with one-shot generation works well, while larger KG may require cyclical generation. We present techniques for augmenting hierarchies, which led to coverage increase by 98% for intents and 99% for colors in our knowledge graph.


title: VeTraSS: Vehicle Trajectory Similarity Search Through Graph Modeling and Representation Learning

abstract: Trajectory similarity search plays an essential role in autonomous driving, as it enables vehicles to analyze the information and characteristics of different trajectories to make informed decisions and navigate safely in dynamic environments. Existing work on the trajectory similarity search task primarily utilizes sequence-processing algorithms or Recurrent Neural Networks (RNNs), which suffer from the inevitable issues of complicated architecture and heavy training costs. Considering the intricate connections between trajectories, using Graph Neural Networks (GNNs) for data modeling is feasible. However, most methods directly use existing mathematical graph structures as the input instead of constructing specific graphs from certain vehicle trajectory data. This ignores such data's unique and dynamic characteristics. To bridge such a research gap, we propose VeTraSS -- an end-to-end pipeline for Vehicle Trajectory Similarity Search. Specifically, VeTraSS models the original trajectory data into multi-scale graphs, and generates comprehensive embeddings through a novel multi-layer attention-based GNN. The learned embeddings can be used for searching similar vehicle trajectories. Extensive experiments on the Porto and Geolife datasets demonstrate the effectiveness of VeTraSS, where our model outperforms existing work and reaches the state-of-the-art. This demonstrates the potential of VeTraSS for trajectory analysis and safe navigation in self-driving vehicles in the real world.


title: A lightweight dual-stage framework for personalized speech enhancement based on DeepFilterNet2

abstract: Isolating the desired speaker's voice amidst multiplespeakers in a noisy acoustic context is a challenging task. Per-sonalized speech enhancement (PSE) endeavours to achievethis by leveraging prior knowledge of the speaker's voice.Recent research efforts have yielded promising PSE mod-els, albeit often accompanied by computationally intensivearchitectures, unsuitable for resource-constrained embeddeddevices. In this paper, we introduce a novel method to per-sonalize a lightweight dual-stage Speech Enhancement (SE)model and implement it within DeepFilterNet2, a SE modelrenowned for its state-of-the-art performance. We seek anoptimal integration of speaker information within the model,exploring different positions for the integration of the speakerembeddings within the dual-stage enhancement architec-ture. We also investigate a tailored training strategy whenadapting DeepFilterNet2 to a PSE task. We show that ourpersonalization method greatly improves the performancesof DeepFilterNet2 while preserving minimal computationaloverhead.


title: Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis

abstract: The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and high-throughput genome sequencing, establishing effective multi-modal fusion models for survival prediction and revealing the potential association between histopathology and transcriptomics remains challenging. In this paper, we propose Pathology-Genome Heterogeneous Graph (PGHG) that integrates whole slide images (WSI) and bulk RNA-Seq expression data with heterogeneous graph neural network for cancer survival analysis. The PGHG consists of biological knowledge-guided representation learning network and pathology-genome heterogeneous graph. The representation learning network utilizes the biological prior knowledge of intra-modal and inter-modal data associations to guide the feature extraction. The node features of each modality are updated through attention-based graph learning strategy. Unimodal features and bi-modal fused features are extracted via attention pooling module and then used for survival prediction. We evaluate the model on low-grade gliomas, glioblastoma, and kidney renal papillary cell carcinoma datasets from the Cancer Genome Atlas (TCGA) and the First Affiliated Hospital of Zhengzhou University (FAHZU). Extensive experimental results demonstrate that the proposed method outperforms both unimodal and other multi-modal fusion models. For demonstrating the model interpretability, we also visualize the attention heatmap of pathological images and utilize integrated gradient algorithm to identify important tissue structure, biological pathways and key genes.


title: The OxMat dataset: a multimodal resource for the development of AI-driven technologies in maternal and newborn child health

abstract: The rapid advancement of Artificial Intelligence (AI) in healthcare presents a unique opportunity for advancements in obstetric care, particularly through the analysis of cardiotocography (CTG) for fetal monitoring. However, the effectiveness of such technologies depends upon the availability of large, high-quality datasets that are suitable for machine learning. This paper introduces the Oxford Maternity (OxMat) dataset, the world's largest curated dataset of CTGs, featuring raw time series CTG data and extensive clinical data for both mothers and babies, which is ideally placed for machine learning. The OxMat dataset addresses the critical gap in women's health data by providing over 177,211 unique CTG recordings from 51,036 pregnancies, carefully curated and reviewed since 1991. The dataset also comprises over 200 antepartum, intrapartum and postpartum clinical variables, ensuring near-complete data for crucial outcomes such as stillbirth and acidaemia. While this dataset also covers the intrapartum stage, around 94% of the constituent CTGS are antepartum. This allows for a unique focus on the underserved antepartum period, in which early detection of at-risk fetuses can significantly improve health outcomes. Our comprehensive review of existing datasets reveals the limitations of current datasets: primarily, their lack of sufficient volume, detailed clinical data and antepartum data. The OxMat dataset lays a foundation for future AI-driven prenatal care, offering a robust resource for developing and testing algorithms aimed at improving maternal and fetal health outcomes.


title: On arithmetic nature of $q$-analogue of the generalized Stieltjes constants

abstract: In this article, our aim is to extend the research conducted by Kurokawa and Wakayama in 2003, particularly focusing on the $q$-analogue of the Hurwitz zeta function. Our specific emphasis lies in exploring the coefficients in the Laurent series expansion of a $q$-analogue of the Hurwitz zeta function around $s=1$. We establish the closed-form expressions for the first two coefficients in the Laurent series of the $q$-Hurwitz zeta function. Additionally, utilizing the reflection formula for the digamma function and the identity of Bernoulli polynomials, we explore transcendence results related to $\gamma_0(q,x)$ for $q>1$ and $0 < x <1$, where $\gamma_0(q,x)$ is the constant term which appears in the Laurent series expansion of $q$-Hurwitz zeta function around $s=1$. Furthermore, we put forth a conjecture about the linear independence of special values of $\gamma_0(q,x)$ along with $1$ at rational arguments with co-prime conditions, over the field of rational numbers. Finally, we show that at least one more than half of the numbers are linearly independent over the field of rationals.


title: Gravitational wave pulse and memory effects for hairy Kiselev black hole and its analogy with Bondi-Sachs formalism

abstract: The investigation of non-vacuum cosmological backgrounds containing black holes is greatly enhanced by the Kiselev solution. This solution plays a crucial role in understanding the properties of the background and its relationship with the features of the black hole. Consequently, the gravitational memory effects at large distances from the black hole offer a valuable means of obtaining information about the surrounding field parameter N and parameters related to the hair of the hairy Kiselev Black hole. This paper investigates the gravitational memory effects in the context of the Kiselev solution through two distinct approaches. At first, the gravitational memory effect at null infinity is explored by utilizing the Bondi-Sachs formalism by introducing a gravitational wave (GW) pulse to the solution. The resulting Bondi mass is then analyzed to gain further insight. Therefore, the Kiselev solution is being examined to determine the variations in Bondi mass caused by the pulse of GWs. The study of changes in Bondi mass is motivated by the fact that it is dynamic and time-dependent, and it measures mass on an asymptotically null slice or the densities of energy on celestial spheres. In the second approach, the investigation of displacement and velocity memory effects is undertaken in relation to the deviation of two neighboring geodesics and the deviation of their derivative influenced by surrounding field parameter N and the hair of hairy Kiselev black hole. This analysis is conducted within the context of a gravitational wave pulse present in the background of a hairy Kiselev black hole surrounded by a field parameter N.


title: SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction

abstract: Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both whole slide images (WSIs) and transcriptomic data, from which better intra-modal representations and inter-modal integration could be derived. Moreover, many existing studies attempt to improve multi-modal representations through attention mechanisms, which inevitably lead to high complexity when processing high-dimensional WSIs and transcriptomic data. Recently, a structured state space model named Mamba emerged as a promising approach for its superior performance in modeling long sequences with low complexity. In this study, we propose Mamba with multi-grained multi-modal interaction (SurvMamba) for survival prediction. SurvMamba is implemented with a Hierarchical Interaction Mamba (HIM) module that facilitates efficient intra-modal interactions at different granularities, thereby capturing more detailed local features as well as rich global representations. In addition, an Interaction Fusion Mamba (IFM) module is used for cascaded inter-modal interactive fusion, yielding more comprehensive features for survival prediction. Comprehensive evaluations on five TCGA datasets demonstrate that SurvMamba outperforms other existing methods in terms of performance and computational cost.


title: FedAuxHMTL: Federated Auxiliary Hard-Parameter Sharing Multi-Task Learning for Network Edge Traffic Classification

abstract: Federated Learning (FL) has garnered significant interest recently due to its potential as an effective solution for tackling many challenges in diverse application scenarios, for example, data privacy in network edge traffic classification. Despite its recognized advantages, FL encounters obstacles linked to statistical data heterogeneity and labeled data scarcity during the training of single-task models for machine learning-based traffic classification, leading to hindered learning performance. In response to these challenges, adopting a hard-parameter sharing multi-task learning model with auxiliary tasks proves to be a suitable approach. Such a model has the capability to reduce communication and computation costs, navigate statistical complexities inherent in FL contexts, and overcome labeled data scarcity by leveraging knowledge derived from interconnected auxiliary tasks. This paper introduces a new framework for federated auxiliary hard-parameter sharing multi-task learning, namely, FedAuxHMTL. The introduced framework incorporates model parameter exchanges between edge server and base stations, enabling base stations from distributed areas to participate in the FedAuxHMTL process and enhance the learning performance of the main task-network edge traffic classification. Empirical experiments are conducted to validate and demonstrate the FedAuxHMTL's effectiveness in terms of accuracy, total global loss, communication costs, computing time, and energy consumption compared to its counterparts.


title: A Multi-Expert Large Language Model Architecture for Verilog Code Generation

abstract: Recently, there has been a surging interest in using large language models (LLMs) for Verilog code generation. However, the existing approaches are limited in terms of the quality of the generated Verilog code. To address such limitations, this paper introduces an innovative multi-expert LLM architecture for Verilog code generation (MEV-LLM). Our architecture uniquely integrates multiple LLMs, each specifically fine-tuned with a dataset that is categorized with respect to a distinct level of design complexity. It allows more targeted learning, directly addressing the nuances of generating Verilog code for each category. Empirical evidence from experiments highlights notable improvements in terms of the percentage of generated Verilog outputs that are syntactically and functionally correct. These findings underscore the efficacy of our approach, promising a forward leap in the field of automated hardware design through machine learning.


title: Rethinking Artistic Copyright Infringements in the Era of Text-to-Image Generative Models

abstract: Recent text-to-image generative models such as Stable Diffusion are extremely adept at mimicking and generating copyrighted content, raising concerns amongst artists that their unique styles may be improperly copied. Understanding how generative models copy "artistic style" is more complex than duplicating a single image, as style is comprised by a set of elements (or signature) that frequently co-occurs across a body of work, where each individual work may vary significantly. In our paper, we first reformulate the problem of "artistic copyright infringement" to a classification problem over image sets, instead of probing image-wise similarities. We then introduce ArtSavant, a practical (i.e., efficient and easy to understand) tool to (i) determine the unique style of an artist by comparing it to a reference dataset of works from 372 artists curated from WikiArt, and (ii) recognize if the identified style reappears in generated images. We leverage two complementary methods to perform artistic style classification over image sets, includingTagMatch, which is a novel inherently interpretable and attributable method, making it more suitable for broader use by non-technical stake holders (artists, lawyers, judges, etc). Leveraging ArtSavant, we then perform a large-scale empirical study to provide quantitative insight on the prevalence of artistic style copying across 3 popular text-to-image generative models. Namely, amongst a dataset of prolific artists (including many famous ones), only 20% of them appear to have their styles be at a risk of copying via simple prompting of today's popular text-to-image generative models.


title: Latent Guard: a Safety Framework for Text-to-image Generation

abstract: With the ability to generate high-quality images, text-to-image (T2I) models can be exploited for creating inappropriate content. To prevent misuse, existing safety measures are either based on text blacklists, which can be easily circumvented, or harmful content classification, requiring large datasets for training and offering low flexibility. Hence, we propose Latent Guard, a framework designed to improve safety measures in text-to-image generation. Inspired by blacklist-based approaches, Latent Guard learns a latent space on top of the T2I model's text encoder, where it is possible to check the presence of harmful concepts in the input text embeddings. Our proposed framework is composed of a data generation pipeline specific to the task using large language models, ad-hoc architectural components, and a contrastive learning strategy to benefit from the generated data. The effectiveness of our method is verified on three datasets and against four baselines. Code and data will be shared at https://github.com/rt219/LatentGuard.


title: Finite modular symmetries and the strong CP problem

abstract: Recently, it was shown that modular symmetry may solve the strong CP problem without axions, by producing a vanishing QCD angle while generating a large quark CP violation phase. We extend this framework to finite modular groups, systematically identifying the allowed mass textures. We find quark fields must furnish 1D representations and scan the minimal model landscape.


title: Imaging dark matter at the smallest scales with $z\approx1$ lensed stars

abstract: Observations of caustic-crossing galaxies at redshift $0.7<z<1$ show a wealth of transient events. Most of them are believed to be microlensing events of highly magnified stars. Earlier work predicted such events should be common near the critical curves (CCs) of galaxy clusters, but some are found relatively far away from these CCs. We consider the possibility that substructure on milliarcsecond scales (few parsecs in the lens plane) is boosting the microlensing signal. We study the combined magnification from the macrolens, millilenses, and microlenses (3M-lensing). After considering realistic populations of millilenses and microlenses, we conclude that the enhanced microlensing rate around millilenses is not sufficient to explain the high fraction of observed events in the far region. Instead we find a that the shape of the luminosity function (LF) of the lensed stars combined with the amount of substructure in the lens plane determines the number of mcirolensing events found near and far from the CC. By measuring $\beta$ (the exponent of the LF), and the number density of microlensing events at each location, one can create a pseudoimage of the underlying distribution of mass on small scales. We identify two regimes: (i) positive imaging regime where $\beta>2$ and the number density of events is greater around substructureand the number density of events is greater around substructures, and (ii) negative imaging regime where $\beta<2$. We study the particular case of seven microlensing events found by HST in the Dragon arc (at z=0.725). We find that a population of supergiant stars with a steep LF with $\beta=2.55$ fits the distribution of these events. We identify a small region of high density of microlensing events, and interpret it as evidence of a possible invisible substructure, for which we derive a mass of $\sim 1.3 \times 10^8\,\Msun$ (within its Einstein radius).


title: A non-Perturbative and Background-Independent Formulation of Quadratic Gravity

abstract: A non-perturbative and background-independent quantum formulation of quadratic gravity is provided. A canonical quantization procedure introduced in previous works, named after Dirac and Pauli, is here applied to quadratic gravity to obtain, as required by consistency, a well-defined Euclidean path integral. The theory is unitary: all probabilities are non negative and they sum up to one. We obtain path-integral expressions for the transition amplitudes, Green's functions and generic matrix elements of time-ordered products of the metric. As a byproduct, similar results are also obtained for a scalar-field four-derivative interacting model. In this way, among other things, previous perturbative and background-dependent calculations are justified. The (quantum) quadratic gravity effective action, whose field equations determine the vacuum expectation value of the metric in the presence of a generic energy-momentum tensor, is constructed. The classical limit of the effective action turns out to be equivalent to the starting classical action of quadratic gravity, whose runaway rates were previously shown to be slow enough to be compatible with observations. Finally, the constructed non-perturbative and background-independent quantum quadratic gravity is applied to quantum cosmology to obtain a path-integral expression for the wave function of the universe, which satisfies a sort of Wheeler-DeWitt equation. This application allows us to understand at the quantum level why our universe is nearly homogeneous and isotropic.


title: Solar photospheric spectrum microvariability II. Observed relations to magnetic activity and radial-velocity modulation

abstract: Searches for small exoplanets around solar-type stars are limited by stellar physical variability. While chromospheric variability is well studied, observing, modeling. and understanding the much smaller fluctuations in photospheric spectral line strengths, shapes, and shifts is challenging. Extreme precision radial-velocity spectrometers now enable extreme precision stellar spectroscopy and time series of the Sun seen as a star permit monitoring of its photospheric variability. Fluctuations in their line strengths may well correlate with radial-velocity excursions and identify observable proxies for their monitoring. From three years of HARPS-N observations of the Sun-as-a-star, one thousand low-noise spectra are selected, and line absorption measured in Fe I, Fe II, Mg I, Mn I, H-alpha, H-beta, H-gamma, Na I, and the G-band. Their variations and likely atmospheric origins are examined, also with respect to simultaneously measured chromospheric emission and apparent radial velocity. Systematic line-strength variability is seen, largely shadowing the solar-cycle evolution of Ca II H & K emission, but with smaller amounts, typically on a sub-percent level. Among iron lines, greatest amplitudes are for Fe II in the blue, while the trends change sign among differently strong lines in the green Mg I triplet and between Balmer lines. Variations in the G-band core are greater than of the full G-band, in line with theoretical predictions. No variation is detected in the semi-forbidden Mg I 457.1 nm. Hyperfine split Mn I behaves largely similar to Fe I. For lines at longer wavelengths, telluric absorption limits the achievable precision. Microvariability in the solar photospheric spectrum thus displays systematic signatures among various features. These measure something different than the classical Ca II H & K index while still reflecting a strong influence from magnetic regions.


title: Euclid preparation. XLII. A unified catalogue-level reanalysis of weak lensing by galaxy clusters in five imaging surveys

abstract: Precise and accurate mass calibration is required to exploit galaxy clusters as astrophysical and cosmological probes in the Euclid era. Systematic errors in lensing signals by galaxy clusters can be empirically estimated by comparing different surveys with independent and uncorrelated systematics. To assess the robustness of the lensing results to systematic errors, we carried out end-to-end tests across different data sets. We performed a unified analysis at the catalogue level by leveraging the Euclid combined cluster and weak-lensing pipeline (COMB-CL). COMB-CL will measure weak lensing cluster masses for the Euclid Survey. Heterogeneous data sets from five independent, recent, lensing surveys (CHFTLenS, DES~SV1, HSC-SSP~S16a, KiDS~DR4, and RCSLenS), which exploited different shear and photometric redshift estimation algorithms, were analysed with a consistent pipeline under the same model assumptions. We performed a comparison of the amplitude of the reduced excess surface density and of the mass estimates using lenses from the Planck PSZ2 and SDSS redMaPPer cluster samples. Mass estimates agree with literature results collected in the LC2 catalogues. Mass accuracy was further investigated considering the AMICO detected clusters in the HSC-SSP XXL North field. The consistency of the data sets was tested using our unified analysis framework. We found agreement between independent surveys, at the level of systematic noise in Stage-III surveys or precursors. This indicates successful control over systematics. If such control continues in Stage-IV, Euclid will be able to measure the weak lensing masses of around 13000 (considering shot noise only) or 3000 (noise from shape and large-scale-structure) massive clusters with a signal-to-noise ratio greater than 3.


title: The Evolution of Binaries Embedded Within Common Envelopes

abstract: Triple stellar systems allow us to study stellar processes that cannot be attained in binary stars. The evolutionary phases in which the stellar members undergo mass exchanges can alter the hierarchical layout of these systems. Yet, the lack of a self-consistent treatment of common-envelope (CE) in triple star-systems hinders the comprehensive understanding of their long-term fate. This letter examines the conditions predicted around binaries embedded within CEs using local 3D hydrodynamical simulations. We explore varying the initial binary separation, the flow Mach number, and the background stellar density gradients as informed by a wide array of CE conditions, including those invoked to explain the formation of the triple system hosting PSR J0337+1715. We find that the stellar density gradient governs the gaseous drag force, which determines the final configuration of the embedded binary. We observe a comparable net drag force on the center of mass but an overall reduction in the accretion rate of the binary compared to the single object case. We find that for most CE conditions, and in contrast to the uniform background density case, the binary orbital separation increases with time, softening the binary and preventing it from subsequently merging. We conclude that binaries spiraling within CEs become more vulnerable to be disrupted by tidal interactions. This can have profound implications on the final outcomes of triple star-systems.


title: Small Magellanic Cloud Cepheids Observed with the Hubble Space Telescope Provide a New Anchor for the SH0ES Distance Ladder

abstract: We present photometric measurements of 88 Cepheid variables in the core of the Small Magellanic Cloud (SMC), the first sample obtained with the Hubble Space Telescope (HST) and Wide Field Camera 3, in the same homogeneous photometric system as past measurements of all Cepheids on the SH0ES distance ladder. We limit the sample to the inner core and model the geometry to reduce errors in prior studies due to the non-trivial depth of this Cloud. Without crowding present in ground-based studies, we obtain an unprecedentedly low dispersion of 0.102 mag for a Period-Luminosity relation in the SMC, approaching the width of the Cepheid instability strip. The new geometric distance to 15 late-type detached eclipsing binaries in the SMC offers a rare opportunity to improve the foundation of the distance ladder, increasing the number of calibrating galaxies from three to four. With the SMC as the only anchor, we find H$_0\!=\!74.1 \pm 2.1$ km s$^{-1}$ Mpc$^{-1}$. Combining these four geometric distances with our HST photometry of SMC Cepheids, we obtain H$_0\!=\!73.17 \pm 0.86$ km s$^{-1}$ Mpc$^{-1}$. By including the SMC in the distance ladder, we also double the range where the metallicity ([Fe/H]) dependence of the Cepheid Period-Luminosity relation can be calibrated, and we find $\gamma = -0.22 \pm 0.05$ mag dex$^{-1}$. Our local measurement of H$_0$ based on Cepheids and Type Ia supernovae shows a 5.8$\sigma$ tension with the value inferred from the CMB assuming a $\Lambda$CDM cosmology, reinforcing the possibility of physics beyond $\Lambda$CDM.


title: Improving Photometric Galaxy Clustering Constraints With Cross-Bin Correlations

abstract: Clustering studies in current photometric galaxy surveys focus solely on auto-correlations, neglecting cross-correlations between redshift bins. We evaluate the potential advantages and drawbacks of incorporating cross-bin correlations in Fisher forecasts for the Dark Energy Survey (DES) and the forthcoming Rubin Observatory Legacy Survey of Space and Time (LSST). Our analysis considers the impact of including redshift space distortions (RSD) and magnification in model predictions, as well as systematic uncertainties in photometric redshift distributions (photo-$z$). While auto-correlations alone suffer from a degeneracy between the amplitude of matter fluctuations ($\sigma_8$) and galaxy bias parameters, accounting for RSD and magnification in cross-correlations helps break this degeneracy - although more weakly than the degeneracy breaking expected from a combined analysis with other observables. Incorporating cross-bin correlations does not significantly increase sensitivity to photo-$z$ systematics, addressing previous concerns, and self-calibrates photo-$z$ systematics, reducing errors on photo-$z$ nuisance parameters. We suggest that the benefits of including cross-correlations in future photometric galaxy clustering analyses outweigh the risks, but caution that careful evaluation is necessary as more realistic pictures of surveys' precision and systematic error budgets develop.


title: Three-Body Binary Formation in Clusters: Analytical Theory

abstract: Binary formation in clusters through triple encounters between three unbound stars, 'three-body' binary formation, is one of the main dynamical formation processes of binary systems in dense environments. In this paper, we use an analytical probabilistic approach to study the process for the equal mass case and calculate a probability distribution for the orbital parameters of three-body-formed binaries, as well as their formation rate. For the first time, we give closed-form analytical expressions to the full orbital parameter distribution, accounting for both energy and angular momentum conservation. This calculation relies on the sensitive dependence of the outcomes of three-body scatterings on the initial conditions: here we compute the rate of three-body binaries from ergodic interactions, which allow for an analytical derivation of the distribution of orbital parameters of the binaries thus created. We find that soft binaries are highly favoured in this process and that these binaries have a super-thermal eccentricity distribution, while the few hard three-body binaries have an eccentricity distribution much closer to thermal. The analytical results predict and reproduce simulation results of three-body scattering experiments in the literature well.


title: Modeling Ionized Gas in the Small Magellanic Cloud: The Wolf-Rayet Nebula N76

abstract: We present Cloudy modeling of infrared emission lines in the Wolf-Rayet (WR) nebula N76 caused by one of the most luminous and hottest WR stars in the low metallicity Small Magellanic Cloud. We use spatially resolved mid-infrared Spitzer/IRS and far-infrared Herschel/PACS spectroscopy to establish the physical conditions of the ionized gas. The spatially resolved distribution of the emission allows us to constrain properties much more accurately than using spatially integrated quantities. We construct models with a range of constant hydrogen densities between n$_H$ = 4 - 10 cm$^{-3}$ and a stellar wind-blown cavity of 10 pc which reproduces the intensity and shape of most ionized gas emission lines, including the high ionization lines [OIV] and [NeV], as well as [SIII], [SIV], [OIII], and [NeIII]. Our models suggest that the majority of [SiII] emission (91%) is produced at the edge of the HII region around the transition between ionized and atomic gas while very little of the [CII] emission (<5%) is associated with the ionized gas. The physical conditions of N76 are characterized by a hot HII region with a maximum electron temperature of T$_e$ ~ 24,000 K, electron densities that range from n$_e$ ~ 4 to 12 cm$^{-3}$, and high ionization parameters of log(U) ~ -1.15 to -1.77. By analyzing a low metallicty WR nebula with a single ionization source, this work gives valuable insights on the impact WR stars have to the galaxy-integrated ionized gas properties in nearby dwarf galaxies.


title: Testing common approximations to predict the 21cm signal at the Epoch of Reionization and Cosmic Dawn

abstract: Predicting the 21cm signal from the epoch of reionization and cosmic dawn is a complex and challenging task. Various simplifying assumptions have been applied over the last decades to make the modeling more affordable. In this paper, we investigate the validity of several such assumptions, using a simulation suite consisting of three different astrophysical source models that agree with the current constraints on the reionization history and the UV luminosity function. We first show that the common assumption of a saturated spin temperature may lead to significant errors in the 21cm clustering signal over the full reionization period. The same is true for the assumption of a neutral universe during the cosmic dawn which may lead to significant deviation from the correct signal during the heating and the Lyman-$\alpha$ coupling period. Another popular simplifying assumption consists of predicting the global differential brightness temperature ($dT_b$) based on the average quantities of the reionization fraction, gas temperature, and Lyman-$\alpha$ coupling. We show that such an approach leads to a 10 percent deeper absorption signal compared to the results obtained by averaging the final $dT_b$-map. Finally, we investigate the simplifying method of breaking the 21cm clustering signal into different auto and cross components that are then solved assuming linearity. We show that even though the individual fields have a variance well below unity, they often cannot be treated perturbatively as the perturbations are strongly non-Gaussian. As a consequence, predictions based on the perturbative solution of individual auto and cross power spectra may lead to strongly biased results, even if higher-order terms are taken into account.


title: Milky Way-est: Cosmological Zoom-in Simulations with Large Magellanic Cloud and Gaia-Sausage-Enceladus Analogs

abstract: We present Milky Way-est, a suite of 20 cosmological cold-dark-matter-only zoom-in simulations of Milky Way (MW)-like host halos. Milky Way-est hosts are selected such that they: ($i$) are consistent with the MW's measured halo mass and concentration, ($ii$) accrete a Large Magellanic Cloud (LMC)-like ($\approx 10^{11}~M_{\odot}$) subhalo within the last $1.3~\mathrm{Gyr}$ on a realistic orbit, placing them near $50~\mathrm{kpc}$ from the host center at $z\approx 0$, and ($iii$) undergo a $>$1:5 sub-to-host halo mass ratio merger with a Gaia-Sausage-Enceladus (GSE)-like system at early times ($0.67<z<3$). Hosts satisfying these LMC and GSE constraints constitute $< 1\%$ of all halos in the MW's mass range, and their total masses grow rapidly at late times due to LMC analog accretion. Compared to hosts of a similar final halo mass that are not selected to include LMC and GSE analogs, Milky Way-est hosts contain $22\%$ more subhalos with present-day virial masses above $10^8~M_{\odot}$ throughout the virial radius, on average. This enhancement reaches $\approx 80\%$ in the inner $100~\mathrm{kpc}$ and is largely, if not entirely, due to LMC-associated subhalos. These systems also induce spatial anisotropy in Milky Way-est subhalo populations, with $\approx 60\%$ of the total subhalo population within $100~\mathrm{kpc}$ found in the current direction of the LMC. Meanwhile, we find that GSE-associated subhalos do not significantly contribute to present-day Milky Way-est subhalo populations. These results provide context for our Galaxy's dark matter structure and subhalo population and will help interpret a range of measurements that are currently only possible in the MW.


title: A Microscopic Perspective on Moir\'e Materials

abstract: Contemporary quantum materials research is guided by themes of topology and of electronic correlations. A confluence of these two themes is engineered in "moir\'e materials", an emerging class of highly tunable, strongly correlated two-dimensional (2D) materials designed by the rotational or lattice misalignment of atomically thin crystals. In moir\'e materials, dominant Coulomb interactions among electrons give rise to collective electronic phases, often with robust topological properties. Identifying the mechanisms responsible for these exotic phases is fundamental to our understanding of strongly interacting quantum systems, and to our ability to engineer new material properties for potential future technological applications. In this Review, we highlight the contributions of local spectroscopic, thermodynamic, and electromagnetic probes to the budding field of moir\'e materials research. These techniques have not only identified many of the underlying mechanisms of the correlated insulators, generalized Wigner crystals, unconventional superconductors, moir\'e ferroelectrics, and topological orbital ferromagnets found in moir\'e materials, but they have also uncovered fragile quantum phases that have evaded spatially averaged global probes. Furthermore, we highlight recently developed local probe techniques, including local charge sensing and quantum interference probes, that have uncovered new physical observables in moir\'e materials.


title: JWST Discovery of $40+$ Microlensed Stars in a Magnified Galaxy, the "Dragon" behind Abell 370

abstract: Strong gravitational magnification by massive galaxy clusters enable us to detect faint background sources, resolve their detailed internal structures, and in the most extreme cases identify and study individual stars in distant galaxies. Highly magnified individual stars allow for a wide range of applications, including studies of stellar populations in distant galaxies and constraining small-scale dark matter structures. However, these applications have been hampered by the small number of events observed, as typically one or a few stars are identified from each distant galaxy. Here, we report the discovery of 46 significant microlensed stars in a single strongly-lensed high-redshift galaxy behind the Abell 370 cluster at redshift of 0.725 when the Universe was half of its current age (dubbed the ``Dragon arc''), based on two observations separated by one year with the James Webb Space Telescope ({\it JWST}). These events are mostly found near the expected lensing critical curves, suggesting that these are magnified individual stars that appear as transients from intracluster stellar microlenses. Through multi-wavelength photometry and colors, we constrain stellar types and find that many of them are consistent with red giants/supergiants magnified by factors of thousands. This finding reveals an unprecedented high occurrence of microlensing events in the Dragon arc, and proves that {\it JWST}'s time-domain observations open up the possibility of conducting statistical studies of high-redshift stars and subgalactic scale perturbations in the lensing dark matter field.


title: FORGE'd in FIRE III: The IMF in Quasar Accretion Disks from STARFORGE

abstract: Recently, we demonstrated self-consistent formation of strongly-magnetized quasar accretion disks (QADs) from cosmological radiation-magnetohydrodynamic-thermochemical galaxy-star formation simulations, including the full STARFORGE physics shown previously to produce a reasonable IMF under typical ISM conditions. Here we study star formation and the stellar IMF in QADs, on scales from 100 au to 10 pc from the SMBH. We show it is critical to include physics often previously neglected, including magnetic fields, radiation, and (proto)stellar feedback. Closer to the SMBH, star formation is suppressed, but the (rare) stars that do form exhibit top-heavy IMFs. Stars can form only in special locations (e.g. magnetic field switches) in the outer QAD. Protostars accrete their natal cores rapidly but then dynamically decouple from the gas and 'wander,' ceasing accretion on timescales ~100 yr. Their jets control initial core accretion, but the ejecta are 'swept up' into the larger-scale QAD flow without much dynamical effect. The strong tidal environment strongly suppresses common-core multiplicity. The IMF shape depends sensitively on un-resolved dynamics of protostellar disks (PSDs), as the global dynamical times can become incredibly short (< yr) and tidal fields are incredibly strong, so whether PSDs can efficiently transport angular momentum or fragment catastrophically at <10 au scales requires novel PSD simulations to properly address. Most analytic IMF models and analogies with planet formation in PSDs fail qualitatively to explain the simulation IMFs, though we discuss a couple of viable models.

categories: astro-ph.GA astro-ph.CO astro-ph.HE astro-ph.SR


title: The Origin of Young Stellar Populations in NGC 1783: Accretion of External Stars

abstract: The presence of young stellar populations in the Large Magellanic Cloud cluster NGC 1783 has caught significant attention, with suggestions ranging from it being a genuine secondary stellar generation to a population of blue straggler stars or simply contamination from background stars. Thanks to multi-epoch observations with the Hubble Space Telescope, proper motions for stars within the field of NGC 1783 have been derived, thus allowing accurate cluster membership determination. Here, we report that the younger stars within NGC 1783 indeed belong to the cluster, and their spatial distribution is more extended compared to the bulk of the older stellar population, consistent with previous studies. Through N-body simulations, we demonstrate that the observed characteristics of the younger stars cannot be explained solely by blue straggler stars in the context of the isolated dynamical evolution of NGC 1783. Instead, accretion of the external, low-mass stellar system can better account for both the inverse spatial concentration and the radial velocity isotropy of the younger stars. We propose that NGC 1783 may have accreted external stars from low-mass stellar systems, resulting in a mixture of external younger stars and blue straggler stars from the older bulk population, thereby accounting for the characteristics of the younger sequence.


title: The origin of the coherent radio flash potentially associated with GRB 201006A

abstract: Rowlinson et al. 2023 recently claimed the detection of a coherent radio flash 76.6 minutes after a short gamma-ray burst. They proposed that the radio emission may be associated with a long-lived neutron star engine. We show through theoretical and observational arguments that the coherent radio emission, if real and indeed associated with GRB 201006A and at the estimated redshift, is unlikely to be due to the collapse of the neutron star, ruling out a blitzar-like mechanism. Instead, we show if a long-lived engine was created, it must have been stable with the radio emission likely linked to the intrinsic magnetar activity. However, we find that the optical upper limits require fine-tuning to be consistent with a magnetar-driven kilonova: we show that neutron-star engines that do satisfy the optical constraints would have produced a bright kilonova afterglow that should already be observable by the VLA or MeerKAT (for ambient densities typical for short GRBs). Given the optical limits and the current lack of a kilonova afterglow, we instead posit that no neutron star survived the merger, and the coherent radio emission was produced far from a black hole central engine via mechanisms such as synchrotron maser or magnetic reconnection in the jet -- a scenario consistent with all observations. We encourage future radio follow-up to probe the engine of this exciting event and continued prompt radio follow-up of short GRBs.