title: WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models

abstract: This paper introduces WordArt Designer, a user-driven framework for artistic typography synthesis, relying on the Large Language Model (LLM). The system incorporates four key modules: the LLM Engine, SemTypo, StyTypo, and TexTypo modules. 1) The LLM Engine, empowered by the LLM (e.g., GPT-3.5), interprets user inputs and generates actionable prompts for the other modules, thereby transforming abstract concepts into tangible designs. 2) The SemTypo module optimizes font designs using semantic concepts, striking a balance between artistic transformation and readability. 3) Building on the semantic layout provided by the SemTypo module, the StyTypo module creates smooth, refined images. 4) The TexTypo module further enhances the design's aesthetics through texture rendering, enabling the generation of inventive textured fonts. Notably, WordArt Designer highlights the fusion of generative AI with artistic typography. Experience its capabilities on ModelScope: https://www.modelscope.cn/studios/WordArt/WordArt.


title: She had Cobalt Blue Eyes: Prompt Testing to Create Aligned and Sustainable Language Models

abstract: As the use of large language models (LLMs) increases within society, as does the risk of their misuse. Appropriate safeguards must be in place to ensure LLM outputs uphold the ethical standards of society, highlighting the positive role that artificial intelligence technologies can have. Recent events indicate ethical concerns around conventionally trained LLMs, leading to overall unsafe user experiences. This motivates our research question: how do we ensure LLM alignment? In this work, we introduce a test suite of unique prompts to foster the development of aligned LLMs that are fair, safe, and robust. We show that prompting LLMs at every step of the development pipeline, including data curation, pre-training, and fine-tuning, will result in an overall more responsible model. Our test suite evaluates outputs from four state-of-the-art language models: GPT-3.5, GPT-4, OPT, and LLaMA-2. The assessment presented in this paper highlights a gap between societal alignment and the capabilities of current LLMs. Additionally, implementing a test suite such as ours lowers the environmental overhead of making models safe and fair.


title: Hypersparse Traffic Matrix Construction using GraphBLAS on a DPU

abstract: Low-power small form factor data processing units (DPUs) enable offloading and acceleration of a broad range of networking and security services. DPUs have accelerated the transition to programmable networking by enabling the replacement of FPGAs/ASICs in a wide range of network oriented devices. The GraphBLAS sparse matrix graph open standard math library is well-suited for constructing anonymized hypersparse traffic matrices of network traffic which can enable a wide range of network analytics. This paper measures the performance of the GraphBLAS on an ARM based NVIDIA DPU (BlueField 2) and, to the best of our knowledge, represents the first reported GraphBLAS results on a DPU and/or ARM based system. Anonymized hypersparse traffic matrices were constructed at a rate of over 18 million packets per second.


title: The hardware is the software

abstract: Human brains and bodies are not hardware running software: the hardware is the software. We reason that because the microscopic physics of artificial-intelligence hardware and of human biological "hardware" is distinct, neuromorphic engineers need to be cautious (and yet also creative) in how we take inspiration from biological intelligence. We should focus primarily on principles and design ideas that respect -- and embrace -- the underlying hardware physics of non-biological intelligent systems, rather than abstracting it away. We see a major role for neuroscience in neuromorphic computing as identifying the physics-agnostic principles of biological intelligence -- that is the principles of biological intelligence that can be gainfully adapted and applied to any physical hardware.


title: AITA Generating Moral Judgements of the Crowd with Reasoning

abstract: Morality is a fundamental aspect of human behavior and ethics, influencing how we interact with each other and the world around us. When faced with a moral dilemma, a person's ability to make clear moral judgments can be clouded. Due to many factors such as personal biases, emotions and situational factors people can find it difficult to decide their best course of action. The AmITheAsshole (AITA) subreddit is a forum on the social media platform Reddit that helps people get clarity and objectivity on their predicaments. In the forum people post anecdotes about moral dilemmas they are facing in their lives, seeking validation for their actions or advice on how to navigate the situation from the community. The morality of the actions in each post is classified based on the collective opinion of the community into mainly two labels, "Not The Asshole" (NTA) and "You Are The Asshole" (YTA). This project aims to generate comments with moral reasoning for stories with moral dilemmas using the AITA subreddit as a dataset. While past literature has explored the classification of posts into labels (Alhassan et al., 2022), the generation of comments remains a novel and challenging task. It involves understanding the complex social and ethical considerations in each situation. To address this challenge, we will leverage the vast amount of data on the forum with the goal of generating coherent comments that align with the norms and values of the AITA community. In this endeavor, we aim to evaluate state-of-the-art seq2seq text generation models for their ability to make moral judgments similarly to humans, ultimately producing concise comments providing clear moral stances and advice for the poster.


title: Testing tensor product B\'{e}zier surfaces for coincidence: A comprehensive solution

abstract: It is known that B\'{e}zier curves and surfaces may have multiple representations by different control polygons. The polygons may have different number of control points and may even be disjoint. Up to our knowledge, Pekerman et al. (2005) were the first to address the problem of testing two parametric polynomial curves for coincidence. Their approach is based on reduction of the input curves into canonical irreducible form. They claimed that their approach can be extended for testing tensor product surfaces but gave no further detail. In this paper we develop a new technique and provide a comprehensive solution to the problem of testing tensor product B\'ezier surfaces for coincidence. In (Vlachkova, 2017) an algorithm for testing B\'ezier curves was proposed based on subdivision. There a partial solution to the problem of testing tensor product B\'ezier surfaces was presented. Namely, the case where the irreducible surfaces are of same degree $(n,m)$, $n,m \in \mathbb{N}$, was resolved under certain additional condition. The other cases where one of the surfaces is of degree $(n,m)$ and the other is of degree either $(n,n+m)$, or $(n+m,m)$, or $(n+m,n+m)$ remained open. We have implemented our algorithm for testing tensor product B\'ezier surfaces for coincidence using Mathematica package. Experimental results and their analysis are presented.


title: Small Language Models Fine-tuned to Coordinate Larger Language Models improve Complex Reasoning

abstract: Large Language Models (LLMs) prompted to generate chain-of-thought (CoT) exhibit impressive reasoning capabilities. Recent attempts at prompt decomposition toward solving complex, multi-step reasoning problems depend on the ability of the LLM to simultaneously decompose and solve the problem. A significant disadvantage is that foundational LLMs are typically not available for fine-tuning, making adaptation computationally prohibitive. We believe (and demonstrate) that problem decomposition and solution generation are distinct capabilites, better addressed in separate modules, than by one monolithic LLM. We introduce DaSLaM, which uses a decomposition generator to decompose complex problems into subproblems that require fewer reasoning steps. These subproblems are answered by a solver. We use a relatively small (13B parameters) LM as the decomposition generator, which we train using policy gradient optimization to interact with a solver LM (regarded as black-box) and guide it through subproblems, thereby rendering our method solver-agnostic. Evaluation on multiple different reasoning datasets reveal that with our method, a 175 billion parameter LM (text-davinci-003) can produce competitive or even better performance, compared to its orders-of-magnitude larger successor, GPT-4. Additionally, we show that DaSLaM is not limited by the solver's capabilities as a function of scale; e.g., solver LMs with diverse sizes give significant performance improvement with our solver-agnostic decomposition technique. Exhaustive ablation studies evince the superiority of our modular finetuning technique over exorbitantly large decomposer LLMs, based on prompting alone.


title: When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications

abstract: The recent surge in Large Language Models (LLMs) has garnered significant attention across numerous fields. Fine-tuning is often required to fit general LLMs for a specific domain, like the web-based healthcare system. However, two problems arise during fine-tuning LLMs for medical applications. One is the task variety problem, which involves distinct tasks in real-world medical scenarios. The variety often leads to sub-optimal fine-tuning for data imbalance and seesaw problems. Besides, the large amount of parameters in LLMs leads to huge time and computation consumption by fine-tuning. To address these two problems, we propose a novel parameter efficient fine-tuning framework for multi-task medical applications, dubbed as MOELoRA. The designed framework aims to absorb both the benefits of mixture-of-expert (MOE) for multi-task learning and low-rank adaptation (LoRA) for parameter efficient fine-tuning. For unifying MOE and LoRA, we devise multiple experts as the trainable parameters, where each expert consists of a pair of low-rank matrices to retain the small size of trainable parameters. Then, a task-motivated gate function for all MOELoRA layers is proposed, which can control the contributions of each expert and produce distinct parameters for various tasks. We conduct experiments on a multi-task medical dataset, indicating MOELoRA outperforms the existing parameter efficient fine-tuning methods. The code is available online.


title: UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Web

abstract: Urban region profiling from web-sourced data is of utmost importance for urban planning and sustainable development. We are witnessing a rising trend of LLMs for various fields, especially dealing with multi-modal data research such as vision-language learning, where the text modality serves as a supplement information for the image. Since textual modality has never been introduced into modality combinations in urban region profiling, we aim to answer two fundamental questions in this paper: i) Can textual modality enhance urban region profiling? ii) and if so, in what ways and with regard to which aspects? To answer the questions, we leverage the power of Large Language Models (LLMs) and introduce the first-ever LLM-enhanced framework that integrates the knowledge of textual modality into urban imagery profiling, named LLM-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining (UrbanCLIP). Specifically, it first generates a detailed textual description for each satellite image by an open-source Image-to-Text LLM. Then, the model is trained on the image-text pairs, seamlessly unifying natural language supervision for urban visual representation learning, jointly with contrastive loss and language modeling loss. Results on predicting three urban indicators in four major Chinese metropolises demonstrate its superior performance, with an average improvement of 6.1% on R^2 compared to the state-of-the-art methods. Our code and the image-language dataset will be released upon paper notification.


title: CXR-LLAVA: a multimodal large language model for interpreting chest X-ray images

abstract: Purpose: This study aimed to develop an open-source multimodal large language model (CXR-LLAVA) for interpreting chest X-ray images (CXRs), leveraging recent advances in large language models (LLMs) to potentially replicate the image interpretation skills of human radiologists Materials and Methods: For training, we collected 592,580 publicly available CXRs, of which 374,881 had labels for certain radiographic abnormalities (Dataset 1) and 217,699 provided free-text radiology reports (Dataset 2). After pre-training a vision transformer with Dataset 1, we integrated it with an LLM influenced by the LLAVA network. Then, the model was fine-tuned, primarily using Dataset 2. The model's diagnostic performance for major pathological findings was evaluated, along with the acceptability of radiologic reports by human radiologists, to gauge its potential for autonomous reporting. Results: The model demonstrated impressive performance in test sets, achieving an average F1 score of 0.81 for six major pathological findings in the MIMIC internal test set and 0.62 for seven major pathological findings in the external test set. The model's F1 scores surpassed those of GPT-4-vision and Gemini-Pro-Vision in both test sets. In human radiologist evaluations of the external test set, the model achieved a 72.7% success rate in autonomous reporting, slightly below the 84.0% rate of ground truth reports. Conclusion: This study highlights the significant potential of multimodal LLMs for CXR interpretation, while also acknowledging the performance limitations. Despite these challenges, we believe that making our model open-source will catalyze further research, expanding its effectiveness and applicability in various clinical contexts. CXR-LLAVA is available at https://github.com/ECOFRI/CXR_LLAVA.


title: MIRACLE: Towards Personalized Dialogue Generation with Latent-Space Multiple Personal Attribute Control

abstract: Personalized dialogue systems aim to endow the chatbot agent with more anthropomorphic traits for human-like interactions. Previous approaches have explored explicitly user profile modeling using text descriptions, implicit derivation of user embeddings, or utilizing handicraft prompts for ChatGPT-like models. However, textual personas are limited in describing multi-faceted attributes (\emph{e.g.}, \emph{language style, inner character nuances}), implicit embedding suffers from personality sparsity, and handicraft prompts lack fine-grained and stable controllability. Hence, these approaches may struggle with complex personalized dialogue generation tasks that require generating controllable responses with multiple personal attributes. To this end, we propose \textbf{\textsc{Miracle}}, a novel personalized dialogue generation method through \textbf{M}ult\textbf{I}ple Pe\textbf{R}sonal \textbf{A}ttributes \textbf{C}ontrol within \textbf{L}atent-Space \textbf{E}nergy-based Models. ttributes \textbf{C}ontrol within \textbf{L}atent-Space \textbf{E}nergy-based Models. Specifically, our approach first disentangles complex personality into multi-faceted attributes. Subsequently, we employ a conditional variational auto-encoder to align with the dense personalized responses within a latent joint attribute space. We have also tailored a dedicated energy function and customized the ordinary differential equations sampling method to offer flexible attribute composition and precise attribute control. Extensive experiments demonstrate that \textsc{Miracle} outperforms several strong baselines in terms of personality controllability and response generation quality. Our dataset and code are available at \url{https://github.com/LZY-the-boys/MIRACLE}


title: PHD: Pixel-Based Language Modeling of Historical Documents

abstract: The digitisation of historical documents has provided historians with unprecedented research opportunities. Yet, the conventional approach to analysing historical documents involves converting them from images to text using OCR, a process that overlooks the potential benefits of treating them as images and introduces high levels of noise. To bridge this gap, we take advantage of recent advancements in pixel-based language models trained to reconstruct masked patches of pixels instead of predicting token distributions. Due to the scarcity of real historical scans, we propose a novel method for generating synthetic scans to resemble real historical documents. We then pre-train our model, PHD, on a combination of synthetic scans and real historical newspapers from the 1700-1900 period. Through our experiments, we demonstrate that PHD exhibits high proficiency in reconstructing masked image patches and provide evidence of our model's noteworthy language understanding capabilities. Notably, we successfully apply our model to a historical QA task, highlighting its usefulness in this domain.


title: Chainpoll: A high efficacy method for LLM hallucination detection

abstract: Large language models (LLMs) have experienced notable advancements in generating coherent and contextually relevant responses. However, hallucinations - incorrect or unfounded claims - are still prevalent, prompting the creation of automated metrics to detect these in LLM outputs. Our contributions include: introducing ChainPoll, an innovative hallucination detection method that excels compared to its counterparts, and unveiling RealHall, a refined collection of benchmark datasets to assess hallucination detection metrics from recent studies. While creating RealHall, we assessed tasks and datasets from previous hallucination detection studies and observed that many are not suitable for the potent LLMs currently in use. Overcoming this, we opted for four datasets challenging for modern LLMs and pertinent to real-world scenarios. Using RealHall, we conducted a comprehensive comparison of ChainPoll with numerous hallucination metrics from recent studies. Our findings indicate that ChainPoll outperforms in all RealHall benchmarks, achieving an overall AUROC of 0.781. This surpasses the next best theoretical method by 11% and exceeds industry standards by over 23%. Additionally, ChainPoll is cost-effective and offers greater transparency than other metrics. We introduce two novel metrics to assess LLM hallucinations: Adherence and Correctness. Adherence is relevant to Retrieval Augmented Generation workflows, evaluating an LLM's analytical capabilities within given documents and contexts. In contrast, Correctness identifies logical and reasoning errors.


title: A Survey on Semantic Processing Techniques

abstract: Semantic processing is a fundamental research domain in computational linguistics. In the era of powerful pre-trained language models and large language models, the advancement of research in this domain appears to be decelerating. However, the study of semantics is multi-dimensional in linguistics. The research depth and breadth of computational semantic processing can be largely improved with new technologies. In this survey, we analyzed five semantic processing tasks, e.g., word sense disambiguation, anaphora resolution, named entity recognition, concept extraction, and subjectivity detection. We study relevant theoretical research in these fields, advanced methods, and downstream applications. We connect the surveyed tasks with downstream applications because this may inspire future scholars to fuse these low-level semantic processing tasks with high-level natural language processing tasks. The review of theoretical research may also inspire new tasks and technologies in the semantic processing domain. Finally, we compare the different semantic processing techniques and summarize their technical trends, application trends, and future directions.


title: Data-Free Distillation Improves Efficiency and Privacy in Federated Thorax Disease Analysis

abstract: Thorax disease analysis in large-scale, multi-centre, and multi-scanner settings is often limited by strict privacy policies. Federated learning (FL) offers a potential solution, while traditional parameter-based FL can be limited by issues such as high communication costs, data leakage, and heterogeneity. Distillation-based FL can improve efficiency, but it relies on a proxy dataset, which is often impractical in clinical practice. To address these challenges, we introduce a data-free distillation-based FL approach FedKDF. In FedKDF, the server employs a lightweight generator to aggregate knowledge from different clients without requiring access to their private data or a proxy dataset. FedKDF combines the predictors from clients into a single, unified predictor, which is further optimized using the learned knowledge in the lightweight generator. Our empirical experiments demonstrate that FedKDF offers a robust solution for efficient, privacy-preserving federated thorax disease analysis.


title: PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adapter

abstract: The Retrieval Question Answering (ReQA) task employs the retrieval-augmented framework, composed of a retriever and generator. The generator formulates the answer based on the documents retrieved by the retriever. Incorporating Large Language Models (LLMs) as generators is beneficial due to their advanced QA capabilities, but they are typically too large to be fine-tuned with budget constraints while some of them are only accessible via APIs. To tackle this issue and further improve ReQA performance, we propose a trainable Pluggable Reward-Driven Contextual Adapter (PRCA), keeping the generator as a black box. Positioned between the retriever and generator in a Pluggable manner, PRCA refines the retrieved information by operating in a token-autoregressive strategy via maximizing rewards of the reinforcement learning phase. Our experiments validate PRCA's effectiveness in enhancing ReQA performance on three datasets by up to 20% improvement to fit black-box LLMs into existing frameworks, demonstrating its considerable potential in the LLMs era.


title: Meaning Representations from Trajectories in Autoregressive Models

abstract: We propose to extract meaning representations from autoregressive language models by considering the distribution of all possible trajectories extending an input text. This strategy is prompt-free, does not require fine-tuning, and is applicable to any pre-trained autoregressive model. Moreover, unlike vector-based representations, distribution-based representations can also model asymmetric relations (e.g., direction of logical entailment, hypernym/hyponym relations) by using algebraic operations between likelihood functions. These ideas are grounded in distributional perspectives on semantics and are connected to standard constructions in automata theory, but to our knowledge they have not been applied to modern language models. We empirically show that the representations obtained from large models align well with human annotations, outperform other zero-shot and prompt-free methods on semantic similarity tasks, and can be used to solve more complex entailment and containment tasks that standard embeddings cannot handle. Finally, we extend our method to represent data from different modalities (e.g., image and text) using multimodal autoregressive models. Our code is available at: https://github.com/tianyu139/meaning-as-trajectories


title: A Boundary Offset Prediction Network for Named Entity Recognition

abstract: Named entity recognition (NER) is a fundamental task in natural language processing that aims to identify and classify named entities in text. However, span-based methods for NER typically assign entity types to text spans, resulting in an imbalanced sample space and neglecting the connections between non-entity and entity spans. To address these issues, we propose a novel approach for NER, named the Boundary Offset Prediction Network (BOPN), which predicts the boundary offsets between candidate spans and their nearest entity spans. By leveraging the guiding semantics of boundary offsets, BOPN establishes connections between non-entity and entity spans, enabling non-entity spans to function as additional positive samples for entity detection. Furthermore, our method integrates entity type and span representations to generate type-aware boundary offsets instead of using entity types as detection targets. We conduct experiments on eight widely-used NER datasets, and the results demonstrate that our proposed BOPN outperforms previous state-of-the-art methods.


title: Stochastic resolution of identity to CC2 for large systems: excited state properties

abstract: We apply a stochastic resolution of identity approximation (sRI) to the CC2 method for excitation energy calculations. A set of stochastic orbitals are employed to decouple the crucial 4-index electron repulsion integrals and optimize the contraction steps in CC2 response theory. The CC2 response for excitations builds upon sRI-CC2 ground-state calculations, which scales as O(N^3), where N is a measure for the system size. Overall, the current algorithm for excited states also allows a sharp scaling reduction from original O(N^5) to O(N^3). We test the sRI-CC2 for different molecular systems and basis sets, and we show our sRI-CC2 method can accurately reproduce the results of deterministic CC2 approach. Our sRI-CC2 exhibits an experimental scaling of O(N^2.88) for a hydrogen dimer chain, allowing us to calculate systems with nearly thousands of electrons.


title: BioImage.IO Chatbot: A Community-Driven AI Assistant for Integrative Computational Bioimaging

abstract: We present the BioImage$.$IO Chatbot, an AI assistant powered by Large Language Models and supported by a community-driven knowledge base and toolset. This chatbot is designed to cater to a wide range of user needs through a flexible extension mechanism that spans from information retrieval to AI-enhanced analysis and microscopy control. Embracing open-source principles, the chatbot is designed to evolve through community contributions. By simplifying navigation through the intricate bioimaging landscape, the BioImage$.$IO Chatbot empowers life sciences to progress by leveraging the collective expertise and innovation of its users.


title: Theory of Rayleigh-Brillouin optical activity light scattering applicable to chiral liquids

abstract: It has long been understood that dilute samples of chiral molecules such as rarefied gases should exhibit Rayleigh optical activity. We extend the existing theory by accounting for molecular dynamics and correlations, thus obtaining a more general theory of Rayleigh-Brillouin optical activity applicable to dense samples such as neat liquids.


title: Supporting Custom Instructions with the LLVM Compiler for RISC-V Processor

abstract: The rise of hardware accelerators with custom instructions necessitates custom compiler backends supporting these accelerators. This study provides detailed analyses of LLVM and its RISC-V backend, supplemented with case studies providing end-to-end overview of the mentioned transformations. We discuss that instruction design should consider both hardware and software design space. The necessary compiler modifications may mean that the instruction is not well designed and need to be reconsidered. We discuss that RISC-V standard extensions provide exemplary instructions that can guide instruction designers. In this study, the process of adding a custom instruction to compiler is split into two parts as Assembler support and pattern matching support. Without pattern matching support, conventional software requires manual entries of inline Assembly for the accelerator which is not scalable. While it is trivial to add Assembler support regardless of the instruction semantics, pattern matching support is on the contrary. Pattern matching support and choosing the right stage for the modification, requires the knowledge of the internal transformations in the compiler. This study delves deep into pattern matching and presents multiple ways to approach the problem of pattern matching support. It is discussed that depending on the pattern's complexity, higher level transformations, e.g. IR level, can be more maintainable compared to Instruction Selection phase.


title: A Review of Reinforcement Learning for Natural Language Processing, and Applications in Healthcare

abstract: Reinforcement learning (RL) has emerged as a powerful approach for tackling complex medical decision-making problems such as treatment planning, personalized medicine, and optimizing the scheduling of surgeries and appointments. It has gained significant attention in the field of Natural Language Processing (NLP) due to its ability to learn optimal strategies for tasks such as dialogue systems, machine translation, and question-answering. This paper presents a review of the RL techniques in NLP, highlighting key advancements, challenges, and applications in healthcare. The review begins by visualizing a roadmap of machine learning and its applications in healthcare. And then it explores the integration of RL with NLP tasks. We examined dialogue systems where RL enables the learning of conversational strategies, RL-based machine translation models, question-answering systems, text summarization, and information extraction. Additionally, ethical considerations and biases in RL-NLP systems are addressed.


title: Health Disparities through Generative AI Models: A Comparison Study Using A Domain Specific large language model

abstract: Health disparities are differences in health outcomes and access to healthcare between different groups, including racial and ethnic minorities, low-income people, and rural residents. An artificial intelligence (AI) program called large language models (LLMs) can understand and generate human language, improving health communication and reducing health disparities. There are many challenges in using LLMs in human-doctor interaction, including the need for diverse and representative data, privacy concerns, and collaboration between healthcare providers and technology experts. We introduce the comparative investigation of domain-specific large language models such as SciBERT with a multi-purpose LLMs BERT. We used cosine similarity to analyze text queries about health disparities in exam rooms when factors such as race are used alone. Using text queries, SciBERT fails when it doesn't differentiate between queries text: "race" alone and "perpetuates health disparities." We believe clinicians can use generative AI to create a draft response when communicating asynchronously with patients. However, careful attention must be paid to ensure they are developed and implemented ethically and equitably.


title: LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recovery

abstract: Large Language Models (LLMs) have transformed the landscape of artificial intelligence, while their enormous size presents significant challenges in terms of computational costs. We introduce LoRAShear, a novel efficient approach to structurally prune LLMs and recover knowledge. Given general LLMs, LoRAShear at first creates the dependency graphs over LoRA modules to discover minimally removal structures and analyze the knowledge distribution. It then proceeds progressive structured pruning on LoRA adaptors and enables inherent knowledge transfer to better preserve the information in the redundant structures. To recover the lost knowledge during pruning, LoRAShear meticulously studies and proposes a dynamic fine-tuning schemes with dynamic data adaptors to effectively narrow down the performance gap to the full models. Numerical results demonstrate that by only using one GPU within a couple of GPU days, LoRAShear effectively reduced footprint of LLMs by 20% with only 1.0% performance degradation and significantly outperforms state-of-the-arts. The source code will be available at https://github.com/microsoft/lorashear.


title: Leveraging Large Language Models for Enhanced Product Descriptions in eCommerce

abstract: In the dynamic field of eCommerce, the quality and comprehensiveness of product descriptions are pivotal for enhancing search visibility and customer engagement. Effective product descriptions can address the 'cold start' problem, align with market trends, and ultimately lead to increased click-through rates. Traditional methods for crafting these descriptions often involve significant human effort and may lack both consistency and scalability. This paper introduces a novel methodology for automating product description generation using the LLAMA 2.0 7B language model. We train the model on a dataset of authentic product descriptions from Walmart, one of the largest eCommerce platforms. The model is then fine-tuned for domain-specific language features and eCommerce nuances to enhance its utility in sales and user engagement. We employ multiple evaluation metrics, including NDCG, customer click-through rates, and human assessments, to validate the effectiveness of our approach. Our findings reveal that the system is not only scalable but also significantly reduces the human workload involved in creating product descriptions. This study underscores the considerable potential of large language models like LLAMA 2.0 7B in automating and optimizing various facets of eCommerce platforms, offering significant business impact, including improved search functionality and increased sales.


title: A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models

abstract: The springing up of Large Language Models (LLMs) has shifted the community from single-task-orientated natural language processing (NLP) research to a holistic end-to-end multi-task learning paradigm. Along this line of research endeavors in the area, LLM-based prompting methods have attracted much attention, partially due to the technological advantages brought by prompt engineering (PE) as well as the underlying NLP principles disclosed by various prompting methods. Traditional supervised learning usually requires training a model based on labeled data and then making predictions. In contrast, PE methods directly use the powerful capabilities of existing LLMs (i.e., GPT-3 and GPT-4) via composing appropriate prompts, especially under few-shot or zero-shot scenarios. Facing the abundance of studies related to the prompting and the ever-evolving nature of this field, this article aims to (i) illustrate a novel perspective to review existing PE methods, within the well-established communication theory framework; (ii) facilitate a better/deeper understanding of developing trends of existing PE methods used in four typical tasks; (iii) shed light on promising research directions for future PE methods.


title: DeSIQ: Towards an Unbiased, Challenging Benchmark for Social Intelligence Understanding

abstract: Social intelligence is essential for understanding and reasoning about human expressions, intents and interactions. One representative benchmark for its study is Social Intelligence Queries (Social-IQ), a dataset of multiple-choice questions on videos of complex social interactions. We define a comprehensive methodology to study the soundness of Social-IQ, as the soundness of such benchmark datasets is crucial to the investigation of the underlying research problem. Our analysis reveals that Social-IQ contains substantial biases, which can be exploited by a moderately strong language model to learn spurious correlations to achieve perfect performance without being given the context or even the question. We introduce DeSIQ, a new challenging dataset, constructed by applying simple perturbations to Social-IQ. Our empirical analysis shows DeSIQ significantly reduces the biases in the original Social-IQ dataset. Furthermore, we examine and shed light on the effect of model size, model style, learning settings, commonsense knowledge, and multi-modality on the new benchmark performance. Our new dataset, observations and findings open up important research questions for the study of social intelligence.


title: Guiding LLM to Fool Itself: Automatically Manipulating Machine Reading Comprehension Shortcut Triggers

abstract: Recent applications of LLMs in Machine Reading Comprehension (MRC) systems have shown impressive results, but the use of shortcuts, mechanisms triggered by features spuriously correlated to the true label, has emerged as a potential threat to their reliability. We analyze the problem from two angles: LLMs as editors, guided to edit text to mislead LLMs; and LLMs as readers, who answer questions based on the edited text. We introduce a framework that guides an editor to add potential shortcuts-triggers to samples. Using GPT4 as the editor, we find it can successfully edit trigger shortcut in samples that fool LLMs. Analysing LLMs as readers, we observe that even capable LLMs can be deceived using shortcut knowledge. Strikingly, we discover that GPT4 can be deceived by its own edits (15% drop in F1). Our findings highlight inherent vulnerabilities of LLMs to shortcut manipulations. We publish ShortcutQA, a curated dataset generated by our framework for future research.


title: Clinical Decision Support System for Unani Medicine Practitioners

abstract: Like other fields of Traditional Medicines, Unani Medicines have been found as an effective medical practice for ages. It is still widely used in the subcontinent, particularly in Pakistan and India. However, Unani Medicines Practitioners are lacking modern IT applications in their everyday clinical practices. An Online Clinical Decision Support System may address this challenge to assist apprentice Unani Medicines practitioners in their diagnostic processes. The proposed system provides a web-based interface to enter the patient's symptoms, which are then automatically analyzed by our system to generate a list of probable diseases. The system allows practitioners to choose the most likely disease and inform patients about the associated treatment options remotely. The system consists of three modules: an Online Clinical Decision Support System, an Artificial Intelligence Inference Engine, and a comprehensive Unani Medicines Database. The system employs advanced AI techniques such as Decision Trees, Deep Learning, and Natural Language Processing. For system development, the project team used a technology stack that includes React, FastAPI, and MySQL. Data and functionality of the application is exposed using APIs for integration and extension with similar domain applications. The novelty of the project is that it addresses the challenge of diagnosing diseases accurately and efficiently in the context of Unani Medicines principles. By leveraging the power of technology, the proposed Clinical Decision Support System has the potential to ease access to healthcare services and information, reduce cost, boost practitioner and patient satisfaction, improve speed and accuracy of the diagnostic process, and provide effective treatments remotely. The application will be useful for Unani Medicines Practitioners, Patients, Government Drug Regulators, Software Developers, and Medical Researchers.


title: SoK: Memorization in General-Purpose Large Language Models

abstract: Large Language Models (LLMs) are advancing at a remarkable pace, with myriad applications under development. Unlike most earlier machine learning models, they are no longer built for one specific application but are designed to excel in a wide range of tasks. A major part of this success is due to their huge training datasets and the unprecedented number of model parameters, which allow them to memorize large amounts of information contained in the training data. This memorization goes beyond mere language, and encompasses information only present in a few documents. This is often desirable since it is necessary for performing tasks such as question answering, and therefore an important part of learning, but also brings a whole array of issues, from privacy and security to copyright and beyond. LLMs can memorize short secrets in the training data, but can also memorize concepts like facts or writing styles that can be expressed in text in many different ways. We propose a taxonomy for memorization in LLMs that covers verbatim text, facts, ideas and algorithms, writing styles, distributional properties, and alignment goals. We describe the implications of each type of memorization - both positive and negative - for model performance, privacy, security and confidentiality, copyright, and auditing, and ways to detect and prevent memorization. We further highlight the challenges that arise from the predominant way of defining memorization with respect to model behavior instead of model weights, due to LLM-specific phenomena such as reasoning capabilities or differences between decoding algorithms. Throughout the paper, we describe potential risks and opportunities arising from memorization in LLMs that we hope will motivate new research directions.


title: A Contextualized Real-Time Multimodal Emotion Recognition for Conversational Agents using Graph Convolutional Networks in Reinforcement Learning

abstract: Owing to the recent developments in Generative Artificial Intelligence (GenAI) and Large Language Models (LLM), conversational agents are becoming increasingly popular and accepted. They provide a human touch by interacting in ways familiar to us and by providing support as virtual companions. Therefore, it is important to understand the user's emotions in order to respond considerately. Compared to the standard problem of emotion recognition, conversational agents face an additional constraint in that recognition must be real-time. Studies on model architectures using audio, visual, and textual modalities have mainly focused on emotion classification using full video sequences that do not provide online features. In this work, we present a novel paradigm for contextualized Emotion Recognition using Graph Convolutional Network with Reinforcement Learning (conER-GRL). Conversations are partitioned into smaller groups of utterances for effective extraction of contextual information. The system uses Gated Recurrent Units (GRU) to extract multimodal features from these groups of utterances. More importantly, Graph Convolutional Networks (GCN) and Reinforcement Learning (RL) agents are cascade trained to capture the complex dependencies of emotion features in interactive scenarios. Comparing the results of the conER-GRL model with other state-of-the-art models on the benchmark dataset IEMOCAP demonstrates the advantageous capabilities of the conER-GRL architecture in recognizing emotions in real-time from multimodal conversational signals.


title: From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning

abstract: Pre-trained language models (PLMs) have shown impressive performance in various language tasks. However, they are prone to spurious correlations, and often generate illusory information. In real-world applications, PLMs should justify decisions with formalized, coherent reasoning chains, but this challenge remains under-explored. Cognitive psychology theorizes that humans are capable of utilizing fast and intuitive heuristic thinking to make decisions based on past experience, then rationalizing the decisions through slower and deliberative analytic reasoning. We incorporate these interlinked dual processes in fine-tuning and in-context learning with PLMs, applying them to two language understanding tasks that require coherent physical commonsense reasoning. We show that our proposed Heuristic-Analytic Reasoning (HAR) strategies drastically improve the coherence of rationalizations for model decisions, yielding state-of-the-art results on Tiered Reasoning for Intuitive Physics (TRIP). We also find that this improved coherence is a direct result of more faithful attention to relevant language context in each step of reasoning. Our findings suggest that human-like reasoning strategies can effectively improve the coherence and reliability of PLM reasoning.


title: Using GPT-4 to Augment Unbalanced Data for Automatic Scoring

abstract: Machine learning-based automatic scoring can be challenging if students' responses are unbalanced across scoring categories, as it introduces uncertainty in the machine training process. To meet this challenge, we introduce a novel text data augmentation framework using GPT-4, a generative large language model, specifically tailored for unbalanced datasets in automatic scoring. Our experimental dataset comprised student-written responses to two science items. We crafted prompts for GPT-4 to generate responses resembling student-written answers, particularly for the minority scoring classes, to augment the data. We then finetuned DistillBERT for automatic scoring based on the augmented and original datasets. Model performance was assessed using accuracy, precision, recall, and F1 score. We incorporate varied amounts of augmented data to examine scoring performance, and our findings revealed remarkedly improved model performance. The average maximum increase observed across two items is: 3.5% for accuracy, 30.6% for precision, 21.1% for recall, and 24.2% for F1 score. Notably, using just 5% of the augmented data led to substantial improvements: 2.6%, 29.2%, 15.1%, and 19.6%. Interestingly, the extent of improvement varied depending on specific datasets. Moreover, we found that a varying amount of augmented data (5%-40%) was needed to obtain a stable improvement. We also compare models trained with GPT-4 augmented data and those trained with additional student-written responses. The findings indicate that former ones match or even exceed the performance of the latter. Specifically, there is an average difference of 1.7%, 1.9%, 11.0%, and 7.8% for four metrics separately. This research underscores the potential and effectiveness of data augmentation techniques utilizing GPT-4 in addressing unbalanced datasets within automated assessment.


title: A Multilingual Virtual Guide for Self-Attachment Technique

abstract: In this work, we propose a computational framework that leverages existing out-of-language data to create a conversational agent for the delivery of Self-Attachment Technique (SAT) in Mandarin. Our framework does not require large-scale human translations, yet it achieves a comparable performance whilst also maintaining safety and reliability. We propose two different methods of augmenting available response data through empathetic rewriting. We evaluate our chatbot against a previous, English-only SAT chatbot through non-clinical human trials (N=42), each lasting five days, and quantitatively show that we are able to attain a comparable level of performance to the English SAT chatbot. We provide qualitative analysis on the limitations of our study and suggestions with the aim of guiding future improvements.


title: Unsupervised Learning of Molecular Embeddings for Enhanced Clustering and Emergent Properties for Chemical Compounds

abstract: The detailed analysis of molecular structures and properties holds great potential for drug development discovery through machine learning. Developing an emergent property in the model to understand molecules would broaden the horizons for development with a new computational tool. We introduce various methods to detect and cluster chemical compounds based on their SMILES data. Our first method, analyzing the graphical structures of chemical compounds using embedding data, employs vector search to meet our threshold value. The results yielded pronounced, concentrated clusters, and the method produced favorable results in querying and understanding the compounds. We also used natural language description embeddings stored in a vector database with GPT3.5, which outperforms the base model. Thus, we introduce a similarity search and clustering algorithm to aid in searching for and interacting with molecules, enhancing efficiency in chemical exploration and enabling future development of emergent properties in molecular property prediction models.


title: Muslim-Violence Bias Persists in Debiased GPT Models

abstract: Abid et al. (2021) showed a tendency in GPT-3 to generate mostly violent completions when prompted about Muslims, compared with other religions. Two pre-registered replication attempts found few violent completions and only a weak anti-Muslim bias in the more recent InstructGPT, fine-tuned to eliminate biased and toxic outputs. However, more pre-registered experiments showed that using common names associated with the religions in prompts increases several-fold the rate of violent completions, revealing a significant second-order anti-Muslim bias. ChatGPT showed a bias many times stronger regardless of prompt format, suggesting that the effects of debiasing were reduced with continued model development. Our content analysis revealed religion-specific themes containing offensive stereotypes across all experiments. Our results show the need for continual de-biasing of models in ways that address both explicit and higher-order associations.


title: Apollo: Zero-shot MultiModal Reasoning with Multiple Experts

abstract: We propose a modular framework that leverages the expertise of different foundation models over different modalities and domains in order to perform a single, complex, multi-modal task, without relying on prompt engineering or otherwise tailor-made multi-modal training. Our approach enables decentralized command execution and allows each model to both contribute and benefit from the expertise of the other models. Our method can be extended to a variety of foundation models (including audio and vision), above and beyond only language models, as it does not depend on prompts. We demonstrate our approach on two tasks. On the well-known task of stylized image captioning, our experiments show that our approach outperforms semi-supervised state-of-the-art models, while being zero-shot and avoiding costly training, data collection, and prompt engineering. We further demonstrate this method on a novel task, audio-aware image captioning, in which an image and audio are given and the task is to generate text that describes the image within the context of the provided audio. Our code is available on GitHub.


title: New Boolean satisfiability problem heuristic strategy: Minimal Positive Negative Product Strategy

abstract: This study presents a novel heuristic algorithm called the "Minimal Positive Negative Product Strategy" to guide the CDCL algorithm in solving the Boolean satisfiability problem. It provides a mathematical explanation for the superiority of this algorithm over widely used heuristics such as the Dynamic Largest Individual Sum (DLIS) and the Variable State Independent Decaying Sum (VSIDS). Experimental results further confirm the effectiveness of this heuristic strategy in problem-solving.


title: In-Context Ability Transfer for Question Decomposition in Complex QA

abstract: Answering complex questions is a challenging task that requires question decomposition and multistep reasoning for arriving at the solution. While existing supervised and unsupervised approaches are specialized to a certain task and involve training, recently proposed prompt-based approaches offer generalizable solutions to tackle a wide variety of complex question-answering (QA) tasks. However, existing prompt-based approaches that are effective for complex QA tasks involve expensive hand annotations from experts in the form of rationales and are not generalizable to newer complex QA scenarios and tasks. We propose, icat (In-Context Ability Transfer) which induces reasoning capabilities in LLMs without any LLM fine-tuning or manual annotation of in-context samples. We transfer the ability to decompose complex questions to simpler questions or generate step-by-step rationales to LLMs, by careful selection from available data sources of related tasks. We also propose an automated uncertainty-aware exemplar selection approach for selecting examples from transfer data sources. Finally, we conduct large-scale experiments on a variety of complex QA tasks involving numerical reasoning, compositional complex QA, and heterogeneous complex QA which require decomposed reasoning. We show that ICAT convincingly outperforms existing prompt-based solutions without involving any model training, showcasing the benefits of re-using existing abilities.


title: The fundamental unit of quantum conductance and quantum diffusion for a gas of massive particles

abstract: By analogy with the fundamental quantum units of electrical conductance $G_0^e=\frac{2 e^2}{h}$ and thermal conductance $K_0^t=\frac{2 K_B^2 T}{h}$ we define a fundamental quantum unit of conductance, $G_0^m$, and diffusion of a massive gas of atomic particles, respectively given by $$ G_0^m=\frac{m^2}{h} \ , \ D_0=\frac{h}{m}$$ with $h$ the Planck constant, $K_B$ the Boltzmann constant, $T$ the absolute temperature, $e$ the unit charge and $m$ the mass of the atomic gas particle that move balistically in a one dimensional medium of length $L$. The effect of scattering can be accounted for by introducing an appropriate transmission probability in analogy with the quantum electrical conductance model introduced by Landauer in 1957. For an electron gas $G_0^m=1.25 \times 10^{-27} \ Kg^2/(J s)$ and $D_0 = 7.3 \times 10^{-3} \ m^2/s$, and we found a quantum expression for the generalized Einstein relation that writes $$G_0^e = \frac{2e^2m}{h^2} D_0 $$


title: Can LLMs Grade Short-Answer Reading Comprehension Questions : An Empirical Study with a Novel Dataset

abstract: Open-ended questions, which require students to produce multi-word, nontrivial responses, are a popular tool for formative assessment as they provide more specific insights into what students do and don't know. However, grading open-ended questions can be time-consuming leading teachers to resort to simpler question formats or conduct fewer formative assessments. While there has been a longstanding interest in automating of short-answer grading (ASAG), but previous approaches have been technically complex, limiting their use in formative assessment contexts. The newest generation of Large Language Models (LLMs) potentially makes grading short answer questions more feasible. This paper investigates the potential for the newest version of LLMs to be used in ASAG, specifically in the grading of short answer questions for formative assessments, in two ways. First, it introduces a novel dataset of short answer reading comprehension questions, drawn from a set of reading assessments conducted with over 150 students in Ghana. This dataset allows for the evaluation of LLMs in a new context, as they are predominantly designed and trained on data from high-income North American countries. Second, the paper empirically evaluates how well various configurations of generative LLMs grade student short answer responses compared to expert human raters. The findings show that GPT-4, with minimal prompt engineering, performed extremely well on grading the novel dataset (QWK 0.92, F1 0.89), reaching near parity with expert human raters. To our knowledge this work is the first to empirically evaluate the performance of generative LLMs on short answer reading comprehension questions using real student data, with low technical hurdles to attaining this performance. These findings suggest that generative LLMs could be used to grade formative literacy assessment tasks.


title: Forum on immune digital twins: a meeting report

abstract: Medical digital twins are computational models of human biology relevant to a given medical condition, which can be tailored to an individual patient, thereby predicting the course of disease and individualized treatments, an important goal of personalized medicine. The immune system, which has a central role in many diseases, is highly heterogeneous between individuals, and thus poses a major challenge for this technology. If medical digital twins are to faithfully capture the characteristics of a patient's immune system, we need to answer many questions, such as: What do we need to know about the immune system to build mathematical models that reflect features of an individual? What data do we need to collect across the different scales of immune system action? What are the right modeling paradigms to properly capture immune system complexity? In February 2023, an international group of experts convened in Lake Nona, FL for two days to discuss these and other questions related to digital twins of the immune system. The group consisted of clinicians, immunologists, biologists, and mathematical modelers, representative of the interdisciplinary nature of medical digital twin development. A video recording of the entire event is available. This paper presents a synopsis of the discussions, brief descriptions of ongoing digital twin projects at different stages of progress. It also proposes a 5-year action plan for further developing this technology. The main recommendations are to identify and pursue a small number of promising use cases, to develop stimulation-specific assays of immune function in a clinical setting, and to develop a database of existing computational immune models, as well as advanced modeling technology and infrastructure.


title: CMOS-based Single-Cycle In-Memory XOR/XNOR

abstract: Big data applications are on the rise, and so is the number of data centers. The ever-increasing massive data pool needs to be periodically backed up in a secure environment. Moreover, a massive amount of securely backed-up data is required for training binary convolutional neural networks for image classification. XOR and XNOR operations are essential for large-scale data copy verification, encryption, and classification algorithms. The disproportionate speed of existing compute and memory units makes the von Neumann architecture inefficient to perform these Boolean operations. Compute-in-memory (CiM) has proved to be an optimum approach for such bulk computations. The existing CiM-based XOR/XNOR techniques either require multiple cycles for computing or add to the complexity of the fabrication process. Here, we propose a CMOS-based hardware topology for single-cycle in-memory XOR/XNOR operations. Our design provides at least 2 times improvement in the latency compared with other existing CMOS-compatible solutions. We verify the proposed system through circuit/system-level simulations and evaluate its robustness using a 5000-point Monte Carlo variation analysis. This all-CMOS design paves the way for practical implementation of CiM XOR/XNOR at scaled technology nodes.


title: SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation

abstract: In recent years, the task of text-to-SQL translation, which converts natural language questions into executable SQL queries, has gained significant attention for its potential to democratize data access. Despite its promise, challenges such as adapting to unseen databases and aligning natural language with SQL syntax have hindered widespread adoption. To overcome these issues, we introduce SQLformer, a novel Transformer architecture specifically crafted to perform text-to-SQL translation tasks. Our model predicts SQL queries as abstract syntax trees (ASTs) in an autoregressive way, incorporating structural inductive bias in the encoder and decoder layers. This bias, guided by database table and column selection, aids the decoder in generating SQL query ASTs represented as graphs in a Breadth-First Search canonical order. Our experiments demonstrate that SQLformer achieves state-of-the-art performance across six prominent text-to-SQL benchmarks.


title: Large-scale Foundation Models and Generative AI for BigData Neuroscience

abstract: Recent advances in machine learning have made revolutionary breakthroughs in computer games, image and natural language understanding, and scientific discovery. Foundation models and large-scale language models (LLMs) have recently achieved human-like intelligence thanks to BigData. With the help of self-supervised learning (SSL) and transfer learning, these models may potentially reshape the landscapes of neuroscience research and make a significant impact on the future. Here we present a mini-review on recent advances in foundation models and generative AI models as well as their applications in neuroscience, including natural language and speech, semantic memory, brain-machine interfaces (BMIs), and data augmentation. We argue that this paradigm-shift framework will open new avenues for many neuroscience research directions and discuss the accompanying challenges and opportunities.


title: Ontology Revision based on Pre-trained Language Models

abstract: Ontology revision aims to seamlessly incorporate a new ontology into an existing ontology and plays a crucial role in tasks such as ontology evolution, ontology maintenance, and ontology alignment. Similar to repair single ontologies, resolving logical incoherence in the task of ontology revision is also important and meaningful, because incoherence is a main potential factor to cause inconsistency and reasoning with an inconsistent ontology will obtain meaningless answers.To deal with this problem, various ontology revision approaches have been proposed to define revision operators and design ranking strategies for axioms in an ontology. However, they rarely consider axiom semantics which provides important information to differentiate axioms. In addition, pre-trained models can be utilized to encode axiom semantics, and have been widely applied in many natural language processing tasks and ontology-related ones in recent years.Therefore, in this paper, we study how to apply pre-trained models to revise ontologies. We first define four scoring functions to rank axioms based on a pre-trained model by considering various information from an ontology. Based on the functions, an ontology revision algorithm is then proposed to deal with unsatisfiable concepts at once. To improve efficiency, an adapted revision algorithm is designed to deal with unsatisfiable concepts group by group. We conduct experiments over 19 ontology pairs and compare our algorithms and scoring functions with existing ones. According to the experiments, our algorithms could achieve promising performance.


title: Influence of EOM sideband modulation noise on space-borne gravitational wave detection

abstract: Clock noise is one of the dominant noises in the space-borne gravitational wave (GW) detection. To suppress this noise, the clock noise-calibrated time-delay-interferometry (TDI) technique is proposed. In this technique, an inter-spacecraft clock tone transfer chain is necessary to obtain the comparison information of the clock noises in two spacecraft, during which an electro-optic-modulator (EOM) is critical and used to modulate the clock noise to the laser phase. Since the EOM sideband modulation process introduces modulation noise, it is significant to put forward the corresponding requirements and assess whether the commercial EOM meets. In this work, based on the typical Michelson TDI algorithm and the fundamental noise requirement of GW detectors, the analytic expression of the modulation noise requirement is strictly derived, which relax the component indicator need compared to the existing commonly used rough assessments. Furthermore, a commercial EOM (iXblue-NIR-10 GHz) is tested, and the experimental results show that it can meet the requirement of the typical GW detection mission LISA in whole scientific bandwidth by taking the optimal combination of the data stream. Even when the displacement measurement accuracy of LISA is improved to 1 pm/ $\mathrm{Hz^{1/2}}$ in the future, it still meets the demand.


title: Experimental demonstration of picometer level signal extraction with time-delay interferometry technique

abstract: In this work, we have built an experimental setup to simulate the clock noise transmission with two spacecrafts and two optical links, and further demonstrated the extraction of picometer level signal drowned by the large laser frequency noise and clock noise with the data post-processing method. Laser frequency noise is almost eliminated by using the idea of time-delay interferometry (TDI) to construct an equal arm interferometer. Clock asynchronism and clock jitter noise are significantly suppressed by laser sideband transmitting the clock noise using an electro-optic modulator (EOM). Experimental results show a reduction in laser frequency noise by approximately 10^5 and clock noise by 10^2, recovering a weak displacement signal with an average amplitude about 60 picometer and period 1 second. This work has achieved the principle verification of the noise reduction function of TDI technique to some extent, serving the data processing research of space-borne gravitational wave detection.


title: Unveil Sleep Spindles with Concentration of Frequency and Time

abstract: Objective: Sleep spindles contain crucial brain dynamics information. We introduce the novel non-linear time-frequency analysis tool 'Concentration of Frequency and Time' (ConceFT) to create an interpretable automated algorithm for sleep spindle annotation in EEG data and to measure spindle instantaneous frequencies (IFs). Methods: ConceFT effectively reduces stochastic EEG influence, enhancing spindle visibility in the time-frequency representation. Our automated spindle detection algorithm, ConceFT-Spindle (ConceFT-S), is compared to A7 (non-deep learning) and SUMO (deep learning) using Dream and MASS benchmark databases. We also quantify spindle IF dynamics. Results: ConceFT-S achieves F1 scores of 0.749 in Dream and 0.786 in MASS, which is equivalent to or surpass A7 and SUMO with statistical significance. We reveal that spindle IF is generally nonlinear. Conclusion: ConceFT offers an accurate, interpretable EEG-based sleep spindle detection algorithm and enables spindle IF quantification.


title: From Generative AI to Generative Internet of Things: Fundamentals, Framework, and Outlooks

abstract: Generative Artificial Intelligence (GAI) possesses the capabilities of generating realistic data and facilitating advanced decision-making. By integrating GAI into modern Internet of Things (IoT), Generative Internet of Things (GIoT) is emerging and holds immense potential to revolutionize various aspects of society, enabling more efficient and intelligent IoT applications, such as smart surveillance and voice assistants. In this article, we present the concept of GIoT and conduct an exploration of its potential prospects. Specifically, we first overview four GAI techniques and investigate promising GIoT applications. Then, we elaborate on the main challenges in enabling GIoT and propose a general GAI-based secure incentive mechanism framework to address them, in which we adopt Generative Diffusion Models (GDMs) for incentive mechanism designs and apply blockchain technologies for secure GIoT management. Moreover, we conduct a case study on modern Internet of Vehicle traffic monitoring, which utilizes GDMs to generate effective contracts for incentivizing users to contribute sensing data with high quality. Finally, we suggest several open directions worth investigating for the future popularity of GIoT.


title: QCD equation of state and thermodynamic observables from computationally minimal Dyson-Schwinger Equations

abstract: We study the QCD equation of state and other thermodynamic observables including the isentropic trajectories and the speed of sound. These observables are of eminent importance for the understanding of experimental results in heavy ion collisions and also provide a QCD input for studies of the timeline of heavy-ion-collisions with hydrodynamical simulations. They can be derived from the quark propagator whose gap equation is solved within a minimal approximation to the Dyson-Schwinger equations of QCD at finite temperature and density. This minimal approximation aims at a combination of computational efficiency and simplification of the truncation scheme while maintaining quantitative precision. This minimal DSE scheme is confronted and benchmarked with results for correlation functions and observables from first principles QCD lattice at vanishing density and quantitative functional approaches at finite density.


title: MicroNAS: Memory and Latency Constrained Hardware-Aware Neural Architecture Search for Time Series Classification on Microcontrollers

abstract: Designing domain specific neural networks is a time-consuming, error-prone, and expensive task. Neural Architecture Search (NAS) exists to simplify domain-specific model development but there is a gap in the literature for time series classification on microcontrollers. Therefore, we adapt the concept of differentiable neural architecture search (DNAS) to solve the time-series classification problem on resource-constrained microcontrollers (MCUs). We introduce MicroNAS, a domain-specific HW-NAS system integration of DNAS, Latency Lookup Tables, dynamic convolutions and a novel search space specifically designed for time-series classification on MCUs. The resulting system is hardware-aware and can generate neural network architectures that satisfy user-defined limits on the execution latency and peak memory consumption. Our extensive studies on different MCUs and standard benchmark datasets demonstrate that MicroNAS finds MCU-tailored architectures that achieve performance (F1-score) near to state-of-the-art desktop models. We also show that our approach is superior in adhering to memory and latency constraints compared to domain-independent NAS baselines such as DARTS.


title: Matching of Descriptive Labels to Glossary Descriptions

abstract: Semantic text similarity plays an important role in software engineering tasks in which engineers are requested to clarify the semantics of descriptive labels (e.g., business terms, table column names) that are often consists of too short or too generic words and appears in their IT systems. We formulate this type of problem as a task of matching descriptive labels to glossary descriptions. We then propose a framework to leverage an existing semantic text similarity measurement (STS) and augment it using semantic label enrichment and set-based collective contextualization where the former is a method to retrieve sentences relevant to a given label and the latter is a method to compute similarity between two contexts each of which is derived from a set of texts (e.g., column names in the same table). We performed an experiment on two datasets derived from publicly available data sources. The result indicated that the proposed methods helped the underlying STS correctly match more descriptive labels with the descriptions.


title: Is multidimensional space an illusion?

abstract: The quantum-phase-field concept of matter is revisited with special emphasis on the introverted view of space. Extroverted space surrounds physical objects, while introverted space lies in between physical objects. Space between objects leads to a network structure of matter: a network in which one-dimensional spaces connect individual particles.


title: OffMix-3L: A Novel Code-Mixed Dataset in Bangla-English-Hindi for Offensive Language Identification

abstract: Code-mixing is a well-studied linguistic phenomenon when two or more languages are mixed in text or speech. Several works have been conducted on building datasets and performing downstream NLP tasks on code-mixed data. Although it is not uncommon to observe code-mixing of three or more languages, most available datasets in this domain contain code-mixed data from only two languages. In this paper, we introduce OffMix-3L, a novel offensive language identification dataset containing code-mixed data from three different languages. We experiment with several models on this dataset and observe that BanglishBERT outperforms other transformer-based models and GPT-3.5.


title: Middle-mile optimization for next-day delivery

abstract: We consider an e-commerce retailer operating a supply chain that consists of middle- and last-mile transportation, and study its ability to deliver products stored in warehouses within a day from customer's order time. Successful next-day delivery requires inventory availability and timely truck schedules in the middle-mile and in this paper we assume a fixed inventory position and focus on optimizing the middle-mile. We formulate a novel optimization problem which decides the departure of the last middle-mile truck at each (potential) network connection in order to maximize the number of next-day deliveries. We show that the respective \emph{next-day delivery optimization} is a combinatorial problem that is $NP$-hard to approximate within $(1-1/e)\cdot\texttt{opt}\approx 0.632\cdot\texttt{opt}$, hence every retailer that offers one-day deliveries has to deal with this complexity barrier. We study three variants of the problem motivated by operational constraints that different retailers encounter, and propose solutions schemes tailored to each problem's properties. To that end, we rely on greedy submodular maximization, pipage rounding techniques, and Lagrangian heuristics. The algorithms are scalable, offer optimality gap guarantees, and evaluated in realistic datasets and network scenarios were found to achieve near-optimal results.


title: Reduction of Necessary Conditions for the Variational Collision Avoidance Problem

abstract: In this work, we study the reduction by a Lie group of symmetries of variational collision avoidance probelms of multiple agents evolving on a Riemannian manifold and derive necessary conditions for the reduced extremals. The problem consists of finding non-intersecting trajectories of a given number of agents, among a set of admissible curves, to reach a specified configuration, based on minimizing an energy functional that depends on the velocity, covariant acceleration and an artificial potential function used to prevent collision among the agents.


title: Entity Embeddings : Perspectives Towards an Omni-Modality Era for Large Language Models

abstract: Large Language Models (LLMs) are evolving to integrate multiple modalities, such as text, image, and audio into a unified linguistic space. We envision a future direction based on this framework where conceptual entities defined in sequences of text can also be imagined as modalities. Such a formulation has the potential to overcome the cognitive and computational limitations of current models. Several illustrative examples of such potential implicit modalities are given. Along with vast promises of the hypothesized structure, expected challenges are discussed as well.


title: Entanglement in BF theory II: Edge-modes

abstract: We consider the entanglement entropy arising from edge-modes in Abelian $p$-form topological field theories in $d$ dimensions on arbitrary spatial topology and across arbitrary entangling surfaces. We find a series of descending area laws plus universal corrections proportional to the Betti numbers of the entangling surface, which can be taken as a higher-dimensional version of the "topological entanglement entropy." Our calculation comes in two flavors: firstly, through an induced edge-mode theory appearing on the regulated entangling surface in a replica path integral and secondly through a more rigorous definition of the entanglement entropy through an extended Hilbert space. Along the way we establish several key results that are of their own merit. We explain how the edge-mode theory is a novel combination of $(p-1)$-form and $(d-p-2)$-form Maxwell theories linked by a chirality condition, in what we coin a "chiral mixed Maxwell theory." We explicitly evaluate the thermal partition function of this theory. Additionally we show that the extended Hilbert space is completely organized into representations of an infinite-dimensional, centrally extended current algebra which naturally generalizes 2d Kac-Moody algebras to arbitrary dimension and topology. We construct the Verma modules and the representation characters of this algebra. Lastly, we connect the two approaches, showing that the thermal partition function of the chiral mixed Maxwell theory is precisely an extended representation character of our current algebra, establishing an exact correspondence of the edge-mode theory and the entanglement spectrum.


title: Shock cooling and breakout emission for optical flares associated with gravitational wave events

abstract: The astrophysical origin of stellar-mass black hole (BH) mergers discovered through gravitational waves (GWs) is widely debated. Mergers in the disks of active galactic nuclei (AGN) represent promising environments for at least a fraction of these events, with possible observational clues in the GW data. An additional clue to unveil AGN merger environments is provided by possible electromagnetic emission from post-merger accreting BHs. Associated with BH mergers in AGN disks, emission from shocks emerging around jets launched by accreting merger remnants is expected. In this paper we compute the properties of the emission produced during breakout and the subsequent adiabatic expansion phase of the shocks, and we then apply this model to optical flares suggested to be possibly associated with GW events. We find that the majority of the reported flares can be explained by the breakout and the shock cooling emission. If these events are real, then the merging locations of binaries are constrained depending on the emission processes. If the optical flares are produced by shock cooling emission, they would display moderate color evolution, possibly color variations among different events, a positive correlation between the delay time and the duration of flares, and accompanying breakout emission in X-ray bands before the optical flares. If the breakout emission dominates the observed lightcurve, it is expected that the color is distributed in a narrow range in the optical band, and the delay time from GW to electromagnetic emission is longer than $\sim 2$ days. Hence, further explorations of the distributions of delay times, color evolution of the flares, and associated X-ray emission will be useful to test the proposed emission model for the observed flares.


title: Engineering the Kitaev spin liquid in a quantum dot system

abstract: The Kitaev model on a honeycomb lattice may provide a robust topological quantum memory platform, but finding a material that realizes the unique spin liquid phase remains a considerable challenge. We demonstrate that an effective Kitaev Hamiltonian can arise from a half-filled Fermi-Hubbard Hamiltonian where each site can experience a magnetic field in a different direction. As such, we provide a method for realizing the Kitaev spin liquid on a single hexagonal plaquette made up of twelve quantum dots. Despite the small system size, there are clear signatures of the Kitaev spin-liquid ground state, and there is a range of parameters where these signatures are predicted, allowing a potential platform where Kitaev spin-liquid physics can be explored experimentally in quantum dot plaquettes.


title: Astrophysical and Cosmological Relevance of the High-Frequency Features in the Stochastic Gravitational-Wave Background

abstract: The stochastic gravitational-wave background (SGWB) produced by merging neutron stars exhibits a peak in the kHz band. In this paper, we develop a theoretical framework to exploit this distinctive feature through a Markov Chain Monte Carlo analysis using a simulated dataset of SGWB measurements within this frequency range. The aim is to use the SGWB peak as an observable to constrain a set of astrophysical and cosmological parameters that accurately describe the sources of the SGWB. We examine how variations in these parameters impact the morphology of the SGWB and investigate the necessary sensitivity to effectively constrain them. Given our priors on astrophysical and cosmological parameters, and assuming a power-law integrated sensitivity curve of the order of $10^{-11}$ between 1 kHz and 5 kHz, we show that the values of the chirp mass and common envelope efficiency of the binary systems are retrieved with percent accuracy. Furthermore, the method allows for the reconstruction of the cosmological expansion history populated by these binaries, encompassing the Hubble constant, matter abundance, and the effective equation of state of dark energy.


title: Undermassive Host Galaxies of Five z~6 Luminous Quasars Detected with JWST

abstract: We measure host galaxy stellar masses for a sample of five luminous quasars at $z\sim5-7$. Using JWST/NIRCam medium-band images of nearby PSF reference stars, we carefully subtract the contribution from the quasar light to place upper and lower limits on the flux of each host galaxy. We find that the members of our sample of quasar host galaxies have masses of $10^{9.7} - 10^{10.8} M_{\odot}$, significantly less than expected from their SMBH masses and the local \magorrian relation. We additionally obtain JWST/NIRSpec IFU spectra of three of our quasars to calculate black hole masses, which we find are consistent with those in the literature, and to search for the presence of a bright but compact galaxy via a Balmer break, which we do not find evidence for. We discuss the potential effects of dust extinction on our measured fluxes and the impact of selection effects on high-redshift quasar samples. We conclude that the masses of the SMBHs relative to the host galaxy stellar masses have a much larger scatter than locally, large enough that these selection effects cannot be responsible. The result is reinforced by other studies. Finally, we explore the potential implications of these results on the picture of SMBH-galaxy coeval growth in the early Universe.


title: Circumnuclear Multi-phase Gas in the Circinus Galaxy. V. The Origin of the X-Ray Polarization in the Circinus Galaxy

abstract: The Imaging X-ray Polarimetry Explorer (IXPE) detected X-ray polarization in the nearest Seyfert 2 galaxy, the Circinus galaxy, for the first time. To reproduce the IXPE results, we computed the degree of polarization based on two types of radiative hydrodynamic simulations: a parsec-scale three-dimensional model and a sub-parsec-scale axisymmetric model with a higher spatial resolution. In a series of papers, we confirmed that these models naturally explain the multi-wavelength observations of the Circinus galaxy from radio to X-rays. We used a Monte Carlo Simulation for Astrophysics and Cosmology code to compute the linear polarization of continuum emission. We found that the degree of polarization based on the parsec-scale radiation-driven fountain model was smaller than that observed with the IXPE. The degree of polarization based on the sub-parsec-scale model depends on the hydrogen number density of the disk ($d$), and the degree of polarization obtained from our simulation is consistent with that observed with the IXPE in the case of $\log d/\mathrm{cm}^{-3} \geq 13$. We investigate where the photons are Compton scattered and imply that the origin of the X-ray polarization in the Circinus galaxy is the outflow inside $0.01 \ \mathrm{pc}$. In this case, the degree of polarization may change over a timescale of approximately ten years.


title: Detectable, defect-free dark photon dark matter

abstract: Ultralight dark photons are compelling dark matter candidates, but their allowed kinetic mixing with the Standard Model photon is severely constrained by requiring that the dark photons do not collapse into a cosmic string network in the early Universe. Direct detection in minimal production scenarios for dark photon dark matter is strongly limited, if not entirely excluded; discovery of sub-meV dark photon dark matter would therefore point to a nonminimal dark sector. We describe a model that evades such constraints, capable of producing cold dark photons in any parameter space accessible to future direct detection experiments. The associated production dynamics yield additional signatures in cosmology and small-scale structure, allowing for possible positive identification of this particular class of production mechanisms.


title: Maglev for Dark Matter: Dark-photon and axion dark matter sensing with levitated superconductors

abstract: Ultraprecise mechanical sensors offer an exciting avenue for testing new physics. While many of these sensors are tailored to detect inertial forces, magnetically levitated (Maglev) systems are particularly interesting, in that they are also sensitive to electromagnetic forces. In this work, we propose the use of magnetically levitated superconductors to detect dark-photon and axion dark matter through their couplings to electromagnetism. Several existing laboratory experiments search for these dark-matter candidates at high frequencies, but few are sensitive to frequencies below $\mathrm{1\,kHz}$ (corresponding to dark-matter masses $m_\mathrm{DM}\lesssim10^{-12}\,\mathrm{eV}$). As a mechanical resonator, magnetically levitated superconductors are sensitive to lower frequencies, and so can probe parameter space currently unexplored by laboratory experiments. Dark-photon and axion dark matter can source an oscillating magnetic field that drives the motion of a magnetically levitated superconductor. This motion is resonantly enhanced when the dark matter Compton frequency matches the levitated superconductor's trapping frequency. We outline the necessary modifications to make magnetically levitated superconductors sensitive to dark matter, including specifications for both broadband and resonant schemes. We show that in the $\mathrm{Hz}\lesssim f_\mathrm{DM}\lesssim\mathrm{kHz}$ frequency range our technique can achieve the leading sensitivity amongst laboratory probes of both dark-photon and axion dark matter.


title: The spooky ghost of vectorization

abstract: An interesting mechanism for the formation of hairy black holes occurs when a vector field, non-minimally coupled to a source term, grows from a perturbation of the vacuum black hole, \textit{aka} vectorization. Its study has, however, been lacking, in part due to the constant threat of ghost instabilities that have plagued vector fields. In this work, we show evidence that, in a generic family of extended-vector-tensor theories where the vector field is non-minimally coupled to the model's invariant (source term), a spherically symmetric, vectorized black hole always suffers from ghost instabilities. These ultimately turn the process of vectorization astrophysically unviable.


title: Isotropic 3D topological phases with broken time reversal symmetry

abstract: Axial vectors, such as current or magnetization, are commonly used order parameters in time-reversal symmetry breaking systems. These vectors also break isotropy in three dimensional systems, lowering the spatial symmetry. We demonstrate that it is possible to construct a fully isotropic and inversion-symmetric three-dimensional medium where time-reversal symmetry is systematically broken. We devise a cubic crystal with scalar time-reversal symmetry breaking, implemented by hopping through chiral magnetic clusters along the crystal bonds. The presence of only the spatial symmetries of the crystal -- finite rotation and inversion symmetry -- is sufficient to protect a topological phase. The realization of this phase in amorphous systems with average continuous rotation symmetry yields a statistical topological insulator phase. We demonstrate the topological nature of our model by constructing a bulk integer topological invariant, which guarantees gapless surface spectrum on any surface with several overlapping Dirac nodes, analogous to crystalline mirror Chern insulators. We also show the expected transport properties of a three-dimensional statistical topological insulator, which remains critical on the surface for odd values of the invariant.


title: Alleviating the present tension between T2K and NO$\nu$A with neutrino New Physics at source

abstract: Since neutrino oscillation was observed, several experiments have been built to measure its parameters. NO$\nu$A and T2K are two long-baseline experiments dedicated to measuring mainly the mixing angle $\theta_{23}$, the charge-parity conjugation phase $\delta_{\rm CP}$, and the mass ordering. However, there is a tension in current data. The T2K allowed region is almost excluded by the NO$\nu$A result at the $90\%$ confidence level. We propose a non-standard interaction (NSI) in neutrino production to relieve this tension. The NSI is computed through quantum field theory (QFT) formalism, where we derive perturbative analytical formulae considering NSI in the pion decay. Within this new approach, we can alleviate NO$\nu$A and T2K tension for a NSI complex parameters of order $10^{-3}$. We show the new phase has a degeneracy to the Dirac CP phase of the form $\delta_{\rm CP} \pm \phi= 1.5\pi$ being a possible source of violation of charge-parity symmetry.


title: K-inflation: the legitimacy of classical treatment

abstract: In this paper we consider general theory of k-inlation and find out, that it may be in strong coupling regime. We derive accurate conditions of classical description validity using unitarity bounds for this model. Next, we choose simple toy model of k-inflation and obtain the explicit condition, which guarantees that the generation of perturbations is performed in a controllable way, i.e the exit from effective horizon occurs in the weak coupling regime. However, for the same toy model the corresponding experimental bounds on a non-linear parameter $f^{\text{equil}}_{\text{NL}}$ associated with non-Gaussianities of the curvature perturbation provide much stronger constraint than strong coupling absence condition. Nevertheless, for other known models of inflation this may not be the case. Generally, one should always check if classical description is legitimate for chosen models of inflation.


title: Adiabatic Axion-Photon Mixing Near Neutron Stars

abstract: One of the promising new proposals to search for axions in astrophysical environments is to look for narrow radio lines produced from the resonant conversion of axion dark matter falling through the magnetospheres of neutron stars. For sufficiently strong magnetic fields, axion masses in the $\mathcal{O}(10\mu{\rm eV)}$ range, and axion-photon couplings $g_{a\gamma} \gtrsim 10^{-12} \, {\rm GeV^{-1}}$, the conversion can become hyper-efficient, allowing axion-photon and photon-axion transitions to occur with $\mathcal{O}(1)$ probabilities. Despite the strong mixing between these particles, the observable radio flux emanating from the magnetosphere is expected to be heavily suppressed -- this is a consequence of the fact that photons sourced by infalling axions have a high probability of converting back into axions before escaping the magnetosphere. In this work, we study the evolution of the axion and photon phase space near the surface of highly magnetized neutron stars in the adiabatic regime, quantifying for the first time the properties of the radio flux that arise at high axion-photon couplings. We show that previous attempts to mimic the scaling in this regime have been overly conservative in their treatment, and that the suppression can be largely circumvented for radio observations targeting neutron star populations.


title: Orbital Angular Momentum at Small $x$ Revisited

abstract: We revisit the problem of the small Bjorken-$x$ asymptotics of the quark and gluon orbital angular momentum (OAM) distributions in the proton utilizing the revised small-$x$ helicity evolution derived recently. We relate the quark and gluon OAM distributions at small $x$ to the polarized dipole amplitudes and their (first) impact-parameter moments. To obtain the OAM distributions, we derive novel small-$x$ evolution equations for the impact-parameter moments of the polarized dipole amplitudes in the double-logarithmic approximation (summing powers of $\alpha_s \ln^2(1/x)$ with $\alpha_s$ the strong coupling constant). We solve these evolution equations numerically and extract the leading large-$N_c$, small-$x$ asymptotics of the quark and gluon OAM distributions, which we determine to be \begin{align} L_{q+\bar{q}}(x, Q^2) \sim L_{G}(x,Q^2) \sim \Delta \Sigma(x, Q^2) \sim \Delta G(x,Q^2) \sim \left(\frac{1}{x}\right)^{3.66 \, \sqrt{\frac{\alpha_s N_c}{2\pi}}}, \notag \end{align} in agreement with the existing results in the literature within the precision of our numerical evaluation. (Here $N_c$ is the number of quark colors.) We also investigate the ratios of the quark and gluon OAM distributions to their helicity distribution counterparts in the small-$x$ region.


title: Are nonrelativistic ground state $\ell$-boson stars only stable for $\ell=0$ and $\ell=1$?

abstract: In previous work we analyzed the linear stability of non-relativistic $\ell$-boson stars with respect to radial modes and showed that ground state configurations are stable with respect to these modes, whereas excited states are unstable. In this work we extend the analysis to non-spherical linear mode perturbations. To this purpose, we expand the wave function in terms of tensor spherical harmonics which allows us to decouple the perturbation equations into a family of radial problems. By using a combination of analytic and numerical methods, we show that ground state configurations with $\ell > 1$ possess exponentially in time growing non-radial modes, whereas only oscillating modes are found for $\ell=0$ and $\ell=1$. This leads us to conjecture that nonrelativistic $\ell$-boson stars in their ground state are stable for $\ell=1$ as well as $\ell=0$, while ground state and excited configurations with $\ell > 1$ are unstable.

categories: gr-qc astro-ph.GA astro-ph.SR math-ph math.MP


title: An ensemble study of turbulence in extended QSO nebulae at $z\approx0.5$--1

abstract: Turbulent motions in the circumgalactic medium (CGM) play a critical role in regulating the evolution of galaxies, yet their detailed characterization remains elusive. Using two-dimensional velocity maps constructed from spatially-extended [OII] and [OIII] emission, Chen et al. (2023b) measured the velocity structure functions (VSFs) of four quasar nebulae at $z\approx\!0.5$--1.1. One of these exhibits a spectacular Kolmogorov relation. Here we carry out an ensemble study using an expanded sample incorporating four new nebulae from three additional QSO fields. The VSFs measured for all eight nebulae are best explained by subsonic turbulence revealed by the line-emitting gas, which in turn strongly suggests that the cool gas ($T\!\sim\!10^4$ K) is dynamically coupled to the hot ambient medium. Previous work demonstrates that the largest nebulae in our sample reside in group environments with clear signs of tidal interactions, suggesting that environmental effects are vital in seeding and enhancing turbulence within the gaseous halos, ultimately promoting the formation of the extended nebulae. No discernible differences are observed in the VSF properties between radio-loud and radio-quiet QSO fields. We estimate the turbulent heating rate per unit volume, $Q_{\rm turb}$, in the QSO nebulae to be $\sim 10^{-26}$--$10^{-22}$ erg cm$^{-3}$ s$^{-1}$ for the cool phase and $\sim 10^{-28}$--$10^{-25}$ erg cm$^{-3}$ s$^{-1}$ for the hot phase. This range aligns with measurements in the intracluster medium and star-forming molecular clouds but is $\sim10^3$ times higher than the $Q_{\rm turb}$ observed inside cool gas clumps on scales $\lesssim1$ kpc using absorption-line techniques. We discuss the prospect of bridging the gap between emission and absorption studies by pushing the emission-based VSF measurements to below $\approx\!10$ kpc.


title: Resolved low-J $^{12}$CO excitation at 190 parsec resolution across NGC 2903 and NGC 3627

abstract: The low-$J$ rotational transitions of $^{12}$CO are commonly used to trace the distribution of molecular gas in galaxies. Their ratios are sensitive to excitation and physical conditions in the molecular gas. Spatially resolved studies of CO ratios are still sparse and affected by flux calibration uncertainties, especially since most do not have high angular resolution or do not have short-spacing information and hence miss any diffuse emission. We compare the low-$J$ CO ratios across the disk of two massive, star-forming spiral galaxies NGC2903 and NGC3627 to investigate whether and how local environments drive excitation variations at GMC scales. We use Atacama Large Millimeter Array (ALMA) observations of the three lowest-$J$ CO transitions at a common angular resolution of 4$''$ (190pc). We measure median line ratios of $R_{21}=0.67^{+0.13}_{-0.11}$, $R_{32}=0.33^{+0.09}_{-0.08}$, and $R_{31}=0.24^{+0.10}_{-0.09}$ across the full disk of NGC3627. We see clear CO line ratio variation across the galaxy consistent with changes in temperature and density of the molecular gas. In particular, toward the center, $R_{21}$, $R_{32}$, and $R_{31}$ increase by 35\%, 50\%, and 66\%, respectively compared to their average disk values. The overall line ratio trends suggest that CO(3-2) is more sensitive to changes in the excitation conditions than the two lower-$J$ transitions. Furthermore, we find a similar radial $R_{32}$ trend in NGC2903, albite a larger disk-wide average of $\langle R_{32}\rangle=0.47^{+0.14}_{-0.08}$. We conclude that the CO low-$J$ line ratios vary across environments in such a way that they can trace changes in the molecular gas conditions, with the main driver being changes in temperature.