title: Adaptive Activation Steering: A Tuning-Free LLM Truthfulness Improvement Method for Diverse Hallucinations Categories

abstract: Recent studies have indicated that Large Language Models (LLMs) harbor an inherent understanding of truthfulness, yet often fail to express fully and generate false statements. This gap between "knowing" and "telling" poses a challenge for ensuring the truthfulness of generated content. To address this, we introduce Adaptive Activation Steering (ACT), a tuning-free method that adaptively shift LLM's activations in "truthful" direction during inference. ACT addresses diverse categories of hallucinations by utilizing diverse steering vectors and adjusting the steering intensity adaptively. Applied as an add-on across various models, ACT significantly improves truthfulness in LLaMA ($\uparrow$ 142\%), LLaMA2 ($\uparrow$ 24\%), Alpaca ($\uparrow$ 36\%), Vicuna ($\uparrow$ 28\%), and LLaMA2-Chat ($\uparrow$ 19\%). Furthermore, we verify ACT's scalability across larger models (13B, 33B, 65B), underscoring the adaptability of ACT to large-scale language models.


title: Reducing the Environmental Impact of Midblock Crossing

abstract: Accommodating pedestrians crossing midblock has been shown to have harmful environmental consequences because of increased fuel consumption and CO2 emissions. Somewhat surprisingly, no studies were devoted to mitigating the environmental impact of midblock crossing. Our main contribution is to propose schemes that mitigate the increased fuel consumption and CO2 emissions due to pedestrian midblock crossing by leveraging information about the location and expected duration of the crossing. This information is shared in a timely manner with approaching cars. We evaluated the impact of car decisions on fuel consumption and emissions by exploring potential trajectories that cars may take as a result of messages received. Our extensive simulations showed that timely dissemination of pedestrian crossing information to approaching vehicles can reduce fuel consumption and emissions by up to 16.7%.


title: EMERGE: Integrating RAG for Improved Multimodal EHR Predictive Modeling

abstract: The integration of multimodal Electronic Health Records (EHR) data has notably advanced clinical predictive capabilities. However, current models that utilize clinical notes and multivariate time-series EHR data often lack the necessary medical context for precise clinical tasks. Previous methods using knowledge graphs (KGs) primarily focus on structured knowledge extraction. To address this, we propose EMERGE, a Retrieval-Augmented Generation (RAG) driven framework aimed at enhancing multimodal EHR predictive modeling. Our approach extracts entities from both time-series data and clinical notes by prompting Large Language Models (LLMs) and aligns them with professional PrimeKG to ensure consistency. Beyond triplet relationships, we include entities' definitions and descriptions to provide richer semantics. The extracted knowledge is then used to generate task-relevant summaries of patients' health statuses. These summaries are fused with other modalities utilizing an adaptive multimodal fusion network with cross-attention. Extensive experiments on the MIMIC-III and MIMIC-IV datasets for in-hospital mortality and 30-day readmission tasks demonstrate the superior performance of the EMERGE framework compared to baseline models. Comprehensive ablation studies and analyses underscore the efficacy of each designed module and the framework's robustness to data sparsity. EMERGE significantly enhances the use of multimodal EHR data in healthcare, bridging the gap with nuanced medical contexts crucial for informed clinical predictions.


abstract: Code Community Question Answering (CCQA) seeks to tackle programming-related issues, thereby boosting productivity in both software engineering and academic research. Recent advancements in Reinforcement Learning from Human Feedback (RLHF) have transformed the fine-tuning process of Large Language Models (LLMs) to produce responses that closely mimic human behavior. Leveraging LLMs with RLHF for practical CCQA applications has thus emerged as a promising area of study. Unlike standard code question-answering tasks, CCQA involves multiple possible answers, with varying user preferences for each response. Additionally, code communities often show a preference for new APIs. These challenges prevent LLMs from generating responses that cater to the diverse preferences of users in CCQA tasks. To address these issues, we propose a novel framework called Aligning LLMs through Multi-perspective User Preference Ranking-based Feedback for Programming Question Answering (ALMupQA) to create user-focused responses. Our approach starts with Multi-perspective Preference Ranking Alignment (MPRA), which synthesizes varied user preferences based on the characteristics of answers from code communities. We then introduce a Retrieval-augmented In-context Learning (RIL) module to mitigate the problem of outdated answers by retrieving responses to similar questions from a question bank. Due to the limited availability of high-quality, multi-answer CCQA datasets, we also developed a dataset named StaCCQA from real code communities. Extensive experiments demonstrated the effectiveness of the ALMupQA framework in terms of accuracy and user preference. Compared to the base model, ALMupQA showed nearly an 11% improvement in BLEU, with increases of 20% and 17.5% in BERTScore and CodeBERTScore, respectively.


title: ViSpeR: Multilingual Audio-Visual Speech Recognition

abstract: This work presents an extensive and detailed study on Audio-Visual Speech Recognition (AVSR) for five widely spoken languages: Chinese, Spanish, English, Arabic, and French. We have collected large-scale datasets for each language except for English, and have engaged in the training of supervised learning models. Our model, ViSpeR, is trained in a multi-lingual setting, resulting in competitive performance on newly established benchmarks for each language. The datasets and models are released to the community with an aim to serve as a foundation for triggering and feeding further research work and exploration on Audio-Visual Speech Recognition, an increasingly important area of research. Code available at \href{https://github.com/YasserdahouML/visper}{https://github.com/YasserdahouML/visper}.


title: How Ready Are Generative Pre-trained Large Language Models for Explaining Bengali Grammatical Errors?

abstract: Grammatical error correction (GEC) tools, powered by advanced generative artificial intelligence (AI), competently correct linguistic inaccuracies in user input. However, they often fall short in providing essential natural language explanations, which are crucial for learning languages and gaining a deeper understanding of the grammatical rules. There is limited exploration of these tools in low-resource languages such as Bengali. In such languages, grammatical error explanation (GEE) systems should not only correct sentences but also provide explanations for errors. This comprehensive approach can help language learners in their quest for proficiency. Our work introduces a real-world, multi-domain dataset sourced from Bengali speakers of varying proficiency levels and linguistic complexities. This dataset serves as an evaluation benchmark for GEE systems, allowing them to use context information to generate meaningful explanations and high-quality corrections. Various generative pre-trained large language models (LLMs), including GPT-4 Turbo, GPT-3.5 Turbo, Text-davinci-003, Text-babbage-001, Text-curie-001, Text-ada-001, Llama-2-7b, Llama-2-13b, and Llama-2-70b, are assessed against human experts for performance comparison. Our research underscores the limitations in the automatic deployment of current state-of-the-art generative pre-trained LLMs for Bengali GEE. Advocating for human intervention, our findings propose incorporating manual checks to address grammatical errors and improve feedback quality. This approach presents a more suitable strategy to refine the GEC tools in Bengali, emphasizing the educational aspect of language learning.


title: Unveiling Themes in Judicial Proceedings: A Cross-Country Study Using Topic Modeling on Legal Documents from India and the UK

abstract: Legal documents are indispensable in every country for legal practices and serve as the primary source of information regarding previous cases and employed statutes. In today's world, with an increasing number of judicial cases, it is crucial to systematically categorize past cases into subgroups, which can then be utilized for upcoming cases and practices. Our primary focus in this endeavor was to annotate cases using topic modeling algorithms such as Latent Dirichlet Allocation, Non-Negative Matrix Factorization, and Bertopic for a collection of lengthy legal documents from India and the UK. This step is crucial for distinguishing the generated labels between the two countries, highlighting the differences in the types of cases that arise in each jurisdiction. Furthermore, an analysis of the timeline of cases from India was conducted to discern the evolution of dominant topics over the years.


title: QUB-Cirdan at "Discharge Me!": Zero shot discharge letter generation by open-source LLM

abstract: The BioNLP ACL'24 Shared Task on Streamlining Discharge Documentation aims to reduce the administrative burden on clinicians by automating the creation of critical sections of patient discharge letters. This paper presents our approach using the Llama3 8B quantized model to generate the "Brief Hospital Course" and "Discharge Instructions" sections. We employ a zero-shot method combined with Retrieval-Augmented Generation (RAG) to produce concise, contextually accurate summaries. Our contributions include the development of a curated template-based approach to ensure reliability and consistency, as well as the integration of RAG for word count prediction. We also describe several unsuccessful experiments to provide insights into our pathway for the competition. Our results demonstrate the effectiveness and efficiency of our approach, achieving high scores across multiple evaluation metrics.


title: Rise and Fall of Anderson Localization By Lattice Vibrations: A Time-Dependent Machine Learning Approach

abstract: The intricate relationship between electrons and the crystal lattice is a linchpin in condensed matter, traditionally described by the Fr\"ohlich model encompassing the lowest-order lattice-electron coupling. Recently developed quantum acoustics emphasizing the wave nature of lattice vibrations has enabled the exploration of previously uncharted territories of electron-lattice interaction, not accessible with conventional tools such as perturbation theory. In this context, our agenda here is two-fold. First, we showcase the application of machine learning methods to categorize various interaction regimes within the subtle interplay of electrons and the dynamical lattice landscape. Second, we shed light on a nebulous region of electron dynamics identified by the machine learning approach and then attribute it to transient localization, where strong lattice vibrations result in a momentary Anderson prison for electronic wavepackets, later released by the evolution of the lattice. Overall, our research illuminates the spectrum of dynamics within the Fr\"ohlich model, such as transient localization, which has been suggested as a pivotal factor contributing to the mysteries surrounding strange metals. Furthermore, this paves the way for utilizing time-dependent perspectives in machine learning for designing materials with tailored electron-lattice properties.


title: Sistemas de control basados en el estandar grafcet para la alteracion de bombas centrifugas

abstract: From the implementation of the Grafcet programming language we obtain in this document the different ways of applying this method, the advantages it obtains with respect to efficiency, cost, quality and operational and time optimization. The behavior of a pump alternation process is analyzed using GRAFCET, which is easier to design, verify and implement sequential control systems. We will also have the different fields where this programming is applied.


title: Stochastic Adversarial Networks for Multi-Domain Text Classification

abstract: Adversarial training has been instrumental in advancing multi-domain text classification (MDTC). Traditionally, MDTC methods employ a shared-private paradigm, with a shared feature extractor for domain-invariant knowledge and individual private feature extractors for domain-specific knowledge. Despite achieving state-of-the-art results, these methods grapple with the escalating model parameters due to the continuous addition of new domains. To address this challenge, we introduce the Stochastic Adversarial Network (SAN), which innovatively models the parameters of the domain-specific feature extractor as a multivariate Gaussian distribution, as opposed to a traditional weight vector. This design allows for the generation of numerous domain-specific feature extractors without a substantial increase in model parameters, maintaining the model's size on par with that of a single domain-specific extractor. Furthermore, our approach integrates domain label smoothing and robust pseudo-label regularization to fortify the stability of adversarial training and to refine feature discriminability, respectively. The performance of our SAN, evaluated on two leading MDTC benchmarks, demonstrates its competitive edge against the current state-of-the-art methodologies. The code is available at https://github.com/wangxu0820/SAN.


title: Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization

abstract: Researchers have been studying approaches to steer the behavior of Large Language Models (LLMs) and build personalized LLMs tailored for various applications. While fine-tuning seems to be a direct solution, it requires substantial computational resources and may significantly affect the utility of the original LLM. Recent endeavors have introduced more lightweight strategies, focusing on extracting "steering vectors" to guide the model's output toward desired behaviors by adjusting activations within specific layers of the LLM's transformer architecture. However, such steering vectors are directly extracted from the activations of human preference data and thus often lead to suboptimal results and occasional failures, especially in alignment-related scenarios. This work proposes an innovative approach that could produce more effective steering vectors through bi-directional preference optimization. Our method is designed to allow steering vectors to directly influence the generation probability of contrastive human preference data pairs, thereby offering a more precise representation of the target behavior. By carefully adjusting the direction and magnitude of the steering vector, we enabled personalized control over the desired behavior across a spectrum of intensities. Extensive experimentation across various open-ended generation tasks, particularly focusing on steering AI personas, has validated the efficacy of our approach. Moreover, we comprehensively investigate critical alignment-concerning scenarios, such as managing truthfulness, mitigating hallucination, and addressing jailbreaking attacks. Remarkably, our method can still demonstrate outstanding steering effectiveness across these scenarios. Furthermore, we showcase the transferability of our steering vectors across different models/LoRAs and highlight the synergistic benefits of applying multiple vectors simultaneously.


title: Hate Speech Detection with Generalizable Target-aware Fairness

abstract: To counter the side effect brought by the proliferation of social media platforms, hate speech detection (HSD) plays a vital role in halting the dissemination of toxic online posts at an early stage. However, given the ubiquitous topical communities on social media, a trained HSD classifier easily becomes biased towards specific targeted groups (e.g., female and black people), where a high rate of false positive/negative results can significantly impair public trust in the fairness of content moderation mechanisms, and eventually harm the diversity of online society. Although existing fairness-aware HSD methods can smooth out some discrepancies across targeted groups, they are mostly specific to a narrow selection of targets that are assumed to be known and fixed. This inevitably prevents those methods from generalizing to real-world use cases where new targeted groups constantly emerge over time. To tackle this defect, we propose Generalizable target-aware Fairness (GetFair), a new method for fairly classifying each post that contains diverse and even unseen targets during inference. To remove the HSD classifier's spurious dependence on target-related features, GetFair trains a series of filter functions in an adversarial pipeline, so as to deceive the discriminator that recovers the targeted group from filtered post embeddings. To maintain scalability and generalizability, we innovatively parameterize all filter functions via a hypernetwork that is regularized by the semantic affinity among targets. Taking a target's pretrained word embedding as input, the hypernetwork generates the weights used by each target-specific filter on-the-fly without storing dedicated filter parameters. Finally, comparative experiments on two HSD datasets have shown advantageous performance of GetFair on out-of-sample targets.


title: A Theoretical Framework for an Efficient Normalizing Flow-Based Solution to the Schrodinger Equation

abstract: A central problem in quantum mechanics involves solving the Electronic Schrodinger Equation for a molecule or material. The Variational Monte Carlo approach to this problem approximates a particular variational objective via sampling, and then optimizes this approximated objective over a chosen parameterized family of wavefunctions, known as the ansatz. Recently neural networks have been used as the ansatz, with accompanying success. However, sampling from such wavefunctions has required the use of a Markov Chain Monte Carlo approach, which is inherently inefficient. In this work, we propose a solution to this problem via an ansatz which is cheap to sample from, yet satisfies the requisite quantum mechanical properties. We prove that a normalizing flow using the following two essential ingredients satisfies our requirements: (a) a base distribution which is constructed from Determinantal Point Processes; (b) flow layers which are equivariant to a particular subgroup of the permutation group. We then show how to construct both continuous and discrete normalizing flows which satisfy the requisite equivariance. We further demonstrate the manner in which the non-smooth nature ("cusps") of the wavefunction may be captured, and how the framework may be generalized to provide induction across multiple molecules. The resulting theoretical framework entails an efficient approach to solving the Electronic Schrodinger Equation.

categories: physics.chem-ph cs.CE cs.LG physics.comp-ph


title: Towards a theory of how the structure of language is acquired by deep neural networks

abstract: How much data is required to learn the structure of a language via next-token prediction? We study this question for synthetic datasets generated via a Probabilistic Context-Free Grammar (PCFG) -- a hierarchical generative model that captures the tree-like structure of natural languages. We determine token-token correlations analytically in our model and show that they can be used to build a representation of the grammar's hidden variables, the longer the range the deeper the variable. In addition, a finite training set limits the resolution of correlations to an effective range, whose size grows with that of the training set. As a result, a Language Model trained with increasingly many examples can build a deeper representation of the grammar's structure, thus reaching good performance despite the high dimensionality of the problem. We conjecture that the relationship between training set size and effective range of correlations holds beyond our synthetic datasets. In particular, our conjecture predicts how the scaling law for the test loss behaviour with training set size depends on the length of the context window, which we confirm empirically for a collection of lines from Shakespeare's plays.


title: QUEST: Quality-Aware Metropolis-Hastings Sampling for Machine Translation

abstract: An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model correlates poorly with translation quality. In contrast, quality evaluation metrics (such as COMET or BLEURT) exhibit high correlations with human judgments, which has motivated their use as rerankers (such as quality-aware and minimum Bayes risk decoding). However, relying on a single translation with high estimated quality increases the chances of "gaming the metric''. In this paper, we address the problem of sampling a set of high-quality and diverse translations. We provide a simple and effective way to avoid over-reliance on noisy quality estimates by using them as the energy function of a Gibbs distribution. Instead of looking for a mode in the distribution, we generate multiple samples from high-density areas through the Metropolis-Hastings algorithm, a simple Markov chain Monte Carlo approach. The results show that our proposed method leads to high-quality and diverse outputs across multiple language pairs (English$\leftrightarrow${German, Russian}) with two strong decoder-only LLMs (Alma-7b, Tower-7b).


title: An Empirical Analysis on Large Language Models in Debate Evaluation

abstract: In this study, we investigate the capabilities and inherent biases of advanced large language models (LLMs) such as GPT-3.5 and GPT-4 in the context of debate evaluation. We discover that LLM's performance exceeds humans and surpasses the performance of state-of-the-art methods fine-tuned on extensive datasets in debate evaluation. We additionally explore and analyze biases present in LLMs, including positional bias, lexical bias, order bias, which may affect their evaluative judgments. Our findings reveal a consistent bias in both GPT-3.5 and GPT-4 towards the second candidate response presented, attributed to prompt design. We also uncover lexical biases in both GPT-3.5 and GPT-4, especially when label sets carry connotations such as numerical or sequential, highlighting the critical need for careful label verbalizer selection in prompt design. Additionally, our analysis indicates a tendency of both models to favor the debate's concluding side as the winner, suggesting an end-of-discussion bias.


title: Zero Energy Bound States on Nano Atomic Line Defect in Iron-based High Temperature Superconductors

abstract: Motivated by recent scanning tunneling microscopy experiments on Fe atomic line defect in iron-based high temperature superconductors, we explore the origin of the zero energy bound states near the endpoints of the line defect by employing the two-orbit four-band tight binding model. With increasing the strength of the Rashba spin-orbit coupling along the line defect, the zero energy resonance peaks move simultaneously forward to negative energy for $s_{+-}$ pairing symmetry, but split for $s_{++}$ pairing symmetry. The superconducting order parameter correction due to As(Te, Se) atoms missing does not shift the zero energy resonance peaks. Such the zero energy bound states are induced by the weak magnetic order rather than the strong Rashba spin-orbit coupling on Fe atomic line defect.


title: Detectability and Characterisation of Strongly Lensed Supernova Lightcurves in the Zwicky Transient Facility

abstract: The Zwicky Transient Facility (ZTF) was expected to detect more than one strong gravitationally-lensed supernova (glSN) per year, but only one event was identified in the first four years of the survey. This work investigates selection biases in the search strategy that could explain the discrepancy and revise discovery predictions. We present simulations of realistic lightcurves for lensed thermonuclear (glSNIa) and core-collapse supernova (glCCSN) explosions over a span of 5.33 years of the survey, utilizing the actual observation logs of ZTF. We find that the magnitude limit in spectroscopic screening significantly biases the selection towards highly magnified glSNe, for which the detection rates are consistent with the identification of a single object by ZTF. To reach the higher predicted rate of detections requires an optimization of the identification criteria for fainter objects. We find that around 1.36 (3.08) Type Ia SNe (CCSNe) are identifiable with the magnification method per year in ZTF, but when applying the magnitude cut of m < 19 mag, the detection rates decrease to 0.17 (0.32) per year. We compare our simulations with the previously found lensed Type Ia SNe, iPTF16geu and SN Zwicky, and conclude that considering the bias towards highly magnified events, the findings are within expectations in terms of detection rates and lensing properties of the systems. In addition, we provide a set of selection cuts based on simple observables to distinguish glSNe from regular, unlensed, supernovae to select potential candidates for spectroscopic and high-spatial resolution follow-up campaigns. We find optimal cuts in observed colours $g-r$, $g-i$, and $r-i$ as well as in the colour SALT2 fit parameter. The developed pipeline and the simulated lightcurves employed in this analysis can be found in the $LENSIT$ github repository.


title: Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting

abstract: Language models have the ability to perform in-context learning (ICL), allowing them to flexibly adapt their behavior based on context. This contrasts with in-weights learning, where information is statically encoded in model parameters from iterated observations of the data. Despite this apparent ability to learn in-context, language models are known to struggle when faced with unseen or rarely seen tokens. Hence, we study $\textbf{structural in-context learning}$, which we define as the ability of a model to execute in-context learning on arbitrary tokens -- so called because the model must generalize on the basis of e.g. sentence structure or task structure, rather than semantic content encoded in token embeddings. An ideal model would be able to do both: flexibly deploy in-weights operations (in order to robustly accommodate ambiguous or unknown contexts using encoded semantic information) and structural in-context operations (in order to accommodate novel tokens). We study structural in-context algorithms in a simple part-of-speech setting using both practical and toy models. We find that active forgetting, a technique that was recently introduced to help models generalize to new languages, forces models to adopt structural in-context learning solutions. Finally, we introduce $\textbf{temporary forgetting}$, a straightforward extension of active forgetting that enables one to control how much a model relies on in-weights vs. in-context solutions. Importantly, temporary forgetting allows us to induce a $\textit{dual process strategy}$ where in-context and in-weights solutions coexist within a single model.


title: $\epsilon$-Optimally Solving Zero-Sum POSGs

abstract: A recent method for solving zero-sum partially observable stochastic games (zs-POSGs) embeds the original game into a new one called the occupancy Markov game. This reformulation allows applying Bellman's principle of optimality to solve zs-POSGs. However, improving a current solution requires solving a linear program with exponentially many potential constraints, which significantly restricts the scalability of this approach. This paper exploits the optimal value function's novel uniform continuity properties to overcome this limitation. We first construct a new operator that is computationally more efficient than the state-of-the-art update rules without compromising optimality. In particular, improving a current solution now involves a linear program with an exponential drop in constraints. We then also show that point-based value iteration algorithms utilizing our findings improve the scalability of existing methods while maintaining guarantees in various domains.


title: Rocket motion

abstract: The motion of rockets is part of the study devoted to the motion of variable mass systems. Notably those in which the mass leaves permanently the considered system. Rockets are propelled forward by the reaction force produced by the hot exhausted gases ejected from their tales in the rearward direction. Thus their motion should not violate Newton's third principle of the equality of action and reaction forces during the exhaustion process. Nor should it violate Newton's second law of motion judged by inertial observers. However a close examination of the study of the motion of rockets in a major part of physics textbooks, if not all reveals erroneous determination of the expression of the thrust force that pushes the rocket in the forward direction. The false expression of the thrust force entails a bad effect on obtaining the right differential equation that governs the motion of rockets. This trap induced some prominent physics authors to pretend the in applicability of Newton's second law in such particular cases. Not only that, but they also modified Newton's second law in order to fit their purposes of obtaining the right differential equation, historically known under the name Tsiolkovsky rocket equation. The object of this paper is to give the true expression of the thrust force and to write the differential equation of motion of rockets without any necessity of modification of the classical laws. The paper also delves into the expression of the change of velocity of rockets, and proves that their motion is uniformly accelerated in the early stages of liftoff from the ground at condition of constant velocity of expulsion of hot gases from their nozzles.


title: Optimizing Bio-energy Supply Chain to Achieve Alternative Energy Targets

abstract: In response to global warming and the dwindling reservoirs of fossil fuels, Thailand has increasingly embraced alternative energy sources. Central to its energy development strategy is the Alternative Energy Development Plan (AEDP), which aims to reduce energy intensity, capitalize on residual resources, and mitigate greenhouse gas emissions. While significant strides have been made in meeting various consumption targets set forth by the AEDP, notable challenges persist, particularly in the realms of bio-mass-derived electricity generation, bio-gas utilization, and bio-ethanol production from bio-mass. Therefore, this study delves into the factors contributing to the shortfall in achieving AEDP targets and proposes strategies to enhance the efficiency of the bioenergy supply chain. Leveraging mathematical and linear programming techniques, our research optimizes the supply chain dynamics, accounting for monthly supplier profiles spanning 77 provinces, 17 distinct biomasses, and 427 bioenergy plants equipped with diverse energy conversion technologies. Our findings indicate that Thailand currently boasts adequate bio-mass resources to fulfill the electricity and bio-ethanol targets outlined in the AEDP provided enhancements are made to supply chain efficiency. To fully realize the objectives of the AEDP, we recommend augmenting bio-mass cultivation efforts and implementing new power plant installations. Additionally, we advocate for the consideration of high-methane content fuels, such as solid waste, as a means to alleviate bio-mass demand. This study underscores the paramount importance of strategic planning and optimization in propelling Thailand towards its alternative energy ambitions while surmounting supply chain impediments.


title: Toward Conversational Agents with Context and Time Sensitive Long-term Memory

abstract: There has recently been growing interest in conversational agents with long-term memory which has led to the rapid development of language models that use retrieval-augmented generation (RAG). Until recently, most work on RAG has focused on information retrieval from large databases of texts, like Wikipedia, rather than information from long-form conversations. In this paper, we argue that effective retrieval from long-form conversational data faces two unique problems compared to static database retrieval: 1) time/event-based queries, which requires the model to retrieve information about previous conversations based on time or the order of a conversational event (e.g., the third conversation on Tuesday), and 2) ambiguous queries that require surrounding conversational context to understand. To better develop RAG-based agents that can deal with these challenges, we generate a new dataset of ambiguous and time-based questions that build upon a recent dataset of long-form, simulated conversations, and demonstrate that standard RAG based approaches handle such questions poorly. We then develop a novel retrieval model which combines chained-of-table search methods, standard vector-database retrieval, and a prompting method to disambiguate queries, and demonstrate that this approach substantially improves over current methods at solving these tasks. We believe that this new dataset and more advanced RAG agent can act as a key benchmark and stepping stone towards effective memory augmented conversational agents that can be used in a wide variety of AI applications.


title: Multiplicative logic in arithmetic

abstract: The article explores the arithmetic of multiplication as a model of many valued projective logic. It is demonstrated that closed numerical intervals within this framework constitute Heyting algebras. The conditions for these algebras to be Boolean are identified. The article claims have undergone numerical verification. Paths for generalization to normed linear spaces are delineated.


title: Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Execution

abstract: The complexity of large language model (LLM) serving workloads has substantially increased due to the integration with external tool invocations, such as ChatGPT plugins. In this paper, we identify a new opportunity for efficient LLM serving for requests that trigger tools: tool partial execution alongside LLM decoding. To this end, we design Conveyor, an efficient LLM serving system optimized for handling requests involving external tools. We introduce a novel interface for tool developers to expose partial execution opportunities to the LLM serving system and a request scheduler that facilitates partial tool execution. Our results demonstrate that tool partial execution can improve request completion latency by up to 38.8%.


title: Cascade-Aware Training of Language Models

abstract: Reducing serving cost and latency is a fundamental concern for the deployment of language models (LMs) in business applications. To address this, cascades of LMs offer an effective solution that conditionally employ smaller models for simpler queries. Cascaded systems are typically built with independently trained models, neglecting the advantages of considering inference-time interactions of the cascaded LMs during training. In this paper, we present cascade-aware training(CAT), an approach to optimizing the overall quality-cost performance tradeoff of a cascade of LMs. We achieve inference-time benefits by training the small LM with awareness of its place in a cascade and downstream capabilities. We demonstrate the value of the proposed method with over 60 LM tasks of the SuperGLUE, WMT22, and FLAN2021 datasets.


title: STAT: Shrinking Transformers After Training

abstract: We present STAT: a simple algorithm to prune transformer models without any fine-tuning. STAT eliminates both attention heads and neurons from the network, while preserving accuracy by calculating a correction to the weights of the next layer. Each layer block in the network is compressed using a series of principled matrix factorizations that preserve the network structure. Our entire algorithm takes minutes to compress BERT, and less than three hours to compress models with 7B parameters using a single GPU. Using only several hundred data examples, STAT preserves the output of the network and improves upon existing gradient-free pruning methods. It is even competitive with methods that include significant fine-tuning. We demonstrate our method on both encoder and decoder architectures, including BERT, DistilBERT, and Llama-2 using benchmarks such as GLUE, Squad, WikiText2.


title: Unlocking the Potential of Large Language Models for Clinical Text Anonymization: A Comparative Study

abstract: Automated clinical text anonymization has the potential to unlock the widespread sharing of textual health data for secondary usage while assuring patient privacy and safety. Despite the proposal of many complex and theoretically successful anonymization solutions in literature, these techniques remain flawed. As such, clinical institutions are still reluctant to apply them for open access to their data. Recent advances in developing Large Language Models (LLMs) pose a promising opportunity to further the field, given their capability to perform various tasks. This paper proposes six new evaluation metrics tailored to the challenges of generative anonymization with LLMs. Moreover, we present a comparative study of LLM-based methods, testing them against two baseline techniques. Our results establish LLM-based models as a reliable alternative to common approaches, paving the way toward trustworthy anonymization of clinical text.


title: Methods for Linking Data to Online Resources and Ontologies with Applications to Neurophysiology

abstract: Across many domains, large swaths of digital assets are being stored across distributed data repositories, e.g., the DANDI Archive [8]. The distribution and diversity of these repositories impede researchers from formally defining terminology within experiments, integrating information across datasets, and easily querying, reusing, and analyzing data that follow the FAIR principles [15]. As such, it has become increasingly important to have a standardized method to attach contextual metadata to datasets. Neuroscience is an exemplary use case of this issue due to the complex multimodal nature of experiments. Here, we present the HDMF External Resources Data (HERD) standard and related tools, enabling researchers to annotate new and existing datasets by mapping external references to the data without requiring modification of the original dataset. We integrated HERD closely with Neurodata Without Borders (NWB) [2], a widely used data standard for sharing and storing neurophysiology data. By integrating with NWB, our tools provide neuroscientists with the capability to more easily create and manage neurophysiology data in compliance with controlled sets of terms, enhancing rigor and accuracy of data and facilitating data reuse.


title: Integration Formulas Involving Fibonacci and Lucas Numbers

abstract: We present a range of difficult integration formulas involving Fibonacci and Lucas numbers and trigonometric functions. These formulas are often expressed in terms of special functions like the dilogarithm and Clausen's function. We also prove complements of integral identities of Dilcher (2000) and Stewart (2022). Many of our results are based on a fundamental lemma dealing with differentiation of complex-valued Fibonacci (Lucas) functions.


title: Parallel Redundancy Removal in lrslib with Application to Projections

abstract: We describe a parallel implementation in lrslib for removing redundant halfspaces and finding a minimum representation for an H-representation of a convex polyhedron. By a standard transformation, the same code works for V-representations. We use this approach to speed up the redundancy removal step in Fourier-Motzkin elimination. Computational results are given including a comparison with Clarkson's algorithm, which is particularly fast on highly redundant inputs.


title: Estimates on the domain of validity for Lyapunov-Schmidt reduction

abstract: Lyapunov-Schmidt reduction is a dimensionality reduction technique in nonlinear systems analysis that is commonly utilised in the study of bifurcation problems in high-dimensional systems. The method is a systematic procedure for reducing the dimensionality of systems of algebraic equations that have singular points, preserving essential features of their solution sets. In this article, we establish estimates for the region of validity of the reduction by applying bounds on the implicit function theorem derived in [https://doi.org/10.1007/s00498-023-00370-5]. We then apply these bounds to an illustrative example of a two-dimensional system with a pitchfork bifurcation.


title: Nonlinear synthesis of compliant mechanisms with selective compliance

abstract: The synthesis of compliant mechanisms (CMs) is frequently achieved through topology optimization. Many synthesis approaches simplify implementation by assuming small distortions, but this limits their practical application since CMs typically undergo large deformations that include geometric and material nonlinearities. CMs designed to generate a desired deformation path at the output points under specific loads are known as path-generating CMs. However, these CMs face significant challenges in topology optimization, resulting in the development of only a few optimization methods. Existing approaches often include only certain load cases in the optimization process. Consequently, if a CM designed this way encounters different load cases in practice, its path-generating behavior cannot be guaranteed. The authors have previously contributed to the development of an approach suitable for synthesizing load case insensitive CMs. This paper extends that approach to account for nonlinearities, enabling the synthesis of path-generating CMs. The effectiveness of this extended approach is demonstrated through appropriate design examples. Additionally, the paper presents, for the first time, a shape-adaptive path-generating CM.


title: Building the Butterfly Fractal: The Eightfold Way

abstract: The hierarchical structure of the butterfly fractal -- the Hofstader butterfly, is found to be described by an octonary tree. In this framework of building the butterfly graph, every iteration generates sextuplets of butterflies, each with a tail that is made up of an infinity of butterflies. Identifying {\it butterfly with a tale} as the building block, the tree is constructed with eight generators represented by unimodular matrices with integer coefficients. This Diophantine description provides one to one mapping with the butterfly fractal, encoding the magnetic flux interval and the topological quantum numbers of every butterfly. The butterfly tree is a generalization of the ternary tree describing the set of primitive Pythagorean triplets.


title: Confidence-Aware Sub-Structure Beam Search (CABS): Mitigating Hallucination in Structured Data Generation with Large Language Models

abstract: Large Language Models (LLMs) have facilitated structured data generation, with applications in domains like tabular data, document databases, product catalogs, etc. However, concerns persist about generation veracity due to incorrect references or hallucinations, necessitating the incorporation of some form of model confidence for mitigation. Existing confidence estimation methods on LLM generations primarily focus on the confidence at the individual token level or the entire output sequence level, limiting their applicability to structured data generation, which consists of an intricate mix of both independent and correlated entries at the sub-structure level. In this paper, we first investigate confidence estimation methods for generated sub-structure-level data. We introduce the concept of Confidence Network that applies on the hidden state of the LLM transformer, as a more targeted estimate than the traditional token conditional probability. We further propose Confidence-Aware sub-structure Beam Search (CABS), a novel decoding method operating at the sub-structure level in structured data generation. CABS enhances the faithfulness of structured data generation by considering confidence scores from the Confidence Network for each sub-structure-level data and iteratively refining the prompts. Results show that CABS outperforms traditional token-level beam search for structured data generation by 16.7% Recall at 90% precision averagely on the problem of product attribute generation.


title: $J/\psi$ photoproduction and polarization in $e+p$ collisions in the improved color evaporation model

abstract: We calculate the production and polarization of direct $J/\psi$ in the improved color evaporation model in $e+p$ photoproduction. We present the production as functions of transverse momentun, mass of the hadronic final state, and inelasticity. We also present the polarization parameters $\lambda_\vartheta$, $\lambda_{\varphi}$, and $\lambda_{\vartheta \varphi}$ in the helicity and the Collins-Soper frames, as well as the frame-invariant polarization parameter $\tilde{\lambda}$ as a function of transverse momentum and inelasticity. We find agreement with both $J/\psi$ unpolarized cross sections and the invariant polarization parameters as a function of $p_T$.


title: Optimizing Photometric Light Curve Analysis: Evaluating Scipy's Minimize Function for Eclipse Mapping of Cataclysmic Variables

abstract: With a particular focus on Scipy's minimize function the eclipse mapping method is thoroughly researched and implemented utilizing Python and essential libraries. Many optimization techniques are used, including Sequential Least Squares Programming (SLSQP), Nelder-Mead, and Conjugate Gradient (CG). However, for the purpose of examining photometric light curves these methods seek to solve the maximum entropy equation under a chi-squared constraint. Therefore, these techniques are first evaluated on two-dimensional Gaussian data without a chi-squared restriction, and then they are used to map the accretion disc and uncover the Gaussian structure of the Cataclysmic Variable KIC 201325107. Critical analysis is performed on the code structure to find possible faults and design problems. Additionally, the analysis shows how several factors impacting computing time and image quality are included including the variance in Gaussian weighting, disc image resolution, number of data points in the light curve, and degree of constraint.


title: Methodology for Analyzing Proton Multiplicity Fluctuations with Azimuthal Partitions in Heavy-Ion Collisions

abstract: A primary objective in high-energy heavy-ion collisions is to investigate the phase transition between confined and deconfined color matter. Complementary to the cumulants of conserved charges integrated over the full azimuth, we introduce a novel experimental approach to explore particle fluctuations in azimuthal partitions, which are potentially sensitive to the first-order phase transition in heavy-ion collisions. We evaluate proton multiplicity ($N_w$) fluctuations in azimuthal partitions of width $w$ to quantitatively estimate the clustering tendency among these protons. The $\Delta \sigma^2$ observable is defined as the normalized difference between the variance of the $N_w$ distribution and the binomial baseline. We demonstrate the feasibility and characteristics of this observable through simulations using the AMPT and MUSIC+FIST models. We also use a Gaussian correlation model to illustrate that the dependence of $\Delta \sigma^2$ on $w$ can be parameterized to accurately extract the strength and the range of the input interaction among protons.


title: A Novel Review of Stability Techniques for Improved Privacy-Preserving Machine Learning

abstract: Machine learning models have recently enjoyed a significant increase in size and popularity. However, this growth has created concerns about dataset privacy. To counteract data leakage, various privacy frameworks guarantee that the output of machine learning models does not compromise their training data. However, this privatization comes at a cost by adding random noise to the training process, which reduces model performance. By making models more resistant to small changes in input and thus more stable, the necessary amount of noise can be decreased while still protecting privacy. This paper investigates various techniques to enhance stability, thereby minimizing the negative effects of privatization in machine learning.


title: DSR transformations with zero time delay

abstract: In doubly special relativity (DSR) theories the speed of the light usually depends on the frequency. Thus, we expect that light from very distant stars and gamma ray bursts have additional time delays with respect to special relativity. In this paper, we will find the general DSR transformations in the first order of the Planck length which have zero time delay. With respect to these transformations zero time delay isn't only a consequence of special relativity, and we can find some DSR theories which behave like special relativity in the first order of the Planck length in some aspects. We notify that for a correct conclusion in the observations of the quantum gravity effects we should look to all quantum gravity effects together and not one.


title: Arbitrary-Length Generalization for Addition in a Tiny Transformer

abstract: This paper introduces a novel training methodology that enables a Transformer model to generalize the addition of two-digit numbers to numbers with unseen lengths of digits. The proposed approach employs an autoregressive generation technique, processing from right to left, which mimics a common manual method for adding large numbers. To the best of my knowledge, this methodology has not been previously explored in the literature. All results are reproducible, and the corresponding R code is available at github.com/AGPatriota/ALGA-R/.


title: How public funding affects complexity in R&D projects. An analysis of team project perceptions

abstract: In this paper, we apply a case study approach to advance current understanding of what effects public co-funding of R&D projects have on project team members' perceived complexity. We chose an R&D project carried out by an industrial SME in northern Spain. The chosen research strategy was a qualitative approach, and sixteen employees participated in the project. We held in-depth semi-structured interviews at the beginning and end of the co-funded part of the project. NVivo data analysis software was used for qualitative data analysis. Results showed a substantial increase in perceived complexity. We observed that this was due to unresolved tension between the requirements of the project's co-financing entity and normal SME working procedures. New working procedures needed to be developed in order to comply with the co-financing entity's requirements. However, overall perceived complexity significantly decreased once the co-financed part of the project was completed.


title: On the project risk baseline: integrating aleatory uncertainty into project scheduling

abstract: Obtaining a viable schedule baseline that meets all project constraints is one of the main issues for project managers. The literature on this topic focuses mainly on methods to obtain schedules that meet resource restrictions and, more recently, financial limitations. The methods provide different viable schedules for the same project, and the solutions with the shortest duration are considered the best-known schedule for that project. However, no tools currently select which schedule best performs in project risk terms. To bridge this gap, this paper aims to propose a method for selecting the project schedule with the highest probability of meeting the deadline of several alternative schedules with the same duration. To do so, we propose integrating aleatory uncertainty into project scheduling by quantifying the risk of several execution alternatives for the same project. The proposed method, tested with a well-known repository for schedule benchmarking, can be applied to any project type to help managers to select the project schedules from several alternatives with the same duration, but the lowest risk.


title: Project Risk Management from the bottom-up: Activity Risk Index

abstract: Project managers need to manage risks throughout the project lifecycle and, thus, need to know how changes in activity durations influence project duration and risk. We propose a new indicator (the Activity Risk Index, ARI) that measures the contribution of each activity to the total project risk while it is underway. In particular, the indicator informs us about what activities contribute the most to the project's uncertainty so that project managers can pay closer attention to the performance of these activities. The main difference between our indicator and other activity sensitivity metrics in the literature (e.g. cruciality, criticality, significance, or schedule sensitivity indices) is that our indicator is based on the Schedule Risk Baseline concept instead of on cost or schedule baselines. The new metric not only provides information at the beginning of the project, but also while it is underway. Furthermore, the ARI is the only one to offer a normalized result: if we add its value for each activity, the total sum is 100%.


title: Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling

abstract: Recent works have shown the remarkable superiority of transformer models in reinforcement learning (RL), where the decision-making problem is formulated as sequential generation. Transformer-based agents could emerge with self-improvement in online environments by providing task contexts, such as multiple trajectories, called in-context RL. However, due to the quadratic computation complexity of attention in transformers, current in-context RL methods suffer from huge computational costs as the task horizon increases. In contrast, the Mamba model is renowned for its efficient ability to process long-term dependencies, which provides an opportunity for in-context RL to solve tasks that require long-term memory. To this end, we first implement Decision Mamba (DM) by replacing the backbone of Decision Transformer (DT). Then, we propose a Decision Mamba-Hybrid (DM-H) with the merits of transformers and Mamba in high-quality prediction and long-term memory. Specifically, DM-H first generates high-value sub-goals from long-term memory through the Mamba model. Then, we use sub-goals to prompt the transformer, establishing high-quality predictions. Experimental results demonstrate that DM-H achieves state-of-the-art in long and short-term tasks, such as D4RL, Grid World, and Tmaze benchmarks. Regarding efficiency, the online testing of DM-H in the long-term task is 28$\times$ times faster than the transformer-based baselines.


title: An Efficient Multi Quantile Regression Network with Ad Hoc Prevention of Quantile Crossing

abstract: This article presents the Sorting Composite Quantile Regression Neural Network (SCQRNN), an advanced quantile regression model designed to prevent quantile crossing and enhance computational efficiency. Integrating ad hoc sorting in training, the SCQRNN ensures non-intersecting quantiles, boosting model reliability and interpretability. We demonstrate that the SCQRNN not only prevents quantile crossing and reduces computational complexity but also achieves faster convergence than traditional models. This advancement meets the requirements of high-performance computing for sustainable, accurate computation. In organic computing, the SCQRNN enhances self-aware systems with predictive uncertainties, enriching applications across finance, meteorology, climate science, and engineering.


title: From Structured to Unstructured:A Comparative Analysis of Computer Vision and Graph Models in solving Mesh-based PDEs

abstract: This article investigates the application of computer vision and graph-based models in solving mesh-based partial differential equations within high-performance computing environments. Focusing on structured, graded structured, and unstructured meshes, the study compares the performance and computational efficiency of three computer vision-based models against three graph-based models across three data\-sets. The research aims to identify the most suitable models for different mesh topographies, particularly highlighting the exploration of graded meshes, a less studied area. Results demonstrate that computer vision-based models, notably U-Net, outperform the graph models in prediction performance and efficiency in two (structured and graded) out of three mesh topographies. The study also reveals the unexpected effectiveness of computer vision-based models in handling unstructured meshes, suggesting a potential shift in methodological approaches for data-driven partial differential equation learning. The article underscores deep learning as a viable and potentially sustainable way to enhance traditional high-performance computing methods, advocating for informed model selection based on the topography of the mesh.


title: Multistable Physical Neural Networks

abstract: Artificial neural networks (ANNs), which are inspired by the brain, are a central pillar in the ongoing breakthrough in artificial intelligence. In recent years, researchers have examined mechanical implementations of ANNs, denoted as Physical Neural Networks (PNNs). PNNs offer the opportunity to view common materials and physical phenomena as networks, and to associate computational power with them. In this work, we incorporated mechanical bistability into PNNs, enabling memory and a direct link between computation and physical action. To achieve this, we consider an interconnected network of bistable liquid-filled chambers. We first map all possible equilibrium configurations or steady states, and then examine their stability. Building on these maps, both global and local algorithms for training multistable PNNs are implemented. These algorithms enable us to systematically examine the network's capability to achieve stable output states and thus the network's ability to perform computational tasks. By incorporating PNNs and multistability, we can design structures that mechanically perform tasks typically associated with electronic neural networks, while directly obtaining physical actuation. The insights gained from our study pave the way for the implementation of intelligent structures in smart tech, metamaterials, medical devices, soft robotics, and other fields.


title: BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

abstract: Large Language Models (LLMs) are constrained by outdated information and a tendency to generate incorrect data, commonly referred to as "hallucinations." Retrieval-Augmented Generation (RAG) addresses these limitations by combining the strengths of retrieval-based methods and generative models. This approach involves retrieving relevant information from a large, up-to-date dataset and using it to enhance the generation process, leading to more accurate and contextually appropriate responses. Despite its benefits, RAG introduces a new attack surface for LLMs, particularly because RAG databases are often sourced from public data, such as the web. In this paper, we propose \TrojRAG{} to identify the vulnerabilities and attacks on retrieval parts (RAG database) and their indirect attacks on generative parts (LLMs). Specifically, we identify that poisoning several customized content passages could achieve a retrieval backdoor, where the retrieval works well for clean queries but always returns customized poisoned adversarial queries. Triggers and poisoned passages can be highly customized to implement various attacks. For example, a trigger could be a semantic group like "The Republican Party, Donald Trump, etc." Adversarial passages can be tailored to different contents, not only linked to the triggers but also used to indirectly attack generative LLMs without modifying them. These attacks can include denial-of-service attacks on RAG and semantic steering attacks on LLM generations conditioned by the triggers. Our experiments demonstrate that by just poisoning 10 adversarial passages can induce 98.2\% success rate to retrieve the adversarial passages. Then, these passages can increase the reject ratio of RAG-based GPT-4 from 0.01\% to 74.6\% or increase the rate of negative responses from 0.22\% to 72\% for targeted queries.


title: Universe-inspired algorithms for Control Engineering: A review

abstract: Control algorithms have been proposed based on knowledge related to nature-inspired mechanisms, including those based on the behavior of living beings. This paper presents a review focused on major breakthroughs carried out in the scope of applied control inspired by the gravitational attraction between bodies. A control approach focused on Artificial Potential Fields was identified, as well as four optimization metaheuristics: Gravitational Search Algorithm, Black-Hole algorithm, Multi-Verse Optimizer, and Galactic Swarm Optimization. A thorough analysis of ninety-one relevant papers was carried out to highlight their performance and to identify the gravitational and attraction foundations, as well as the universe laws supporting them. Included are their standard formulations, as well as their improved, modified, hybrid, cascade, fuzzy, chaotic and adaptive versions. Moreover, this review also deeply delves into the impact of universe-inspired algorithms on control problems of dynamic systems, providing an extensive list of control-related applications, and their inherent advantages and limitations. Strong evidence suggests that gravitation-inspired and black-hole dynamic-driven algorithms can outperform other well-known algorithms in control engineering, even though they have not been designed according to realistic astrophysical phenomena and formulated according to astrophysics laws. Even so, they support future research directions towards the development of high-sophisticated control laws inspired by Newtonian/Einsteinian physics, such that effective control-astrophysics bridges can be established and applied in a wide range of applications.


title: Augmentation-based Unsupervised Cross-Domain Functional MRI Adaptation for Major Depressive Disorder Identification

abstract: Major depressive disorder (MDD) is a common mental disorder that typically affects a person's mood, cognition, behavior, and physical health. Resting-state functional magnetic resonance imaging (rs-fMRI) data are widely used for computer-aided diagnosis of MDD. While multi-site fMRI data can provide more data for training reliable diagnostic models, significant cross-site data heterogeneity would result in poor model generalizability. Many domain adaptation methods are designed to reduce the distributional differences between sites to some extent, but usually ignore overfitting problem of the model on the source domain. Intuitively, target data augmentation can alleviate the overfitting problem by forcing the model to learn more generalized features and reduce the dependence on source domain data. In this work, we propose a new augmentation-based unsupervised cross-domain fMRI adaptation (AUFA) framework for automatic diagnosis of MDD. The AUFA consists of 1) a graph representation learning module for extracting rs-fMRI features with spatial attention, 2) a domain adaptation module for feature alignment between source and target data, 3) an augmentation-based self-optimization module for alleviating model overfitting on the source domain, and 4) a classification module. Experimental results on 1,089 subjects suggest that AUFA outperforms several state-of-the-art methods in MDD identification. Our approach not only reduces data heterogeneity between different sites, but also localizes disease-related functional connectivity abnormalities and provides interpretability for the model.


title: Leptogenesis in exponential $f(R)$ gravity model

abstract: We show that gravitational leptogenesis with dynamical $CPT$ breaking in an expanding universe can be reconciled with exponential $f(R)$ gravity models with axion as cold dark matter. For $L$ violating interactions, we consider both non-supersymmetric model with heavy right handed neutrino decay and supersymmetric model with sneutrino decay. For both the cases, we have shown that the required baryonis asymmetry could be obtained and also have shown the variation of decoupling temperature for lepton number violating interactions with $\beta$ parameter in exponential $f(R)$ gravity. Lepton number violating model parameters are contrained with $\beta$ through decoupling temperature. Upper bound on $\beta$ parameter is also obtained.


title: A simple model of magnetic universe without singularity associated with a quadratic equation of state

abstract: A model of magnetic universe based on nonlinear electrodynamics has been introduced by Kruglov. This model describes an early inflation era followed by a radiation era. We show that this model is related to our model of universe based on a quadratic equation of state. We discuss two quantitatively different models of early universe. In Model I, the primordial density of the universe is identified with the Planck density. At $t=0$, the universe had the characteristics of a Planck black hole. During the inflation, which takes place on a Planck timescale, the size of the universe evolves from the Planck length to a size comparable to the Compton wavelength of the neutrino. If we interpret the radius of the universe at the end of the inflation (neutrino's Compton wavelength) as a minimum length related to quantum gravity and use Zeldovich's first formula of the vacuum energy, we obtain the correct value of the cosmological constant. In Model II, the primordial density of the universe is identified with the electron density as a consequence of nonlinear electrodynamics. At $t=0$, the universe had the characteristics of an electron. During the inflation, which takes place on a gravitoelectronic timescale, the size of the universe evolves from the electron's classical radius to a size comparable to the size of a dark energy star of the stellar mass. If we interpret the radius of the universe at the begining of the inflation (electron's classical radius) as a minimum length related to quantum gravity and use Zeldovich's second formula of the vacuum energy, we obtain the correct value of the cosmological constant. This provides an accurate form of Eddington relation between the cosmological constant and the mass of the electron. We also introduce a nonlinear electromagnetic Lagrangian that describes simultaneously the early inflation, the radiation era, and the dark energy era.


title: The High-Resolution Far- to Near-Infrared Anharmonic Absorption Spectra of Cyano-Substituted Polycyclic Aromatic Hydrocarbons from 300-6200 cm$^{-1}$

abstract: Cyano-substituted polycyclic aromatic hydrocarbons (CN-PAHs) may contribute to the emission detected in the 7 - 9 $\mu$m (1430 - 1100 cm$^{-1}$) and 11 - 15 $\mu$m (900 - 670 cm$^{-1}$) regions of astronomical IR spectra. Anharmonic quantum chemical computations of 17 CN-PAH isomers for 4 small PAHs and Benzene reveal strong, broad absorption features across the entire 300 - 6200 cm$^{-1}$ (33 - 1.6 $\mu$m) frequency range. In particular, when a FWHM of 15 cm$^{-1}$ is applied, the composite CN-PAH spectrum is almost indistinguishable from the unsubstituted-PAH spectrum. At high resolution, however, the infrared absorption spectra reveal unique, identifiable features of CN-PAHs in the 700 - 950, 1100 - 1300, 2000 - 2500, and 3400 - 3600 cm$^{-1}$ ranges. The in-plane and out-of-plane CH bending vibrational frequencies of CN-PAHs are shifted when comparing isomers and to their unsubstituted counterparts, making their differentiation in mixed laboratory experiments possible. The overall aromatic CH stretch fundamental (2950 - 3200 cm$^{-1}$) and first overtone (5950 - 6200 cm$^{-1}$) regions are relatively unaffected by the cyano-substitution, with changes only to the breadth and intensity of the bands. Detailed spectroscopic data on the normal mode components of each state reported herein provide the means to directly assign future laboratory spectra and to guide direct IR observations of astronomical regions with, e.g., JWST.


title: Group-theoretical classification of orientable objects and particle phenomenology

abstract: In our previous works, we have proposed a quantum description of relativistic orientable objects by a scalar field on the Poincar\'{e} group. This description is, in a sense, a generalization of ideas used by Wigner, Casimir and Eckart back in the 1930's in constructing a non-relativistic theory of a rigid rotator. The present work is a continuation and development of the above mentioned our works. The position of the relativistic orientable object in Minkowski space is completely determined by the position of a body-fixed reference frame with respect to the space-fixed reference frame, and can be specified by elements $q$ of the motion group of the Minkowski space - the Poincar\'e group $M(3,1)$. Quantum states of relativistic orientable objects are described by scalar wave functions $f(q)$ where the arguments $q=(x,z)$ consist of Minkowski space-time points $x$, and of orientation variables $z$ given by elements of the matrix $Z\in SL(2,C)$. Technically, we introduce and study the so-called double-sided representation $\boldsymbol{T}(\boldsymbol{g})f(q)=f(g_l^{-1}qg_r)$, $\boldsymbol{g}=(g_l,g_r)\in \boldsymbol{M}$, of the group $\boldsymbol{M}$, in the space of the scalar functions $f(q)$. Here the left multiplication by $g_l^{-1}$ corresponds to a change of space-fixed reference frame, whereas the right multiplication by $g_r$ corresponds to a change of body-fixed reference frame. On this basis, we develop a classification of the orientable objects and draw the attention to a possibility of connecting these results with the particle phenomenology. In particular, we demonstrate how one may identify fields described by linear and quadratic functions of $z$ with known elementary particles of spins $0$,$\frac{1}{2}$, and $1$. The developed classification does not contradict the phenomenology of elementary particles and, moreover, in some cases give its group-theoretic explanation.


title: Probing Shocked Ejecta in SN 1987A with XRISM-Resolve: the effects of the gate valve closed

abstract: Supernova (SN) 1987A is widely regarded as an excellent candidate for leveraging the capabilities of the freshly launched XRISM satellite. Recent researches indicate that the X-ray emission from SN 1987A will increasingly originate from its ejecta in the years to come. In a previous study, we thoroughly examined the proficiency of XRISM-Resolve in identifying signatures of shocked ejecta in SN 1987A, synthesizing the XRISM-Resolve spectrum based on a state-of-the-art magneto-hydrodynamic simulation. However, following the satellite's launch, a technical issue arose with the XRISM instrument's gate valve, which failed to open, thereby affecting observations with the Resolve spectrometer. Here, we update our analysis, reevaluating our diagnostic approach under the assumption that the gate valve remains closed. We find that, even with the reduced instrumental capabilities, it will be possible to pinpoint the ejecta contribution through the study of the line profiles in the XRISM-Resolve spectrum of SN 1987A.


title: Transformer neural networks and quantum simulators: a hybrid approach for simulating strongly correlated systems

abstract: Owing to their great expressivity and versatility, neural networks have gained attention for simulating large two-dimensional quantum many-body systems. However, their expressivity comes with the cost of a challenging optimization due to the in general rugged and complicated loss landscape. Here, we present a hybrid optimization scheme for neural quantum states (NQS) that involves a data-driven pretraining with numerical or experimental data and a second, Hamiltonian-driven optimization stage. By using both projective measurements from the computational basis as well as expectation values from other measurement configurations such as spin-spin correlations, our pretraining gives access to the sign structure of the state, yielding improved and faster convergence that is robust w.r.t. experimental imperfections and limited datasets. We apply the hybrid scheme to the ground state search for the 2D transverse field Ising model and the 2D dipolar XY model on $6\times 6$ and $10\times 10$ square lattices with a patched transformer wave function, using numerical and experimental data from a programmable Rydberg quantum simulator [Chen et al., Nature 616 (2023)], with snapshots of the quantum system obtained from the different measurement configurations, and show that the information from the second basis highly improves the performance. Our work paves the way for a reliable and efficient optimization of neural quantum states.

categories: cond-mat.dis-nn cond-mat.quant-gas cond-mat.str-el quant-ph


title: How Random is Random? Evaluating the Randomness and Humaness of LLMs' Coin Flips

abstract: One uniquely human trait is our inability to be random. We see and produce patterns where there should not be any and we do so in a predictable way. LLMs are supplied with human data and prone to human biases. In this work, we explore how LLMs approach randomness and where and how they fail through the lens of the well studied phenomena of generating binary random sequences. We find that GPT 4 and Llama 3 exhibit and exacerbate nearly every human bias we test in this context, but GPT 3.5 exhibits more random behavior. This dichotomy of randomness or humaness is proposed as a fundamental question of LLMs and that either behavior may be useful in different circumstances.


title: Bootstrap3D: Improving 3D Content Creation with Synthetic Data

abstract: Recent years have witnessed remarkable progress in multi-view diffusion models for 3D content creation. However, there remains a significant gap in image quality and prompt-following ability compared to 2D diffusion models. A critical bottleneck is the scarcity of high-quality 3D assets with detailed captions. To address this challenge, we propose Bootstrap3D, a novel framework that automatically generates an arbitrary quantity of multi-view images to assist in training multi-view diffusion models. Specifically, we introduce a data generation pipeline that employs (1) 2D and video diffusion models to generate multi-view images based on constructed text prompts, and (2) our fine-tuned 3D-aware MV-LLaVA for filtering high-quality data and rewriting inaccurate captions. Leveraging this pipeline, we have generated 1 million high-quality synthetic multi-view images with dense descriptive captions to address the shortage of high-quality 3D data. Furthermore, we present a Training Timestep Reschedule (TTR) strategy that leverages the denoising process to learn multi-view consistency while maintaining the original 2D diffusion prior. Extensive experiments demonstrate that Bootstrap3D can generate high-quality multi-view images with superior aesthetic quality, image-text alignment, and maintained view consistency.


title: The flavor invariants of the $\nu$SM

abstract: Sixty years after the experimental discovery of CP violation in the quark sector, the existence of a similar CP violation in the lepton sector is still to be established. Actually, the structure of such a violation depends crucially on the origin of the neutrino masses. In an attempt at categorizing the leptonic sources of CP violation, we studied the $\nu$SM, the Standard Model extended with three generations of sterile neutrinos, that can interpolate continuously between the Dirac and Majorana scenarios of neutrino masses. In particular, we perform a classification of the Jarlskog-like flavor invariants entering CP-violating observables and we study their suppression with the heavy Majorana mass in the seesaw limit of the model. To simplify the construction of the invariants, we introduce a graph-based method. With the guidance of the Hilbert series and plethystic logarithm of the theory, we construct the \emph{generating} and \emph{primary} sets of invariants for the $\nu$SM for the first time. Unlike in the Standard Model and some other theories, we find that the numbers of generating invariants and the syzygies among them cannot immediately be read off from the plethystic logarithm, but require a more careful examination. Our analysis reveals that the \emph{generating} set contains 459 invariants, out of which 208 are CP-even and 251 are CP-odd. In the seesaw limit of the $\nu$SM, we show that all parameters of the UV theory can be captured in the effective theory with a certain suppression with the heavy Majorana mass, while these parameters can only appear in a \emph{flavor-invariant} way with a \emph{higher} mass suppression. Furthermore, we discuss how the necessary and sufficient conditions for CP violation can be captured by utilizing these invariants. Along the way, we present useful algorithms to enumerate and build the flavor invariants.


title: Can you hear the Planck mass?

abstract: For the Laplacian of an $n$-Riemannian manifold $X$, the Weyl law states that the $k$-th eigenvalue is asymptotically proportional to $(k/V)^{2/n}$, where $V$ is the volume of $X$. We show that this result can be derived via physical considerations by demanding that the gravitational potential for a compactification on $X$ behaves in the expected $(4+n)$-dimensional way at short distances. In simple product compactifications, when particle motion on $X$ is ergodic, for large $k$ the eigenfunctions oscillate around a constant, and the argument is relatively straightforward. The Weyl law thus allows to reconstruct the four-dimensional Planck mass from the asymptotics of the masses of the spin 2 Kaluza--Klein modes. For warped compactifications, a puzzle appears: the Weyl law still depends on the ordinary volume $V$, while the Planck mass famously depends on a weighted volume obtained as an integral of the warping function. We resolve this tension by arguing that in the ergodic case the eigenfunctions oscillate now around a power of the warping function rather than around a constant, a property that we call weighted quantum ergodicity. This has implications for the problem of gravity localization, which we discuss. We show that for spaces with D$p$-brane singularities the spectrum is discrete only for $p =6,7,8$, and for these cases we rigorously prove the Weyl law by applying modern techniques from RCD theory.

categories: hep-th gr-qc math-ph math.DG math.MG math.MP


title: Overlap reduction functions for pulsar timing arrays and astrometry

abstract: We present an efficient technique for calculating the angular two-point correlation functions (or ''overlap reduction functions'') induced by gravitational waves in both the pulse arrival times of pulsars and in the angular deflections of distant sources. In the most general case, there are six auto- and cross-correlations for the pulse arrival times and the two components of the angular deflection. We provide results for spin-2 (i.e., general-relativistic) gravitational waves as well as the spin-1 modes that may arise in alternative-gravity theories. These calculations can be easily implemented for future analysis or study, and we provide code to do so.


title: Updated Absolute Parameters and Kinematics of IS CMa

abstract: Eclipsing binary systems are significant objects for astrophysics in that direct observations can determine the fundamental parameters of stars. In this study, we determined precisely the fundamental parameters of the binary component stars obtained by simultaneous analysis of radial velocities and the {\it TESS} light curve using the Wilson and Devinney code. Following the analysis, the masses and radii of the primary and secondary components were determined as $M_{1}= 1.58\pm 0.01M_\odot$, $M_{2}= 0.48\pm0.02M_\odot$, and $R_{1}=1.93\pm 0.01R_\odot$, $R_{2}= 1.14\pm 0.01 R_\odot$, respectively. Furthermore, the distance of IS CMa is calculated as $92.7\pm6.5$ pc. On the basis of the analysis of the mid-eclipse times, it was found that the variation in the orbital period is represented by an upward parabola. It has an increasing rate of $dP/dt$ = 1.09 $\times$ 10$^{-7}$ day yr$^{-1}$. Using PARSEC stellar evolutionary tracks and isochrones with solar metallicity were estimated the age of IS CMa as $1.3\pm0.1$ Gyr. Kinematic and Galactic orbital parameters of IS CMa were obtained from the astrometric and spectroscopic data of the system. The Galactic orbit analysis reveals that IS CMa formed inside the solar circle and it is a member of the young thin-disc population.


title: Dirac spin liquid in quantum dipole arrays

abstract: We predict that the gapless $U(1)$ Dirac spin liquid naturally emerges in a two-dimensional array of quantum dipoles. In particular, we demonstrate that the dipolar XY model$\unicode{x2014}$realized in both Rydberg atom arrays and ultracold polar molecules$\unicode{x2014}$hosts a quantum spin liquid ground state on the kagome lattice. Large-scale density matrix renormalization group calculations indicate that this spin liquid exhibits signatures of gapless, linearly-dispersing spinons, consistent with the $U(1)$ Dirac spin liquid. We identify a route to adiabatic preparation via staggered on-site fields and demonstrate that this approach can prepare cold spin liquids within experimentally realistic time-scales. Finally, we propose a number of novel signatures of the Dirac spin liquid tailored to near-term quantum simulators, including termination-dependent edge modes and the Friedel response to a local perturbation.


title: There and Back Again: Mapping and Factorising Cosmological Observables

abstract: Cosmological correlators encode invaluable information about the wavefunction that characterises the state of the primordial universe. In this letter we present a simple yet novel duality between correlators and wavefunction coefficients that is valid to all orders in the loop expansion. The duality manifests itself as a $\mathbb{Z}_4$ symmetry in the correspondence between correlators and the physical parts of wavefunction coefficients. To demonstrate the power of the duality already at tree-level, we derive a correlator-to-correlator factorisation (CCF) formula for the parity-odd part of cosmological correlators that relates $n$-point observables to lower-point ones via a series of diagrammatic cuts. These relations are in principle testable as they involve observables defined for arbitrary physical kinematics (i.e. without performing any analytic continuation or taking any soft limits). For $n=4$, the CCF formula provides a relation between the parity-odd part of the trispectrum of curvature perturbations, the bispectra involving two curvature perturbations and an additional state with a complementary series mass and integer spin, and the power spectrum of this additional state.


title: Fermion Mass Generation without Symmetry Breaking

abstract: We study the generation of fermion mass in a context where interactions break a discrete chiral symmetry. Then, fermion mass is not protected by a symmetry, no symmetry is broken by the generation of mass, and a vanishing mass no longer enhances a symmetry. We elaborate these scenarios for template fermionic and Yukawa theories in three dimensions where mass can be generated either by fluctuations, strong dynamics, or the vacuum expectation value of a scalar field. We find that fluctuation-induced contributions to fermion mass are parametrically suppressed in the number of fermion flavours $N$. The generation of fermion mass then takes the form of a rapid crossover which turns into a second order quantum phase transition for large $N$, much like in settings with fundamental chiral symmetry. We further discuss theories where fermion mass can be generated spontaneously without breaking any symmetry other than scale symmetry. Implications of our findings are discussed.


title: Hedgehog: An Isolated Quiescent Dwarf Galaxy at 2.4 Mpc

abstract: It is well known that almost all isolated dwarf galaxies are actively forming stars. We report the discovery of Hedgehog, an isolated quiescent dwarf galaxy at a distance of $2.41\pm0.14$ Mpc with a stellar mass of $M_\star \approx 10^{5.8}\, M_\odot$. The distance is measured using surface brightness fluctuations with both Legacy Surveys and deep Magellan/IMACS imaging data. Hedgehog is 1.7 Mpc from the nearest galaxy group, Centaurus A, and has no neighboring galaxies within 1 Mpc, making it one of the most isolated quiescent dwarfs at this stellar mass. It has a red optical color, early-type morphology, and shows no UV emission. This indicates that Hedgehog has an old stellar population and is quiescent in star formation. Compared with other quiescent dwarfs in the Local Group and Local Volume, Hedgehog appears smaller in size for its luminosity but is consistent with the mass--size relations. Hedgehog might be a backsplash galaxy from the Centaurus A group, but it could also have been quenched in the field by ram pressure stripping in the cosmic web, reionization, or internal processes such as supernova and stellar feedback. Future observations are needed to fully unveil its formation, history, and quenching mechanisms.


title: Deep HST imaging favors the bulgeless edge-on galaxy explanation for the hypothetical stellar wake created by a runaway supermassive black hole

abstract: A long linear structure recently discovered could be the stellar wake produced by the passage of a runaway supermassive black hole (SMBH) or, alternatively, a bulgeless edge-on galaxy. We report on new very deep HST imaging that seems to be in tension with the SMBH runaway scenario but is consistent with the bulgeless edge-on galaxy scenario. The new observations were aimed at detecting two key features expected in the SMBH scenario, namely, the bow shock formed where the SMBH meets the surrounding medium, and a counter stellar wake created by another binary SMBH hypothesized as part of the ejection mechanism. Neither of these two features appears to be present in the new images, as would be expected in the edge-on galaxy scenario.


title: The Bispectrum in Lagrangian Perturbation Theory

abstract: We study the bispectrum in Lagrangian perturbation theory. Extending past results for the power spectrum, we describe a method to efficiently compute the bispectrum in LPT, focusing on the Zeldovich approximation, in which contributions due to linear displacements are captured to all orders in a manifestly infrared (IR) safe way. We then isolate the effects of these linear displacements on oscillatory components of the power spectrum like baryon acoustic oscillations or inflationary primordial features and show that the Eulerian perturbation theory (EPT) prescription wherein their effects are resummed by a Gaussian damping of the oscillations arise as a saddle-point approximation of our calculation. These two methods of IR resummation are in excellent agreement at 1-loop in the bispectrum. At tree level, resummed EPT does less well to capture the nonlinear damping of the oscillations, and the LPT calculation does not require an artificial split of the power spectrum into smooth and oscillatory components, making the latter particularly useful for modeling exotic features. We finish by extending our analysis of IR resummation in LPT to N-point functions of arbitrary order.


title: Scalable Bayesian Learning with posteriors

abstract: Although theoretically compelling, Bayesian learning with modern machine learning models is computationally challenging since it requires approximating a high dimensional posterior distribution. In this work, we (i) introduce posteriors, an easily extensible PyTorch library hosting general-purpose implementations making Bayesian learning accessible and scalable to large data and parameter regimes; (ii) present a tempered framing of stochastic gradient Markov chain Monte Carlo, as implemented in posteriors, that transitions seamlessly into optimization and unveils a minor modification to deep ensembles to ensure they are asymptotically unbiased for the Bayesian posterior, and (iii) demonstrate and compare the utility of Bayesian approximations through experiments including an investigation into the cold posterior effect and applications with large language models.


title: The SRG/eROSITA all-sky survey. X-ray emission from the warm-hot phase gas in long cosmic filaments

abstract: The properties of the warm-hot intergalactic medium (WHIM) in the cosmic filaments are among the least quantified in modern astrophysics. eROSITA All Sky Survey (eRASS) provides us with a unique opportunity to study the X-ray emission of the WHIM. We applied both imaging and spectroscopic stacking techniques to the data of the first four eRASS scans to inspect the X-ray emissions from 7817 cosmic filaments identified from Sloan Digital Sky Survey optical galaxy samples. We obtained a 9-sigma significant detection of the total X-ray signal from filaments in the 0.3-1.2 keV band. We introduce a novel method to estimate the contamination fraction from unmasked X-ray halos, active galactic nuclei, and X-ray binaries that are associated with galaxies in filaments. We found an approximately 40% contamination fraction by these unmasked sources, suggesting that the remaining 60% of the signal could be from the WHIM and a 5.4-sigma detection significance of the WHIM. Moreover, we modeled the temperature and baryon density contrast of the detected WHIM by fitting the stacked spectrum and surface brightness profile. The best-fit temperature log(T/k)=6.84+/-0.07 obtained by using a single temperature model is marginally higher than the simulation results, which could be due to the fitting of a single temperature model on a multi-temperature spectrum. The best-fit baryon density contrast log\Delta_b=1.88+/-0.18 generally agrees with the X-ray emitting phases in the IllustrisTNG simulation, suggesting that the broadband X-ray emission traces the high temperature and density end of the entire WHIM population.


title: Local Hamiltonian dynamics from non-local action principles and applications to binary systems in general relativity

abstract: We consider a class of finite-dimensional dynamical systems whose equations of motion are derived from a non-local-in-time action principle. The action functional has a zeroth order piece derived from a local Hamiltonian and a perturbation in the form of a non-local functional of the trajectory on phase space. We prove that the dynamics of these systems admits a local Hamiltonian description to all order in the perturbation and we provide explicit formulae for the $\mathcal{N}^{\text{th}}$ order Hamiltonian and symplectic form in terms of the $(\mathcal{N}-1)^{\text{th}}$ order Hamiltonian flow. In the context of general relativity, these systems arise in the study of binary systems such as pairs of black holes or neutron stars in the small mass-ratio and post-Newtonian approximations. We provide applications of the formalism to binary systems in these regimes.


title: Direct Imaging Detection of the Protoplanet AB Aurigae b at Wavelengths Covering Pa$\beta$: Rebuttal to Biddle et al. (2024)

abstract: Recently, Biddle et al. (2024) claimed a non-detection of the protoplanet AB Aurigae b in Keck/NIRC2 Pa$\beta$ imaging. I reprocess these newly-public data and compare them to data from the extreme AO platform (SCExAO/CHARIS) used to discover AB Aur b. AB Aur b is decisively imaged with SCExAO/CHARIS at wavelengths covering Pa$\beta$. The Biddle et al. non detection of AB Aur b results from a far poorer image quality that is non competitive with SCExAO/CHARIS. Their contrast limits and thus constraints on accretion are overestimated due to an inaccurate AB Aur b source model. Consequentially, the revised Pa$\beta$ 2-$\sigma$ upper limit from these data is about three times higher than previously reported. Irrespective of image quality, single-band Pa$\beta$ imaging is ill suited to conclusively identifying accretion onto AB Aur b. Instead, high-resolution H$\alpha$ spectroscopy may provide accretion signatures. Aside from PDS 70, AB Aurigae remains the system with the strongest evidence for having a directly-imaged protoplanet.


title: Formation and decay of oscillons after inflation in the presence of an external coupling, Part-I: Lattice simulations

abstract: We investigate the formation and decay of oscillons during the post-inflationary reheating epoch from inflaton oscillations around asymptotically flat potentials $V(\varphi)$ in the presence of an external coupling of the form $\frac{1}{2}\, g^2 \, \varphi^2 \, \chi^2$. It is well-known that in the absence of such an external coupling, the attractive self-interaction term in the potential leads to the formation of copious amounts of long-lived oscillons both for symmetric and asymmetric plateau potentials. We perform a detailed numerical analysis to study the formation of oscillons in the $\alpha$-attractor E- and T-model potentials using the publicly available lattice simulation code ${\cal C}$osmo${\cal L}$attice. We observe the formation of nonlinear oscillon-like structures with the average equation of state $\langle w_\varphi\rangle \simeq 0$ for a range of values of the inflaton self-coupling $\lambda$ and the external coupling $g^2$. Our results demonstrate that oscillons form even in the presence of an external coupling and we determine the upper bound on $g^2$ which facilitates oscillon formation. We also find that eventually, these oscillons decay into the scalar inflaton radiation as well as into the quanta of the offspring field $\chi$. Thus, we establish the possibility that reheating could have proceeded through the channel of oscillon decay, along with the usual decay of the oscillating inflaton condensate into $\chi$ particles. For a given value of the self-coupling $\lambda$, we notice that the lifetime of a population of oscillons decreases with an increase in the strength of the external coupling, following an (approximately) inverse power-law dependence on $g^2$.


title: Energetic Electrons Accelerated and Trapped in a Magnetic Bottle above a Solar Flare Arcade

abstract: Where and how flares efficiently accelerate charged particles remains an unresolved question. Recent studies revealed that a "magnetic bottle" structure, which forms near the bottom of a large-scale reconnection current sheet above the flare arcade, is an excellent candidate for confining and accelerating charged particles. However, further understanding its role requires linking the various observational signatures to the underlying coupled plasma and particle processes. Here we present the first study combining multi-wavelength observations with data-informed macroscopic magnetohydrodynamics and particle modeling in a realistic eruptive flare geometry. The presence of an above-the-looptop magnetic bottle structure is strongly supported by the observations, which feature not only a local minimum of magnetic field strength but also abruptly slowing down plasma downflows. It also coincides with a compact hard X-ray source and an extended microwave source that bestrides above the flare arcade. Spatially resolved spectral analysis suggests that nonthermal electrons are highly concentrated in this region. Our model returns synthetic emission signatures that are well-matched to the observations. The results suggest that the energetic electrons are strongly trapped in the magnetic bottle region due to turbulence, with only a small fraction managing to escape. The electrons are primarily accelerated by plasma compression and facilitated by a fast-mode termination shock via the Fermi mechanism. Our results provide concrete support for the magnetic bottle as the primary electron acceleration site in eruptive solar flares. They also offer new insights into understanding the previously reported small population of flare-accelerated electrons entering interplanetary space.


title: DECam Multi-Messenger Astrophysics Pipeline. I. from Raw Data to Single-Exposure Candidates

abstract: We introduce a pipeline that performs rapid image subtraction and source selection to detect transients, with a focus on identifying gravitational wave optical counterparts using the Dark Energy Camera (DECam). In this work, we present the pipeline steps from processing raw data to identification of astrophysical transients on individual exposures. We process DECam data and build difference images using the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) Science Pipelines software, and we use flags and principal component analysis to select transients on a per-exposure basis, without associating the results from different exposures. Those candidates will be sent to brokers for further classification and alert distribution. We validate our pipeline using archival exposures that cover various types of objects, and the tested targets include a kilonova (GW170817), supernovae, stellar flares, variable stars (in a resolved galaxy or the Milky Way Bulge), and serendipitous objects. Overall, the data processing produces clean light curves that are comparable with published results, demonstrating the photometric quality of our pipeline. Real transients can be well selected by our pipeline when sufficiently bright (S/N $\gtrsim15$). This pipeline is intended to serve as a tool for the broader research community. Although this pipeline is designed for DECam, our method can be easily applied to other instruments and future LSST observations.