title: Application Research of Spline Interpolation and ARIMA in the Field of Stock Market Forecasting

abstract: The ARIMA (Autoregressive Integrated Moving Average model) has extensive applications in the field of time series forecasting. However, the predictive performance of the ARIMA model is limited when dealing with data gaps or significant noise. Based on previous research, we have found that cubic spline interpolation performs well in capturing the smooth changes of stock price curves, especially when the market trends are relatively stable. Therefore, this paper integrates the two approaches by taking the time series data in stock trading as an example, establishes a time series forecasting model based on cubic spline interpolation and ARIMA. Through validation, the model has demonstrated certain guidance and reference value for short-term time series forecasting.


title: Non-Parametric Memory Guidance for Multi-Document Summarization

abstract: Multi-document summarization (MDS) is a difficult task in Natural Language Processing, aiming to summarize information from several documents. However, the source documents are often insufficient to obtain a qualitative summary. We propose a retriever-guided model combined with non-parametric memory for summary generation. This model retrieves relevant candidates from a database and then generates the summary considering the candidates with a copy mechanism and the source documents. The retriever is implemented with Approximate Nearest Neighbor Search (ANN) to search large databases. Our method is evaluated on the MultiXScience dataset which includes scientific articles. Finally, we discuss our results and possible directions for future work.


title: Emergence of autopoietic vesicles able to grow, repair and reproduce in a minimalist particle system

abstract: This paper describes a 2D particle system in which autopoietic vesicles that are able to grow, repair, and reproduce can emerge from an initial random distribution of individual components. The reproduction process also exhibits inheritance of the vesicle content that could in principle change from one generation to the next and influence fitness, making those autopoietic vesicles eligible to be acted upon by natural selection. Video abstract: https://www.youtube.com/watch?v=JmCN_4jTwf8


title: Forecast U.S. Covid-19 Numbers by Open SIR Model with Testing

abstract: The U.S. Covid-19 data exhibit a high-frequency oscillation along a low-frequency wave for outbreaks. There is no model to account for it. A modified SIR model is proposed to explain this spiking phenomenon. It is also used to best-fit the data and to make forecast. For the simulated duration of 590 days, the model is capable of achieving a 0.5 percent mean squared relative error (MSRE) fit to the seven-day average of the daily case number. The outright 28-day prediction by the model generates a 20 percent MSRE for the cumulative case total due to a persistent underestimation of the data by the model. With the proposed correction to the aberration, the model is able to keep the 28-day cumulative case total forecast within 10 percent MSRE of the data.


title: Comparing Generalization in Learning with Limited Numbers of Exemplars: Transformer vs. RNN in Attractor Dynamics

abstract: ChatGPT, a widely-recognized large language model (LLM), has recently gained substantial attention for its performance scaling, attributed to the billions of web-sourced natural language sentences used for training. Its underlying architecture, Transformer, has found applications across diverse fields, including video, audio signals, and robotic movement. %The crucial question this raises concerns the Transformer's generalization-in-learning (GIL) capacity. However, this raises a crucial question about Transformer's generalization in learning (GIL) capacity. Is ChatGPT's success chiefly due to the vast dataset used for training, or is there more to the story? To investigate this, we compared Transformer's GIL capabilities with those of a traditional Recurrent Neural Network (RNN) in tasks involving attractor dynamics learning. For performance evaluation, the Dynamic Time Warping (DTW) method has been employed. Our simulation results suggest that under conditions of limited data availability, Transformer's GIL abilities are markedly inferior to those of RNN.


title: Deep Group Interest Modeling of Full Lifelong User Behaviors for CTR Prediction

abstract: Extracting users' interests from their lifelong behavior sequence is crucial for predicting Click-Through Rate (CTR). Most current methods employ a two-stage process for efficiency: they first select historical behaviors related to the candidate item and then deduce the user's interest from this narrowed-down behavior sub-sequence. This two-stage paradigm, though effective, leads to information loss. Solely using users' lifelong click behaviors doesn't provide a complete picture of their interests, leading to suboptimal performance. In our research, we introduce the Deep Group Interest Network (DGIN), an end-to-end method to model the user's entire behavior history. This includes all post-registration actions, such as clicks, cart additions, purchases, and more, providing a nuanced user understanding. We start by grouping the full range of behaviors using a relevant key (like item_id) to enhance efficiency. This process reduces the behavior length significantly, from O(10^4) to O(10^2). To mitigate the potential loss of information due to grouping, we incorporate two categories of group attributes. Within each group, we calculate statistical information on various heterogeneous behaviors (like behavior counts) and employ self-attention mechanisms to highlight unique behavior characteristics (like behavior type). Based on this reorganized behavior data, the user's interests are derived using the Transformer technique. Additionally, we identify a subset of behaviors that share the same item_id with the candidate item from the lifelong behavior sequence. The insights from this subset reveal the user's decision-making process related to the candidate item, improving prediction accuracy. Our comprehensive evaluation, both on industrial and public datasets, validates DGIN's efficacy and efficiency.


title: Enhancing Machine Translation through Advanced In-Context Learning: A Methodological Strategy for GPT-4 Improvement

abstract: The challenge of improving translation accuracy in GPT-4 is being addressed by harnessing a method known as in-context learning. This paper introduces a strategic approach to utilize in-context learning specifically for machine translation, aiming to significantly boost accuracy. The crux of this method lies in the judicious selection of demonstrations that are most effective for in-context learning. By selecting these examples carefully, GPT-4 can utilize them to achieve remarkably accurate machine translations, eliminating the need for task-specific fine-tuning. This technique is anchored in the semantic similarities between the user's prompt and the chosen dataset. Sentences from this dataset, carefully picked for their relevance and clarity, serve as potent demonstrations for in-context learning. This approach not only enhances translation accuracy but also enriches the understanding of nuanced linguistic structures. It represents a significant step forward in machine learning, leveraging the inherent capabilities of GPT-4 to provide translations that are not only accurate but also contextually rich and linguistically sophisticated. This method demonstrates the potential of in-context learning in overcoming language barriers, opening new avenues for cross-cultural communication and global collaboration.


title: Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Values

abstract: The rapid advancement of Large Language Models (LLMs) has attracted much attention to value alignment for their responsible development. However, how to define values in this context remains a largely unexplored question. Existing work mainly follows the Helpful, Honest, Harmless principle and specifies values as risk criteria formulated in the AI community, e.g., fairness and privacy protection, suffering from poor clarity, adaptability and transparency. Inspired by basic values in humanity and social science across cultures, this work proposes a novel basic value alignment paradigm and introduces a value space spanned by basic value dimensions. All LLMs' behaviors can be mapped into the space by identifying the underlying values, possessing the potential to address the three challenges. To foster future research, we apply the representative Schwartz's Theory of Basic Values as an initialized example and construct FULCRA, a dataset consisting of 5k (LLM output, value vector) pairs. Our extensive analysis of FULCRA reveals the underlying relation between basic values and LLMs' behaviors, demonstrating that our approach not only covers existing mainstream risks but also anticipates possibly unidentified ones. Additionally, we present an initial implementation of the basic value evaluation and alignment, paving the way for future research in this line.


title: Optimizing IaC Configurations: a Case Study Using Nature-inspired Computing

abstract: In the last years, one of the fields of artificial intelligence that has been investigated the most is nature-inspired computing. The research done on this specific topic showcases the interest that sparks in researchers and practitioners, who put their focus on this paradigm because of the adaptability and ability of nature-inspired algorithms to reach high-quality outcomes on a wide range of problems. In fact, this kind of methods has been successfully applied to solve real-world problems in heterogeneous fields such as medicine, transportation, industry, or software engineering. Our main objective with this paper is to describe a tool based on nature-inspired computing for solving a specific software engineering problem. The problem faced consists of optimizing Infrastructure as Code deployment configurations. For this reason, the name of the system is IaC Optimizer Platform. A prototypical version of the IOP was described in previous works, in which the functionality of this platform was introduced. With this paper, we take a step forward by describing the final release of the IOP, highlighting its main contribution regarding the current state-of-the-art, and justifying the decisions made on its implementation. Also, we contextualize the IOP within the complete platform in which it is embedded, describing how a user can benefit from its use. To do that, we also present and solve a real-world use case.


title: Memory Augmented Language Models through Mixture of Word Experts

abstract: Scaling up the number of parameters of language models has proven to be an effective approach to improve performance. For dense models, increasing model size proportionally increases the model's computation footprint. In this work, we seek to aggressively decouple learning capacity and FLOPs through Mixture-of-Experts (MoE) style models with large knowledge-rich vocabulary based routing functions and experts. Our proposed approach, dubbed Mixture of Word Experts (MoWE), can be seen as a memory augmented model, where a large set of word-specific experts play the role of a sparse memory. We demonstrate that MoWE performs significantly better than the T5 family of models with similar number of FLOPs in a variety of NLP tasks. Additionally, MoWE outperforms regular MoE models on knowledge intensive tasks and has similar performance to more complex memory augmented approaches that often require to invoke custom mechanisms to search the sparse memory.


title: A Bayesian Inverse Approach to Proton Therapy Dose Delivery Verification

abstract: This study presents a proof-of-concept for a novel Bayesian inverse method in a one-dimensional setting, aimed at proton beam therapy treatment verification. Our methodology is predicated on a hypothetical scenario wherein strategically positioned sensors detect prompt-{\gamma}'s emitted from a proton beam when it interacts with defined layers of tissue. Using this data, we employ a Bayesian framework to estimate the proton beam's energy deposition profile. We validate our Bayesian inverse estimations against a closed-form approximation of the Bragg Peak in a uniform medium and a layered lung tumour.


title: Exponentially Faster Language Modelling

abstract: Language models only really need to use an exponential fraction of their neurons for individual inferences. As proof, we present UltraFastBERT, a BERT variant that uses 0.3% of its neurons during inference while performing on par with similar BERT models. UltraFastBERT selectively engages just 12 out of 4095 neurons for each layer inference. This is achieved by replacing feedforward networks with fast feedforward networks (FFFs). While no truly efficient implementation currently exists to unlock the full acceleration potential of conditional neural execution, we provide high-level CPU code achieving 78x speedup over the optimized baseline feedforward implementation, and a PyTorch implementation delivering 40x speedup over the equivalent batched feedforward inference. We publish our training code, benchmarking setup, and model weights.


title: Automatic Restoration of Diacritics for Speech Data Sets

abstract: Automatic text-based diacritic restoration models generally have high diacritic error rates when applied to speech transcripts as a result of domain and style shifts in spoken language. In this work, we explore the possibility of improving the performance of automatic diacritic restoration when applied to speech data by utilizing parallel spoken utterances. In particular, we use the pre-trained Whisper ASR model fine-tuned on relatively small amounts of diacritized Arabic speech data to produce rough diacritized transcripts for the speech utterances, which we then use as an additional input for diacritic restoration models. The proposed framework consistently improves diacritic restoration performance compared to text-only baselines. Our results highlight the inadequacy of current text-based diacritic restoration models for speech data sets and provide a new baseline for speech-based diacritic restoration.


title: A Generalization of the Brocard Circle

abstract: In this article, we provide a generalization of the Brocard circle and the Brocard triangles. The generalization arises from considering the Miquel points of two inscribed triangles having a common circumcircle. We also present various properties of the Brocard triangles, which lead to a generalization of the Steiner and Tarry points.


title: User Persona Identification and New Service Adaptation Recommendation

abstract: Providing a personalized user experience on information dense webpages helps users in reaching their end-goals sooner. We explore an automated approach to identifying user personas by leveraging high dimensional trajectory information from user sessions on webpages. While neural collaborative filtering (NCF) approaches pay little attention to token semantics, our method introduces SessionBERT, a Transformer-backed language model trained from scratch on the masked language modeling (mlm) objective for user trajectories (pages, metadata, billing in a session) aiming to capture semantics within them. Our results show that representations learned through SessionBERT are able to consistently outperform a BERT-base model providing a 3% and 1% relative improvement in F1-score for predicting page links and next services. We leverage SessionBERT and extend it to provide recommendations (top-5) for the next most-relevant services that a user would be likely to use. We achieve a HIT@5 of 58% from our recommendation model.


title: MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning

abstract: With the rapid development of large language models (LLMs) and their integration into large multimodal models (LMMs), there has been impressive progress in zero-shot completion of user-oriented vision-language tasks. However, a gap remains in the domain of chart image understanding due to the distinct abstract components in charts. To address this, we introduce a large-scale MultiModal Chart Instruction (\textbf{MMC-Instruction}) dataset comprising 600k instances supporting diverse tasks and chart types. Leveraging this data, we develop MultiModal Chart Assistant (\textbf{MMCA}), an LMM that achieves state-of-the-art performance on existing chart QA benchmarks. Recognizing the need for a comprehensive evaluation of LMM chart understanding, we also propose a MultiModal Chart Benchmark (\textbf{MMC-Benchmark}), a comprehensive human-annotated benchmark with nine distinct tasks evaluating reasoning capabilities over charts. Extensive experiments on MMC-Benchmark reveal the limitations of existing LMMs on correctly interpreting charts, even for the most recent GPT-4V model. Our work provides an instruction-tuning methodology and benchmark to advance multimodal understanding of charts. Code and data are available at https://github.com/FuxiaoLiu/MMC.


title: ToolTalk: Evaluating Tool-Usage in a Conversational Setting

abstract: Large language models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users. Many recent works seek to augment LLM-based assistants with external tools so they can access private or up-to-date information and carry out actions on behalf of users. To better measure the performance of these assistants, this paper introduces ToolTalk, a benchmark consisting of complex user intents requiring multi-step tool usage specified through dialogue. ToolTalk contains 28 tools grouped into 7 plugins, and includes a complete simulated implementation of each tool, allowing for fully automated evaluation of assistants that rely on execution feedback. ToolTalk also emphasizes tools that externally affect the world rather than only tools for referencing or searching information. We evaluate GPT-3.5 and GPT-4 on ToolTalk resulting in success rates of 26% and 50% respectively. Our analysis of the errors reveals three major categories and suggests some future directions for improvement. We release ToolTalk at https://github.com/microsoft/ToolTalk.


title: Chemist-X: Large Language Model-empowered Agent for Reaction Condition Recommendation in Chemical Synthesis

abstract: Recent AI research plots a promising future of automatic chemical reactions within the chemistry society. This study proposes Chemist-X, a transformative AI agent that automates the reaction condition recommendation (RCR) task in chemical synthesis with retrieval-augmented generation (RAG) technology. To emulate expert chemists' strategies when solving RCR tasks, Chemist-X utilizes advanced RAG schemes to interrogate online molecular databases and distill critical data from the latest literature database. Further, the agent leverages state-of-the-art computer-aided design (CAD) tools with a large language model (LLM) supervised programming interface. With the ability to utilize updated chemical knowledge and CAD tools, our agent significantly outperforms conventional synthesis AIs confined to the fixed knowledge within its training data. Chemist-X considerably reduces chemists' workload and allows them to focus on more fundamental and creative problems, thereby bringing closer computational techniques and chemical research and making a remarkable leap toward harnessing AI's full capabilities in scientific discovery.


title: A Systematic Review of Aspect-based Sentiment Analysis (ABSA): Domains, Methods, and Trends

abstract: Aspect-based Sentiment Analysis (ABSA) is a fine-grained type of sentiment analysis that identifies aspects and their associated opinions from a given text. With the surge of digital opinionated text data, ABSA gained increasing popularity for its ability to mine more detailed and targeted insights. Many review papers on ABSA subtasks and solution methodologies exist, however, few focus on trends over time or systemic issues relating to research application domains, datasets, and solution approaches. To fill the gap, this paper presents a Systematic Literature Review (SLR) of ABSA studies with a focus on trends and high-level relationships among these fundamental components. This review is one of the largest SLRs on ABSA, and also, to our knowledge, the first that systematically examines the trends and inter-relations among ABSA research and data distribution across domains and solution paradigms and approaches. Our sample includes 519 primary studies screened from 4191 search results without time constraints via an innovative automatic filtering process. Our quantitative analysis not only identifies trends in nearly two decades of ABSA research development but also unveils a systemic lack of dataset and domain diversity as well as domain mismatch that may hinder the development of future ABSA research. We discuss these findings and their implications and propose suggestions for future research.


title: uHD: Unary Processing for Lightweight and Dynamic Hyperdimensional Computing

abstract: Hyperdimensional computing (HDC) is a novel computational paradigm that operates on long-dimensional vectors known as hypervectors. The hypervectors are constructed as long bit-streams and form the basic building blocks of HDC systems. In HDC, hypervectors are generated from scalar values without taking their bit significance into consideration. HDC has been shown to be efficient and robust in various data processing applications, including computer vision tasks. To construct HDC models for vision applications, the current state-of-the-art practice utilizes two parameters for data encoding: pixel intensity and pixel position. However, the intensity and position information embedded in high-dimensional vectors are generally not generated dynamically in the HDC models. Consequently, the optimal design of hypervectors with high model accuracy requires powerful computing platforms for training. A more efficient approach to generating hypervectors is to create them dynamically during the training phase, which results in accurate, low-cost, and highly performable vectors. To this aim, we use low-discrepancy sequences to generate intensity hypervectors only, while avoiding position hypervectors. By doing so, the multiplication step in vector encoding is eliminated, resulting in a power-efficient HDC system. For the first time in the literature, our proposed approach employs lightweight vector generators utilizing unary bit-streams for efficient encoding of data instead of using conventional comparator-based generators.


title: Knowledge Plugins: Enhancing Large Language Models for Domain-Specific Recommendations

abstract: The significant progress of large language models (LLMs) provides a promising opportunity to build human-like systems for various practical applications. However, when applied to specific task domains, an LLM pre-trained on a general-purpose corpus may exhibit a deficit or inadequacy in two types of domain-specific knowledge. One is a comprehensive set of domain data that is typically large-scale and continuously evolving. The other is specific working patterns of this domain reflected in the data. The absence or inadequacy of such knowledge impacts the performance of the LLM. In this paper, we propose a general paradigm that augments LLMs with DOmain-specific KnowledgE to enhance their performance on practical applications, namely DOKE. This paradigm relies on a domain knowledge extractor, working in three steps: 1) preparing effective knowledge for the task; 2) selecting the knowledge for each specific sample; and 3) expressing the knowledge in an LLM-understandable way. Then, the extracted knowledge is incorporated through prompts, without any computational cost of model fine-tuning. We instantiate the general paradigm on a widespread application, i.e. recommender systems, where critical item attributes and collaborative filtering signals are incorporated. Experimental results demonstrate that DOKE can substantially improve the performance of LLMs in specific domains.


title: Extending Neural Network Verification to a Larger Family of Piece-wise Linear Activation Functions

abstract: In this paper, we extend an available neural network verification technique to support a wider class of piece-wise linear activation functions. Furthermore, we extend the algorithms, which provide in their original form exact respectively over-approximative results for bounded input sets represented as start sets, to allow also unbounded input set. We implemented our algorithms and demonstrated their effectiveness in some case studies.


title: Can Language Model Moderators Improve the Health of Online Discourse?

abstract: Conversational moderation of online communities is crucial to maintaining civility for a constructive environment, but it is challenging to scale and harmful to moderators. The inclusion of sophisticated natural language generation modules as a force multiplier to aid human moderators is a tantalizing prospect, but adequate evaluation approaches have so far been elusive. In this paper, we establish a systematic definition of conversational moderation effectiveness grounded on moderation literature and establish design criteria for conducting realistic yet safe evaluation. We then propose a comprehensive evaluation framework to assess models' moderation capabilities independently of human intervention. With our framework, we conduct the first known study of language models as conversational moderators, finding that appropriately prompted models that incorporate insights from social science can provide specific and fair feedback on toxic behavior but struggle to influence users to increase their levels of respect and cooperation.


title: A BERT based Ensemble Approach for Sentiment Classification of Customer Reviews and its Application to Nudge Marketing in e-Commerce

abstract: According to the literature, Product reviews are an important source of information for customers to support their buying decision. Product reviews improve customer trust and loyalty. Reviews help customers in understanding what other customers think about a particular product and helps in driving purchase decisions. Therefore, for an e-commerce platform it is important to understand the sentiments in customer reviews to understand their products and services, and it also allows them to potentially create positive consumer interaction as well as long lasting relationships. Reviews also provide innovative ways to market the products for an ecommerce company. One such approach is Nudge Marketing. Nudge marketing is a subtle way for an ecommerce company to help their customers make better decisions without hesitation.


title: Effect of radiation from vacuum in the interaction of zero-point fluctuations with charged particles accelerated in electric or magnetic fields

abstract: The possibility of the effect of electromagnetic radiation (hereinafter - radiation from vacuum) due to the interaction of zero-point vacuum fluctuations with free charged particles accelerated at relativistic speeds in electric or magnetic fields is theoretically demonstrated and confirmed by calculations. The proposed effect is similar to the appearance of radiation in the Lamb shift effect in the hydrogen atom and the dynamical Casimir effect. However, unlike these effects, the radiation characteristics depend on the induction of electric or magnetic fields. Moreover, in order to comply with the law of conservation of momentum, the braking radiation of charged particles is considered as the "third body". As opposed to this bremsstrahlung, radiation from vacuum will not have a preferred direction. Analytical expressions describing the radiation characteristics were obtained using a semi-classical method. The calculated values of the energy and intensity of radiation from vacuum demonstrate the possibility of using optical methods to determine the characteristics of such radiation in strong electric or magnetic fields. The results of the work can be used in studies of astrophysical objects with powerful electric or magnetic fields, as well as in investigations of physical vacuum states under laboratory conditions.


title: ExFake: Towards an Explainable Fake News Detection Based on Content and Social Context Information

abstract: ExFake is an explainable fake news detection system based on content and context-level information. It is concerned with the veracity analysis of online posts based on their content, social context (i.e., online users' credibility and historical behaviour), and data coming from trusted entities such as fact-checking websites and named entities. Unlike state-of-the-art systems, an Explainable AI (XAI) assistant is also adopted to help online social networks (OSN) users develop good reflexes when faced with any doubted information that spreads on social networks. The trustworthiness of OSN users is also addressed by assigning a credibility score to OSN users, as OSN users are one of the main culprits for spreading fake news. Experimental analysis on a real-world dataset demonstrates that ExFake significantly outperforms other baseline methods for fake news detection.


title: Text Sanitization Beyond Specific Domains: Zero-Shot Redaction & Substitution with Large Language Models

abstract: In the context of information systems, text sanitization techniques are used to identify and remove sensitive data to comply with security and regulatory requirements. Even though many methods for privacy preservation have been proposed, most of them are focused on the detection of entities from specific domains (e.g., credit card numbers, social security numbers), lacking generality and requiring customization for each desirable domain. Moreover, removing words is, in general, a drastic measure, as it can degrade text coherence and contextual information. Less severe measures include substituting a word for a safe alternative, yet it can be challenging to automatically find meaningful substitutions. We present a zero-shot text sanitization technique that detects and substitutes potentially sensitive information using Large Language Models. Our evaluation shows that our method excels at protecting privacy while maintaining text coherence and contextual information, preserving data utility for downstream tasks.


title: A Systems-Theoretical Formalization of Closed Systems

abstract: There is a lack of formalism for some key foundational concepts in systems engineering. One of the most recently acknowledged deficits is the inadequacy of systems engineering practices for engineering intelligent systems. In our previous works, we proposed that closed systems precepts could be used to accomplish a required paradigm shift for the systems engineering of intelligent systems. However, to enable such a shift, formal foundations for closed systems precepts that expand the theory of systems engineering are needed. The concept of closure is a critical concept in the formalism underlying closed systems precepts. In this paper, we provide formal, systems- and information-theoretic definitions of closure to identify and distinguish different types of closed systems. Then, we assert a mathematical framework to evaluate the subjective formation of the boundaries and constraints of such systems. Finally, we argue that engineering an intelligent system can benefit from appropriate closed and open systems paradigms on multiple levels of abstraction of the system. In the main, this framework will provide the necessary fundamentals to aid in systems engineering of intelligent systems.


title: Assurance for Deployed Continual Learning Systems

abstract: The future success of the Navy will depend, in part, on artificial intelligence. In practice, many artificially intelligent algorithms, and in particular deep learning models, rely on continual learning to maintain performance in dynamic environments. The software requires adaptation to maintain its initial level of performance in unseen situations. However, if not monitored properly, continual learning may lead to several issues including catastrophic forgetting in which a trained model forgets previously learned tasks when being retrained on new data. The authors created a new framework for safely performing continual learning with the goal of pairing this safety framework with a deep learning computer vision algorithm to allow for safe and high-performing automatic deck tracking on carriers and amphibious assault ships. The safety framework includes several features, such as an ensemble of convolutional neural networks to perform image classification, a manager to record confidences and determine the best answer from the ensemble, a model of the environment to predict when the system may fail to meet minimum performance metrics, a performance monitor to log system and domain performance and check against requirements, and a retraining component to update the ensemble and manager to maintain performance. The authors validated the proposed method using extensive simulation studies based on dynamic image classification. The authors showed the safety framework could probabilistically detect out of distribution data. The results also show the framework can detect when the system is no longer performing safely and can significantly extend the working envelope of an image classifier.


title: Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

abstract: Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Some newer methods employ optical flow models to capture this temporal aspect, but they are computationally expensive. In contrast, we propose using the related but often ignored Motion Vectors (MVs) and Information Masks (IMs) from the H.264 video codec, to detect temporal inconsistencies in DeepFakes. Our experiments show that this approach is effective and has minimal computational costs, compared with per-frame RGB-only methods. This could lead to new, real-time temporally-aware DeepFake detection methods for video calls and streaming.


title: Stratified-NMF for Heterogeneous Data

abstract: Non-negative matrix factorization (NMF) is an important technique for obtaining low dimensional representations of datasets. However, classical NMF does not take into account data that is collected at different times or in different locations, which may exhibit heterogeneity. We resolve this problem by solving a modified NMF objective, Stratified-NMF, that simultaneously learns strata-dependent statistics and a shared topics matrix. We develop multiplicative update rules for this novel objective and prove convergence of the objective. Then, we experiment on synthetic data to demonstrate the efficiency and accuracy of the method. Lastly, we apply our method to three real world datasets and empirically investigate their learned features.


title: Degeneration of kernel regression with Matern kernels into low-order polynomial regression in high dimension

abstract: Kernel methods such as kernel ridge regression and Gaussian process regressions with Matern type kernels have been increasingly used, in particular, to fit potential energy surfaces (PES) and density functionals, and for materials informatics. When the dimensionality of the feature space is high, these methods are used with necessarily sparse data. In this regime, the optimal length parameter of a Matern-type kernel tends to become so large that the method effectively degenerates into a low-order polynomial regression and therefore loses any advantage over such regression. This is demonstrated theoretically as well as numerically on the examples of six- and fifteen-dimensional molecular PES using squared exponential and simple exponential kernels. The results shed additional light on the success of polynomial approximations such as PIP for medium size molecules and on the importance of orders-of-coupling based models for preserving the advantages of kernel methods with Matern type kernels or on the use of physically-motivated (reproducing) kernels.


title: Modality-invariant and Specific Prompting for Multimodal Human Perception Understanding

abstract: Understanding human perceptions presents a formidable multimodal challenge for computers, encompassing aspects such as sentiment tendencies and sense of humor. While various methods have recently been introduced to extract modality-invariant and specific information from diverse modalities, with the goal of enhancing the efficacy of multimodal learning, few works emphasize this aspect in large language models. In this paper, we introduce a novel multimodal prompt strategy tailored for tuning large language models. Our method assesses the correlation among different modalities and isolates the modality-invariant and specific components, which are then utilized for prompt tuning. This approach enables large language models to efficiently and effectively assimilate information from various modalities. Furthermore, our strategy is designed with scalability in mind, allowing the integration of features from any modality into pretrained large language models. Experimental results on public datasets demonstrate that our proposed method significantly improves performance compared to previous methods.


title: Enhancing Data Efficiency and Feature Identification for Lithium-Ion Battery Lifespan Prediction by Deciphering Interpretation of Temporal Patterns and Cyclic Variability Using Attention-Based Models

abstract: Accurately predicting the lifespan of lithium-ion batteries is crucial for optimizing operational strategies and mitigating risks. While numerous studies have aimed at predicting battery lifespan, few have examined the interpretability of their models or how such insights could improve predictions. Addressing this gap, we introduce three innovative models that integrate shallow attention layers into a foundational model from our previous work, which combined elements of recurrent and convolutional neural networks. Utilizing a well-known public dataset, we showcase our methodology's effectiveness. Temporal attention is applied to identify critical timesteps and highlight differences among test cell batches, particularly underscoring the significance of the "rest" phase. Furthermore, by applying cyclic attention via self-attention to context vectors, our approach effectively identifies key cycles, enabling us to strategically decrease the input size for quicker predictions. Employing both single- and multi-head attention mechanisms, we have systematically minimized the required input from 100 to 50 and then to 30 cycles, refining this process based on cyclic attention scores. Our refined model exhibits strong regression capabilities, accurately forecasting the initiation of rapid capacity fade with an average deviation of only 58 cycles by analyzing just the initial 30 cycles of easily accessible input data.


title: Traffic Sign Interpretation in Real Road Scene

abstract: Most existing traffic sign-related works are dedicated to detecting and recognizing part of traffic signs individually, which fails to analyze the global semantic logic among signs and may convey inaccurate traffic instruction. Following the above issues, we propose a traffic sign interpretation (TSI) task, which aims to interpret global semantic interrelated traffic signs (e.g.,~driving instruction-related texts, symbols, and guide panels) into a natural language for providing accurate instruction support to autonomous or assistant driving. Meanwhile, we design a multi-task learning architecture for TSI, which is responsible for detecting and recognizing various traffic signs and interpreting them into a natural language like a human. Furthermore, the absence of a public TSI available dataset prompts us to build a traffic sign interpretation dataset, namely TSI-CN. The dataset consists of real road scene images, which are captured from the highway and the urban way in China from a driver's perspective. It contains rich location labels of texts, symbols, and guide panels, and the corresponding natural language description labels. Experiments on TSI-CN demonstrate that the TSI task is achievable and the TSI architecture can interpret traffic signs from scenes successfully even if there is a complex semantic logic among signs. The TSI-CN dataset and the source code of the TSI architecture will be publicly available after the revision process.


title: Text-to-Sticker: Style Tailoring Latent Diffusion Models for Human Expression

abstract: We introduce Style Tailoring, a recipe to finetune Latent Diffusion Models (LDMs) in a distinct domain with high visual quality, prompt alignment and scene diversity. We choose sticker image generation as the target domain, as the images significantly differ from photorealistic samples typically generated by large-scale LDMs. We start with a competent text-to-image model, like Emu, and show that relying on prompt engineering with a photorealistic model to generate stickers leads to poor prompt alignment and scene diversity. To overcome these drawbacks, we first finetune Emu on millions of sticker-like images collected using weak supervision to elicit diversity. Next, we curate human-in-the-loop (HITL) Alignment and Style datasets from model generations, and finetune to improve prompt alignment and style alignment respectively. Sequential finetuning on these datasets poses a tradeoff between better style alignment and prompt alignment gains. To address this tradeoff, we propose a novel fine-tuning method called Style Tailoring, which jointly fits the content and style distribution and achieves best tradeoff. Evaluation results show our method improves visual quality by 14%, prompt alignment by 16.2% and scene diversity by 15.3%, compared to prompt engineering the base Emu model for stickers generation.


title: How False Data Affects Machine Learning Models in Electrochemistry?

abstract: Recently, the selection of machine learning model based on only the data distribution without concerning the noise of the data. This study aims to distinguish, which models perform well under noisy data, and establish whether stacking machine learning models actually provide robustness to otherwise weak-to-noise models. The electrochemical data were tested with 12 standalone models and stacking model. This includes XGB, LGBM, RF, GB, ADA, NN, ELAS, LASS, RIDGE, SVM, KNN, DT, and the stacking model. It is found that linear models handle noise well with the average error of (slope) to 1.75 F g-1 up to error per 100% percent noise added; but it suffers from prediction accuracy due to having an average of 60.19 F g-1 estimated at minimal error at 0% noise added. Tree-based models fail in terms of noise handling (average slope is 55.24 F g-1 at 100% percent noise), but it can provide higher prediction accuracy (lowest error of 23.9 F g-1) than that of linear. To address the controversial between prediction accuracy and error handling, the stacking model was constructed, which is not only show high accuracy (intercept of 25.03 F g-1), but it also exhibits good noise handling (slope of 43.58 F g-1), making stacking models a relatively low risk and viable choice for beginner and experienced machine learning research in electrochemistry. Even though neural networks (NN) are gaining popularity in the electrochemistry field. However, this study presents that NN is not suitable for electrochemical data, and improper tuning resulting in a model that is susceptible to noise. Thus, STACK models should provide better benefits in that even with untuned base models, they can achieve an accurate and noise-tolerant model. Overall, this work provides insight into machine learning model selection for electrochemical data, which should aid the understanding of data science in chemistry context.


title: Emotion-Aware Music Recommendation System: Enhancing User Experience Through Real-Time Emotional Context

abstract: This study addresses the deficiency in conventional music recommendation systems by focusing on the vital role of emotions in shaping users music choices. These systems often disregard the emotional context, relying predominantly on past listening behavior and failing to consider the dynamic and evolving nature of users emotional preferences. This gap leads to several limitations. Users may receive recommendations that do not match their current mood, which diminishes the quality of their music experience. Furthermore, without accounting for emotions, the systems might overlook undiscovered or lesser-known songs that have a profound emotional impact on users. To combat these limitations, this research introduces an AI model that incorporates emotional context into the song recommendation process. By accurately detecting users real-time emotions, the model can generate personalized song recommendations that align with the users emotional state. This approach aims to enhance the user experience by offering music that resonates with their current mood, elicits the desired emotions, and creates a more immersive and meaningful listening experience. By considering emotional context in the song recommendation process, the proposed model offers an opportunity for a more personalized and emotionally resonant musical journey.


title: TaCo: Enhancing Cross-Lingual Transfer for Low-Resource Languages in LLMs through Translation-Assisted Chain-of-Thought Processes

abstract: Creating multilingual LLMs poses a significant challenge. Pretraining or fine-tuning LLMs to adopt new languages is evidently very costly. Furthermore, there exist limitations concerning benchmark datasets and the metrics used to measure model performance in multilingual settings. This paper proposes cost-effective solutions to both aforementioned challenges. Firstly, we introduce the Multilingual Instruction-Tuning Dataset (MITS), comprised of Alpaca-52K, Dolly-15K, and Vicuna Benchmark translations into 132 languages. Secondly, we propose a new method called \emph{TaCo: Translation-Assisted Cross-Linguality}, which utilizes translations in a chain-of-thought process to instruction-tune LLMs on new languages through a curriculum-learning process. As a proof of concept, we experimented with the instruction-tuned Guanaco-33B model, performing further instruction tuning using our proposed TaCo method in three low-resource languages and one high-resource language. Our results indicate that the TaCo method impresses GPT-4 with an 82\% score for a low-resource language in the Vicuna Benchmark dataset, doubling the performance in contrast to instruction tuning alone. Furthermore, TaCo shows promise in creating multilingual LLMs, even for low-resource languages. We have released our datasets and model adapters\footnote{https://github.com/UNHSAILLab/TaCo} , encouraging the research community to utilize these resources to advance work on multilingual LLMs.


title: INSPECT: A Multimodal Dataset for Pulmonary Embolism Diagnosis and Prognosis

abstract: Synthesizing information from multiple data sources plays a crucial role in the practice of modern medicine. Current applications of artificial intelligence in medicine often focus on single-modality data due to a lack of publicly available, multimodal medical datasets. To address this limitation, we introduce INSPECT, which contains de-identified longitudinal records from a large cohort of patients at risk for pulmonary embolism (PE), along with ground truth labels for multiple outcomes. INSPECT contains data from 19,402 patients, including CT images, radiology report impression sections, and structured electronic health record (EHR) data (i.e. demographics, diagnoses, procedures, vitals, and medications). Using INSPECT, we develop and release a benchmark for evaluating several baseline modeling approaches on a variety of important PE related tasks. We evaluate image-only, EHR-only, and multimodal fusion models. Trained models and the de-identified dataset are made available for non-commercial use under a data use agreement. To the best of our knowledge, INSPECT is the largest multimodal dataset integrating 3D medical imaging and EHR for reproducible methods evaluation and research.


title: Adaptive Modelling Approach for Row-Type Dependent Predictive Analysis (RTDPA): A Framework for Designing Machine Learning Models for Credit Risk Analysis in Banking Sector

abstract: In many real-world datasets, rows may have distinct characteristics and require different modeling approaches for accurate predictions. In this paper, we propose an adaptive modeling approach for row-type dependent predictive analysis(RTDPA). Our framework enables the development of models that can effectively handle diverse row types within a single dataset. Our dataset from XXX bank contains two different risk categories, personal loan and agriculture loan. each of them are categorised into four classes standard, sub-standard, doubtful and loss. We performed tailored data pre processing and feature engineering to different row types. We selected traditional machine learning predictive models and advanced ensemble techniques. Our findings indicate that all predictive approaches consistently achieve a precision rate of no less than 90%. For RTDPA, the algorithms are applied separately for each row type, allowing the models to capture the specific patterns and characteristics of each row type. This approach enables targeted predictions based on the row type, providing a more accurate and tailored classification for the given dataset.Additionally, the suggested model consistently offers decision makers valuable and enduring insights that are strategic in nature in banking sector.


title: The Next 700 ML-Enabled Compiler Optimizations

abstract: There is a growing interest in enhancing compiler optimizations with ML models, yet interactions between compilers and ML frameworks remain challenging. Some optimizations require tightly coupled models and compiler internals,raising issues with modularity, performance and framework independence. Practical deployment and transparency for the end-user are also important concerns. We propose ML-Compiler-Bridge to enable ML model development within a traditional Python framework while making end-to-end integration with an optimizing compiler possible and efficient. We evaluate it on both research and production use cases, for training and inference, over several optimization problems, multiple compilers and its versions, and gym infrastructures.


title: Reinforcement Learning with Maskable Stock Representation for Portfolio Management in Customizable Stock Pools

abstract: Portfolio management (PM) is a fundamental financial trading task, which explores the optimal periodical reallocation of capitals into different stocks to pursue long-term profits. Reinforcement learning (RL) has recently shown its potential to train profitable agents for PM through interacting with financial markets. However, existing work mostly focuses on fixed stock pools, which is inconsistent with investors' practical demand. Specifically, the target stock pool of different investors varies dramatically due to their discrepancy on market states and individual investors may temporally adjust stocks they desire to trade (e.g., adding one popular stocks), which lead to customizable stock pools (CSPs). Existing RL methods require to retrain RL agents even with a tiny change of the stock pool, which leads to high computational cost and unstable performance. To tackle this challenge, we propose EarnMore, a rEinforcement leARNing framework with Maskable stOck REpresentation to handle PM with CSPs through one-shot training in a global stock pool (GSP). Specifically, we first introduce a mechanism to mask out the representation of the stocks outside the target pool. Second, we learn meaningful stock representations through a self-supervised masking and reconstruction process. Third, a re-weighting mechanism is designed to make the portfolio concentrate on favorable stocks and neglect the stocks outside the target pool. Through extensive experiments on 8 subset stock pools of the US stock market, we demonstrate that EarnMore significantly outperforms 14 state-of-the-art baselines in terms of 6 popular financial metrics with over 40% improvement on profit.


title: Is Conventional SNN Really Efficient? A Perspective from Network Quantization

abstract: Spiking Neural Networks (SNNs) have been widely praised for their high energy efficiency and immense potential. However, comprehensive research that critically contrasts and correlates SNNs with quantized Artificial Neural Networks (ANNs) remains scant, often leading to skewed comparisons lacking fairness towards ANNs. This paper introduces a unified perspective, illustrating that the time steps in SNNs and quantized bit-widths of activation values present analogous representations. Building on this, we present a more pragmatic and rational approach to estimating the energy consumption of SNNs. Diverging from the conventional Synaptic Operations (SynOps), we champion the "Bit Budget" concept. This notion permits an intricate discourse on strategically allocating computational and storage resources between weights, activation values, and temporal steps under stringent hardware constraints. Guided by the Bit Budget paradigm, we discern that pivoting efforts towards spike patterns and weight quantization, rather than temporal attributes, elicits profound implications for model performance. Utilizing the Bit Budget for holistic design consideration of SNNs elevates model performance across diverse data types, encompassing static imagery and neuromorphic datasets. Our revelations bridge the theoretical chasm between SNNs and quantized ANNs and illuminate a pragmatic trajectory for future endeavors in energy-efficient neural computations.


title: Robustness Enhancement in Neural Networks with Alpha-Stable Training Noise

abstract: With the increasing use of deep learning on data collected by non-perfect sensors and in non-perfect environments, the robustness of deep learning systems has become an important issue. A common approach for obtaining robustness to noise has been to train deep learning systems with data augmented with Gaussian noise. In this work, we challenge the common choice of Gaussian noise and explore the possibility of stronger robustness for non-Gaussian impulsive noise, specifically alpha-stable noise. Justified by the Generalized Central Limit Theorem and evidenced by observations in various application areas, alpha-stable noise is widely present in nature. By comparing the testing accuracy of models trained with Gaussian noise and alpha-stable noise on data corrupted by different noise, we find that training with alpha-stable noise is more effective than Gaussian noise, especially when the dataset is corrupted by impulsive noise, thus improving the robustness of the model. The generality of this conclusion is validated through experiments conducted on various deep learning models with image and time series datasets, and other benchmark corrupted datasets. Consequently, we propose a novel data augmentation method that replaces Gaussian noise, which is typically added to the training data, with alpha-stable noise.


title: A Study on Altering the Latent Space of Pretrained Text to Speech Models for Improved Expressiveness

abstract: This report explores the challenge of enhancing expressiveness control in Text-to-Speech (TTS) models by augmenting a frozen pretrained model with a Diffusion Model that is conditioned on joint semantic audio/text embeddings. The paper identifies the challenges encountered when working with a VAE-based TTS model and evaluates different image-to-image methods for altering latent speech features. Our results offer valuable insights into the complexities of adding expressiveness control to TTS systems and open avenues for future research in this direction.


title: Towards a Standardized Reinforcement Learning Framework for AAM Contingency Management

abstract: Advanced Air Mobility (AAM) is the next generation of air transportation that includes new entrants such as electric vertical takeoff and landing (eVTOL) aircraft, increasingly autonomous flight operations, and small UAS package delivery. With these new vehicles and operational concepts comes a desire to increase densities far beyond what occurs today in and around urban areas, to utilize new battery technology, and to move toward more autonomously-piloted aircraft. To achieve these goals, it becomes essential to introduce new safety management system capabilities that can rapidly assess risk as it evolves across a span of complex hazards and, if necessary, mitigate risk by executing appropriate contingencies via supervised or automated decision-making during flights. Recently, reinforcement learning has shown promise for real-time decision making across a wide variety of applications including contingency management. In this work, we formulate the contingency management problem as a Markov Decision Process (MDP) and integrate the contingency management MDP into the AAM-Gym simulation framework. This enables rapid prototyping of reinforcement learning algorithms and evaluation of existing systems, thus providing a community benchmark for future algorithm development. We report baseline statistical information for the environment and provide example performance metrics.


title: SEA++: Multi-Graph-based High-Order Sensor Alignment for Multivariate Time-Series Unsupervised Domain Adaptation

abstract: Unsupervised Domain Adaptation (UDA) methods have been successful in reducing label dependency by minimizing the domain discrepancy between a labeled source domain and an unlabeled target domain. However, these methods face challenges when dealing with Multivariate Time-Series (MTS) data. MTS data typically consist of multiple sensors, each with its own unique distribution. This characteristic makes it hard to adapt existing UDA methods, which mainly focus on aligning global features while overlooking the distribution discrepancies at the sensor level, to reduce domain discrepancies for MTS data. To address this issue, a practical domain adaptation scenario is formulated as Multivariate Time-Series Unsupervised Domain Adaptation (MTS-UDA). In this paper, we propose SEnsor Alignment (SEA) for MTS-UDA, aiming to reduce domain discrepancy at both the local and global sensor levels. At the local sensor level, we design endo-feature alignment, which aligns sensor features and their correlations across domains. To reduce domain discrepancy at the global sensor level, we design exo-feature alignment that enforces restrictions on global sensor features. We further extend SEA to SEA++ by enhancing the endo-feature alignment. Particularly, we incorporate multi-graph-based high-order alignment for both sensor features and their correlations. Extensive empirical results have demonstrated the state-of-the-art performance of our SEA and SEA++ on public MTS datasets for MTS-UDA.


title: SENetV2: Aggregated dense layer for channelwise and global representations

abstract: Convolutional Neural Networks (CNNs) have revolutionized image classification by extracting spatial features and enabling state-of-the-art accuracy in vision-based tasks. The squeeze and excitation network proposed module gathers channelwise representations of the input. Multilayer perceptrons (MLP) learn global representation from the data and in most image classification models used to learn extracted features of the image. In this paper, we introduce a novel aggregated multilayer perceptron, a multi-branch dense layer, within the Squeeze excitation residual module designed to surpass the performance of existing architectures. Our approach leverages a combination of squeeze excitation network module with dense layers. This fusion enhances the network's ability to capture channel-wise patterns and have global knowledge, leading to a better feature representation. This proposed model has a negligible increase in parameters when compared to SENet. We conduct extensive experiments on benchmark datasets to validate the model and compare them with established architectures. Experimental results demonstrate a remarkable increase in the classification accuracy of the proposed model.


title: Multiparameter Persistent Homology for Molecular Property Prediction

abstract: In this study, we present a novel molecular fingerprint generation method based on multiparameter persistent homology. This approach reveals the latent structures and relationships within molecular geometry, and detects topological features that exhibit persistence across multiple scales along multiple parameters, such as atomic mass, partial charge, and bond type, and can be further enhanced by incorporating additional parameters like ionization energy, electron affinity, chirality and orbital hybridization. The proposed fingerprinting method provides fresh perspectives on molecular structure that are not easily discernible from single-parameter or single-scale analysis. Besides, in comparison with traditional graph neural networks, multiparameter persistent homology has the advantage of providing a more comprehensive and interpretable characterization of the topology of the molecular data. We have established theoretical stability guarantees for multiparameter persistent homology, and have conducted extensive experiments on the Lipophilicity, FreeSolv, and ESOL datasets to demonstrate its effectiveness in predicting molecular properties.


title: Extracting periodontitis diagnosis in clinical notes with RoBERTa and regular expression

abstract: This study aimed to utilize text processing and natural language processing (NLP) models to mine clinical notes for the diagnosis of periodontitis and to evaluate the performance of a named entity recognition (NER) model on different regular expression (RE) methods. Two complexity levels of RE methods were used to extract and generate the training data. The SpaCy package and RoBERTa transformer models were used to build the NER model and evaluate its performance with the manual-labeled gold standards. The comparison of the RE methods with the gold standard showed that as the complexity increased in the RE algorithms, the F1 score increased from 0.3-0.4 to around 0.9. The NER models demonstrated excellent predictions, with the simple RE method showing 0.84-0.92 in the evaluation metrics, and the advanced and combined RE method demonstrating 0.95-0.99 in the evaluation. This study provided an example of the benefit of combining NER methods and NLP models in extracting target information from free-text to structured data and fulfilling the need for missing diagnoses from unstructured notes.


title: Use GPT-J Prompt Generation with RoBERTa for NER Models on Diagnosis Extraction of Periodontal Diagnosis from Electronic Dental Records

abstract: This study explored the usability of prompt generation on named entity recognition (NER) tasks and the performance in different settings of the prompt. The prompt generation by GPT-J models was utilized to directly test the gold standard as well as to generate the seed and further fed to the RoBERTa model with the spaCy package. In the direct test, a lower ratio of negative examples with higher numbers of examples in prompt achieved the best results with a F1 score of 0.72. The performance revealed consistency, 0.92-0.97 in the F1 score, in all settings after training with the RoBERTa model. The study highlighted the importance of seed quality rather than quantity in feeding NER models. This research reports on an efficient and accurate way to mine clinical notes for periodontal diagnoses, allowing researchers to easily and quickly build a NER model with the prompt generation approach.


title: A novel post-hoc explanation comparison metric and applications

abstract: Explanatory systems make the behavior of machine learning models more transparent, but are often inconsistent. To quantify the differences between explanatory systems, this paper presents the Shreyan Distance, a novel metric based on the weighted difference between ranked feature importance lists produced by such systems. This paper uses the Shreyan Distance to compare two explanatory systems, SHAP and LIME, for both regression and classification learning tasks. Because we find that the average Shreyan Distance varies significantly between these two tasks, we conclude that consistency between explainers not only depends on inherent properties of the explainers themselves, but also the type of learning task. This paper further contributes the XAISuite library, which integrates the Shreyan distance algorithm into machine learning pipelines.


title: SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos

abstract: We propose SplatArmor, a novel approach for recovering detailed and animatable human models by `armoring' a parameterized body model with 3D Gaussians. Our approach represents the human as a set of 3D Gaussians within a canonical space, whose articulation is defined by extending the skinning of the underlying SMPL geometry to arbitrary locations in the canonical space. To account for pose-dependent effects, we introduce a SE(3) field, which allows us to capture both the location and anisotropy of the Gaussians. Furthermore, we propose the use of a neural color field to provide color regularization and 3D supervision for the precise positioning of these Gaussians. We show that Gaussian splatting provides an interesting alternative to neural rendering based methods by leverging a rasterization primitive without facing any of the non-differentiability and optimization challenges typically faced in such approaches. The rasterization paradigms allows us to leverage forward skinning, and does not suffer from the ambiguities associated with inverse skinning and warping. We show compelling results on the ZJU MoCap and People Snapshot datasets, which underscore the effectiveness of our method for controllable human synthesis.


title: A Language Agent for Autonomous Driving

abstract: Human-level driving is an ultimate goal of autonomous driving. Conventional approaches formulate autonomous driving as a perception-prediction-planning framework, yet their systems do not capitalize on the inherent reasoning ability and experiential knowledge of humans. In this paper, we propose a fundamental paradigm shift from current pipelines, exploiting Large Language Models (LLMs) as a cognitive agent to integrate human-like intelligence into autonomous driving systems. Our approach, termed Agent-Driver, transforms the traditional autonomous driving pipeline by introducing a versatile tool library accessible via function calls, a cognitive memory of common sense and experiential knowledge for decision-making, and a reasoning engine capable of chain-of-thought reasoning, task planning, motion planning, and self-reflection. Powered by LLMs, our Agent-Driver is endowed with intuitive common sense and robust reasoning capabilities, thus enabling a more nuanced, human-like approach to autonomous driving. We evaluate our approach on the large-scale nuScenes benchmark, and extensive experiments substantiate that our Agent-Driver significantly outperforms the state-of-the-art driving methods by a large margin. Our approach also demonstrates superior interpretability and few-shot learning ability to these methods. Code will be released.


title: Coulomb Branch Amplitudes from a Deformed Amplituhedron Geometry

abstract: The Amplituhedron provides, via geometric means, the all-loop integrand of scattering amplitudes in maximally supersymmetric Yang-Mills theory. Unfortunately, dimensional regularization, used conventionally for integration, breaks the beautiful geometric picture. This motivates us to propose a 'deformed' Amplituhedron. Focusing on the four-particle amplitude, we introduce two deformation parameters, which can be interpreted as particle masses. We provide evidence that the mass pattern corresponds to a specific choice of vacuum expectation values on the Coulomb branch. The deformed amplitude is infrared finite, making the answer well-defined in four dimensions. Leveraging four-dimensional integration techniques based on differential equations, we compute the amplitude up to two loops. In the limit where the deformation parameters are taken to zero, we recover the known Bern-Dixon-Smirnov amplitude. In the limit where only one deformation parameter is taken to zero, we find a connection to the angle-dependent cusp anomalous dimension.


title: A Fast Radio Burst in a Compact Galaxy Group at $z$~1

abstract: FRB 20220610A is a high-redshift Fast Radio Burst (FRB) that has not been observed to repeat. Here, we present rest-frame UV and optical $\textit{Hubble Space Telescope}$ observations of the field of FRB 20220610A. The imaging reveals seven extended sources, one of which we identify as the most likely host galaxy with a spectroscopic redshift of $z$=1.017. We spectroscopically confirm at least three additional sources to be at the same redshift, and identify the system as a compact galaxy group with possible signs of interaction among group members. We determine the host of FRB 20220610A to be a star-forming galaxy with stellar mass of $\approx10^{9.7}\,M_{\odot}$, mass-weighted age of $\approx2.6$~Gyr, and star formation rate (integrated over the last 100 Myr) of $\approx1.7$~M$_{\odot}$~yr$^{-1}$. These host properties are commensurate with the star-forming field galaxy population at z~1 and trace their properties analogously to the population of low-$z$ FRB hosts. Based on estimates of the total stellar mass of the galaxy group, we calculate a fiducial contribution to the observed Dispersion Measure (DM) from the intragroup medium of $\approx 110-220$ $\rm pc \, cm^{-3}$ (rest-frame). This leaves a significant excess of $500^{+272}_{-109}$ $\rm pc \, cm^{-3}$ (in the observer frame), with additional sources of DM possibly originating from the circumburst environment, host galaxy interstellar medium, and/or foreground structures along the line of sight. Given the low occurrence rates of galaxies in compact groups, the discovery of an FRB in such a group demonstrates a rare and novel environment in which FRBs can occur.


title: Probing the tunable multi-cone bandstructure in Bernal bilayer graphene

abstract: Controlling the bandstructure of Dirac materials is of wide interest in current research but has remained an outstanding challenge for systems such as monolayer graphene. In contrast, Bernal bilayer graphene (BLG) offers a highly flexible platform for tuning the bandstructure, featuring two distinct regimes. In one regime, which is well established and widely used, a tunable bandgap is induced by a large enough transverse displacement field. Another is a gapless metallic band occurring near charge neutrality and at not too strong fields, featuring rich 'fine structure' consisting of four linearly-dispersing Dirac cones with opposite chiralities in each valley and van Hove singularities. Even though BLG was extensively studied experimentally in the last two decades, the evidence of this exotic bandstructure is still elusive, likely due to insufficient energy resolution. Here, rather than probing the bandstructure by direct spectroscopy, we use Landau levels as markers of the energy dispersion and carefully analyze the Landau level spectrum in a regime where the cyclotron orbits of electrons or holes in momentum space are small enough to resolve the distinct mini Dirac cones. We identify the presence of four distinct Dirac cones and map out complex topological transitions induced by electric displacement field. These findings introduce a valuable addition to the toolkit for graphene electronics.


title: Small Kinetic Mixing in String Theory

abstract: Kinetic mixing between gauge fields of different $U(1)$ factors is a well-studied phenomenon in 4d EFT. In string compactifications with $U(1)$s from sequestered D-brane sectors, kinetic mixing becomes a key target for the UV prediction of a phenomenologically important EFT operator. Surprisingly, in many cases kinetic mixing is absent due to a non-trivial cancellation. In particular, D3-D3 kinetic mixing in type-IIB vanishes while D3-anti-D3 mixing does not. This follows both from exact CFT calculations on tori as well as from a leading-order 10d supergravity analysis, where the key cancellation is between the $C_2$ and $B_2$ contribution. We take the latter approach, which is the only one available in realistic Calabi-Yau settings, to a higher level of precision by including sub-leading terms of the brane action and allowing for non-vanishing $C_0$. The exact cancellation persists, which we argue to be the result of $SL(2,\mathbb{R})$ self-duality. We note that a $B_2C_2$ term on the D3-brane, which is often missing in the recent literature, is essential to obtain the correct zero result. Finally, allowing for $SL(2,\mathbb{R})$-breaking fluxes, kinetic mixing between D3-branes arises at a volume-suppressed level. We provide basic explicit formulae, both for kinetic as well as magnetic mixing, leaving the study of phenomenologically relevant, more complex situations for the future. We also note that describing our result in 4d supergravity appears to require higher-derivative terms - an issue which deserves further study.


title: Fractional Hall physics from large $N$ interacting fermions

abstract: We solve models of $N$ species of fermions in the lowest Landau level with $U(N)$-invariant interactions in the $N\gg 1$ limit. We find saddles of the second quantized path integral at fixed chemical potential corresponding to fractional Hall states with filling $ \frac{p}{q}$ where the integers $p$ and $q$ depend on the chemical potential and interactions. On a long torus there are $q$ such states related by translation symmetry, and $SU(N)$-invariant excitations of fractional charge. Remarkably, these saddles and their filling persist as extrema of the second-quantized action at $N=1$. Our construction gives a first-principles derivation of fractional Hall states from strongly interacting fermions.


title: Eigenstate entanglement entropy in the integrable spin-$\frac{1}{2}$ XYZ model

abstract: We study the average and the standard deviation of the entanglement entropy of highly excited eigenstates of the integrable interacting spin-$\frac{1}{2}$ XYZ chain away from and at special lines with $U(1)$ symmetry and supersymmetry. We universally find that the average eigenstate entanglement entropy exhibits a volume-law coefficient that is smaller than that of quantum-chaotic interacting models. At the supersymmetric point, we resolve the effect that degeneracies have on the computed averages. We further find that the normalized standard deviation of the eigenstate entanglement entropy decays polynomially with increasing system size, which we contrast to the exponential decay in quantum-chaotic interacting models. Our results provide state-of-the art numerical evidence that integrability in spin-$\frac{1}{2}$ chains reduces the average, and increases the standard deviation, of the entanglement entropy of highly excited energy eigenstates when compared to those in quantum-chaotic interacting models.


title: Simulating X-ray Reverberation in the UV-Emitting Regions of Active Galactic Nuclei Accretion Disks with 3D Multi-Frequency Magnetohydrodynamic Simulations

abstract: Active galactic nuclei (AGN) light curves observed with different wavebands show that the variability in longer wavelength bands lags the variability in shorter wavelength bands. Measuring these lags, or reverberation mapping, is used to measure the radial temperature profile and extent of AGN disks, typically with a reprocessing model that assumes X-rays are the main driver of the variability in other wavelength bands. To demonstrate how this reprocessing works with realistic accretion disk structures, we use 3D local shearing box multi-frequency radiation magnetohydrodynamic (MHD) simulations to model the UV-emitting region of an AGN disk, which is unstable to the magnetorotational instability (MRI) and convection. At the same time, we inject hard X-rays ($>1$~keV) into the simulation box to study the effects of X-ray irradiation on the local properties of the turbulence and the resulting variability of the emitted UV light curve. We find that disk turbulence is sufficient to drive intrinsic variability in emitted UV light curves and that a damped random walk (DRW) model is a good fit to this UV light curve for timescales $>5$~days. Meanwhile, the injected X-rays have almost no impact on the power spectrum of the emitted UV light curve. In addition, the injected X-ray and emitted UV light curves are only correlated if there is X-ray variability on timescales $>1$~day, in which case we find a correlation coefficient $r=0.52$. These results suggest that hard X-rays with scattering dominated opacity are likely not the main driver of the reverberation signals.


title: Analytical and numerical validation of a plate-plate tribometer for measuring wall slip

abstract: We model the Darmstadt Slip Length Tribometer (DSLT), specially designed to measure viscosity and slip length simultaneously for lubrication gaps in the range of approximately 10 micrometres at relevant temperatures and surface roughness. We investigate the inlet effect of the flow on the results by varying the inner radius of the fluid inlet pipe. The outcomes of numerical simulations suggest that variations in the diameter of this inner radius have minimal impact on the results. Specifically, any alterations in the velocity profile near the inlet, brought about by changes in the diameter, quickly revert to the profile predicted by the analytical model. The main conclusion drawn from this study is the validation of the Navier-Slip boundary condition as an effective model for technical surface roughness in CFD simulations and the negligible influence of the inlet effect on the fluid dynamics between the tribometer's plates.


title: Gradients and frequency profiles of quantum re-uploading models

abstract: Quantum re-uploading models have been extensively investigated as a form of machine learning within the context of variational quantum algorithms. Their trainability and expressivity are not yet fully understood and are critical to their performance. In this work, we address trainability through the lens of the magnitude of the gradients of the cost function. We prove bounds for the differences between gradients of the better-studied data-less parameterized quantum circuits and re-uploading models. We coin the concept of {\sl absorption witness} to quantify such difference. For the expressivity, we prove that quantum re-uploading models output functions with vanishing high-frequency components and upper-bounded derivatives with respect to data. As a consequence, such functions present limited sensitivity to fine details, which protects against overfitting. We performed numerical experiments extending the theoretical results to more relaxed and realistic conditions. Overall, future designs of quantum re-uploading models will benefit from the strengthened knowledge delivered by the uncovering of absorption witnesses and vanishing high frequencies.


title: High precision accelerator for our hybrid model of the redshift space power spectrum

abstract: Upcoming Large Scale Structure surveys aim to achieve an unprecedented level of precision in measuring galaxy clustering. However, accurately modeling these statistics may require theoretical templates that go beyond second-order perturbation theory, especially for achieving precision at smaller scales. In our previous work, we introduced a hybrid model for the redshift space power spectrum of galaxies. This model combines second-order templates with N-body simulations to capture the influence of scale-independent parameters on the galaxy power spectrum. However, the impact of scale-dependent parameters was addressed by precomputing a set of input statistics derived from computationally expensive N-body simulations. As a result, exploring the scale-dependent parameter space was not feasible in this approach. To address this challenge, we present an accelerated methodology that utilizes Gaussian processes, a machine learning technique, to emulate these input statistics. Our emulators exhibit remarkable accuracy, achieving reliable results with just 13 N-body simulations for training. We reproduce all necessary input statistics for a set of test simulations with an error of approximately 0.1 per cent in the parameter space within $5\sigma$ of the Planck predictions, specifically for scales around $k > 0.1$ $h$Mpc$^{-1}$. Following the training of our emulators, we can predict all inputs for our hybrid model in approximately 0.2,seconds at a specified redshift. Given that performing 13 N-body simulations is a manageable task, our present methodology enables us to construct efficient and highly accurate models of the galaxy power spectra within a manageable time frame.


title: Breakdown of steady-state superradiance in extended driven atomic arrays

abstract: Recent advances in generating well controlled dense arrangements of individual atoms in free space have generated interest in understanding how the extended nature of these systems influences superradiance phenomena. Here, we provide an in-depth analysis on how space-dependent light-shifts and decay rates induced by dipole-dipole interactions modify the steady-state properties of coherently driven arrays of quantum emitters. We characterize the steady-state phase diagram, with particular focus on the radiative properties in the steady-state. Interestingly, we find that diverging from the well-established Dicke paradigm of equal all-to-all interactions significantly modifies the emission properties. In particular, the prominent quadratic scaling of the radiated light intensity with particle number in the steady-state -- a hallmark of steady-state Dicke superradiance -- is entirely suppressed, resulting in only linear scaling with particle number. We show that this breakdown of steady-state superradiance occurs due to the emergence of additional dissipation channels that populate not only superradiant states but also subradiant ones. The additional contribution of subradiant dark states in the dynamics leads to a divergence in the time scales needed to achieve steady-states. Building on this, we further show that measurements taken at finite times for extended atom ensembles reveal properties closely mirroring the idealized Dicke scenario.


title: Pudding: Private User Discovery in Anonymity Networks

abstract: Anonymity networks allow messaging with metadata privacy, providing better privacy than popular encrypted messaging applications. However, contacting a user on an anonymity network currently requires knowing their public key or similar high-entropy information, as these systems lack a privacy-preserving mechanism for contacting a user via a short, human-readable username. Previous research suggests that this is a barrier to widespread adoption. In this paper we propose Pudding, a novel private user discovery protocol that allows a user to be contacted on an anonymity network knowing only their email address. Our protocol hides contact relationships between users, prevents impersonation, and conceals which usernames are registered on the network. Pudding is Byzantine fault tolerant, remaining available and secure as long as less than one third of servers are crashed, unavailable, or malicious. It can be deployed on Loopix and Nym without changes to the underlying anonymity network protocol, and it supports mobile devices with intermittent network connectivity. We demonstrate the practicality of Pudding with a prototype using the Nym anonymity network. We also formally define the security and privacy goals of our protocol and conduct a thorough analysis to assess its compliance with these definitions.


title: A new star formation recipe for magneto-hydrodynamics simulations of galaxy formation

abstract: Star formation has been observed to occur at globally low yet locally varying efficiencies. As such, accurate capture of star formation in numerical simulations requires mechanisms that can replicate both its smaller-scale variations and larger-scale properties. Magnetic fields are thought to play an essential role within the turbulent interstellar medium (ISM) and affect molecular cloud collapse. However, it remains to be fully explored how a magnetised model of star formation might influence galaxy evolution. We present a new model for a sub-grid star formation recipe that depends on the magnetic field. We run isolated disk galaxy simulations to assess its impact on the regulation of star formation using the code RAMSES. Building upon existing numerical methods, our model derives the star formation efficiency from local properties of the sub-grid magnetised ISM turbulence, assuming a constant Alfv\'en speed at sub-parsec scales. Compared to its non-magnetised counterpart, our star formation model suppresses the initial starburst by a factor of two, while regulating star formation later on to a nearly constant rate of $\sim 1~M_{\odot}~\mathrm{yr}^{-1}$. Differences also arise in the local Schmidt law with a shallower power law index for the magnetised star formation model. Our results encourage further examination into the notion that magnetic fields are likely to play a non-trivial role in our understanding of star and galaxy formation.


title: A well-balanced lattice Boltzmann model for binary fluids based on the incompressible phase-field theory

abstract: Spurious velocities arising from the imperfect offset of the undesired term at the discrete level are frequently observed in numerical simulations of equilibrium multiphase flow systems using the lattice Boltzmann equation (LBE) method. To capture the physical equilibrium state of two-phase fluid systems and eliminate spurious velocities, a well-balanced LBE model based on the incompressible phase-field theory is developed. In this model, the equilibrium distribution function for the Cahn-Hilliard (CH) equation is designed by treating the convection term as a source to avoid the introduction of undesired terms, enabling achievement of possible discrete force balance. Furthermore, this approach allows for the attainment of a divergence-free velocity field, effectively mitigating the impact of artificial compression effects and enhancing numerical stability. Numerical tests, including a flat interface problem, a stationary droplet, and the coalescence of two droplets, demonstrate the well-balanced properties and improvements in the stability of the present model.


title: Connecting flux vacua through scalar field excursions

abstract: We show how flux vacua that differ from each other in flux quanta can be seen as different vacua in a single scalar potential of an enlarged field space, which resolves the separation by thin domain walls. This observation, which is motivated by the AdS Distance Conjecture, allows one to compute distances between different vacua using the usual field space metric. We verify for explicit examples such as scale-seperated IIA flux vacua and the IIB Freund-Rubin vacua that the Distance Conjecture (for scalar fields) is satisfied and that the asymptotic directions in the enlarged field space are indeed hyperbolic. This enlarged field space contains the tachyon fields on the unstable $\tilde{\mathrm{D}}p$-branes of type II string theory, which can induce the brane charges of the stable D-branes. We suggest that requiring continuous interpolations refines the Cobordism Conjecture and postdicts the existence of unstable $\tilde{\mathrm{D}}p$-branes.


title: New $\mu$ Forces From $\nu_\mu$ Sources

abstract: Accelerator-based experiments reliant on charged pion and kaon decays to produce muon-neutrino beams also deliver an associated powerful flux of muons. Therefore, these experiments can additionally be sensitive to light new particles that preferentially couple to muons and decay to visible final states on macroscopic length scales. Such particles are produced through rare 3-body meson decays in the decay pipe or via muon scattering in the beam dump, and decay in a downstream detector. To demonstrate the potential of this search strategy, we recast existing MiniBooNE and MicroBooNE studies of neutral pion production in neutrino-induced neutral-current scattering ($\nu_\mu N \to \nu_\mu N \pi^0,~\pi^0\rightarrow \gamma\gamma$) to place new leading limits on light ($< 2m_\mu$) muon-philic scalar particles that decay to diphotons through loops of virtual muons. Our results exclude scalars of mass between 10 and 60 MeV in which this scenario resolves the muon $g-2$ anomaly. We also make projections for the sensitivity of SBND to these models and provide a road map for future neutrino experiments to perform dedicated searches for muon-philic forces.


title: Sensitivity of one-neutron knockout observables of loosely- to more deeply-bound nuclei

abstract: For the last few decades, one-nucleon knockout reactions on light composite targets -- $^9$Be or $^{12}$C -- have been extensively used to study the single-particle (s.p.) structure of nuclei far from stability. To determine which information can be accurately inferred from knockout cross sections, we conduct a sensitivity analysis of these observables considering various s.p. descriptions within the usual eikonal description of the reaction. This work shows that total one-neutron knockout cross sections are not sensitive to the short-range part of the s.p. wave function. Rather, they scale with the mean square radius of the overlap function. Using a perturbative expression of the cross section, we can easily explain our numerical predictions analytically. This analysis suggests that (i) spectroscopic factors extracted from knockout data suffer from sizeable model uncertainties associated with the choice of s.p. wave functions and (ii) knockout reactions constitute an excellent probe of the radius of the nucleus and therefore offer an alternative technique to infer the neutron-skin thickness of exotic nuclei.


title: Religious Competition, Culture and Domestic Violence: Evidence from Colombia

abstract: This paper studies how religious competition, as measured by the emergence of religious organizations with innovative worship styles and cultural practices, impacts domestic violence. Using data from Colombia, the study estimates a two-way fixed-effects model and reveals that the establishment of the first non-Catholic church in a predominantly Catholic municipality leads to a significant decrease in reported cases of domestic violence. This effect persists in the long run, indicating that religious competition introduces values and practices that discourage domestic violence, such as household stability and reduced male dominance. Additionally, the effect is more pronounced in municipalities with less clustered social networks, suggesting the diffusion of these values and practices through social connections. This research contributes to the understanding of how culture influences domestic violence, emphasizing the role of religious competition as a catalyst for cultural change.


title: Exploring Machine Learning Models for Federated Learning: A Review of Approaches, Performance, and Limitations

abstract: In the growing world of artificial intelligence, federated learning is a distributed learning framework enhanced to preserve the privacy of individuals' data. Federated learning lays the groundwork for collaborative research in areas where the data is sensitive. Federated learning has several implications for real-world problems. In times of crisis, when real-time decision-making is critical, federated learning allows multiple entities to work collectively without sharing sensitive data. This distributed approach enables us to leverage information from multiple sources and gain more diverse insights. This paper is a systematic review of the literature on privacy-preserving machine learning in the last few years based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Specifically, we have presented an extensive review of supervised/unsupervised machine learning algorithms, ensemble methods, meta-heuristic approaches, blockchain technology, and reinforcement learning used in the framework of federated learning, in addition to an overview of federated learning applications. This paper reviews the literature on the components of federated learning and its applications in the last few years. The main purpose of this work is to provide researchers and practitioners with a comprehensive overview of federated learning from the machine learning point of view. A discussion of some open problems and future research directions in federated learning is also provided.


title: Generative AI has lowered the barriers to computational social sciences

abstract: Generative artificial intelligence (AI) has revolutionized the field of computational social science, unleashing new possibilities for analyzing multimodal data, especially for scholars who may not have extensive programming expertise. This breakthrough carries profound implications for the realm of social sciences. Firstly, generative AI can significantly enhance the productivity of social scientists by automating the generation, annotation, and debugging of code. Secondly, it empowers researchers to delve into sophisticated data analysis through the innovative use of prompt engineering. Lastly, the educational sphere of computational social science stands to benefit immensely from these tools, given their exceptional ability to annotate and elucidate complex codes for learners, thereby simplifying the learning process and making the technology more accessible.


title: The Otbot project: Dynamic modelling, parameter identification, and motion control of an omnidirectional tire-wheeled robot

abstract: In recent years, autonomous mobile platforms are finding an increasing range of applications in inspection or surveillance tasks, or to the transport of objects, in places such as smart warehouses, factories or hospitals. In these environments it is useful for the robot to have omnidirectional capability in the plane, so it can navigate through narrow or cluttered areas, or make position and orientation changes without having to maneuver. While this capability is usually achieved with directional sliding wheels, this work studies a particular robot that achieves omnidirectionality using conventional wheels, which are easier to manufacture and maintain, and support larger loads in general. This robot, which we call ``Otbot'' (for omnidirectional tire-wheeled robot), was already conceived in the late 1990s, but all the controllers that have been proposed for it are based on purely kinematic models so far. These controllers may be sufficient if the robot is light, or if its motors are powerful, but on platforms that have to carry large loads, or that have more limited motors, it is necessary to resort to control laws based on dynamic models if the full acceleration capacities are to be exploited. This work develops a dynamic model of Otbot, proposes a plausible methodology to identify its parameters, and designs a control law that, using this model, is able to track prescribed trajectories in an accurate and robust manner.


title: Accelerating L-shaped Two-stage Stochastic SCUC with Learning Integrated Benders Decomposition

abstract: Benders decomposition is widely used to solve large mixed-integer problems. This paper takes advantage of machine learning and proposes enhanced variants of Benders decomposition for solving two-stage stochastic security-constrained unit commitment (SCUC). The problem is decomposed into a master problem and subproblems corresponding to a load scenario. The goal is to reduce the computational costs and memory usage of Benders decomposition by creating tighter cuts and reducing the size of the master problem. Three approaches are proposed, namely regression Benders, classification Benders, and regression-classification Benders. A regressor reads load profile scenarios and predicts subproblem objective function proxy variables to form tighter cuts for the master problem. A criterion is defined to measure the level of usefulness of cuts with respect to their contribution to lower bound improvement. Useful cuts that contain the necessary information to form the feasible region are identified with and without a classification learner. Useful cuts are iteratively added to the master problem, and non-useful cuts are discarded to reduce the computational burden of each Benders iteration. Simulation studies on multiple test systems show the effectiveness of the proposed learning-aided Benders decomposition for solving two-stage SCUC as compared to conventional multi-cut Benders decomposition.


title: A high-intensity laser-based positron source

abstract: Plasma based acceleration is considered a promising concept for the next generation of linear electron-positron colliders. Despite the great progress achieved over last twenty years in laser technology, laser and beam driven particle acceleration, and special target availability, positron acceleration remains significantly underdeveloped if compared to electron acceleration. This is due to both the specifics of the plasma-based acceleration, and the lack of adequate positron sources tailored for the subsequent plasma based acceleration. Here a positron source based on the collision of a high energy electron beam with a high intensity laser pulse is proposed. The source relies on the subsequent multi-photon Compton and Breit-Wheeleer processes to generate an electron-positron pair out of a high energy photon emitted by an electron. Due to the strong dependence of the Breit-Wheeler process rate on photon energy and field strength, positrons are created with low divergence in a small volume around the peak of the laser pulse. The resulting low emittance in the submicron range potentially makes such positron source interesting for collider applications.