title: Improved Quantization Strategies for Managing Heavy-tailed Gradients in Distributed Learning

abstract: Gradient compression has surfaced as a key technique to address the challenge of communication efficiency in distributed learning. In distributed deep learning, however, it is observed that gradient distributions are heavy-tailed, with outliers significantly influencing the design of compression strategies. Existing parameter quantization methods experience performance degradation when this heavy-tailed feature is ignored. In this paper, we introduce a novel compression scheme specifically engineered for heavy-tailed gradients, which effectively combines gradient truncation with quantization. This scheme is adeptly implemented within a communication-limited distributed Stochastic Gradient Descent (SGD) framework. We consider a general family of heavy-tail gradients that follow a power-law distribution, we aim to minimize the error resulting from quantization, thereby determining optimal values for two critical parameters: the truncation threshold and the quantization density. We provide a theoretical analysis on the convergence error bound under both uniform and non-uniform quantization scenarios. Comparative experiments with other benchmarks demonstrate the effectiveness of our proposed method in managing the heavy-tailed gradients in a distributed learning environment.


title: Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward

abstract: Despite the impressive performance of LLMs, their widespread adoption faces challenges due to substantial computational and memory requirements during inference. Recent advancements in model compression and system-level optimization methods aim to enhance LLM inference. This survey offers an overview of these methods, emphasizing recent developments. Through experiments on LLaMA(/2)-7B, we evaluate various compression techniques, providing practical insights for efficient LLM deployment in a unified setting. The empirical analysis on LLaMA(/2)-7B highlights the effectiveness of these methods. Drawing from survey insights, we identify current limitations and discuss potential future directions to improve LLM inference efficiency. We release the codebase to reproduce the results presented in this paper at https://github.com/nyunAI/Faster-LLM-Survey


title: An Algebraic Non-Equilibrium Turbulence Model of the High Reynolds Number Transition Region

abstract: We present a mixing length-based algebraic turbulence model calibrated to pipe flow; the main purpose of the model is to capture the increasing turbulence production-to-dissipation ratio observed in connection with the high Reynolds number transition region. The model includes the mixing length description by Gersten and Herwig, which takes the observed variation of the von K\'arm\'an number with Reynolds number into account. Pipe wall roughness effects are included in the model. Results are presented for area-averaged (integral) quantities, which can be used both as a self-contained model and as initial inlet boundary conditions for computational fluid dynamics simulations.


title: Large Language Models for Time Series: A Survey

abstract: Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data, benefiting domains such as climate, IoT, healthcare, traffic, audio and finance. This survey paper provides an in-depth exploration and a detailed taxonomy of the various methodologies employed to harness the power of LLMs for time series analysis. We address the inherent challenge of bridging the gap between LLMs' original text data training and the numerical nature of time series data, and explore strategies for transferring and distilling knowledge from LLMs to numerical time series analysis. We detail various methodologies, including (1) direct prompting of LLMs, (2) time series quantization, (3) aligning techniques, (4) utilization of the vision modality as a bridging mechanism, and (5) the combination of LLMs with tools. Additionally, this survey offers a comprehensive overview of the existing multimodal time series and text datasets and delves into the challenges and future opportunities of this emerging field. We maintain an up-to-date Github repository which includes all the papers and datasets discussed in the survey.


title: An Auction-based Marketplace for Model Trading in Federated Learning

abstract: Federated learning (FL) is increasingly recognized for its efficacy in training models using locally distributed data. However, the proper valuation of shared data in this collaborative process remains insufficiently addressed. In this work, we frame FL as a marketplace of models, where clients act as both buyers and sellers, engaging in model trading. This FL market allows clients to gain monetary reward by selling their own models and improve local model performance through the purchase of others' models. We propose an auction-based solution to ensure proper pricing based on performance gain. Incentive mechanisms are designed to encourage clients to truthfully reveal their model valuations. Furthermore, we introduce a reinforcement learning (RL) framework for marketing operations, aiming to achieve maximum trading volumes under the dynamic and evolving market status. Experimental results on four datasets demonstrate that the proposed FL market can achieve high trading revenue and fair downstream task accuracy.


title: Dynamic programming for the stochastic matching model on general graphs: the case of the `N-graph'

abstract: In this paper, we address the optimal control of stochastic matching models on general graphs and single arrivals having fixed arrival rates, as introduced in \cite{MaiMoy16}. On the `N-shaped' graph, by following the dynamic programming approach of \cite{BCD19}, we show that a `Threshold'-type policy on the diagonal edge, with priority to the extreme edges, is optimal for the discounted cost problem and linear holding costs.


title: Analysis of Internet of Things Implementation Barriers in the Cold Supply Chain: An Integrated ISM-MICMAC and DEMATEL Approach

abstract: Integrating Internet of Things (IoT) technology inside the cold supply chain can enhance transparency, efficiency, and quality, optimizing operating procedures and increasing productivity. The integration of IoT in this complicated setting is hindered by specific barriers that need a thorough examination. Prominent barriers to IoT implementation in the cold supply chain are identified using a two-stage model. After reviewing the available literature on the topic of IoT implementation, a total of 13 barriers were found. The survey data was cross-validated for quality, and Cronbach's alpha test was employed to ensure validity. This research applies the interpretative structural modeling technique in the first phase to identify the main barriers. Among those barriers, "regularity compliance" and "cold chain networks" are key drivers for IoT adoption strategies. MICMAC's driving and dependence power element categorization helps evaluate the barrier interactions. In the second phase of this research, a decision-making trial and evaluation laboratory methodology was employed to identify causal relationships between barriers and evaluate them according to their relative importance. Each cause is a potential drive, and if its efficiency can be enhanced, the system as a whole benefits. The research findings provide industry stakeholders, governments, and organizations with significant drivers of IoT adoption to overcome these barriers and optimize the utilization of IoT technology to improve the effectiveness and reliability of the cold supply chain.


title: Can LLMs perform structured graph reasoning?

abstract: Pretrained Large Language Models (LLMs) have demonstrated various reasoning capabilities through language-based prompts alone, particularly in unstructured task settings (tasks purely based on language semantics). However, LLMs often struggle with structured tasks, because of the inherent incompatibility of input representation. Reducing structured tasks to uni-dimensional language semantics often renders the problem trivial. Keeping the trade-off between LLM compatibility and structure complexity in mind, we design various graph reasoning tasks as a proxy to semi-structured tasks in this paper, in order to test the ability to navigate through representations beyond plain text in various LLMs. Particularly, we design 10 distinct problems of graph traversal, each representing increasing levels of complexity, and benchmark 5 different instruct-finetuned LLMs (GPT-4, GPT-3.5, Claude-2, Llama-2 and Palm-2) on the aforementioned tasks. Further, we analyse the performance of models across various settings such as varying sizes of graphs as well as different forms of k-shot prompting. We highlight various limitations, biases and properties of LLMs through this benchmarking process, such as an inverse relation to the average degrees of freedom of traversal per node in graphs, the overall negative impact of k-shot prompting on graph reasoning tasks, and a positive response bias which prevents LLMs from identifying the absence of a valid solution. Finally, we introduce a new prompting technique specially designed for graph traversal tasks (PathCompare), which demonstrates a notable increase in the performance of LLMs in comparison to standard prompting techniques such as Chain-of-Thought (CoT).


title: HQA-Attack: Toward High Quality Black-Box Hard-Label Adversarial Attack on Text

abstract: Black-box hard-label adversarial attack on text is a practical and challenging task, as the text data space is inherently discrete and non-differentiable, and only the predicted label is accessible. Research on this problem is still in the embryonic stage and only a few methods are available. Nevertheless, existing methods rely on the complex heuristic algorithm or unreliable gradient estimation strategy, which probably fall into the local optimum and inevitably consume numerous queries, thus are difficult to craft satisfactory adversarial examples with high semantic similarity and low perturbation rate in a limited query budget. To alleviate above issues, we propose a simple yet effective framework to generate high quality textual adversarial examples under the black-box hard-label attack scenarios, named HQA-Attack. Specifically, after initializing an adversarial example randomly, HQA-attack first constantly substitutes original words back as many as possible, thus shrinking the perturbation rate. Then it leverages the synonym set of the remaining changed words to further optimize the adversarial example with the direction which can improve the semantic similarity and satisfy the adversarial condition simultaneously. In addition, during the optimizing procedure, it searches a transition synonym word for each changed word, thus avoiding traversing the whole synonym set and reducing the query number to some extent. Extensive experimental results on five text classification datasets, three natural language inference datasets and two real-world APIs have shown that the proposed HQA-Attack method outperforms other strong baselines significantly.


title: AOC-IDS: Autonomous Online Framework with Contrastive Learning for Intrusion Detection

abstract: The rapid expansion of the Internet of Things (IoT) has raised increasing concern about targeted cyber attacks. Previous research primarily focused on static Intrusion Detection Systems (IDSs), which employ offline training to safeguard IoT systems. However, such static IDSs struggle with real-world scenarios where IoT system behaviors and attack strategies can undergo rapid evolution, necessitating dynamic and adaptable IDSs. In response to this challenge, we propose AOC-IDS, a novel online IDS that features an autonomous anomaly detection module (ADM) and a labor-free online framework for continual adaptation. In order to enhance data comprehension, the ADM employs an Autoencoder (AE) with a tailored Cluster Repelling Contrastive (CRC) loss function to generate distinctive representation from limited or incrementally incoming data in the online setting. Moreover, to reduce the burden of manual labeling, our online framework leverages pseudo-labels automatically generated from the decision-making process in the ADM to facilitate periodic updates of the ADM. The elimination of human intervention for labeling and decision-making boosts the system's compatibility and adaptability in the online setting to remain synchronized with dynamic environments. Experimental validation using the NSL-KDD and UNSW-NB15 datasets demonstrates the superior performance and adaptability of AOC-IDS, surpassing the state-of-the-art solutions. The code is released at https://github.com/xinchen930/AOC-IDS.


title: KS-Net: Multi-band joint speech restoration and enhancement network for 2024 ICASSP SSI Challenge

abstract: This paper presents the speech restoration and enhancement system created by the 1024K team for the ICASSP 2024 Speech Signal Improvement (SSI) Challenge. Our system consists of a generative adversarial network (GAN) in complex-domain for speech restoration and a fine-grained multi-band fusion module for speech enhancement. In the blind test set of SSI, the proposed system achieves an overall mean opinion score (MOS) of 3.49 based on ITU-T P.804 and a Word Accuracy Rate (WAcc) of 0.78 for the real-time track, as well as an overall P.804 MOS of 3.43 and a WAcc of 0.78 for the non-real-time track, ranking 1st in both tracks.


title: PhenoLinker: Phenotype-Gene Link Prediction and Explanation using Heterogeneous Graph Neural Networks

abstract: The association of a given human phenotype to a genetic variant remains a critical challenge for biology. We present a novel system called PhenoLinker capable of associating a score to a phenotype-gene relationship by using heterogeneous information networks and a convolutional neural network-based model for graphs, which can provide an explanation for the predictions. This system can aid in the discovery of new associations and in the understanding of the consequences of human genetic variation.


title: Parameter uncertainties for imperfect surrogate models in the low-noise regime

abstract: Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, the loss ignores misspecification, where models are imperfect. Parameter uncertainties from Bayesian regression are thus significantly underestimated and vanish in the large data limit. This is particularly problematic when building models of low-noise, or near-deterministic, calculations, as the main source of uncertainty is neglected. We analyze the generalization error of misspecified, near-deterministic surrogate models, a regime of broad relevance in science and engineering. We show posterior distributions must cover every training point to avoid a divergent generalization error and design an ansatz that respects this constraint, which for linear models incurs minimal overhead. This is demonstrated on model problems before application to thousand dimensional datasets in atomistic machine learning. Our efficient misspecification-aware scheme gives accurate prediction and bounding of test errors where existing schemes fail, allowing this important source of uncertainty to be incorporated in computational workflows.


title: A Distributionally Robust Optimisation Approach to Fair Credit Scoring

abstract: Credit scoring has been catalogued by the European Commission and the Executive Office of the US President as a high-risk classification task, a key concern being the potential harms of making loan approval decisions based on models that would be biased against certain groups. To address this concern, recent credit scoring research has considered a range of fairness-enhancing techniques put forward by the machine learning community to reduce bias and unfair treatment in classification systems. While the definition of fairness or the approach they follow to impose it may vary, most of these techniques, however, disregard the robustness of the results. This can create situations where unfair treatment is effectively corrected in the training set, but when producing out-of-sample classifications, unfair treatment is incurred again. Instead, in this paper, we will investigate how to apply Distributionally Robust Optimisation (DRO) methods to credit scoring, thereby empirically evaluating how they perform in terms of fairness, ability to classify correctly, and the robustness of the solution against changes in the marginal proportions. In so doing, we find DRO methods to provide a substantial improvement in terms of fairness, with almost no loss in performance. These results thus indicate that DRO can improve fairness in credit scoring, provided that further advances are made in efficiently implementing these systems. In addition, our analysis suggests that many of the commonly used fairness metrics are unsuitable for a credit scoring setting, as they depend on the choice of classification threshold.


title: Distilling LLMs' Decomposition Abilities into Compact Language Models

abstract: Large Language Models (LLMs) have demonstrated proficiency in their reasoning abilities, yet their large size presents scalability challenges and limits any further customization. In contrast, compact models offer customized training but often fall short in solving complex reasoning tasks. This study focuses on distilling the LLMs' decomposition skills into compact models using offline reinforcement learning. We leverage the advancements in the LLM`s capabilities to provide feedback and generate a specialized task-specific dataset for training compact models. The development of an AI-generated dataset and the establishment of baselines constitute the primary contributions of our work, underscoring the potential of compact models in replicating complex problem-solving skills.


title: An Educational Tool for Learning about Social Media Tracking, Profiling, and Recommendation

abstract: This paper introduces an educational tool for classroom use, based on explainable AI (XAI), designed to demystify key social media mechanisms - tracking, profiling, and content recommendation - for novice learners. The tool provides a familiar, interactive interface that resonates with learners' experiences with popular social media platforms, while also offering the means to "peek under the hood" and exposing basic mechanisms of datafication. Learners gain first-hand experience of how even the slightest actions, such as pausing to view content, are captured and recorded in their digital footprint, and further distilled into a personal profile. The tool uses real-time visualizations and verbal explanations to create a sense of immediacy: each time the user acts, the resulting changes in their engagement history and their profile are displayed in a visually engaging and understandable manner. This paper discusses the potential of XAI and educational technology in transforming data and digital literacy education and in fostering the growth of children's privacy and security mindsets.


title: Baryon Spin and Emergent Hadron Mass

abstract: This thesis describes the use of Dyson-Schwinger equations (DSEs) to study baryon bound states in QCD. In this work, octet baryon axial form factors are calculated using a symmetry-preserving treatment of a vector $\times$ vector contact interaction (SCI). The baryons are considered as quark-plus-interacting-diquark bound states, whose structure (wave function) is obtained by solving a Poincar\'e-covariant Faddeev equation. Since it preserves symmetries, all consequences of partial conservation of the axial current are manifest. For instance, one finds that octet baryon axial properties are consistent with only minor violations of SU(3)-flavour symmetry, being interpreted as a dynamical consequence of emergent hadron mass (EHM). Considering neutral axial currents, the SCI delivers predictions for the flavour separation of octet baryon axial charges and, consequently, produces values for the associated SU(3) singlet, triplet, and octet axial charges. The results indicate that, at the hadron scale $\zeta_{\mathcal{H}}$, valence degrees of freedom carry approximately $50\%$ of an octet baryon's total spin. Proton structure is one of the principal topics in hadron physics. Its study is expected to reveal key features of both the origin of mass and strong interaction dynamics. This work therefore extended the above analyses to an examination of in-proton parton helicity (spin) distribution functions (DFs). Using Ans\"atze for hadron-scale proton polarised valence quark DFs, predictions are delivered for all proton polarised DFs at the measurement scale $\zeta_{\rm C}^2 = 3\,$GeV$^2$. The pointwise behaviour of the predicted DFs and, consequently, their moments, shows good agreement with results inferred from data. Based on these results, one finds that experimental measurements of the proton flavour-singlet axial charge should return a value $a_0^{\rm E}(\zeta_{\rm C}) = 0.35(2)$.


title: Mitigating Errors on Superconducting Quantum Processors through Fuzzy Clustering

abstract: Quantum utility has been severely limited in superconducting quantum hardware until now by the modest number of qubits and the relatively high level of control and readout errors, due to the intentional coupling with the external environment required for manipulation and readout of the qubit states. Practical applications in the Noisy Intermediate Scale Quantum (NISQ) era rely on Quantum Error Mitigation (QEM) techniques, which are able to improve the accuracy of the expectation values of quantum observables by implementing classical post-processing analysis from an ensemble of repeated noisy quantum circuit runs. In this work, we focus on a recent QEM technique that uses Fuzzy C-Means (FCM) clustering to specifically identify measurement error patterns. For the first time, we report a proof-of-principle validation of the technique on a 2-qubit register, obtained as a subset of a real NISQ 5-qubit superconducting quantum processor based on transmon qubits. We demonstrate that the FCM-based QEM technique allows for reasonable improvement of the expectation values of single- and two-qubit gates based quantum circuits, without necessarily invoking state-of-the-art coherence, gate, and readout fidelities.


title: Simple Symmetric Sustainable Sorting -- the greeNsort article

abstract: We explored an uncharted part of the solution space for sorting algorithms: the role of symmetry in divide&conquer algorithms. We found/designed novel simple binary Quicksort and Mergesort algorithms operating in contiguous space which achieve improved trade-offs between worst-case CPU-efficiency, best-case adaptivity and RAM-requirements. The 'greeNsort' algorithms need less hardware (RAM) and/or less energy (CPU) compared to the prior art. The new algorithms fit a theoretical framework: 'Footprint' KPIs allow to compare algorithms with different RAM-requirements, a new 'definition' of sorting API-targets simplifies construction of stable algorithms with mirrored scan directions, and our ordinal machine model encourages robust algorithms that minimize access 'distance'. Unlike earlier 'Quicksorts', our 'Zacksort', 'Zucksort' and 'Ducksort' algorithms optimally marry CPU-efficiency and tie-adaptivity. Unlike earlier 'Mergesorts' which required 100% distant buffer, our 'Frogsort' and 'Geckosort' algorithms achieve similar CPU-efficiency with 50% or less local buffer. Unlike natural Mergesorts such as 'Timsort' which are optimized for the best case of full-presorting, our 'Octosort' and 'Squidsort' algorithms achieve excellent bi-adaptivity to presorted best-cases without sacrificing worst-case efficiency in real sorting tasks. Our 'Walksort' and 'Jumpsort' have lower Footprint than the impressive low-memory 'Grailsort' and 'Sqrtsort' of Astrelin. Given the current climate-emergency, this is a call to action for all maintainers of sorting libraries, all software-engineers using custom sorting code, all professors teaching algorithms, all IT professionals designing programming languages, compilers and CPUs: check for better algorithms and consider symmetric code-mirroring.


title: LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks

abstract: There is considerable confusion about the role of Large Language Models (LLMs) in planning and reasoning tasks. On one side are over-optimistic claims that LLMs can indeed do these tasks with just the right prompting or self-verification strategies. On the other side are perhaps over-pessimistic claims that all that LLMs are good for in planning/reasoning tasks are as mere translators of the problem specification from one syntactic format to another, and ship the problem off to external symbolic solvers. In this position paper, we take the view that both these extremes are misguided. We argue that auto-regressive LLMs cannot, by themselves, do planning or self-verification (which is after all a form of reasoning), and shed some light on the reasons for misunderstandings in the literature. We will also argue that LLMs should be viewed as universal approximate knowledge sources that have much more meaningful roles to play in planning/reasoning tasks beyond simple front-end/back-end format translators. We present a vision of {\bf LLM-Modulo Frameworks} that combine the strengths of LLMs with external model-based verifiers in a tighter bi-directional interaction regime. We will show how the models driving the external verifiers themselves can be acquired with the help of LLMs. We will also argue that rather than simply pipelining LLMs and symbolic components, this LLM-Modulo Framework provides a better neuro-symbolic approach that offers tighter integration between LLMs and symbolic components, and allows extending the scope of model-based planning/reasoning regimes towards more flexible knowledge, problem and preference specifications.


title: Studying the Behavior of Radial Free Geodesics in {\Lambda}CDM Model

abstract: This paper presents an analytical study of the behavior of radial free-geodesics in the Friedmann-Lema\^itre-Robertson-Walker (FLRW) spacetime within the Lambda Cold Dark Matter ({\Lambda}CDM) model. Using the radial free motion solutions, we provide two methods for characterizing the geodesics and defines a general formula that encapsulates all possible solutions, determined by two initial conditions. We show that the past light cone, event horizon, and particle horizon, can be considered as special cases of this overarching formula. Furthermore, the paper explores the free geodesics within the currently accepted cosmological model based on the recent Planck results, thoroughly examining the various possible geodesic scenarios.


title: Fast LISA likelihood approximations by downsampling

abstract: The LISA gravitational wave observatory is due to launch in 2035. Researchers are currently working out the data analysis picture, including determining requirements of, and prospects for, parameterised gravitational wave models used in Bayesian inference, of which early stage inspirals of low and intermediate mass black hole binaries constitute a significant and important part. With datasets consisting of up to hundreds of millions of datapoints, their likelihood functions can be extremely expensive to compute. We present an approximation procedure for accurately reproducing the likelihood function (from time-domain data) for such signals in simulated environments, significantly reducing this cost. The method is simply to discard most of the datapoints and define a new inner product operator in terms of the remaining data, which closely resembles the original inner product on the model parameter space. Highly accurate reproductions of the likelihood can be achieved using just a few hundred to a few thousand datapoints, which can reduce parameter estimation (PE) time by factors of up to tens of thousands (compared to estimated frequency domain PE time), however, the end user must be responsible for ensuring convergence. The time-domain implementation is particularly useful for modelling waveform modifications arising from non-trivial astrophysical environments. The contents of this article provide the theoretical basis of the software package dolfen.


title: Signature volatility models: pricing and hedging with Fourier

abstract: We consider a stochastic volatility model where the dynamics of the volatility are given by a possibly infinite linear combination of the elements of the time extended signature of a Brownian motion. First, we show that the model is remarkably universal, as it includes, but is not limited to, the celebrated Stein-Stein, Bergomi, and Heston models, together with some path-dependent variants. Second, we derive the joint characteristic functional of the log-price and integrated variance provided that some infinite dimensional extended tensor algebra valued Riccati equation admits a solution. This allows us to price and (quadratically) hedge certain European and path-dependent options using Fourier inversion techniques. We highlight the efficiency and accuracy of these Fourier techniques in a comprehensive numerical study.


title: Human-like Category Learning by Injecting Ecological Priors from Large Language Models into Neural Networks

abstract: Ecological rationality refers to the notion that humans are rational agents adapted to their environment. However, testing this theory remains challenging due to two reasons: the difficulty in defining what tasks are ecologically valid and building rational models for these tasks. In this work, we demonstrate that large language models can generate cognitive tasks, specifically category learning tasks, that match the statistics of real-world tasks, thereby addressing the first challenge. We tackle the second challenge by deriving rational agents adapted to these tasks using the framework of meta-learning, leading to a class of models called ecologically rational meta-learned inference (ERMI). ERMI quantitatively explains human data better than seven other cognitive models in two different experiments. It additionally matches human behavior on a qualitative level: (1) it finds the same tasks difficult that humans find difficult, (2) it becomes more reliant on an exemplar-based strategy for assigning categories with learning, and (3) it generalizes to unseen stimuli in a human-like way. Furthermore, we show that ERMI's ecologically valid priors allow it to achieve state-of-the-art performance on the OpenML-CC18 classification benchmark.


title: Building Guardrails for Large Language Models

abstract: As Large Language Models (LLMs) become more integrated into our daily lives, it is crucial to identify and mitigate their risks, especially when the risks can have profound impacts on human users and societies. Guardrails, which filter the inputs or outputs of LLMs, have emerged as a core safeguarding technology. This position paper takes a deep look at current open-source solutions (Llama Guard, Nvidia NeMo, Guardrails AI), and discusses the challenges and the road towards building more complete solutions. Drawing on robust evidence from previous research, we advocate for a systematic approach to construct guardrails for LLMs, based on comprehensive consideration of diverse contexts across various LLMs applications. We propose employing socio-technical methods through collaboration with a multi-disciplinary team to pinpoint precise technical requirements, exploring advanced neural-symbolic implementations to embrace the complexity of the requirements, and developing verification and testing to ensure the utmost quality of the final product.


title: Bringing statistics to storylines: rare event sampling for sudden, transient extreme events

abstract: A leading goal for climate science and weather risk management is to accurately model both the physics and statistics of extreme events. These two goals are fundamentally at odds: the higher a computational model's resolution, the more expensive are the ensembles needed to capture accurate statistics in the tail of the distribution. Here, we focus on events that are localized in space and time, such as heavy precipitation events, which can start suddenly and decay rapidly. We advance a method for sampling such events more efficiently than straightforward climate model simulation. Our method combines elements of two recent approaches: adaptive multilevel splitting (AMS), a rare event algorithm that generates rigorous statistics at reduced cost, but that does not work well for sudden, transient extreme events; and "ensemble boosting" which generates physically plausible storylines of these events but not their statistics. We modify AMS by splitting trajectories well in advance of the event's onset following the approach of ensemble boosting, and this is shown to be critical for amplifying and diversifying simulated events in tests with the Lorenz-96 model. Early splitting requires a rejection step that reduces efficiency, but nevertheless we demonstrate improved sampling of extreme local events by a factor of order 10 relative to direct sampling in Lorenz-96. Our work makes progress on the challenge posed by fast dynamical timescales for rare event sampling, and it draws connections with existing methods in reliability engineering which, we believe, can be further exploited for weather risk assessment.


title: Identification of Cognitive Decline from Spoken Language through Feature Selection and the Bag of Acoustic Words Model

abstract: Memory disorders are a central factor in the decline of functioning and daily activities in elderly individuals. The confirmation of the illness, initiation of medication to slow its progression, and the commencement of occupational therapy aimed at maintaining and rehabilitating cognitive abilities require a medical diagnosis. The early identification of symptoms of memory disorders, especially the decline in cognitive abilities, plays a significant role in ensuring the well-being of populations. Features related to speech production are known to connect with the speaker's cognitive ability and changes. The lack of standardized speech tests in clinical settings has led to a growing emphasis on developing automatic machine learning techniques for analyzing naturally spoken language. Non-lexical but acoustic properties of spoken language have proven useful when fast, cost-effective, and scalable solutions are needed for the rapid diagnosis of a disease. The work presents an approach related to feature selection, allowing for the automatic selection of the essential features required for diagnosis from the Geneva minimalistic acoustic parameter set and relative speech pauses, intended for automatic paralinguistic and clinical speech analysis. These features are refined into word histogram features, in which machine learning classifiers are trained to classify control subjects and dementia patients from the Dementia Bank's Pitt audio database. The results show that achieving a 75% average classification accuracy with only twenty-five features with the separate ADReSS 2020 competition test data and the Leave-One-Subject-Out cross-validation of the entire competition data is possible. The results rank at the top compared to international research, where the same dataset and only acoustic features have been used to diagnose patients.


title: Fractal Patterns May Illuminate the Success of Next-Token Prediction

abstract: We study the fractal structure of language, aiming to provide a precise formalism for quantifying properties that may have been previously suspected but not formally shown. We establish that language is: (1) self-similar, exhibiting complexities at all levels of granularity, with no particular characteristic context length, and (2) long-range dependent (LRD), with a Hurst parameter of approximately H=0.7. Based on these findings, we argue that short-term patterns/dependencies in language, such as in paragraphs, mirror the patterns/dependencies over larger scopes, like entire documents. This may shed some light on how next-token prediction can capture the structure of text across multiple levels of granularity, from words and clauses to broader contexts and intents. In addition, we carry out an extensive analysis across different domains and architectures, showing that fractal parameters are robust. Finally, we demonstrate that the tiny variations in fractal parameters seen across LLMs improve upon perplexity-based bits-per-byte (BPB) in predicting their downstream performance. We hope these findings offer a fresh perspective on language and the mechanisms underlying the success of LLMs.


title: Leveraging Large Language Models for Analyzing Blood Pressure Variations Across Biological Sex from Scientific Literature

abstract: Hypertension, defined as blood pressure (BP) that is above normal, holds paramount significance in the realm of public health, as it serves as a critical precursor to various cardiovascular diseases (CVDs) and significantly contributes to elevated mortality rates worldwide. However, many existing BP measurement technologies and standards might be biased because they do not consider clinical outcomes, comorbidities, or demographic factors, making them inconclusive for diagnostic purposes. There is limited data-driven research focused on studying the variance in BP measurements across these variables. In this work, we employed GPT-35-turbo, a large language model (LLM), to automatically extract the mean and standard deviation values of BP for both males and females from a dataset comprising 25 million abstracts sourced from PubMed. 993 article abstracts met our predefined inclusion criteria (i.e., presence of references to blood pressure, units of blood pressure such as mmHg, and mention of biological sex). Based on the automatically-extracted information from these articles, we conducted an analysis of the variations of BP values across biological sex. Our results showed the viability of utilizing LLMs to study the BP variations across different demographic factors.


title: Extracting Scalar Measures from Curves

abstract: The ability to order outcomes is necessary to make comparisons which is complicated when there is no natural ordering on the space of outcomes, as in the case of functional outcomes. This paper examines methods for extracting a scalar summary from functional or longitudinal outcomes based on an average rate of change which can be used to compare curves. Common approaches used in practice use a change score or an analysis of covariance (ANCOVA) to make comparisons. However, these standard approaches only use a fraction of the available data and are inefficient. We derive measures of performance of an averaged rate of change of a functional outcome and compare this measure to standard measures. Simulations and data from a depression clinical trial are used to illustrate results.


title: Retrieval Augmented End-to-End Spoken Dialog Models

abstract: We recently developed SLM, a joint speech and language model, which fuses a pretrained foundational speech model and a large language model (LLM), while preserving the in-context learning capability intrinsic to the pretrained LLM. In this paper, we apply SLM to speech dialog applications where the dialog states are inferred directly from the audio signal. Task-oriented dialogs often contain domain-specific entities, i.e., restaurants, hotels, train stations, and city names, which are difficult to recognize, however, critical for the downstream applications. Inspired by the RAG (retrieval-augmented generation) paradigm, we propose a retrieval augmented SLM (ReSLM) that overcomes this weakness. We first train a speech retriever to retrieve text entities mentioned in the audio. The retrieved entities are then added as text inputs to the underlying SLM to bias model predictions. We evaluated ReSLM on speech MultiWoz task (DSTC-11 challenge), and found that this retrieval augmentation boosts model performance, achieving joint goal accuracy (38.6% vs 32.7%), slot error rate (20.6% vs 24.8%) and ASR word error rate (5.5% vs 6.7%). While demonstrated on dialog state tracking, our approach is broadly applicable to other speech tasks requiring contextual information or domain-specific entities, such as contextual ASR with biasing capability.


title: Predicting ATP binding sites in protein sequences using Deep Learning and Natural Language Processing

abstract: Predicting ATP-Protein Binding sites in genes is of great significance in the field of Biology and Medicine. The majority of research in this field has been conducted through time- and resource-intensive 'wet experiments' in laboratories. Over the years, researchers have been investigating computational methods computational methods to accomplish the same goals, utilising the strength of advanced Deep Learning and NLP algorithms. In this paper, we propose to develop methods to classify ATP-Protein binding sites. We conducted various experiments mainly using PSSMs and several word embeddings as features. We used 2D CNNs and LightGBM classifiers as our chief Deep Learning Algorithms. The MP3Vec and BERT models have also been subjected to testing in our study. The outcomes of our experiments demonstrated improvement over the state-of-the-art benchmarks.


title: PiCO: Peer Review in LLMs based on the Consistency Optimization

abstract: Existing large language models (LLMs) evaluation methods typically focus on testing the performance on some closed-environment and domain-specific benchmarks with human annotations. In this paper, we explore a novel unsupervised evaluation direction, utilizing peer-review mechanisms to measure LLMs automatically. In this setting, both open-source and closed-source LLMs lie in the same environment, capable of answering unlabeled questions and evaluating each other, where each LLM's response score is jointly determined by other anonymous ones. To obtain the ability hierarchy among these models, we assign each LLM a learnable capability parameter to adjust the final ranking. We formalize it as a constrained optimization problem, intending to maximize the consistency of each LLM's capabilities and scores. The key assumption behind is that high-level LLM can evaluate others' answers more accurately than low-level ones, while higher-level LLM can also achieve higher response scores. Moreover, we propose three metrics called PEN, CIN, and LIS to evaluate the gap in aligning human rankings. We perform experiments on multiple datasets with these metrics, validating the effectiveness of the proposed approach.


title: Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities

abstract: Augmenting large language models (LLMs) to understand audio -- including non-speech sounds and non-verbal speech -- is critically important for diverse real-world applications of LLMs. In this paper, we propose Audio Flamingo, a novel audio language model with 1) strong audio understanding abilities, 2) the ability to quickly adapt to unseen tasks via in-context learning and retrieval, and 3) strong multi-turn dialogue abilities. We introduce a series of training techniques, architecture design, and data strategies to enhance our model with these abilities. Extensive evaluations across various audio understanding tasks confirm the efficacy of our method, setting new state-of-the-art benchmarks. Our demo website is https://audioflamingo.github.io/ and the code is open-sourced at https://github.com/NVIDIA/audio-flamingo.


title: SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?

abstract: We present SynthCLIP, a novel framework for training CLIP models with entirely synthetic text-image pairs, significantly departing from previous methods relying on real data. Leveraging recent text-to-image (TTI) generative networks and large language models (LLM), we are able to generate synthetic datasets of images and corresponding captions at any scale, with no human intervention. With training at scale, SynthCLIP achieves performance comparable to CLIP models trained on real datasets. We also introduce SynthCI-30M, a purely synthetic dataset comprising 30 million captioned images. Our code, trained models, and generated data are released at https://github.com/hammoudhasan/SynthCLIP


title: SMA detection of an extreme millimeter flare from the young class III star HD 283572

abstract: We present evidence of variable 1.3 millimeter emission from the 1-3 Myr, SpT G2-G5 class III YSO, HD~283572. HD~283572 was observed on 8 dates with the Submillimeter Array between 2021 December and 2023 May, a total on-source time of 10.2 hours, probing a range of timescales down to 5.2 seconds. Averaging all data obtained on 2022 Jan 17 shows a 4.4 mJy ($8.8\sigma$) point source detection with a negative spectral index ($\alpha{=}{-2.7}{\pm}1.2$), with peak emission rising to 13.8 mJy in one 3 minute span, and 25 mJy in one 29.7 second integration ($L_\nu=4.7\times10^{17}$ erg s$^{-1}$ Hz$^{-1}$). Combining our data for the other 7 dates shows no detection, with an rms noise of 0.24 mJy beam$^{-1}$. The stochastic millimeter enhancements on time frames of seconds--minutes--hours with negative spectral indices are most plausibly explained by synchrotron or gyro-synchrotron radiation from stellar activity. HD 283572's 1.3 mm light-curve has similarities with variable binaries, suggesting HD 283572's activity may have been triggered by interactions with an as-yet undetected companion. We additionally identify variability of HD 283572 at 10 cm, from VLASS data. This study highlights the challenges of interpreting faint mm emission from evolved YSOs that may host tenuous disks, and suggests that a more detailed temporal analysis of spatially unresolved data is generally warranted. The variability of class III stars may open up new ground for understanding the physics of flares in the context of terrestrial planet formation.


title: Simulating the LOcal Web (SLOW) -- II: Properties of local galaxy clusters

abstract: This is the second paper in a series presenting the results from a 500 $h^{-1}$Mpc large constrained hydro-dynamical simulation of the local Universe (SLOW). The initial conditions are based on peculiar velocities derived from the CosmicFlows-2 catalogue. The inclusion of galaxy formation treatment, allows to directly predict observable properties of the Intra-Cluster Medium (ICM) within galaxy clusters. Comparing the properties of observed galaxy clusters within the local Universe with the properties of their simulated counterparts, enables us to assess the effectiveness of the initial condition constraints in accurately replicating the non-linear properties of the largest, collapsed objects within the simulation. Based on the combination of several, publicly available surveys, we identified 45 local Universe galaxy clusters in SLOW, including the 13 most massive from the Planck SZ catalog and 70% of those with $M_{500} > 2\times 10^{14}$ M$_{\odot}$. We then derived the probability of the cross identification based on mass, X-ray luminosity, temperature and Compton-y by comparing it to a random selection. In relation to previous constrained simulations of the local volume, we found in SLOW a much larger amount of replicated galaxy clusters, where their simulation based mass prediction falls within the uncertainties of the observational mass estimates. Comparing the median observed and simulated masses of our cross identified sample allows to independently deduce a hydrostatic mass bias of $(1-b)\approx0.87$. The SLOW constrained simulation of the local Universe faithfully reproduces numerous fundamental characteristics of the galaxy clusters within our local neighbourhood, opening a new avenue for studying the formation and evolution of a large set of individual galaxy clusters as well as testing our understanding of physical processes governing the ICM.


title: Obscuration in high redshift jetted QSO

abstract: Obscuration in high-redshift quasi-stellar objects (QSO) has a profound impact on our understanding of the evolution of supermassive black holes across the cosmic time. An accurate quantification of its relevance is therefore mandatory. We present a study aimed at evaluating the importance of obscuration in high redshift jetted QSO, i.e. those active nuclei characterized by the presence of powerful relativistic jets. We compare the observed number of radio detected QSO at different radio flux density limits with the value predicted by the beaming model on the basis of the number of oriented sources (blazars). Any significant deficit of radio-detected QSO compared to the predictions can be caused by the presence of obscuration along large angles from the jet direction. We apply this method to two sizable samples characterized by the same optical limit (mag=21) but significantly different radio density limits (30 mJy and 1 mJy respectively) and containing a total of 87 independent radio-loud 4<z<6.8 QSO, 31 of which classified as blazars. We find a general good agreement between the numbers predicted by the model and those actually observed, with only a marginal discrepancy at 0.5 mJy that could be caused by the lack of completeness of the sample. We conclude that we have no evidence of obscuration within angles 10-20deg from the relativistic jet direction. We also show how the ongoing deep wide-angle radio surveys will be instrumental to test the presence of obscuration at much larger angles, up to 30-35deg. We finally suggest that, depending on the actual fraction of obscured QSO, relativistic jets could be much more common at high redshifts compared to what is usually observed in the local Universe


title: Transverse Momentum Moments

abstract: We establish robust relations between Transverse Momentum Dependent distributions (TMDs) and collinear distributions. We define weighted integrals of TMDs that we call Transverse Momentum Moments (TMMs) and prove that TMMs are equal to collinear distributions evaluated in some minimal subtraction scheme. The conversion to the $\bar{MS}$-scheme can be done by a calculable factor, which we derive up to three loops for some cases. We discuss in detail the zeroth, the first, and the second TMMs and provide phenomenological results for them based on the current extractions of TMDs. The results of this paper open new avenues for theoretical and phenomenological investigation of the three-dimensional and collinear hadron structures.


title: X-ray properties of two complementary samples of intermediate Seyfert galaxies

abstract: We present the X-ray spectral analysis of two complementary sets of intermediate Seyfert galaxies (ISs). Analyzing X-ray data, we estimate the hydrogen abundance $N_H$ and test its connection with the [O III] luminosity acquired from optical observations. The results confirm the conclusions drawn in a previous study concerning the lack of a direct correlation between the obscuration measure ($N_H$) and the intrinsic characteristics of the active nuclei ([O III] luminosity). Instead, we validate the existence of a correlation between the Seyfert type and the $N_H$ parameter, employing a separation threshold of approximately 10$^{22}$ atoms cm$^{-2}$. Simultaneously, our findings align with prior research, corroborating the relationship between X-ray luminosity and the [O III] luminosity.


title: Primordial black hole capture, gravitational wave beats, and the nuclear equation of state

abstract: Primordial black holes (PBHs), if captured by neutron stars (NSs), would emit a characteristic gravitational wave (GW) signal as they orbit inside the host star. We identify a specific and qualitatively new feature of these signals, namely quasi-periodic beats caused by the precession of noncircular PBH orbits. We demonstrate numerically and analytically that the beat frequency depends rather sensitively on the NS structure, so that hypothetical future observations with next-generation GW detectors would provide valuable constraints on the nuclear equation of state.


title: Indirect Searches for Dark Photon-Photon Tridents in Celestial Objects

abstract: We model and constrain the unique indirect detection signature produced by dark matter particles that annihilate through a $U(1)$ gauge symmetry into dark photons that subsequently decay into three-photon final states. We focus on scenarios where the dark photon is long-lived, and show that $\gamma$-ray probes of celestial objects can set strong constraints on the dark matter/baryon scattering cross section that in many cases surpass the power of current direct detection constraints, and in some cases even peer into the neutrino fog.


title: Ruitenburg's Theorem mechanized and contextualized

abstract: In 1984, Wim Ruitenburg published a surprising result about periodic sequences in intuitionistic propositional calculus (IPC). The property established by Ruitenburg naturally generalizes local finiteness (intuitionistic logic is not locally finite, even in a single variable). However, one of the two main goals of this note is to illustrate that most "natural" non-classical logics failing local finiteness also do not enjoy the periodic sequence property; IPC is quite unique in separating these properties. The other goal of this note is to present a Coq formalization of Ruitenburg's heavily syntactic proof. Apart from ensuring its correctness, the formalization allows extraction of a program providing a certified implementation of Ruitenburg's algorithm.


title: COMET: Generating Commit Messages using Delta Graph Context Representation

abstract: Commit messages explain code changes in a commit and facilitate collaboration among developers. Several commit message generation approaches have been proposed; however, they exhibit limited success in capturing the context of code changes. We propose Comet (Context-Aware Commit Message Generation), a novel approach that captures context of code changes using a graph-based representation and leverages a transformer-based model to generate high-quality commit messages. Our proposed method utilizes delta graph that we developed to effectively represent code differences. We also introduce a customizable quality assurance module to identify optimal messages, mitigating subjectivity in commit messages. Experiments show that Comet outperforms state-of-the-art techniques in terms of bleu-norm and meteor metrics while being comparable in terms of rogue-l. Additionally, we compare the proposed approach with the popular gpt-3.5-turbo model, along with gpt-4-turbo; the most capable GPT model, over zero-shot, one-shot, and multi-shot settings. We found Comet outperforming the GPT models, on five and four metrics respectively and provide competitive results with the two other metrics. The study has implications for researchers, tool developers, and software developers. Software developers may utilize Comet to generate context-aware commit messages. Researchers and tool developers can apply the proposed delta graph technique in similar contexts, like code review summarization.


title: Stochastic Suspended Sediment Dynamics in Semi-Bounded Open Channel Flows: A Reflected SDE Approach

abstract: Stochastic processes, in the form of stochastic differential equations (SDEs), integrate stochastic elements to account for the inherent randomness in sediment particle trajectories in an open-channel turbulent flow. Accordingly, a stochastic diffusion particle tracking model (SDPTM) has been proposed in the literature to analyze suspended sediment dynamics. In this work, we develop a reflected stochastic diffusion particle tracking model (RSDPTM) for suspended sediment motion in a two-dimensional open channel flow based on reflected SDE, which is a mathematically consistent theory for stochastic processes in a bounded region. The Eulerian model given in terms of the Fokker-Planck equation (FPE) is also proposed by formulating boundary conditions for the confined domain. The existence and uniqueness of the solution to the proposed reflected SDE are proven, and the strong order of convergence of the projected Euler-Maruyama (EM) method is discussed. In order to correctly incorporate the physical mechanism of sediment-laden open-channel flow, an improved algorithm considering the threshold criteria of sediment suspension is proposed. The ensemble means, variances, and MSDs in both streamwise and vertical directions are discussed. It is observed that the particle motion in both directions follows anomalous diffusion, which is the deviation from normal or Fickian diffusion theory. Finally, the proposed model is validated through the suspended sediment concentration (SSC) distribution by comparing it with relevant experiential data, and the comparison shows an excellent agreement between the estimated and measured values of SSC. In summary, the proposed RSDPTM and improved algorithm may enhance our idea about the inherent randomness of suspended sediment motion in an open channel turbulent flow.


title: Towards a Scalable In Situ Fast Fourier Transform

abstract: The Fast Fourier Transform (FFT) is a numerical operation that transforms a function into a form comprised of its constituent frequencies and is an integral part of scientific computation and data analysis. The objective of our work is to enable use of the FFT as part of a scientific in situ processing chain to facilitate the analysis of data in the spectral regime. We describe the implementation of an FFT endpoint for the transformation of multi-dimensional data within the SENSEI infrastructure. Our results show its use on a sample problem in the context of a multi-stage in situ processing workflow.


title: A Massive Protocluster Anchored by a Luminous Quasar at $z=6.63$

abstract: Protoclusters, the progenitors of galaxy clusters, trace large scale structures in the early Universe and are important to our understanding of structure formation and galaxy evolution. To date, only a handful of protoclusters have been identified in the Epoch of Reionization (EoR). As one of the rarest populations in the early Universe, distant quasars that host active supermassive black holes are thought to reside in the most massive dark matter halos at that cosmic epoch, and could thus potentially pinpoint some of the earliest protoclusters. In this letter, we report the discovery of a massive protocluster around a luminous quasar at $z=6.63$. This protocluster is anchored by the quasar, and includes three [CII] emitters at $z\sim6.63$, 12 spectroscopically confirmed Ly$\alpha$ emitters (LAEs) at $6.54<z\le6.64$, and a large number of narrow-band imaging selected LAE candidates at the same redshift. This structure has an overall overdensity of $\delta=3.3^{+1.1}_{-0.9}$ within $\sim35\times74$ cMpc$^2$ on the sky and an extreme overdensity of $\delta>30$ in its central region (i.e., $R\lesssim2$ cMpc). We estimate that this protocluster will collapse into a galaxy cluster with a mass of $6.9^{+1.2}_{-1.4}\times10^{15}~M_\odot$ at the current epoch, more massive than the most massive clusters known in the local Universe such as Coma. In the quasar vicinity, we discover a double-peaked LAE which implies that the quasar has a UV lifetime greater than 0.8 Myrs and has already ionized its surrounding intergalactic medium.


title: Multi-Armed Bandits with Interference

abstract: Experimentation with interference poses a significant challenge in contemporary online platforms. Prior research on experimentation with interference has concentrated on the final output of a policy. The cumulative performance, while equally crucial, is less well understood. To address this gap, we introduce the problem of {\em Multi-armed Bandits with Interference} (MABI), where the learner assigns an arm to each of $N$ experimental units over a time horizon of $T$ rounds. The reward of each unit in each round depends on the treatments of {\em all} units, where the influence of a unit decays in the spatial distance between units. Furthermore, we employ a general setup wherein the reward functions are chosen by an adversary and may vary arbitrarily across rounds and units. We first show that switchback policies achieve an optimal {\em expected} regret $\tilde O(\sqrt T)$ against the best fixed-arm policy. Nonetheless, the regret (as a random variable) for any switchback policy suffers a high variance, as it does not account for $N$. We propose a cluster randomization policy whose regret (i) is optimal in {\em expectation} and (ii) admits a high probability bound that vanishes in $N$.


title: Identifying differences between semi-classical and full-quantum descriptions of plexcitons

abstract: Strong light-matter coupling between molecules and plasmonic nanoparticles give rise to new hybrid eigenstates of the coupled system, commonly referred to as polaritons, or more precisely, plexcitons. Over the last decade it has been amply shown that molecular electron dynamics and photophysics can be drastically affected by such interactions, thus paving the way for light-induced control of molecular excited-state properties and reactivity. Here, by combining ab initio molecular description and classical or quantum modelling of arbitrarily-shaped plasmonic nanostructures within Stochastic Schr\"odinger Equation, we present two approaches, one semi-classical and one full-quantum, to follow in real-time the electronic dynamics of plexcitons while realistically taking plasmonic dissipative losses into account. The full-quantum theory is compared with the semi-classical analogue under different interaction regimes, showing (numerically and theoretically) that even in the weak-field and weak-coupling limit a small-yet-observable difference arises.


title: Relativity of the event: examples in JT gravity and linearized GR

abstract: Observables in quantum gravity are famously defined asymptotically, at the boundary of AdS or Minkowski spaces. However, by gauge fixing a coordinate system or suitably dressing the field operators, an approximate, "quasi-local" approach is also possible, that can give account of the measurements performed by a set of observers living inside the spacetime. In particular, one can attach spatial coordinates to the worldlines of these observers and use their proper times as a time coordinate. Here we highlight that any such local formulation has to face the relativity of the event, in that changing frame (= set of observers) implies a reshuffling of the point-events and the way they are identified. As a consequence, coordinate transformations between different frames become probabilistic in quantum gravity. We give a concrete realization of this mechanism in Jackiw-Teitelboim gravity, where a point in the bulk can be defined operationally with geodesics anchored to the boundary. We describe different ways to do so, each corresponding to a different frame, and compute the variances of the transformations relating some of these frames. In particular, we compute the variance of the location of the black hole horizon, which appears smeared in most frames. We then suggest how to calculate this effect in Einstein gravity, assuming knowledge of the wavefunction of the metric. The idea is to expand the latter on a basis of semiclassical states. Each element of this basis enjoys standard/deterministic coordinate transformations and the result is thus obtained by superposition. As a divertissement, we sabotage the familiar Lorentz boosts by adding to Minkoswki spacetime a quantum superposition of gravitational waves and compute the probabilistic transformation to a boosted frame in linearized gravity. Finally, we attempt to translate the relativity of the event in the language of dressed operators.


title: A Perspective on Plasticity, Dissipation and the 2nd Law of Thermodynamics

abstract: The requirement of a non-negative dissipation rate for all possible deformation histories is generally imposed on plastic constitutive relations. This is a constraint analogous to the Coleman-Noll [1] postulate that the Clausius-Duhem inequality needs to be satisfied for all possible deformation histories. The physical basis for the Clausius-Duhem inequality is as a statistical limit for a large number of discrete events for a long time and is not a fundamental physical requirement for small systems for a short time. The relation between the requirement of a non-negative dissipation rate and the Clausius-Duhem inequality is considered. The consequences of imposing a non-negative dissipation rate for all possible deformation histories are illustrated for: (i) a single crystal plasticity framework that accounts for elastic lattice curvature changes as well as elastic lattice straining; and (ii) for discrete defect theories of plasticity, with attention specifically on discrete dislocation plasticity for crystalline solids and discrete shear transformation zone (STZ) plasticity for amorphous solids. Possible less restrictive conditions on the evolution of dissipation in plasticity formulations are considered as are implications for stability. The focus is on open questions and issues.


title: Capturing waste collection planning expert knowledge in a fitness function through preference learning

abstract: This paper copes with the COGERSA waste collection process. Up to now, experts have been manually designed the process using a trial and error mechanism. This process is not globally optimized, since it has been progressively and locally built as council demands appear. Planning optimization algorithms usually solve it, but they need a fitness function to evaluate a route planning quality. The drawback is that even experts are not able to propose one in a straightforward way due to the complexity of the process. Hence, the goal of this paper is to build a fitness function though a preference framework, taking advantage of the available expert knowledge and expertise. Several key performance indicators together with preference judgments are carefully established according to the experts for learning a promising fitness function. Particularly, the additivity property of them makes the task be much more affordable, since it allows to work with routes rather than with route plannings. Besides, a feature selection analysis is performed over such indicators, since the experts suspect of a potential existing (but unknown) redundancy among them. The experiment results confirm this hypothesis, since the best $C-$index ($98\%$ against around $94\%$) is reached when 6 or 8 out of 21 indicators are taken. Particularly, truck load seems to be a highly promising key performance indicator, together to the travelled distance along non-main roads. A comparison with other existing approaches shows that the proposed method clearly outperforms them, since the $C-$index goes from $72\%$ or $90\%$ to $98\%$.


title: Dimensional curvature identities in Fedosov geometry

abstract: The curvature tensor of a symplectic connection, as well as its covariant derivatives, satisfy certain identities that hold on any manifold of dimension less than or equal to a fixed n. In this paper, we prove certain results regarding these curvature identities. Our main result describes, for any fixed dimension and any even number p of indices, the first space (provided we have filtered the identities by a homogeneity condition) of p-covariant curvature identities. To this end, we use recent results on the theory of natural operations on Fedosov manifolds. These results allow us to apply the invariant theory of the symplectic group, with a method that is analogous to that used in Riemannian or Kahler geometry.


title: Exploring the predictability of the solar cycle from the polar field rise rate: Results from observations and simulations

abstract: The inherent stochastic and nonlinear nature of the solar dynamo makes the strength of the solar cycles vary in a wide range, making it difficult to predict the strength of an upcoming solar cycle. Recently, our work has shown that by using the observed correlation of the polar field rise rate with the peak of polar field at cycle minimum and amplitude of following cycle, an early prediction can be made. In a follow-up study, we perform SFT simulations to explore the robustness of this correlation against variation of meridional flow speed, and against stochastic fluctuations of BMR tilt properties that give rise to anti-Joy and anti-Hale type anomalous BMRs. The results suggest that the observed correlation is a robust feature of the solar cycle and can be utilized for a reliable prediction of peak strength of a cycle at least 2 to 3 years earlier than the minimum.


title: QPP and HPPK: Unifying Non-Commutativity for Quantum-Secure Cryptography with Galois Permutation Group

abstract: In response to the evolving landscape of quantum computing and the escalating vulnerabilities in classical cryptographic systems, our paper introduces a unified cryptographic framework. Rooted in the innovative work of Kuang et al., we leverage two novel primitives: the Quantum Permutation Pad (QPP) for symmetric key encryption and the Homomorphic Polynomial Public Key (HPPK) for Key Encapsulation Mechanism (KEM) and Digital Signatures (DS). Our approach adeptly confronts the challenges posed by quantum advancements. Utilizing the Galois Permutation Group's matrix representations and inheriting its bijective and non-commutative properties, QPP achieves quantum-secure symmetric key encryption, seamlessly extending Shannon's perfect secrecy to both classical and quantum-native systems. Meanwhile, HPPK, free from NP-hard problems, fortifies symmetric encryption for the plain public key. It accomplishes this by concealing the mathematical structure through modular multiplications or arithmetic representations of Galois Permutation Group over hidden rings, harnessing their partial homomorphic properties. This allows for secure computation on encrypted data during secret encapsulations, bolstering the security of the plain public key. The seamless integration of KEM and DS within HPPK cryptography yields compact key, cipher, and signature sizes, demonstrating exceptional performance. This paper organically unifies QPP and HPPK under the Galois Permutation Group, marking a significant advancement in laying the groundwork for quantum-resistant cryptographic protocols. Our contribution propels the development of secure communication systems amid the era of quantum computing.


title: The role of nonlinear toroidal flux loss due to flux emergence in the long-term evolution of the solar cycle

abstract: A striking feature of the solar cycle is that at the beginning, sunspots appear around mid-latitudes, and over time the latitudes of emergences migrate towards the equator. The maximum level of activity varies from cycle to cycle. For strong cycles, the activity begins early and at higher latitudes with wider sunspot distributions than for weak cycles. The activity and the width of sunspot belts increase rapidly and begin to decline when the belts are still at high latitudes. However, in the late stages of the cycles, the level of activity, and properties of the butterfly wings all have the same statistical properties independent of the peak strength of the cycles. We have modelled these features using Babcock-Leighton type dynamo model and shown that the toroidal flux loss from the solar interior due to magnetic buoyancy is an essential nonlinearity that leads to all the cycles decline in the same way.


title: Efficient implementation of discrete-time quantum walks on quantum computers

abstract: Quantum walks have proven to be a universal model for quantum computation and to provide speed-up in certain quantum algorithms. The discrete-time quantum walk (DTQW) model, among others, is one of the most suitable candidates for circuit implementation, due to its discrete nature. Current implementations, however, are usually characterized by quantum circuits of large size and depth, which leads to a higher computational cost and severely limits the number of time steps that can be reliably implemented on current quantum computers. In this work, we propose an efficient and scalable quantum circuit implementing the DTQW on the $2^n$-cycle based on the diagonalization of the conditional shift operator. For $t$ time-steps of the DTQW, the proposed circuit requires only $O(n^2 + nt)$ two-qubit gates compared to the $O(n^2 t)$ of the current most efficient implementation based on quantum Fourier transforms. We test the proposed circuit on an IBM quantum device for a Hadamard DTQW on the $4$- and $8$-cycle characterized by periodic dynamics and recurrent generation of maximally entangled single-particle states. Experimental results are meaningful well beyond the regime of few time steps, paving the way for reliable implementation and use on quantum computers.


title: SPDE priors for uncertainty quantification of end-to-end neural data assimilation schemes

abstract: The spatio-temporal interpolation of large geophysical datasets has historically been adressed by Optimal Interpolation (OI) and more sophisticated model-based or data-driven DA techniques. In the last ten years, the link established between Stochastic Partial Differential Equations (SPDE) and Gaussian Markov Random Fields (GMRF) opened a new way of handling both large datasets and physically-induced covariance matrix in Optimal Interpolation. Recent advances in the deep learning community also enables to adress this problem as neural architecture embedding data assimilation variational framework. The reconstruction task is seen as a joint learning problem of the prior involved in the variational inner cost and the gradient-based minimization of the latter: both prior models and solvers are stated as neural networks with automatic differentiation which can be trained by minimizing a loss function, typically stated as the mean squared error between some ground truth and the reconstruction. In this work, we draw from the SPDE-based Gaussian Processes to estimate complex prior models able to handle non-stationary covariances in both space and time and provide a stochastic framework for interpretability and uncertainty quantification. Our neural variational scheme is modified to embed an augmented state formulation with both state and SPDE parametrization to estimate. Instead of a neural prior, we use a stochastic PDE as surrogate model along the data assimilation window. The training involves a loss function for both reconstruction task and SPDE prior model, where the likelihood of the SPDE parameters given the true states is involved in the training. Because the prior is stochastic, we can easily draw samples in the prior distribution before conditioning to provide a flexible way to estimate the posterior distribution based on thousands of members.


title: Watch the Moon, Learn the Moon: Lunar Geology Research at School Level with Telescope and Open Source Data

abstract: Science-AI Symbiotic Group at Seven Square Academy, Naigaon was formed in 2023 with the purpose of bringing school students to the forefronts of science research by involving them in hands on research. In October 2023 a new project was started with the goal of studying the lunar surface by real-time observations and open source data. Twelve students/members from grades 8, 9, 10 participated in this research attempt wherein each student filled an observation metric by observing the Moon on various days with a Bresser Messier 150mm/1200mm reflector Newtonian telescope. After the observations were done, the members were assigned various zones on the lunar near side for analysis of geological features. Then a data analysis metric was filled by each of students with the help of Lunar Reconnaissance Orbiter Camera's/ LROC's quickmap open access data hosted by Arizona State University. In this short paper a brief overview of this project is given. One example each of observation metric and data analysis metric is presented. This kind of project has high impact for school science education with minimal costs. This project can also serve as an interesting science outreach program for organisations looking forward to popularise planetary sciences research at school level.


title: Position Paper: Assessing Robustness, Privacy, and Fairness in Federated Learning Integrated with Foundation Models

abstract: Federated Learning (FL), while a breakthrough in decentralized machine learning, contends with significant challenges such as limited data availability and the variability of computational resources, which can stifle the performance and scalability of the models. The integration of Foundation Models (FMs) into FL presents a compelling solution to these issues, with the potential to enhance data richness and reduce computational demands through pre-training and data augmentation. However, this incorporation introduces novel issues in terms of robustness, privacy, and fairness, which have not been sufficiently addressed in the existing research. We make a preliminary investigation into this field by systematically evaluating the implications of FM-FL integration across these dimensions. We analyze the trade-offs involved, uncover the threats and issues introduced by this integration, and propose a set of criteria and strategies for navigating these challenges. Furthermore, we identify potential research directions for advancing this field, laying a foundation for future development in creating reliable, secure, and equitable FL systems.


title: Explaining latent representations of generative models with large multimodal models

abstract: Learning interpretable representations of data generative latent factors is an important topic for the development of artificial intelligence. With the rise of the large multimodal model, it can align images with text to generate answers. In this work, we propose a framework to comprehensively explain each latent variable in the generative models using a large multimodal model. We further measure the uncertainty of our generated explanations, quantitatively evaluate the performance of explanation generation among multiple large multimodal models, and qualitatively visualize the variations of each latent variable to learn the disentanglement effects of different generative models on explanations. Finally, we discuss the explanatory capabilities and limitations of state-of-the-art large multimodal models.


title: Intermittent Electron-Only Reconnection at Lunar Mini-Magnetospheres

abstract: Lunar crustal magnetic anomalies (LCMA) are sub-ion-gyroradius structures that have been shown to stand off the solar wind (SW) plasma from the Moon's surface, forming shock-like discontinuities and reflecting incident SW protons. In this letter, the results of high-resolution, two-dimensional fully kinetic simulations show a bursty electron-only magnetic reconnection in the SW-LCMA interaction region, characterized by the quasi-periodic formation and ejection of magnetic islands and strong parallel electron flows along the X-point separator lines. The islands are observed to modify the magnetic pressure pile-up and Hall electric field above the LCMA, leading to sharp increases in reflected protons that drive electromagnetic fluctuations downstream and short distances upstream in the SW.


title: Outlier Accommodation for GNSS Precise Point Positioning using Risk-Averse State Estimation

abstract: Reliable and precise absolute positioning is necessary in the realm of Connected Automated Vehicles (CAV). Global Navigation Satellite Systems (GNSS) provides the foundation for absolute positioning. Recently enhanced Precise Point Positioning (PPP) technology now offers corrections for GNSS on a global scale, with the potential to achieve accuracy suitable for real-time CAV applications. However, in obstructed sky conditions, GNSS signals are often affected by outliers; therefore, addressing outliers is crucial. In GNSS applications, there are many more measurements available than are required to meet the specification. Therefore, selecting measurements to avoid outliers is of interest. The recently developed Risk-Averse Performance-Specified (RAPS) state estimation optimally selects measurements to minimize outlier risk while meeting a positive semi-definite constraint on performance; at present, the existing solution methods are not suitable for real-time computation and have not been demonstrated using challenging real-world data or in Real-time PPP (RT-PPP) applications. This article makes contributions in a few directions. First, it uses a diagonal performance specification, which reduces computational costs relative to the positive semi-definite constraint. Second, this article considers GNSS RT-PPP applications. Third, the experiments use real-world GNSS data collected in challenging environments. The RT-PPP experimental results show that among the compared methods: all achieve comparable performance in open-sky conditions, and all exceed the Society of Automotive Engineers (SAE) specification; however, in challenging environments, the diagonal RAPS approach shows improvement of 6-19% over traditional methods. Throughout, RAPS achieves the lowest estimation risk.


title: Depth for samples of sets with applications to testing equality in distribution of two samples of random sets

abstract: This paper introduces several depths for random sets with possibly non-convex realisations, proposes ways to estimate the depths based on the samples and compares them with existing ones. The depths are further applied for the comparison between two samples of random sets using a visual method of DD-plots and statistical testing. The advantage of this approach is identifying sets within the sample that are responsible for rejecting the null hypothesis of equality in distribution and providing clues on differences between distributions. The method is justified using a simulation study and applied to real data consisting of histological images of mastopathy and mammary cancer tissue.


title: Parametric Feature Transfer: One-shot Federated Learning with Foundation Models

abstract: In one-shot federated learning (FL), clients collaboratively train a global model in a single round of communication. Existing approaches for one-shot FL enhance communication efficiency at the expense of diminished accuracy. This paper introduces FedPFT (Federated Learning with Parametric Feature Transfer), a methodology that harnesses the transferability of foundation models to enhance both accuracy and communication efficiency in one-shot FL. The approach involves transferring per-client parametric models (specifically, Gaussian mixtures) of features extracted from foundation models. Subsequently, each parametric model is employed to generate synthetic features for training a classifier head. Experimental results on eight datasets demonstrate that FedPFT enhances the communication-accuracy frontier in both centralized and decentralized FL scenarios, as well as across diverse data-heterogeneity settings such as covariate shift and task shift, with improvements of up to 20.6%. Additionally, FedPFT adheres to the data minimization principle of FL, as clients do not send real features. We demonstrate that sending real features is vulnerable to potent reconstruction attacks. Moreover, we show that FedPFT is amenable to formal privacy guarantees via differential privacy, demonstrating favourable privacy-accuracy tradeoffs.


title: DFML: Decentralized Federated Mutual Learning

abstract: In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit model and data heterogeneity. Existing work lacks a Decentralized FL (DFL) framework capable of accommodating such heterogeneity without imposing architectural restrictions or assuming the availability of public data. To address these issues, we propose a Decentralized Federated Mutual Learning (DFML) framework that is serverless, supports nonrestrictive heterogeneous models, and avoids reliance on public data. DFML effectively handles model and data heterogeneity through mutual learning, which distills knowledge between clients, and cyclically varying the amount of supervision and distillation signals. Extensive experimental results demonstrate consistent effectiveness of DFML in both convergence speed and global accuracy, outperforming prevalent baselines under various conditions. For example, with the CIFAR-100 dataset and 50 clients, DFML achieves a substantial increase of +17.20% and +19.95% in global accuracy under Independent and Identically Distributed (IID) and non-IID data shifts, respectively.


title: (A)I Am Not a Lawyer, But...: Engaging Legal Experts towards Responsible LLM Policies for Legal Advice

abstract: Large language models (LLMs) are increasingly capable of providing users with advice in a wide range of professional domains, including legal advice. However, relying on LLMs for legal queries raises concerns due to the significant expertise required and the potential real-world consequences of the advice. To explore \textit{when} and \textit{why} LLMs should or should not provide advice to users, we conducted workshops with 20 legal experts using methods inspired by case-based reasoning. The provided realistic queries ("cases") allowed experts to examine granular, situation-specific concerns and overarching technical and legal constraints, producing a concrete set of contextual considerations for LLM developers. By synthesizing the factors that impacted LLM response appropriateness, we present a 4-dimension framework: (1) User attributes and behaviors, (2) Nature of queries, (3) AI capabilities, and (4) Social impacts. We share experts' recommendations for LLM response strategies, which center around helping users identify `right questions to ask' and relevant information rather than providing definitive legal judgments. Our findings reveal novel legal considerations, such as unauthorized practice of law, confidentiality, and liability for inaccurate advice, that have been overlooked in the literature. The case-based deliberation method enabled us to elicit fine-grained, practice-informed insights that surpass those from de-contextualized surveys or speculative principles. These findings underscore the applicability of our method for translating domain-specific professional knowledge and practices into policies that can guide LLM behavior in a more responsible direction.


title: What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement

abstract: Language models deployed in the wild make errors. However, simply updating the model with the corrected error instances causes catastrophic forgetting -- the updated model makes errors on instances learned during the instruction tuning or upstream training phase. Randomly replaying upstream data yields unsatisfactory performance and often comes with high variance and poor controllability. To this end, we try to forecast upstream examples that will be forgotten due to a model update for improved controllability of the replay process and interpretability. We train forecasting models given a collection of online learned examples and corresponding forgotten upstream pre-training examples. We propose a partially interpretable forecasting model based on the observation that changes in pre-softmax logit scores of pretraining examples resemble that of online learned examples, which performs decently on BART but fails on T5 models. We further show a black-box classifier based on inner products of example representations achieves better forecasting performance over a series of setups. Finally, we show that we reduce forgetting of upstream pretraining examples by replaying examples that are forecasted to be forgotten, demonstrating the practical utility of forecasting example forgetting.


title: Parametric Bootstrap on Networks with Non-Exchangeable Nodes

abstract: This paper studies the parametric bootstrap method for networks to quantify the uncertainty of statistics of interest. While existing network resampling methods primarily focus on count statistics under node-exchangeable (graphon) models, we consider more general network statistics (including local statistics) under the Chung-Lu model without node-exchangeability. We show that the natural network parametric bootstrap that first estimates the network generating model and then draws bootstrap samples from the estimated model generally suffers from bootstrap bias. As a general recipe for addressing this problem, we show that a two-level bootstrap procedure provably reduces the bias. This essentially extends the classical idea of iterative bootstrap to the network setting with a growing number of parameters. Moreover, the second-level bootstrap provides a way to construct higher-accuracy confidence intervals for many network statistics.


title: Leveraging Large Language Models for Structure Learning in Prompted Weak Supervision

abstract: Prompted weak supervision (PromptedWS) applies pre-trained large language models (LLMs) as the basis for labeling functions (LFs) in a weak supervision framework to obtain large labeled datasets. We further extend the use of LLMs in the loop to address one of the key challenges in weak supervision: learning the statistical dependency structure among supervision sources. In this work, we ask the LLM how similar are these prompted LFs. We propose a Structure Refining Module, a simple yet effective first approach based on the similarities of the prompts by taking advantage of the intrinsic structure in the embedding space. At the core of Structure Refining Module are Labeling Function Removal (LaRe) and Correlation Structure Generation (CosGen). Compared to previous methods that learn the dependencies from weak labels, our method finds the dependencies which are intrinsic to the LFs and less dependent on the data. We show that our Structure Refining Module improves the PromptedWS pipeline by up to 12.7 points on the benchmark tasks. We also explore the trade-offs between efficiency and performance with comprehensive ablation experiments and analysis. Code for this project can be found in https://github.com/BatsResearch/su-bigdata23-code.


title: Challenges in Training PINNs: A Loss Landscape Perspective

abstract: This paper explores challenges in training Physics-Informed Neural Networks (PINNs), emphasizing the role of the loss landscape in the training process. We examine difficulties in minimizing the PINN loss function, particularly due to ill-conditioning caused by differential operators in the residual term. We compare gradient-based optimizers Adam, L-BFGS, and their combination Adam+L-BFGS, showing the superiority of Adam+L-BFGS, and introduce a novel second-order optimizer, NysNewton-CG (NNCG), which significantly improves PINN performance. Theoretically, our work elucidates the connection between ill-conditioned differential operators and ill-conditioning in the PINN loss and shows the benefits of combining first- and second-order optimization methods. Our work presents valuable insights and more powerful optimization strategies for training PINNs, which could improve the utility of PINNs for solving difficult partial differential equations.


title: InferCept: Efficient Intercept Support for Augmented Large Language Model Inference

abstract: Large language models are increasingly integrated with external environments, tools, and agents like ChatGPT plugins to extend their capability beyond language-centric tasks. However, today's LLM inference systems are designed for standalone LLMs. They treat each external interaction as the end of LLM generation and form a new request when the interaction finishes, causing unnecessary recomputation of already computed contexts, which accounts for 37-40% of total model forwarding time. This paper presents InferCept, the first LLM inference framework targeting augmented LLMs and supporting the efficient interception of LLM generation. InferCept minimizes the GPU resource waste caused by LLM interceptions and dedicates saved memory for serving more requests. InferCept improves the overall serving throughput by 1.6x-2x and completes 2x more requests per second compared to the state-of-the-art LLM inference systems.


title: Notes on a homomorphism from the affine Yangian associated with $\widehat{\mathfrak{sl}}(n)$ to the affine Yangian associated with $\widehat{\mathfrak{sl}}(n+1)$

abstract: In the previous paper, we constructed a homomorphism from the affine Yangian associated with $\widehat{\mathfrak{sl}}(n)$ to the standard degreewise completion of the affine Yangian associated with $\widehat{\mathfrak{sl}}(n+1)$. By using this homomorphism, we construct a homomorphism from the affine Yangian to the universal enveloping algebra of a non-rectangular $W$-algebra, which is different from the one in \cite{U7}. We also show that this homomorphism is related to the one from the quantum affine algebra associated with $\widehat{\mathfrak{sl}}(n)$ to the quantum affine algebra associated with $\widehat{\mathfrak{sl}}(n+1)$ given by Li.


title: Robust Majorana bound state in pseudo-spin domain wall of 2-D topological insulator

abstract: We investigate helical edge states (HES) emerging at the composite domain wall of spin and pseudo-spin degrees of freedom in a 2-D bulk governed by the Bernevig-Hughes-Zhang Hamiltonian which underwent quantum spin Hall to anomalous Hall transition. We numerically study the stability of Majorana bound state (MBS) formed due to proximity induced superconductivity in these helical edge states. We establish exceptional robustness of MBS against moderate chemical potential or magnetic disorder owing to the existence of the simultaneous orthogonality between the right and the left moving modes both in spin and pseudo-spin space. Hence our proposal could pave the way to realizing robust Majorana bound state on 2D platforms.


title: Distributionally Fair Stochastic Optimization using Wasserstein Distance

abstract: A traditional stochastic program under a finite population typically seeks to optimize efficiency by maximizing the expected profits or minimizing the expected costs, subject to a set of constraints. However, implementing such optimization-based decisions can have varying impacts on individuals, and when assessed using the individuals' utility functions, these impacts may differ substantially across demographic groups delineated by sensitive attributes, such as gender, race, age, and socioeconomic status. As each group comprises multiple individuals, a common remedy is to enforce group fairness, which necessitates the measurement of disparities in the distributions of utilities across different groups. This paper introduces the concept of Distributionally Fair Stochastic Optimization (DFSO) based on the Wasserstein fairness measure. The DFSO aims to minimize distributional disparities among groups, quantified by the Wasserstein distance, while adhering to an acceptable level of inefficiency. Our analysis reveals that: (i) the Wasserstein fairness measure recovers the demographic parity fairness prevalent in binary classification literature; (ii) this measure can approximate the well-known Kolmogorov-Smirnov fairness measure with considerable accuracy; and (iii) despite DFSO's biconvex nature, the epigraph of the Wasserstein fairness measure is generally Mixed-Integer Convex Programming Representable (MICP-R). Additionally, we introduce two distinct lower bounds for the Wasserstein fairness measure: the Jensen bound, applicable to the general Wasserstein fairness measure, and the Gelbrich bound, specific to the type-2 Wasserstein fairness measure. We establish the exactness of the Gelbrich bound and quantify the theoretical difference between the Wasserstein fairness measure and the Gelbrich bound.


title: Fourier--Mukai transforms commuting with Frobenius

abstract: We show that a Fourier--Mukai equivalence between smooth projective varieties of characteristic $p$ which commutes with either pushforward or pullback along Frobenius is a composition of shifts, isomorphisms, and tensor product with invertible sheaves whose $(p-1)$th tensor power is trivial.


title: The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models

abstract: In this work, we review research studies that combine Reinforcement Learning (RL) and Large Language Models (LLMs), two areas that owe their momentum to the development of deep neural networks. We propose a novel taxonomy of three main classes based on the way that the two model types interact with each other. The first class, RL4LLM, includes studies where RL is leveraged to improve the performance of LLMs on tasks related to Natural Language Processing. L4LLM is divided into two sub-categories depending on whether RL is used to directly fine-tune an existing LLM or to improve the prompt of the LLM. In the second class, LLM4RL, an LLM assists the training of an RL model that performs a task that is not inherently related to natural language. We further break down LLM4RL based on the component of the RL training framework that the LLM assists or replaces, namely reward shaping, goal generation, and policy function. Finally, in the third class, RL+LLM, an LLM and an RL agent are embedded in a common planning framework without either of them contributing to training or fine-tuning of the other. We further branch this class to distinguish between studies with and without natural language feedback. We use this taxonomy to explore the motivations behind the synergy of LLMs and RL and explain the reasons for its success, while pinpointing potential shortcomings and areas where further research is needed, as well as alternative methodologies that serve the same goal.