title: Large-Scale Contextual Market Equilibrium Computation through Deep Learning

abstract: Market equilibrium is one of the most fundamental solution concepts in economics and social optimization analysis. Existing works on market equilibrium computation primarily focus on settings with a relatively small number of buyers. Motivated by this, our paper investigates the computation of market equilibrium in scenarios with a large-scale buyer population, where buyers and goods are represented by their contexts. Building on this realistic and generalized contextual market model, we introduce MarketFCNet, a deep learning-based method for approximating market equilibrium. We start by parameterizing the allocation of each good to each buyer using a neural network, which depends solely on the context of the buyer and the good. Next, we propose an efficient method to estimate the loss function of the training algorithm unbiasedly, enabling us to optimize the network parameters through gradient descent. To evaluate the approximated solution, we introduce a metric called Nash Gap, which quantifies the deviation of the given allocation and price pair from the market equilibrium. Experimental results indicate that MarketFCNet delivers competitive performance and significantly lower running times compared to existing methods as the market scale expands, demonstrating the potential of deep learning-based methods to accelerate the approximation of large-scale contextual market equilibrium.


title: Engaging Students Through Math Competitions

abstract: This article contains a selection of problems from the American Mathematics Competitions.


title: The Origin of Dark Matter and the Cosmological Constant

abstract: The concept of exotic charged dust is introduced here to represent dark matter. The term "exotic" means that the dust is not composed of normal matter, and the charge--for lack of a better term--is not an electric charge. It is also shown that the often-used approximate expression for dark matter density corresponds to an exact solution of the coupled Einstein-Maxwell equations for charged dust. The Einstein field equations tells us is that for a flat universe the cosmological constant acts as a gravitating negative energy distribution that is gravitationally repulsive; following Schwinger, it is shown that the vacuum must have a negative energy spectrum if QFT is to be gauge invariant.


title: Thermal/epithermal neutron detection via LiO$_{2}$-doped fiber bundles: A computational study through GEANT4 simulations

abstract: One of the neutron capture processes in lithium or lithium-doped materials leads to the production of secondary alpha-triton pairs. The counts of these secondary charged particle pairs in the presence of thermal/epithermal neutrons indirectly give access to detecting the primary incident neutrons with the aid of the plastic scintillators by reminding that both these secondary alphas and tritons deposit their entire kinetic energy within a short range. In this study, we modify the polystyrene fiber core of Kuraray Y11-200(M) by doping with 10 wt.$\%$ LiO$_{2}$. We investigate a fiber bundle system hinged on 10 wt.$\%$ LiO$_{2}$-doped Kuraray Y11-200(M) fibers via the GEANT4 simulations by targeting the detection of the incident thermal/epithermal neutrons through the generation of the secondary alpha-triton pairs. First, we estimate an optimal number of fiber arrays by using a monoenergetic beam of thermal neutrons with a kinetic energy of 0.025 eV and we count the number of secondary alpha-triton pairs. Subsequently, we insert a pixelated photo-sensor on both ends of the fiber bundle in order to collect the entrapped optical photons. In addition to the thermal neutrons, we also explore the detection of epithermal neutrons with a kinetic energy of 1 eV by utilizing a combination of the 10 wt.$\%$ LiO$_{2}$-doped Kuraray Y11-200(M) fiber bundles and the neutron absorption layers. We demonstrate that the LiO$_{2}$-doped plastic scintillating fiber bundles are instrumental for the detection of thermal/epithermal neutrons in diverse applications.


title: Emergent Complexity in the Decision-Making Process of Chess Players

abstract: In this article, we study the decision-making process of chess players by using a chess engine to evaluate the moves across different pools of games. We quantify the decisiveness of each move during the games using a metric called $\Delta$, which is derived from the engine's evaluation of the positions. We then performed a comparative analysis across players of varying competitive levels. Firstly, we observed that players face a wide spectrum of $\Delta$ values, evidencing the complexity of the process. By examining groups of winning and losing players, we found evidence where a decrease in complexity may be associated with a drop in player performance levels. Secondly, we observed that players' accuracy increases in positions with high $\Delta$ values regardless of competitive level. Complementing this information with a null model where players make completely random legal moves allowed us to characterize the decision-making process under the simple strategy of making moves that minimize $\Delta$ values. Finally, based on this idea, we proposed a simple model that approximately replicates the global emergent properties of the system.


title: How Does Culture Evolve?

abstract: This chapter synthesizes evidence from cognitive science, evolutionary theory, anthropology, psychological studies, and computational models for a complex systems inspired theory of creativity, and its role in cultural evolution. Creativity is guided by the global shape of one's integrated network of memories, concepts, and beliefs: one's worldview. This integrated structure and its dynamical change over time are described using autocatalytic networks. Autocatalytic networks can interact with each other, and they can grow and evolve; through interactions between their components, they generate novel components. Thus, they are used to describe cultural change both within and between individuals, as well as across cultural lineages. The chapter outlines autocatalytic network models of the origin of culture, the cognitive developmental process by which each child becomes a participant in cultural evolution, and the role of imitation, leadership, and social media on cultural evolution, as well as the trade-off between creativity and continuity.


title: RadEx: A Framework for Structured Information Extraction from Radiology Reports based on Large Language Models

abstract: Annually and globally, over three billion radiography examinations and computer tomography scans result in mostly unstructured radiology reports containing free text. Despite the potential benefits of structured reporting, its adoption is limited by factors such as established processes, resource constraints and potential loss of information. However, structured information would be necessary for various use cases, including automatic analysis, clinical trial matching, and prediction of health outcomes. This study introduces RadEx, an end-to-end framework comprising 15 software components and ten artifacts to develop systems that perform automated information extraction from radiology reports. It covers the complete process from annotating training data to extracting information by offering a consistent generic information model and setting boundaries for model development. Specifically, RadEx allows clinicians to define relevant information for clinical domains (e.g., mammography) and to create report templates. The framework supports both generative and encoder-only models and the decoupling of information extraction from template filling enables independent model improvements. Developing information extraction systems according to the RadEx framework facilitates implementation and maintenance as components are easily exchangeable, while standardized artifacts ensure interoperability between components.


title: High-order and adaptive optical conductivity calculations using Wannier interpolation

abstract: We present an automatic, high-order accurate, and adaptive Brillouin zone integration algorithm for the calculation of the optical conductivity with a non-zero but small broadening factor $\eta$, focusing on the case in which a Hamiltonian in a downfolded model can be evaluated efficiently using Wannier interpolation. The algorithm uses iterated adaptive integration to exploit the localization of the transport distribution near energy and energy-difference iso-surfaces, yielding polylogarithmic computational complexity with respect to $\eta$. To demonstrate the method, we compute the AC optical conductivity of a three-band tight-binding model, and are able to resolve the Drude and interband peaks with broadening in the sub-meV regime to several digits of accuracy. Our algorithm automates convergence testing to a user-specified error tolerance, providing an important tool in black-box first-principles calculations of electrical transport phenomena and other response functions.


title: Impedance Spectroscopy for Electroceramics and Electrochemical System

abstract: This tutorial review focuses on the basic theoretical backgrounds, their working principles, and implementation of impedance spectroscopy in both electroceramics and electrochemical research and technological applications. Various contributions to the impedance, admittance, dielectric, and conductivity characteristics of electroceramic materials can be disentangled and independently characterized with the help of impedance spectroscopy as a function of frequency and temperature. In polycrystalline materials, the impedance, charge transport/ conduction mechanism, and the macroscopic dielectric properties i.e., dielectric constant and loss are typically composed of many contributions, including the bulk or grain resistance/capacitance, grain boundary, and sample-electrode interface effect. Similarly, electrochemical impedance spectroscopy (EIS) endeavors to the charging kinetics, diffusion, and mechanical impact of various electrochemical systems widely used in energy storage (i.e., supercapacitor, battery), corrosion resistance, chemical and bio-sensing, diagnostics, etc. in electrolytes as a function of frequency. The understanding of various contributions in the EIS spectra i.e., kinetic control, mass control, and diffusion control is essential for their practical implications. It is demonstrated that electrochemical and electroceramics impedance spectroscopy is an effective method to explain and simulate such behavior. Deconvolute these contributions to obtain a detailed understanding of the functionality of polycrystalline electroceramic materials. This short review aims to endow the expertise of senior researchers in many fields where both EIS (electrochemical and ceramics) are involved, as well as to provide the necessary background information for junior researchers working in these fields.


title: Reasoning or Simply Next Token Prediction? A Benchmark for Stress-Testing Large Language Models

abstract: We propose MMLU-SR, a novel dataset designed to measure the true comprehension abilities of Large Language Models (LLMs) by challenging their performance in question-answering tasks with modified terms. We reasoned that an agent that ``truly'' understands a concept can still evaluate it when key terms are replaced by suitably defined alternate terms, and sought to differentiate such comprehension from mere text replacement. In our study, we modified standardized test questions by replacing a key term with a dummy word along with its definition. The key term could be in the context of questions, answers, or both questions and answers. Notwithstanding the high scores achieved by recent popular LLMs on the MMLU leaderboard, we found a substantial reduction in model performance after such replacement, suggesting poor comprehension. This new benchmark provides a rigorous benchmark for testing true model comprehension, and poses a challenge to the broader scientific community.


title: SimXRD-4M: Big Simulated X-ray Diffraction Data Accelerate the Crystalline Symmetry Classification

abstract: Spectroscopic data, particularly diffraction data, contain detailed crystal and microstructure information and thus are crucial for materials discovery. Powder X-ray diffraction (XRD) patterns are greatly effective in identifying crystals. Although machine learning (ML) has significantly advanced the analysis of powder XRD patterns, the progress is hindered by a lack of training data. To address this, we introduce SimXRD, the largest open-source simulated XRD pattern dataset so far, to accelerate the development of crystallographic informatics. SimXRD comprises 4,065,346 simulated powder X-ray diffraction patterns, representing 119,569 distinct crystal structures under 33 simulated conditions that mimic real-world variations. We find that the crystal symmetry inherently follows a long-tailed distribution and evaluate 21 sequence learning models on SimXRD. The results indicate that existing neural networks struggle with low-frequency crystal classifications. The present work highlights the academic significance and the engineering novelty of simulated XRD patterns in this interdisciplinary field.


title: Mental Disorder Classification via Temporal Representation of Text

abstract: Mental disorders pose a global challenge, aggravated by the shortage of qualified mental health professionals. Mental disorder prediction from social media posts by current LLMs is challenging due to the complexities of sequential text data and the limited context length of language models. Current language model-based approaches split a single data instance into multiple chunks to compensate for limited context size. The predictive model is then applied to each chunk individually, and the most voted output is selected as the final prediction. This results in the loss of inter-post dependencies and important time variant information, leading to poor performance. We propose a novel framework which first compresses the large sequence of chronologically ordered social media posts into a series of numbers. We then use this time variant representation for mental disorder classification. We demonstrate the generalization capabilities of our framework by outperforming the current SOTA in three different mental conditions: depression, self-harm, and anorexia, with an absolute improvement of 5% in the F1 score. We investigate the situation where current data instances fall within the context length of language models and present empirical results highlighting the importance of temporal properties of textual data. Furthermore, we utilize the proposed framework for a cross-domain study, exploring commonalities across disorders and the possibility of inter-domain data usage.


title: Improving Large Models with Small models: Lower Costs and Better Performance

abstract: Pretrained large models (PLMs), such as ChatGPT, have demonstrated remarkable performance across diverse tasks. However, the significant computational requirements of PLMs have discouraged most product teams from running or fine-tuning them. In such cases, to harness the exceptional performance of PLMs, one must rely on expensive APIs, thereby exacerbating the economic burden. Despite the overall inferior performance of small models, in specific distributions, they can achieve comparable or even superior results. Consequently, some input can be processed exclusively by small models. On the other hand, certain tasks can be broken down into multiple subtasks, some of which can be completed without powerful capabilities. Under these circumstances, small models can handle the simple subtasks, allowing large models to focus on challenging subtasks, thus improving the performance. We propose Data Shunt$^+$ (DS$^+$), a general paradigm for collaboration of small and large models. DS$^+$ not only substantially reduces the cost associated with querying large models but also effectively improves large models' performance. For instance, ChatGPT achieves an accuracy of $94.43\%$ on Amazon Product sentiment analysis, and DS$^+$ achieves an accuracy of $95.64\%$, while the cost has been reduced to only $31.18\%$. Besides, experiments also prove that the proposed collaborative-based paradigm can better inject specific task knowledge into PLMs compared to fine-tuning.


title: Hyperbolic sentence representations for solving Textual Entailment

abstract: Hyperbolic spaces have proven to be suitable for modeling data of hierarchical nature. As such we use the Poincare ball to embed sentences with the goal of proving how hyperbolic spaces can be used for solving Textual Entailment. To this end, apart from the standard datasets used for evaluating textual entailment, we developed two additional datasets. We evaluate against baselines of various backgrounds, including LSTMs, Order Embeddings and Euclidean Averaging, which comes as a natural counterpart to representing sentences into the Euclidean space. We consistently outperform the baselines on the SICK dataset and are second only to Order Embeddings on the SNLI dataset, for the binary classification version of the entailment task.


title: Intertwining CP and NLP: The Generation of Unreasonably Constrained Sentences

abstract: Constrained text generation remains a challenging task, particularly when dealing with hard constraints. Traditional Natural Language Processing (NLP) approaches prioritize generating meaningful and coherent output. Also, the current state-of-the-art methods often lack the expressiveness and constraint satisfaction capabilities to handle such tasks effectively. This paper presents the Constraints First Framework to remedy this issue. This framework considers a constrained text generation problem as a discrete combinatorial optimization problem. It is solved by a constraint programming method that combines linguistic properties (e.g., n-grams or language level) with other more classical constraints (e.g., the number of characters, syllables, or words). Eventually, a curation phase allows for selecting the best-generated sentences according to perplexity using a large language model. The effectiveness of this approach is demonstrated by tackling a new more tediously constrained text generation problem: the iconic RADNER sentences problem. This problem aims to generate sentences respecting a set of quite strict rules defined by their use in vision and clinical research. Thanks to our CP-based approach, many new strongly constrained sentences have been successfully generated in an automatic manner. This highlights the potential of our approach to handle unreasonably constrained text generation scenarios.


title: WundtGPT: Shaping Large Language Models To Be An Empathetic, Proactive Psychologist

abstract: Large language models (LLMs) are raging over the medical domain, and their momentum has carried over into the mental health domain, leading to the emergence of few mental health LLMs. Although such mental health LLMs could provide reasonable suggestions for psychological counseling, how to develop an authentic and effective doctor-patient relationship (DPR) through LLMs is still an important problem. To fill this gap, we dissect DPR into two key attributes, i.e., the psychologist's empathy and proactive guidance. We thus present WundtGPT, an empathetic and proactive mental health large language model that is acquired by fine-tuning it with instruction and real conversation between psychologists and patients. It is designed to assist psychologists in diagnosis and help patients who are reluctant to communicate face-to-face understand their psychological conditions. Its uniqueness lies in that it could not only pose purposeful questions to guide patients in detailing their symptoms but also offer warm emotional reassurance. In particular, WundtGPT incorporates Collection of Questions, Chain of Psychodiagnosis, and Empathy Constraints into a comprehensive prompt for eliciting LLMs' questions and diagnoses. Additionally, WundtGPT proposes a reward model to promote alignment with empathetic mental health professionals, which encompasses two key factors: cognitive empathy and emotional empathy. We offer a comprehensive evaluation of our proposed model. Based on these outcomes, we further conduct the manual evaluation based on proactivity, effectiveness, professionalism and coherence. We notice that WundtGPT can offer professional and effective consultation. The model is available at huggingface.


title: Green pathway of Urea Synthesis through Plasma-Ice Interaction Optimization and Mechanistic Insights with N2 + CO2 and NH3 + CO2 Gas Mixtures

abstract: This study explores a green pathway for urea synthesis using plasma-ice interaction with gas mixtures of N2 + CO2 and NH3 + CO2. Electrical and optical emission spectroscopy were employed to characterize the plasmas, revealing that urea formation involves complex reactions driven by high-energy species, producing reactive nitrogen and carbon intermediates that further react to form urea. Physicochemical analyses of plasma-treated ice showed increased pH, electrical conductivity (EC), and reduced oxidation-reduction potential (ORP). Optimization of plasma process parameters (gas pressure, applied voltage, and treatment time) was performed to enhance urea formation. Among these parameters, plasma treatment time had the most substantial influence. Increasing treatment time from 20 to 60 minutes significantly impacted physicochemical properties: for N2 + CO2 plasma, pH increased by 21.05%, EC by 184.7%, and ORP decreased by 27.48%; for NH3 + CO2 plasma, pH increased by 27.37%, EC by 239.05%, and ORP decreased by 72.67%, respectively. The study shows that NH3 + CO2 plasma produces a significantly higher concentration of urea (7.7 mg L-1) compared to N2 + CO2 plasma (0.55 mg L-1). This is attributed to the direct availability and reactivity of ammonia, which simplifies reaction pathways and enhances intermediate formation. These findings highlight the potential of plasma-ice interaction as an energy-efficient and environmentally friendly method for urea synthesis, offering a sustainable alternative to conventional processes.


title: Self-Regulated Data-Free Knowledge Amalgamation for Text Classification

abstract: Recently, there has been a growing availability of pre-trained text models on various model repositories. These models greatly reduce the cost of training new models from scratch as they can be fine-tuned for specific tasks or trained on large datasets. However, these datasets may not be publicly accessible due to the privacy, security, or intellectual property issues. In this paper, we aim to develop a lightweight student network that can learn from multiple teacher models without accessing their original training data. Hence, we investigate Data-Free Knowledge Amalgamation (DFKA), a knowledge-transfer task that combines insights from multiple pre-trained teacher models and transfers them effectively to a compact student network. To accomplish this, we propose STRATANET, a modeling framework comprising: (a) a steerable data generator that produces text data tailored to each teacher and (b) an amalgamation module that implements a self-regulative strategy using confidence estimates from the teachers' different layers to selectively integrate their knowledge and train a versatile student. We evaluate our method on three benchmark text classification datasets with varying labels or domains. Empirically, we demonstrate that the student model learned using our STRATANET outperforms several baselines significantly under data-driven and data-free constraints.


title: CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics

abstract: In the field of crisis/disaster informatics, social media is increasingly being used for improving situational awareness to inform response and relief efforts. Efficient and accurate text classification tools have been a focal area of investigation in crisis informatics. However, current methods mostly rely on single-label text classification models, which fails to capture different insights embedded in dynamic and multifaceted disaster-related social media data. This study introduces a novel approach to disaster text classification by enhancing a pre-trained Large Language Model (LLM) through instruction fine-tuning targeted for multi-label classification of disaster-related tweets. Our methodology involves creating a comprehensive instruction dataset from disaster-related tweets, which is then used to fine-tune an open-source LLM, thereby embedding it with disaster-specific knowledge. This fine-tuned model can classify multiple aspects of disaster-related information simultaneously, such as the type of event, informativeness, and involvement of human aid, significantly improving the utility of social media data for situational awareness in disasters. The results demonstrate that this approach enhances the categorization of critical information from social media posts, thereby facilitating a more effective deployment for situational awareness during emergencies. This research paves the way for more advanced, adaptable, and robust disaster management tools, leveraging the capabilities of LLMs to improve real-time situational awareness and response strategies in disaster scenarios.


title: Impact of the Top SiO2 Interlayer Thickness on Memory Window of Si Channel FeFET with TiN/SiO2/Hf0.5Zr0.5O2/SiOx/Si (MIFIS) Gate Structure

abstract: We study the impact of top SiO2 interlayer thickness on the memory window (MW) of Si channel ferroelectric field-effect transistor (FeFET) with TiN/SiO2/Hf0.5Zr0.5O2/SiOx/Si (MIFIS) gate structure. We find that the MW increases with the increasing thickness of the top SiO2 interlayer, and such an increase exhibits a two-stage linear dependence. The physical origin is the presence of the different interfacial charges trapped at the top SiO2/Hf0.5Zr0.5O2 interface. Moreover, we investigate the dependence of endurance characteristics on initial MW. We find that the endurance characteristic degrades with increasing the initial MW. By inserting a 3.4 nm SiO2 dielectric interlayer between the gate metal TiN and the ferroelectric Hf0.5Zr0.5O2, we achieve a MW of 6.3 V and retention over 10 years. Our work is helpful in the device design of FeFET.


title: Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging

abstract: In the era of large language models, model merging is a promising way to combine multiple task-specific models into a single multitask model without extra training. However, two challenges remain: (a) interference between different models and (b) heterogeneous data during testing. Traditional model merging methods often show significant performance gaps compared to fine-tuned models due to these issues. Additionally, a one-size-fits-all model lacks flexibility for diverse test data, leading to performance degradation. We show that both shared and exclusive task-specific knowledge are crucial for merging performance, but directly merging exclusive knowledge hinders overall performance. In view of this, we propose Twin-Merging, a method that encompasses two principal stages: (1) modularizing knowledge into shared and exclusive components, with compression to reduce redundancy and enhance efficiency; (2) dynamically merging shared and task-specific knowledge based on the input. This approach narrows the performance gap between merged and fine-tuned models and improves adaptability to heterogeneous data. Extensive experiments on $12$ datasets for both discriminative and generative tasks demonstrate the effectiveness of our method, showing an average improvement of $28.34\%$ in absolute normalized score for discriminative tasks and even surpassing the fine-tuned upper bound on the generative tasks. (Our implementation is available in https://github.com/LZY-the-boys/Twin-Mergin.)


title: On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion

abstract: Efficient fine-tuning of large language models for task-specific applications is imperative, yet the vast number of parameters in these models makes their training increasingly challenging. Despite numerous proposals for effective methods, a substantial memory overhead remains for gradient computations during updates. \thm{Can we fine-tune a series of task-specific small models and transfer their knowledge directly to a much larger model without additional training?} In this paper, we explore weak-to-strong specialization using logit arithmetic, facilitating a direct answer to this question. Existing weak-to-strong methods often employ a static knowledge transfer ratio and a single small model for transferring complex knowledge, which leads to suboptimal performance. % To address this, To surmount these limitations, we propose a dynamic logit fusion approach that works with a series of task-specific small models, each specialized in a different task. This method adaptively allocates weights among these models at each decoding step, learning the weights through Kullback-Leibler divergence constrained optimization problems. We conduct extensive experiments across various benchmarks in both single-task and multi-task settings, achieving leading results. By transferring expertise from the 7B model to the 13B model, our method closes the performance gap by 96.4\% in single-task scenarios and by 86.3\% in multi-task scenarios compared to full fine-tuning of the 13B model. Notably, we achieve surpassing performance on unseen tasks. Moreover, we further demonstrate that our method can effortlessly integrate in-context learning for single tasks and task arithmetic for multi-task scenarios. (Our implementation is available in https://github.com/Facico/Dynamic-Logit-Fusion.)


title: CSRT: Evaluation and Analysis of LLMs using Code-Switching Red-Teaming Dataset

abstract: Recent studies in large language models (LLMs) shed light on their multilingual ability and safety, beyond conventional tasks in language modeling. Still, current benchmarks reveal their inability to comprehensively evaluate them and are excessively dependent on manual annotations. In this paper, we introduce code-switching red-teaming (CSRT), a simple yet effective red-teaming technique that simultaneously tests multilingual understanding and safety of LLMs. We release the CSRT dataset, which comprises 315 code-switching queries combining up to 10 languages and eliciting a wide range of undesirable behaviors. Through extensive experiments with ten state-of-the-art LLMs, we demonstrate that CSRT significantly outperforms existing multilingual red-teaming techniques, achieving 46.7% more attacks than existing methods in English. We analyze the harmful responses toward the CSRT dataset concerning various aspects under ablation studies with 16K samples, including but not limited to scaling laws, unsafe behavior categories, and input conditions for optimal data generation. Additionally, we validate the extensibility of CSRT, by generating code-switching attack prompts with monolingual data.


title: Blockchain for Academic Integrity: Developing the Blockchain Academic Credential Interoperability Protocol (BACIP)

abstract: This research introduces the Blockchain Academic Credential Interoperability Protocol (BACIP), designed to significantly enhance the security, privacy, and interoperability of verifying academic credentials globally, addressing the widespread issue of academic fraud. BACIP integrates dual blockchain architecture, smart contracts, and zero-knowledge proofs to offer a scalable and transparent framework aimed at reducing fraud and improving the mobility and opportunities for students and professionals worldwide. The research methodology adopts a mixed-methods approach, involving a rigorous review of pertinent literature and systematic integration of advanced technological components. This includes both qualitative and quantitative analyses that underpin the development of a universally compatible system. Preliminary evaluations suggest that BACIP could enhance verification efficiency and bolster security against tampering and unauthorized access. While the theoretical framework and practical implementations have laid a solid foundation, the protocol's real-world efficacy awaits empirical validation in a production environment. Future research will focus on deploying a prototype, establishing robust validation policies, and defining precise testing parameters. This critical phase is indispensable for a thorough assessment of BACIP's operational robustness and its compliance with international educational standards. This work contributes significantly to the academic field by proposing a robust model for managing and safeguarding academic credentials, thus laying a strong foundation for further innovation in credential verification using blockchain technology.


title: Duplicate Detection with GenAI

abstract: Customer data is often stored as records in Customer Relations Management systems (CRMs). Data which is manually entered into such systems by one of more users over time leads to data replication, partial duplication or fuzzy duplication. This in turn means that there no longer a single source of truth for customers, contacts, accounts, etc. Downstream business processes become increasing complex and contrived without a unique mapping between a record in a CRM and the target customer. Current methods to detect and de-duplicate records use traditional Natural Language Processing techniques known as Entity Matching. In this paper we show how using the latest advancements in Large Language Models and Generative AI can vastly improve the identification and repair of duplicated records. On common benchmark datasets we find an improvement in the accuracy of data de-duplication rates from 30 percent using NLP techniques to almost 60 percent using our proposed method.


title: JobFair: A Framework for Benchmarking Gender Hiring Bias in Large Language Models

abstract: This paper presents a novel framework for benchmarking hierarchical gender hiring bias in Large Language Models (LLMs) for resume scoring, revealing significant issues of reverse bias and overdebiasing. Our contributions are fourfold: First, we introduce a framework using a real, anonymized resume dataset from the Healthcare, Finance, and Construction industries, meticulously used to avoid confounding factors. It evaluates gender hiring biases across hierarchical levels, including Level bias, Spread bias, Taste-based bias, and Statistical bias. This framework can be generalized to other social traits and tasks easily. Second, we propose novel statistical and computational hiring bias metrics based on a counterfactual approach, including Rank After Scoring (RAS), Rank-based Impact Ratio, Permutation Test-Based Metrics, and Fixed Effects Model-based Metrics. These metrics, rooted in labor economics, NLP, and law, enable holistic evaluation of hiring biases. Third, we analyze hiring biases in ten state-of-the-art LLMs. Six out of ten LLMs show significant biases against males in healthcare and finance. An industry-effect regression reveals that the healthcare industry is the most biased against males. GPT-4o and GPT-3.5 are the most biased models, showing significant bias in all three industries. Conversely, Gemini-1.5-Pro, Llama3-8b-Instruct, and Llama3-70b-Instruct are the least biased. The hiring bias of all LLMs, except for Llama3-8b-Instruct and Claude-3-Sonnet, remains consistent regardless of random expansion or reduction of resume content. Finally, we offer a user-friendly demo to facilitate adoption and practical application of the framework.


title: SegHist: A General Segmentation-based Framework for Chinese Historical Document Text Line Detection

abstract: Text line detection is a key task in historical document analysis facing many challenges of arbitrary-shaped text lines, dense texts, and text lines with high aspect ratios, etc. In this paper, we propose a general framework for historical document text detection (SegHist), enabling existing segmentation-based text detection methods to effectively address the challenges, especially text lines with high aspect ratios. Integrating the SegHist framework with the commonly used method DB++, we develop DB-SegHist. This approach achieves SOTA on the CHDAC, MTHv2, and competitive results on HDRC datasets, with a significant improvement of 1.19% on the most challenging CHDAC dataset which features more text lines with high aspect ratios. Moreover, our method attains SOTA on rotated MTHv2 and rotated HDRC, demonstrating its rotational robustness. The code is available at https://github.com/LumionHXJ/SegHist.


title: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention

abstract: Large language models (LLMs) now support extremely long context windows, but the quadratic complexity of vanilla attention results in significantly long Time-to-First-Token (TTFT) latency. Existing approaches to address this complexity require additional pretraining or finetuning, and often sacrifice model accuracy. In this paper, we first provide both theoretical and empirical foundations for near-lossless sparse attention. We find dynamically capturing head-specific sparse patterns at runtime with low overhead is crucial. To address this, we propose SampleAttention, an adaptive structured and near-lossless sparse attention. Leveraging observed significant sparse patterns, SampleAttention attends to a fixed percentage of adjacent tokens to capture local window patterns, and employs a two-stage query-guided key-value filtering approach, which adaptively select a minimum set of key-values with low overhead, to capture column stripe patterns. Comprehensive evaluations show that SampleAttention can seamlessly replace vanilla attention in off-the-shelf LLMs with nearly no accuracy loss, and reduces TTFT by up to $2.42\times$ compared with FlashAttention.


title: Improving Text-To-Audio Models with Synthetic Captions

abstract: It is an open challenge to obtain high quality training data, especially captions, for text-to-audio models. Although prior methods have leveraged \textit{text-only language models} to augment and improve captions, such methods have limitations related to scale and coherence between audio and captions. In this work, we propose an audio captioning pipeline that uses an \textit{audio language model} to synthesize accurate and diverse captions for audio at scale. We leverage this pipeline to produce a dataset of synthetic captions for AudioSet, named \texttt{AF-AudioSet}, and then evaluate the benefit of pre-training text-to-audio models on these synthetic captions. Through systematic evaluations on AudioCaps and MusicCaps, we find leveraging our pipeline and synthetic captions leads to significant improvements on audio generation quality, achieving a new \textit{state-of-the-art}.


title: Orangutan: A Multiscale Brain Emulation-Based Artificial Intelligence Framework for Dynamic Environments

abstract: Achieving General Artificial Intelligence (AGI) has long been a grand challenge in the field of AI, and brain-inspired computing is widely acknowledged as one of the most promising approaches to realize this goal. This paper introduces a novel brain-inspired AI framework, Orangutan. It simulates the structure and computational mechanisms of biological brains on multiple scales, encompassing multi-compartment neuron architectures, diverse synaptic connection modalities, neural microcircuits, cortical columns, and brain regions, as well as biochemical processes including facilitation, feedforward inhibition, short-term potentiation, and short-term depression, all grounded in solid neuroscience. Building upon these highly integrated brain-like mechanisms, I have developed a sensorimotor model that simulates human saccadic eye movements during object observation. The model's algorithmic efficacy was validated through testing with the observation of handwritten digit images.


title: A Flexible Cryptographic Infrastructure for High-security SDR-based Systems

abstract: Military software defined radio (SDR) systems are a major factor in future network-centric operations due to their flexibility and support for more capable radio communications systems. The inherent nature of software-based systems requires a more complex auxiliary infrastructure and multiple independent levels of security compared with typical systems: Secure booting of the SDR device, cryptographically signed software, real time operating platform software as well as radio applications. This technology raises new challenges with respect to the management. The largest impact on SDR deployments is due to the auxiliary cryptographic infrastructure for the security of the software life cycle and the cyclic update of the keys. Compared to conventional radio devices, the SDR system with the cryptographic infrastructure described in this paper reaches a higher security level and is more flexible. The advantage is the possibility to deploy trunked radio system and further waveforms, such as coalition wideband, which will be standardized in the future. Also it is possible to update cryptographic mechanisms. In this work, we analyze the requirements for a high secure SDR deployment and model the life cycle of the components of a deployed SDR node based on the Joint Program Executive Office (JPEO) Software Communication Architecture (SCA).


title: Causal Discovery Inspired Unsupervised Domain Adaptation for Emotion-Cause Pair Extraction

abstract: This paper tackles the task of emotion-cause pair extraction in the unsupervised domain adaptation setting. The problem is challenging as the distributions of the events causing emotions in target domains are dramatically different than those in source domains, despite the distributions of emotional expressions between domains are overlapped. Inspired by causal discovery, we propose a novel deep latent model in the variational autoencoder (VAE) framework, which not only captures the underlying latent structures of data but also utilizes the easily transferable knowledge of emotions as the bridge to link the distributions of events in different domains. To facilitate knowledge transfer across domains, we also propose a novel variational posterior regularization technique to disentangle the latent representations of emotions from those of events in order to mitigate the damage caused by the spurious correlations related to the events in source domains. Through extensive experiments, we demonstrate that our model outperforms the strongest baseline by approximately 11.05% on a Chinese benchmark and 2.45% on a English benchmark in terms of weighted-average F1 score. The source code will be publicly available upon acceptance.


title: Vibrational Entropy and Free Energy of Solid Lithium using Covariance of Atomic Displacements Enabled by Machine Learning

abstract: Vibrational properties of solids are key to determining stability, response and functionality. However, they are challenging to computationally predict at Ab-Initio accuracy, even for elemental systems. Ab-Initio methods for modeling atomic interactions are limited in the system sizes and simulation times that can be achieved. Due to these limitations, Machine Learning Interatomic Potentials (MLIPs) are gaining popularity and success as a faster, more scalable approach for modeling atomic interactions, potentially at Ab-Initio accuracy. Even with faster potentials, methodologies for predicting entropy, free energy and vibrational properties vary in accuracy, cost and difficulty to implement. Using the Covariance of Atomic Displacements (CAD) to predict entropy, free energy and finite-temperature phonon dispersions is a promising approach but thorough benchmarking has been hampered by the cost of Ab-Initio methods for sampling. In this work, we use a MLIP and the CAD to characterize the convergence of the predicted properties and determine optimal sampling strategies. We focus on solid lithium at zero pressure, showing that the MLIP-CAD approach reproduces experimental entropy, phonon dispersions and the martensitic transition while also comparing to more established methods.


title: On the Principles behind Opinion Dynamics in Multi-Agent Systems of Large Language Models

abstract: We study the evolution of opinions inside a population of interacting large language models (LLMs). Every LLM needs to decide how much funding to allocate to an item with three initial possibilities: full, partial, or no funding. We identify biases that drive the exchange of opinions based on the LLM's tendency to (i) find consensus with the other LLM's opinion, (ii) display caution when specifying funding, and (iii) consider ethical concerns in its opinion. We find these biases are affected by the perceived absence of compelling reasons for opinion change, the perceived willingness to engage in discussion, and the distribution of allocation values. Moreover, tensions among biases can lead to the survival of funding for items with negative connotations. We also find that the final distribution of full, partial, and no funding opinions is more diverse when an LLM freely forms its opinion after an interaction than when its opinion is a multiple-choice selection among the three allocation options. In the latter case, consensus or polarization is generally attained. When agents are aware of past opinions, they seek to maintain consistency with them, and more diverse updating rules emerge. Our study is performed using a Llama 3 LLM.


title: Exploring Study Abroad with Traditionally Underrepresented Populations: Impacts of Institutional Types

abstract: The study investigated roles of institutional types and ethnic/racial background on academic credit among the traditionally underrepresented population of the U.S. study abroad program. Using archival data, the study sampled the students' enrollment and academic credit information spanning a period of 20 years (2003 - 2022). Data analysis Using One-Way Analysis of Variance (ANOVA) indicates significant main influence of institutional type (p<.001) and significant main influence of ethnic/racial identity (p<.001) on students' academic credit. The result was discussed in terms of its relevance in educational policy re-evaluations, improvement of the study conditions of the underrepresented students, and enhancement of the enrollment opportunities of these minority population across all U.S. institutions of learning


title: Simple Cracking of (Noise-Based) Dynamic Watermarking in Smart Grids

abstract: Previous research employing a conceptual approach with a digital twin has demonstrated that (noise-based) dynamic watermarking is incapable of providing unconditional security in smart electrical grid systems. However, the implementation of digital twins can be prohibitively costly or infeasible due to limited available data on critical infrastructure. In this study, we first analyze the spectral properties of dynamic watermarking and its associated protocol. Subsequently, we present a straightforward attack inspired by the digital twin method, which extracts and utilizes the grid noises and completely breaches the security of dynamic watermarking without requiring knowledge of the private watermarking signal. The attacker can fully expose the grid while evading detection by the controller. Our findings indicate that in the absence of secure and authenticated communications, dynamic watermarking offers neither conditional nor unconditional security. Conversely, when communication lines, sensors, and communicators are equipped with tamper-resistant and secure/authenticated links, dynamic watermarking becomes redundant for grid security.


title: Comment on "ENN's roadmap for proton-boron fusion based on spherical torus" [Phys. Plasmas 31, 062507 (2024)]

abstract: This comment discusses the feasibility of hot ion mode ${{T}_{i}}/{{T}_{e}}=4$ for proton-boron fusion which is critical for the roadmap proposed in Liu, M et al [Phys. Plasmas 31, 062507 (2024)]. The hot ion mode ${{T}_{i}}/{{T}_{e}}=4$ has been calculated to be far from accessible (${{T}_{i}}/{{T}_{e}}<1.5$ for ${{T}_{i}}=150\text{keV}$) under the most optimal conditions if fusion provides the heating (Xie, H [Introduction to Fusion Ignition Principles: Zeroth Order Factors of Fusion Energy Research (in Chinese), USTC Press, Hefei, 2023]), i.e., that all fusion power serves to heat the ions and that electrons acquire energy only through interactions with ions. We also discuss if hot ion mode of ${{T}_{i}}/{{T}_{e}}=4$ could be achieved by an ideal heating method which is much more efficient than fusion itself and only heats the ions, whether it makes sense economically.


title: A Note for CPS Data-driven Approaches Developed in the IDS Lab

abstract: The rapid evolution of Cyber-Physical Systems (CPS) across various domains like mobility systems, networked control systems, sustainable manufacturing, smart power grids, and the Internet of Things necessitates innovative solutions that merge control and learning [1]. Traditional model-based control methodologies often fail to adapt to the dynamism and complexity of modern CPS. This report outlines a comprehensive approach undertaken by the Information and Decision Science (IDS) Lab, focusing on integrating data-driven techniques with control strategies to enhance CPS performance, particularly in the context of energy efficiency and environmental impact. CPS are intricate networks where physical and software components are deeply intertwined, operating as systems of systems. These systems are characterized by their informationally decentralized nature, posing significant challenges in optimization and control. Classical control methods depend heavily on precise models, which often do not capture the full complexity of real-world CPS. As these systems generate large volumes of real-time data, there is a growing need for control algorithms that can leverage this data effectively. The IDS Lab is at the forefront of developing such data-driven approaches for CPS.


title: Wide Binaries, Retardation and the External Field Effect

abstract: A low acceleration gravitational anomaly was reported for wide binaries: two binary stars which are separated by more than five kilo astronomical units (kau). The increase in gravitational force was reported to be about $1.37$ greater than Newtonian gravity. At the same time binaries separated less than one kau were shown to obey standard Newtonian gravity. A possible explanation for this was given in the framework of MOND correction to gravity which is applicable for low acceleration. However, it was noticed that the explanation is only adequate in the framework of Milgromian AQUAL theory which considers the "external field effect" that is the effect of the gravitational field of the rest of the galaxy on the binary system. Recently it was shown that many "anomalous gravity" effects can be explained in the framework of general relativity and its weak field approximation. It was shown that anomalous galaxy rotation curves, anomalous gravitational lensing and the Tully-Fisher relations can be understood in terms of retarded gravity. Moreover, the anomalous mass of galaxy clusters derived from the virial theorem was also shown to be a retarded gravity effect. On the other hand, it was shown that retarded effects are not important in the solar system and the correction to the anomalous shift of Mercury's perihelion is connected with the motion of the solar center of mass with respect to the sun and not to retardation. It is desirable to investigate if the wide binary acceleration gravitational anomaly can be explained in the framework of Einstein-Newton general relativity. We show that the scale of five kau separation arises naturally within such a theory if the effect of the galaxy on the wide binary is considered (a Newtonian external field effect) suggesting the anomaly found can be explained without the need to invoke theoretical modifications of the accepted theory.


title: An Integration of policy and reputation based trust mechanisms

abstract: Due to popularization of internet and e-commerce, more and more people getting involved in online shopping market. A large number of companies have been transferred to the internet where online customers have been increased due to easy access. The online business facilitates people to communicate without knowing each other. The e-commerce systems are the combination of commerce behavior and internet technologies. Therefore, trust aspects are positive elements in buyer-seller transactions and a potential source of competitive e-commerce industry. There are two different approaches to handle the trust. The first approach has a solid authentication set of rules where decisions are made on some digital or logical rules called policy based trust mechanism. The second approach is a decentralized trust approach where reputation assembled and shared in distributed environment called reputation based trust mechanism. Objectives: In this thesis, the strengths and weaknesses of policy and reputation based trust mechanisms have been identified through systematic literature review and industrial interviews. Furthermore, the process of integrated trust mechanism has been proposed. The integrated trust mechanism is proposed through mapping process, weakness of one mechanism with the strength of other. The proposed integrated trust mechanism was validated by conducting experiment with buyer/seller scenario in auction system. The analysis of collected results indicated that proposed integrated trust mechanism improved the trust of buyer against eBay and Tradera. At the end, we have discussed some key points that may affect trust relationship between seller and buyer. Furthermore, there is a need for further validation of proposed trust mechanism in auction system/e-commerce industry.


title: Exploring large language models for microstructure evolution in materials

abstract: There is a significant potential for coding skills to transition fully to natural language in the future. In this context, large language models (LLMs) have shown impressive natural language processing abilities to generate sophisticated computer code for research tasks in various domains. We report the first study on the applicability of LLMs to perform computer experiments on microstructure pattern formation in model materials. In particular, we exploit LLM's ability to generate code for solving various types of phase-field-based partial differential equations (PDEs) that integrate additional physics to model material microstructures. The results indicate that LLMs have a remarkable capacity to generate multi-physics code and can effectively deal with materials microstructure problems up to a certain complexity. However, for complex multi-physics coupled PDEs for which a detailed understanding of the problem is required, LLMs fail to perform the task efficiently, since much more detailed instructions with many iterations of the same query are required to generate the desired output. Nonetheless, at their current stage of development and potential future advancements, LLMs offer a promising outlook for accelerating materials education and research by supporting beginners and experts in their physics-based methodology. We hope this paper will spur further interest to leverage LLMs as a supporting tool in the integrated computational materials engineering (ICME) approach to materials modeling and design.


title: Hidden Variables unseen by Random Forests

abstract: Random Forests are widely claimed to capture interactions well. However, some simple examples suggest that they perform poorly in the presence of certain pure interactions that the conventional CART criterion struggles to capture during tree construction. We argue that simple alternative partitioning schemes used in the tree growing procedure can enhance identification of these interactions. In a simulation study we compare these variants to conventional Random Forests and Extremely Randomized trees. Our results validate that the modifications considered enhance the model's fitting ability in scenarios where pure interactions play a crucial role.


title: Secure Combination of Untrusted Time information Based on Optimized Dempster-Shafer Theory

abstract: Secure precision time synchronization is important for applications of Cyber-Physical Systems. However, several attacks, especially the Time Delay Attack (TDA), deteriorates the performance of time synchronization system seriously. Multiple paths scheme is thought as an effective security countermeasure to decrease the influence of TDA. However, the effective secure combination algorithm is still missed for precision time synchronization. In this paper, a secure combination algorithm based on Dempster-Shafer theory is proposed for multiple paths method. Special optimizations are done for the combination algorithm to solve the potential problems due to untrusted evidence. Theoretical simulation shows that the proposed algorithm works much better than Fault Tolerant Algorithm (FTA) and the attack detection method based on single path. And experimental demonstration proves the feasibility and superiority of the proposed algorithm, where the time stability with 27.97 ps, 1.57 ps, and 1.12 ps at average time 1s, 10s, 100s is achieved under TDA and local clock jump. The proposed algorithm can be used to improve the security and resilience of many importance synchronization protocol, such as NTP, PTP, and TWFTT.


title: Considerations about the measurement of the magnetic moment and electric dipole moment of the electron

abstract: The goal of the measurement of the magnetic moment of the electron $\mu$, is to experimentaly determine the gyromagnetic ratio. The factor $g/2$ is computed by the accurate measurement of two frequencies, the spin precession frequency $\nu_s$, and the cyclotron frequency $\nu_c$, and is defined as $\nu_s/\nu_c=g/2$. These experiments are performed with a single electron confined inside a Penning trap. The existence of the electric dipole moment ${d}_e$, involves the idea of an asymmetric charge distribution along the spin direction such that ${ d}_e=d_e{ S}/(\hbar/2)$. The energy shift $\Delta U=2{d}_eE_{eff}$ of the interaction of the electric dipole of electrons with a huge effective electric field ${E}_{eff}$, close to the nucleus of heavy neutral atoms or molecules, is determined by a spin precession measurement. By using a classical model of a spinning electron, which satisfies Dirac's equation when quantized, we determine classically the time average value of the electric and magnetic dipole moments of this electron model when moving in a uniform magnetic field and in a Penning trap, with the same fields as in the real experiments, and obtain an estimated value of these dipoles. We compare these results with the experimental data and make some interpretation of the measured dipoles.


title: Data representation with optimal transport

abstract: Optimal transport has been used to define bijective nonlinear transforms and different transport-related metrics for discriminating data and signals. Here we briefly describe the advances in this topic with the main applications and properties in each case.


title: Dr.E Bridges Graphs with Large Language Models through Words

abstract: Significant efforts have been directed toward integrating powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of vision, language, and audio data. However, the graph-structured data, inherently rich in structural and domain-specific knowledge, have not yet been gracefully adapted to LLMs. Existing methods either describe the graph with raw text, suffering the loss of graph structural information, or feed Graph Neural Network (GNN) embeddings directly into LLM at the cost of losing semantic representation. To bridge this gap, we introduce an innovative, end-to-end modality-aligning framework, equipped with a pretrained Dual-Residual Vector Quantized-Variational AutoEncoder (Dr.E). This framework is specifically designed to facilitate token-level alignment with LLMs, enabling an effective translation of the intrinsic `language' of graphs into comprehensible natural language. Our experimental evaluations on standard GNN node classification tasks demonstrate competitive performance against other state-of-the-art approaches. Additionally, our framework ensures interpretability, efficiency, and robustness, with its effectiveness further validated under both fine-tuning and few-shot settings. This study marks the first successful endeavor to achieve token-level alignment between GNNs and LLMs.


title: Integral Betti signature confirms the hyperbolic geometry of brain, climate, and financial networks

abstract: This paper extends the possibility to examine the underlying curvature of data through the lens of topology by using the Betti curves, tools of Persistent Homology, as key topological descriptors, building on the clique topology approach. It was previously shown that Betti curves distinguish random from Euclidean geometric matrices - i.e. distance matrices of points randomly distributed in a cube with Euclidean distance. In line with previous experiments, we consider their low-dimensional approximations named integral Betti values, or signatures that effectively distinguish not only Euclidean, but also spherical and hyperbolic geometric matrices, both from purely random matrices as well as among themselves. To prove this, we analyse the behaviour of Betti curves for various geometric matrices -- i.e. distance matrices of points randomly distributed on manifolds of constant sectional curvature, considering the classical models of curvature 0, 1, -1, given by the Euclidean space, the sphere, and the hyperbolic space. We further investigate the dependence of integral Betti signatures on factors including the sample size and dimension. This is important for assessment of real-world connectivity matrices, as we show that the standard approach to network construction gives rise to (spurious) spherical geometry, with topology dependent on sample dimensions. Finally, we use the manifolds of constant curvature as comparison models to infer curvature underlying real-world datasets coming from neuroscience, finance and climate. Their associated topological features exhibit a hyperbolic character: the integral Betti signatures associated to these datasets sit in between Euclidean and hyperbolic (of small curvature). The potential confounding ``hyperbologenic effect'' of intrinsic low-rank modular structures is also evaluated through simulations.

categories: math.AT physics.data-an q-bio.NC q-fin.CP


title: The next galactic supernova can uncover mass and couplings of particles decaying to neutrinos

abstract: Many particles predicted by extensions of the Standard Model feature interactions with neutrinos, e.g., Majoron-like bosons $\phi$. If the mass of $\phi$ is larger than about 10 keV, they can be produced abundantly in the core of the next galactic core-collapse supernova through neutrino coalescence, and leave it with energies of around 100 MeV. Their subsequent decay to high-energy neutrinos and anti-neutrinos provides a distinctive signature at Earth. Ongoing and planned neutrino and dark matter experiments allow us to reconstruct the energy, flavor, and time of arrival of these high-energy neutrinos. For the first time, we show that these measurements can help pinpointing the mass of $\phi$ and its couplings to neutrinos of different flavor. Our results can be generalized in a straightforward manner to other hypothetical feebly interacting particles, like novel gauge bosons or heavy neutral leptons, that decay into neutrinos.


title: Few-shot Knowledge Graph Relational Reasoning via Subgraph Adaptation

abstract: Few-shot Knowledge Graph (KG) Relational Reasoning aims to predict unseen triplets (i.e., query triplets) for rare relations in KGs, given only several triplets of these relations as references (i.e., support triplets). This task has gained significant traction due to the widespread use of knowledge graphs in various natural language processing applications. Previous approaches have utilized meta-training methods and manually constructed meta-relation sets to tackle this task. Recent efforts have focused on edge-mask-based methods, which exploit the structure of the contextualized graphs of target triplets (i.e., a subgraph containing relevant triplets in the KG). However, existing edge-mask-based methods have limitations in extracting insufficient information from KG and are highly influenced by spurious information in KG. To overcome these challenges, we propose SAFER (Subgraph Adaptation for Few-shot Relational Reasoning), a novel approach that effectively adapts the information in contextualized graphs to various subgraphs generated from support and query triplets to perform the prediction. Specifically, SAFER enables the extraction of more comprehensive information from support triplets while minimizing the impact of spurious information when predicting query triplets. Experimental results on three prevalent datasets demonstrate the superiority of our proposed framework SAFER.


title: What Teaches Robots to Walk, Teaches Them to Trade too -- Regime Adaptive Execution using Informed Data and LLMs

abstract: Machine learning techniques applied to the problem of financial market forecasting struggle with dynamic regime switching, or underlying correlation and covariance shifts in true (hidden) market variables. Drawing inspiration from the success of reinforcement learning in robotics, particularly in agile locomotion adaptation of quadruped robots to unseen terrains, we introduce an innovative approach that leverages world knowledge of pretrained LLMs (aka. 'privileged information' in robotics) and dynamically adapts them using intrinsic, natural market rewards using LLM alignment technique we dub as "Reinforcement Learning from Market Feedback" (**RLMF**). Strong empirical results demonstrate the efficacy of our method in adapting to regime shifts in financial markets, a challenge that has long plagued predictive models in this domain. The proposed algorithmic framework outperforms best-performing SOTA LLM models on the existing (FLARE) benchmark stock-movement (SM) tasks by more than 15\% improved accuracy. On the recently proposed NIFTY SM task, our adaptive policy outperforms the SOTA best performing trillion parameter models like GPT-4. The paper details the dual-phase, teacher-student architecture and implementation of our model, the empirical results obtained, and an analysis of the role of language embeddings in terms of Information Gain.


title: Machine Learning Visualization Tool for Exploring Parameterized Hydrodynamics

abstract: We are interested in the computational study of shock hydrodynamics, i.e. problems involving compressible solids, liquids, and gases that undergo large deformation. These problems are dynamic and nonlinear and can exhibit complex instabilities. Due to advances in high performance computing it is possible to parameterize a hydrodynamic problem and perform a computational study yielding $\mathcal{O}\left({\rm TB}\right)$ of simulation state data. We present an interactive machine learning tool that can be used to compress, browse, and interpolate these large simulation datasets. This tool allows computational scientists and researchers to quickly visualize "what-if" situations, perform sensitivity analyses, and optimize complex hydrodynamic experiments.


title: Calculation of the Comparative Efficiency of Algorithms Using a Single Metric

abstract: While time complexity and space complexity of an algorithm helps to determine its efficiency when time or space needs to be optimized respectively, they fail to determine the more efficient algorithm when time and space both need to be optimized simultaneously. This resulted in the development of the A1-Score Factor which solve the problem i.e., helps to find the algorithm which optimizes both time and space simultaneously. The following research paper contains the hypothesis, the proof, the theoretical and the graphical implementation of the A1-Score Factor along with the use cases of the same.


title: On the number of freeway lanes and its positive or negative effect on safety

abstract: We address the 80-year-old question of whether a freeway with more lanes results in fewer or more accidents. For finding the optimally safe number of lanes, in particular, we look at three types of accidents that are prevalent on urban freeways, namely "following too closely", "driver inattention", and "unsafe change of lanes". To do so we extend the intelligent driver model (IDM) to create a microscopic traffic flow model which is capable of producing accidents. We study the rate of accidents relative to a baseline 2-lane unidirectional freeway via Monte Carlo simulation. For each simulation instance we create a starting configuration involving only a few cars over a short segment of the freeway and simulate the dynamics thereafter. Furthermore, we look at the number of shoulders present, and show that the presence of shoulders can positively or negatively affect the accident rate depending on the type of accident.


title: Quantum Mechanics in Curved Space(time) with a Noncommutative Geometric Perspective

abstract: We have previously presented a version of the Weak Equivalence Principle for a quantum particle as an exact analog of the classical case, based on the Heisenberg picture analysis of free particle motion. Here, we take that to a full formalism of quantum mechanics in a generic curved space(time). Our basic perspective is to take seriously the noncommutative symplectic geometry corresponding to the quantum observable algebra. Particle position coordinate transformations and a nontrivial metric assigning an invariant inner product to vectors, and covectors, are implemented accordingly. That allows an analog to the classical picture of the phase space as the cotangent bundle. The mass-independent quantum geodesic equations as equations of free particle motion under a generic metric as a quantum observable are obtained from an invariant Hamiltonian. Hermiticity of momentum observables is to be taken as reference frame dependent. Our results have a big contrast to the alternative obtained based on the Schr\"odinger wavefunction representation. Hence, the work points to a very different approach to quantum gravity.


title: PKU-SafeRLHF: A Safety Alignment Preference Dataset for Llama Family Models

abstract: In this work, we introduce the PKU-SafeRLHF dataset, designed to promote research on safety alignment in large language models (LLMs). As a sibling project to SafeRLHF and BeaverTails, we separate annotations of helpfulness and harmlessness for question-answering pairs, providing distinct perspectives on these coupled attributes. Overall, we provide 44.6k refined prompts and 265k question-answer pairs with safety meta-labels for 19 harm categories and three severity levels ranging from minor to severe, with answers generated by Llama-family models. Based on this, we collected 166.8k preference data, including dual-preference (helpfulness and harmlessness decoupled) and single-preference data (trade-off the helpfulness and harmlessness from scratch), respectively. Using the large-scale annotation data, we further train severity-sensitive moderation for the risk control of LLMs and safety-centric RLHF algorithms for the safety alignment of LLMs. We believe this dataset will be a valuable resource for the community, aiding in the safe deployment of LLMs.


title: How big does a population need to be before demographers can ignore individual-level randomness in demographic events?

abstract: When studying a national-level population, demographers can safely ignore the effect of individual-level randomness on age-sex structure. When studying a single community, or group of communities, however, the potential importance of individual-level randomness is less clear. We seek to measure the effect of individual-level randomness in births and deaths on standard summary indicators of age-sex structure, for populations of different sizes, focusing on on demographic conditions typical of historical populations. We conduct a microsimulation experiment where we simulate events and age-sex structure under a range of settings for demographic rates and population size. The experiment results suggest that individual-level randomness strongly affects age-sex structure for populations of about 100, but has a much smaller effect on populations of 1,000, and a negligible effect on populations of 10,000. Our conclusion is that analyses of age-sex structure in historical populations with sizes on the order 100 must account for individual-level randomness in demographic events. Analyses of populations with sizes on the order of 1,000 may need to make some allowance for individual-level variation, but other issues, such as measurement error, probably deserve more attention. Analyses of populations of 10,000 can safely ignore individual-level variation.


title: Machine Learning Models for Accurately Predicting Properties of CsPbCl3 Perovskite Quantum Dots

abstract: Perovskite Quantum Dots (PQDs) have a promising future for several applications due to their unique properties. This study investigates the effectiveness of Machine Learning (ML) in predicting the size, absorbance (1S abs) and photoluminescence (PL) properties of $\mathrm{CsPbCl}_3$ PQDs using synthesizing features as the input dataset. the study employed ML models of Support Vector Regression (SVR), Nearest Neighbour Distance (NND), Random Forest (RF), Gradient Boosting Machine (GBM), Decision Tree (DT) and Deep Learning (DL). Although all models performed highly accurate results, SVR and NND demonstrated the best accurate property prediction by achieving excellent performance on the test and training datasets, with high $\mathrm{R}^2$ and low Root Mean Squared Error (RMSE) and low Mean Absolute Error (MAE) metric values. Given that ML is becoming more superior, its ability to understand the QDs field could prove invaluable to shape the future of nanomaterials designing.


title: System Description for the Displace Speaker Diarization Challenge 2023

abstract: This paper describes our solution for the Diarization of Speaker and Language in Conversational Environments Challenge (Displace 2023). We used a combination of VAD for finding segfments with speech, Resnet architecture based CNN for feature extraction from these segments, and spectral clustering for features clustering. Even though it was not trained with using Hindi, the described algorithm achieves the following metrics: DER 27. 1% and DER 27. 4%, on the development and phase-1 evaluation parts of the dataset, respectively.


title: Multidimensional representation of semantic relations between physical theories, fundamental constants and units of measurement with formal concept analysis

abstract: We propose several hierarchical graphs that represent the semantic relations between physical theories, their fundamental constants and units of measurement. We begin with an alternative representation of Zelmanov's cube of fundamental constants as a concept lattice. We then propose the inclusion of a new fundamental constant: Milgrom's critical acceleration and discuss the implications of such analysis. We then look for the same fundamental constants in a graph that relates magnitudes and units of measurement in the International System of Units. This exercise shows the potential of visualizing hierarchical networks as a tool to better comprehend the interrelations and dependencies of physical magnitudes, units and theories. New regimes of application may be deduced, as well as an interesting reflection on our ontologies and corresponding theoretical objects.


title: Steering Without Side Effects: Improving Post-Deployment Control of Language Models

abstract: Language models (LMs) have been shown to behave unexpectedly post-deployment. For example, new jailbreaks continually arise, allowing model misuse, despite extensive red-teaming and adversarial training from developers. Given most model queries are unproblematic and frequent retraining results in unstable user experience, methods for mitigation of worst-case behavior should be targeted. One such method is classifying inputs as potentially problematic, then selectively applying steering vectors on these problematic inputs, i.e. adding particular vectors to model hidden states. However, steering vectors can also negatively affect model performance, which will be an issue on cases where the classifier was incorrect. We present KL-then-steer (KTS), a technique that decreases the side effects of steering while retaining its benefits, by first training a model to minimize Kullback-Leibler (KL) divergence between a steered and unsteered model on benign inputs, then steering the model that has undergone this training. Our best method prevents 44% of jailbreak attacks compared to the original Llama-2-chat-7B model while maintaining helpfulness (as measured by MT-Bench) on benign requests almost on par with the original LM. To demonstrate the generality and transferability of our method beyond jailbreaks, we show that our KTS model can be steered to reduce bias towards user-suggested answers on TruthfulQA. Code is available: https://github.com/AsaCooperStickland/kl-then-steer.


title: Towards optical neuromodulation using nitrogen-doped ultrananocrystalline diamond photoelectrodes

abstract: Nitrogen-doped ultrananocrystalline diamond (N-UNCD) is a form of diamond electrode with near-infrared photoresponsivity, making it well suited for physiological applications. N-UNCD's photoresponsivity is strongly influenced by its surface. While it is known that oxygen treatment provides a higher photoresponsivity, a better understanding of its surface processes is needed to tailor the material for optical neuromodulation. This work examines the impact of various oxygen treatment methods, with aim of creating oxygen rich surfaces with different chemical and structural properties. Surface characterisation methods along with electrochemical and photoelectrochemical measurements and modelling were used to investigate the films. It was found that oxygen furnace annealing resulted in orders of magnitude improvement in the near-infrared photoresponsivity, to 3.75 +/- 0.05 uA/W. This translates to an approximate 200 times increase in the photocurrent compared to the untreated surface. This enhancement in photocurrent is largely due to the changes in the chemical species present at the surface. The photocurrent is estimated to be sufficient for extra-cellular stimulation of brain neurons within the safe optical exposure limit, positioning N-UNCD as an excellent candidate to be used in next-generation photoelectrodes for photobiomodulation.


title: Miniature fluorescence sensor for quantitative detection of brain tumour

abstract: Fluorescence-guided surgery has emerged as a vital tool for tumour resection procedures. As well as intraoperative tumour visualisation, 5-ALA-induced PpIX provides an avenue for quantitative tumour identification based on ratiometric fluorescence measurement. To this end, fluorescence imaging and fibre-based probes have enabled more precise demarcation between the cancerous and healthy tissues. These sensing approaches, which rely on collecting the fluorescence light from the tumour resection site and its remote spectral sensing, introduce challenges associated with optical losses. In this work, we demonstrate the viability of tumour detection at the resection site using a miniature fluorescence measurement system. Unlike the current bulky systems, which necessitate remote measurement, we have adopted a millimetre-sized spectral sensor chip for quantitative fluorescence measurements. A reliable measurement at the resection site requires a stable optical window between the tissue and the optoelectronic system. This is achieved using an antifouling diamond window, which provides stable optical transparency. The system achieved a sensitivity of 92.3% and specificity of 98.3% in detecting a surrogate tumour at a resolution of 1 x 1 mm2. As well as addressing losses associated with collecting and coupling fluorescence light in the current remote sensing approaches, the small size of the system introduced in this work paves the way for its direct integration with the tumour resection tools with the aim of more accurate interoperative tumour identification.


title: Impact of surface treatments on the electron affinity of nitrogen-doped ultrananocrystalline diamond

abstract: In recent years, various forms of nanocrystalline diamond (NCD) have emerged as an attractive group of diamond/graphite mixed-phase materials for a range of applications from electron emission sources to electrodes for neural interfacing. To tailor their properties for different uses, NCD surfaces can be terminated with various chemical functionalities, in particular hydrogen and oxygen, which shift the band edge positions and electron affinity values. While the band edge positions of chemically terminated single crystal diamond are well understood, the same is not true for nanocrystalline diamond, which has uncontrolled crystallographic surfaces with a variety of chemical states as well as graphitic grain boundary regions. In this work, the relative band edge positions of as-grown, hydrogen terminated, and oxygen terminated nitrogen-doped ultrananocrystalline diamond (N-UNCD) are determined using ultraviolet photoelectron spectroscopy (UPS), while the band bending is investigated using photoelectrochemical measurements. In contrast to the widely reported negative electrode affinity of hydrogen terminated single crystal diamond, our work demonstrates that hydrogen terminated N-UNCD exhibits a positive electron affinity owing to the increased surface and bulk defect densities. These findings elucidate the marked differences in electrochemical properties of hydrogen and oxygen terminated N-UNCD, such as the dramatic changes in electrochemical capacitance.


title: Statistical Inference and A/B Testing in Fisher Markets and Paced Auctions

abstract: We initiate the study of statistical inference and A/B testing for two market equilibrium models: linear Fisher market (LFM) equilibrium and first-price pacing equilibrium (FPPE). LFM arises from fair resource allocation systems such as allocation of food to food banks and notification opportunities to different types of notifications. For LFM, we assume that the data observed is captured by the classical finite-dimensional Fisher market equilibrium, and its steady-state behavior is modeled by a continuous limit Fisher market. The second type of equilibrium we study, FPPE, arises from internet advertising where advertisers are constrained by budgets and advertising opportunities are sold via first-price auctions. For platforms that use pacing-based methods to smooth out the spending of advertisers, FPPE provides a hindsight-optimal configuration of the pacing method. We propose a statistical framework for the FPPE model, in which a continuous limit FPPE models the steady-state behavior of the auction platform, and a finite FPPE provides the data to estimate primitives of the limit FPPE. Both LFM and FPPE have an Eisenberg-Gale convex program characterization, the pillar upon which we derive our statistical theory. We start by deriving basic convergence results for the finite market to the limit market. We then derive asymptotic distributions, and construct confidence intervals. Furthermore, we establish the asymptotic local minimax optimality of estimation based on finite markets. We then show that the theory can be used for conducting statistically valid A/B testing on auction platforms. Synthetic and semi-synthetic experiments verify the validity and practicality of our theory.


title: Unifying Unsupervised Graph-Level Anomaly Detection and Out-of-Distribution Detection: A Benchmark

abstract: To build safe and reliable graph machine learning systems, unsupervised graph-level anomaly detection (GLAD) and unsupervised graph-level out-of-distribution (OOD) detection (GLOD) have received significant attention in recent years. Though those two lines of research indeed share the same objective, they have been studied independently in the community due to distinct evaluation setups, creating a gap that hinders the application and evaluation of methods from one to the other. To bridge the gap, in this work, we present a Unified Benchmark for unsupervised Graph-level OOD and anomaly Detection (our method), a comprehensive evaluation framework that unifies GLAD and GLOD under the concept of generalized graph-level OOD detection. Our benchmark encompasses 35 datasets spanning four practical anomaly and OOD detection scenarios, facilitating the comparison of 16 representative GLAD/GLOD methods. We conduct multi-dimensional analyses to explore the effectiveness, generalizability, robustness, and efficiency of existing methods, shedding light on their strengths and limitations. Furthermore, we provide an open-source codebase (https://github.com/UB-GOLD/UB-GOLD) of our method to foster reproducible research and outline potential directions for future investigations based on our insights.


title: Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization

abstract: This work suggests fundamentally rethinking the current practice of pruning large language models (LLMs). The way it is done is by divide and conquer: split the model into submodels, sequentially prune them, and reconstruct predictions of the dense counterparts on small calibration data one at a time; the final model is obtained simply by putting the resulting sparse submodels together. While this approach enables pruning under memory constraints, it generates high reconstruction errors. In this work, we first present an array of reconstruction techniques that can significantly reduce this error by more than $90\%$. Unwittingly, however, we discover that minimizing reconstruction error is not always ideal and can overfit the given calibration data, resulting in rather increased language perplexity and poor performance at downstream tasks. We find out that a strategy of self-generating calibration data can mitigate this trade-off between reconstruction and generalization, suggesting new directions in the presence of both benefits and pitfalls of reconstruction for pruning LLMs.


title: Turbulent homeomorphisms and the topological snail

abstract: The topological snail is a geometric universal plane object, described by matrices in the special linear group with integer coefficients. It has many nice properties. From a dynamical point of view, it gives a description of the set of fixed points and periodic obits of turbulent homeomorphims in the plane. Those homeomorphisms are the truly complicated one. They have many fixed points and periodic orbits, as much as the trace of the turbulence matrix that caracterizes their action on a finite invariant set. The topological snail generally gives a map of the fixed points and periodic orbits of a such homeomorphims. One can compute their indexes and turbulent topological types, and different Nielsen's classes of fixed points naturally give a minoration of the topological entropy of the considered homeomorphisms by the logarithm of the spectral radius of the turbulence matrix. One even get a dynamical interpretation and proof of the extension of the Fermat' theorem to matrices. I first described the topological snail and its properties at my conference the 31st of may 2024 in Paris, in the case of a purely turbulent homeomorphism, with an invariant set of three points.


title: Massless Dirac Perturbations of black holes in f(Q) gravity: quasinormal modes and weak deflection angle

abstract: This article considers a static and spherical black hole (BH) in f(Q) gravity. f(Q) gravity is the extension of symmetric teleparallel general relativity, where both curvature and torsion are vanishing, and gravity is described by nonmetricity. In this study, we investigate the possible implications of quasinormal modes (QNM) modified Hawking spectra, and deflection angles generated by the model. The WKB method is used to solve the equations of motion for massless Dirac perturbation fields and explore the impact of the nonmetricity parameter ($Q_{0}$). Based on the QNMs computation, we can ensure that the BH is stable against massless Dirac perturbations and as $Q_{0}$ increases the the oscillatory frequency of the mode decrease. We then discuss the weak deflection angle in the weak field limit approximation. We compute the deflection angle up to the fourth order of approximation and show how the nonmetricity parameter affects it. We find that the $Q_{0}$ parameter reduces the deflection angle.


title: Data Efficient Evaluation of Large Language Models and Text-to-Image Models via Adaptive Sampling

abstract: Evaluating LLMs and text-to-image models is a computationally intensive task often overlooked. Efficient evaluation is crucial for understanding the diverse capabilities of these models and enabling comparisons across a growing number of new models and benchmarks. To address this, we introduce SubLIME, a data-efficient evaluation framework that employs adaptive sampling techniques, such as clustering and quality-based methods, to create representative subsets of benchmarks. Our approach ensures statistically aligned model rankings compared to full datasets, evidenced by high Pearson correlation coefficients. Empirical analysis across six NLP benchmarks reveals that: (1) quality-based sampling consistently achieves strong correlations (0.85 to 0.95) with full datasets at a 10\% sampling rate such as Quality SE and Quality CPD (2) clustering methods excel in specific benchmarks such as MMLU (3) no single method universally outperforms others across all metrics. Extending this framework, we leverage the HEIM leaderboard to cover 25 text-to-image models on 17 different benchmarks. SubLIME dynamically selects the optimal technique for each benchmark, significantly reducing evaluation costs while preserving ranking integrity and score distribution. Notably, a minimal sampling rate of 1% proves effective for benchmarks like MMLU. Additionally, we demonstrate that employing difficulty-based sampling to target more challenging benchmark segments enhances model differentiation with broader score distributions. We also combine semantic search, tool use, and GPT-4 review to identify redundancy across benchmarks within specific LLM categories, such as coding benchmarks. This allows us to further reduce the number of samples needed to maintain targeted rank preservation. Overall, SubLIME offers a versatile and cost-effective solution for the robust evaluation of LLMs and text-to-image models.


title: From Kalman to Einstein and Maxwell: the Structural Controllability Revisited

abstract: In the Special Relativity paper of Einstein (1905), only a footnote provides a reference to the conformal group of space-time for the Minkowski metric $\omega$. We prove that General Relativity (1915) will depend on the following {\it cornerstone} result of differential homological algebra (1990). Let $K$ be a differential field and $D=K[d_1,...,d_n]$ be the ring of differential operators with coefficients in $K$. If $M$ is the differential module over $D$ defined by the Killing operator ${\cal{D}} :T \rightarrow S_2T^*: \xi \rightarrow \Omega = {\cal{L}}(\xi) \omega$ and $N$ is the differential module over $D$ defined by the $Cauchy = ad(Killing)$ adjoint operator with torsion submodule $t(N)$, then $t(N) \simeq {ext}^1_D(M) = 0$ and the Cauchy operator can be thus parametrized by stress functions having strictly nothing to do with $\Omega$. This result is largely superseding the Kalman controllability test in classical OD control theory and is showing that controllability is a structural "{\it built-in}" property of an OD/PD control system not depending on the choice of inputs and outputs, contrary to the engineering tradition. It also points out the {\it terrible confusion} done by Einstein (1915) while following Beltrami (1892), both of them using the Einstein operator but ignoring that it was self-adjoint in the framework of differential double duality (1995). We finally prove that the structure of electromagnetism and gravitation only depends on the nonlinear {\it elations} of the conformal group of space-time, showing thus that {\it nothing is left from the mathematical foundations of both general relativity and gauge theory}.


title: Supersonic OT: Fast Unconditionally Secure Oblivious Transfer

abstract: Oblivious Transfer (OT) is a fundamental cryptographic protocol with applications in secure Multi-Party Computation, Federated Learning, and Private Set Intersection. With the advent of quantum computing, it is crucial to develop unconditionally secure core primitives like OT to ensure their continued security in the post-quantum era. Despite over four decades since OT's introduction, the literature has predominantly relied on computational assumptions, except in cases using unconventional methods like noisy channels or a fully trusted party. Introducing "Supersonic OT", a highly efficient and unconditionally secure OT scheme that avoids public-key-based primitives, we offer an alternative to traditional approaches. Supersonic OT enables a receiver to obtain a response of size O(1). Its simple (yet non-trivial) design facilitates easy security analysis and implementation. The protocol employs a basic secret-sharing scheme, controlled swaps, the one-time pad, and a third-party helper who may be corrupted by a semi-honest adversary. Our implementation and runtime analysis indicate that a single instance of Supersonic OT completes in 0.35 milliseconds, making it up to 2000 times faster than the state-of-the-art base OT.


title: Pragmatic Self-adjoint Procedure in the Schrodinger Equation for the Inverse Square Potential

abstract: The self-adjoint extension (SAE) procedure is considered in the Schrodinger equation for potentials behaving as an attractive inverse square at the origin of coordinates. This approach guarantees self-adjointness of the radial Hamiltonian in three dimensions. It is shown that the single bound state appears after such an extension, which depends on SAE parameter. The same parameter arises for the scattering case as well, when the extension is made by orthogonality requirement. The closed form is derived for the modified scattering amplitude, which consists an extra factor depended on the SAE parameter. That guarantees the appearance of the same bound state in the form of the scattering amplitude pole. So, the generalization of pragmatic method is demonstrated in case of continuous spectrum.


title: cp3-bench: A tool for benchmarking symbolic regression algorithms tested with cosmology

abstract: We present a benchmark study of ten symbolic regression algorithms applied to cosmological datasets. We find that the dimension of the feature space as well as precision of datasets are highly important for symbolic regression tasks to be successful. We find no indication that inter-dependence of features in datasets are particularly important, meaning that it is not an issue if datasets e.g. contain both $z$ and $H(z)$ as features. We find no indication that performance of algorithms on standardized datasets are good indications of performance on cosmological datasets. This suggests that it is not necessarily prudent to choose which symbolic regressions algorithm to use based on their performance on standardized data. Instead, a more prudent approach is to consider a variety of algorithms. Overall, we find that most of the benched algorithms do rather poorly in the benchmark and suggest possible ways to proceed with developing algorithms that will be better at identifying ground truth expressions for cosmological datasets. As part of this publication we introduce our benchmark algorithm cp3-bench which we make publicly available at https://github.com/CP3-Origins/cp3-bench. The philosophy behind cp3-bench is that is should be as user-friendly as possible, available in a ready-to-use format, and allow for easy additions of new algorithms and datasets.


title: Transposed Poisson structures on Virasoro-type algebras

abstract: We compute $\frac{1}{2}$-derivations on the deformed generalized Heisenberg-Virasoro algebras and on not-finitely graded Heisenberg-Virasoro algebras $\widehat{W}_n(G)$, $\widetilde{W}_n(G)$, and $\widetilde{HW}_n(G)$. We classify all transposed Poisson structures on such algebras.


title: Food Pairing Unveiled: Exploring Recipe Creation Dynamics through Recommender Systems

abstract: In the early 2000s, renowned chef Heston Blumenthal formulated his "food pairing" hypothesis, positing that if foods share many flavor compounds, then they tend to taste good when eaten together. In 2011, Ahn et al. conducted a study using a dataset of recipes, ingredients, and flavor compounds, finding that, in Western cuisine, ingredients in recipes often share more flavor compounds than expected by chance, indicating a natural tendency towards food pairing. Building upon Ahn's research, our work applies state-of-the-art collaborative filtering techniques to the dataset, providing a tool that can recommend new foods to add in recipes, retrieve missing ingredients and advise against certain combinations. We create our recommender in two ways, by taking into account ingredients appearances in recipes or shared flavor compounds between foods. While our analysis confirms the existence of food pairing, the recipe-based recommender performs significantly better than the flavor-based one, leading to the conclusion that food pairing is just one of the principles to take into account when creating recipes. Furthermore, and more interestingly, we find that food pairing in data is mostly due to trivial couplings of very similar ingredients, leading to a reconsideration of its current role in recipes, from being an already existing feature to a key to open up new scenarios in gastronomy. Our flavor-based recommender can thus leverage this novel concept and provide a new tool to lead culinary innovation.