title: Einstein metrics on homogeneous spaces $H\times H/\Delta K$

abstract: Given any compact homogeneous space $H/K$ with $H$ simple, we consider the new space $M=H\times H/\Delta K$, where $\Delta K$ denotes diagonal embedding, and study the existence, classification and stability of $H\times H$-invariant Einstein metrics on $M$, as a first step into the largely unexplored case of homogeneous spaces of compact non-simple Lie groups. We find unstable Einstein metrics on $M$ for most spaces $H/K$ such that their standard metric is Einstein (e.g., isotropy irreducible) and the Killing form of $\mathfrak{k}$ is a multiple of the Killing form of $\mathfrak{h}$ (e.g., $K$ simple), a class which contains $17$ families and $50$ individual examples. A complete classification is obtained in the case when $H/K$ is an irreducible symmetric space. We also study the behavior of the scalar curvature function on the space of all normal metrics on $M=H\times H/\Delta K$ (none of which is Einstein), obtaining that the standard metric is a global minimum.


title: Healthcare Copilot: Eliciting the Power of General LLMs for Medical Consultation

abstract: The copilot framework, which aims to enhance and tailor large language models (LLMs) for specific complex tasks without requiring fine-tuning, is gaining increasing attention from the community. In this paper, we introduce the construction of a Healthcare Copilot designed for medical consultation. The proposed Healthcare Copilot comprises three main components: 1) the Dialogue component, responsible for effective and safe patient interactions; 2) the Memory component, storing both current conversation data and historical patient information; and 3) the Processing component, summarizing the entire dialogue and generating reports. To evaluate the proposed Healthcare Copilot, we implement an auto-evaluation scheme using ChatGPT for two roles: as a virtual patient engaging in dialogue with the copilot, and as an evaluator to assess the quality of the dialogue. Extensive results demonstrate that the proposed Healthcare Copilot significantly enhances the capabilities of general LLMs for medical consultations in terms of inquiry capability, conversational fluency, response accuracy, and safety. Furthermore, we conduct ablation studies to highlight the contribution of each individual module in the Healthcare Copilot. Code will be made publicly available on GitHub.


title: An efficient finite element method for computing the response of a strain-limiting elastic solid containing a v-notch and inclusions

abstract: Accurate triangulation of the domain plays a pivotal role in computing the numerical approximation of the differential operators. A good triangulation is the one which aids in reducing discretization errors. In a standard collocation technique, the smooth curved domain is typically triangulated with a mesh by taking points on the boundary to approximate them by polygons. However, such an approach often leads to geometrical errors which directly affect the accuracy of the numerical approximation. To restrict such geometrical errors, \textit{isoparametric}, \textit{subparametric}, and \textit{iso-geometric} methods were introduced which allow the approximation of the curved surfaces (or curved line segments). In this paper, we present an efficient finite element method to approximate the solution to the elliptic boundary value problem (BVP), which governs the response of an elastic solid containing a v-notch and inclusions. The algebraically nonlinear constitutive equation along with the balance of linear momentum reduces to second-order quasi-linear elliptic partial differential equation. Our approach allows us to represent the complex curved boundaries by smooth \textit{one-of-its-kind} point transformation. The main idea is to obtain higher-order shape functions which enable us to accurately compute the entries in the finite element matrices and vectors. A Picard-type linearization is utilized to handle the nonlinearities in the governing differential equation. The numerical results for the test cases show considerable improvement in the accuracy.


title: Bayesian Neural Networks with Domain Knowledge Priors

abstract: Bayesian neural networks (BNNs) have recently gained popularity due to their ability to quantify model uncertainty. However, specifying a prior for BNNs that captures relevant domain knowledge is often extremely challenging. In this work, we propose a framework for integrating general forms of domain knowledge (i.e., any knowledge that can be represented by a loss function) into a BNN prior through variational inference, while enabling computationally efficient posterior inference and sampling. Specifically, our approach results in a prior over neural network weights that assigns high probability mass to models that better align with our domain knowledge, leading to posterior samples that also exhibit this behavior. We show that BNNs using our proposed domain knowledge priors outperform those with standard priors (e.g., isotropic Gaussian, Gaussian process), successfully incorporating diverse types of prior information such as fairness, physics rules, and healthcare knowledge and achieving better predictive performance. We also present techniques for transferring the learned priors across different model architectures, demonstrating their broad utility across various settings.


title: Double Scattering in Deuteron Electrodisintegration

abstract: We demonstrate that at sufficiently high energies where the eikonal regime is established for hadronic interactions, the double scattering subprocess can be clearly identified and isolated in quasi-elastic deuteron electro-disintegration processes. Comparing theoretical calculations with the recent high precision experimental data we present a ``proof of principle" that these processes can be used to study advanced issues related to hadron formation in QCD. In this case, the double scattering represents as a fermi-scale ``detector" which probes products of high $Q^2$ scattering from the bound nucleon through their rescattering from the spectator nucleon in the deuteron.


title: Scaling physics-informed hard constraints with mixture-of-experts

abstract: Imposing known physical constraints, such as conservation laws, during neural network training introduces an inductive bias that can improve accuracy, reliability, convergence, and data efficiency for modeling physical dynamics. While such constraints can be softly imposed via loss function penalties, recent advancements in differentiable physics and optimization improve performance by incorporating PDE-constrained optimization as individual layers in neural networks. This enables a stricter adherence to physical constraints. However, imposing hard constraints significantly increases computational and memory costs, especially for complex dynamical systems. This is because it requires solving an optimization problem over a large number of points in a mesh, representing spatial and temporal discretizations, which greatly increases the complexity of the constraint. To address this challenge, we develop a scalable approach to enforce hard physical constraints using Mixture-of-Experts (MoE), which can be used with any neural network architecture. Our approach imposes the constraint over smaller decomposed domains, each of which is solved by an "expert" through differentiable optimization. During training, each expert independently performs a localized backpropagation step by leveraging the implicit function theorem; the independence of each expert allows for parallelization across multiple GPUs. Compared to standard differentiable optimization, our scalable approach achieves greater accuracy in the neural PDE solver setting for predicting the dynamics of challenging non-linear systems. We also improve training stability and require significantly less computation time during both training and inference stages.


title: Generation and control of population difference gratings in a three-level hydrogen atomic medium using half-cycle attosecond pulses

abstract: Recently, the possibility of the generation and interaction of unipolar half-cycle electromagnetic pulses with quantum systems has been the subject of active research. Such pulses can have many different and interesting applications. They are able to excite quantum systems very fast. Based on the numerical solution of Maxwell-Bloch equations, this paper theoretically studies the possibility of guiding and ultrafast controlling population difference gratings by a sequence of half-cycle attosecond pulses in a three-level resonant medium. The parameters of the model medium (transition frequencies and dipole moments of the transitions) are close to those found in the hydrogen atom. We show the possibility of guiding periodic gratings and dynamic microcavities on different resonance transitions of the medium. In this case, the medium considered is an example of a spatiotemporal photonic crystal. The refractive index varies rapidly in space and time. The possibility of the use of such gratings as Bragg mirrors in ultrafast optics is discussed. The results obtained are of interest in two actively developing areas of modern optics - the physics of half-cycle pulses and space-time photonic crystals.


title: Harnessing Large Language Models as Post-hoc Correctors

abstract: As Machine Learning (ML) models grow in size and demand higher-quality training data, the expenses associated with re-training and fine-tuning these models are escalating rapidly. Inspired by recent impressive achievements of Large Language Models (LLMs) in different fields, this paper delves into the question: can LLMs efficiently improve an ML's performance at a minimal cost? We show that, through our proposed training-free framework LlmCorr, an LLM can work as a post-hoc corrector to propose corrections for the predictions of an arbitrary ML model. In particular, we form a contextual knowledge database by incorporating the dataset's label information and the ML model's predictions on the validation dataset. Leveraging the in-context learning capability of LLMs, we ask the LLM to summarise the instances in which the ML model makes mistakes and the correlation between primary predictions and true labels. Following this, the LLM can transfer its acquired knowledge to suggest corrections for the ML model's predictions. Our experimental results on text analysis and the challenging molecular predictions show that \model improves the performance of a number of models by up to 39%.


title: Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the Text

abstract: Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language often encompasses complex relationships among entities, making it challenging to maintain a clear reasoning chain over longer spans. Secondly, the abundance of linguistic diversity means that the same entities and relationships can be expressed using different terminologies and structures, complicating the task of identifying and establishing connections between multiple pieces of information. Graphs provide an effective solution to represent data rich in relational information and capture long-term dependencies among entities. To harness the potential of graphs, our paper introduces Structure Guided Prompt, an innovative three-stage task-agnostic prompting framework designed to improve the multi-step reasoning capabilities of LLMs in a zero-shot setting. This framework explicitly converts unstructured text into a graph via LLMs and instructs them to navigate this graph using task-specific strategies to formulate responses. By effectively organizing information and guiding navigation, it enables LLMs to provide more accurate and context-aware responses. Our experiments show that this framework significantly enhances the reasoning capabilities of LLMs, enabling them to excel in a broader spectrum of natural language scenarios.


title: Birkhoff-James classification of norm's properties

abstract: For an arbitrary normed space $\mathcal X$ over a field $\mathbb F \in \{ \mathbb R, \mathbb C \}$, we define the directed graph $\Gamma(\mathcal X)$ induced by Birkhoff-James orthogonality on the projective space $\mathbb P(\mathcal X)$, and also its nonprojective counterpart $\Gamma_0(\mathcal X)$. We show that, in finite-dimensional normed spaces, $\Gamma(\mathcal X)$ carries all the information about the dimension, smooth points, and norm's maximal faces. It also allows to determine whether the norm is a supremum norm or not, and thus classifies finite-dimensional abelian $C^\ast$-algebras among other normed spaces. We further establish the necessary and sufficient conditions under which the graph $\Gamma_0(\mathcal{R})$ of a (real or complex) Radon plane $\mathcal{R}$ is isomorphic to the graph $\Gamma_0(\mathbb F^2, \|\cdot\|_2)$ of the two-dimensional Hilbert space and construct examples of such nonsmooth Radon planes.


title: Unlocking the `Why' of Buying: Introducing a New Dataset and Benchmark for Purchase Reason and Post-Purchase Experience

abstract: Explanations are crucial for enhancing user trust and understanding within modern recommendation systems. To build truly explainable systems, we need high-quality datasets that elucidate why users make choices. While previous efforts have focused on extracting users' post-purchase sentiment in reviews, they ignore the reasons behind the decision to buy. In our work, we propose a novel purchase reason explanation task. To this end, we introduce an LLM-based approach to generate a dataset that consists of textual explanations of why real users make certain purchase decisions. We induce LLMs to explicitly distinguish between the reasons behind purchasing a product and the experience after the purchase in a user review. An automated, LLM-driven evaluation, as well as a small scale human evaluation, confirms the effectiveness of our approach to obtaining high-quality, personalized explanations. We benchmark this dataset on two personalized explanation generation tasks. We release the code and prompts to spur further research.


title: Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding

abstract: Predicting protein properties is paramount for biological and medical advancements. Current protein engineering mutates on a typical protein, called the wild-type, to construct a family of homologous proteins and study their properties. Yet, existing methods easily neglect subtle mutations, failing to capture the effect on the protein properties. To this end, we propose EvolMPNN, Evolution-aware Message Passing Neural Network, an efficient model to learn evolution-aware protein embeddings. EvolMPNN samples sets of anchor proteins, computes evolutionary information by means of residues and employs a differentiable evolution-aware aggregation scheme over these sampled anchors. This way, EvolMPNN can efficiently utilise a novel message-passing method to capture the mutation effect on proteins with respect to the anchor proteins. Afterwards, the aggregated evolution-aware embeddings are integrated with sequence embeddings to generate final comprehensive protein embeddings. Our model shows up to 6.4% better than state-of-the-art methods and attains 36X inference speedup in comparison with large pre-trained models. Code and models are available at https://github.com/zhiqiangzhongddu/EvolMPNN.


title: Reward Bound for Behavioral Guarantee of Model-based Planning Agents

abstract: Recent years have seen an emerging interest in the trustworthiness of machine learning-based agents in the wild, especially in robotics, to provide safety assurance for the industry. Obtaining behavioral guarantees for these agents remains an important problem. In this work, we focus on guaranteeing a model-based planning agent reaches a goal state within a specific future time step. We show that there exists a lower bound for the reward at the goal state, such that if the said reward is below that bound, it is impossible to obtain such a guarantee. By extension, we show how to enforce preferences over multiple goals.


title: On binary codes with distances $d$ and $d+2$

abstract: We consider the problem of finding $A_2(n,\{d_1,d_2\})$ defined as the maximal size of a binary (non-linear) code of length $n$ with two distances $d_1$ and $d_2$. Binary codes with distances $d$ and $d+2$ of size $\sim\frac{n^2}{\frac{d}{2}(\frac{d}{2}+1)}$ can be obtained from $2$-packings of an $n$-element set by blocks of cardinality $\frac{d}{2}+1$. This value is far from the upper bound $A_2(n,\{d_1,d_2\})\le1+{n\choose2}$ proved recently by Barg et al. In this paper we prove that for every fixed $d$ ($d$ even) there exists an integer $N(d)$ such that for every $n\ge N(d)$ it holds $A_2(n,\{d,d+2\})=D(n,\frac{d}{2}+1,2)$, or, in other words, optimal codes are isomorphic to constant weight codes. We prove also estimates on $N(d)$ for $d=4$ and $d=6$.


title: Context-Aware Quantitative Risk Assessment Machine Learning Model for Drivers Distraction

abstract: Risk mitigation techniques are critical to avoiding accidents associated with driving behaviour. We provide a novel Multi-Class Driver Distraction Risk Assessment (MDDRA) model that considers the vehicle, driver, and environmental data during a journey. MDDRA categorises the driver on a risk matrix as safe, careless, or dangerous. It offers flexibility in adjusting the parameters and weights to consider each event on a specific severity level. We collect real-world data using the Field Operation Test (TeleFOT), covering drivers using the same routes in the East Midlands, United Kingdom (UK). The results show that reducing road accidents caused by driver distraction is possible. We also study the correlation between distraction (driver, vehicle, and environment) and the classification severity based on a continuous distraction severity score. Furthermore, we apply machine learning techniques to classify and predict driver distraction according to severity levels to aid the transition of control from the driver to the vehicle (vehicle takeover) when a situation is deemed risky. The Ensemble Bagged Trees algorithm performed best, with an accuracy of 96.2%.


title: Induced supersolidity and hypersonic flow of a dipolar Bose-Einstein Condensate in a rotating bubble trap

abstract: Motivated by the recent realization of space-borne Bose-Einstein Condensate (BEC) under micro-gravity conditions, we extend the understanding of ultracold dipolar bosonic gases by exploring their behavior in a novel trapping configuration known as the ``bubble trap" topology. Utilizing the three-dimensional numerical simulations within the extended Gross-Pitaevskii framework, we unveil diverse ground state phases in such a static curved topology. Subsequently, we investigate the influence of rotation on a dipolar BEC confined to the surface of a spherical bubble. Our findings reveal that the rotation of a bubble trap with certain rotation frequencies can modify the effective local dipole-dipole interaction strength, leading to the induction of supersolidity and the formation of quantum droplets. In addition, we demonstrate that a bubble trap can sustain high circulation and the flow also persists for a longer time. Significantly, adjusting the rf detuning parameter allows the condensate to achieve hypersonic velocity. Finally, we explore the impact of drastic change in the topological nature of the trap on the rotating dipolar BEC, transitioning from a filled shell trap to a bubble trap and vice versa.


title: Diagonal poset Ramsey numbers

abstract: A poset $(Q,\le_Q)$ contains an induced copy of a poset $(P,\le_P)$ if there exists an injective mapping $\phi\colon P\to Q$ such that for any two elements $X,Y\in P$, $X\le_P Y$ if and only if $\phi(X)\le_Q \phi(Y)$. By $Q_n$ we denote the Boolean lattice $(2^{[n]},\subseteq)$. The poset Ramsey number $R(P,Q)$ for posets $P$ and $Q$ is the least integer $N$ for which any coloring of the elements of $Q_N$ in blue and red contains either a blue induced copy of $P$ or a red induced copy of $Q$. In this paper, we show that $R(Q_m,Q_n)\le nm-\big(1-o(1)\big)n\log m$ where $n\ge m$ and $m$ is sufficiently large. This improves the best known upper bound on $R(Q_n,Q_n)$ from $n^2-n+2$ to $n^2-\big(1-o(1)\big) n\log n$. Furthermore, we determine $R(P,P)$ where $P$ is an $n$-fork or $n$-diamond up to an additive constant of $2$. A poset $(Q,\le_Q)$ contains a weak copy of $(P,\le_P)$ if there is an injection $\psi\colon P\to Q$ such that $\psi(X)\le_Q \psi(Y)$ for any $X,Y\in P$ with $X\le_P Y$. The weak poset Ramsey number $R^{\text{w}}(P,Q)$ is the smallest $N$ for which any blue/red-coloring of $Q_N$ contains a blue weak copy of $P$ or a red weak copy of $Q$. We show that $R^{\text{w}}(Q_n,Q_n)\le 0.96n^2$.


title: Magnetotransport Signatures of the Radial Rashba Spin-Orbit Coupling in Proximitized Graphene

abstract: Graphene-based van der Waals heterostructures take advantage of tailoring spin-orbit coupling (SOC) in the graphene layer by proximity effect. At long-wavelength -- saddled by the electronic states near the Dirac points -- the proximitized features can be effectively modelled by the Hamiltonian involving novel SOC terms and allow for an admixture of the tangential and radial spin textures -- by the so-called Rashba angle $\theta_{\text{R}}$. Taking such effective models we perform realistic large-scale magneto-transport calculations -- transverse magnetic focusing and Dyakonov-Perel spin relaxation -- and show that there are unique qualitative and quantitative features allowing for an unbiased experimental disentanglement of the conventional Rashba SOC from its novel radial counterpart, called here the radial Rashba SOC. Along with that, we propose a scheme for a direct estimation of the Rashba angle by exploring the magneto-response symmetries when swapping an in-plane magnetic field. To complete the story, we analyze the magneto-transport signatures in the presence of an emergent Dresselhaus SOC and also provide some generic ramifications about possible scenarios of the radial superconducting diode effect.


title: Investigating the Histogram Loss in Regression

abstract: It is becoming increasingly common in regression to train neural networks that model the entire distribution even if only the mean is required for prediction. This additional modeling often comes with performance gain and the reasons behind the improvement are not fully known. This paper investigates a recent approach to regression, the Histogram Loss, which involves learning the conditional distribution of the target variable by minimizing the cross-entropy between a target distribution and a flexible histogram prediction. We design theoretical and empirical analyses to determine why and when this performance gain appears, and how different components of the loss contribute to it. Our results suggest that the benefits of learning distributions in this setup come from improvements in optimization rather than learning a better representation. We then demonstrate the viability of the Histogram Loss in common deep learning applications without a need for costly hyperparameter tuning.


title: Explaining Relationships Among Research Papers

abstract: Due to the rapid pace of research publications, keeping up to date with all the latest related papers is very time-consuming, even with daily feed tools. There is a need for automatically generated, short, customized literature reviews of sets of papers to help researchers decide what to read. While several works in the last decade have addressed the task of explaining a single research paper, usually in the context of another paper citing it, the relationship among multiple papers has been ignored; prior works have focused on generating a single citation sentence in isolation, without addressing the expository and transition sentences needed to connect multiple papers in a coherent story. In this work, we explore a feature-based, LLM-prompting approach to generate richer citation texts, as well as generating multiple citations at once to capture the complex relationships among research papers. We perform an expert evaluation to investigate the impact of our proposed features on the quality of the generated paragraphs and find a strong correlation between human preference and integrative writing style, suggesting that humans prefer high-level, abstract citations, with transition sentences between them to provide an overall story.


title: Quantitative causality, causality-guided scientific discovery, and causal machine learning

abstract: It has been said, arguably, that causality analysis should pave a promising way to interpretable deep learning and generalization. Incorporation of causality into artificial intelligence (AI) algorithms, however, is challenged with its vagueness, non-quantitiveness, computational inefficiency, etc. During the past 18 years, these challenges have been essentially resolved, with the establishment of a rigorous formalism of causality analysis initially motivated from atmospheric predictability. This not only opens a new field in the atmosphere-ocean science, namely, information flow, but also has led to scientific discoveries in other disciplines, such as quantum mechanics, neuroscience, financial economics, etc., through various applications. This note provides a brief review of the decade-long effort, including a list of major theoretical results, a sketch of the causal deep learning framework, and some representative real-world applications in geoscience pertaining to this journal, such as those on the anthropogenic cause of global warming, the decadal prediction of El Ni\~no Modoki, the forecasting of an extreme drought in China, among others.


title: Emergence and dynamics of delusions and hallucinations across stages in early psychosis

abstract: Hallucinations and delusions are often grouped together within the positive symptoms of psychosis. However, recent evidence suggests they may be driven by distinct computational and neural mechanisms. Examining the time course of their emergence may provide insights into the relationship between these underlying mechanisms. Participants from the second (N = 719) and third (N = 699) iterations of the North American Prodrome Longitudinal Study (NAPLS 2 and 3) were assessed for timing of CHR-P-level delusion and hallucination onset. Pre-onset symptom patterns in first-episode psychosis patients (FEP) from the Prevention and Early Intervention Program for Psychosis (PEPP-Montreal; N = 694) were also assessed. Symptom onset was determined at baseline assessment and the evolution of symptom patterns examined over 24 months. In all three samples, participants were more likely to report the onset of delusion-spectrum symptoms prior to hallucination-spectrum symptoms (odds ratios (OR): NAPLS 2 = 4.09; NAPLS 3 = 4.14; PEPP, Z = 7.01, P < 0.001) and to present with only delusions compared to only hallucinations (OR: NAPLS 2 = 5.6; NAPLS 3 = 11.11; PEPP = 42.75). Re-emergence of delusions after remission was also more common than re-emergence of hallucinations (Ps < 0.05), and hallucinations more often resolved first (Ps < 0.001). In both CHR-P samples, ratings of delusional ideation fell with the onset of hallucinations (P = 0.007). Delusions tend to emerge before hallucinations and may play a role in their development. Further work should examine the relationship between the mechanisms driving these symptoms and its utility for diagnosis and treatment.


title: Everything You Always Wanted to Know About Storage Compressibility of Pre-Trained ML Models but Were Afraid to Ask

abstract: As the number of pre-trained machine learning (ML) models is growing exponentially, data reduction tools are not catching up. Existing data reduction techniques are not specifically designed for pre-trained model (PTM) dataset files. This is largely due to a lack of understanding of the patterns and characteristics of these datasets, especially those relevant to data reduction and compressibility. This paper presents the first, exhaustive analysis to date of PTM datasets on storage compressibility. Our analysis spans different types of data reduction and compression techniques, from hash-based data deduplication, data similarity detection, to dictionary-coding compression. Our analysis explores these techniques at three data granularity levels, from model layers, model chunks, to model parameters. We draw new observations that indicate that modern data reduction tools are not effective when handling PTM datasets. There is a pressing need for new compression methods that take into account PTMs' data characteristics for effective storage reduction. Motivated by our findings, we design ELF, a simple yet effective, error-bounded, lossy floating-point compression method. ELF transforms floating-point parameters in such a way that the common exponent field of the transformed parameters can be completely eliminated to save storage space. We develop Elves, a compression framework that integrates ELF along with several other data reduction methods. Elves uses the most effective method to compress PTMs that exhibit different patterns. Evaluation shows that Elves achieves an overall compression ratio of $1.52\times$, which is $1.31\times$, $1.32\times$ and $1.29\times$ higher than a general-purpose compressor (zstd), an error-bounded lossy compressor (SZ3), and the uniform model quantization, respectively, with negligible model accuracy loss.


title: LinkSAGE: Optimizing Job Matching Using Graph Neural Networks

abstract: We present LinkSAGE, an innovative framework that integrates Graph Neural Networks (GNNs) into large-scale personalized job matching systems, designed to address the complex dynamics of LinkedIns extensive professional network. Our approach capitalizes on a novel job marketplace graph, the largest and most intricate of its kind in industry, with billions of nodes and edges. This graph is not merely extensive but also richly detailed, encompassing member and job nodes along with key attributes, thus creating an expansive and interwoven network. A key innovation in LinkSAGE is its training and serving methodology, which effectively combines inductive graph learning on a heterogeneous, evolving graph with an encoder-decoder GNN model. This methodology decouples the training of the GNN model from that of existing Deep Neural Nets (DNN) models, eliminating the need for frequent GNN retraining while maintaining up-to-date graph signals in near realtime, allowing for the effective integration of GNN insights through transfer learning. The subsequent nearline inference system serves the GNN encoder within a real-world setting, significantly reducing online latency and obviating the need for costly real-time GNN infrastructure. Validated across multiple online A/B tests in diverse product scenarios, LinkSAGE demonstrates marked improvements in member engagement, relevance matching, and member retention, confirming its generalizability and practical impact.


title: Game Design Inspired by Quantum Physics: A Case Study on The Quantum Photo Booth

abstract: In this paper, we explain the conceptual development of the STAGE Lab Quantum Casino (a.k.a. the STAGE Lab Quantum Arcade), one of the Lab's most recent artistic endeavors about quantum physics. This work consists of a series of card and digital games and an interactive experience, exposing the public to quantum physics and minimizing learning barriers. Furthermore, we will also present a case study of the interactive experience, in the form of The Quantum Photo Booth. The STAGE Lab Quantum Casino provides an entertaining and approachable experience for people of all ages to become familiar with quantum physics. By using core concepts of quantum physics as tools and strategies to overcome challenges that arise in gameplay, players gain an intuitive understanding of these concepts. These games provide players with a first-hand experience of the following quantum physics concepts: measurement, superposition, encryption, decoherence, and entanglement. Instead of teaching the concepts through a traditional classroom pedagogy, these games aim to invoke curiosity, spark moments of playfulness, and catalyze play-centric learning modalities. This paper provides a general overview of the development of the STAGE Lab Quantum Casino, focusing on The Quantum Photo Booth experience and how science is integrated into the very nature of the game development process in addition to its outcome.


title: DrBenchmark: A Large Language Understanding Evaluation Benchmark for French Biomedical Domain

abstract: The biomedical domain has sparked a significant interest in the field of Natural Language Processing (NLP), which has seen substantial advancements with pre-trained language models (PLMs). However, comparing these models has proven challenging due to variations in evaluation protocols across different models. A fair solution is to aggregate diverse downstream tasks into a benchmark, allowing for the assessment of intrinsic PLMs qualities from various perspectives. Although still limited to few languages, this initiative has been undertaken in the biomedical field, notably English and Chinese. This limitation hampers the evaluation of the latest French biomedical models, as they are either assessed on a minimal number of tasks with non-standardized protocols or evaluated using general downstream tasks. To bridge this research gap and account for the unique sensitivities of French, we present the first-ever publicly available French biomedical language understanding benchmark called DrBenchmark. It encompasses 20 diversified tasks, including named-entity recognition, part-of-speech tagging, question-answering, semantic textual similarity, and classification. We evaluate 8 state-of-the-art pre-trained masked language models (MLMs) on general and biomedical-specific data, as well as English specific MLMs to assess their cross-lingual capabilities. Our experiments reveal that no single model excels across all tasks, while generalist models are sometimes still competitive.


title: Structured Tree Alignment for Evaluation of (Speech) Constituency Parsing

abstract: We present the structured average intersection-over-union ratio (STRUCT-IOU), a similarity metric between constituency parse trees motivated by the problem of evaluating speech parsers. STRUCT-IOU enables comparison between a constituency parse tree (over automatically recognized spoken word boundaries) with the ground-truth parse (over written words). To compute the metric, we project the ground-truth parse tree to the speech domain by forced alignment, align the projected ground-truth constituents with the predicted ones under certain structured constraints, and calculate the average IOU score across all aligned constituent pairs. STRUCT-IOU takes word boundaries into account and overcomes the challenge that the predicted words and ground truth may not have perfect one-to-one correspondence. Extending to the evaluation of text constituency parsing, we demonstrate that STRUCT-IOU can address token-mismatch issues, and shows higher tolerance to syntactically plausible parses than PARSEVAL (Black et al., 1991).


title: Phase transition and universality of the majority-rule model on complex networks

abstract: We investigate the phenomena of order-disorder phase transition and the universality of the majority-rule model defined on three complex networks, namely the Barabasi-Albert, Watts-Strogatz, and Erdos-Renyi networks. Assume each agent holds two possible opinions distributed randomly across the networks' nodes. Agents adopt anticonformity and independence behaviors, represented by the probability (p), where with a probability (p), agents adopt anticonformity or independence behavior. Based on our numerical simulation results and finite-size scaling analysis, it is found that the model undergoes a continuous phase transition for all networks, with critical points for the independence model greater than those for the anticonformity model in all three networks. We obtain critical exponents identical to the opinion dynamics model defined on a complete graph, indicating that the model exhibits the same universality class as the mean-field Ising model.


title: Learning to Retrieve for Job Matching

abstract: Web-scale search systems typically tackle the scalability challenge with a two-step paradigm: retrieval and ranking. The retrieval step, also known as candidate selection, often involves extracting standardized entities, creating an inverted index, and performing term matching for retrieval. Such traditional methods require manual and time-consuming development of query models. In this paper, we discuss applying learning-to-retrieve technology to enhance LinkedIns job search and recommendation systems. In the realm of promoted jobs, the key objective is to improve the quality of applicants, thereby delivering value to recruiter customers. To achieve this, we leverage confirmed hire data to construct a graph that evaluates a seeker's qualification for a job, and utilize learned links for retrieval. Our learned model is easy to explain, debug, and adjust. On the other hand, the focus for organic jobs is to optimize seeker engagement. We accomplished this by training embeddings for personalized retrieval, fortified by a set of rules derived from the categorization of member feedback. In addition to a solution based on a conventional inverted index, we developed an on-GPU solution capable of supporting both KNN and term matching efficiently.


title: Optimisation of design parameters to improve performance of a planar electromagnetic actuator

abstract: Planar electromagnetic actuators based on the principle of linear motors are widely employed for micro and nano positioning applications. These actuators usually employ a planar magnetic platform driven by a co-planar electromagnetic coil. While these actuators offer a large motion range and high positioning resolution, their actuation bandwidth is limited due to relatively small electromagnetic stiffness. We report optimization of the design parameters of the electromagnetic coil and the magnetic assembly to maximize the electromagnetic force and stiffness. Firstly, we derive closed-form expressions for the electromagnetic forces and stiffness, which enable us to express these quantities in terms of the design parameters of the actuator. Secondly, based on these derived expressions, we estimate the optimum values of the design parameters to maximize force and stiffness. Notably, for the optimum design parameters, the force and stiffness per unit volume can be increased by two and three orders of magnitude, respectively by reducing the pitch of the electromagnetic coil by a factor of 10. Lastly, we develop an electromagnetic actuator and evaluate its performance using a Microelectromechanical system (MEMS) based force sensor. By operating the force sensor in a feedback loop, we precisely measure the generated electromagnetic forces for different design parameters of the actuator. The experimental results obtained align closely with the analytical values, with an error of less than 15%.


title: Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit

abstract: Advances in artificial intelligence (AI) have enabled unprecedented capabilities, yet innovation teams struggle when envisioning AI concepts. Data science teams think of innovations users do not want, while domain experts think of innovations that cannot be built. A lack of effective ideation seems to be a breakdown point. How might multidisciplinary teams identify buildable and desirable use cases? This paper presents a first hand account of ideating AI concepts to improve critical care medicine. As a team of data scientists, clinicians, and HCI researchers, we conducted a series of design workshops to explore more effective approaches to AI concept ideation and problem formulation. We detail our process, the challenges we encountered, and practices and artifacts that proved effective. We discuss the research implications for improved collaboration and stakeholder engagement, and discuss the role HCI might play in reducing the high failure rate experienced in AI innovation.


title: Approximate identities for Ideals in $L(L^p))$

abstract: The main result is that the only non trivial closed ideal in the Banach algebra $L(L^p)$ of bounded linear operators on $L^p(0,1)$, $1\le p < \infty$, that has a left approximate identity is the ideal of compact operators. The algebra $L(L^1)$ has at least one non trivial closed ideal that has a contractive right approximate identity as well as many, including the unique maximal ideal, that do not have a right approximate identity.


title: Estimating Demand for Lamb, Beef, Pork, and Poultry in Canada

abstract: This paper investigates the demand for lamb, beef, pork, and poultry in Canada, both at the national level and in disaggregated provinces, to identify meat consumption patterns in different provinces. Meat consumption plays a significant role in Canada's economy and is an important source of calories for the population. However, meat demand faces several consumption challenges due to logistic constraints, as a significant portion of the supply is imported from other countries. Therefore, there is a need for a better understanding of the causal relationships underlying lamb, beef, pork, and poultry consumption in Canada. Until recently, there have been no attempts to estimate meat consumption at the provincial level in Canada. Different Almost Ideal Demand System (AIDS) models have been applied for testing specifications to circumvent several econometric and theoretical problems. In particular, generalized AIDS and its Quadratic extension QUAIDS methods have been estimated across each province using the Iterative Linear Least Squares Estimator (ILLE) estimation Method. Weekly retail meat consumption price and quantity data from 2019 to 2022 have been used for Canada and for each province namely Quebec, Maritime provinces (New Brunswick, Nova Scotia, and Prince Edward Island), Ontario, total West (Yukon, Northwest Territory and Nunavut), Alberta, Manitoba-Saskatchewan and Manitoba as well as British Columbia. Consistent coefficients and demand elasticities estimates reveal patterns of substitution and/or complementarity between the four categories of meat. Meat consumption patterns differ across each province. Results show that the demand for the four categories of meat is responsive to price changes. Overall, lamb expenditure was found to be elastic and thus considered a luxury good during the study period, while the other three categories are considered normal goods across Canada.


title: A Neuro-Symbolic Approach to Multi-Agent RL for Interpretability and Probabilistic Decision Making

abstract: Multi-agent reinforcement learning (MARL) is well-suited for runtime decision-making in optimizing the performance of systems where multiple agents coexist and compete for shared resources. However, applying common deep learning-based MARL solutions to real-world problems suffers from issues of interpretability, sample efficiency, partial observability, etc. To address these challenges, we present an event-driven formulation, where decision-making is handled by distributed co-operative MARL agents using neuro-symbolic methods. The recently introduced neuro-symbolic Logical Neural Networks (LNN) framework serves as a function approximator for the RL, to train a rules-based policy that is both logical and interpretable by construction. To enable decision-making under uncertainty and partial observability, we developed a novel probabilistic neuro-symbolic framework, Probabilistic Logical Neural Networks (PLNN), which combines the capabilities of logical reasoning with probabilistic graphical models. In PLNN, the upward/downward inference strategy, inherited from LNN, is coupled with belief bounds by setting the activation function for the logical operator associated with each neural network node to a probability-respecting generalization of the Fr\'echet inequalities. These PLNN nodes form the unifying element that combines probabilistic logic and Bayes Nets, permitting inference for variables with unobserved states. We demonstrate our contributions by addressing key MARL challenges for power sharing in a system-on-chip application.


title: PaCKD: Pattern-Clustered Knowledge Distillation for Compressing Memory Access Prediction Models

abstract: Deep neural networks (DNNs) have proven to be effective models for accurate Memory Access Prediction (MAP), a critical task in mitigating memory latency through data prefetching. However, existing DNN-based MAP models suffer from the challenges such as significant physical storage space and poor inference latency, primarily due to their large number of parameters. These limitations render them impractical for deployment in real-world scenarios. In this paper, we propose PaCKD, a Pattern-Clustered Knowledge Distillation approach to compress MAP models while maintaining the prediction performance. The PaCKD approach encompasses three steps: clustering memory access sequences into distinct partitions involving similar patterns, training large pattern-specific teacher models for memory access prediction for each partition, and training a single lightweight student model by distilling the knowledge from the trained pattern-specific teachers. We evaluate our approach on LSTM, MLP-Mixer, and ResNet models, as they exhibit diverse structures and are widely used for image classification tasks in order to test their effectiveness in four widely used graph applications. Compared to the teacher models with 5.406M parameters and an F1-score of 0.4626, our student models achieve a 552$\times$ model size compression while maintaining an F1-score of 0.4538 (with a 1.92% performance drop). Our approach yields an 8.70% higher result compared to student models trained with standard knowledge distillation and an 8.88% higher result compared to student models trained without any form of knowledge distillation.


title: CoFRIDA: Self-Supervised Fine-Tuning for Human-Robot Co-Painting

abstract: Prior robot painting and drawing work, such as FRIDA, has focused on decreasing the sim-to-real gap and expanding input modalities for users, but the interaction with these systems generally exists only in the input stages. To support interactive, human-robot collaborative painting, we introduce the Collaborative FRIDA (CoFRIDA) robot painting framework, which can co-paint by modifying and engaging with content already painted by a human collaborator. To improve text-image alignment, FRIDA's major weakness, our system uses pre-trained text-to-image models; however, pre-trained models in the context of real-world co-painting do not perform well because they (1) do not understand the constraints and abilities of the robot and (2) cannot perform co-painting without making unrealistic edits to the canvas and overwriting content. We propose a self-supervised fine-tuning procedure that can tackle both issues, allowing the use of pre-trained state-of-the-art text-image alignment models with robots to enable co-painting in the physical world. Our open-source approach, CoFRIDA, creates paintings and drawings that match the input text prompt more clearly than FRIDA, both from a blank canvas and one with human created work. More generally, our fine-tuning procedure successfully encodes the robot's constraints and abilities into a foundation model, showcasing promising results as an effective method for reducing sim-to-real gaps.


title: Autonomous Mapless Navigation on Uneven Terrains

abstract: We propose a new method for autonomous navigation in uneven terrains by utilizing a sparse Gaussian Process (SGP) based local perception model. The SGP local perception model is trained on local ranging observation (pointcloud) to learn the terrain elevation profile and extract the feasible navigation subgoals around the robot. Subsequently, a cost function, which prioritizes the safety of the robot in terms of keeping the robot's roll and pitch angles bounded within a specified range, is used to select a safety-aware subgoal that leads the robot to its final destination. The algorithm is designed to run in real-time and is intensively evaluated in simulation and real world experiments. The results compellingly demonstrate that our proposed algorithm consistently navigates uneven terrains with high efficiency and surpasses the performance of other planners. The code and video can be found here: https://rb.gy/3ov2r8


title: The Effectiveness of Graph Contrastive Learning on Mathematical Information Retrieval

abstract: This paper details an empirical investigation into using Graph Contrastive Learning (GCL) to generate mathematical equation representations, a critical aspect of Mathematical Information Retrieval (MIR). Our findings reveal that this simple approach consistently exceeds the performance of the current leading formula retrieval model, TangentCFT. To support ongoing research and development in this field, we have made our source code accessible to the public at https://github.com/WangPeiSyuan/GCL-Formula-Retrieval/.


title: Multi-messenger Astrophysics of Black Holes and Neutron Stars as Probed by Ground-based Gravitational Wave Detectors: From Present to Future

abstract: The ground-based gravitational wave (GW) detectors LIGO and Virgo have enabled the birth of multi-messenger GW astronomy via the detection of GWs from merging stellar-mass black holes (BHs) and neutron stars (NSs). GW170817, the first binary NS merger detected in GWs and all bands of the electromagnetic spectrum, is an outstanding example of the impact that GW discoveries can have on multi-messenger astronomy. Yet, GW170817 is only one of the many and varied multi-messenger sources that can be unveiled using ground-based GW detectors. In this contribution, we summarize key open questions in the astrophysics of stellar-mass BHs and NSs that can be answered using current and future-generation ground-based GW detectors, and highlight the potential for new multi-messenger discoveries ahead.


title: Large Language Models for Data Annotation: A Survey

abstract: Data annotation generally refers to the labeling or generating of raw data with relevant information, which could be used for improving the efficacy of machine learning models. The process, however, is labor-intensive and costly. The emergence of advanced Large Language Models (LLMs), exemplified by GPT-4, presents an unprecedented opportunity to automate the complicated process of data annotation. While existing surveys have extensively covered LLM architecture, training, and general applications, we uniquely focus on their specific utility for data annotation. This survey contributes to three core aspects: LLM-Based Annotation Generation, LLM-Generated Annotations Assessment, and LLM-Generated Annotations Utilization. Furthermore, this survey includes an in-depth taxonomy of data types that LLMs can annotate, a comprehensive review of learning strategies for models utilizing LLM-generated annotations, and a detailed discussion of the primary challenges and limitations associated with using LLMs for data annotation. Serving as a key guide, this survey aims to assist researchers and practitioners in exploring the potential of the latest LLMs for data annotation, thereby fostering future advancements in this critical field.


title: Inverse-designed Photonic Computing Core for Parallel Matrix-vector Multiplication

abstract: On-chip optical neural networks (ONNs) have recently emerged as an attractive hardware accelerator for deep learning applications, characterized by high computing density, low latency, and compact size. As these networks rely heavily on massive matrix multiplication, photonic computing cores for matrix computation become crucial components for on-chip ONNs, which harness the degree of freedoms (DOFs) in photonics including space, wavelength and mode dimensions. However, previous photonic computing devices have not fully utilized the orthogonality and the conversion characteristic of the waveguide modes, which as we show here, allows for the simultaneous parallel computing of several independent matrix-vector multiplications within the same device. In this work, we propose an inverse-designed photonic computing core for parallel matrix-vector multiplication. The matrices are implemented through a mode conversion process, where the input fundamental modes are simultaneously converted into several orthogonal output modes. Specifically, we target the complex-valued conversion matrices between input and output modes and inversely design the dielectric distribution within the device to achieve parallel matrix-vector multiplication. As a demonstration, the proposed photonic computing core supports simultaneous parallel computing of two independent matrix-vector multiplications, with an ultra-compact footprint and high computing precision (relative error < 8%) at 1550 nm wavelength. The inverse-designed photonic computing devices hold great potential for high-performance on-chip ONNs with low energy consumption and high computing density.


title: ED-Copilot: Reduce Emergency Department Wait Time with Language Model Diagnostic Assistance

abstract: In the emergency department (ED), patients undergo triage and multiple laboratory tests before diagnosis. This time-consuming process causes ED crowding which impacts patient mortality, medical errors, staff burnout, etc. This work proposes (time) cost-effective diagnostic assistance that leverages artificial intelligence systems to help ED clinicians make efficient and accurate diagnoses. In collaboration with ED clinicians, we use public patient data to curate MIMIC-ED-Assist, a benchmark for AI systems to suggest laboratory tests that minimize wait time while accurately predicting critical outcomes such as death. With MIMIC-ED-Assist, we develop ED-Copilot which sequentially suggests patient-specific laboratory tests and makes diagnostic predictions. ED-Copilot employs a pre-trained bio-medical language model to encode patient information and uses reinforcement learning to minimize ED wait time and maximize prediction accuracy. On MIMIC-ED-Assist, ED-Copilot improves prediction accuracy over baselines while halving average wait time from four hours to two hours. ED-Copilot can also effectively personalize treatment recommendations based on patient severity, further highlighting its potential as a diagnostic assistant. Since MIMIC-ED-Assist is a retrospective benchmark, ED-Copilot is restricted to recommend only observed tests. We show ED-Copilot achieves competitive performance without this restriction as the maximum allowed time increases. Our code is available at https://github.com/cxcscmu/ED-Copilot.


title: CAMELoT: Towards Large Language Models with Training-Free Consolidated Associative Memory

abstract: Large Language Models (LLMs) struggle to handle long input sequences due to high memory and runtime costs. Memory-augmented models have emerged as a promising solution to this problem, but current methods are hindered by limited memory capacity and require costly re-training to integrate with a new LLM. In this work, we introduce an associative memory module which can be coupled to any pre-trained (frozen) attention-based LLM without re-training, enabling it to handle arbitrarily long input sequences. Unlike previous methods, our associative memory module consolidates representations of individual tokens into a non-parametric distribution model, dynamically managed by properly balancing the novelty and recency of the incoming data. By retrieving information from this consolidated associative memory, the base LLM can achieve significant (up to 29.7% on Arxiv) perplexity reduction in long-context modeling compared to other baselines evaluated on standard benchmarks. This architecture, which we call CAMELoT (Consolidated Associative Memory Enhanced Long Transformer), demonstrates superior performance even with a tiny context window of 128 tokens, and also enables improved in-context learning with a much larger set of demonstrations.


title: On-the-fly machine learned force fields for the study of warm dense matter: application to diffusion and viscosity of CH

abstract: We develop a framework for on-the-fly machine learned force field (MLFF) molecular dynamics (MD) simulations of warm dense matter (WDM). In particular, we employ an MLFF scheme based on the kernel method and Bayesian linear regression, with the training data generated from Kohn-Sham density functional theory (DFT) using the Gauss Spectral Quadrature method, within which we calculate energies, atomic forces, and stresses. We verify the accuracy of the formalism by comparing the predicted properties of warm dense carbon with recent Kohn-Sham DFT results in the literature. In so doing, we demonstrate that ab initio MD simulations of WDM can be accelerated by up to three orders of magnitude, while retaining ab initio accuracy. We apply this framework to calculate the diffusion coefficients and shear viscosity of CH at a density of 1 g/cm$^3$ and temperatures in the range of 75,000 to 750,000 K. We find that the self- and inter-diffusion coefficients as well as the viscosity obey a power law with temperature, and that the diffusion coefficient results suggest a weak coupling between C and H in CH. In addition, we find agreement within standard deviation with previous results for C and CH but disagreement for H, demonstrating the need for ab initio calculations as presented here.


title: On the Folklore set and Dirichlet spectrum for matrices

abstract: We study the Folklore set of Dirichlet improvable matrices in $\mathbb R^{m\times n}$ which are neither singular nor badly approximable. We prove the non-emptiness for all positive integer pairs $m,n$ apart from $\{m,n\}=\{ 1,1\}$ and $\{m,n\}=\{ 2,3\}$ in a constructive way. For a wide range of integer pairs $(m,n)$ we construct subsets of the Folklore set with an exact prescribed Dirichlet constant (in some right neighbourhood of $0$). This enables us to provide information on the Dirichlet Spectrum of matrices. The key technique of our construction is to build certain $2$-dimensional simultaneously approximable very singular vectors, and then `lift' these vectors to higher dimensions by `glueing' them to a large set of well-behaved matrices. Our technique is also applicable to arbitrary norms. As a corollary, we obtain lower bounds on the Hausdorff dimension of these sets. These statements complement previous results of the middle-named author (Selecta Math. 2023), Beresnevich et. al. (Adv. Math. 2023), and Das et. al. (Adv. Math. 2024).


title: LocalTweets to LocalHealth: A Mental Health Surveillance Framework Based on Twitter Data

abstract: Prior research on Twitter (now X) data has provided positive evidence of its utility in developing supplementary health surveillance systems. In this study, we present a new framework to surveil public health, focusing on mental health (MH) outcomes. We hypothesize that locally posted tweets are indicative of local MH outcomes and collect tweets posted from 765 neighborhoods (census block groups) in the USA. We pair these tweets from each neighborhood with the corresponding MH outcome reported by the Center for Disease Control (CDC) to create a benchmark dataset, LocalTweets. With LocalTweets, we present the first population-level evaluation task for Twitter-based MH surveillance systems. We then develop an efficient and effective method, LocalHealth, for predicting MH outcomes based on LocalTweets. When used with GPT3.5, LocalHealth achieves the highest F1-score and accuracy of 0.7429 and 79.78\%, respectively, a 59\% improvement in F1-score over the GPT3.5 in zero-shot setting. We also utilize LocalHealth to extrapolate CDC's estimates to proxy unreported neighborhoods, achieving an F1-score of 0.7291. Our work suggests that Twitter data can be effectively leveraged to simulate neighborhood-level MH outcomes.


title: A rational logit dynamic for decision-making under uncertainty: well-posedness, vanishing-noise limit, and numerical approximation

abstract: The classical logit dynamic on a continuous action space for decision-making un-der uncertainty is generalized to the dynamic where the exponential function for the softmax part has been replaced by a rational one that includes the former as a special case. We call the new dynamic as the rational logit dynamic. The use of the rational logit function implies that the uncertainties have a longer tail than that assumed in the classical one. We show that the rational logit dynamic admits a unique measure-valued solution and the solution can be approximated using a fi-nite difference discretization. We also show that the vanishing-noise limit of the rational logit dynamic exists and is different from the best-response one, demon-strating that influences of the uncertainty tail persist in the rational logit dynamic. We finally apply the rational logit dynamic to a unique fishing competition data that has been recently acquired by the authors.


title: Theoretical Analysis of Submodular Information Measures for Targeted Data Subset Selection

abstract: With increasing volume of data being used across machine learning tasks, the capability to target specific subsets of data becomes more important. To aid in this capability, the recently proposed Submodular Mutual Information (SMI) has been effectively applied across numerous tasks in literature to perform targeted subset selection with the aid of a exemplar query set. However, all such works are deficient in providing theoretical guarantees for SMI in terms of its sensitivity to a subset's relevance and coverage of the targeted data. For the first time, we provide such guarantees by deriving similarity-based bounds on quantities related to relevance and coverage of the targeted data. With these bounds, we show that the SMI functions, which have empirically shown success in multiple applications, are theoretically sound in achieving good query relevance and query coverage.


title: Light Bridges and Solar Active Region Evolution Processes

abstract: The formation mechanism of light bridges (LBs) is strongly related to the dynamic evolution of solar active regions (ARs). To study the relationship between LB formation and AR evolution phases, we employ 109 LB samples from 69 ARs in 2014 using observational data from the Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory (HMI/SDO). LBs are well matched with the weak field lanes (WFLs), except that aligned on the polarity inversion line of {\delta} sunspots. For penumbral intrusion (type-A) and umbral-dot emergence (type-C) LBs, the WFLs represent the splitting of magnetic flux systems. The sunspots tend to decay and split into several parts after type-A and type-C LBs formed. For sunspot/umbra merging (type-B) LBs, the WFLs declining are caused by collisions of flux systems. The sunspots merge and keep stable after type-B LBs formed. We conclude that type-B LBs are formed by collisions of flux systems, while type-A and type-C LBs are generated by splits. The time differences ({\delta}T) between LBs appearing and ARs peaking have average value of 1.06, -1.60, 1.82 for type-A, B, C LBs, with the standard deviation of 3.27, 2.17, 1.89, respectively. A positive value of {\delta}T means that the LB appear after AR peaking, whereas a minus {\delta}T before the peak. Type-A LBs trend to form in the decaying phase or around the peak time. Type-B LBs are more likely to be formed in the developing phase. Type-C LBs mostly take shape in the decaying phase of ARs.


title: Universal equation describes the shape of air bubbles trapped in ice

abstract: Water usually contains dissolved gases, and because freezing is a purifying process these gases must be expelled for ice to form. Bubbles appear at the freezing front and are trapped in ice, making pores. These pores come in a range of sizes from microns to millimeters and their shapes are peculiar; never spherical but elongated, and usually fore-aft asymmetric. We show that these remarkable shapes result of a delicate balance between freezing, capillarity, and mass diffusion. A non-linear ordinary differential equation suffices to describe the bubbles, with only two non-dimensional parameters representing the supersaturation and the freezing rate. Our experiments provide us with a large variety of pictures of bubble shapes. We show that all of them have their rounded tip well described by an asymptotic regime of the differential equation, and that most of them can have their full shape quantitatively matched by a full solution. This enables the measurement of the freezing conditions of ice samples, and the design of freeze-cast porous materials. Furthermore, the equation exhibits a bifurcation that explains why some bubbles grow indefinitely and make long cylindrical ``ice worms'', well known to glaciologists.


title: A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models

abstract: Large Language Models (LLMS) have increasingly become central to generating content with potential societal impacts. Notably, these models have demonstrated capabilities for generating content that could be deemed harmful. To mitigate these risks, researchers have adopted safety training techniques to align model outputs with societal values to curb the generation of malicious content. However, the phenomenon of "jailbreaking", where carefully crafted prompts elicit harmful responses from models, persists as a significant challenge. This research conducts a comprehensive analysis of existing studies on jailbreaking LLMs and their defense techniques. We meticulously investigate nine attack techniques and seven defense techniques applied across three distinct language models: Vicuna, LLama, and GPT-3.5 Turbo. We aim to evaluate the effectiveness of these attack and defense techniques. Our findings reveal that existing white-box attacks underperform compared to universal techniques and that including special tokens in the input significantly affects the likelihood of successful attacks. This research highlights the need to concentrate on the security facets of LLMs. Additionally, we contribute to the field by releasing our datasets and testing framework, aiming to foster further research into LLM security. We believe these contributions will facilitate the exploration of security measures within this domain.


title: Non-nucleonic degrees of freedom and the spin structure of the deuteron

abstract: Electro-disintegration of the deuteron at large $Q^2$ currently represents on of the most promising reactions which allows to probe the bound nuclear state at internal momenta comparable to the rest mass of the nucleon. Large internal momentum in this case makes non-nuncleonic states energetically more feasible and the question that we address is what are the signatures that will indicate the existence of such states in the ground state of the nuclear wave function. To probe such states we developed a light-front formalism for relativistic description of a composite pseudo-vector system in which emerging proton and neutron are observed in electro-disintegration reaction. In leading high energy approximation our calculations show the possibility of the existence of a new ``incomplete" P-state-like structure in the deuteron at extremely large internal momenta. The incompleteness of the observed P-state violates the angular condition for the momentum distribution, which can happen only if the deuteron contains non-nucleonic structures, such as $\Delta\Delta$, $N^*N$ or hidden color components. Because such states have distinctive angular momentum ($l=1$) they significantly modify the polarization properties of the deuteron wave function. As a result in addition to angular anisotropy of the LF momentum distribution of the nucleon in the deuteron one predicts strong modification of the tensor polarization asymmetry of the deuteron beyond the S- and D- wave predictions at large internal momenta in the deuteron.


title: Learning to Poison Large Language Models During Instruction Tuning

abstract: The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where adversaries insert backdoor triggers into training data to manipulate outputs for malicious purposes. This work further identifies additional security risks in LLMs by designing a new data poisoning attack tailored to exploit the instruction tuning process. We propose a novel gradient-guided backdoor trigger learning approach to identify adversarial triggers efficiently, ensuring an evasion of detection by conventional defenses while maintaining content integrity. Through experimental validation across various LLMs and tasks, our strategy demonstrates a high success rate in compromising model outputs; poisoning only 1\% of 4,000 instruction tuning samples leads to a Performance Drop Rate (PDR) of around 80\%. Our work highlights the need for stronger defenses against data poisoning attack, offering insights into safeguarding LLMs against these more sophisticated attacks. The source code can be found on this GitHub repository: https://github.com/RookieZxy/GBTL/blob/main/README.md.


title: Time- and angle-resolved photoemission spectroscopy with wavelength-tunable pump and extreme ultraviolet probe enabled by twin synchronized amplifiers

abstract: We describe a setup for time- and angle-resolved photoemission spectroscopy with wavelength-tunable excitation and extreme ultraviolet probe. It is enabled by using the 10 kHz twin Ti:sapphire amplifiers seeded by the common Ti:sapphire oscillator. The typical probe energy is 21.7 eV, and the wavelength of the pump excitation is tuned between 2400 and 1200 nm by using the optical parametric amplifier. The total energy resolution of 133 meV is achieved, and the time resolution is dependent on the wavelength for the pump, typically better than 100 fs. This system enables the pump energy to be matched with a specific interband transition and to probe a wider energy-momentum space. We present the results for the prototypical materials of highly oriented pyrolytic graphite and Bi2Se3 to show the performance of our system.


title: Approximation analysis for the minimization problem of difference-of-convex functions with Moreau envelopes

abstract: In this work the minimization problem for the difference of convex (DC) functions is studied by using Moreau envelopes and the descent method with Moreau gradient is employed to approximate the numerical solution. The main regularization idea in this work is inspired by Hiriart-Urruty [14], Moudafi[17], regularize the components of the DC problem by adapting the different parameters and strategic matrices flexibly to evaluate the whole DC problem. It is shown that the inertial gradient method as well as the classic gradient descent scheme tend towards an approximation stationary point of the original problem.


title: Potential and Challenges of Model Editing for Social Debiasing

abstract: Large language models (LLMs) trained on vast corpora suffer from inevitable stereotype biases. Mitigating these biases with fine-tuning could be both costly and data-hungry. Model editing methods, which focus on modifying LLMs in a post-hoc manner, are of great potential to address debiasing. However, it lacks a comprehensive study that facilitates both internal and external model editing methods, supports various bias types, as well as understands the pros and cons of applying editing methods to stereotypical debiasing. To mitigate this gap, we carefully formulate social debiasing into an editing problem and benchmark seven existing model editing algorithms on stereotypical debiasing, i.e., debias editing. Our findings in three scenarios reveal both the potential and challenges of debias editing: (1) Existing model editing methods can effectively preserve knowledge and mitigate biases, while the generalization of debias effect from edited sentences to semantically equivalent sentences is limited.(2) Sequential editing highlights the robustness of SERAC (Mitchell et al. 2022b), while internal editing methods degenerate with the number of edits. (3) Model editing algorithms achieve generalization towards unseen biases both within the same type and from different types. In light of these findings, we further propose two simple but effective methods to improve debias editing, and experimentally show the effectiveness of the proposed methods.


title: RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models

abstract: The application scope of large language models (LLMs) is increasingly expanding. In practical use, users might provide feedback based on the model's output, hoping for a responsive model that can complete responses according to their feedback. Whether the model can appropriately respond to users' refuting feedback and consistently follow through with execution has not been thoroughly analyzed. In light of this, this paper proposes a comprehensive benchmark, RefuteBench, covering tasks such as question answering, machine translation, and email writing. The evaluation aims to assess whether models can positively accept feedback in form of refuting instructions and whether they can consistently adhere to user demands throughout the conversation. We conduct evaluations on numerous LLMs and find that LLMs are stubborn, i.e. exhibit inclination to their internal knowledge, often failing to comply with user feedback. Additionally, as the length of the conversation increases, models gradually forget the user's stated feedback and roll back to their own responses. We further propose a recall-and-repeat prompts as a simple and effective way to enhance the model's responsiveness to feedback.


title: Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICU

abstract: Clinical practice guidelines, care pathways, and protocols are designed to support evidence-based practices for clinicians; however, their adoption remains a challenge. We set out to investigate why clinicians deviate from the ``Wake Up and Breathe'' protocol, an evidence-based guideline for liberating patients from mechanical ventilation in the intensive care unit (ICU). We conducted over 40 hours of direct observations of live clinical workflows, 17 interviews with frontline care providers, and 4 co-design workshops at three different medical intensive care units. Our findings indicate that unlike prior literature suggests, disagreement with the protocol is not a substantial barrier to adoption. Instead, the uncertainty surrounding the application of the protocol for individual patients leads clinicians to deprioritize adoption in favor of tasks where they have high certainty. Reflecting on these insights, we identify opportunities for technical systems to help clinicians in effectively executing the protocol and discuss future directions for HCI research to support the integration of protocols into clinical practice in complex, team-based healthcare settings.


title: Unsupervised learning based object detection using Contrastive Learning

abstract: Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy environments. However, the collection of imagery itself can often be straightforward; for instance, cameras mounted in vehicles can effortlessly capture vast amounts of data in various real-world scenarios. In light of this, we introduce a groundbreaking method for training single-stage object detectors through unsupervised/self-supervised learning. Our state-of-the-art approach has the potential to revolutionize the labeling process, substantially reducing the time and cost associated with manual annotation. Furthermore, it paves the way for previously unattainable research opportunities, particularly for large, diverse, and challenging datasets lacking extensive labels. In contrast to prevalent unsupervised learning methods that primarily target classification tasks, our approach takes on the unique challenge of object detection. We pioneer the concept of intra-image contrastive learning alongside inter-image counterparts, enabling the acquisition of crucial location information essential for object detection. The method adeptly learns and represents this location information, yielding informative heatmaps. Our results showcase an outstanding accuracy of \textbf{89.2\%}, marking a significant breakthrough of approximately \textbf{15x} over random initialization in the realm of unsupervised object detection within the field of computer vision.


title: Leveraging Demonstrator-perceived Precision for Safe Interactive Imitation Learning of Clearance-limited Tasks

abstract: Interactive imitation learning is an efficient, model-free method through which a robot can learn a task by repetitively iterating an execution of a learning policy and a data collection by querying human demonstrations. However, deploying unmatured policies for clearance-limited tasks, like industrial insertion, poses significant collision risks. For such tasks, a robot should detect the collision risks and request intervention by ceding control to a human when collisions are imminent. The former requires an accurate model of the environment, a need that significantly limits the scope of IIL applications. In contrast, humans implicitly demonstrate environmental precision by adjusting their behavior to avoid collisions when performing tasks. Inspired by human behavior, this paper presents a novel interactive learning method that uses demonstrator-perceived precision as a criterion for human intervention called Demonstrator-perceived Precision-aware Interactive Imitation Learning (DPIIL). DPIIL captures precision by observing the speed-accuracy trade-off exhibited in human demonstrations and cedes control to a human to avoid collisions in states where high precision is estimated. DPIIL improves the safety of interactive policy learning and ensures efficiency without explicitly providing precise information of the environment. We assessed DPIIL's effectiveness through simulations and real-robot experiments that trained a UR5e 6-DOF robotic arm to perform assembly tasks. Our results significantly improved training safety, and our best performance compared favorably with other learning methods.


title: Galactic diffuse emission from radio to ultra-high-energy gamma rays in light of up-to-date cosmic ray measurements

abstract: Cosmic rays travel throughout the Galaxy, leaving traces from radio to ultra-high-energy gamma rays due to interactions with the interstellar gas, radiation field and magnetic field. Therefore, it is necessary to utilize multi-wavelength investigations on the Galactic diffuse emission to shed light on the physics of CR production and propagation. In this work, we present a spatially dependent propagation scenario, taking account of a local source contribution, while making allowances for an additional CR component freshly accelerated near their sources. In this picture, after reproducing the particle measurements at the Solar system, we calculated the intensity and compared the spectral energy distribution to observations from Fermi-LAT and LHAASO-KM2A in the gamma-ray band, and from WMAP and Planck among other radio surveys at lower energies. Multi-band data considered in conjunction, the former comparison exhibits sufficiently good consistency in favor of our model, while the latter calls for improvement in data subtraction and processing. From this standpoint, there remains potential for advanced observations at energies from milli-eVs to MeVs towards the Galactic plane, in order to evaluate our model further and more comprehensively in the future.


title: STENCIL: Submodular Mutual Information Based Weak Supervision for Cold-Start Active Learning

abstract: As supervised fine-tuning of pre-trained models within NLP applications increases in popularity, larger corpora of annotated data are required, especially with increasing parameter counts in large language models. Active learning, which attempts to mine and annotate unlabeled instances to improve model performance maximally fast, is a common choice for reducing the annotation cost; however, most methods typically ignore class imbalance and either assume access to initial annotated data or require multiple rounds of active learning selection before improving rare classes. We present STENCIL, which utilizes a set of text exemplars and the recently proposed submodular mutual information to select a set of weakly labeled rare-class instances that are then strongly labeled by an annotator. We show that STENCIL improves overall accuracy by $10\%-24\%$ and rare-class F-1 score by $17\%-40\%$ on multiple text classification datasets over common active learning methods within the class-imbalanced cold-start setting.


title: The Quantum Abstract Machine

abstract: This paper develops a model of quantum behavior that is intended to support the abstract yet accurate design and functional verification of quantum communication protocols. The work is motivated by the need for conceptual tools for the development of quantum-communication systems that are usable by non-specialists in quantum physics while also correctly capturing at a useful abstraction the underlying quantum phenomena. Our approach involves defining a quantum abstract machine (QAM) whose operations correspond to well-known quantum circuits; these operations, however, are given direct abstract semantics in a style similar to that of Berry's and Boudol's Chemical Abstract Machine. This paper defines the QAM's semantics and shows via examples how it may be used to model and reason about existing quantum communication protocols.


title: How Important is Domain Specificity in Language Models and Instruction Finetuning for Biomedical Relation Extraction?

abstract: Cutting edge techniques developed in the general NLP domain are often subsequently applied to the high-value, data-rich biomedical domain. The past few years have seen generative language models (LMs), instruction finetuning, and few-shot learning become foci of NLP research. As such, generative LMs pretrained on biomedical corpora have proliferated and biomedical instruction finetuning has been attempted as well, all with the hope that domain specificity improves performance on downstream tasks. Given the nontrivial effort in training such models, we investigate what, if any, benefits they have in the key biomedical NLP task of relation extraction. Specifically, we address two questions: (1) Do LMs trained on biomedical corpora outperform those trained on general domain corpora? (2) Do models instruction finetuned on biomedical datasets outperform those finetuned on assorted datasets or those simply pretrained? We tackle these questions using existing LMs, testing across four datasets. In a surprising result, general-domain models typically outperformed biomedical-domain models. However, biomedical instruction finetuning improved performance to a similar degree as general instruction finetuning, despite having orders of magnitude fewer instructions. Our findings suggest it may be more fruitful to focus research effort on larger-scale biomedical instruction finetuning of general LMs over building domain-specific biomedical LMs


title: Thermal transport in a 2D amorphous material

abstract: Two-dimensional (2D) crystals proved revolutionary soon after graphene was discovered in 2004. However, 2D amorphous materials only became accessible in 2020 and remain largely unexplored. In particular, the thermophysical properties of amorphous materials are of great interest upon transition from 3D to 2D. Here, we probe thermal transport in 2D amorphous carbon. A cross-plane thermal conductivity ($\kappa$) down to 0.079 $\rm{Wm}^{-1}K^{-1}$ is measured for van der Waals stacked multilayers at room temperature, which is among the lowest reported to date. Meanwhile, an unexpectedly high in-plane $\kappa$ is obtained for freestanding monolayers which is a few times larger than what is predicted by conventional wisdom for 3D amorphous carbon with similar $\rm{sp}^{2}$ fraction. Our molecular dynamics simulations reveal the role of disorder and highlight the impact of dimensionality. Amorphous materials at the 2D limit open up new avenues for understanding and manipulating heat at the atomic scale.


title: Generalized linear models with spatial dependence and a functional covariate

abstract: We extend generalized functional linear models under independence to a situation in which a functional covariate is related to a scalar response variable that exhibits spatial dependence. For estimation, we apply basis expansion and truncation for dimension reduction of the covariate process followed by a composite likelihood estimating equation to handle the spatial dependency. We develop asymptotic results for the proposed model under a repeating lattice asymptotic context, allowing us to construct a confidence interval for the spatial dependence parameter and a confidence band for the parameter function. A binary conditionals model is presented as a concrete illustration and is used in simulation studies to verify the applicability of the asymptotic inferential results.


title: Learning Highly Dynamic Behaviors for Quadrupedal Robots

abstract: Learning highly dynamic behaviors for robots has been a longstanding challenge. Traditional approaches have demonstrated robust locomotion, but the exhibited behaviors lack diversity and agility. They employ approximate models, which lead to compromises in performance. Data-driven approaches have been shown to reproduce agile behaviors of animals, but typically have not been able to learn highly dynamic behaviors. In this paper, we propose a learning-based approach to enable robots to learn highly dynamic behaviors from animal motion data. The learned controller is deployed on a quadrupedal robot and the results show that the controller is able to reproduce highly dynamic behaviors including sprinting, jumping and sharp turning. Various behaviors can be activated through human interaction using a stick with markers attached to it. Based on the motion pattern of the stick, the robot exhibits walking, running, sitting and jumping, much like the way humans interact with a pet.


title: Modeling oncolytic virus therapy with distributed delay and non-local diffusion

abstract: In the field of modeling the dynamics of oncolytic viruses, researchers often face the challenge of using specialized mathematical terms to explain uncertain biological phenomena. This paper introduces a basic framework for an oncolytic virus dynamics model with a general growth rate $\mathcal{F}$ and a general nonlinear incidence term $\mathcal{G}$. The construction and derivation of the model explain in detail the generation process and practical significance of the distributed time delays and non-local infection terms. The paper provides the existence and uniqueness of solutions to the model, as well as the existence of a global attractor. Furthermore, through two auxiliary linear partial differential equations, the threshold parameters $\sigma_1$ are determined for sustained tumor growth and $\lambda_1$ for successful viral invasion of tumor cells to analyze the global dynamic behavior of the model. Finally, we illustrate and analyze our abstract theoretical results through a specific example.


title: Multi-scale Spatio-temporal Transformer-based Imbalanced Longitudinal Learning for Glaucoma Forecasting from Irregular Time Series Images

abstract: Glaucoma is one of the major eye diseases that leads to progressive optic nerve fiber damage and irreversible blindness, afflicting millions of individuals. Glaucoma forecast is a good solution to early screening and intervention of potential patients, which is helpful to prevent further deterioration of the disease. It leverages a series of historical fundus images of an eye and forecasts the likelihood of glaucoma occurrence in the future. However, the irregular sampling nature and the imbalanced class distribution are two challenges in the development of disease forecasting approaches. To this end, we introduce the Multi-scale Spatio-temporal Transformer Network (MST-former) based on the transformer architecture tailored for sequential image inputs, which can effectively learn representative semantic information from sequential images on both temporal and spatial dimensions. Specifically, we employ a multi-scale structure to extract features at various resolutions, which can largely exploit rich spatial information encoded in each image. Besides, we design a time distance matrix to scale time attention in a non-linear manner, which could effectively deal with the irregularly sampled data. Furthermore, we introduce a temperature-controlled Balanced Softmax Cross-entropy loss to address the class imbalance issue. Extensive experiments on the Sequential fundus Images for Glaucoma Forecast (SIGF) dataset demonstrate the superiority of the proposed MST-former method, achieving an AUC of 98.6% for glaucoma forecasting. Besides, our method shows excellent generalization capability on the Alzheimer's Disease Neuroimaging Initiative (ADNI) MRI dataset, with an accuracy of 90.3% for mild cognitive impairment and Alzheimer's disease prediction, outperforming the compared method by a large margin.


title: Exploring the dependence of the Hubble constant from the cluster-lensed supernova SN Refsdal on mass model assumptions

abstract: The Hubble constant, $H_0$, which is a crucial parameter in astrophysics and cosmology, is under significant tension. We explore an independent technique to measure $H_0$ based on the time-delay cosmography with strong gravitational lensing of a supernova lensed by a galaxy cluster, focusing on SN Refsdal in MACS J1149.5+2223, the first gravitationally lensed supernova with resolved multiple images. We carefully examine the dependence of constraints on the Hubble constant on the choice of lens mass models, employing 23 lens mass models with different assumptions on dark matter halos and external perturbations. Remarkably, we observe that the dependence on the choice of lens mass models is not significantly large, suggesting the robustness of the constraint on the Hubble constant from SN Refsdal. We combine measurements for the 23 lens mass models to obtain $H_0=70.0^{+4.7}_{-4.9}km/s/Mpc$ assuming equal weighting. We find that best-fitting Hubble constant values correlate with radial density profiles of the lensing cluster, implying a room for improving the constraint on the Hubble constant with future observations of more multiple images. We also find a clear correlation between best-fitting Hubble constant values and magnification factors of supernova multiple images. This correlation highlights the importance of gravitationally lensed Type Ia supernovae for accurate and robust Hubble constant measurements.


title: Multiplicity of powers of path ideals of a line graph

abstract: Let $S=K[x_1,\ldots,x_n]$ and let $I$ be the $t$-path ideal of the line graph $L_n$ with $n$-vertices. It is shown that the set of associated prime ideals of $I^s$ is equal to the set of minimal prime ideals of $I$ for all $s\geq 1$, and we provide an explicit description of these prime ideals. Additionally, as the main contribution of this paper, we derive an explicit formula for the multiplicity of $S/I^s$ for all $s\geq 1$, revealing that it is a polynomial in $s$ from the beginning.


title: Plasmon Enhanced Spectroscopy and Photocatalysis

abstract: This study examines the Raman scattering and charge transfer properties of molecules adsorbed on the surface of a tetrahedral Au$_{120}$ nanoparticle based on the time-dependent density functional tight-binding (TD-DFTB) method. We study Raman scattering (SERS) enhancements for pyridine where the molecule is adsorbed either on the tip (V complex) or surface (S complex) of the nanoparticle. The scattering intensity is enhanced by a factor of 3-15 due to chemical effects while significantly larger enhancements (in the order of 10$^2$-10$^4$) are observed for plasmon resonance excitation at an energy of 2.5 eV depending on the adsorption site. Furthermore, we demonstrate charge transfer between the nanoparticle and a fullerene-based molecule after pulsed excitation of the plasmon resonance which shows how plasmon excitation can lead to negative molecular ion formation. All of these results are consistent with earlier studies using either TD-DFT theory or experimental measurements.


title: Some inequalities for adjointable operators on Hilbert $C^*$-modules

abstract: The main purpose of this paper is, in the general setting of the adjointable operators on Hilbert $C^*$-modules, to develop two new tools that can be applied to deal with the positive solutions of certain operator equations, the operator norm as well as the numerical radius, respectively. Among other things, the positivity of a $2\times 2$ block operator matrix is clarified without any preconditions on its entries, and a generalized version of the mixed Schwarz inequality with a parameter is derived. Numerical examples are provided to illustrate the non-triviality of this newly obtained inequality.


title: Modeling and Simulation of the Evaporation and Drying of a Two Component Slurry Droplet

abstract: In this paper, we present a mathematical model and numerical simulation of the evaporation and drying process of a liquid droplet containing suspended solids. This type of drying is commonly encountered in manufacturing processes such as spray drying and spray pyrolysis, which have applications in industries such as food and pharmaceuticals. The proposed model consists of three stages. In the first stage, we consider the evaporation of the liquid in the presence of solid particles. The second stage involves the formation of a porous crust around a wet core region, with liquid evaporation occurring through the crust layer. Finally, the third stage involves sensible heating of the dry particle to reach ambient temperature. To solve the physical models governing these processes, we use a finite difference method with a moving grid methodology. This allows us to account for the moving interface between the crust and the wet core region of the droplet. In this study, we use a non-uniform temperature model that takes into account the spatial variation of temperature inside the droplet. We also assess the validity of a uniform temperature model. To validate our model, we compare it with experimental data on the drying of a single droplet containing colloidal silica particles. We find that our model agrees well with the experimental results. We rigorously examine assumptions made in the model, such as the shape of the solid particles and the continuum flow of vapor through the porous crust. In addition, we analyze the effects of drying conditions, such as the velocity, temperature, relative humidity, and concentration of solid particles, on the drying rate and the final morphology of the particle. Finally, we develop a regime map that can be used to determine whether the final particle will be solid or hollow, based on the operating conditions.


title: Learning to Model Diverse Driving Behaviors in Highly Interactive Autonomous Driving Scenarios with Multi-Agent Reinforcement Learning

abstract: Autonomous vehicles trained through Multi-Agent Reinforcement Learning (MARL) have shown impressive results in many driving scenarios. However, the performance of these trained policies can be impacted when faced with diverse driving styles and personalities, particularly in highly interactive situations. This is because conventional MARL algorithms usually operate under the assumption of fully cooperative behavior among all agents and focus on maximizing team rewards during training. To address this issue, we introduce the Personality Modeling Network (PeMN), which includes a cooperation value function and personality parameters to model the varied interactions in high-interactive scenarios. The PeMN also enables the training of a background traffic flow with diverse behaviors, thereby improving the performance and generalization of the ego vehicle. Our extensive experimental studies, which incorporate different personality parameters in high-interactive driving scenarios, demonstrate that the personality parameters effectively model diverse driving styles and that policies trained with PeMN demonstrate better generalization compared to traditional MARL methods.


title: Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks

abstract: Despite large successes of recent language models on diverse tasks, they suffer from severe performance degeneration in low-resource settings with limited training data available. Many existing works tackle this problem by generating synthetic data from the training data and then training models on them, recently using Large Language Models (LLMs). However, in low-resource settings, the amount of seed data samples to use for data augmentation is very small, which makes generated samples suboptimal and less diverse. To tackle this challenge, we propose a novel method that augments training data by incorporating a wealth of examples from other datasets, along with the given training data. Specifically, we first retrieve the relevant instances from other datasets, such as their input-output pairs or contexts, based on their similarities with the given seed data, and then prompt LLMs to generate new samples with the contextual information within and across the original and retrieved samples. This approach can ensure that the generated data is not only relevant but also more diverse than what could be achieved using the limited seed data alone. We validate our proposed Retrieval-Augmented Data Augmentation (RADA) framework on multiple datasets under low-resource settings of training and test-time data augmentation scenarios, on which it outperforms existing LLM-powered data augmentation baselines.