title: FS-RAG: A Frame Semantics Based Approach for Improved Factual Accuracy in Large Language Models

abstract: We present a novel extension to Retrieval Augmented Generation with the goal of mitigating factual inaccuracies in the output of large language models. Specifically, our method draws on the cognitive linguistic theory of frame semantics for the indexing and retrieval of factual information relevant to helping large language models answer queries. We conduct experiments to demonstrate the effectiveness of this method both in terms of retrieval effectiveness and in terms of the relevance of the frames and frame relations automatically generated. Our results show that this novel mechanism of Frame Semantic-based retrieval, designed to improve Retrieval Augmented Generation (FS-RAG), is effective and offers potential for providing data-driven insights into frame semantics theory. We provide open access to our program code and prompts.


title: An All-MLP Sequence Modeling Architecture That Excels at Copying

abstract: Recent work demonstrated Transformers' ability to efficiently copy strings of exponential sizes, distinguishing them from other architectures. We present the Causal Relation Network (CausalRN), an all-MLP sequence modeling architecture that can match Transformers on the copying task. Extending Relation Networks (RNs), we implemented key innovations to support autoregressive sequence modeling while maintaining computational feasibility. We discovered that exponentially-activated RNs are reducible to linear time complexity, and pre-activation normalization induces an infinitely growing memory pool, similar to a KV cache. In ablation study, we found both exponential activation and pre-activation normalization are indispensable for Transformer-level copying. Our findings provide new insights into what actually constitutes strong in-context retrieval.


title: On the origin of polar planets around single stars

abstract: The Rossiter-McLaughlin effect measures the misalignment between a planet's orbital plane and its host star's rotation plane. Around 10$\%$ of planets exhibit misalignments in the approximate range $80 - 125^\circ$, with their origin remaining a mystery. On the other hand, large misalignments may be common in eccentric circumbinary systems due to misaligned discs undergoing polar alignment. If the binary subsequently merges, a polar circumbinary disc -- along with any planets that form within it -- may remain inclined near 90$^{\circ}$ to the merged star's rotation. To test this hypothesis, we present $N$-body simulations of the evolution of a polar circumbinary debris disc comprised of test particles around an eccentric binary during a binary merger that is induced by tidal dissipation. After the merger, the disc particles remain on near-polar orbits. Interaction of the binary with the polar-aligned gas disc may be required to bring the binary to the small separations that trigger the merger by tides. Our findings imply that planets forming in discs that are polar-aligned to the orbit of a high-eccentricity binary may, following the merger of the binary, provide a possible origin for the population of near-polar planets around single stars.


title: SimCE: Simplifying Cross-Entropy Loss for Collaborative Filtering

abstract: The learning objective is integral to collaborative filtering systems, where the Bayesian Personalized Ranking (BPR) loss is widely used for learning informative backbones. However, BPR often experiences slow convergence and suboptimal local optima, partially because it only considers one negative item for each positive item, neglecting the potential impacts of other unobserved items. To address this issue, the recently proposed Sampled Softmax Cross-Entropy (SSM) compares one positive sample with multiple negative samples, leading to better performance. Our comprehensive experiments confirm that recommender systems consistently benefit from multiple negative samples during training. Furthermore, we introduce a \underline{Sim}plified Sampled Softmax \underline{C}ross-\underline{E}ntropy Loss (SimCE), which simplifies the SSM using its upper bound. Our validation on 12 benchmark datasets, using both MF and LightGCN backbones, shows that SimCE significantly outperforms both BPR and SSM.


title: Exploring the difficulty of estimating win probability: a simulation study

abstract: Estimating win probability is one of the classic modeling tasks of sports analytics. Many widely used win probability estimators are statistical win probability models, which fit the relationship between a binary win/loss outcome variable and certain game-state variables using data-driven regression or machine learning approaches. To illustrate just how difficult it is to accurately fit a statistical win probability model from noisy and highly correlated observational data, in this paper we conduct a simulation study. We create a simplified random walk version of football in which true win probability at each game-state is known, and we see how well a model recovers it. We find that the dependence structure of observational play-by-play data substantially inflates the bias and variance of estimators and lowers the effective sample size. This makes it essential to quantify uncertainty in win probability estimates, but typical bootstrapped confidence intervals are too narrow and don't achieve nominal coverage. Hence, we introduce a novel method, the fractional bootstrap, to calibrate these intervals to achieve adequate coverage.


title: Algebraic billiards in the Fermat hyperbola

abstract: Algebraic billiards in a plane curve of degree $d \geq 2$ is a rational correspondence on a surface. The dynamical degree is an algebraic analogue of entropy that measures intersection-theoretic complexity. We compute a lower bound on the dynamical degree of billiards in the generic algebraic curve of degree $d$ over any field of characteristic coprime to $2d$, complementing the upper bound in our previous work. To do this, we specialize to a highly symmetric curve that we call the Fermat hyperbola. Over $\mathbb{C}$, we construct an algebraically stable model for this billiard via an iterated blowup. Over general fields, we compute the growth of a particular big and nef divisor.


title: Crepe: A Mobile Screen Data Collector Using Graph Query

abstract: Collecting mobile datasets remains challenging for academic researchers due to limited data access and technical barriers. Commercial organizations often possess exclusive access to mobile data, leading to a "data monopoly" that restricts the independence of academic research. Existing open-source mobile data collection frameworks primarily focus on mobile sensing data rather than screen content, which is crucial for various research studies. We present Crepe, a no-code Android app that enables researchers to collect information displayed on screen through simple demonstrations of target data. Crepe utilizes a novel Graph Query technique which augments the structures of mobile UI screens to support flexible identification, location, and collection of specific data pieces. The tool emphasizes participants' privacy and agency by providing full transparency over collected data and allowing easy opt-out. We designed and built Crepe for research purposes only and in scenarios where researchers obtain explicit consent from participants. Code for Crepe will be open-sourced to support future academic research data collection.


title: Comparison of methods for mediation analysis with multiple correlated mediators

abstract: Various methods have emerged for conducting mediation analyses with multiple correlated mediators, each with distinct strengths and limitations. However, a comparative evaluation of these methods is lacking, providing the motivation for this paper. This study examines six mediation analysis methods for multiple correlated mediators that provide insights to the contributors for health disparities. We assessed the performance of each method in identifying joint or path-specific mediation effects in the context of binary outcome variables varying mediator types and levels of residual correlation between mediators. Through comprehensive simulations, the performance of six methods in estimating joint and/or path-specific mediation effects was assessed rigorously using a variety of metrics including bias, mean squared error, coverage and width of the 95$\%$ confidence intervals. Subsequently, these methods were applied to the REasons for Geographic And Racial Differences in Stroke (REGARDS) study, where differing conclusions were obtained depending on the mediation method employed. This evaluation provides valuable guidance for researchers grappling with complex multi-mediator scenarios, enabling them to select an optimal mediation method for their research question and dataset.


title: The Persistence of Contrarianism on Twitter: Mapping users' sharing habits for the Ukraine war, COVID-19 vaccination, and the 2020 Midterm Elections

abstract: Empirical studies of online disinformation emphasize matters of public concern such as the COVID-19 pandemic, foreign election interference, and the Russo-Ukraine war, largely in studies that treat the topics separately. Comparatively fewer studies attempt to relate such disparate topics and address the extent to which they share behaviors. In this study, we compare three samples of Twitter data on COVID-19 vaccination, the Ukraine war and the 2020 midterm elections, to ascertain how distinct ideological stances of users across the three samples might be related. Our results indicate the emergence of a broad contrarian stance that is defined by its opposition to public health narratives/policies along with the Biden administration's foreign policy stances. Sharing activity within the contrarian position falls on a spectrum with outright conspiratorial content on one end. We confirm the existence of ideologically coherent cross-subject stances among Twitter users, but in a manner not squarely aligned with right-left political orientations.


title: GraphEval2000: Benchmarking and Improving Large Language Models on Graph Datasets

abstract: Large language models (LLMs) have achieved remarkable success in natural language processing (NLP), demonstrating significant capabilities in processing and understanding text data. However, recent studies have identified limitations in LLMs' ability to reason about graph-structured data. To address this gap, we introduce GraphEval2000, the first comprehensive graph dataset, comprising 40 graph data structure problems along with 2000 test cases. Additionally, we introduce an evaluation framework based on GraphEval2000, designed to assess the graph reasoning abilities of LLMs through coding challenges. Our dataset categorizes test cases into four primary and four sub-categories, ensuring a comprehensive evaluation. We evaluate eight popular LLMs on GraphEval2000, revealing that LLMs exhibit a better understanding of directed graphs compared to undirected ones. While private LLMs consistently outperform open-source models, the performance gap is narrowing. Furthermore, to improve the usability of our evaluation framework, we propose Structured Symbolic Decomposition (SSD), an instruction-based method designed to enhance LLM performance on GraphEval2000. Results show that SSD improves the performance of GPT-3.5, GPT-4, and GPT-4o on complex graph problems, with an increase of 11.11\%, 33.37\%, and 33.37\%, respectively.


title: Flowy: Supporting UX Design Decisions Through AI-Driven Pattern Annotation in Multi-Screen User Flows

abstract: Many recent AI-powered UX design tools focus on generating individual static UI screens from natural language. However, they overlook the crucial aspect of interactions and user experiences across multiple screens. Through formative studies with UX professionals, we identified limitations of these tools in supporting realistic UX design workflows. In response, we designed and developed Flowy, an app that augments designers' information foraging process in ideation by supplementing specific user flow examples with distilled design pattern knowledge. Flowy utilizes large multimodal AI models and a high-quality user flow dataset to help designers identify and understand relevant abstract design patterns in the design space for multi-screen user flows. Our user study with professional UX designers demonstrates how Flowy supports realistic UX tasks. Our design considerations in Flowy, such as representations with appropriate levels of abstraction and assisted navigation through the solution space, are generalizable to other creative tasks and embody a human-centered, intelligence augmentation approach to using AI in UX design.


title: A Precision Gyroscope from the Spin of Light

abstract: We describe a gyroscope that measures rotation based on the effects of the rotation on the polarization of light. Rotation induces a differential phase shift in the propagation of left and right circularly polarized light and this phase shift can be measured in suitably designed interferometric setups. The signal in this setup is independent of the frequency of light, unlike various sources of noise such as vibrations, which cause phase shifts that depend on the frequency. Such vibrations are the practical limit on the sensitivity of conventional Sagnac-style optical interferometers that are typically used as gyroscopes. In the proposed setup, one can potentially mitigate this source of noise by simultaneously using two (or more) sources of light that have different frequencies. The signal in this setup scales with the total storage time of the light. Due to its frequency independence, it is thus most optimal to measure the signal using superconducting RF systems where the high finesse of the available cavities enables considerably longer storage times than is possible in an optical setup.


title: Combinatorial Curve Neighborhood of the Affine Flag Manifold of Type $A_{n-1}^1$

abstract: Let $\mathscr{X}$ be the affine flag manifold of Lie type $A_{n-1}^{(1)}$ where $n \geq 3$ and let $W_{\text{aff}}$ be the associated affine Weyl group. The moment graph for $\mathscr{X}$ encodes the torus fixed points (corresponding to elements of the affine Weyl group $W_{\text{aff}}$) and the torus stable curves in $\mathscr{X}$. Given a fixed point $u\in W_{\text{aff}}$ and a degree $\mathbf{d}=(d_0,d_1,...,d_{n-1})\in \mathbb{Z}_{\geq 0}^{n}$, the combinatorial curve neighborhood is the set of maximal elements in the moment graph of $\mathscr{X}$ which can be reached from $u'\leq u$ by a chain of curves of total degree $\leq \mathbf{d}$. In this paper we give combinatorial formulas and algorithms for calculating these elements in $\mathscr{X}$.


title: Boundary Conditions that Remove Certain Ultraviolet Divergences

abstract: In quantum field theory, Hamiltonians contain particle creation and annihilation terms that are usually ultraviolet (UV) divergent. It is well known that these divergences can sometimes be removed by adding counter-terms and taking limits in which an UV cut-off tends to infinity. Here, I review a novel way of removing UV divergences: by imposing a kind of boundary condition on the wave function. These conditions, called interior-boundary conditions (IBCs), relate the values of the wave function at two configurations linked by the creation or annihilation of a particle. They allow for a direct definition of the Hamiltonian without renormalization or limiting procedures. In the last section, I review another boundary condition that serves for determining the probability distribution of detection times and places on a timelike 3-surface.


title: Constants of motion and quantum non-relativistic motion of a charged particle on a flat surface with transversal magnetic field

abstract: The motion of a charged particle moving on a flat surface is studied through the constants of motion associated to the system, given the magnetic gauge. The usual Landau' solution and the non separable solution for the Landau's gauge are found, and new non separable solution for the symmetric gauge is given. As a consequence of this, the quantization of the magnetic flux results from the invariance of the solutions under the unitary transformations which arise from the operators constants of motion.


title: Privacy-Preserving and Trustworthy Localization in an IoT Environment

abstract: The Internet of Things (IoT) is increasingly prevalent in various applications, such as healthcare and logistics. One significant service of IoT technologies that is essential for these applications is localization. The goal of this service is to determine the precise position of a specific target. The localization data often needs to be private, accessible only to specific entities, and must maintain authenticity and integrity to ensure trustworthiness. IoT technology has evolved significantly, with Ultra-Wide Band (UWB) technology enhancing localization speed and precision. However, IoT device security remains a concern, as devices can be compromised or act maliciously. Furthermore, localization data is typically stored centrally, which can also be a point of vulnerability. Our approach leverages the features of a permissioned blockchain, specifically Hyperledger Fabric, to address these challenges. Hyperledger Fabric's collection feature ensures data privacy, and its smart contracts (chaincode) enhance trustworthiness. We tested our solution using a network of devices known as CLOVES, demonstrating robust performance characteristics with UWB technology. Additionally, we evaluated our approach through an indoor localization use case.


title: Short-range correlation and Urca process in neutron stars

abstract: Recent measurements of high-momentum correlated neutron-proton pairs at JLab suggest that the dense nucleonic component of the compact stars contain a fraction of high-momentum neutron-proton pairs that is not accounted in the familiar Fermi-liquid theory of the neutron-proton fluid mixture. We compute the rate of the Urca process in compact stars taking into the non-Fermi liquid contributions to the proton's spectral widths induced by short-range correlations. The Urca rate differs strongly from the Fermi-liquid prediction at low temperatures, in particular, the high threshold on the proton fraction precluding the Urca process in neutron stars is is lifted. This observation may have a profound impact on the theories of cooling of compact stars.


title: Characters, Hall subgroups, and Normal Complements

abstract: We settle a question from 1962: if $H$ is a Hall subgroup of a finite group $G$, then all the irreducible complex characters of $H$ extend to $G$ if and only if $H$ haS A normal complement.


title: Thermally-operating regimes for a three-layer liquid metal battery

abstract: Thermally-operating regimes of a three-layer liquid metal battery are determined in terms of the aspect ratio. The heat exchange between the battery container and the environment is taken into account. Velocity fields and temperature distribution of the convection state inside the battery are determined from numerical simulations. For a chosen geometry, the identified operating regime result in characteristic charge/discharge time close to half a day.


title: Philosophical views of justice and their implications in energy systems modelling

abstract: What constitutes socially just or unjust energy systems or transitions can be derived from the philosophy and theories of justice. Assessments of justice and utilising them in modelling lead to great differences based on which justice principles are applied. We find that comparisons between the two principles of utilitarianism and egalitarianism dominate in assessments of distributive justice, with the latter most often considered representing a "just energy system". The lack of recognition of alternative and equally valid principles of justice, resting on e.g. capabilities, responsibilities and/or opportunities, leads to a narrow understanding of justice that fails to align with the views of different individuals, stakeholders and societies. More importantly, it can lead to the unjust design of future energy systems and energy systems analysis. In this work, we contribute to the growing amount of research on justice in energy systems modelling by assessing the implications of different philosophical views on justice on modelling results. Through a modelling exercise with a power system model for Europe, we explore different designs of a future net-zero European energy system, and its distributional implications based on the application of different justice principles. In addition to the utilitarian and egalitarian approach, we include, among others, principles of "polluters pay" and "ability-to-pay", which take historical contributions of GHG and the socio-economic conditions of a region into account. We find that socially just energy systems look significantly different depending on the justice principles applied. The results may stimulate a greater discussion among researchers and policymakers on the implications of different constructions of justice in modelling, expansion of approaches, and demonstrate the importance of transparency and assumptions when communicating such results


title: Evaluation and Comparison of Emotionally Evocative Image Augmentation Methods

abstract: Experiments in affective computing are based on stimulus datasets that, in the process of standardization, receive metadata describing which emotions each stimulus evokes. In this paper, we explore an approach to creating stimulus datasets for affective computing using generative adversarial networks (GANs). Traditional dataset preparation methods are costly and time consuming, prompting our investigation of alternatives. We conducted experiments with various GAN architectures, including Deep Convolutional GAN, Conditional GAN, Auxiliary Classifier GAN, Progressive Augmentation GAN, and Wasserstein GAN, alongside data augmentation and transfer learning techniques. Our findings highlight promising advances in the generation of emotionally evocative synthetic images, suggesting significant potential for future research and improvements in this domain.


title: A Benchmarking of QCD Evolution at Approximate $N^3LO$

abstract: We present a detailed benchmarking of different treatments of the QCD evolution of unpolarized PDFs at approximate $N^3LO$ ($aN^3LO$) order in the QCD coupling. Namely, the implementations in the public $aN^3LO$ releases of the MSHT and NNPDF global PDF fitters, as well as that of the theoretical FHMRUVV collaboration are compared. This follows the same procedure as in previous benchmarking exercises at lower order, that is by considering the impact of this evolution on a set of simple toy PDFs.


title: Fuzzy Attention-based Border Rendering Network for Lung Organ Segmentation

abstract: Automatic lung organ segmentation on CT images is crucial for lung disease diagnosis. However, the unlimited voxel values and class imbalance of lung organs can lead to false-negative/positive and leakage issues in advanced methods. Additionally, some slender lung organs are easily lost during the recycled down/up-sample procedure, e.g., bronchioles & arterioles, causing severe discontinuity issue. Inspired by these, this paper introduces an effective lung organ segmentation method called Fuzzy Attention-based Border Rendering (FABR) network. Since fuzzy logic can handle the uncertainty in feature extraction, hence the fusion of deep networks and fuzzy sets should be a viable solution for better performance. Meanwhile, unlike prior top-tier methods that operate on all regular dense points, our FABR depicts lung organ regions as cube-trees, focusing only on recycle-sampled border vulnerable points, rendering the severely discontinuous, false-negative/positive organ regions with a novel Global-Local Cube-tree Fusion (GLCF) module. All experimental results, on four challenging datasets of airway & artery, demonstrate that our method can achieve the favorable performance significantly.


title: On open book analogs of quantum graphs

abstract: Quantum graphs have become in this century a favorite playground for mathematicians, mathematical physicists, and chemists, due to their manifold applications as models of thin structures, as well as presenting sometimes simpler playground for hard higher dimensional problems. It was clear from some applications that thin surface structures (looking as stratified varieties) also arise, for instance in photonic crystals theory and dynamical systems. However, both justification and studying of these models is much harder and very little progress has been made by now. The goal of this note is to set down some basic notions and results for such structures. The name ``open book'' has been used for such geometric structures in topology and comes from an image of several smooth $n$-dimensional ``pages'' bound to an $(n-1)$- dimensional ``binding.''


title: Accelerating Matrix Diagonalization through Decision Transformers with Epsilon-Greedy Optimization

abstract: This paper introduces a novel framework for matrix diagonalization, recasting it as a sequential decision-making problem and applying the power of Decision Transformers (DTs). Our approach determines optimal pivot selection during diagonalization with the Jacobi algorithm, leading to significant speedups compared to the traditional max-element Jacobi method. To bolster robustness, we integrate an epsilon-greedy strategy, enabling success in scenarios where deterministic approaches fail. This work demonstrates the effectiveness of DTs in complex computational tasks and highlights the potential of reimagining mathematical operations through a machine learning lens. Furthermore, we establish the generalizability of our method by using transfer learning to diagonalize matrices of smaller sizes than those trained.


title: HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysis

abstract: Spatial transcriptomics (ST) enables interrogating the molecular composition of tissue with ever-increasing resolution, depth, and sensitivity. However, costs, rapidly evolving technology, and lack of standards have constrained computational methods in ST to narrow tasks and small cohorts. In addition, the underlying tissue morphology as reflected by H&E-stained whole slide images (WSIs) encodes rich information often overlooked in ST studies. Here, we introduce HEST-1k, a collection of 1,108 spatial transcriptomic profiles, each linked to a WSI and metadata. HEST-1k was assembled using HEST-Library from 131 public and internal cohorts encompassing 25 organs, two species (Homo Sapiens and Mus Musculus), and 320 cancer samples from 25 cancer types. HEST-1k processing enabled the identification of 1.5 million expression--morphology pairs and 60 million nuclei. HEST-1k is tested on three use cases: (1) benchmarking foundation models for histopathology (HEST-Benchmark), (2) biomarker identification, and (3) multimodal representation learning. HEST-1k, HEST-Library, and HEST-Benchmark can be freely accessed via https://github.com/mahmoodlab/hest.


title: Semi-Variance Reduction for Fair Federated Learning

abstract: Ensuring fairness in a Federated Learning (FL) system, i.e., a satisfactory performance for all of the participating diverse clients, is an important and challenging problem. There are multiple fair FL algorithms in the literature, which have been relatively successful in providing fairness. However, these algorithms mostly emphasize on the loss functions of worst-off clients to improve their performance, which often results in the suppression of well-performing ones. As a consequence, they usually sacrifice the system's overall average performance for achieving fairness. Motivated by this and inspired by two well-known risk modeling methods in Finance, Mean-Variance and Mean-Semi-Variance, we propose and study two new fair FL algorithms, Variance Reduction (VRed) and Semi-Variance Reduction (SemiVRed). VRed encourages equality between clients' loss functions by penalizing their variance. In contrast, SemiVRed penalizes the discrepancy of only the worst-off clients' loss functions from the average loss. Through extensive experiments on multiple vision and language datasets, we show that, SemiVRed achieves SoTA performance in scenarios with heterogeneous data distributions and improves both fairness and system overall average performance.


title: Electrically tunable giant Nernst effect in two-dimensional van der Waals heterostructures

abstract: The Nernst effect, a transverse thermoelectric phenomenon, has attracted significant attention for its potential in energy conversion, thermoelectrics, and spintronics. However, achieving high performance and versatility at low temperatures remains elusive. Here, we demonstrate a large and electrically tunable Nernst effect by combining graphene's electrical properties with indium selenide's semiconducting nature in a field-effect geometry. Our results establish a novel platform for exploring and manipulating this thermoelectric effect, showcasing the first electrical tunability with an on/off ratio of 10^3. Moreover, photocurrent measurements reveal a stronger photo-Nernst signal in the Gr/InSe heterostructure compared to individual components. Remarkably, we observe a record-high Nernst coefficient of 66.4 {\mu}V K^(-1) T^(-1) at ultra-low temperatures and low magnetic fields, paving the way toward applications in quantum information and low-temperature emergent phenomena.


title: A Python Benchmark Functions Framework for Numerical Optimisation Problems

abstract: This work proposes a framework of benchmark functions designed to facilitate the creation of test cases for numerical optimisation techniques. The framework, written in Python 3, is designed to be easy to install, use, and expand. The collection includes some of the most used multi-modal continuous functions present in literature, which can be instantiated using an arbitrary number of dimensions. Meta-information of each benchmark function, like search boundaries and position of known optima, are included and made easily accessible through class methods. Built-in interactive visualisation capabilities, baseline techniques, and rigorous testing protocols complement the features of the framework. The framework can be found here: \url{https://gitlab.com/luca.baronti/python_benchmark_functions


title: Torsion-Free Lattices in Baumslag-Solitar Complexes

abstract: This paper classifies the pairs of nonzero integers $(m,n)$ for which the locally compact group of combinatorial automorphisms, Aut$(X_{m,n})$, contains incommensurable torsion-free lattices, where $X_{m,n}$ is the combinatorial model for Baumslag-Solitar group $BS(m, n)$. In particular, we show that Aut$(X_{m,n})$ contains abstractly incommensurable torsion-free lattices if and only if there exists a prime $p \leq gcd(m, n)$ such that either $m/gcd(m,n)$ or $n/gcd(m,n)$ is divisible by $p$. Additionally, we show that when Aut$(X_{m,n})$ does not contain incommensurable lattices, the cell complex $X_{m,n}$ satisfies Leighton$'$s property.


title: Free Electron Theory for Thin Metal Films

abstract: Quantum free electrons, i.e. plane waves, with wavevector k, and occupancy constrained by the Pauli exclusion principle, are explained in all introductory texts about solids. A free-electron description works surprisingly well for many properties of "simple" metals. It is assumed that the interior of the metal is essentially infinite, and surfaces are presumed irrelevant. Over the past 30 years, experiments that visualize surfaces have revolutionized solid state physics, stimulating new theory and applications. Therefore, a basic question is, how can the free electron picture be applied to properties of solids where surfaces play a prominent role? Various versions of an extended free-electron theory are used, but not always explained pedagogically. This paper focusses on idealized metallic films. Three versions (an oversimplified one and two stages of improvement) of a free-electron description of metal films are given. These versions are illustrated in detail for the specific example of a slab of aluminum with six layers of atoms.


title: Hardware-Aware Neural Dropout Search for Reliable Uncertainty Prediction on FPGA

abstract: The increasing deployment of artificial intelligence (AI) for critical decision-making amplifies the necessity for trustworthy AI, where uncertainty estimation plays a pivotal role in ensuring trustworthiness. Dropout-based Bayesian Neural Networks (BayesNNs) are prominent in this field, offering reliable uncertainty estimates. Despite their effectiveness, existing dropout-based BayesNNs typically employ a uniform dropout design across different layers, leading to suboptimal performance. Moreover, as diverse applications require tailored dropout strategies for optimal performance, manually optimizing dropout configurations for various applications is both error-prone and labor-intensive. To address these challenges, this paper proposes a novel neural dropout search framework that automatically optimizes both the dropout-based BayesNNs and their hardware implementations on FPGA. We leverage one-shot supernet training with an evolutionary algorithm for efficient dropout optimization. A layer-wise dropout search space is introduced to enable the automatic design of dropout-based BayesNNs with heterogeneous dropout configurations. Extensive experiments demonstrate that our proposed framework can effectively find design configurations on the Pareto frontier. Compared to manually-designed dropout-based BayesNNs on GPU, our search approach produces FPGA designs that can achieve up to 33X higher energy efficiency. Compared to state-of-the-art FPGA designs of BayesNN, the solutions from our approach can achieve higher algorithmic performance and energy efficiency.


title: Reinterpreting Economic Complexity: A co-clustering approach

abstract: Economic growth results from countries' accumulation of organizational and technological capabilities. The Economic and Product Complexity Indices, introduced as an attempt to measure these capabilities from a country's basket of exported products, have become popular to study economic development, the geography of innovation, and industrial policies. Despite this reception, the interpretation of these indicators proved difficult. Although the original Method of Reflections suggested a direct interconnection between country and product metrics, it has been proved that the Economic and Product Complexity Indices result from a spectral clustering algorithm that separately groups similar countries or similar products, respectively. This recent approach to economic and product complexity conflicts with the original one and treats separately countries and products. However, building on previous interpretations of the indices and the recent evolution in spectral clustering, we show that these indices simultaneously identify two co-clusters of similar countries and products. This viewpoint reconciles the spectral clustering interpretation of the indices with the original Method of Reflections interpretation. By proving the often neglected intimate relationship between country and product complexity, this approach emphasizes the role of a selected set of products in determining economic development while extending the range of applications of these indicators in economics.


title: Towards unlocking the mystery of adversarial fragility of neural networks

abstract: In this paper, we study the adversarial robustness of deep neural networks for classification tasks. We look at the smallest magnitude of possible additive perturbations that can change the output of a classification algorithm. We provide a matrix-theoretic explanation of the adversarial fragility of deep neural network for classification. In particular, our theoretical results show that neural network's adversarial robustness can degrade as the input dimension $d$ increases. Analytically we show that neural networks' adversarial robustness can be only $1/\sqrt{d}$ of the best possible adversarial robustness. Our matrix-theoretic explanation is consistent with an earlier information-theoretic feature-compression-based explanation for the adversarial fragility of neural networks.


title: Blind Baselines Beat Membership Inference Attacks for Foundation Models

abstract: Membership inference (MI) attacks try to determine if a data sample was used to train a machine learning model. For foundation models trained on unknown Web data, MI attacks can be used to detect copyrighted training materials, measure test set contamination, or audit machine unlearning. Unfortunately, we find that evaluations of MI attacks for foundation models are flawed, because they sample members and non-members from different distributions. For 8 published MI evaluation datasets, we show that blind attacks -- that distinguish the member and non-member distributions without looking at any trained model -- outperform state-of-the-art MI attacks. Existing evaluations thus tell us nothing about membership leakage of a foundation model's training data.


title: Refined Tsirelson Bounds on Multipartite Bell Inequalities

abstract: Despite their importance, there is an on-going challenge characterizing multipartite quantum correlations. The Svetlichny and Mermin-Klyshko (MK) inequalities present constraints on correlations in multipartite systems, a violation of which allows to classify the correlations by using the non-separability property. In this work we present refined Tsirelson (quantum) bounds on these inequalities, derived from inequalities stemming from a fundamental constraint, tightly akin to quantum uncertainty. Unlike the original, known inequalities, our bounds do not consist of a single constant point but rather depend on correlations in specific subsystems (being local correlations for our bounds on the Svetlichny operators and bipartite correlations for our bounds on the MK operators). We analyze concrete examples in which our bounds are strictly tighter than the known bounds.


title: LLMs' Classification Performance is Overclaimed

abstract: In many classification tasks designed for AI or human to solve, gold labels are typically included within the label space by default, often posed as "which of the following is correct?" This standard setup has traditionally highlighted the strong performance of advanced AI, particularly top-performing Large Language Models (LLMs), in routine classification tasks. However, when the gold label is intentionally excluded from the label space, it becomes evident that LLMs still attempt to select from the available label candidates, even when none are correct. This raises a pivotal question: Do LLMs truly demonstrate their intelligence in understanding the essence of classification tasks? In this study, we evaluate both closed-source and open-source LLMs across representative classification tasks, arguing that the perceived performance of LLMs is overstated due to their inability to exhibit the expected comprehension of the task. This paper makes a threefold contribution: i) To our knowledge, this is the first work to identify the limitations of LLMs in classification tasks when gold labels are absent. We define this task as Classify-w/o-Gold and propose it as a new testbed for LLMs. ii) We introduce a benchmark, Know-No, comprising two existing classification tasks and one new task, to evaluate Classify-w/o-Gold. iii) This work defines and advocates for a new evaluation metric, OmniAccuracy, which assesses LLMs' performance in classification tasks both when gold labels are present and absent.


title: Breaking the Frame: Image Retrieval by Visual Overlap Prediction

abstract: We propose a novel visual place recognition approach, VOP, that efficiently addresses occlusions and complex scenes by shifting from traditional reliance on global image similarities and local features to image overlap prediction. The proposed method enables the identification of visible image sections without requiring expensive feature detection and matching. By focusing on obtaining patch-level embeddings by a Vision Transformer backbone and establishing patch-to-patch correspondences, our approach uses a voting mechanism to assess overlap scores for potential database images, thereby providing a nuanced image retrieval metric in challenging scenarios. VOP leads to more accurate relative pose estimation and localization results on the retrieved image pairs than state-of-the-art baselines on a number of large-scale, real-world datasets. The code is available at https://github.com/weitong8591/vop.


title: Recursions Satisfied by Families of Determinants with Applications to Resistance Distance

abstract: The main contribution of this paper is a six-step semi-automatic algorithm that obtains a recursion satisfied by a family of determinants by systematically and iteratively applying Laplace expansion to the underlying matrix family. The recursion allows explicit computation of the Binet form providing a closed formula for resistance distance between two specified nodes in a family of graphs. This approach is particularly suited for graph families with complex structures; the method is used to prove the 1 over 14 conjectured asymptotic formula for linear 3--trees. Additionally, although the literature on recursive formulas for resistance distances is quite large, the Fibonacci Quarterly and the Proceedings have almost no such results despite the fact that many recursions related to resistance distances involve the Fibonacci numbers. Therefore, a secondary purpose of the paper is to provide a brief introductory survey of graph families, accompanied by figures, Laplacian matrices, and typical recursive results, supported by a modest bibliography of current papers on many relevant graph families, in the hope to involve Fibonaccians in this active and beautiful field.


title: Zero-Inflated Tweedie Boosted Trees with CatBoost for Insurance Loss Analytics

abstract: In this paper, we explore advanced modifications to the Tweedie regression model in order to address its limitations in modeling aggregate claims for various types of insurance such as automobile, health, and liability. Traditional Tweedie models, while effective in capturing the probability and magnitude of claims, usually fall short in accurately representing the large incidence of zero claims. Our recommended approach involves a refined modeling of the zero-claim process, together with the integration of boosting methods in order to help leverage an iterative process to enhance predictive accuracy. Despite the inherent slowdown in learning algorithms due to this iteration, several efficient implementation techniques that also help precise tuning of parameter like XGBoost, LightGBM, and CatBoost have emerged. Nonetheless, we chose to utilize CatBoost, a efficient boosting approach that effectively handles categorical and other special types of data. The core contribution of our paper is the assembly of separate modeling for zero claims and the application of tree-based boosting ensemble methods within a CatBoost framework, assuming that the inflated probability of zero is a function of the mean parameter. The efficacy of our enhanced Tweedie model is demonstrated through the application of an insurance telematics dataset, which presents the additional complexity of compositional feature variables. Our modeling results reveal a marked improvement in model performance, showcasing its potential to deliver more accurate predictions suitable for insurance claim analytics.


title: Thinking beyond Bias: Analyzing Multifaceted Impacts and Implications of AI on Gendered Labour

abstract: Artificial Intelligence with its multifaceted technologies and integral role in global production significantly impacts gender dynamics particularly in gendered labor. This paper emphasizes the need to explore AIs broader impacts on gendered labor beyond its current emphasis on the generation and perpetuation of epistemic biases. We draw attention to how the AI industry as an integral component of the larger economic structure is transforming the nature of work. It is expanding the prevalence of platform based work models and exacerbating job insecurity particularly for women. Of critical concern is the increasing exclusion of women from meaningful engagement in the digital labor force. This issue often overlooked demands urgent attention from the AI research community. Understanding AIs multifaceted role in gendered labor requires a nuanced examination of economic transformation and its implications for gender equity. By shedding light on these intersections this paper aims to stimulate in depth discussions and catalyze targeted actions aimed at mitigating the gender disparities accentuated by AI driven transformations.


title: Deformation Families of Quasi-Projective Varieties and Symmetric Projective K3 Surfaces

abstract: The main aim of this paper is to construct a deformation family of symmetric projective K3 surfaces through a deformation family of quasi-projective varieties together with construction of symmetric Kahler metrics on symmetric projective K3 surfaces. Firstly, if the normal bundle satisfies the Diophantine condition, the tubular neighborhood of an elliptic curve embedded in $\text{CP}^2 \text{$\#$9} \overline{\text{CP}}^2$ can be identified through the toroidal group. Secondly, with ample line bundles fixed on $\text{CP}^2 \text{$\#$9} \overline{\text{CP}}^2$, complete Kahler metrics are constructed on the quasi-projective variety from $\text{CP}^2 \text{$\#$9} \overline{\text{CP}}^2$. Finally, a deformation family of symmetric projective K3 surfaces over a 10-dimensional complex manifold is constructed through a smooth compactifiable deformation of complete quasi-projective varieties from $\text{CP}^2 \text{$\#$9} \overline{\text{CP}}^2$ over a 9-dimensional complex manifold and an analogue deformation family.


title: Covering Simple Orthogonal Polygons with Rectangles

abstract: We study the problem of Covering Orthogonal Polygons with Rectangles. For polynomial-time algorithms, the best-known approximation factor is $O(\sqrt{\log n})$ when the input polygon may have holes [Kumar and Ramesh, STOC '99, SICOMP '03], and there is a $2$-factor approximation algorithm known when the polygon is hole-free [Franzblau, SIDMA '89]. Arguably, an easier problem is the Boundary Cover problem where we are interested in covering only the boundary of the polygon in contrast to the original problem where we are interested in covering the interior of the polygon, hence it is also referred as the Interior Cover problem. For the Boundary Cover problem, a $4$-factor approximation algorithm is known to exist and it is APX-hard when the polygon has holes [Berman and DasGupta, Algorithmica '94]. In this work, we investigate how effective is local search algorithm for the above covering problems on simple polygons. We prove that a simple local search algorithm yields a PTAS for the Boundary Cover problem when the polygon is simple. Our proof relies on the existence of planar supports on appropriate hypergraphs defined on the Boundary Cover problem instance. On the other hand, we construct instances where support graphs for the Interior Cover problem have arbitrarily large bicliques, thus implying that the same local search technique cannot yield a PTAS for this problem. We also show large locality gap for its dual problem, namely the Maximum Antirectangle problem.


title: Received Power Maximization Using Nonuniform Discrete Phase Shifts for RISs With a Limited Phase Range

abstract: To maximize the received power at a user equipment, the problem of optimizing a reconfigurable intelligent surface (RIS) with a limited phase range R and nonuniform discrete phase shifts with adjustable gains is addressed. Necessary and sufficient conditions to achieve this maximization are given. These conditions are employed in two algorithms to achieve the global optimum in linear time for R {\ge} {\pi} and R < {\pi}, where R is the RIS phase range. With a total number of N(2K +1) complex vector additions, it is shown for R {\ge} {\pi} and R < {\pi} that the global optimality is achieved in NK or fewer and N(K +1) or fewer steps, respectively, where N is the number of RIS elements and K is the number of discrete phase shifts which may be placed nonuniformly over the phase range R. In addition, we define an intuitive quantization algorithm that we call the nonuniform polar quantization (NPQ) algorithm. With NPQ, we provide a closed form solution for the approximation ratio with which an arbitrary set of nonuniform discrete phase shifts can approximate the continuous solution. We also show that with a phase range limitation, equal separation among the nonuniform discrete phase shifts maximizes the normalized performance. Furthermore, we show that the gain of using K {\ge} 3 with R < {\pi}/2 and K {\ge} 4 with R < {\pi} is only marginal. Finally, we reveal that when R < 2{\pi}/3, ON/OFF selection for the RIS elements brings significant performance compared to the case when the RIS elements are strictly ON.


title: Machine-Learning-Enabled Fast Optical Identification and Characterization of 2D Materials

abstract: Two-dimensional materials are a class of atomically thin materials with assorted electronic and quantum properties. Accurate identification of layer thickness, especially for a single monolayer, is crucial for their characterization. This characterization process, however, is often time-consuming, requiring highly skilled researchers and expensive equipment like atomic force microscopy. This project aims to streamline the identification process by using machine learning to analyze optical images and quickly determine layer thickness. In this paper, we evaluate the performance of three machine learning models -- SegNet, 1D U-Net, and 2D U-Net -- in accurately identifying monolayers in microscopic images. Additionally, we explore labeling and image processing techniques to determine the most effective method for identifying layer thickness in this class of materials.


title: A Mechanism for Optimizing Media Recommender Systems

abstract: A mechanism is described that addresses the fundamental trade off between media producers who want to increase reach and consumers who provide attention based on the rate of utility received, and where overreach negatively impacts that rate. An optimal solution can be achieved when the media source considers the impact of overreach in a cost function used in determining the optimal distribution of content to maximize individual consumer utility and participation. The result is a Nash equilibrium between producer and consumer that is also Pareto efficient. Comparison with the literature on Recommender systems highlights the advantages of the mechanism.The review suggests advancements over that literature including identifying an optimal content volume for the consumer and improvements for handling multiple objectives A practical algorithm to generate the optimal distribution for each consumer is provided.


title: Provable Statistical Rates for Consistency Diffusion Models

abstract: Diffusion models have revolutionized various application domains, including computer vision and audio generation. Despite the state-of-the-art performance, diffusion models are known for their slow sample generation due to the extensive number of steps involved. In response, consistency models have been developed to merge multiple steps in the sampling process, thereby significantly boosting the speed of sample generation without compromising quality. This paper contributes towards the first statistical theory for consistency models, formulating their training as a distribution discrepancy minimization problem. Our analysis yields statistical estimation rates based on the Wasserstein distance for consistency models, matching those of vanilla diffusion models. Additionally, our results encompass the training of consistency models through both distillation and isolation methods, demystifying their underlying advantage.


title: Reducing the Sampling Burden of Fourier Sensing with a Non-rectangular Field-of-View

abstract: With Fourier sensing, it is commonly the case that the field-of-view (FOV), the area of space to be imaged, is known prior to reconstruction. To date, reconstruction algorithms have focused on FOVs with simple geometries: a rectangle or a hexagon. This yields sampling patterns that are more burdensome than necessary. Due to the reduced area of imaging possible with an arbitrary (e.g., non-rectangular) FOV, the number of samples required for a high-quality images is reduced. However, when an arbitrary FOV has been considered, the reconstruction algorithm is computationally expensive. In this manuscript, we present a method to reduce the sampling pattern for an arbitrary FOV with an accompanying direct (non-iterative) reconstruction algorithm. We also present a method to decrease the computational cost of the (iterative) model-based reconstruction (MBR) algorithm. We present results using MRI data of an ankle, a pineapple, and a brain.


title: Porosity and topological properties of triply periodic minimal surfaces

abstract: Triple periodic minimal surfaces (TPMS) have garnered significant interest due to their structural efficiency and controllable geometry, making them suitable for a wide range of applications. This paper investigates the relationships between porosity and persistence entropy with the shape factor of TPMS. We propose conjectures suggesting that these relationships are polynomial in nature, derived through the application of machine learning techniques. This study exemplifies the integration of machine learning methodologies in pure mathematical research. Besides the conjectures, we provide the mathematical models that might have the potential implications for the design and modeling of TPMS structures in various practical applications.

categories: math.DG math-ph math.GT math.KT math.MP stat.ML


title: A Predictor-Corrector Algorithm in the Framework of Conformable Fractional Differential Equations

abstract: This work proposes a conformable fractional predictor-corrector algorithm for solving conformable fractional differential equations. Fractional calculus is finding applications in various scientific fields, but existing numerical methods might have limitations. This work addresses that gap by introducing a new algorithm specifically designed for the conformable fractional derivative using Adams-Bashforth and Adams-Moulton methods.


title: Monopole Excitation and Nuclear Compressibility: Present and Future Perspectives

abstract: Isoscalar giant resonances are nuclear collective excitations associated with the oscillation in phase of protons and neutrons according to a certain multipolarity $L$. In particular, the isoscalar giant monopole resonance ($L=0$) is the strongest nuclear compression mode, and its excitation energy is directly related to the compression modulus for finite nuclei. Typically, microscopic calculations are utilized to establish a relationship between the experimental compression modulus and the nuclear incompressibility that is a crucial parameter of the equation of state for nuclear matter. The incompressibility of nuclear matter has been determined with an accuracy of 10 to 20\% using relativistic and non-relativistic microscopic models for describing the monopole distributions in ${}^{208}$Pb and ${}^{90}$Zr isotopes. However, the same theoretical models are not able to describe data for open-shell nuclei, such as those of tin and cadmium isotopes. In fact, only effective interactions with a softer nuclear-matter incompressibility are able to predict the centroid energy of monopole distributions for open-shell nuclei. An unified description of the monopole resonance in ${}^{208}$Pb and other open-shell nuclei remains unsolved from the theory side. Most of this uncertainty is due to our poor knowledge of the symmetry energy, which is another essential component of the equation of state of nuclear matter. Therefore, new experimental data along isotopic chains covering a wide range in $N/Z$ ratios, including neutron-deficient and neutron-rich nuclei, are of paramount importance for determining both the nuclear-matter incompressibility and the symmetry energy more precisely.


title: Trace is the New AutoDiff -- Unlocking Efficient Optimization of Computational Workflows

abstract: We study a class of optimization problems motivated by automating the design and update of AI systems like coding assistants, robots, and copilots. We propose an end-to-end optimization framework, Trace, which treats the computational workflow of an AI system as a graph akin to neural networks, based on a generalization of back-propagation. Optimization of computational workflows often involves rich feedback (e.g. console output or user's responses), heterogeneous parameters (e.g. prompts, hyper-parameters, codes), and intricate objectives (beyond maximizing a score). Moreover, its computation graph can change dynamically with the inputs and parameters. We frame a new mathematical setup of iterative optimization, Optimization with Trace Oracle (OPTO), to capture and abstract these properties so as to design optimizers that work across many domains. In OPTO, an optimizer receives an execution trace along with feedback on the computed output and updates parameters iteratively. Trace is the tool to implement OPTO in practice. Trace has a Python interface that efficiently converts a computational workflow into an OPTO instance using a PyTorch-like interface. Using Trace, we develop a general-purpose LLM-based optimizer called OptoPrime that can effectively solve OPTO problems. In empirical studies, we find that OptoPrime is capable of first-order numerical optimization, prompt optimization, hyper-parameter tuning, robot controller design, code debugging, etc., and is often competitive with specialized optimizers for each domain. We believe that Trace, OptoPrime and the OPTO framework will enable the next generation of interactive agents that automatically adapt using various kinds of feedback. Website: https://microsoft.github.io/Trace


title: Towards a Formal Foundation for Blockchain Rollups

abstract: Blockchains like Bitcoin and Ethereum have revolutionized digital transactions, yet scalability issues persist. Layer 2 solutions, such as validity proof Rollups (ZK-Rollups), aim to address these challenges by processing transactions off-chain and validating them on the main chain. However, concerns remain about security and censorship resistance, particularly regarding centralized control in Layer 2 and inadequate mechanisms for enforcing these properties through Layer 1 contracts. This work presents a formal analysis using the Alloy specification language to examine and design key Layer 2 functionalities, including forced transaction queues, safe blacklisting, and upgradeability. Through this analysis, we identify potential vulnerabilities in current mechanisms and propose enhanced models to strengthen security and censorship resistance, setting new standards for the security of rollups.


title: Learning Run-time Safety Monitors for Machine Learning Components

abstract: For machine learning components used as part of autonomous systems (AS) in carrying out critical tasks it is crucial that assurance of the models can be maintained in the face of post-deployment changes (such as changes in the operating environment of the system). A critical part of this is to be able to monitor when the performance of the model at runtime (as a result of changes) poses a safety risk to the system. This is a particularly difficult challenge when ground truth is unavailable at runtime. In this paper we introduce a process for creating safety monitors for ML components through the use of degraded datasets and machine learning. The safety monitor that is created is deployed to the AS in parallel to the ML component to provide a prediction of the safety risk associated with the model output. We demonstrate the viability of our approach through some initial experiments using publicly available speed sign datasets.


title: F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data

abstract: Demand prediction is a crucial task for e-commerce and physical retail businesses, especially during high-stake sales events. However, the limited availability of historical data from these peak periods poses a significant challenge for traditional forecasting methods. In this paper, we propose a novel approach that leverages strategically chosen proxy data reflective of potential sales patterns from similar entities during non-peak periods, enriched by features learned from a graph neural networks (GNNs)-based forecasting model, to predict demand during peak events. We formulate the demand prediction as a meta-learning problem and develop the Feature-based First-Order Model-Agnostic Meta-Learning (F-FOMAML) algorithm that leverages proxy data from non-peak periods and GNN-generated relational metadata to learn feature-specific layer parameters, thereby adapting to demand forecasts for peak events. Theoretically, we show that by considering domain similarities through task-specific metadata, our model achieves improved generalization, where the excess risk decreases as the number of training tasks increases. Empirical evaluations on large-scale industrial datasets demonstrate the superiority of our approach. Compared to existing state-of-the-art models, our method demonstrates a notable improvement in demand prediction accuracy, reducing the Mean Absolute Error by 26.24% on an internal vending machine dataset and by 1.04% on the publicly accessible JD.com dataset.


title: The microlocal Riemann-Hilbert correspondence for complex contact manifolds

abstract: Kashiwara showed in 1996 that the categories of microlocalized D-modules can be canonically glued to give a sheaf of categories over a complex contact manifold. Much more recently, and by rather different considerations, we constructed a canonical notion of perverse microsheaves on the same class of spaces. Here we provide a Riemann-Hilbert correspondence.


title: Continuous Output Personality Detection Models via Mixed Strategy Training

abstract: The traditional personality models only yield binary results. This paper presents a novel approach for training personality detection models that produce continuous output values, using mixed strategies. By leveraging the PANDORA dataset, which includes extensive personality labeling of Reddit comments, we developed models that predict the Big Five personality traits with high accuracy. Our approach involves fine-tuning a RoBERTa-base model with various strategies such as Multi-Layer Perceptron (MLP) integration, and hyperparameter tuning. The results demonstrate that our models significantly outperform traditional binary classification methods, offering precise continuous outputs for personality traits, thus enhancing applications in AI, psychology, human resources, marketing and health care fields.


title: From Text to Test: AI-Generated Control Software for Materials Science Instruments

abstract: Large language models (LLMs) are transforming the landscape of chemistry and materials science. Recent examples of LLM-accelerated experimental research include virtual assistants for parsing synthesis recipes from the literature, or using the extracted knowledge to guide synthesis and characterization. Despite these advancements, their application is constrained to labs with automated instruments and control software, leaving much of materials science reliant on manual processes. Here, we demonstrate the rapid deployment of a Python-based control module for a Keithley 2400 electrical source measure unit using ChatGPT-4. Through iterative refinement, we achieved effective instrument management with minimal human intervention. Additionally, a user-friendly graphical user interface (GUI) was created, effectively linking all instrument controls to interactive screen elements. Finally, we integrated this AI-crafted instrument control software with a high-performance stochastic optimization algorithm to facilitate rapid and automated extraction of electronic device parameters related to semiconductor charge transport mechanisms from current-voltage (IV) measurement data. This integration resulted in a comprehensive open-source toolkit for semiconductor device characterization and analysis using IV curve measurements. We demonstrate the application of these tools by acquiring, analyzing, and parameterizing IV data from a Pt/Cr$_2$O$_3$:Mg/$\beta$-Ga$_2$O$_3$ heterojunction diode, a novel stack for high-power and high-temperature electronic devices. This approach underscores the powerful synergy between LLMs and the development of instruments for scientific inquiry, showcasing a path for further acceleration in materials science.


title: On The Effectiveness of Dynamic Reduction Techniques in Automated Program Repair

abstract: Repairing a large-scale buggy program using current automated program repair (APR) approaches can be a time-consuming operation that requires significant computational resources. We describe a program repair framework that effectively handles large-scale buggy programs of industrial complexity. The framework exploits program reduction in the form of program slicing to eliminate parts of the code irrelevant to the bug being repaired without adversely affecting the capability of the repair system in producing correct patches. Observation-based slicing is a recently introduced, language-independent slicing technique that shows a good effectiveness in a wide range of applications. In this work, we show how ORBS can be effectively integrated with APR to improve all aspects of the repair process including the fault localization step, patch generation step, and patch validation step. The presented repair framework indeed enhances the capability of APR by reducing the execution cost of a test suite and the search cost for the appropriate faulty statement corresponding to the bug being repair. Our empirical results on the widely used Defects4J dataset reveal that a substantial improvement in performance can be obtained without any degradation in repair quality.


title: Homogenization of non-convex integral energies with Orlicz growth via periodic unfolding

abstract: The periodic unfolding method is extended to the Orlicz setting and used to prove a homogenization result for non-convex integral energies defined on vector-valued configurations in the Orlicz-Sobolev setting.


title: VICatMix: variational Bayesian clustering and variable selection for discrete biomedical data

abstract: Effective clustering of biomedical data is crucial in precision medicine, enabling accurate stratifiction of patients or samples. However, the growth in availability of high-dimensional categorical data, including `omics data, necessitates computationally efficient clustering algorithms. We present VICatMix, a variational Bayesian finite mixture model designed for the clustering of categorical data. The use of variational inference (VI) in its training allows the model to outperform competitors in term of efficiency, while maintaining high accuracy. VICatMix furthermore performs variable selection, enhancing its performance on high-dimensional, noisy data. The proposed model incorporates summarisation and model averaging to mitigate poor local optima in VI, allowing for improved estimation of the true number of clusters simultaneously with feature saliency. We demonstrate the performance of VICatMix with both simulated and real-world data, including applications to datasets from The Cancer Genome Atlas (TCGA), showing its use in cancer subtyping and driver gene discovery. We demonstrate VICatMix's utility in integrative cluster analysis with different `omics datasets, enabling the discovery of novel subtypes. \textbf{Availability:} VICatMix is freely available as an R package, incorporating C++ for faster computation, at \url{https://github.com/j-ackierao/VICatMix}.


title: Comments on the publication "Discrete symmetries tested at 10e-4 precision using linear polarization of photons from positronium annihilations" by P. Moskal et al

abstract: The authors of Ref.[1] (referred to here as "Moskal et al.") claim to have performed the most precise test of P, T and CP invariance in the decay of ortho-Positronium. In this note: 1) we demonstrate, assuming standard properties for Compton scattering, that the average value of the correlation measured by Moskal et al. must necessarily be zero, independently of any physics occurring in o-Ps decay; 2) we point out that there is no formal justification to equate the normal vector to the Compton scattering plane with the incident photon polarization, as done by Moskal et al.; 3) we observe the absence of characterization of the device as a Compton polarimeter, which is paramount in photon polarimetry; 4) we review previous measurements of the polarization of photons from o-Ps decay, properly implementing the Compton polarimetry technique, and make the connection with tests of discrete symmetries; and 5) we stress that the correlation proposed by Moskal et al. cannot be generated solely by the physics of o-Ps decay, including possible violations of discrete symmetries.


title: Multi-Objective Linguistic Control of Large Language Models

abstract: Large language models (LLMs), despite their breakthroughs on many challenging benchmark tasks, lean to generate verbose responses and lack the controllability of output complexity, which is usually preferred by human users in practice. In this paper, we study how to precisely control multiple linguistic complexities of LLM output by finetuning using off-the-shelf data. To this end, we propose multi-control tuning (MCTune), which includes multiple linguistic complexity values of ground-truth responses as controls in the input for instruction tuning. We finetune LLaMA2-7B on Alpaca-GPT4 and WizardLM datasets. Evaluations on widely used benchmarks demonstrate that our method does not only improve LLMs' multi-complexity controllability substantially but also retains or even enhances the quality of the responses as a side benefit.


title: Intergalactic medium rotation measure of primordial magnetic fields

abstract: The Faraday rotation effect, quantified by the Rotation Measure (RM), is a powerful probe of the large-scale magnetization of the Universe - tracing magnetic fields not only on galaxy and galaxy cluster scales but also in the intergalactic Medium (IGM; referred to as $\mathrm{RM}_{\text{IGM}}$). The redshift dependence of the latter has extensively been explored with observations. It has also been shown that this relation can help to distinguish between different large-scale magnetization scenarios. We study the evolution of this $\mathrm{RM}_{\text{IGM}}$ for different primordial magnetogenesis scenarios to search for the imprints of primordial magnetic fields (PMFs; magnetic fields originating in the early Universe) on the redshift-dependence of $\mathrm{RM}_{\text{IGM}}$. We use cosmological magnetohydrodynamic (MHD) simulations for evolving PMFs during large-scale structure formation, coupled to the light cone analysis to produce a realistic statistical sample of mock $\mathrm{RM}_{\text{IGM}}$ images. We study the predicted behavior for the cosmic evolution of $\mathrm{RM}_{\text{IGM}}$ for different correlation lengths of PMFs, and provide fitting functions for their dependence on redshifts. We compare these mock RM trends with the recent analysis of the the LOw-Frequency ARray (LOFAR) RM Grid and find that large-scale-correlated PMFs should have (comoving) strengths $\lesssim 0.75$ nanoGauss, if originated during inflation with the scale invariant spectrum and (comoving) correlation length $\sim 19$ cMpc/h or $ \lesssim 30$ nanoGauss if they originated during phase-transition epochs with the comoving correlation length $\sim 1$ cMpc/h. Our findings agree with previous observations and confirm the results of semi-analytical studies, showing that upper limits on the PMF strength decrease as their coherence scales increase.


title: Gradual Divergence for Seamless Adaptation: A Novel Domain Incremental Learning Method

abstract: Domain incremental learning (DIL) poses a significant challenge in real-world scenarios, as models need to be sequentially trained on diverse domains over time, all the while avoiding catastrophic forgetting. Mitigating representation drift, which refers to the phenomenon of learned representations undergoing changes as the model adapts to new tasks, can help alleviate catastrophic forgetting. In this study, we propose a novel DIL method named DARE, featuring a three-stage training process: Divergence, Adaptation, and REfinement. This process gradually adapts the representations associated with new tasks into the feature space spanned by samples from previous tasks, simultaneously integrating task-specific decision boundaries. Additionally, we introduce a novel strategy for buffer sampling and demonstrate the effectiveness of our proposed method, combined with this sampling strategy, in reducing representation drift within the feature encoder. This contribution effectively alleviates catastrophic forgetting across multiple DIL benchmarks. Furthermore, our approach prevents sudden representation drift at task boundaries, resulting in a well-calibrated DIL model that maintains the performance on previous tasks.


title: Jacobian Descent for Multi-Objective Optimization

abstract: Many optimization problems are inherently multi-objective. To address them, we formalize Jacobian descent (JD), a direct generalization of gradient descent for vector-valued functions. Each step of this algorithm relies on a Jacobian matrix consisting of one gradient per objective. The aggregator, responsible for reducing this matrix into an update vector, characterizes JD. While the multi-task learning literature already contains a variety of aggregators, they often lack some natural properties. In particular, the update should not conflict with any objective and should scale proportionally to the norm of each gradient. We propose a new aggregator specifically designed to satisfy this. Emphasizing conflict between objectives, we then highlight direct applications for our methods. Most notably, we introduce instance-wise risk minimization (IWRM), a learning paradigm in which the loss of each training example is considered a separate objective. On simple image classification tasks, IWRM exhibits promising results compared to the direct minimization of the average loss. The performance of our aggregator in those experiments also corroborates our theoretical findings. Lastly, as speed is the main limitation of JD, we provide a path towards a more efficient implementation.


title: Measure theoretic aspects of the finite Hilbert transform

abstract: The finite Hilbert transform $T$, when acting in the classical Zygmund space $\logl$ (over $(-1,1)$), was intensively studied in \cite{curbera-okada-ricker-log}. In this note an integral representation of $T$ is established via the $L^1(-1,1)$-valued measure $\mlog\colon A\mapsto T(\chi_A)$ for each Borel set $A\subseteq(-1,1)$. This integral representation, together with various non-trivial properties of $\mlog$, allow the use of measure theoretic methods (not available in \cite{curbera-okada-ricker-log}) to establish new properties of $T$. For instance, as an operator between Banach function spaces $T$ is not order bounded, it is not completely continuous and neither is it weakly compact. An appropriate Parseval formula for $T$ plays a crucial role.


title: Efficient estimation of longitudinal treatment effects using difference-in-differences and machine learning

abstract: Difference-in-differences is based on a parallel trends assumption, which states that changes over time in average potential outcomes are independent of treatment assignment, possibly conditional on covariates. With time-varying treatments, parallel trends assumptions can identify many types of parameters, but most work has focused on group-time average treatment effects and similar parameters conditional on the treatment trajectory. This paper focuses instead on identification and estimation of the intervention-specific mean - the mean potential outcome had everyone been exposed to a proposed intervention - which may be directly policy-relevant in some settings. Previous estimators for this parameter under parallel trends have relied on correctly-specified parametric models, which may be difficult to guarantee in applications. We develop multiply-robust and efficient estimators of the intervention-specific mean based on the efficient influence function, and derive conditions under which data-adaptive machine learning methods can be used to relax modeling assumptions. Our approach allows the parallel trends assumption to be conditional on the history of time-varying covariates, thus allowing for adjustment for time-varying covariates possibly impacted by prior treatments. Simulation results support the use of the proposed methods at modest sample sizes. As an example, we estimate the effect of a hypothetical federal minimum wage increase on self-rated health in the US.


title: Preference Tuning For Toxicity Mitigation Generalizes Across Languages

abstract: Detoxifying multilingual Large Language Models (LLMs) has become crucial due to their increasing global use. In this work, we explore zero-shot cross-lingual generalization of preference tuning in detoxifying LLMs. Unlike previous studies that show limited cross-lingual generalization for other safety tasks, we demonstrate that Direct Preference Optimization (DPO) training with only English data can significantly reduce toxicity in multilingual open-ended generations. For example, the probability of mGPT-1.3B generating toxic continuations drops from 46.8% to 3.9% across 17 different languages after training. Our results also extend to other multilingual LLMs, such as BLOOM, Llama3, and Aya-23. Using mechanistic interpretability tools like causal intervention and activation analysis, we identified the dual multilinguality property of MLP layers in LLMs, which explains the cross-lingual generalization of DPO. Finally, we show that bilingual sentence retrieval can predict the cross-lingual transferability of DPO preference tuning.


title: Physics-informed neural networks for tsunami inundation modeling

abstract: We use physics-informed neural networks for solving the shallow-water equations for tsunami modeling. Physics-informed neural networks are an optimization based approach for solving differential equations that is completely meshless. This substantially simplifies the modeling of the inundation process of tsunamis. While physics-informed neural networks require retraining for each particular new initial condition of the shallow-water equations, we also introduce the use of deep operator networks that can be trained to learn the solution operator instead of a particular solution only and thus provides substantial speed-ups, also compared to classical numerical approaches for tsunami models. We show with several classical benchmarks that our method can model both tsunami propagation and the inundation process exceptionally well.


title: An accessibility condition for discrete-time linear systems on Lie groups

abstract: In this paper, we characterize the accessibility of discrete-time linear control systems on Lie groups. Using an exceptional notion of derivative, we construct a subalgebra $\mathfrak{h}$ based on the infinitesimal automorphism of the system such that if its dimension is maximal, the system is accessible. Our criteria provide simple conditions in a general context for the discrete-time case. Additionally, we prove a sufficient condition for local controllability at the identity using the infinitesimal automorphism, akin to the ad-rank condition in the continuous case.


title: Improved Modularity and New Features in ipie: Towards Even Larger AFQMC Calculations on CPUs and GPUs at Zero and Finite Temperatures

abstract: ipie is a Python-based auxiliary-field quantum Monte Carlo (AFQMC) package that has undergone substantial improvements since its initial release [J. Chem. Theory Comput., 2022, 19(1): 109-121]. This paper outlines the improved modularity and new capabilities implemented in ipie. We highlight the ease of incorporating different trial and walker types and the seamless integration of ipie with external libraries. We enable distributed Hamiltonian simulations, allowing for multi-GPU simulations of large systems. This development enabled us to compute the interaction energy of a benzene dimer with 84 electrons and 1512 orbitals, which otherwise would not have fit on a single GPU. We also support GPU-accelerated multi-slater determinant trial wavefunctions [arXiv:2406.08314] to enable efficient and highly accurate simulations of large-scale systems. This allows for near-exact ground state energies of multi-reference clusters, [Cu$_2$O$_2$]$^{2+}$ and [Fe$_2$S$_2$(SCH$_3$)]$^{2-}$. We also describe implementations of free projection AFQMC, finite temperature AFQMC, AFQMC for electron-phonon systems, and automatic differentiation in AFQMC for calculating physical properties. These advancements position ipie as a leading platform for AFQMC research in quantum chemistry, facilitating more complex and ambitious computational method development and their applications.


title: Complex-Valued Kernel-based Phase and Amplitude Distortion Compensation in Parametrically Amplified Optical Links

abstract: We develop a complex-valued kernel-adaptive-filtering based method for phase and amplitude distortion compensation in cascaded fibre-optical parametric amplifier (FOPA) links. Our algorithm predicts and cancels both distortions induced by pump-phase modulation across all amplification stages, achieving more than an order of magnitude improvement in BER.


title: Quasi-\'etale covers of Du Val del Pezzo surfaces and Zariski dense exceptional sets in Manin's conjecture

abstract: We construct first examples of singular del Pezzo surfaces with Zariski dense exceptional sets in Manin's conjecture, varying in degrees $1, 2$ and $3$. To systematically study these examples, we classify all quasi-\'etale covers of Du Val del Pezzo surfaces up to singularity types and study their equivariant geometry.


title: Position: Benchmarking is Limited in Reinforcement Learning Research

abstract: Novel reinforcement learning algorithms, or improvements on existing ones, are commonly justified by evaluating their performance on benchmark environments and are compared to an ever-changing set of standard algorithms. However, despite numerous calls for improvements, experimental practices continue to produce misleading or unsupported claims. One reason for the ongoing substandard practices is that conducting rigorous benchmarking experiments requires substantial computational time. This work investigates the sources of increased computation costs in rigorous experiment designs. We show that conducting rigorous performance benchmarks will likely have computational costs that are often prohibitive. As a result, we argue for using an additional experimentation paradigm to overcome the limitations of benchmarking.


title: Foliation of area minimizing hypersurfaces in asymptotically flat manifolds and Schoen's conjecture

abstract: In this paper, we demonstrate that any asymptotically flat manifold $(M^n, g)$ with $4\leq n\leq 7$ can be foliated by a family of area-minimizing hypersurfaces, each of which is asymptotic to Cartesian coordinate hyperplanes defined at an end of $(M^n, g)$. As an application of this foliation, we show that for any asymptotically flat manifold $(M^n, g)$ with $4\leq n\leq 7$, nonnegative scalar curvature and positive mass, the solution of free boundary problem for area-minimizing hypersurface in coordinate cylinder $C_{R_i}$ in $(M^n, g)$ either does not exist or drifts to infinity of $(M^n, g)$ as $R_i$ tends to infinity. Additionally, we introduce a concept of globally minimizing hypersurface in $(M^n, g)$, and verify a version of the Schoen Conjecture.


title: Prescribed mean curvature problems on homogeneous vector bundles

abstract: In this paper, we provide a detailed and systematic study of weak (singular) Hermite-Einstein structures on homogeneous holomorphic vector bundles over rational homogeneous varieties. We use standard tools from spectral geometry, Harmonic analysis, and Cartan's highest weight theory to provide a sufficient condition in terms of Fourier series and intersection numbers under which an $L^{2}$-function can be realized as mean curvature of a singular Hermitian structure on an irreducible homogeneous holomorphic vector bundle. We prove that the condition provided is necessary and sufficient for functions that belong to certain interpolation spaces. In the particular case of line bundles over irreducible Hermitian symmetric spaces of compact type, we describe explicitly in terms of representation theory the solutions of the underlying geometric PDE. Also, we establish a sufficient condition in terms of Fourier coefficients and intersection numbers for solvability and convergence of the weak Hermite-Einstein flow on irreducible homogeneous holomorphic vector bundles. As an application of our methods, we describe the first explicit examples in the literature of solutions to several geometric flows, including Donaldson's heat flow, Yang-Mills heat flow, and the gradient flow of Donaldson's Lagrangian, on line bundles over irreducible Hermitian symmetric spaces of compact type. Additionally, we show that every polynomial central charge function gives rise to a weak Donaldson's Lagrangian $\mathcal{M}$. In the particular case of irreducible homogeneous holomorphic vector bundles, we prove that the gradient flow of $\mathcal{M}$ converges to a Hermitian structure which is, up to a gauge transformation, a $Z$-critical Hermitian structure in the large volume limit.


title: Soley: Identification and Automated Detection of Logic Vulnerabilities in Ethereum Smart Contracts Using Large Language Models

abstract: Modern blockchain, such as Ethereum, supports the deployment and execution of so-called smart contracts, autonomous digital programs with significant value of cryptocurrency. Executing smart contracts requires gas costs paid by users, which define the limits of the contract's execution. Logic vulnerabilities in smart contracts can lead to financial losses, and are often the root cause of high-impact cyberattacks. Our objective is threefold: (i) empirically investigate logic vulnerabilities in real-world smart contracts extracted from code changes on GitHub, (ii) introduce Soley, an automated method for detecting logic vulnerabilities in smart contracts, leveraging Large Language Models (LLMs), and (iii) examine mitigation strategies employed by smart contract developers to address these vulnerabilities in real-world scenarios. We obtained smart contracts and related code changes from GitHub. To address the first and third objectives, we qualitatively investigated available logic vulnerabilities using an open coding method. We identified these vulnerabilities and their mitigation strategies. For the second objective, we extracted various logic vulnerabilities, applied preprocessing techniques, and implemented and trained the proposed Soley model. We evaluated Soley along with the performance of various LLMs and compared the results with the state-of-the-art baseline on the task of logic vulnerability detection. From our analysis, we identified nine novel logic vulnerabilities, extending existing taxonomies with these vulnerabilities. Furthermore, we introduced several mitigation strategies extracted from observed developer modifications in real-world scenarios. Our Soley method outperforms existing methods in automatically identifying logic vulnerabilities. Interestingly, the efficacy of LLMs in this task was evident without requiring extensive feature engineering.


title: Single-Layer Fe-Cu Interphase in Ferritic Steels Stabilized by Magnetic Friedel Oscillations

abstract: Copper precipitation is a technique extensively deployed in steel strengthening. Being as tiny as a few nanometers in diameter, the Cu precipitates present a real challenge to experimental techniques in determination of their composition. The late Professor Morris Fine called it a mystery when addressing the discrepancy between the fact of low solubility of Fe in bulk Cu and the remarkable content of Fe in Cu precipitates according to atom probe tomography measurement. With a thorough search using rigorous first-principles density functional theory calculations, we are surprised to find that the interface between Cu precipitate and Fe matrix is neither immiscibly sharp, nor commonly miscible over a range of atomic layers, but rather manifests itself as a single-layer mixed Fe-Cu interphase. Our detailed analysis reveals that spin polarization is a key factor in defining such an interphase. The magnetic Friedel oscillations through spin polarization is the driving force to stabilize it. When the single-layer Fe-Cu interphase is counted in, the content of Fe in Cu precipitates would be significant due to their small size. Our finding is a strong demonstration that quantum mechanical effects such as Friedel oscillations can have explicit consequence also in structural materials. The accurate knowledge of the Fe-Cu interface is crucial for the design of advanced high-strength steels.


title: Bitangent surfaces and involutions of quartic surfaces

abstract: We study the set of bitangent lines (called a congruence of bitangent lines classically) of an irreducible surface in a 3-dimensional projective space, especially a quartic surface with rational double points in any characteristic. In particular, we determine the congruences of bitangent lines for Kummer quartic surfaces in characteristic two.


title: Demonstrating Quantum Homomorphic Encryption Through Simulation

abstract: Quantum homomorphic encryption (QHE), allows a quantum cloud server to compute on private data as uploaded by a client. We provide a proof-of-concept software simulation for QHE, according to the "EPR" scheme of Broadbent and Jeffery, for universal quantum circuits. We demonstrate the near-term viability of this scheme and provide verification that the additional cost of homomorphic circuit evaluation is minor when compared to the simulation cost of the quantum operations. Our simulation toolkit is an open-source Python implementation, that serves as a step towards further hardware applications of quantum homomorphic encryption between networked quantum devices.


title: Twin primes and the $3$-sphere

abstract: We investigate the group of points of the $3$-sphere modulo a prime, point out connections to other known groups and the Chebyshev polynomials, and show that there is an infinite series which converges if and only if there are finitely many pairs of twin primes. Hence to prove that that the series diverges is to prove the twin prime conjecture.


title: An Optimal Tightness Bound for the Simulation Lemma

abstract: We present a bound for value-prediction error with respect to model misspecification that is tight, including constant factors. This is a direct improvement of the "simulation lemma," a foundational result in reinforcement learning. We demonstrate that existing bounds are quite loose, becoming vacuous for large discount factors, due to the suboptimal treatment of compounding probability errors. By carefully considering this quantity on its own, instead of as a subcomponent of value error, we derive a bound that is sub-linear with respect to transition function misspecification. We then demonstrate broader applicability of this technique, improving a similar bound in the related subfield of hierarchical abstraction.


title: Evaluating Serverless Machine Learning Performance on Google Cloud Run

abstract: End-users can get functions-as-a-service from serverless platforms, which promise lower hosting costs, high availability, fault tolerance, and dynamic flexibility for hosting individual functions known as microservices. Machine learning tools are seen to be reliably useful, and the services created using these tools are in increasing demand on a large scale. The serverless platforms are uniquely suited for hosting these machine learning services to be used for large-scale applications. These platforms are well known for their cost efficiency, fault tolerance, resource scaling, robust APIs for communication, and global reach. However, machine learning services are different from the web-services in that these serverless platforms were originally designed to host web services. We aimed to understand how these serverless platforms handle machine learning workloads with our study. We examine machine learning performance on one of the serverless platforms - Google Cloud Run, which is a GPU-less infrastructure that is not designed for machine learning application deployment.


title: Probing critical spin fluctuations with a composite magnetoelectric method: A case study on a Kitaev spin liquid candidate Na$_3$Co$_2$SbO$_6$

abstract: In correlated quantum materials, divergent critical fluctuations near the quantum critical point are often closely associated with exotic quantum phases of matter, such as unconventional superconductivity and quantum spin liquids. Here we present a simple yet highly sensitive composite magnetoelectric (ME) method for detecting the critical spin fluctuations in quantum magnets. The ME signal is proportional the magnetostriction coefficient, which directly probes the product of magnetization and spin-spin correlation. As a demonstration, the composite ME method is applied to a Kitaev quantum spin liquid candidate Na$_3$Co$_2$SbO$_6$, which shows signs of magnetic field-induced quantum criticality. Notably, the ME signal prominently diverges at the magnetic field-induced tricritical points, particularly at a tricritical point that lies in close proximity to a zero-temperature quantum critical point. A crucial aspect of these tricritical points is their tunability through the modification of the in-plane magnetic field's direction. The direction of magnetic field can thus serve as a handful yet important tuning parameter, alongside pressure and chemical doping, for searching quantum critical points in quantum magnets with pronounced magnetic anisotropy.


title: Graph-Augmented LLMs for Personalized Health Insights: A Case Study in Sleep Analysis

abstract: Health monitoring systems have revolutionized modern healthcare by enabling the continuous capture of physiological and behavioral data, essential for preventive measures and early health intervention. While integrating this data with Large Language Models (LLMs) has shown promise in delivering interactive health advice, traditional methods like Retrieval-Augmented Generation (RAG) and fine-tuning often fail to fully utilize the complex, multi-dimensional, and temporally relevant data from wearable devices. These conventional approaches typically provide limited actionable and personalized health insights due to their inadequate capacity to dynamically integrate and interpret diverse health data streams. In response, this paper introduces a graph-augmented LLM framework designed to significantly enhance the personalization and clarity of health insights. Utilizing a hierarchical graph structure, the framework captures inter and intra-patient relationships, enriching LLM prompts with dynamic feature importance scores derived from a Random Forest Model. The effectiveness of this approach is demonstrated through a sleep analysis case study involving 20 college students during the COVID-19 lockdown, highlighting the potential of our model to generate actionable and personalized health insights efficiently. We leverage another LLM to evaluate the insights for relevance, comprehensiveness, actionability, and personalization, addressing the critical need for models that process and interpret complex health data effectively. Our findings show that augmenting prompts with our framework yields significant improvements in all 4 criteria. Through our framework, we can elicit well-crafted, more thoughtful responses tailored to a specific patient.


title: LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing

abstract: This work is motivated by two key trends. On one hand, large language models (LLMs) have shown remarkable versatility in various generative tasks such as writing, drawing, and question answering, significantly reducing the time required for many routine tasks. On the other hand, researchers, whose work is not only time-consuming but also highly expertise-demanding, face increasing challenges as they have to spend more time reading, writing, and reviewing papers. This raises the question: how can LLMs potentially assist researchers in alleviating their heavy workload? This study focuses on the topic of LLMs assist NLP Researchers, particularly examining the effectiveness of LLM in assisting paper (meta-)reviewing and its recognizability. To address this, we constructed the ReviewCritique dataset, which includes two types of information: (i) NLP papers (initial submissions rather than camera-ready) with both human-written and LLM-generated reviews, and (ii) each review comes with "deficiency" labels and corresponding explanations for individual segments, annotated by experts. Using ReviewCritique, this study explores two threads of research questions: (i) "LLMs as Reviewers", how do reviews generated by LLMs compare with those written by humans in terms of quality and distinguishability? (ii) "LLMs as Metareviewers", how effectively can LLMs identify potential issues, such as Deficient or unprofessional review segments, within individual paper reviews? To our knowledge, this is the first work to provide such a comprehensive analysis.