title: Engineering liquid-liquid interfaces for high-entropy alloy synthesis

abstract: High-entropy alloys (HEAs) with various promising applications have attracted significant interest. However, alloying immiscible metal elements while controlling the morphology and crystallinity remains extremely challenging. We report a general route, by engineering liquid-liquid interfaces, for the synthesis of HEAs with controlled crystallinity (single crystal, mesocrystal, polycrystal, amorphous), morphology (0-dimension, 2-dimension, 3-dimension), and high composition diversity (20 elements) under mild conditions (room temperature to 80 degrees celsius). As reactions can be spatially confined at the liquid-liquid interface, it provides an opportunity to control the kinetics and reduce the alloying temperature. Our real-time observation of the alloying of HEAs reveals hydrogen-enhanced mixing and isothermal solidification that kinetically traps the mixing states due to composition changes. The concept of liquid-liquid interface engineering can be applied to obtain other high-entropy compounds.


title: LEAST: "Local" text-conditioned image style transfer

abstract: Text-conditioned style transfer enables users to communicate their desired artistic styles through text descriptions, offering a new and expressive means of achieving stylization. In this work, we evaluate the text-conditioned image editing and style transfer techniques on their fine-grained understanding of user prompts for precise "local" style transfer. We find that current methods fail to accomplish localized style transfers effectively, either failing to localize style transfer to certain regions in the image, or distorting the content and structure of the input image. To this end, we carefully design an end-to-end pipeline that guarantees local style transfer according to users' intent. Further, we substantiate the effectiveness of our approach through quantitative and qualitative analysis. The project code is available at: https://github.com/silky1708/local-style-transfer.


title: Confirming the Null: Remarks on Equivalence Testing and the Topology of Confirmation

abstract: Null Hypothesis Statistical Testing is a dominant framework for conducting statistical analysis across the sciences. There remains considerable debate as to whether, and under what circumstances, evidence can be said to be confirmatory of a null hypothesis. This paper presents a modal logic of short-run frequentist confirmation developed by leveraging the duality between hypothesis testing and statistical estimation. It is shown that a hypothesis is confirmable if and only if it satisfies the topological condition of having nonempty interior. Consequently, two-sided hypotheses are not statistically confirmable owing to defects in their topological structure. Equivalence hypotheses are, by contrast, confirmable.


title: Phi Classical 1-Absorbing Prime Submodule

abstract: In this paper, all rings are commutative with nonzero identity. Let M be an R-module. We introduce the concept of phi classical 1-absorbing prime submodules. A proper submodule N of M is a phi classical 1-absorbing prime submodule if whenever non units a, b, c belongs to R and m belongs to M with abcm belongs to N and does not belong to phi(N), then abm belongs to N or cm belongs to N. Many properties and characterizations of phi classical 1-absorbing prime submodules are given.


title: Gaussian Recombining Split Tree

abstract: Binomial trees are widely used in the financial sector for valuing securities with early exercise characteristics, such as American stock options. However, while effective in many scenarios, pricing options with CRR binomial trees are limited. Major limitations are volatility estimation, constant volatility assumption, subjectivity in parameter choices, and impracticality of instantaneous delta hedging. This paper presents a novel tree: Gaussian Recombining Split Tree (GRST), which is recombining and does not need log-normality or normality market assumption. GRST generates a discrete probability mass function of market data distribution, which approximates a Gaussian distribution with known parameters at any chosen time interval. GRST Mixture builds upon the GRST concept while being flexible to fit a large class of market distributions and when given a 1-D time series data and moments of distributions at each time interval, fits a Gaussian mixture with the same mixture component probabilities applied at each time interval. Gaussian Recombining Split Tre Mixture comprises several GRST tied using Gaussian mixture component probabilities at the first node. Our extensive empirical analysis shows that the option prices from the GRST align closely with the market.


title: Devil's Advocate: Anticipatory Reflection for LLM Agents

abstract: In this work, we introduce a novel approach that equips LLM agents with introspection, enhancing consistency and adaptability in solving complex tasks. Our approach prompts LLM agents to decompose a given task into manageable subtasks (i.e., to make a plan), and to continuously introspect upon the suitability and results of their actions. %; and when necessary, to explore ``the road not taken.'' We implement a three-fold introspective intervention: 1) anticipatory reflection on potential failures and alternative remedy before action execution, 2) post-action alignment with subtask objectives and backtracking with remedy to ensure utmost effort in plan execution, and 3) comprehensive review upon plan completion for future strategy refinement. By deploying and experimenting with this methodology -- a zero-shot approach -- within WebArena for practical tasks in web environments, our agent demonstrates superior performance with a success rate of 23.5% over existing zero-shot methods by 3.5%. The experimental results suggest that our introspection-driven approach not only enhances the agent's ability to navigate unanticipated challenges through a robust mechanism of plan execution, but also improves efficiency by reducing the number of trials and plan revisions by 45% needed to achieve a task.


title: RoboArm-NMP: a Learning Environment for Neural Motion Planning

abstract: We present RoboArm-NMP, a learning and evaluation environment that allows simple and thorough evaluations of Neural Motion Planning (NMP) algorithms, focused on robotic manipulators. Our Python-based environment provides baseline implementations for learning control policies (either supervised or reinforcement learning based), a simulator based on PyBullet, data of solved instances using a classical motion planning solver, various representation learning methods for encoding the obstacles, and a clean interface between the learning and planning frameworks. Using RoboArm-NMP, we compare several prominent NMP design points, and demonstrate that the best methods mostly succeed in generalizing to unseen goals in a scene with fixed obstacles, but have difficulty in generalizing to unseen obstacle configurations, suggesting focus points for future research.


title: Intertemporal Cost-efficient Consumption

abstract: We aim to provide an intertemporal, cost-efficient consumption model that extends the consumption optimization inspired by the Distribution Builder, a tool developed by Sharpe, Johnson, and Goldstein. The Distribution Builder enables the recovery of investors' risk preferences by allowing them to select a desired distribution of terminal wealth within their budget constraints. This approach differs from the classical portfolio optimization, which considers the agent's risk aversion modeled by utility functions that are challenging to measure in practice. Our intertemporal model captures the dependent structure between consumption periods using copulas. This strategy is demonstrated using both the Black-Scholes and CEV models.


title: Learning to Reason via Program Generation, Emulation, and Search

abstract: Program synthesis with language models (LMs) has unlocked a large set of reasoning abilities; code-tuned LMs have proven adept at generating programs that solve a wide variety of algorithmic symbolic manipulation tasks (e.g. word concatenation). However, not all reasoning tasks are easily expressible as code, e.g. tasks involving commonsense reasoning, moral decision-making, and sarcasm understanding. Our goal is to extend an LM's program synthesis skills to such tasks and evaluate the results via pseudo-programs, namely Python programs where some leaf function calls are left undefined. To that end, we propose, Code Generation and Emulated EXecution (CoGEX). CoGEX works by (1) training LMs to generate their own pseudo-programs, (2) teaching them to emulate their generated program's execution, including those leaf functions, allowing the LM's knowledge to fill in the execution gaps; and (3) using them to search over many programs to find an optimal one. To adapt the CoGEX model to a new task, we introduce a method for performing program search to find a single program whose pseudo-execution yields optimal performance when applied to all the instances of a given dataset. We show that our approach yields large improvements compared to standard in-context learning approaches on a battery of tasks, both algorithmic and soft reasoning. This result thus demonstrates that code synthesis can be applied to a much broader class of problems than previously considered. Our released dataset, fine-tuned models, and implementation can be found at \url{https://github.com/nweir127/CoGEX}.


title: Projective hypersurfaces in tropical scheme theory I: the Macaulay ideal

abstract: A "tropical ideal" is an ideal in the idempotent semiring of tropical polynomials that is also, degree by degree, a tropical linear space. We introduce a construction based on transversal matroids that canonically extends any principal ideal to a tropical ideal. We call this the Macaulay tropical ideal. It has a universal property: any other extension of the given principal ideal to a tropical ideal with the expected Hilbert function is a weak image of the Macaulay tropical ideal. For each $n\geq 2$ and $d\geq 1$ our construction yields a non-realizable degree $d$ hypersurface scheme in $\mathbb{P}^n$. Maclagan-Rinc\'on produced a non-realizable line in $\mathbb{P}^n$ for each $n$, and for $(d,n)=(1,2)$ the two constructions agree. An appendix by Mundinger compares the Macaulay construction with another method for canonically extending ideals to tropical ideals.


title: BOLD: Boolean Logic Deep Learning

abstract: Deep learning is computationally intensive, with significant efforts focused on reducing arithmetic complexity, particularly regarding energy consumption dominated by data movement. While existing literature emphasizes inference, training is considerably more resource-intensive. This paper proposes a novel mathematical principle by introducing the notion of Boolean variation such that neurons made of Boolean weights and inputs can be trained -- for the first time -- efficiently in Boolean domain using Boolean logic instead of gradient descent and real arithmetic. We explore its convergence, conduct extensively experimental benchmarking, and provide consistent complexity evaluation by considering chip architecture, memory hierarchy, dataflow, and arithmetic precision. Our approach achieves baseline full-precision accuracy in ImageNet classification and surpasses state-of-the-art results in semantic segmentation, with notable performance in image super-resolution, and natural language understanding with transformer-based models. Moreover, it significantly reduces energy consumption during both training and inference.


title: A Strong Direct Sum Theorem for Distributional Query Complexity

abstract: Consider the expected query complexity of computing the $k$-fold direct product $f^{\otimes k}$ of a function $f$ to error $\varepsilon$ with respect to a distribution $\mu^k$. One strategy is to sequentially compute each of the $k$ copies to error $\varepsilon/k$ with respect to $\mu$ and apply the union bound. We prove a strong direct sum theorem showing that this naive strategy is essentially optimal. In particular, computing a direct product necessitates a blowup in both query complexity and error. Strong direct sum theorems contrast with results that only show a blowup in query complexity or error but not both. There has been a long line of such results for distributional query complexity, dating back to (Impagliazzo, Raz, Wigderson 1994) and (Nisan, Rudich, Saks 1994), but a strong direct sum theorem had been elusive. A key idea in our work is the first use of the Hardcore Theorem (Impagliazzo 1995) in the context of query complexity. We prove a new "resilience lemma" that accompanies it, showing that the hardcore of $f^{\otimes k}$ is likely to remain dense under arbitrary partitions of the input space.


title: R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Model

abstract: In the evolving landscape of text-to-image (T2I) diffusion models, the remarkable capability to generate high-quality images from textual descriptions faces challenges with the potential misuse of reproducing sensitive content. To address this critical issue, we introduce Robust Adversarial Concept Erase (RACE), a novel approach designed to mitigate these risks by enhancing the robustness of concept erasure method for T2I models. RACE utilizes a sophisticated adversarial training framework to identify and mitigate adversarial text embeddings, significantly reducing the Attack Success Rate (ASR). Impressively, RACE achieves a 30 percentage point reduction in ASR for the ``nudity'' concept against the leading white-box attack method. Our extensive evaluations demonstrate RACE's effectiveness in defending against both white-box and black-box attacks, marking a significant advancement in protecting T2I diffusion models from generating inappropriate or misleading imagery. This work underlines the essential need for proactive defense measures in adapting to the rapidly advancing field of adversarial challenges.


title: Jacobson radicals of Ore extensions

abstract: Let $R$ be a ring, $\sigma$ be an automorphism of $R$, and $D$ be a $\sigma$-derivation on $R$. We will show that if $R$ is an algebra over a field of characteristic $0$ and $D$ is $q$-skew, then $J(R[x;\sigma,D])=I\cap R+I_0$ where $I=\{r\in R : rx\in J(R[x;\sigma,D])\}$ and $I_0=\{\sum_{i\geq 1}r_ix^i: r_i\in I\}$. We will prove that $J(R[x;\sigma,D])\cap R$ is nil if $\sigma$ is locally torsion and one of the following conditions is given: (1) $R$ is a PI-ring, (2) $R$ is an algebra over a field of characteristic $p>0$ and $D$ is a locally nilpotent derivation such that $\sigma D=D\sigma$. This answers partially an open question by Greenfeld, Smoktunowicz and Ziembowski.


title: Learning Point Spread Function Invertibility Assessment for Image Deconvolution

abstract: Deep-learning (DL)-based image deconvolution (ID) has exhibited remarkable recovery performance, surpassing traditional linear methods. However, unlike traditional ID approaches that rely on analytical properties of the point spread function (PSF) to achieve high recovery performance - such as specific spectrum properties or small conditional numbers in the convolution matrix - DL techniques lack quantifiable metrics for evaluating PSF suitability for DL-assisted recovery. Aiming to enhance deconvolution quality, we propose a metric that employs a non-linear approach to learn the invertibility of an arbitrary PSF using a neural network by mapping it to a unit impulse. A lower discrepancy between the mapped PSF and a unit impulse indicates a higher likelihood of successful inversion by a DL network. Our findings reveal that this metric correlates with high recovery performance in DL and traditional methods, thereby serving as an effective regularizer in deconvolution tasks. This approach reduces the computational complexity over conventional condition number assessments and is a differentiable process. These useful properties allow its application in designing diffractive optical elements through end-to-end (E2E) optimization, achieving invertible PSFs, and outperforming the E2E baseline framework.


title: Large Language Models Enable Automated Formative Feedback in Human-Robot Interaction Tasks

abstract: We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted by non-experts. Luckily, LLMs are adept at generating easy-to-understand text that explains difficult concepts. By integrating task assessment outcomes and other contextual information into an LLM prompt, we can effectively synthesize a useful set of recommendations for the learner to improve their performance.


title: Cypher4BIM: Releasing the Power of Graph for Building Knowledge Discovery

abstract: Graph is considered a promising way for managing building information. A new graphic form of IFC (Industry Foundation Classes) data has just been developed, referred to as IFC-Graph. However, understanding of IFC-Graph is insufficient, especially for information query. This study aims to explore graphic building information query and develop a graph query language tailored for IFC-Graph. A series of tasks were carried out, including a) investigating the structure of IFC data and the main types of information in IFC, b) investigating the graph query language Cypher, and c) developing a set of tailored functional query patterns. The developed language is referred to as Cypher4BIM. Five IFC models were used for validation, and the result shows that Cypher4BIM can query individual instances and complex relations from IFC, such as spatial structure, space boundary, and space accessibility. This study contributes to applications that require effective building information query, such as digital twin.


title: A modular and scalable web platform for computational phylogenetics

abstract: Phylogenetic analysis, which allow to understand the evolution of bacterial and viral epidemics, requires large quantities of data to be analysed and processed for knowledge extraction. One of the major challenges consists on the integration of the results from typing and phylogenetic inference methods with epidemiological data, namely in what concerns their integrated and simultaneous analysis and visualization. Numerous approaches to support phylogenetic analysis have been proposed, varying from standalone tools to integrative web applications that include tools and/or algorithms for executing the common analysis tasks for this kind of data. However, most of them lack the capacity to integrate epidemiological data. Others provide the ability for visualizing and analyzing such data, allowing the integration of epidemiological data but they do not scale for large data analysis and visualization. Namely, most of them run inference and/or visualization optimization tasks on the client side, which becomes often unfeasible for large amounts of data, usually implying transferring data from existing databases in order to be analysed. Moreover, the results and optimizations are not stored for reuse. We propose the PHYLOViZ Web Platform, a cloud based tool for phylogenetic analysis, that not only unifies the features of both existing versions of PHYLOViZ, but also supports structured and customized workflows for executing data processing and analyses tasks, and promotes the reproducibility of previous phylogenetic analyses. This platform supports large scale analyses by relying on a workflow system that enables the distribution of parallel computations on cloud and HPC environments. Moreover, it has a modular architecture, allowing easy integration of new methods and tools, as well as customized workflows, making it flexible and extensible.


title: Prediction of induced magnetism in 2D Ti$_2$C based MXene by manipulating the mixed surface functionalization and metal substitution computed by xTB model Hamiltonian of the DFTB method

abstract: We employed the recently developed density functional tight binding (DFTB) method's Hamiltonian, GFN1-xTB, for modeling the mixed termination in Ti$_{{\rm2}}$C MXene, namely three types of termination by combining -O and -OH, -O and -F, as well as -F and -OH. We demonstrated that the approach yields reliable predictions for electronic and magnetic properties of such MXenes. The first highlighted result is that the mixed surface functionalization in Ti$_{{\rm2}}$CA$_{{\rm x}}$B$_{{\rm y}}$ MXene induces spin polarization with diverse magnetic alignments, including ferromagnetism and two types of antiferromagnetism. We further identified the magnetic alignment for the investigated MXene in terms of the compositions of the terminal groups. Moreover, the effect of the transition metal (Ti) substituted by the Sc atom on the electronic and magnetic properties were also investigated. We found that the studied systems maintain the magnetism and the metallic characteristics. A magnetic transition from antiferromagnetic (AFM) to ferrimagnetic (FiM) ordering was found for ScTi$_{{\rm15}}$C$_{{\rm8}}$F$_{{\rm8}}$(OH)$_{{\rm8}}$ and ScTi$_{{\rm15}}$C$_{{\rm8}}$F$_{{\rm12}}$(OH)$_{{\rm4}}$ compounds. Finally, we proved that incorporating the Sc atom into the lattice of Ti$_{{\rm2}}$CO$_{{\rm2}}$ and mixed surface termination Ti$_{{\rm2}}$CA$_{{\rm x}}$B$_{{\rm y}}$ is an effective strategy to induce magnetism. Our study may provide a new potential application for designing MXene-based spintronics.


title: HESS J1745$-$290 spectrum explained by a transition in the diffusion regime of PeV cosmic rays in the Sgr A* accretion flow

abstract: Context. The diffuse TeV gamma-ray emission detected in the inner $\sim$ 100 pc of the Galactic Center suggests the existence of a central cosmic-ray accelerator reaching $\sim$ PeV energies. It is interesting to associate this so-called PeVatron with the point source HESS J1745$-$290, whose position is consistent with that of the central supermassive black hole, Sgr A*. However, the point source shows a spectral break at a few TeV, which is not shown by the diffuse emission, challenging this association. Aims. We seek to build an emission model for the point source consistent with both emissions being produced by the same population of relativistic protons, continuously injected with a power-law spectrum up to $\sim$ PeV energies, near Sgr A*. Methods. In our model, we assume that the point source is produced by hadronic collisions between the cosmic rays and the gas in the accretion flow of Sgr A*. The cosmic-ray density is calculated taking into consideration cosmic-ray transport due to diffusion and advection, while the properties of the gas are obtained from previous numerical simulations of the accretion flow. Results. Our model succeeds in explaining both the point source and the diffuse emission with the same cosmic rays injected in the vicinity of Sgr A*, as long as the coherence length of the magnetic turbulence in the accretion flow is $l_c\sim(1-3)\times 10^{14}\,\mathrm{cm}$. The spectral break of the point source appears naturally due to an energy-dependent transition in the way the cosmic rays diffuse within the inner $\sim 0.1$ pc of the accretion flow (where most of the emission is produced) Conclusions. Our model supports the idea that Sgr A* can be a PeVatron, whose accelerated cosmic rays give rise to both the point source and the diffuse emission. Future TeV telescopes, like CTAO, will be able to test this model.


title: Distribution of the Hessian values of Gaussian hypergeometric functions

abstract: We consider a special family of Gaussian hypergeometric functions whose entries are cubic and trivial characters over finite fields. The special values of these functions are known to give the Frobenius traces of families of Hessian elliptic curves. Using the theory of harmonic Maass forms and mock modular forms, we prove that the limiting distribution of these values is semi-circular (i.e. $SU(2)$), confirming the usual Sato-Tate distribution in this setting.


title: A Second-Order perspective on Compositionality and Incremental Learning

abstract: The fine-tuning of deep pre-trained models has recently revealed compositional properties. This enables the arbitrary composition of multiple specialized modules into a single, multi-task model. However, identifying the conditions that promote compositionality remains an open issue, with recent efforts concentrating mainly on linearized networks. We conduct a theoretical study that attempts to demystify compositionality in standard non-linear networks through the second-order Taylor approximation of the loss function. The proposed formulation highlights the importance of staying within the pre-training basin for achieving composable modules. Moreover, it provides the basis for two dual incremental training algorithms: the one from the perspective of multiple models trained individually, while the other aims to optimize the composed model as a whole. We probe their application in incremental classification tasks and highlight some valuable skills. In fact, the pool of incrementally learned modules not only supports the creation of an effective multi-task model but also enables unlearning and specialization in specific tasks.


title: A Differential Equation Approach for Wasserstein GANs and Beyond

abstract: We propose a new theoretical lens to view Wasserstein generative adversarial networks (WGANs). In our framework, we define a discretization inspired by a distribution-dependent ordinary differential equation (ODE). We show that such a discretization is convergent and propose a viable class of adversarial training methods to implement this discretization, which we call W1 Forward Euler (W1-FE). In particular, the ODE framework allows us to implement persistent training, a novel training technique that cannot be applied to typical WGAN algorithms without the ODE interpretation. Remarkably, when we do not implement persistent training, we prove that our algorithms simplify to existing WGAN algorithms; when we increase the level of persistent training appropriately, our algorithms outperform existing WGAN algorithms in both low- and high-dimensional examples.


title: Quantifying Multipolar Polarization

abstract: Studying and understanding social networks is crucial for accurately defining ideological polarization, since they enable precise modeling of social structures. One of the limitations of many methods for quantifying polarization on networks is the assumption of a two-dimensional opinion space. This prevents accurate study of multipolar systems like multi-party political systems, where modeling more than two opinion poles is beneficial. Here, I experimentally compare methods for quantifying multipolar polarization on a network, and find that the average pairwise distance extension of generalized Euclidean distance conforms to several desired properties, showing its advantages over other methods. This allows study of multipolar polarized systems based on an empirically and intuitively good metric.


title: Game Derandomization

abstract: Using Kolmogorov Game Derandomization, upper bounds of the Kolmogorov complexity of deterministic winning players against deterministic environments can be proved. This paper gives improved upper bounds of the Kolmogorov complexity of such players. This paper also generalizes this result to probabilistic games. This applies to computable, lower computable, and uncomputable environments. We characterize the classic even-odds game and then generalize these results to time bounded players and also to all zero-sum repeated games. We characterize partial game derandomization. But first, we start with an illustrative example of game derandomization, taking place on the island of Crete.


title: Universal lower bounds for Dirichlet eigenvalues

abstract: Let $\Omega \subset \mathbb{R}^d$ be a bounded domain and let $\lambda_1, \lambda_2, \dots$ denote the sequence of eigenvalues of the Laplacian subject to Dirichlet boundary conditions. We consider inequalities for $\lambda_n$ that are independent of the domain $\Omega$. A well-known such inequality follows from the Berezin-Li-Yau approach $$\lambda_n \geq \frac{d}{d+2} \frac{4 \pi^2 n^{2/d}}{ (|\Omega| \omega_d)^{2/d}}.$$ The purpose of this paper is to point out a certain degree of flexibility in the Li-Yau approach. We use it to show that, for all $1 \leq k \leq n$, $$ \lambda_n \geq \frac{d}{d+2} \frac{4 \pi^2 n^{2/d}}{ (|\Omega| \omega_d)^{2/d}} + \frac{k}{n}(\lambda_n - \lambda_k).$$ This correction term is, at least asymptotically, not of lower order but comparable to the leading term. Moreover, the Berezin-Li-Yau inequality cannot be close to sharp on average. A family of universal inequalities follows as a byproduct: one example is, when $d=2$, the inequality $2 \lambda_n + \lambda_{2n} \geq 10 \pi n /|\Omega|$.


title: Navigating AI Fallibility: Examining People's Reactions and Perceptions of AI after Encountering Personality Misrepresentations

abstract: Many hyper-personalized AI systems profile people's characteristics (e.g., personality traits) to provide personalized recommendations. These systems are increasingly used to facilitate interactions among people, such as providing teammate recommendations. Despite improved accuracy, such systems are not immune to errors when making inferences about people's most personal traits. These errors manifested as AI misrepresentations. However, the repercussions of such AI misrepresentations are unclear, especially on people's reactions and perceptions of the AI. We present two studies to examine how people react and perceive the AI after encountering personality misrepresentations in AI-facilitated team matching in a higher education context. Through semi-structured interviews (n=20) and a survey experiment (n=198), we pinpoint how people's existing and newly acquired AI knowledge could shape their perceptions and reactions of the AI after encountering AI misrepresentations. Specifically, we identified three rationales that people adopted through knowledge acquired from AI (mis)representations: AI works like a machine, human, and/or magic. These rationales are highly connected to people's reactions of over-trusting, rationalizing, and forgiving of AI misrepresentations. Finally, we found that people's existing AI knowledge, i.e., AI literacy, could moderate people's changes in their trust in AI after encountering AI misrepresentations, but not changes in people's social perceptions of AI. We discuss the role of people's AI knowledge when facing AI fallibility and implications for designing responsible mitigation and repair strategies.


title: Prudent Price-Responsive Demands

abstract: We investigate a flexible demand with a risk-neutral cost-saving objective in response to volatile electricity prices. We introduce the concept of prudent demand, which states that future price uncertainties will affect immediate consumption patterns, despite the price expectations remaining unchanged. We develop a theoretical framework and prove that demand exhibits prudence when the third-order derivative of its utility cost function is positive, and show a prudent demand demonstrates risk-averse behaviors despite the objective being risk-neutral. . Prudent demands exhibit skewness aversion, with increased price skewness elevating the cost associated with prudence. We validate our theoretical findings through numerical simulations and conclude their implications for demand response modeling and the future design of incentive-based demand response mechanisms.


title: Exploring the Enigma of Neural Dynamics Through A Scattering-Transform Mixer Landscape for Riemannian Manifold

abstract: The human brain is a complex inter-wired system that emerges spontaneous functional fluctuations. In spite of tremendous success in the experimental neuroscience field, a system-level understanding of how brain anatomy supports various neural activities remains elusive. Capitalizing on the unprecedented amount of neuroimaging data, we present a physics-informed deep model to uncover the coupling mechanism between brain structure and function through the lens of data geometry that is rooted in the widespread wiring topology of connections between distant brain regions. Since deciphering the puzzle of self-organized patterns in functional fluctuations is the gateway to understanding the emergence of cognition and behavior, we devise a geometric deep model to uncover manifold mapping functions that characterize the intrinsic feature representations of evolving functional fluctuations on the Riemannian manifold. In lieu of learning unconstrained mapping functions, we introduce a set of graph-harmonic scattering transforms to impose the brain-wide geometry on top of manifold mapping functions, which allows us to cast the manifold-based deep learning into a reminiscent of MLP-Mixer architecture (in computer vision) for Riemannian manifold. As a proof-of-concept approach, we explore a neural-manifold perspective to understand the relationship between (static) brain structure and (dynamic) function, challenging the prevailing notion in cognitive neuroscience by proposing that neural activities are essentially excited by brain-wide oscillation waves living on the geometry of human connectomes, instead of being confined to focal areas.


title: Neural L1 Adaptive Control of Vehicle Lateral Dynamics

abstract: We address the problem of stable and robust control of vehicles with lateral error dynamics for the application of lane keeping. Lane departure is the primary reason for half of the fatalities in road accidents, making the development of stable, adaptive and robust controllers a necessity. Traditional linear feedback controllers achieve satisfactory tracking performance, however, they exhibit unstable behavior when uncertainties are induced into the system. Any disturbance or uncertainty introduced to the steering-angle input can be catastrophic for the vehicle. Therefore, controllers must be developed to actively handle such uncertainties. In this work, we introduce a Neural L1 Adaptive controller (Neural-L1) which learns the uncertainties in the lateral error dynamics of a front-steered Ackermann vehicle and guarantees stability and robustness. Our contributions are threefold: i) We extend the theoretical results for guaranteed stability and robustness of conventional L1 Adaptive controllers to Neural-L1; ii) We implement a Neural-L1 for the lane keeping application which learns uncertainties in the dynamics accurately; iii)We evaluate the performance of Neural-L1 on a physics-based simulator, PyBullet, and conduct extensive real-world experiments with the F1TENTH platform to demonstrate superior reference trajectory tracking performance of Neural-L1 compared to other state-of-the-art controllers, in the presence of uncertainties. Our project page, including supplementary material and videos, can be found at https://mukhe027.github.io/Neural-Adaptive-Control/


title: A First Course in Monte Carlo Methods

abstract: This is a concise mathematical introduction to Monte Carlo methods, a rich family of algorithms with far-reaching applications in science and engineering. Monte Carlo methods are an exciting subject for mathematical statisticians and computational and applied mathematicians: the design and analysis of modern algorithms are rooted in a broad mathematical toolbox that includes ergodic theory of Markov chains, Hamiltonian dynamical systems, transport maps, stochastic differential equations, information theory, optimization, Riemannian geometry, and gradient flows, among many others. These lecture notes celebrate the breadth of mathematical ideas that have led to tangible advancements in Monte Carlo methods and their applications. To accommodate a diverse audience, the level of mathematical rigor varies from chapter to chapter, giving only an intuitive treatment to the most technically demanding subjects. The aim is not to be comprehensive or encyclopedic, but rather to illustrate some key principles in the design and analysis of Monte Carlo methods through a carefully-crafted choice of topics that emphasizes timeless over timely ideas. Algorithms are presented in a way that is conducive to conceptual understanding and mathematical analysis -- clarity and intuition are favored over state-of-the-art implementations that are harder to comprehend or rely on ad-hoc heuristics. To help readers navigate the expansive landscape of Monte Carlo methods, each algorithm is accompanied by a summary of its pros and cons, and by a discussion of the type of problems for which they are most useful. The presentation is self-contained, and therefore adequate for self-guided learning or as a teaching resource. Each chapter contains a section with bibliographic remarks that will be useful for those interested in conducting research on Monte Carlo methods and their applications.


title: How Many Matrices Should I Prepare To Polarize Channels Optimally Fast?

abstract: Polar codes that approach capacity at a near-optimal speed, namely with scaling exponents close to $2$, have been shown possible for $q$-ary erasure channels (Pfister and Urbanke), the BEC (Fazeli, Hassani, Mondelli, and Vardy), all BMS channels (Guruswami, Riazanov, and Ye), and all DMCs (Wang and Duursma). There is, nevertheless, a subtlety separating the last two papers from the first two, namely the usage of multiple dynamic kernels in the polarization process, which leads to increased complexity and fewer opportunities to hardware-accelerate. This paper clarifies this subtlety, providing a trade-off between the number of kernels in the construction and the scaling exponent. We show that the number of kernels can be bounded by $O(\ell^{3/\mu-1})$ where $\mu$ is the targeted scaling exponent and $\ell$ is the kernel size. In particular, if one settles for scaling exponent approaching $3$, a single kernel suffices, and to approach the optimal scaling exponent of $2$, about $O(\sqrt{\ell})$ kernels suffice.


title: LDPKiT: Recovering Utility in LDP Schemes by Training with Noise^2

abstract: The adoption of large cloud-based models for inference has been hampered by concerns about the privacy leakage of end-user data. One method to mitigate this leakage is to add local differentially private noise to queries before sending them to the cloud, but this degrades utility as a side effect. Our key insight is that knowledge available in the noisy labels returned from performing inference on noisy inputs can be aggregated and used to recover the correct labels. We implement this insight in LDPKiT, which stands for Local Differentially-Private and Utility-Preserving Inference via Knowledge Transfer. LDPKiT uses the noisy labels returned from querying a set of noised inputs to train a local model (noise^2), which is then used to perform inference on the original set of inputs. Our experiments on CIFAR-10, Fashion-MNIST, SVHN, and CARER NLP datasets demonstrate that LDPKiT can improve utility without compromising privacy. For instance, on CIFAR-10, compared to a standard $\epsilon$-LDP scheme with $\epsilon=15$, which provides a weak privacy guarantee, LDPKiT can achieve nearly the same accuracy (within 1% drop) with $\epsilon=7$, offering an enhanced privacy guarantee. Moreover, the benefits of using LDPKiT increase at higher, more privacy-protective noise levels. For Fashion-MNIST and CARER, LDPKiT's accuracy on the sensitive dataset with $\epsilon=7$ not only exceeds the average accuracy of the standard $\epsilon$-LDP scheme with $\epsilon=7$ by roughly 20% and 9% but also outperforms the standard $\epsilon$-LDP scheme with $\epsilon=15$, a scenario with less noise and minimal privacy protection. We also perform Zest distance measurements to demonstrate that the type of distillation performed by LDPKiT is different from a model extraction attack.


title: A finite difference scheme for smooth solutions of the general mKdV equation

abstract: We consider a generalization of the mKdV model of shallow water out-flows. This generalization is a family of equations with nonlinear dispersion terms containing, in particular, KdV, mKdV, Benjamin-Bona-Mahony, Camassa-Holm, and Degasperis-Procesi equations. Nonlinear dispersion, generally speaking, implies instability of classical solutions and wave breaking in a finite time. However, there are special conditions under which the general mKdV equation admits classical solutions that are global in time. We have created an economic finite difference scheme that preserves this property for numerical solutions. To illustrate this we demonstrate some numerical results about propagation and interaction of solitons.


title: LLMs for User Interest Exploration in Large-scale Recommendation Systems

abstract: Traditional recommendation systems are subject to a strong feedback loop by learning from and reinforcing past user-item interactions, which in turn limits the discovery of novel user interests. To address this, we introduce a hybrid hierarchical framework combining Large Language Models (LLMs) and classic recommendation models for user interest exploration. The framework controls the interfacing between the LLMs and the classic recommendation models through "interest clusters", the granularity of which can be explicitly determined by algorithm designers. It recommends the next novel interests by first representing "interest clusters" using language, and employs a fine-tuned LLM to generate novel interest descriptions that are strictly within these predefined clusters. At the low level, it grounds these generated interests to an item-level policy by restricting classic recommendation models, in this case a transformer-based sequence recommender to return items that fall within the novel clusters generated at the high level. We showcase the efficacy of this approach on an industrial-scale commercial platform serving billions of users. Live experiments show a significant increase in both exploration of novel interests and overall user enjoyment of the platform.


title: On a multi-dimensional transport equation with nonlocal velocity and fractional dissipation

abstract: This paper aims to investigate a multi-dimensional transport equation with nonlocal velocity and fractional dissipation.The balance between the nonlinearity and dissipation gives rise to three different cases, namely the subcritical, critical and supercritical ranges. We study those three cases and obtain a set of results containing local well-posedness, global smoothness, eventual regularity and finite-time blowup of smooth solutions.


title: Evidence for a close-in tertiary orbiting around the Algol-type system HZ Dra with tidal splitting and spots activities

abstract: We reported a cyclic variation of $O-C$ diagram with a semi-amplitude of 0.0033 days and a period of 1.05 years for the pulsating eclipsing binary HZ Dra. The cyclic variation can be explained by the light travel-time effect via the presence of a close-in third body orbiting around HZ Dra in an elliptical orbit with a maximum semi-major axis of 0.92 au. Based on the W-D code, the contribution of the third light to the total system is determined to be 29 $\%$, which is in agreement with the estimated value. Our light curve modelling indicates an evolving hot and cool spot on the surface of the primary and secondary components, respectively. Their positions are roughly symmetrical to the inner Lagrangian point L1, which could be used to explain the variation in the O$^{'}$Connell effect. Our frequency analysis detects 1 radial p-mode, 7 non-radial p-modes and 1 non-radial g-mode. In addition, a total of 6 multiplets are identified, spaced by the orbital frequency, which can be explained as a tidally split mode caused by the equilibrium tides of the close binary system with a circular orbit. These pulsating features suggest that the primary of HZ Dra is a $\delta$ Scuti star, pulsating in both p- and g-mode and influenced by tidal forces.


title: Josephson bifurcation readout: beyond the monochromatic approximation

abstract: We analyze properties of bifurcation quantum detectors based on weakly nonlinear superconducting resonance circuits, in particular, with application to quantum readout. The developed quantitative description demonstrates strong influence of higher harmonics on their characteristics. While this effect is relevant for various circuits, including the conventional Josephson bifurcation amplifier and the parametrically driven circuit, we first focus on the period-doubling bifurcation under a force driving. This kind of bifurcation is due to nominally quadratic nonlinearity, which enables parametric down-conversion of the driving signal at nearly double resonance frequency to the basic mode. We analyze the effect of higher harmonics on the dynamics of the basic mode, inherent in a nonlinear circuit, which in our case is based on a Josephson junction with a sinusoidal current-phase relation as the origin of nonlinearity. We demonstrate that effects beyond the monochromatic approximation significantly modify the bare characteristics and evaluate their contribution. Due to high sensitivity of this circuit to small variations of parameters, it can serve as an efficient detector of the quantum state of superconducting qubits.


title: Orbital dynamics in galactic potentials under mass transfer

abstract: Time-dependent potentials are common in galactic systems that undergo significant evolution, interactions, or encounters with other galaxies, or when there are dynamic processes like star formation and merging events. Recent studies show that an ensemble approach along with the so-called snapshot framework in dynamical system theory provide a powerful tool to analyze time dependent dynamics. In this work, we aim to explore and quantify the phase space structure and dynamical complexity in time-dependent galactic potentials consisting of multiple components. We apply the classical method of Poincar\'e-surface of section to analyze the phase space structure in a chaotic Hamiltonian system subjected to parameter drift. This, however, makes sense only when the evolution of a large ensemble of initial conditions is followed. Numerical simulations explore the phase space structure of such ensembles while the system undergoes a continuous parameter change. The pair-wise average distance of ensemble members allows us to define a generalized Lyapunov-exponent, that might also be time dependent, to describe the system stability. We revise the system parameters for the Milky Way galaxy and provide a comprehensive dynamical analysis of the system under circumstances where linear mass transfer undergoes between the disk and bulge components of the model.


title: Qsco: A Quantum Scoring Module for Open-set Supervised Anomaly Detection

abstract: Open set anomaly detection (OSAD) is a crucial task that aims to identify abnormal patterns or behaviors in data sets, especially when the anomalies observed during training do not represent all possible classes of anomalies. The recent advances in quantum computing in handling complex data structures and improving machine learning models herald a paradigm shift in anomaly detection methodologies. This study proposes a Quantum Scoring Module (Qsco), embedding quantum variational circuits into neural networks to enhance the model's processing capabilities in handling uncertainty and unlabeled data. Extensive experiments conducted across eight real-world anomaly detection datasets demonstrate our model's superior performance in detecting anomalies across varied settings and reveal that integrating quantum simulators does not result in prohibitive time complexities. Our study validates the feasibility of quantum-enhanced anomaly detection methods in practical applications.


title: Lane Detection using Graph Search and Geometric Constraints for Formula Student Driverless

abstract: Lane detection is a fundamental task in autonomous driving. While the problem is typically formulated as the detection of continuous boundaries, we study the problem of detecting lane boundaries that are sparsely marked by 2D points with many false positives. This problem arises in the Formula Student Driverless (FSD) competition and is challenging due to its inherent ambiguity. Previous methods are inefficient and unable to find long-horizon solutions. We propose a deterministic algorithm called CLC that uses backtracking graph search with a learned likelihood function to overcome these limitations. We impose geometric constraints on the lane candidates to guarantee a geometrically sound lane. Our exhaustive search leads to finding the global optimum in 45% of instances, and the algorithm is overall robust to up to 50% false positives. Our algorithm runs in less than 15 ms on a single CPU core, meeting the low latency requirements of autonomous racing. We extensively evaluate our method on real data and realistic racetrack layouts, and show that it outperforms the state-of-the-art by detecting long lanes over 100 m with few (0.6%) critical failures. This allows our autonomous racecar to drive close to its physical limits on a previously unknown racetrack without being limited by perception. We release our dataset with realistic Formula Student racetracks to enable further research.


title: Quickly-Decodable Group Testing with Fewer Tests: Price-Scarlett and Cheraghchi-Nakos's Nonadaptive Splitting with Explicit Scalars

abstract: We modify Cheraghchi-Nakos [CN20] and Price-Scarlett's [PS20] fast binary splitting approach to nonadaptive group testing. We show that, to identify a uniformly random subset of $k$ infected persons among a population of $n$, it takes only $\ln(2 - 4\varepsilon) ^{-2} k \ln n$ tests and decoding complexity $O(\varepsilon^{-2} k \ln n)$, for any small $\varepsilon > 0$, with vanishing error probability. In works prior to ours, only two types of group testing schemes exist. Those that use $\ln(2)^{-2} k \ln n$ or fewer tests require linear-in-$n$ complexity, sometimes even polynomial in $n$; those that enjoy sub-$n$ complexity employ $O(k \ln n)$ tests, where the big-$O$ scalar is implicit, presumably greater than $\ln(2)^{-2}$. We almost achieve the best of both worlds, namely, the almost-$\ln(2)^{-2}$ scalar and the sub-$n$ decoding complexity. How much further one can reduce the scalar $\ln(2)^{-2}$ remains an open problem.


title: Eventually positive semigroups: spectral and asymptotic analysis

abstract: The spectral theory of semigroup generators is a crucial tool for analysing the asymptotic properties of operator semigroups. Typically, Tauberian theorems, such as the ABLV theorem, demand extensive information about the spectrum to derive convergence results. However, the scenario is significantly simplified for positive semigroups on Banach lattices. This observation extends to the broader class of eventually positive semigroups -- a phenomenon observed in various concrete differential equations. In this paper, we investigate the spectral and asymptotic properties of eventually positive semigroups, focusing particularly on the persistently irreducible case. Our findings expand upon the existing theory of eventual positivity, offering new insights into the cyclicity of the peripheral spectrum and asymptotic trends. Notably, several arguments for positive operators and semigroups do not apply in our context, necessitating the use of ultrapower arguments to circumvent these challenges.


title: Path-wise Vulnerability Mitigation

abstract: Software vulnerabilities are prevalent but fixing software vulnerabilities is not trivial. Studies have shown that a considerable prepatch window exists because it often takes weeks or months for software vendors to fix a vulnerability. Existing approaches aim to reduce the pre-patch window by generating and applying mitigation patches that prevent adversaries from exploiting vulnerabilities rather than fix vulnerabilities. Because mitigation patches typically terminate the execution of vulnerability-triggering program paths at the level of functions, they can have significant side-effects. This paper describes an approach called PAVER that generates and inserts mitigation patches at the level of program paths, i.e. path-wise vulnerability mitigation patches, in order to reduce their side-effects. PAVER generates a program path graph that includes the paths leading to vulnerabilities and the control dependencies on these paths, then identifies candidate patch locations based on the program path graph. For each candidate patch location, PAVER generates and inserts a mitigation patch, and tests the patched program to assess the side-effect of the patch. It ranks the patches by the extent of their side-effects. We evaluates the prototype of PAVER on real world vulnerabilities and the evaluation shows that our path-wise vulnerability mitigation patches can achieve minimum side-effects.


title: Successive Cancellation Sampling Decoder: An Attempt to Analyze List Decoding Theoretically

abstract: Successive cancellation list (SCL) decoders of polar codes excel in practical performance but pose challenges for theoretical analysis. Existing works either limit their scope to erasure channels or address general channels without taking advantage of soft information. In this paper, we propose the "successive cancellation sampling" (SCS) decoder. SCS hires iid "agents" to sample codewords using posterior probabilities. This makes it fully parallel and amenable for some theoretical analysis. As an example, when comparing SCS with $a$ agents to any list decoder with list size $\ell$, we can prove that the error probability of the former is at most $\ell/ae$ more than that of the latter. In this paper, we also describe how to adjust the "temperature" of agents. Warmer agents are less likely to sample the same codewords and hence can further reduce error probability.


title: Isolate and then Identify: Rethinking Adaptive Group Testing

abstract: Group testing (GT) is the art of identifying binary signals and the marketplace for exchanging new ideas for related fields such as unique-element counting, compressed sensing, traitor tracing, and geno-typing. A GT scheme can be nonadaptive or adaptive; the latter is preferred when latency is ess of an issue. To construct adaptive GT schemes, a popular strategy is to spend the majority of tests in the first few rounds to gain as much information as possible, and uses later rounds to refine details. In this paper, we propose a transparent strategy called "isolate and then identify" (I@I). In the first few rounds, I@I divides the population into teams until every team contains at most one sick person. Then, in the last round, I@I identifies the sick person in each team. Performance-wise, I@I is the first GT scheme that achieves the optimal coefficient $1/$capacity$(Z)$ for the $k \log_2 (n/k)$ term in the number of tests when $Z$ is a generic channel corrupting the test outcomes. I@I follows a modular methodology whereby the isolating part and the identification part can be optimized separately.


title: Hybrid Quantum Downsampling Networks

abstract: Classical max pooling plays a crucial role in reducing data dimensionality among various well-known deep learning models, yet it often leads to the loss of vital information. We proposed a novel hybrid quantum downsampling module (HQD), which is a noise-resilient algorithm. By integrating a substantial number of quantum bits (qubits), our approach ensures the key characteristics of the original image are maximally preserved within the local receptive field. Moreover, HQD provides unique advantages in the context of the noisy intermediate-scale quantum (NISQ) era. We introduce a unique quantum variational circuit in our design, utilizing rotating gates including RX, RY, RZ gates, and the controlled-NOT (CNOT) gate to explore nonlinear characteristics. The results indicate that the network architectures incorporating the HQD module significantly outperform the classical structures with max pooling in CIFAR-10 and CIFAR-100 datasets. The accuracy of all tested models improved by an average of approximately 3%, with a maximum fluctuation of only 0.4% under various quantum noise conditions.


title: STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making

abstract: Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments is hampered by significant limitations including poor mathematical reasoning, difficulty in following instructions, and a tendency to generate incorrect information. These deficiencies hinder their performance in strategic and interactive tasks that demand adherence to nuanced game rules, long-term planning, exploration in unknown environments, and anticipation of opponents' moves. To overcome these obstacles, this paper presents a novel LLM agent framework equipped with memory and specialized tools to enhance their strategic decision-making capabilities. We deploy the tools in a number of economically important environments, in particular bilateral bargaining and multi-agent and dynamic mechanism design. We employ quantitative metrics to assess the framework's performance in various strategic decision-making problems. Our findings establish that our enhanced framework significantly improves the strategic decision-making capability of LLMs. While we highlight the inherent limitations of current LLM models, we demonstrate the improvements through targeted enhancements, suggesting a promising direction for future developments in LLM applications for interactive environments.


title: Non-hyperbolic 3-manifolds and 3D field theories for 2D Virasoro minimal models

abstract: Using 3D-3D correspondence, we construct 3D dual bulk field theories for general Virasoro minimal models $M(P,Q)$. These theories correspond to Seifert fiber spaces $S^2 ((P,P-R),(Q,S),(3,1))$ with two integers $(R,S)$ satisfying $PS-QR =1$. In the unitary case, where $|P-Q|=1$, the bulk theory has a mass gap and flows to a unitary topological field theory (TQFT) in the IR, which is expected to support the chiral Virasoro minimal model at the boundary under an appropriate boundary condition. For the non-unitary case, where $|P-Q|>1$, the bulk theory flows to a 3D $\mathcal{N}=4$ rank-0 superconformal field theory, whose topologically twisted theory supports the chiral minimal model at the boundary. We also provide a concrete field theory description of the 3D bulk theory using $T[SU(2)]$ theories. Our proposals are supported by various consistency checks using 3D-3D relations and direct computations of various partition functions.


title: FPsPIN: An FPGA-based Open-Hardware Research Platform for Processing in the Network

abstract: In the era of post-Moore computing, network offload emerges as a solution to two challenges: the imperative for low-latency communication and the push towards hardware specialisation. Various methods have been employed to offload protocol- and data-processing onto network interface cards (NICs), from firmware modification to running full Linux on NICs for application execution. The sPIN project enables users to define handlers executed upon packet arrival. While simulations show sPIN's potential across diverse workloads, a full-system evaluation is lacking. This work presents FPsPIN, a full FPGA-based implementation of sPIN. FPsPIN is showcased through offloaded MPI datatype processing, achieving a 96% overlap ratio. FPsPIN provides an adaptable open-source research platform for researchers to conduct end-to-end experiments on smart NICs.


title: Selective inference for multiple pairs of clusters after K-means clustering

abstract: If the same data is used for both clustering and for testing a null hypothesis that is formulated in terms of the estimated clusters, then the traditional hypothesis testing framework often fails to control the Type I error. Gao et al. [2022] and Chen and Witten [2023] provide selective inference frameworks for testing if a pair of estimated clusters indeed stem from underlying differences, for the case where hierarchical clustering and K-means clustering, respectively, are used to define the clusters. In applications, however, it is often of interest to test for multiple pairs of clusters. In our work, we extend the pairwise test of Chen and Witten [2023] to a test for multiple pairs of clusters, where the cluster assignments are produced by K-means clustering. We further develop an analogous test for the setting where the variance is unknown, building on the work of Yun and Barber [2023] that extends Gao et al. [2022]'s pairwise test to the case of unknown variance. For both known and unknown variance settings, we present methods that address certain forms of data-dependence in the choice of pairs of clusters to test for. We show that our proposed tests control the Type I error, both theoretically and empirically, and provide a numerical study of their empirical powers under various settings.


title: Dynamic Inhomogeneous Quantum Resource Scheduling with Reinforcement Learning

abstract: A central challenge in quantum information science and technology is achieving real-time estimation and feedforward control of quantum systems. This challenge is compounded by the inherent inhomogeneity of quantum resources, such as qubit properties and controls, and their intrinsically probabilistic nature. This leads to stochastic challenges in error detection and probabilistic outcomes in processes such as heralded remote entanglement. Given these complexities, optimizing the construction of quantum resource states is an NP-hard problem. In this paper, we address the quantum resource scheduling issue by formulating the problem and simulating it within a digitized environment, allowing the exploration and development of agent-based optimization strategies. We employ reinforcement learning agents within this probabilistic setting and introduce a new framework utilizing a Transformer model that emphasizes self-attention mechanisms for pairs of qubits. This approach facilitates dynamic scheduling by providing real-time, next-step guidance. Our method significantly improves the performance of quantum systems, achieving more than a 3$\times$ improvement over rule-based agents, and establishes an innovative framework that improves the joint design of physical and control systems for quantum applications in communication, networking, and computing.


title: Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groups

abstract: The generative modeling of data on manifold is an important task, for which diffusion models in flat spaces typically need nontrivial adaptations. This article demonstrates how a technique called `trivialization' can transfer the effectiveness of diffusion models in Euclidean spaces to Lie groups. In particular, an auxiliary momentum variable was algorithmically introduced to help transport the position variable between data distribution and a fixed, easy-to-sample distribution. Normally, this would incur further difficulty for manifold data because momentum lives in a space that changes with the position. However, our trivialization technique creates to a new momentum variable that stays in a simple $\textbf{fixed vector space}$. This design, together with a manifold preserving integrator, simplifies implementation and avoids inaccuracies created by approximations such as projections to tangent space and manifold, which were typically used in prior work, hence facilitating generation with high-fidelity and efficiency. The resulting method achieves state-of-the-art performance on protein and RNA torsion angle generation and sophisticated torus datasets. We also, arguably for the first time, tackle the generation of data on high-dimensional Special Orthogonal and Unitary groups, the latter essential for quantum problems.


title: Video Prediction Models as General Visual Encoders

abstract: This study explores the potential of open-source video conditional generation models as encoders for downstream tasks, focusing on instance segmentation using the BAIR Robot Pushing Dataset. The researchers propose using video prediction models as general visual encoders, leveraging their ability to capture critical spatial and temporal information which is essential for tasks such as instance segmentation. Inspired by human vision studies, particularly Gestalts principle of common fate, the approach aims to develop a latent space representative of motion from images to effectively discern foreground from background information. The researchers utilize a 3D Vector-Quantized Variational Autoencoder 3D VQVAE video generative encoder model conditioned on an input frame, coupled with downstream segmentation tasks. Experiments involve adapting pre-trained video generative models, analyzing their latent spaces, and training custom decoders for foreground-background segmentation. The findings demonstrate promising results in leveraging generative pretext learning for downstream tasks, working towards enhanced scene analysis and segmentation in computer vision applications.


title: Rewarded Region Replay (R3) for Policy Learning with Discrete Action Space

abstract: We introduce a new on-policy algorithm called Rewarded Region Replay (R3), which significantly improves on PPO in solving environments with discrete action spaces. R3 improves sample efficiency by using a replay buffer which contains past successful trajectories with reward above a certain threshold, which are used to update a PPO agent with importance sampling. Crucially, we discard the importance sampling factors which are above a certain ratio to reduce variance and stabilize training. We found that R3 significantly outperforms PPO in Minigrid environments with sparse rewards and discrete action space, such as DoorKeyEnv and CrossingEnv, and moreover we found that the improvement margin of our method versus baseline PPO increases with the complexity of the environment. We also benchmarked the performance of R3 against DDQN (Double Deep Q-Network), which is a standard baseline in off-policy methods for discrete actions, and found that R3 also outperforms DDQN agent in DoorKeyEnv. Lastly, we adapt the idea of R3 to dense reward setting to obtain the Dense R3 algorithm (or DR3) and benchmarked it against PPO on Cartpole-V1 environment. We found that DR3 outperforms PPO significantly on this dense reward environment. Our code can be found at https://github.com/chry-santhemum/R3.


title: Free Foil: Generating Efficient and Scope-Safe Abstract Syntax

abstract: Handling bound identifiers correctly and efficiently is critical in implementations of compilers, proof assistants, and theorem provers. When choosing a representation for abstract syntax with binders, implementors face a trade-off between type safety with intrinsic scoping, efficiency, and generality. The "foil" by Maclaurin, Radul, and Paszke combines an efficient implementation of the Barendregt convention with intrinsic scoping through advanced type system features in Haskell, such as rank-2 polymorphism and generalized algebraic data types. Free scoped monads of Kudasov, on the other hand, combine intrinsic scoping with de Bruijn indices as nested data types with Sweirstra's data types \`a la carte approach to allow generic implementation of algorithms such as higher-order unification. In this paper, we suggest two approaches of making the foil more affordable. First, we marry free scoped monads with the foil, allowing to generate efficient, type-safe, and generic abstract syntax representation with binders for any language given its second-order signature. Second, we provide Template Haskell functions that allow generating the scope-safe representation from a na\"ive one. The latter approach enables us to use existing tools like BNF Converter to very quickly prototype complete implementation of languages, including parsing, pretty-printing, and efficient intrinsically scoped abstract syntax. We demonstrate both approaches using $\lambda\Pi$ with pairs and patterns as our example object language. Finally, we provide benchmarks comparing our implementation against the foil, free scoped monads with nested de Bruijn indices, and some traditional implementations.


title: Combining straight-line and map-based distances to investigate the connection between proximity to healthy foods and disease

abstract: Healthy foods are essential for a healthy life, but accessing healthy food can be more challenging for some people than others. This disparity in food access may lead to disparities in well-being, potentially with disproportionate rates of diseases in communities that face more challenges in accessing healthy food (i.e., low-access communities). Identifying low-access, high-risk communities for targeted interventions is a public health priority, but current methods to quantify food access rely on distance measures that are either computationally simple (like the length of the shortest straight-line route) or accurate (like the length of the shortest map-based driving route), but not both. We propose a multiple imputation approach to combine these distance measures, allowing researchers to harness the computational ease of one with the accuracy of the other. The approach incorporates straight-line distances for all neighborhoods and map-based distances for just a subset, offering comparable estimates to the ``gold standard'' model using map-based distances for all neighborhoods and improved efficiency over the ``complete case'' model using map-based distances for just the subset. Through the adoption of a measurement error framework, information from the straight-line distances can be leveraged to compute informative placeholders (i.e., impute) for any neighborhoods without map-based distances. Using simulations and data for the Piedmont Triad region of North Carolina, we quantify and compare the associations between various health outcomes (diabetes and obesity) and neighborhood-level proximity to healthy foods. The imputation procedure also makes it possible to predict the full landscape of food access in an area without requiring map-based measurements for all neighborhoods.


title: Variational Offline Multi-agent Skill Discovery

abstract: Skills are effective temporal abstractions established for sequential decision making tasks, which enable efficient hierarchical learning for long-horizon tasks and facilitate multi-task learning through their transferability. Despite extensive research, research gaps remain in multi-agent scenarios, particularly for automatically extracting subgroup coordination patterns in a multi-agent task. In this case, we propose two novel auto-encoder schemes: VO-MASD-3D and VO-MASD-Hier, to simultaneously capture subgroup- and temporal-level abstractions and form multi-agent skills, which firstly solves the aforementioned challenge. An essential algorithm component of these schemes is a dynamic grouping function that can automatically detect latent subgroups based on agent interactions in a task. Notably, our method can be applied to offline multi-task data, and the discovered subgroup skills can be transferred across relevant tasks without retraining. Empirical evaluations on StarCraft tasks indicate that our approach significantly outperforms existing methods regarding applying skills in multi-agent reinforcement learning (MARL). Moreover, skills discovered using our method can effectively reduce the learning difficulty in MARL scenarios with delayed and sparse reward signals.


title: Reverse Transition Kernel: A Flexible Framework to Accelerate Diffusion Inference

abstract: To generate data from trained diffusion models, most inference algorithms, such as DDPM, DDIM, and other variants, rely on discretizing the reverse SDEs or their equivalent ODEs. In this paper, we view such approaches as decomposing the entire denoising diffusion process into several segments, each corresponding to a reverse transition kernel (RTK) sampling subproblem. Specifically, DDPM uses a Gaussian approximation for the RTK, resulting in low per-subproblem complexity but requiring a large number of segments (i.e., subproblems), which is conjectured to be inefficient. To address this, we develop a general RTK framework that enables a more balanced subproblem decomposition, resulting in $\tilde O(1)$ subproblems, each with strongly log-concave targets. We then propose leveraging two fast sampling algorithms, the Metropolis-Adjusted Langevin Algorithm (MALA) and Underdamped Langevin Dynamics (ULD), for solving these strongly log-concave subproblems. This gives rise to the RTK-MALA and RTK-ULD algorithms for diffusion inference. In theory, we further develop the convergence guarantees for RTK-MALA and RTK-ULD in total variation (TV) distance: RTK-ULD can achieve $\epsilon$ target error within $\tilde{\mathcal O}(d^{1/2}\epsilon^{-1})$ under mild conditions, and RTK-MALA enjoys a $\mathcal{O}(d^{2}\log(d/\epsilon))$ convergence rate under slightly stricter conditions. These theoretical results surpass the state-of-the-art convergence rates for diffusion inference and are well supported by numerical experiments.


title: Multi-Reference Preference Optimization for Large Language Models

abstract: How can Large Language Models (LLMs) be aligned with human intentions and values? A typical solution is to gather human preference on model outputs and finetune the LLMs accordingly while ensuring that updates do not deviate too far from a reference model. Recent approaches, such as direct preference optimization (DPO), have eliminated the need for unstable and sluggish reinforcement learning optimization by introducing close-formed supervised losses. However, a significant limitation of the current approach is its design for a single reference model only, neglecting to leverage the collective power of numerous pretrained LLMs. To overcome this limitation, we introduce a novel closed-form formulation for direct preference optimization using multiple reference models. The resulting algorithm, Multi-Reference Preference Optimization (MRPO), leverages broader prior knowledge from diverse reference models, substantially enhancing preference learning capabilities compared to the single-reference DPO. Our experiments demonstrate that LLMs finetuned with MRPO generalize better in various preference data, regardless of data scarcity or abundance. Furthermore, MRPO effectively finetunes LLMs to exhibit superior performance in several downstream natural language processing tasks such as GSM8K and TruthfulQA.


title: Decorrelation in Local Statistics for random operators

abstract: In this paper we study the local spectral statistics in the localised region of various random operator models, including the $d$-dimensional the Anderson model and random Schr\"odinger operators. It is already established, in the above models, that at an energy $E$, in the localised energy region of the spectrum, where the density of states $n(E) > 0$, the local eigenvalue statistics $X_E$ is a Poisson processes with intensity $n(E) \mathcal{L}$, $\mathcal{L}$ being the Lebesgue measure on $\mathbb{R}$. The question of independence of $X_E, X_{E^\prime}$ for distinct energies was partially solved in the literature. We solve it completely for all the models for which the Minami technique works.


title: Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning

abstract: In numerous reinforcement learning (RL) problems involving safety-critical systems, a key challenge lies in balancing multiple objectives while simultaneously meeting all stringent safety constraints. To tackle this issue, we propose a primal-based framework that orchestrates policy optimization between multi-objective learning and constraint adherence. Our method employs a novel natural policy gradient manipulation method to optimize multiple RL objectives and overcome conflicting gradients between different tasks, since the simple weighted average gradient direction may not be beneficial for specific tasks' performance due to misaligned gradients of different task objectives. When there is a violation of a hard constraint, our algorithm steps in to rectify the policy to minimize this violation. We establish theoretical convergence and constraint violation guarantees in a tabular setting. Empirically, our proposed method also outperforms prior state-of-the-art methods on challenging safe multi-objective reinforcement learning tasks.


title: When does compositional structure yield compositional generalization? A kernel theory

abstract: Compositional generalization (the ability to respond correctly to novel combinations of familiar components) is thought to be a cornerstone of intelligent behavior. Compositionally structured (e.g. disentangled) representations are essential for this; however, the conditions under which they yield compositional generalization remain unclear. To address this gap, we present a general theory of compositional generalization in kernel models with fixed, potentially nonlinear representations (which also applies to neural networks in the "lazy regime"). We prove that these models are functionally limited to adding up values assigned to conjunctions/combinations of components that have been seen during training ("conjunction-wise additivity"), and identify novel compositionality failure modes that arise from the data and model structure, even for disentangled inputs. For models in the representation learning (or "rich") regime, we show that networks can generalize on an important non-additive task (associative inference), and give a mechanistic explanation for why. Finally, we validate our theory empirically, showing that it captures the behavior of deep neural networks trained on a set of compositional tasks. In sum, our theory characterizes the principles giving rise to compositional generalization in kernel models and shows how representation learning can overcome their limitations. We further provide a formally grounded, novel generalization class for compositional tasks that highlights fundamental differences in the required learning mechanisms (conjunction-wise additivity).


title: Development of a Virtual Reality Application for Oculomotor Examination Education Based on Student-Centered Pedagogy

abstract: This work-in-progress paper discusses the use of student-centered pedagogy to teach clinical oculomotor examination via Virtual Reality (VR). Traditional methods, such as PowerPoint slides and lab activities, are often insufficient for providing hands-on experience due to the high cost of clinical equipment. To address this, a VR-based application was developed using Unity and the HTC Vive Pro headset, offering a cost-effective solution for practical learning. The VR app allows students to engage in oculomotor examinations at their own pace, accommodating diverse backgrounds and learning preferences. This application enables students to collect and analyze data, providing a realistic simulation of clinical practice. The user study results from Doctor of Physical Therapy students indicate a high preference for the flexibility offered by the VR app, suggesting its potential as a valuable educational tool. Additionally, the paper explores the broader implications of using VR in engineering and computing education, highlighting the benefits of immersive, interactive learning environments.


title: Disentangling Foreground and Background Motion for Enhanced Realism in Human Video Generation

abstract: Recent advancements in human video synthesis have enabled the generation of high-quality videos through the application of stable diffusion models. However, existing methods predominantly concentrate on animating solely the human element (the foreground) guided by pose information, while leaving the background entirely static. Contrary to this, in authentic, high-quality videos, backgrounds often dynamically adjust in harmony with foreground movements, eschewing stagnancy. We introduce a technique that concurrently learns both foreground and background dynamics by segregating their movements using distinct motion representations. Human figures are animated leveraging pose-based motion, capturing intricate actions. Conversely, for backgrounds, we employ sparse tracking points to model motion, thereby reflecting the natural interaction between foreground activity and environmental changes. Training on real-world videos enhanced with this innovative motion depiction approach, our model generates videos exhibiting coherent movement in both foreground subjects and their surrounding contexts. To further extend video generation to longer sequences without accumulating errors, we adopt a clip-by-clip generation strategy, introducing global features at each step. To ensure seamless continuity across these segments, we ingeniously link the final frame of a produced clip with input noise to spawn the succeeding one, maintaining narrative flow. Throughout the sequential generation process, we infuse the feature representation of the initial reference image into the network, effectively curtailing any cumulative color inconsistencies that may otherwise arise. Empirical evaluations attest to the superiority of our method in producing videos that exhibit harmonious interplay between foreground actions and responsive background dynamics, surpassing prior methodologies in this regard.


title: Quantum State Diffusion on a Graph

abstract: Quantum walks have frequently envisioned the behavior of a quantum state traversing a classically defined, generally finite, graph structure. While this approach has already generated significant results, it imposes a strong assumption: all nodes where the walker is not positioned are quiescent. This paper will examine some mathematical structures that underlie state diffusion on arbitrary graphs, that is the circulation of states within a graph. We will seek to frame the multi-walker problem as a finite quantum cellular automaton. Every vertex holds a walker at all times. The walkers will never collide and at each time step their positions update non-deterministically by a quantum swap of walkers at opposite ends of a randomly chosen edge. The update is accomplished by a unitary transformation of the position of a walker to a superposition of all such possible swaps and then performing a quantum measurement on the superposition of possible swaps. This behavior generates strong entanglement between vertex states which provides a path toward developing local actions producing diffusion throughout the graph without depending on the specific structure of the graph through blind computation.


title: Daily Physical Activity Monitoring -- Adaptive Learning from Multi-source Motion Sensor Data

abstract: In healthcare applications, there is a growing need to develop machine learning models that use data from a single source, such as that from a wrist wearable device, to monitor physical activities, assess health risks, and provide immediate health recommendations or interventions. However, the limitation of using single-source data often compromises the model's accuracy, as it fails to capture the full scope of human activities. While a more comprehensive dataset can be gathered in a lab setting using multiple sensors attached to various body parts, this approach is not practical for everyday use due to the impracticality of wearing multiple sensors. To address this challenge, we introduce a transfer learning framework that optimizes machine learning models for everyday applications by leveraging multi-source data collected in a laboratory setting. We introduce a novel metric to leverage the inherent relationship between these multiple data sources, as they are all paired to capture aspects of the same physical activity. Through numerical experiments, our framework outperforms existing methods in classification accuracy and robustness to noise, offering a promising avenue for the enhancement of daily activity monitoring.


title: Machine learning in business process management: A systematic literature review

abstract: Machine learning (ML) provides algorithms to create computer programs based on data without explicitly programming them. In business process management (BPM), ML applications are used to analyse and improve processes efficiently. Three frequent examples of using ML are providing decision support through predictions, discovering accurate process models, and improving resource allocation. This paper organises the body of knowledge on ML in BPM. We extract BPM tasks from different literature streams, summarise them under the phases of a process`s lifecycle, explain how ML helps perform these tasks and identify technical commonalities in ML implementations across tasks. This study is the first exhaustive review of how ML has been used in BPM. We hope that it can open the door for a new era of cumulative research by helping researchers to identify relevant preliminary work and then combine and further develop existing approaches in a focused fashion. Our paper helps managers and consultants to find ML applications that are relevant in the current project phase of a BPM initiative, like redesigning a business process. We also offer - as a synthesis of our review - a research agenda that spreads ten avenues for future research, including applying novel ML concepts like federated learning, addressing less regarded BPM lifecycle phases like process identification, and delivering ML applications with a focus on end-users.


title: AdaFisher: Adaptive Second Order Optimization via Fisher Information

abstract: First-order optimization methods are currently the mainstream in training deep neural networks (DNNs). Optimizers like Adam incorporate limited curvature information by employing the diagonal matrix preconditioning of the stochastic gradient during the training. Despite their widespread, second-order optimization algorithms exhibit superior convergence properties compared to their first-order counterparts e.g. Adam and SGD. However, their practicality in training DNNs are still limited due to increased per-iteration computations and suboptimal accuracy compared to the first order methods. We present AdaFisher--an adaptive second-order optimizer that leverages a block-diagonal approximation to the Fisher information matrix for adaptive gradient preconditioning. AdaFisher aims to bridge the gap between enhanced convergence capabilities and computational efficiency in second-order optimization framework for training DNNs. Despite the slow pace of second-order optimizers, we showcase that AdaFisher can be reliably adopted for image classification, language modelling and stand out for its stability and robustness in hyperparameter tuning. We demonstrate that AdaFisher outperforms the SOTA optimizers in terms of both accuracy and convergence speed. Code available from \href{https://github.com/AtlasAnalyticsLab/AdaFisher}{https://github.com/AtlasAnalyticsLab/AdaFisher}


title: Networked Integrated Sensing and Communications for 6G Wireless Systems

abstract: Integrated sensing and communication (ISAC) is envisioned as a key pillar for enabling the upcoming sixth generation (6G) communication systems, requiring not only reliable communication functionalities but also highly accurate environmental sensing capabilities. In this paper, we design a novel networked ISAC framework to explore the collaboration among multiple users for environmental sensing. Specifically, multiple users can serve as powerful sensors, capturing back scattered signals from a target at various angles to facilitate reliable computational imaging. Centralized sensing approaches are extremely sensitive to the capability of the leader node because it requires the leader node to process the signals sent by all the users. To this end, we propose a two-step distributed cooperative sensing algorithm that allows low-dimensional intermediate estimate exchange among neighboring users, thus eliminating the reliance on the centralized leader node and improving the robustness of sensing. This way, multiple users can cooperatively sense a target by exploiting the block-wise environment sparsity and the interference cancellation technique. Furthermore, we analyze the mean square error of the proposed distributed algorithm as a networked sensing performance metric and propose a beamforming design for the proposed network ISAC scheme to maximize the networked sensing accuracy and communication performance subject to a transmit power constraint. Simulation results validate the effectiveness of the proposed algorithm compared with the state-of-the-art algorithms.


title: Automorphisms of GKM graphs and regular semisimple Hessenberg varieties

abstract: A regular semisimple Hessenberg variety $\mathrm{Hess}(S,h)$ is a smooth subvariety of the full flag variety $\mathrm{Fl}(\mathbb{C}^n)$ associated with a regular semisimple matrix $S$ of order $n$ and a function $h$ from $\{1,2,\dots,n\}$ to itself satisfying a certain condition. We show that when $\mathrm{Hess}(S,h)$ is connected and not the entire space $\mathrm{Fl}(\mathbb{C}^n)$, the reductive part of the identity component $\mathrm{Aut}^0(\mathrm{Hess}(S,h))$ of the automorphism group $\mathrm{Aut}(\mathrm{Hess}(S,h))$ of $\mathrm{Hess}(S,h)$ is an algebraic torus of dimension $n-1$ and $\mathrm{Aut}(\mathrm{Hess}(S,h))/\mathrm{Aut}^0(\mathrm{Hess}(S,h))$ is isomorphic to a subgroup of $\mathfrak{S}_n$ or $\mathfrak{S}_n\rtimes \{\pm 1\}$, where $\mathfrak{S}_n$ is the symmetric group of degree $n$. As a byproduct of our argument, we show that $\mathrm{Aut}(X)/\mathrm{Aut}^0(X)$ is a finite group for any projective GKM manifold $X$.


title: Weighted sampling recovery of functions with mixed smoothness

abstract: We study sparse-grid linear sampling algorithms and their optimality for approximate recovery of functions with mixed smoothness on $\mathbb{R}^d$ from a set of $n$ their sampled values in two different settings: (i) functions to be recovered are in weighted Sobolev spaces $W^r_{p,w}(\mathbb{R}^d)$ of mixed smoothness and the approximation error is measured by the norm of the weighted Lebesgue space $L_{q,w}(\mathbb{R}^d)$, and (ii) functions to be recovered are in Sobolev spaces with measure $W^r_p(\mathbb{R}^d; \mu_w)$ of mixed smoothness and the approximation error is measured by the norm of the Lebesgue space with measure $L_q(\mathbb{R}^d; \mu_w)$. Here, the function $w$, a tensor-product Freud-type weight is the weight in the setting (i), and the density function of the measure $\mu_w$ in the setting (ii). The optimality of linear sampling algorithms is investigated in terms of the relevant sampling $n$-widths. We construct sparse-grid linear sampling algorithms which are completely different for the settings (i) and (ii) and which give upper bounds of the corresponding sampling $n$-widths. We prove that in the one-dimensional case, these algorithms realize the right convergence rate of the sampling widths. In the setting (ii) for the high dimensional case ($d\ge 2$), we also achieve the right convergence rate of the sampling $n$-widths for $1\le q \le 2 \le p \le \infty$ through a non-constructive method.


title: Understanding the Effect of using Semantically Meaningful Tokens for Visual Representation Learning

abstract: Vision transformers have established a precedent of patchifying images into uniformly-sized chunks before processing. We hypothesize that this design choice may limit models in learning comprehensive and compositional representations from visual data. This paper explores the notion of providing semantically-meaningful visual tokens to transformer encoders within a vision-language pre-training framework. Leveraging off-the-shelf segmentation and scene-graph models, we extract representations of instance segmentation masks (referred to as tangible tokens) and relationships and actions (referred to as intangible tokens). Subsequently, we pre-train a vision-side transformer by incorporating these newly extracted tokens and aligning the resultant embeddings with caption embeddings from a text-side encoder. To capture the structural and semantic relationships among visual tokens, we introduce additive attention weights, which are used to compute self-attention scores. Our experiments on COCO demonstrate notable improvements over ViTs in learned representation quality across text-to-image (+47%) and image-to-text retrieval (+44%) tasks. Furthermore, we showcase the advantages on compositionality benchmarks such as ARO (+18%) and Winoground (+10%).


title: Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactions

abstract: The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an intriguing question Can ChatGPT respond with a greater degree of empathy than those typically offered by physicians? To answer this question, we collect a de-identified dataset of patient messages and physician responses from Mayo Clinic and generate alternative replies using ChatGPT. Our analyses incorporate novel empathy ranking evaluation (EMRank) involving both automated metrics and human assessments to gauge the empathy level of responses. Our findings indicate that LLM-powered chatbots have the potential to surpass human physicians in delivering empathetic communication, suggesting a promising avenue for enhancing patient care and reducing professional burnout. The study not only highlights the importance of empathy in patient interactions but also proposes a set of effective automatic empathy ranking metrics, paving the way for the broader adoption of LLMs in healthcare.


title: Dynamic response of a ferromagnetic nanofilament under rotating fields: effects of flexibility, thermal fluctuations and hydrodynamics

abstract: Using nonequilibrium computer simulations, we study the response of ferromagnetic nanofilaments, consisting of stabilized onedimensional chains of ferromagnetic nanoparticles, under external rotating magnetic fields. In difference with their analogous microscale and stiff counterparts, which have been actively studied in recent years, nonequilibrium properties of rather flexible nanoparticle filaments remain mostly unexplored. By progressively increasing the modeling details, we are able to evidence the qualitative impact of main interactions that can not be neglected at the nanoscale, showing that filament flexibility, thermal fluctuations and hydrodynamic interactions contribute independently to broaden the range of synchronous frequency response in this system. Furthermore, we also show the existence of a limited set of characteristic dynamic filament configurations and discuss in detail the asynchronous response, which at finite temperature becomes probabilistic.


title: Quantum entanglement dynamics of the three-qubit W_zeta quantum state coupled to spin chain with ternary interaction

abstract: In this study, we explore the dynamics of quantum entanglement using the negativity criterion for the W_zeta quantum state. We investigate changes in negativity in terms of anisotropy parameters, gamma, the strength of the external magnetic field applied to the spin chain, eta, the triple interaction strength, alpha. We examine how these parameters affect the entanglement properties of the system and discuss the implications for quantum information processing and quantum communication protocols. By analyzing the negativity of the W_zeta state under different conditions, we gain insights into the behaviour of entanglement in complex quantum systems. Our results shed light on the intricate interplay between various factors that influence quantum entanglement and provide a foundation for further investigations in this field of research.


title: Intruding with Words: Towards Understanding Graph Injection Attacks at the Text Level

abstract: Graph Neural Networks (GNNs) excel across various applications but remain vulnerable to adversarial attacks, particularly Graph Injection Attacks (GIAs), which inject malicious nodes into the original graph and pose realistic threats. Text-attributed graphs (TAGs), where nodes are associated with textual features, are crucial due to their prevalence in real-world applications and are commonly used to evaluate these vulnerabilities. However, existing research only focuses on embedding-level GIAs, which inject node embeddings rather than actual textual content, limiting their applicability and simplifying detection. In this paper, we pioneer the exploration of GIAs at the text level, presenting three novel attack designs that inject textual content into the graph. Through theoretical and empirical analysis, we demonstrate that text interpretability, a factor previously overlooked at the embedding level, plays a crucial role in attack strength. Among the designs we investigate, the Word-frequency-based Text-level GIA (WTGIA) is particularly notable for its balance between performance and interpretability. Despite the success of WTGIA, we discover that defenders can easily enhance their defenses with customized text embedding methods or large language model (LLM)--based predictors. These insights underscore the necessity for further research into the potential and practical significance of text-level GIAs.


title: SpinQuant: LLM quantization with learned rotations

abstract: Post-training quantization (PTQ) techniques applied to weights, activations, and the KV cache greatly reduce memory usage, latency, and power consumption of Large Language Models (LLMs), but may lead to large quantization errors when outliers are present. Recent findings suggest that rotating activation or weight matrices helps remove outliers and benefits quantization. In this work, we identify a collection of applicable rotation parameterizations that lead to identical outputs in full-precision Transformer architectures, and find that some random rotations lead to much better quantization than others, with an up to 13 points difference in downstream zero-shot reasoning performance. As a result, we propose SpinQuant that optimizes (or learns) the rotation matrices with Cayley optimization on a small validation set. With 4-bit quantization of weight, activation, and KV-cache, SpinQuant narrows the accuracy gap on zero-shot reasoning tasks with full precision to merely 2.9 points on the LLaMA-2 7B model, surpassing LLM-QAT by 19.1 points and SmoothQuant by 25.0 points. SpinQuant also outperforms concurrent work QuaRot, which applies random rotations to remove outliers. In particular, for LLaMA-2 7B/LLaMA-3 8B models that are hard to quantize, SpinQuant reduces the gap to full precision by 30.2%/34.1% relative to QuaRot.