title: Demonstration of Robust and Efficient Quantum Property Learning with Shallow Shadows

abstract: Extracting information efficiently from quantum systems is a major component of quantum information processing tasks. Randomized measurements, or classical shadows, enable predicting many properties of arbitrary quantum states using few measurements. While random single qubit measurements are experimentally friendly and suitable for learning low-weight Pauli observables, they perform poorly for nonlocal observables. Prepending a shallow random quantum circuit before measurements maintains this experimental friendliness, but also has favorable sample complexities for observables beyond low-weight Paulis, including high-weight Paulis and global low-rank properties such as fidelity. However, in realistic scenarios, quantum noise accumulated with each additional layer of the shallow circuit biases the results. To address these challenges, we propose the robust shallow shadows protocol. Our protocol uses Bayesian inference to learn the experimentally relevant noise model and mitigate it in postprocessing. This mitigation introduces a bias-variance trade-off: correcting for noise-induced bias comes at the cost of a larger estimator variance. Despite this increased variance, as we demonstrate on a superconducting quantum processor, our protocol correctly recovers state properties such as expectation values, fidelity, and entanglement entropy, while maintaining a lower sample complexity compared to the random single qubit measurement scheme. We also theoretically analyze the effects of noise on sample complexity and show how the optimal choice of the shallow shadow depth varies with noise strength. This combined theoretical and experimental analysis positions the robust shallow shadow protocol as a scalable, robust, and sample-efficient protocol for characterizing quantum states on current quantum computing platforms.

categories: quant-ph cond-mat.stat-mech cs.IT cs.LG math.IT


title: Magnetocaloric performance of RE$_{5}$Pd$_2$In$_4$ (RE = Tb-Tm) compounds

abstract: Magnetocaloric performance of the RE$_{5}$Pd$_2$In$_4$ (RE = Tb-Tm) rare earth compounds has been investigated using measurements of magnetization in the function of temperature and applied magnetic field. The maximum magnetic entropy change ($-\Delta S_{M}^{max}$) at magnetic flux density change ($\Delta \mu_0 H$) of 0-9~T has been determined to be 3.3~J$\cdot$kg$^{-1}\cdot$K$^{-1}$ at 62~K for Tb$_{5}$Pd$_2$In$_4$, 7.0~J$\cdot$kg$^{-1}\cdot$K$^{-1}$ at 22~K for Dy$_{5}$Pd$_2$In$_4$, 12.6~J$\cdot$kg$^{-1}\cdot$K$^{-1}$ at 22~K for Ho$_{5}$Pd$_2$In$_4$, 12.1~J$\cdot$kg$^{-1}\cdot$K$^{-1}$ at 17~K for Er$_{5}$Pd$_2$In$_4$ and 11.9~J$\cdot$kg$^{-1}\cdot$K$^{-1}$ at 9.0~K for Tm$_{5}$Pd$_2$In$_4$. The temperature averaged entropy change (TEC) with 3~K span equals 3.2, 7.0, 12.6, 12.2 and 11.8~J$\cdot$kg$^{-1}\cdot$K$^{-1}$ for RE = Tb-Tm, respectively. The relative cooling power (RCP) and refrigerant capacity (RC) are equal to respectively 258 and 215~J$\cdot$kg$^{-1}$ in Tb$_{5}$Pd$_2$In$_4$, 498 and 325~J$\cdot$kg$^{-1}$ in Dy$_{5}$Pd$_2$In$_4$, 489 and 403~J$\cdot$kg$^{-1}$ in Ho$_{5}$Pd$_2$In$_4$, 403 and 314~J$\cdot$kg$^{-1}$ in Er$_{5}$Pd$_2$In$_4$ and 234 and 184~J$\cdot$kg$^{-1}$ in Tm$_{5}$Pd$_2$In$_4$. The magnetocaloric properties of RE$_{5}$Pd$_2$In$_4$ are comparable to those of other known magnetocaloric materials, which show good magnetocaloric performance at low temperatures. Among RE$_{5}$Pd$_2$In$_4$, the highest values of parameters characterizing the magnetocaloric effect are found for RE = Ho and Er. Furthermore, for fixed RE element, the RE$_{5}$Pd$_2$In$_4$ compound displays the highest RCP and RC values when compared to those of its isostructural RE$_{5}$T$_2$In$_4$ (T = Ni, Pt) analogues.


title: Using AI libraries for Incompressible Computational Fluid Dynamics

abstract: Recently, there has been a huge effort focused on developing highly efficient open source libraries to perform Artificial Intelligence (AI) related computations on different computer architectures (for example, CPUs, GPUs and new AI processors). This has not only made the algorithms based on these libraries highly efficient and portable between different architectures, but also has substantially simplified the entry barrier to develop methods using AI. Here, we present a novel methodology to bring the power of both AI software and hardware into the field of numerical modelling by repurposing AI methods, such as Convolutional Neural Networks (CNNs), for the standard operations required in the field of the numerical solution of Partial Differential Equations (PDEs). The aim of this work is to bring the high performance, architecture agnosticism and ease of use into the field of the numerical solution of PDEs. We use the proposed methodology to solve the advection-diffusion equation, the non-linear Burgers equation and incompressible flow past a bluff body. For the latter, a convolutional neural network is used as a multigrid solver in order to enforce the incompressibility constraint. We show that the presented methodology can solve all these problems using repurposed AI libraries in an efficient way, and presents a new avenue to explore in the development of methods to solve PDEs and Computational Fluid Dynamics problems with implicit methods.


title: Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers

abstract: Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations.


title: Generation and analysis of synthetic data via Bayesian networks: a robust approach for uncertainty quantification via Bayesian paradigm

abstract: Safe and reliable disclosure of information from confidential data is a challenging statistical problem. A common approach considers the generation of synthetic data, to be disclosed instead of the original data. Efficient approaches ought to deal with the trade-off between reliability and confidentiality of the released data. Ultimately, the aim is to be able to reproduce as accurately as possible statistical analysis of the original data using the synthetic one. Bayesian networks is a model-based approach that can be used to parsimoniously estimate the underlying distribution of the original data and generate synthetic datasets. These ought to not only approximate the results of analyses with the original data but also robustly quantify the uncertainty involved in the approximation. This paper proposes a fully Bayesian approach to generate and analyze synthetic data based on the posterior predictive distribution of statistics of the synthetic data, allowing for efficient uncertainty quantification. The methodology makes use of probability properties of the model to devise a computationally efficient algorithm to obtain the target predictive distributions via Monte Carlo. Model parsimony is handled by proposing a general class of penalizing priors for Bayesian network models. Finally, the efficiency and applicability of the proposed methodology is empirically investigated through simulated and real examples.


title: Adversarial Math Word Problem Generation

abstract: Large language models (LLMs) have significantly transformed the educational landscape. As current plagiarism detection tools struggle to keep pace with LLMs' rapid advancements, the educational community faces the challenge of assessing students' true problem-solving abilities in the presence of LLMs. In this work, we explore a new paradigm for ensuring fair evaluation -- generating adversarial examples which preserve the structure and difficulty of the original questions aimed for assessment, but are unsolvable by LLMs. Focusing on the domain of math word problems, we leverage abstract syntax trees to structurally generate adversarial examples that cause LLMs to produce incorrect answers by simply editing the numeric values in the problems. We conduct experiments on various open- and closed-source LLMs, quantitatively and qualitatively demonstrating that our method significantly degrades their math problem-solving ability. We identify shared vulnerabilities among LLMs and propose a cost-effective approach to attack high-cost models. Additionally, we conduct automatic analysis to investigate the cause of failure, providing further insights into the limitations of LLMs.


title: Collaborative learning of common latent representations in routinely collected multivariate ICU physiological signals

abstract: In Intensive Care Units (ICU), the abundance of multivariate time series presents an opportunity for machine learning (ML) to enhance patient phenotyping. In contrast to previous research focused on electronic health records (EHR), here we propose an ML approach for phenotyping using routinely collected physiological time series data. Our new algorithm integrates Long Short-Term Memory (LSTM) networks with collaborative filtering concepts to identify common physiological states across patients. Tested on real-world ICU clinical data for intracranial hypertension (IH) detection in patients with brain injury, our method achieved an area under the curve (AUC) of 0.889 and average precision (AP) of 0.725. Moreover, our algorithm outperforms autoencoders in learning more structured latent representations of the physiological signals. These findings highlight the promise of our methodology for patient phenotyping, leveraging routinely collected multivariate time series to improve clinical care practices.


title: The Seeker's Dilemma: Realistic Formulation and Benchmarking for Hardware Trojan Detection

abstract: This work focuses on advancing security research in the hardware design space by formally defining the realistic problem of Hardware Trojan (HT) detection. The goal is to model HT detection more closely to the real world, i.e., describing the problem as "The Seeker's Dilemma" (an extension of Hide&Seek on a graph), where a detecting agent is unaware of whether circuits are infected by HTs or not. Using this theoretical problem formulation, we create a benchmark that consists of a mixture of HT-free and HT-infected restructured circuits while preserving their original functionalities. The restructured circuits are randomly infected by HTs, causing a situation where the defender is uncertain if a circuit is infected or not. We believe that our innovative dataset will help the community better judge the detection quality of different methods by comparing their success rates in circuit classification. We use our developed benchmark to evaluate three state-of-the-art HT detection tools to show baseline results for this approach. We use Principal Component Analysis to assess the strength of our benchmark, where we observe that some restructured HT-infected circuits are mapped closely to HT-free circuits, leading to significant label misclassification by detectors.


title: Quanto Option Pricing on a Multivariate Levy Process Model with a Generative Artificial Intelligence

abstract: In this study, we discuss a machine learning technique to price exotic options with two underlying assets based on a non-Gaussian Levy process model. We introduce a new multivariate Levy process model named the generalized normal tempered stable (gNTS) process, which is defined by time-changed multivariate Brownian motion. Since the gNTS process does not provide a simple analytic formula for the probability density function (PDF), we use the conditional real-valued non-volume preserving (CRealNVP) model, which is a type of flow-based generative network. Then, we discuss the no-arbitrage pricing on the gNTS model for pricing the quanto option, whose underlying assets consist of a foreign index and foreign exchange rate. We present the training of the CRealNVP model to learn the PDF of the gNTS process using a training set generated by Monte Carlo simulation. Next, we estimate the parameters of the gNTS model with the trained CRealNVP model using the empirical data observed in the market. Finally, we provide a method to find an equivalent martingale measure on the gNTS model and to price the quanto option using the CRealNVP model with the risk-neutral parameters of the gNTS model.


title: Generalized Bayesian Additive Regression Trees for Restricted Mean Survival Time Inference

abstract: Prediction methods for time-to-event outcomes often utilize survival models that rely on strong assumptions about noninformative censoring or on how individual-level covariates and survival functions are related. When the main interest is in predicting individual-level restricted mean survival times (RMST), reliance on such assumptions can lead to poor predictive performance if these assumptions are not satisfied. We propose a generalized Bayes framework that avoids full probability modeling of all survival outcomes by using an RMST-targeted loss function that depends on a collection of inverse probability of censoring weights (IPCW). In our generalized Bayes formulation, we utilize a flexible additive tree regression model for the RMST function, and the posterior distribution of interest is obtained through model-averaging IPCW-conditional loss function-based pseudo-Bayesian posteriors. Because informative censoring can be captured by the IPCW-dependent loss function, our approach only requires one to specify a model for the censoring distribution, thereby obviating the need for complex joint modeling to handle informative censoring. We evaluate the performance of our method through a series of simulations that compare it with several well-known survival machine learning methods, and we illustrate the application of our method using a multi-site cohort of breast cancer patients with clinical and genomic covariates.


title: Model Structures on Infinity-Categories of Filtrations

abstract: In 1974, Gugenheim and May showed that the cohomology $\text{Ext}_A(R,R)$ of a connected augmented algebra over a field $R$ is generated by elements with $s = 1$ under matric Massey products. In particular, this applies to the $E_2$ page of the $H\mathbb{F}_p$-based Adams spectral sequence. By studying a novel sequence of deformations of a presentably symmetric monoidal stable $\infty$-category $C$, we show that for a variety of spectral sequences coming from filtered spectra, the set of elements on the $E_2$ page surviving to the $E_k$ page is generated under matric Massey products by elements with degree $s < k.$ This work is the author's PhD thesis, completed under the supervision of Peter May.


title: Two-stage Quantum Estimation and the Asymptotics of Quantum-enhanced Transmittance Sensing

abstract: Quantum Cram\'er-Rao bound is the ultimate limit of the mean squared error for unbiased estimation of an unknown parameter embedded in a quantum state. While it can be achieved asymptotically for large number of quantum state copies, the measurement required often depends on the true value of the parameter of interest. This paradox was addressed by Hayashi and Matsumoto using a two-stage approach in 2005. Unfortunately, their analysis imposes conditions that severely restrict the class of classical estimators applied to the quantum measurement outcomes, hindering applications of this method. We relax these conditions to substantially broaden the class of usable estimators at the cost of slightly weakening the asymptotic properties of the two-stage method. We apply our results to obtain the asymptotics of quantum-enhanced transmittance sensing.


title: A linear photonic swap test circuit for quantum kernel estimation

abstract: Among supervised learning models, Support Vector Machine stands out as one of the most robust and efficient models for classifying data clusters. At the core of this method, a kernel function is employed to calculate the distance between different elements of the dataset, allowing for their classification. Since every kernel function can be expressed as a scalar product, we can estimate it using Quantum Mechanics, where probability amplitudes and scalar products are fundamental objects. The swap test, indeed, is a quantum algorithm capable of computing the scalar product of two arbitrary wavefunctions, potentially enabling a quantum speed-up. Here, we present an integrated photonic circuit designed to implement the swap test algorithm. Our approach relies solely on linear optical integrated components and qudits, represented by single photons from an attenuated laser beam propagating through a set of waveguides. By utilizing 2$^3$ spatial degrees of freedom for the qudits, we can configure all the necessary arrangements to set any two-qubits state and perform the swap test. This simplifies the requirements on the circuitry elements and eliminates the need for non-linearity, heralding, or post-selection to achieve multi-qubits gates. Our photonic swap test circuit successfully encodes two qubits and estimates their scalar product with a measured root mean square error smaller than 0.05. This result paves the way for the development of integrated photonic architectures capable of performing Quantum Machine Learning tasks with robust devices operating at room temperature.


title: Band structure and excitonic properties of WSe$_2$ in the isolated monolayer limit in an all-electron approach

abstract: A study is presented of the electronic band structure and optical absorption spectrum of monolayer WSe$_2$ using an all-electron quasiparticle self-consistent $GW$ approach, QS$G\hat W$, in which the screened Coulomb interaction $\hat W$ is calculated including ladder diagrams representing electron-hole interaction. The Bethe-Salpeter Equation is used to calculate both the screened Coulomb interaction $\hat W$ in the quasiparticle band structure and the imaginary part of the macroscopic dielectric function. The convergence of the quasiparticle band gap and lowest exciton peak position is studied as function of the separation of the monolayers when using periodic boundary conditions. The quasiparticle gap is found to vary as $1/d$ with $d$ the size of the vacuum separation, while the excitonic lowest peak reaches convergence much faster. The nature of the exciton spectrum is analyzed and shows several excitonic peaks below the quasiparticle gap when a sufficient number of $\textbf{k}$ points is used. They are found to be in good agreement with prior work and experiment after adding spin-orbit coupling corrections and can be explained in the context of the Wannier-Mott theory adapted to 2D.


title: [RE] Modeling Personalized Item Frequency Information for Next-basket Recommendation

abstract: This paper focuses on reproducing and extending the results of the paper: "Modeling Personalized Item Frequency Information for Next-basket Recommendation" which introduced the TIFU-KNN model and proposed to utilize Personalized Item Frequency (PIF) for Next Basket Recommendation (NBR). We utilized publicly available grocery shopping datasets used in the original paper and incorporated additional datasets to assess the generalizability of the findings. We evaluated the performance of the models using metrics such as Recall@K, NDCG@K, personalized-hit ratio (PHR), and Mean Reciprocal Rank (MRR). Furthermore, we conducted a thorough examination of fairness by considering user characteristics such as average basket size, item popularity, and novelty. Lastly, we introduced novel $\beta$-VAE architecture to model NBR. The experimental results confirmed that the reproduced model, TIFU-KNN, outperforms the baseline model, Personal Top Frequency, on various datasets and metrics. The findings also highlight the challenges posed by smaller basket sizes in some datasets and suggest avenues for future research to improve NBR performance.


title: Certain and Approximately Certain Models for Statistical Learning

abstract: Real-world data is often incomplete and contains missing values. To train accurate models over real-world datasets, users need to spend a substantial amount of time and resources imputing and finding proper values for missing data items. In this paper, we demonstrate that it is possible to learn accurate models directly from data with missing values for certain training data and target models. We propose a unified approach for checking the necessity of data imputation to learn accurate models across various widely-used machine learning paradigms. We build efficient algorithms with theoretical guarantees to check this necessity and return accurate models in cases where imputation is unnecessary. Our extensive experiments indicate that our proposed algorithms significantly reduce the amount of time and effort needed for data imputation without imposing considerable computational overhead.


title: MCSat-based Finite Field Reasoning in the Yices2 SMT Solver

abstract: This system description introduces an enhancement to the Yices2 SMT solver, enabling it to reason over non-linear polynomial systems over finite fields. Our reasoning approach fits into the model-constructing satisfiability (MCSat) framework and is based on zero decomposition techniques, which find finite basis explanations for theory conflicts over finite fields. As the MCSat solver within Yices2 can support (and combine) several theories via theory plugins, we implemented our reasoning approach as a new plugin for finite fields and extended Yices2's frontend to parse finite field problems, making our implementation the first MCSat-based reasoning engine for finite fields. We present its evaluation on finite field benchmarks, comparing it against cvc5. Additionally, our work leverages the modular architecture of the MCSat solver in Yices2 to provide a foundation for the rapid implementation of further reasoning techniques for this theory.


title: Electron-Induced Radiolysis Chemistry in Fluid Cell Electron Microscopy: Application on the Reactivity of Aluminum Nanocubes

abstract: Leveraging the high energy electrons as probe for the atomic landscape of materials, the importance of understanding radiolysis chemistry in the field of transmission electron microscopy (TEM) is exceptionally important. Reactive chemical species generated from electron-material interactions diffuse throughout the sample and may induce "artifact" reactions with the specimen of interest. However, in other aspects, this radiolysis can be utilized to intentionally trigger chemical reactions related to the nucleation and growth of colloidal nanoparticles, as well as chemical etching under a priori conditions in fluid condition. Therefore, systematic research and new theories are required to help researchers gain a deeper understanding of these electron-materials interactions either to mitigate damage or rationally use radical chemistry especially in the environmental TEM (E-TEM). Radiolysis in open-cell gas phase TEM (GPTEM) under reduced pressures is usually disregarded considering the low density of molecules and high diffusivity. However, for emerging closed-cell GPTEM, which usually involves the usage of higher pressures, less is known. Here, we utilize an ultrathin (UT) silicon nitride gas cell to investigate and quantify the effects of electron dosage on the oxidation behavior of {100}-faceted aluminum (Al) nanocubes under various conditions. In addition, we develop a generalized computational code to elucidate radiolysis chemistry in varying media with consideration of the diffusion dynamics, while rationalizing the experimental observations. Based on these theoretical electron-fluid interaction models, we propose guidelines to control the radical species of the closed-cell in situ nanoreactors, paving the way to the nanoscale control of chemical reactions in E-TEM.


title: Decremental $(1+\epsilon)$-Approximate Maximum Eigenvector: Dynamic Power Method

abstract: We present a dynamic algorithm for maintaining $(1+\epsilon)$-approximate maximum eigenvector and eigenvalue of a positive semi-definite matrix $A$ undergoing \emph{decreasing} updates, i.e., updates which may only decrease eigenvalues. Given a vector $v$ updating $A\gets A-vv^{\top}$, our algorithm takes $\tilde{O}(\mathrm{nnz}(v))$ amortized update time, i.e., polylogarithmic per non-zeros in the update vector. Our technique is based on a novel analysis of the influential power method in the dynamic setting. The two previous sets of techniques have the following drawbacks (1) algebraic techniques can maintain exact solutions but their update time is at least polynomial per non-zeros, and (2) sketching techniques admit polylogarithmic update time but suffer from a crude additive approximation. Our algorithm exploits an oblivious adversary. Interestingly, we show that any algorithm with polylogarithmic update time per non-zeros that works against an adaptive adversary and satisfies an additional natural property would imply a breakthrough for checking psd-ness of matrices in $\tilde{O}(n^{2})$ time, instead of $O(n^{\omega})$ time.


title: Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning

abstract: People often give instructions whose meaning is ambiguous without further context, expecting that their actions or goals will disambiguate their intentions. How can we build assistive agents that follow such instructions in a flexible, context-sensitive manner? This paper introduces cooperative language-guided inverse plan search (CLIPS), a Bayesian agent architecture for pragmatic instruction following and goal assistance. Our agent assists a human by modeling them as a cooperative planner who communicates joint plans to the assistant, then performs multimodal Bayesian inference over the human's goal from actions and language, using large language models (LLMs) to evaluate the likelihood of an instruction given a hypothesized plan. Given this posterior, our assistant acts to minimize expected goal achievement cost, enabling it to pragmatically follow ambiguous instructions and provide effective assistance even when uncertain about the goal. We evaluate these capabilities in two cooperative planning domains (Doors, Keys & Gems and VirtualHome), finding that CLIPS significantly outperforms GPT-4V, LLM-based literal instruction following and unimodal inverse planning in both accuracy and helpfulness, while closely matching the inferences and assistive judgments provided by human raters.


title: Universal energy-speed-accuracy trade-offs in driven nonequilibrium systems

abstract: Physical systems driven away from equilibrium by an external controller dissipate heat to the environment; the excess entropy production in the thermal reservoir can be interpreted as a "cost" to transform the system in a finite time. The connection between measure theoretic optimal transport and dissipative nonequilibrium dynamics provides a language for quantifying this cost and has resulted in a collection of "thermodynamic speed limits", which argue that the minimum dissipation of a transformation between two probability distributions is directly proportional to the rate of driving. Thermodynamic speed limits rely on the assumption that the target probability distribution is perfectly realized, which is almost never the case in experiments or numerical simulations. Here, we address the ubiquitous situation in which the external controller is imperfect. As a consequence, we obtain a lower bound for the dissipated work in generic nonequilibrium control problems that 1) is asymptotically tight and 2) matches the thermodynamic speed limit in the case of optimal driving. We illustrate these bounds on analytically solvable examples and also develop a strategy for optimizing minimally dissipative protocols based on optimal transport flow matching, a generative machine learning technique. This latter approach ensures the scalability of both the theoretical and computational framework we put forth. Crucially, we demonstrate that we can compute the terms in our bound numerically using efficient algorithms from the computational optimal transport literature and that the protocols that we learn saturate the bound.


title: A Heterogeneous Agent Model of Mortgage Servicing: An Income-based Relief Analysis

abstract: Mortgages account for the largest portion of household debt in the United States, totaling around \$12 trillion nationwide. In times of financial hardship, alleviating mortgage burdens is essential for supporting affected households. The mortgage servicing industry plays a vital role in offering this assistance, yet there has been limited research modelling the complex relationship between households and servicers. To bridge this gap, we developed an agent-based model that explores household behavior and the effectiveness of relief measures during financial distress. Our model represents households as adaptive learning agents with realistic financial attributes. These households experience exogenous income shocks, which may influence their ability to make mortgage payments. Mortgage servicers provide relief options to these households, who then choose the most suitable relief based on their unique financial circumstances and individual preferences. We analyze the impact of various external shocks and the success of different mortgage relief strategies on specific borrower subgroups. Through this analysis, we show that our model can not only replicate real-world mortgage studies but also act as a tool for conducting a broad range of what-if scenario analyses. Our approach offers fine-grained insights that can inform the development of more effective and inclusive mortgage relief solutions.


title: ICAT: An Indoor Connected and Autonomous Testbed for Vehicle Computing

abstract: Indoor autonomous driving testbeds have emerged to complement expensive outdoor testbeds and virtual simulations, offering scalable and cost-effective solutions for research in navigation, traffic optimization, and swarm intelligence. However, they often lack the robust sensing and computing infrastructure for advanced research. Addressing these limitations, we introduce the Indoor Connected Autonomous Testbed (ICAT), a platform that not only tackles the unique challenges of indoor autonomous driving but also innovates vehicle computing and V2X communication. Moreover, ICAT leverages digital twins through CARLA and SUMO simulations, facilitating both centralized and decentralized autonomy deployments.


title: Multitask Multilingual Model Adaptation with Featurized Low-Rank Mixtures

abstract: Adapting pretrained large language models (LLMs) to various downstream tasks in tens or hundreds of human languages is computationally expensive. Parameter-efficient fine-tuning (PEFT) significantly reduces the adaptation cost, by tuning only a small amount of parameters. However, directly applying PEFT methods such as LoRA (Hu et al., 2022) on diverse dataset mixtures could lead to suboptimal performance due to limited parameter capacity and negative interference among different datasets. In this work, we propose Featurized Low-rank Mixtures (FLix), a novel PEFT method designed for effective multitask multilingual tuning. FLix associates each unique dataset feature, such as the dataset's language or task, with its own low-rank weight update parameters. By composing feature-specific parameters for each dataset, FLix can accommodate diverse dataset mixtures and generalize better to unseen datasets. Our experiments show that FLix leads to significant improvements over a variety of tasks for both supervised learning and zero-shot settings using different training data mixtures.


title: Lusztig varieties and Macdonald polynomials

abstract: This paper uses Lusztig varieties to give central elements of the Iwahori-Hecke algebra corresponding to unipotent conjugacy classes in the finite Chevalley group $GL_n(\mathbb{F}_q)$. We explain how these central elements are related to Macdonald polynomials and how this provides a framework for generalizing integral form and modified Macdonald polynomials to Lie types other than $GL_n$. The key steps are to recognize (a) that counting points in Lusztig varieties is equivalent to computing traces on the Hecke algebras, (b) that traces on the Hecke algebra determine elements of the center of the Hecke algebra, (c) that the Geck-Rouquier basis elements of the center of the Hecke algebra produce an `expansion matrix', (d) that the parabolic subalgebras of the Hecke algebra produce a `contraction matrix' and (e) that the combination `expansion-contraction' is the plethystic transformation that relates integral form Macdonald polynomials and modified Macdonald polynomials.


title: Acquiring Linguistic Knowledge from Multimodal Input

abstract: In contrast to children, language models (LMs) exhibit considerably inferior data efficiency when acquiring language. In this submission to the BabyLM Challenge (Warstadt et al., 2023), we test the hypothesis that this data efficiency gap is partly caused by a lack of multimodal input and grounding in the learning environment of typical language models. Although previous work looking into this question found that multimodal training can even harm language-only performance, we speculate that these findings can be attributed to catastrophic forgetting of complex language due to fine-tuning on captions data. To test our hypothesis, we perform an ablation study on FLAVA (Singh et al., 2022), a multimodal vision-and-language model, independently varying the volume of text and vision input to quantify how much text data (if any) can be offset by vision at different data scales. We aim to limit catastrophic forgetting through a multitask pretraining regime that includes unimodal text-only tasks and data sampled from WiT, the relatively diverse Wikipedia-based dataset (Srinivasan et al., 2021). Our results are largely negative: Multimodal pretraining does not harm our models' language performance but does not consistently help either. That said, our conclusions are limited by our having been able to conduct only a small number of runs. While we must leave open the possibility that multimodal input explains some of the gap in data efficiency between LMs and humans, positive evidence for this hypothesis will require better architectures and techniques for multimodal training.


title: Can an LLM-Powered Socially Assistive Robot Effectively and Safely Deliver Cognitive Behavioral Therapy? A Study With University Students

abstract: Cognitive behavioral therapy (CBT) is a widely used therapeutic method for guiding individuals toward restructuring their thinking patterns as a means of addressing anxiety, depression, and other challenges. We developed a large language model (LLM)-powered prompt-engineered socially assistive robot (SAR) that guides participants through interactive CBT at-home exercises. We evaluated the performance of the SAR through a 15-day study with 38 university students randomly assigned to interact daily with the robot or a chatbot (using the same LLM), or complete traditional CBT worksheets throughout the duration of the study. We measured weekly therapeutic outcomes, changes in pre-/post-session anxiety measures, and adherence to completing CBT exercises. We found that self-reported measures of general psychological distress significantly decreased over the study period in the robot and worksheet conditions but not the chatbot condition. Furthermore, the SAR enabled significant single-session improvements for more sessions than the other two conditions combined. Our findings suggest that SAR-guided LLM-powered CBT may be as effective as traditional worksheet methods in supporting therapeutic progress from the beginning to the end of the study and superior in decreasing user anxiety immediately after completing the CBT exercise.


title: EmMark: Robust Watermarks for IP Protection of Embedded Quantized Large Language Models

abstract: This paper introduces EmMark,a novel watermarking framework for protecting the intellectual property (IP) of embedded large language models deployed on resource-constrained edge devices. To address the IP theft risks posed by malicious end-users, EmMark enables proprietors to authenticate ownership by querying the watermarked model weights and matching the inserted signatures. EmMark's novelty lies in its strategic watermark weight parameters selection, nsuring robustness and maintaining model quality. Extensive proof-of-concept evaluations of models from OPT and LLaMA-2 families demonstrate EmMark's fidelity, achieving 100% success in watermark extraction with model performance preservation. EmMark also showcased its resilience against watermark removal and forging attacks.


title: Fast buffet onset prediction and optimization method based on a pre-trained flowfield prediction model

abstract: The transonic buffet is a detrimental phenomenon occurs on supercritical airfoils and limits aircraft's operating envelope. Traditional methods for predicting buffet onset rely on multiple computational fluid dynamics simulations to assess a series of airfoil flowfields and then apply criteria to them, which is slow and hinders optimization efforts. This article introduces an innovative approach for rapid buffet onset prediction. A machine-learning flowfield prediction model is pre-trained on a large database and then deployed offline to replace simulations in the buffet prediction process for new airfoil designs. Unlike using a model to directly predict buffet onset, the proposed technique offers better visualization capabilities by providing users with intuitive flowfield outputs. It also demonstrates superior generalization ability, evidenced by a 32.5% reduction in average buffet onset prediction error on the testing dataset. The method is utilized to optimize the buffet performance of 11 distinct airfoils within and outside the training dataset. The optimization results are verified with simulations and proved to yield improved samples across all cases. It is affirmed the pre-trained flowfield prediction model can be applied to accelerate aerodynamic shape optimization, while further work still needs to raise its reliability for this safety-critical task.


title: Weakly Private Information Retrieval from Heterogeneously Trusted Servers

abstract: We study the problem of weakly private information retrieval (PIR) when there is heterogeneity in servers' trustfulness under the maximal leakage (Max-L) metric and mutual information (MI) metric. A user wishes to retrieve a desired message from N non-colluding servers efficiently, such that the identity of the desired message is not leaked in a significant manner; however, some servers can be more trustworthy than others. We propose a code construction for this setting and optimize the probability distribution for this construction. For the Max-L metric, it is shown that the optimal probability allocation for the proposed scheme essentially separates the delivery patterns into two parts: a completely private part that has the same download overhead as the capacity-achieving PIR code, and a non-private part that allows complete privacy leakage but has no download overhead by downloading only from the most trustful server. The optimal solution is established through a sophisticated analysis of the underlying convex optimization problem, and a reduction between the homogeneous setting and the heterogeneous setting. For the MI metric, the homogeneous case is studied first for which the code can be optimized with an explicit probability assignment, while a closed-form solution becomes intractable for the heterogeneous case. Numerical results are provided for both cases to corroborate the theoretical analysis.


title: Neural Networks for Portfolio-Level Risk Management: Portfolio Compression, Static Hedging, Counterparty Credit Risk Exposures and Impact on Capital Requirement

abstract: In this paper, we present an artificial neural network framework for portfolio compression of a large portfolio of European options with varying maturities (target portfolio) by a significantly smaller portfolio of European options with shorter or same maturity (compressed portfolio), which also represents a self-replicating static hedge portfolio of the target portfolio. For the proposed machine learning architecture, which is consummately interpretable by choice of design, we also define the algorithm to learn model parameters by providing a parameter initialisation technique and leveraging the optimisation methodology proposed in Lokeshwar and Jain (2024), which was initially introduced to price Bermudan options. We demonstrate the convergence of errors and the iterative evolution of neural network parameters over the course of optimization process, using selected target portfolio samples for illustration. We demonstrate through numerical examples that the Exposure distributions and Exposure profiles (Expected Exposure and Potential Future Exposure) of the target portfolio and compressed portfolio align closely across future risk horizons under risk-neutral and real-world scenarios. Additionally, we benchmark the target portfolio's Financial Greeks (Delta, Gamma, and Vega) against the compressed portfolio at future time horizons across different market scenarios generated by Monte-Carlo simulations. Finally, we compare the regulatory capital requirement under the standardised approach for counterparty credit risk of the target portfolio against the compressed portfolio and highlight that the capital requirement for the compact portfolio substantially reduces.


title: Increased instantaneous bandwidth of Rydberg atom electrometry with an optical frequency comb probe

abstract: We show that the use of an optical frequency comb probe leads to dramatically improved bandwidth (as high as 12+/-1 MHz) for the detection of modulated radio frequencies in Rydberg atom-based electrometry.


title: Sequential transport maps using SoS density estimation and $\alpha$-divergences

abstract: Transport-based density estimation methods are receiving growing interest because of their ability to efficiently generate samples from the approximated density. We further invertigate the sequential transport maps framework proposed from arXiv:2106.04170 arXiv:2303.02554, which builds on a sequence of composed Knothe-Rosenblatt (KR) maps. Each of those maps are built by first estimating an intermediate density of moderate complexity, and then by computing the exact KR map from a reference density to the precomputed approximate density. In our work, we explore the use of Sum-of-Squares (SoS) densities and $\alpha$-divergences for approximating the intermediate densities. Combining SoS densities with $\alpha$-divergence interestingly yields convex optimization problems which can be efficiently solved using semidefinite programming. The main advantage of $\alpha$-divergences is to enable working with unnormalized densities, which provides benefits both numerically and theoretically. In particular, we provide two new convergence analyses of the sequential transport maps: one based on a triangle-like inequality and the second on information geometric properties of $\alpha$-divergences for unnormalizied densities. The choice of intermediate densities is also crucial for the efficiency of the method. While tempered (or annealed) densities are the state-of-the-art, we introduce diffusion-based intermediate densities which permits to approximate densities known from samples only. Such intermediate densities are well-established in machine learning for generative modeling. Finally we propose and try different low-dimensional maps (or lazy maps) for dealing with high-dimensional problems and numerically demonstrate our methods on several benchmarks, including Bayesian inference problems and unsupervised learning task.


title: Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey

abstract: Recent breakthroughs in large language modeling have facilitated rigorous exploration of their application in diverse tasks related to tabular data modeling, such as prediction, tabular data synthesis, question answering, and table understanding. Each task presents unique challenges and opportunities. However, there is currently a lack of comprehensive review that summarizes and compares the key techniques, metrics, datasets, models, and optimization approaches in this research domain. This survey aims to address this gap by consolidating recent progress in these areas, offering a thorough survey and taxonomy of the datasets, metrics, and methodologies utilized. It identifies strengths, limitations, unexplored territories, and gaps in the existing literature, while providing some insights for future research directions in this vital and rapidly evolving field. It also provides relevant code and datasets references. Through this comprehensive review, we hope to provide interested readers with pertinent references and insightful perspectives, empowering them with the necessary tools and knowledge to effectively navigate and address the prevailing challenges in the field.


title: Elastocaloric evidence for a multicomponent superconductor stabilized within the nematic state in Ba(Fe$_{1-x}$Co$_x$)$_2$As$_2$

abstract: The iron-based high-$T_c$ superconductors exhibit rich phase diagrams with intertwined phases, including magnetism, nematicity and superconductivity. The superconducting $T_c$ in many of these materials is maximized in the regime of strong nematic fluctuations, making the role of nematicity in influencing the superconductivity a topic of intense research. Here, we use the AC elastocaloric effect (ECE) to map out the phase diagram of Ba(Fe$_{1-x}$Co$_x$)$_2$As$_2$ near optimal doping. The ECE signature at $T_c$ on the overdoped side, where superconductivity condenses without any nematic order, is quantitatively consistent with other thermodynamic probes that indicate a single-component superconducting state. In contrast, on the slightly underdoped side, where superconductivity condenses within the nematic phase, ECE reveals a second thermodynamic transition proximate to and below $T_c$. We rule out magnetism and re-entrant tetragonality as the origin of this transition, and find that our observations strongly suggest a phase transition into a multicomponent superconducting state. This implies the existence of a sub-dominant pairing instability that competes strongly with the dominant $s^\pm$ instability. Our results thus motivate a re-examination of the pairing state and its interplay with nematicity in this extensively studied iron-based superconductor, while also demonstrating the power of ECE in uncovering strain-tuned phase diagrams of quantum materials.


title: SparseLLM: Towards Global Pruning for Pre-trained Language Models

abstract: The transformative impact of large language models (LLMs) like LLaMA and GPT on natural language processing is countered by their prohibitive computational demands. Pruning has emerged as a pivotal compression strategy, introducing sparsity to enhance both memory and computational efficiency. Yet, traditional global pruning is impractical for LLMs due to scalability issues, while local pruning, despite its efficiency, leads to suboptimal solutions. Addressing these challenges, we propose SparseLLM, a novel framework that redefines the global pruning process into manageable, coordinated subproblems, allowing for resource-efficient optimization with global optimality. SparseLLM's approach, which conceptualizes LLMs as a chain of modular functions and leverages auxiliary variables for problem decomposition, not only facilitates a pragmatic application on LLMs but also demonstrates significant performance improvements, particularly in high-sparsity regimes where it surpasses current state-of-the-art methods.


title: Quantitative asymptotic regularity of the VAM iteration with error terms for m-accretive operators in Banach spaces

abstract: In this paper we obtain, by using proof mining methods, quantitative results on the asymptotic regularity of the viscosity approximation method (VAM) with error terms for m-accretive operators in Banach spaces. For concrete instances of the parameter sequences, linear rates are computed by applying a lemma due to Sabach and Shtern.


title: The Dirichlet problem for second-order elliptic equations in non-divergence form with continuous coefficients

abstract: This paper investigates the Dirichlet problem for a non-divergence form elliptic operator $L$ in a bounded domain of $\mathbb{R}^d$. Under certain conditions on the coefficients of $L$, we first establish the existence of a unique Green's function in a ball and derive two-sided pointwise estimates for it. Utilizing these results, we demonstrate the equivalence of regular points for $L$ and those for the Laplace operator, characterized via the Wiener test. This equivalence facilitates the unique solvability of the Dirichlet problem with continuous boundary data in regular domains. Furthermore, we construct the Green's function for $L$ in regular domains and establish pointwise bounds for it. This advancement is significant, as it extends the scope of existing estimates to domains beyond $C^{1,1}$, contributing to our understanding of elliptic operators in non-divergence form.


title: End-to-End Analysis Automation over Distributed Resources with Luigi Analysis Workflows

abstract: In particle physics, workflow management systems are primarily used as tailored solutions in dedicated areas such as Monte Carlo production. However, physicists performing data analyses are usually required to steer their individual, complex workflows manually, frequently involving job submission in several stages and interaction with distributed storage systems by hand. This process is not only time-consuming and error-prone, but also leads to undocumented relations between particular workloads, rendering the steering of an analysis a serious challenge. This article presents the Luigi Analysis Workflow (Law) Python package which is based on the open-source pipelining tool Luigi, originally developed by Spotify. It establishes a generic design pattern for analyses of arbitrary scale and complexity, and shifts the focus from executing to defining the analysis logic. Law provides the building blocks to seamlessly integrate with interchangeable remote resources without, however, limiting itself to a specific choice of infrastructure. In particular, it introduces the concept of complete separation between analysis algorithms on the one hand, and run locations, storage locations, and software environments on the other hand. To cope with the sophisticated demands of end-to-end HEP analyses, Law supports job execution on WLCG infrastructure (ARC, gLite, CMS-CRAB) as well as on local computing clusters (HTCondor, Slurm, LSF), remote file access via various protocols using the Grid File Access Library (GFAL2), and an environment sandboxing mechanism with support for sub-shells and virtual environments, as well as Docker and Singularity containers. Moreover, the novel approach ultimately aims for analysis preservation out-of-the-box. Law is developed open-source and independent of any experiment or the language of executed code, and its user-base increased steadily over the past years.


title: Nucleons and vector mesons in a confining holographic QCD model

abstract: We present a simple holographic QCD model that provides a unified description of vector mesons and nucleons in a confining background based on Einstein-dilaton gravity. For the confining background we consider analytical solutions of the Einstein-dilaton equations where the dilaton is a quadratic function of the radial coordinate far from the boundary. We build actions for the 5d gauge field and the 5d Dirac field dual to the 4d flavor current and the 4d nucleon interpolator respectively. In order to obtain asymptotically linear Regge trajectories we impose for each sector the condition that the effective Schr\"odinger equation has a potential that grows quadratically in the radial coordinate far from the boundary. For the vector mesons we show that this condition is automatically satisfied by a 5d Yang-Mills action minimally coupled to the metric and the dilaton. For the nucleons we find that the mass term of the 5d Dirac action needs to be generalised to include couplings to the metric and the dilaton. Using Sturm-Liouville theory we obtain a spectral decomposition for the hadronic correlators consistent with large $N_c$ QCD. Our setup contains only three parameters: the mass scale associated with confinement, the 5d gauge coupling and the 5d Dirac coupling. The last two are completely fixed by matching the correlators at high energies to perturbative QCD. We calculate masses and decay constants and compare our results against available experimental data. Our model can be thought of as a consistent embedding of soft wall models in Einstein-dilaton gravity.


title: QN-Mixer: A Quasi-Newton MLP-Mixer Model for Sparse-View CT Reconstruction

abstract: Inverse problems span across diverse fields. In medical contexts, computed tomography (CT) plays a crucial role in reconstructing a patient's internal structure, presenting challenges due to artifacts caused by inherently ill-posed inverse problems. Previous research advanced image quality via post-processing and deep unrolling algorithms but faces challenges, such as extended convergence times with ultra-sparse data. Despite enhancements, resulting images often show significant artifacts, limiting their effectiveness for real-world diagnostic applications. We aim to explore deep second-order unrolling algorithms for solving imaging inverse problems, emphasizing their faster convergence and lower time complexity compared to common first-order methods like gradient descent. In this paper, we introduce QN-Mixer, an algorithm based on the quasi-Newton approach. We use learned parameters through the BFGS algorithm and introduce Incept-Mixer, an efficient neural architecture that serves as a non-local regularization term, capturing long-range dependencies within images. To address the computational demands typically associated with quasi-Newton algorithms that require full Hessian matrix computations, we present a memory-efficient alternative. Our approach intelligently downsamples gradient information, significantly reducing computational requirements while maintaining performance. The approach is validated through experiments on the sparse-view CT problem, involving various datasets and scanning protocols, and is compared with post-processing and deep unrolling state-of-the-art approaches. Our method outperforms existing approaches and achieves state-of-the-art performance in terms of SSIM and PSNR, all while reducing the number of unrolling iterations required.


title: A Note On the Orbits of a Symmetric Subgroup in the Flag Variety

abstract: Motivated by relating the representation theory of the split real and $p$-adic forms of a connected reductive algebraic group $G$, we describe a subset of $2^r$ orbits on the complex flag variety for a certain symmetric subgroup. (Here $r$ is the semisimple rank of $G$.) This set of orbits has the property that, while the closure of individual orbits are generally singular, they are always smooth along other orbits in the set. This, in turn, implies consequences for the representation theory of the split real group.


title: A Proof of Basic Limit Theorem of Renewal Theory

abstract: Let $\{q_n\}_{n=0}^\infty\subset [0,1]$ satisfy $q_0=0$, $\sum_{n=0}^\infty q_n=1$, and $\gcd\{n\geq 1\mid q_n\neq 0\}=1$. We consider the following process: Let $x$ be a real number. We first set $x=0$. Then $x$ is increased by $i$ with probability $q_i~(i=0,1,2,\cdots)$ every time. For $n\geq 0$, let $p_n$ be the probability such that $x=n$ occurs, so we have $p_0=1$ and $p_n=q_1p_{n-1}+q_2p_{n-2}+\cdots+q_np_0~(n\geq 1)$. In this setting, we have $\lim_n p_n=1/\sum_{i=0}^\infty iq_i$, where we define $1/\sum_{i=0}^\infty iq_i=0$ if $\sum_{i=0}^\infty iq_i=+\infty$. This result is known as (discrete case of) Blackwell's renewal theorem. The proof of $\lim_n p_n=1/\sum_{i=0}^\infty iq_i$ is not trivial, while the meaning of $\lim_n p_n=1/\sum_{i=0}^\infty iq_i$ is clear since the expected value of increasing number $i$ is $\sum_{i=0}^\infty iq_i$. Many proofs of this result have been given. In this paper, we will also provide a proof of this result. The idea of our proof is based on Fourier-analytic methods and Tauberian theorems for almost convergent sequences, while we actually need only elementary analysis.


title: Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps

abstract: Current automatic speech recognition (ASR) models are designed to be used across many languages and tasks without substantial changes. However, this broad language coverage hides performance gaps within languages, for example, across genders. Our study systematically evaluates the performance of two widely used multilingual ASR models on three datasets, encompassing 19 languages from eight language families and two speaking conditions. Our findings reveal clear gender disparities, with the advantaged group varying across languages and models. Surprisingly, those gaps are not explained by acoustic or lexical properties. However, probing internal model states reveals a correlation with gendered performance gap. I.e., the easier it is to distinguish speaker gender in a language using probes, the more the gap reduces, favoring female speakers. Our results show that gender disparities persist even in state-of-the-art models. Our findings have implications for the improvement of multilingual ASR systems, underscoring the importance of accessibility to training data and nuanced evaluation to predict and mitigate gender gaps. We release all code and artifacts at https://github.com/g8a9/multilingual-asr-gender-gap.


title: Instantaneous regularization of measure-valued population densities in a Keller--Segel system with flux limitation

abstract: This paper is concerned with the Keller--Segel system with flux limitation, \begin{align} \tag{$\ast$} \begin{cases} u_t=\Delta u - \nabla \cdot (uf(|\nabla v|^{2})\nabla v), \\ v_t=\Delta v - v + u \end{cases} \end{align} in bounded $n$-dimensional domains with homogeneous Neumann boundary conditions, where $f$ generalizes the prototype obtained on letting \[ f(\xi) = k_f(1 + \xi)^{-\alpha}, \quad \xi \ge 0, \] with $k_f > 0$ and $\alpha > 0$. In this framework, it is shown that if either $n = 1$ and $\alpha > 0$ is arbitrary, or $n \ge 2$ and $\alpha > \frac{n-2}{2(n-1)}$, then for any nonnegative initial data belonging to the space of Radon measures for the population density and to $W^{1,q}$ with $q \in (\max\{1, (1-2\alpha)n\}, \frac{n}{n-1})$ for the signal density, there exists a global classical solution of the Neumann problem for $(\ast)$, which is continuous at $t = 0$ in an appropriate sense.


title: Relating Real and P-adic Kazhdan-Lusztig Polynomials

abstract: Fix an integral semisimple element $\lambda$ in the Lie algebra $\mathfrak{g}$ of a complex reductive algebraic group $G$. Let $L$ denote the centralizer of $\lambda$ in $G$ and let $\mathfrak{g}(-1)$ denote the $-1$ eigenspace of $\mathrm{ad}(\lambda)$ in $\mathfrak{g}$. Under a natural hypothesis (which is always satisfied for classical subgroups of $\mathrm{GL}(n)$), we embed the closure of each $L$ orbit on $\mathfrak{g}(-1)$ into the closure of an orbit of a symmetric subgroup $K$ containing $L$ on a partial flag variety for $G$. We use this to relate the local intersection homology of the later orbit closures to the former orbit closures. This, in turn, relates multiplicity matrices for split real and $p$-adic groups. We also describe relationships between "microlocal packets'' of representations of these groups.


title: Missing Titanium in the Asymmetric Supernova Remnant W49B

abstract: The progenitor of the W49B supernova remnant is still under debate. One of the candidates is a jet-driven core-collapse supernova. In such a highly asymmetric explosion, a strong $\alpha$-rich freezeout is expected in local high entropy regions, which should enrich elements synthesized by the capture of $\alpha$-particles such as $^{44}$Ti and $^{48}$Cr (decaying to $^{44}$Ca and $^{48}$Ti, respectively). In the present work, in order to infer the progenitor of the W49B remnant, we constrain the amount of stable Ti ($^{48}$Ti) synthesized, using the {\it Suzaku} observation. We found no firm evidence for the Ti line and set the upper limit of $M_{\rm Ti}/M_{\rm Fe} < 8.2 \times$ 10$^{-4}$ (99\% limit using Xspec) and $M_{\rm Ti}/M_{\rm Fe} < 1.9 \times$ 10$^{-3}$ (99\% limit using SPEX), and thus excluded almost all hypernova/jet-driven supernova models. Our results, as complemented by some previous studies, suggest that a Type Ia supernova from a near-$M_{\rm Ch}$ (Chandrasekhar mass) white dwarf is the most favorable candidate for the origin of W49B. Future observations with X-ray calorimeter missions, such as XRISM, will give us a stronger constraint on the progenitor.


title: Spatial Distribution of Intracluster Light versus Dark Matter in Horizon Run 5

abstract: One intriguing approach for studying the dynamical evolution of galaxy clusters is to compare the spatial distributions among various components, such as dark matter, member galaxies, gas, and intracluster light (ICL). Utilizing the recently introduced Weighted Overlap Coefficient (WOC) \citep{2022ApJS..261...28Y}, we analyze the spatial distributions of components within 174 galaxy clusters ($M_{\rm tot}> 5 \times 10^{13} M_{\odot}$, $z=0.625$) at varying dynamical states in the cosmological hydrodynamical simulation Horizon Run 5. We observe that the distributions of gas and the combination of ICL with the brightest cluster galaxy (BCG) closely resembles the dark matter distribution, particularly in more relaxed clusters, characterized by the half-mass epoch. The similarity in spatial distribution between dark matter and BCG+ICL mimics the changes in the dynamical state of clusters during a major merger. Notably, at redshifts $>$ 1, BCG+ICL traced dark matter more accurately than the gas. Additionally, we examined the one-dimensional radial profiles of each component, which show that the BCG+ICL is a sensitive component revealing the dynamical state of clusters. We propose a new method that can approximately recover the dark matter profile by scaling the BCG+ICL radial profile. Furthermore, we find a recipe for tracing dark matter in unrelaxed clusters by including the most massive satellite galaxies together with BCG+ICL distribution. Combining the BCG+ICL and the gas distribution enhances the dark matter tracing ability. Our results imply that the BCG+ICL distribution is an effective tracer for the dark matter distribution, and the similarity of spatial distribution may be a useful probe of the dynamical state of a cluster.


title: An Iterative Associative Memory Model for Empathetic Response Generation

abstract: Empathetic response generation aims to comprehend the cognitive and emotional states in dialogue utterances and generate proper responses. Psychological theories posit that comprehending emotional and cognitive states necessitates iteratively capturing and understanding associated words across dialogue utterances. However, existing approaches regard dialogue utterances as either a long sequence or independent utterances for comprehension, which are prone to overlook the associated words between them. To address this issue, we propose an Iterative Associative Memory Model (IAMM) for empathetic response generation. Specifically, we employ a novel second-order interaction attention mechanism to iteratively capture vital associated words between dialogue utterances and situations, dialogue history, and a memory module (for storing associated words), thereby accurately and nuancedly comprehending the utterances. We conduct experiments on the Empathetic-Dialogue dataset. Both automatic and human evaluations validate the efficacy of the model. Variant experiments on LLMs also demonstrate that attending to associated words improves empathetic comprehension and expression.


title: Rapid hyperspectral photothermal mid-infrared spectroscopic imaging from sparse data for gynecologic cancer tissue subtyping

abstract: Ovarian cancer detection has traditionally relied on a multi-step process that includes biopsy, tissue staining, and morphological analysis by experienced pathologists. While widely practiced, this conventional approach suffers from several drawbacks: it is qualitative, time-intensive, and heavily dependent on the quality of staining. Mid-infrared (MIR) hyperspectral photothermal imaging is a label-free, biochemically quantitative technology that, when combined with machine learning algorithms, can eliminate the need for staining and provide quantitative results comparable to traditional histology. However, this technology is slow. This work presents a novel approach to MIR photothermal imaging that enhances its speed by an order of magnitude. Our method significantly accelerates data collection by capturing a combination of high-resolution and interleaved, lower-resolution infrared band images and applying computational techniques for data interpolation. We effectively minimize data collection requirements by leveraging sparse data acquisition and employing curvelet-based reconstruction algorithms. This method enables the reconstruction of high-quality, high-resolution images from undersampled datasets and achieving a 10X improvement in data acquisition time. We assessed the performance of our sparse imaging methodology using a variety of quantitative metrics, including mean squared error (MSE), structural similarity index (SSIM), and tissue subtype classification accuracies, employing both random forest and convolutional neural network (CNN) models, accompanied by ROC curves. Our statistically robust analysis, based on data from 100 ovarian cancer patient samples and over 65 million data points, demonstrates the method's capability to produce superior image quality and accurately distinguish between different gynecological tissue types with segmentation accuracy exceeding 95%.


title: A Compact Anomaly Detection Solution for Science Instruments

abstract: Small low-cost instruments enable new and exciting mission opportunities yet their constrained volume and limited budgets make them especially susceptible to suffering anomalies during flight. Radiation effects as well as sensor or actuator failure can all pose a serious threat to the continued collection of scientific data as well as cause the partial or complete loss of a mission science payload. Onboard anomaly detection could allow instruments to recover from such events but its ad hoc development typically falls outside the mission timeline or monetary constraints. Here we describe a compact solution for the implementation of onboard anomaly detection meant for space science missions. The device is designed to be interoperable with a broad range of instruments utilizing easily accessible power and logic signals to monitor the state of peripherals and actuators without disrupting their functionality. By leveraging a commercially available microcontroller with a radiation hardened alternative package the device can be inexpensively sourced and assembled with minimal work enabling instrument characterization on an expedited timeline. The system can then be exchanged for a radiation hardened version ensuring the replicability of observed anomalies in a laboratory environment during instrument operations. We also present currently implemented anomaly detection algorithms which enable the system to detect anomalies in instruments with varying failure modes and allow mission designers to choose which detection approach best fits the specific needs of their instrument. Finally, we showcase an example application of this system in the detection of anomalies during the operation of a lysis motor designed for use in biological space instruments.


title: On the Treewidth of Token and Johnson Graphs

abstract: Let $G$ be a graph on $n$ vertices and $1 \le k \le n$ a fixed integer. The $k$-token graph of $G$ is the graph, $F_k(G)$, whose vertex set is equal to all the $k$-subsets of $V(G)$; where two of them are adjacent whenever their symmetric difference is an edge of $G$. In this paper we study the treewidth of $F_k(G)$, when $G$ is a star, path or a complete graph. We show that in the first two cases, the treewidth is of order $\Theta(n^{k-1})$, and of order $\Theta(n^k)$ in the third case. We conjecture that our upper bound for the treewidth of $F_k(K_n)$ is tight. This is particularly relevant since $F_k(K_n)$ is isomorphic to the well known Johnson graph $J(n,k)$.


title: The Design and Implementation of a High-Performance Log-Structured RAID System for ZNS SSDs

abstract: Zoned Namespace (ZNS) defines a new abstraction for host software to flexibly manage storage in flash-based SSDs as append-only zones. It also provides a Zone Append primitive to further boost the write performance of ZNS SSDs by exploiting intra-zone parallelism. However, making Zone Append effective for reliable and scalable storage, in the form of a RAID array of multiple ZNS SSDs, is non-trivial since Zone Append offloads address management to ZNS SSDs and requires hosts to dedicatedly manage RAID stripes across multiple drives. We propose ZapRAID, a high-performance log-structured RAID system for ZNS SSDs by carefully exploiting Zone Append to achieve high write parallelism and lightweight stripe management. ZapRAID adopts a group-based data layout with a coarse-grained ordering across multiple groups of stripes, such that it can use small-size metadata for stripe management on a per-group basis under Zone Append. It further adopts hybrid data management to simultaneously achieve intra-zone and inter-zone parallelism through a careful combination of both Zone Append and Zone Write primitives. We evaluate ZapRAID using microbenchmarks, trace-driven experiments, and real-application experiments. Our evaluation results show that ZapRAID achieves high write throughput and maintains high performance in normal reads, degraded reads, crash recovery, and full-drive recovery.


title: Direct measure of DNA bending by quantum magnetic imaging of a nano-mechanical torque-balance

abstract: DNA flexibility is a key determinant of biological function, from nucleosome positioning to transcriptional regulation, motivating a direct measurement of the bend-torque response of individual DNA molecules. In this work, DNA bending is detected using a nano-mechanical torque balance formed by tethering a ferromagnetic nanoparticle probe by an individual DNA molecule to a diamond magnetic field imager. The torque exerted by the DNA in response to bending caused by an applied magnetic torque is measured using wide-field imaging of quantum defects near the surface of the diamond. Qualitative measurements of differences in DNA bio-mechanical binding configuration are demonstrated, and as a proof-of-principle, a quantitative measurement of the bend response is made for individual DNA molecules. This quantum-enabled measurement approach could be applied to characterize the bend response of biophysically relevant short DNA molecules as well as the sequence dependence of DNA bending energy.


title: Twisted Koszul algebras of nonisolated hypersurface singularities

abstract: Given a hypersurface singularity (not necessarily isolated) with a finite abelian group action, we develop a method to define an explicit product structure on the twisted Koszul algebra (whose invariant subalgebra is the orbifold Koszul algebra).


title: STC-ViT: Spatio Temporal Continuous Vision Transformer for Weather Forecasting

abstract: Operational weather forecasting system relies on computationally expensive physics-based models. Recently, transformer based models have shown remarkable potential in weather forecasting achieving state-of-the-art results. However, transformers are discrete models which limit their ability to learn the continuous spatio-temporal features of the dynamical weather system. We address this issue with STC-ViT, a Spatio-Temporal Continuous Vision Transformer for weather forecasting. STC-ViT incorporates the continuous time Neural ODE layers with multi-head attention mechanism to learn the continuous weather evolution over time. The attention mechanism is encoded as a differentiable function in the transformer architecture to model the complex weather dynamics. We evaluate STC-ViT against a operational Numerical Weather Prediction (NWP) model and several deep learning based weather forecasting models. STC-ViT performs competitively with current data-driven methods in global forecasting while only being trained at lower resolution data and with less compute power.


title: Imitation-regularized Optimal Transport on Networks: Provable Robustness and Application to Logistics Planning

abstract: Network systems form the foundation of modern society, playing a critical role in various applications. However, these systems are at significant risk of being adversely affected by unforeseen circumstances, such as disasters. Considering this, there is a pressing need for research to enhance the robustness of network systems. Recently, in reinforcement learning, the relationship between acquiring robustness and regularizing entropy has been identified. Additionally, imitation learning is used within this framework to reflect experts' behavior. However, there are no comprehensive studies on the use of a similar imitation framework for optimal transport on networks. Therefore, in this study, imitation-regularized optimal transport (I-OT) on networks was investigated. It encodes prior knowledge on the network by imitating a given prior distribution. The I-OT solution demonstrated robustness in terms of the cost defined on the network. Moreover, we applied the I-OT to a logistics planning problem using real data. We also examined the imitation and apriori risk information scenarios to demonstrate the usefulness and implications of the proposed method.


title: The Reflection Coefficient of a Reflectionless Kink

abstract: Classically, reflectionless kinks transmit all incident radiation. Recently, we have used an analyticity argument together with a solution of the Lippmann-Schwinger equation to write down the leading quantum correction to the reflection probability. The argument was fast but rather indirect. In the present paper, we calculate the reflection coefficient and probability by methodically grinding through the Schrodinger picture time evolution. We find the same answer. This answer contains contributions not considered in the traditional calculation of meson-kink scattering in 1991. However, as a result of these contributions, our total result is zero in the case of the Sine-Gordon model, and so is consistent with integrability.


title: Vision Language Model-based Caption Evaluation Method Leveraging Visual Context Extraction

abstract: Given the accelerating progress of vision and language modeling, accurate evaluation of machine-generated image captions remains critical. In order to evaluate captions more closely to human preferences, metrics need to discriminate between captions of varying quality and content. However, conventional metrics fail short of comparing beyond superficial matches of words or embedding similarities; thus, they still need improvement. This paper presents VisCE$^2$, a vision language model-based caption evaluation method. Our method focuses on visual context, which refers to the detailed content of images, including objects, attributes, and relationships. By extracting and organizing them into a structured format, we replace the human-written references with visual contexts and help VLMs better understand the image, enhancing evaluation performance. Through meta-evaluation on multiple datasets, we validated that VisCE$^2$ outperforms the conventional pre-trained metrics in capturing caption quality and demonstrates superior consistency with human judgment.


title: Exploring Advanced Methodologies in Security Evaluation for LLMs

abstract: Large Language Models (LLMs) represent an advanced evolution of earlier, simpler language models. They boast enhanced abilities to handle complex language patterns and generate coherent text, images, audios, and videos. Furthermore, they can be fine-tuned for specific tasks. This versatility has led to the proliferation and extensive use of numerous commercialized large models. However, the rapid expansion of LLMs has raised security and ethical concerns within the academic community. This emphasizes the need for ongoing research into security evaluation during their development and deployment. Over the past few years, a substantial body of research has been dedicated to the security evaluation of large-scale models. This article an in-depth review of the most recent advancements in this field, providing a comprehensive analysis of commonly used evaluation metrics, advanced evaluation frameworks, and the routine evaluation processes for LLMs. Furthermore, we also discuss the future directions for advancing the security evaluation of LLMs.


title: All in an Aggregated Image for In-Image Learning

abstract: This paper introduces a new in-context learning (ICL) mechanism called In-Image Learning (I$^2$L) that combines demonstration examples, visual cues, and chain-of-thought reasoning into an aggregated image to enhance the capabilities of Large Multimodal Models (e.g., GPT-4V) in multimodal reasoning tasks. Unlike previous approaches that rely on converting images to text or incorporating visual input into language models, I$^2$L consolidates all information into an aggregated image and leverages image processing, understanding, and reasoning abilities. This has several advantages: it reduces inaccurate textual descriptions of complex images, provides flexibility in positioning demonstration examples, and avoids multiple input images and lengthy prompts. We also introduce I$^2$L-Hybrid, a method that combines the strengths of I$^2$L with other ICL methods. Specifically, it uses an automatic strategy to select the most suitable method (I$^2$L or another certain ICL method) for a specific task instance. We conduct extensive experiments to assess the effectiveness of I$^2$L and I$^2$L-Hybrid on MathVista, which covers a variety of complex multimodal reasoning tasks. Additionally, we investigate the influence of image resolution, the number of demonstration examples in a single image, and the positions of these demonstrations in the aggregated image on the effectiveness of I$^2$L. Our code is publicly available at https://github.com/AGI-Edgerunners/IIL.


title: From Generalization to Precision: Exploring SAM for Tool Segmentation in Surgical Environments

abstract: Purpose: Accurate tool segmentation is essential in computer-aided procedures. However, this task conveys challenges due to artifacts' presence and the limited training data in medical scenarios. Methods that generalize to unseen data represent an interesting venue, where zero-shot segmentation presents an option to account for data limitation. Initial exploratory works with the Segment Anything Model (SAM) show that bounding-box-based prompting presents notable zero-short generalization. However, point-based prompting leads to a degraded performance that further deteriorates under image corruption. We argue that SAM drastically over-segment images with high corruption levels, resulting in degraded performance when only a single segmentation mask is considered, while the combination of the masks overlapping the object of interest generates an accurate prediction. Method: We use SAM to generate the over-segmented prediction of endoscopic frames. Then, we employ the ground-truth tool mask to analyze the results of SAM when the best single mask is selected as prediction and when all the individual masks overlapping the object of interest are combined to obtain the final predicted mask. We analyze the Endovis18 and Endovis17 instrument segmentation datasets using synthetic corruptions of various strengths and an In-House dataset featuring counterfactually created real-world corruptions. Results: Combining the over-segmented masks contributes to improvements in the IoU. Furthermore, selecting the best single segmentation presents a competitive IoU score for clean images. Conclusions: Combined SAM predictions present improved results and robustness up to a certain corruption level. However, appropriate prompting strategies are fundamental for implementing these models in the medical domain.


title: SDHDF: A new file format for spectral-domain radio astronomy data

abstract: Radio astronomy file formats are now required to store wide frequency bandwidths and multiple simultaneous receiver beams and must be able to account for versatile observing modes and numerous calibration strategies. The need to capture and archive high-time and high frequency-resolution data, along with the comprehensive metadata that fully describe the data, implies that a new data format and new processing software are required. This requirement is suited to a well-defined, hierarchically-structured and flexible file format. In this paper we present the Spectral-Domain Hierarchical Data Format (`SDHDF') -- a new file format for radio astronomy data, in particular for single dish or beam-formed data streams. Since 2018, SDHDF has been the primary format for data products from the spectral-line and continuum observing modes at Murriyang, the CSIRO Parkes 64-m radio telescope, and we demonstrate that this data format can also be used to store observations of pulsars and fast radio bursts.


title: All-heavy pentaquarks in a nonrelativistic potential quark model

abstract: In a nonrelativistic potential quark model framework, we carry out a serious calculation of the all-heavy pentaquarks by adopting the explicitly correlated Gaussian method.A complete mass spectrum for the $1S$ states is obtained. For the $cccc\bar{c}$, $cccc\bar{b}$, $bbbb\bar{c}$, $bbbb\bar{b}$, $ccbb\bar{c}$, and $bbcc\bar{b}$ systems, the obtained states are compact and lie far above the lowest dissociation baryon-meson threshold. While, in the $cccb\bar{c}$, $cccb\bar{b}$, $bbbc\bar{c}$, and $bbbc\bar{b}$ systems with $\{123\}4\bar{5}$ symmetry, the two low-lying configurations with $J^P=5/2^-$ and $3/2^-$ have a typical molecular structure due to the special role of the color-Coulomb interactions, they may be good candidates of stable states below the dissociation baryon-meson thresholds.


title: Sample-Efficient Preference-based Reinforcement Learning with Dynamics Aware Rewards

abstract: Preference-based reinforcement learning (PbRL) aligns a robot behavior with human preferences via a reward function learned from binary feedback over agent behaviors. We show that dynamics-aware reward functions improve the sample efficiency of PbRL by an order of magnitude. In our experiments we iterate between: (1) learning a dynamics-aware state-action representation (z^{sa}) via a self-supervised temporal consistency task, and (2) bootstrapping the preference-based reward function from (z^{sa}), which results in faster policy learning and better final policy performance. For example, on quadruped-walk, walker-walk, and cheetah-run, with 50 preference labels we achieve the same performance as existing approaches with 500 preference labels, and we recover 83\% and 66\% of ground truth reward policy performance versus only 38\% and 21\%. The performance gains demonstrate the benefits of explicitly learning a dynamics-aware reward model. Repo: \texttt{https://github.com/apple/ml-reed}.


title: Enhancing Tracking Robustness with Auxiliary Adversarial Defense Networks

abstract: Adversarial attacks in visual object tracking have significantly degraded the performance of advanced trackers by introducing imperceptible perturbations into images. These attack methods have garnered considerable attention from researchers in recent years. However, there is still a lack of research on designing adversarial defense methods specifically for visual object tracking. To address these issues, we propose an effective additional pre-processing network called DuaLossDef that eliminates adversarial perturbations during the tracking process. DuaLossDef is deployed ahead of the search branche or template branche of the tracker to apply defensive transformations to the input images. Moreover, it can be seamlessly integrated with other visual trackers as a plug-and-play module without requiring any parameter adjustments. We train DuaLossDef using adversarial training, specifically employing Dua-Loss to generate adversarial samples that simultaneously attack the classification and regression branches of the tracker. Extensive experiments conducted on the OTB100, LaSOT, and VOT2018 benchmarks demonstrate that DuaLossDef maintains excellent defense robustness against adversarial attack methods in both adaptive and non-adaptive attack scenarios. Moreover, when transferring the defense network to other trackers, it exhibits reliable transferability. Finally, DuaLossDef achieves a processing time of up to 5ms/frame, allowing seamless integration with existing high-speed trackers without introducing significant computational overhead. We will make our code publicly available soon.


title: Null Infinity as a Weakly Isolated Horizon

abstract: Null infinity (Scri) arises as a boundary of the Penrose conformal completion of an asymptotically flat physical space-time. We first note that Scri is a weakly isolated horizon (WIH), and then show that its familiar properties can be derived from the general WIH framework. This seems quite surprising because physics associated with black hole (and cosmological) WIHs is very different from that extracted at Scri. We show that these differences can be directly traced back to the fact that Scri is a WIH in the conformal completion rather than the physical space-time. In particular, the BMS group at Scri stems from the symmetry group of WIHs. We also introduce a unified procedure to arrive at fluxes and charges associated with the BMS symmetries at Scri and those associated with black hole (and cosmological) horizons. This procedure differs from those commonly used in the literature and its novel elements seem interesting in their own right. The fact that is there is a single mathematical framework underlying black hole (and cosmological) horizons and Scri paves the way to explore the relation between horizon dynamics in the strong field region and waveforms at infinity. It should also be useful in the analysis of black hole evaporation in quantum gravity.


title: Imagine, Initialize, and Explore: An Effective Exploration Method in Multi-Agent Reinforcement Learning

abstract: Effective exploration is crucial to discovering optimal strategies for multi-agent reinforcement learning (MARL) in complex coordination tasks. Existing methods mainly utilize intrinsic rewards to enable committed exploration or use role-based learning for decomposing joint action spaces instead of directly conducting a collective search in the entire action-observation space. However, they often face challenges obtaining specific joint action sequences to reach successful states in long-horizon tasks. To address this limitation, we propose Imagine, Initialize, and Explore (IIE), a novel method that offers a promising solution for efficient multi-agent exploration in complex scenarios. IIE employs a transformer model to imagine how the agents reach a critical state that can influence each other's transition functions. Then, we initialize the environment at this state using a simulator before the exploration phase. We formulate the imagination as a sequence modeling problem, where the states, observations, prompts, actions, and rewards are predicted autoregressively. The prompt consists of timestep-to-go, return-to-go, influence value, and one-shot demonstration, specifying the desired state and trajectory as well as guiding the action generation. By initializing agents at the critical states, IIE significantly increases the likelihood of discovering potentially important under-explored regions. Despite its simplicity, empirical results demonstrate that our method outperforms multi-agent exploration baselines on the StarCraft Multi-Agent Challenge (SMAC) and SMACv2 environments. Particularly, IIE shows improved performance in the sparse-reward SMAC tasks and produces more effective curricula over the initialized states than other generative methods, such as CVAE-GAN and diffusion models.


title: Ensemble Methodology:Innovations in Credit Default Prediction Using LightGBM, XGBoost, and LocalEnsemble

abstract: In the realm of consumer lending, accurate credit default prediction stands as a critical element in risk mitigation and lending decision optimization. Extensive research has sought continuous improvement in existing models to enhance customer experiences and ensure the sound economic functioning of lending institutions. This study responds to the evolving landscape of credit default prediction, challenging conventional models and introducing innovative approaches. By building upon foundational research and recent innovations, our work aims to redefine the standards of accuracy in credit default prediction, setting a new benchmark for the industry. To overcome these challenges, we present an Ensemble Methods framework comprising LightGBM, XGBoost, and LocalEnsemble modules, each making unique contributions to amplify diversity and improve generalization. By utilizing distinct feature sets, our methodology directly tackles limitations identified in previous studies, with the overarching goal of establishing a novel standard for credit default prediction accuracy. Our experimental findings validate the effectiveness of the ensemble model on the dataset, signifying substantial contributions to the field. This innovative approach not only addresses existing obstacles but also sets a precedent for advancing the accuracy and robustness of credit default prediction models.


title: Emergence of Large-Scale Structures in Holographic Superfluid Turbulence

abstract: In two-dimensional turbulence systems, the emergence of large-scale structures holds profound physical implications, particularly as it indicates the occurrence of inverse energy cascades, thereby garnering significant attention. In this paper, we report a novel vortex clusters formation in the background of near-extreme Reissner-Nordstr$\ddot{o}$m black hole holographic model. At temperatures nearing absolute zero, we observe not only the formation of vortex clusters but also the emergence of an inverse energy cascade. Distinct from typical quantum systems, the genesis of holographic vortex clusters is rooted in unique quantum dissipation properties, characterized by the near immobilization of vortex dipoles at low temperatures. Through a comparative analysis with the dynamics of the Gross-Pitaevskii equation, our investigation enhances the understanding of inverse energy cascades under these extreme conditions, thereby broadening our comprehension of quantum turbulence.


title: Dynamic laser ablation loading of a linear Paul trap

abstract: We present a detailed method for accumulating Ca$^{+}$ ions controllably in a linear Paul trap. The ions are generated by pulsed laser ablation and dynamically loaded into the ion trap by switching the trapping potential on and off. The loaded ions are precooled by buffer gas and then laser-cooled to form Coulomb crystals for verifying quantity. The number of ions is controlled by manipulating the trapping potential of the ion trap, partial pressure of buffer gas and turn-on time of the entrance end cap voltage. With single-pulse laser ablation, the number of trapped ions ranges from tens to ten thousand. The kinetic energy of loaded ions can be selected via the optimal turn-on time of the entrance end cap. Using multiple-pulse laser ablation, the number is further increased and reaches about $4 \times 10^{4}$. The dynamic loading method has wide application for accumulating low-yielding ions via laser ablation in the ion trap.


title: Collaborative decoding of critical tokens for boosting factuality of large language models

abstract: The most common training pipeline for large language models includes pretraining, finetuning and aligning phases, with their respective resulting models, such as the pretrained model and the finetuned model. Finetuned and aligned models show improved abilities of instruction following and safe generation, however their abilities to stay factual about the world are impacted by the finetuning process. Furthermore, the common practice of using sampling during generation also increases chances of hallucination. In this work, we introduce a collaborative decoding framework to harness the high factuality within pretrained models through the concept of critical tokens. We first design a critical token classifier to decide which model to use for the next token, and subsequently generates the next token using different decoding strategies. Experiments with different models and datasets show that our decoding framework is able to reduce model hallucination significantly, showcasing the importance of the collaborative decoding framework.


title: M3-VRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding

abstract: This paper presents a groundbreaking multimodal, multi-task, multi-teacher joint-grained knowledge distillation model for visually-rich form document understanding. The model is designed to leverage insights from both fine-grained and coarse-grained levels by facilitating a nuanced correlation between token and entity representations, addressing the complexities inherent in form documents. Additionally, we introduce new inter-grained and cross-grained loss functions to further refine diverse multi-teacher knowledge distillation transfer process, presenting distribution gaps and a harmonised understanding of form documents. Through a comprehensive evaluation across publicly available form document understanding datasets, our proposed model consistently outperforms existing baselines, showcasing its efficacy in handling the intricate structures and content of visually complex form documents.


title: Sampling low-fidelity outputs for estimation of high-fidelity density and its tails

abstract: In a multifidelity setting, data are available under the same conditions from two (or more) sources, e.g. computer codes, one being lower-fidelity but computationally cheaper, and the other higher-fidelity and more expensive. This work studies for which low-fidelity outputs, one should obtain high-fidelity outputs, if the goal is to estimate the probability density function of the latter, especially when it comes to the distribution tails and extremes. It is suggested to approach this problem from the perspective of the importance sampling of low-fidelity outputs according to some proposal distribution, combined with special considerations for the distribution tails based on extreme value theory. The notion of an optimal proposal distribution is introduced and investigated, in both theory and simulations. The approach is motivated and illustrated with an application to estimate the probability density function of record extremes of ship motions, obtained through two computer codes of different fidelities.


title: FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization

abstract: Large language models (LLMs) have demonstrated state-of-the-art performance across various tasks. However, the latency of inference and the large GPU memory consumption of LLMs restrict their deployment performance. Recently, there have been some efficient attempts to quantize LLMs, yet inference with large batch size or long sequence still has the issue of being compute-bound. Fine-grained quantization methods have showcased their proficiency in achieving low-bit quantization for LLMs, while requiring FP16 data type for linear layer computations, which is time-consuming when dealing with large batch size or long sequence. In this paper, we introduce a method called FlattenQuant, which significantly reduces the maximum value of the tensor by flattening the large channels in the tensor, to achieve low bit per-tensor quantization with minimal accuracy loss. Our experiments show that FlattenQuant can directly use 4 bits to achieve 48.29% of the linear layer calculation in LLMs, with the remaining layers using 8 bits. The 4-bit matrix multiplication introduced in the FlattenQuant method can effectively address the compute-bound caused by large matrix calculation. Our work achieves up to 2$\times$ speedup and 2.3$\times$ memory reduction for LLMs with negligible loss in accuracy.


title: PolyOculus: Simultaneous Multi-view Image-based Novel View Synthesis

abstract: This paper considers the problem of generative novel view synthesis (GNVS), generating novel, plausible views of a scene given a limited number of known views. Here, we propose a set-based generative model that can simultaneously generate multiple, self-consistent new views, conditioned on any number of views. Our approach is not limited to generating a single image at a time and can condition on a variable number of views. As a result, when generating a large number of views, our method is not restricted to a low-order autoregressive generation approach and is better able to maintain generated image quality over large sets of images. We evaluate our model on standard NVS datasets and show that it outperforms the state-of-the-art image-based GNVS baselines. Further, we show that the model is capable of generating sets of views that have no natural sequential ordering, like loops and binocular trajectories, and significantly outperforms other methods on such tasks.