title: Mining Weighted Sequential Patterns in Incremental Uncertain Databases

abstract: Due to the rapid development of science and technology, the importance of imprecise, noisy, and uncertain data is increasing at an exponential rate. Thus, mining patterns in uncertain databases have drawn the attention of researchers. Moreover, frequent sequences of items from these databases need to be discovered for meaningful knowledge with great impact. In many real cases, weights of items and patterns are introduced to find interesting sequences as a measure of importance. Hence, a constraint of weight needs to be handled while mining sequential patterns. Besides, due to the dynamic nature of databases, mining important information has become more challenging. Instead of mining patterns from scratch after each increment, incremental mining algorithms utilize previously mined information to update the result immediately. Several algorithms exist to mine frequent patterns and weighted sequences from incremental databases. However, these algorithms are confined to mine the precise ones. Therefore, we have developed an algorithm to mine frequent sequences in an uncertain database in this work. Furthermore, we have proposed two new techniques for mining when the database is incremental. Extensive experiments have been conducted for performance evaluation. The analysis showed the efficiency of our proposed framework.


title: Baryon acoustic scale at $z_{\eff} = 0.166$ with the SDSS blue galaxies

abstract: The Baryon Acoustic Oscillations (BAO) phenomenon provides a unique opportunity to establish a standard ruler at any epoch in the history of the evolving universe. The key lies in identifying a suitable cosmological tracer to conduct the measurement. In this study, we focus on quantifying the sound horizon scale of BAO in the Local Universe. Our chosen cosmological tracer is a sample of blue galaxies from the SDSS survey, positioned at the effective redshift $z_{{\eff}} = 0.166$. Utilizing Planck-CMB input values for redshift-to-distance conversion, we derive the BAO scale $s_{\scalebox{0.65}{\rm BAO}} = 100.28 ^{+10.79} _{-22.96}$ Mpc$/h$ at the 1$\sigma$ confidence level. Subsequently, we extrapolate the BAO signal scale in redshift space: $\Delta z_{\scalebox{0.6}{\rm BAO}}(z_{\rm eff}=0.166)=0.0361^{+0.00262}_ {-0.0055}$. This measurement holds the potential to discriminate among dark energy models within the Local Universe. To validate the robustness of our methodology for BAO scale measurement, we conduct three additional BAO analyses using different cosmographic approaches for distance calculation from redshifts. These tests aim to identify possible biases or systematics in our measurements of $s_{\scalebox{0.65}{\rm BAO}}$. Encouragingly, our diverse cosmographic approaches yield results in statistical agreement with the primary measurement, indicating no significant deviations. Conclusively, our study contributes with a novel determination of the BAO scale in the Local Universe, at $z_{{\eff}} = 0.166$, achieved through the analysis of the SDSS blue galaxies cosmic tracer.


title: Benchmark Transparency: Measuring the Impact of Data on Evaluation

abstract: In this paper we present an exploratory research on quantifying the impact that data distribution has on the performance and evaluation of NLP models. We propose an automated framework that measures the data point distribution across 6 different dimensions: ambiguity, difficulty, discriminability, length, noise, and perplexity. We use disproportional stratified sampling to measure how much the data distribution affects absolute (Acc/F1) and relative (Rank) model performance. We experiment on 2 different datasets (SQUAD and MNLI) and test a total of 135 different models (125 on SQUAD and 10 on MNLI). We demonstrate that without explicit control of the data distribution, standard evaluation frameworks are inconsistent and unreliable. We find that the impact of the data is statistically significant and is often larger than the impact of changing the metric. In a second set of experiments, we demonstrate that the impact of data on evaluation is not just observable, but also predictable. We propose to use benchmark transparency as a method for comparing datasets and quantifying the similarity between them. We find that the ``dataset similarity vector'' can be used to predict how well a model generalizes out of distribution.


title: Causal dependencies and Shannon entropy budget -- Analysis of a reduced order atmospheric model

abstract: The information entropy budget and the rate of information transfer between variables is studied in the context of a nonlinear reduced-order atmospheric model. The key ingredients of the dynamics are present in this model, namely the baroclinic and barotropic instabilities, the instability related to the presence of an orography, the dissipation related to the surface friction, and the large-scale meridional imbalance of energy. For the parameter chosen, the solutions of this system display a chaotic dynamics reminiscent of the large-scale atmospheric dynamics in the extra-tropics. The detailed information entropy budget analysis of this system reveals that the linear rotation terms plays a minor role in the generation of uncertainties as compared to the orography and the surface friction. Additionally, the dominant contribution comes from the nonlinear advection terms, and their decomposition in synergetic (co-variability) and single (impact of each single variable on the target one) components reveals that for some variables the co-variability dominates the information transfer. The estimation of the rate of information transfer based on time series is also discussed, and an extension of the Liang's approach to nonlinear observables, is proposed.


title: Can Language Models Recognize Convincing Arguments?

abstract: The remarkable and ever-increasing capabilities of Large Language Models (LLMs) have raised concerns about their potential misuse for creating personalized, convincing misinformation and propaganda. To gain insights into LLMs' persuasive capabilities without directly engaging in experimentation with humans, we propose studying their performance on the related task of detecting convincing arguments. We extend a dataset by Durmus & Cardie (2018) with debates, votes, and user traits and propose tasks measuring LLMs' ability to (1) distinguish between strong and weak arguments, (2) predict stances based on beliefs and demographic characteristics, and (3) determine the appeal of an argument to an individual based on their traits. We show that LLMs perform on par with humans in these tasks and that combining predictions from different LLMs yields significant performance gains, even surpassing human performance. The data and code released with this paper contribute to the crucial ongoing effort of continuously evaluating and monitoring the rapidly evolving capabilities and potential impact of LLMs.


title: C-XGBoost: A tree boosting model for causal effect estimation

abstract: Causal effect estimation aims at estimating the Average Treatment Effect as well as the Conditional Average Treatment Effect of a treatment to an outcome from the available data. This knowledge is important in many safety-critical domains, where it often needs to be extracted from observational data. In this work, we propose a new causal inference model, named C-XGBoost, for the prediction of potential outcomes. The motivation of our approach is to exploit the superiority of tree-based models for handling tabular data together with the notable property of causal inference neural network-based models to learn representations that are useful for estimating the outcome for both the treatment and non-treatment cases. The proposed model also inherits the considerable advantages of XGBoost model such as efficiently handling features with missing values requiring minimum preprocessing effort, as well as it is equipped with regularization techniques to avoid overfitting/bias. Furthermore, we propose a new loss function for efficiently training the proposed causal inference model. The experimental analysis, which is based on the performance profiles of Dolan and Mor{\'e} as well as on post-hoc and non-parametric statistical tests, provide strong evidence about the effectiveness of the proposed approach.


title: On the True Distribution Approximation of Minimum Bayes-Risk Decoding

abstract: Minimum Bayes-risk (MBR) decoding has recently gained renewed attention in text generation. MBR decoding considers texts sampled from a model as pseudo-references and selects the text with the highest similarity to the others. Therefore, sampling is one of the key elements of MBR decoding, and previous studies reported that the performance varies by sampling methods. From a theoretical standpoint, this performance variation is likely tied to how closely the samples approximate the true distribution of references. However, this approximation has not been the subject of in-depth study. In this study, we propose using anomaly detection to measure the degree of approximation. We first closely examine the performance variation and then show that previous hypotheses about samples do not correlate well with the variation, but our introduced anomaly scores do. The results are the first to empirically support the link between the performance and the core assumption of MBR decoding.


title: A compromise criterion for weighted least squares estimates

abstract: When independent errors in a linear model have non-identity covariance, the ordinary least squares estimate of the model coefficients is less efficient than the weighted least squares estimate. However, the practical application of weighted least squares is challenging due to its reliance on the unknown error covariance matrix. Although feasible weighted least squares estimates, which use an approximation of this matrix, often outperform the ordinary least squares estimate in terms of efficiency, this is not always the case. In some situations, feasible weighted least squares can be less efficient than ordinary least squares. The comparison between these two estimates has significant implications for the application of regression analysis in varied fields, yet such a comparison remains an unresolved challenge despite its seemingly straightforward nature. In this study, we directly address this challenge by identifying the conditions under which feasible weighted least squares estimates using fixed weights demonstrate greater efficiency than the ordinary least squares estimate. These conditions provide guidance for the design of feasible estimates using random weights. They also shed light on how certain robust regression estimates behave with respect to the linear model with normal errors of unequal variance.


title: Imitation dynamics and the replicator equation

abstract: Evolutionary game theory has impacted many fields of research by providing a mathematical framework for studying the evolution and maintenance of social and moral behaviors. This success is owed in large part to the demonstration that the central equation of this theory - the replicator equation - is the deterministic limit of a stochastic imitation (social learning) dynamics. Here we offer an alternative elementary proof of this result, which holds for the scenario where players compare their instantaneous (not average) payoffs to decide whether to maintain or change their strategies, and only more successful individuals can be imitated.


title: Stationary solutions to the relativistic BGK model for gas mixtures in a slab

abstract: In a recent paper [16], the authors proposed a BGK model for relativistic gas mixtures based on the Marle-type approximation, which satisfies the fundamental kinetic properties: non-negativity of distribution functions, conservation laws, H-theorem, and indifferentiability principle. In this paper, we are concerned with the stationary problems to the relativistic BGK model for gas mixtures in slab geometry. We establish the existence of a unique mild solution with the fixed inflow boundary data when the collision frequencies for each species are sufficiently small.


title: Recover: A Neuro-Symbolic Framework for Failure Detection and Recovery

abstract: Recognizing failures during task execution and implementing recovery procedures is challenging in robotics. Traditional approaches rely on the availability of extensive data or a tight set of constraints, while more recent approaches leverage large language models (LLMs) to verify task steps and replan accordingly. However, these methods often operate offline, necessitating scene resets and incurring in high costs. This paper introduces Recover, a neuro-symbolic framework for online failure identification and recovery. By integrating ontologies, logical rules, and LLM-based planners, Recover exploits symbolic information to enhance the ability of LLMs to generate recovery plans and also to decrease the associated costs. In order to demonstrate the capabilities of our method in a simulated kitchen environment, we introduce OntoThor, an ontology describing the AI2Thor simulator setting. Empirical evaluation shows that OntoThor's logical rules accurately detect all failures in the analyzed tasks, and that Recover considerably outperforms, for both failure detection and recovery, a baseline method reliant solely on LLMs.


title: Nonpositively curved surfaces are Loewner

abstract: We show that every closed nonpositively curved surface satisfies Loewner's systolic inequality. The proof relies on a combination of the Gauss-Bonnet formula with an averaging argument using the invariance of the Liouville measure under the geodesic flow. This enables us to find a disk with large total curvature around its center yielding a large area.


title: From Robustness to Improved Generalization and Calibration in Pre-trained Language Models

abstract: Enhancing generalization and uncertainty quantification in pre-trained language models (PLMs) is crucial for their effectiveness and reliability. Building on machine learning research that established the importance of robustness for improving generalization, we investigate the role of representation smoothness, achieved via Jacobian and Hessian regularization, in enhancing PLM performance. Although such regularization methods have proven effective in computer vision, their application in natural language processing (NLP), where PLM inputs are derived from a discrete domain, poses unique challenges. We introduce a novel two-phase regularization approach, JacHess, which minimizes the norms of the Jacobian and Hessian matrices within PLM intermediate representations relative to their inputs. Our evaluation using the GLUE benchmark demonstrates that JacHess significantly improves in-domain generalization and calibration in PLMs, outperforming unregularized fine-tuning and other similar regularization methods.


title: Some geometric consequences of the symmetric reduction

abstract: In this article, we derived some consequences to the symmetrization process developed in \cite{Deng23}. This consists a geometric derivation of part of the properties which uniquely determines the Kazhdan-Lusztig polynomials of type $A_n$ as well as an interpretations of the last property by the decomposition theorem of \cite{BBD}. Finally, the relation of geometry of graded nilpotent classes to Parabolic Kazhdan-Lusztig polynomials is discussed for the purpose of later applications to Zelevinsky's derivatives.


title: Modularity for $\mathcal{W}$-algebras and affine Springer fibres

abstract: We construct a bijection between admissible representations for an affine Lie algebra $\mathfrak{g}$ at boundary admissible levels and $\mathbb{C}^\times$ fixed points in homogeneous elliptic affine Springer fibres for the Langlands dual affine Lie algebra $\mathfrak{g}^\vee$. Using this bijection, we relate the modularity of the characters of admissible representations to Cherednik's Verlinde algebra construction coming from double affine Hecke algebras. Finally, we show that the expected behaviors of simple modules under quantized Drinfeld-Sokolov reductions are compatible with the reductions from affine Springer fibres to affine Spaltenstein varieties. This yields (modulo some conjectures) a similar bijection for irreducible representations of $\mathcal{W}$-algebras, as well as an interpretation for their modularity properties.


title: Cosmological singularities, holographic complexity and entanglement

abstract: We study holographic volume complexity for various families of holographic cosmologies with Kasner-like singularities, in particular with $AdS$, hyperscaling violating and Lifshitz asymptotics. We find through extensive numerical studies that the complexity surface always bends in the direction away from the singularity and transitions from spacelike near the boundary to lightlike in the interior. As the boundary anchoring time slice approaches the singularity, the transition to lightlike is more rapid, with the spacelike part shrinking. The complexity functional has vanishing contributions from the lightlike region so in the vicinity of the singularity, complexity is vanishingly small, indicating a dual Kasner state of vanishingly low complexity, suggesting an extreme thinning of the effective degrees of freedom dual to the near singularity region. We also develop further previous studies on extremal surfaces for holographic entanglement entropy, and find that in the IR limit they reveal similar behaviour as complexity.


title: Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verification

abstract: Formal verification provides a rigorous and systematic approach to ensure the correctness and reliability of software systems. Yet, constructing specifications for the full proof relies on domain expertise and non-trivial manpower. In view of such needs, an automated approach for specification synthesis is desired. While existing automated approaches are limited in their versatility, i.e., they either focus only on synthesizing loop invariants for numerical programs, or are tailored for specific types of programs or invariants. Programs involving multiple complicated data types (e.g., arrays, pointers) and code structures (e.g., nested loops, function calls) are often beyond their capabilities. To help bridge this gap, we present AutoSpec, an automated approach to synthesize specifications for automated program verification. It overcomes the shortcomings of existing work in specification versatility, synthesizing satisfiable and adequate specifications for full proof. It is driven by static analysis and program verification, and is empowered by large language models (LLMs). AutoSpec addresses the practical challenges in three ways: (1) driving \name by static analysis and program verification, LLMs serve as generators to generate candidate specifications, (2) programs are decomposed to direct the attention of LLMs, and (3) candidate specifications are validated in each round to avoid error accumulation during the interaction with LLMs. In this way, AutoSpec can incrementally and iteratively generate satisfiable and adequate specifications. The evaluation shows its effectiveness and usefulness, as it outperforms existing works by successfully verifying 79% of programs through automatic specification synthesis, a significant improvement of 1.592x. It can also be successfully applied to verify the programs in a real-world X509-parser project.


title: Communicating Multiverses in Holographic de-Sitter Braneworld

abstract: In this paper, we construct the wedge holography for the de-Sitter space as a bulk theory. First, we discuss a more general mathematical construction of wedge holography in parallel with wedge holography construction for the AdS bulk, and then we construct the wedge holography in the extended static patch. In the first case, we prove that one can construct wedge holography for the de-Sitter bulk for the static patch as well as global coordinate metric on end-of-the-world branes. Extended static patch wedge holography is constructed by joining the two copies of double holography in DS/dS correspondence. We find that wedge holography with extended static patch metric leads to the emergence of communicating universes. Further, we propose a model which provides the theoretical evidence of communicating multiverses.


title: Sparse Recovery: The Square of $\ell_1/\ell_2$ Norms

abstract: This paper introduces a nonconvex approach to the problem of recovering sparse signals. We propose a novel model, termed the $\tau_2$-model, which utilizes the square of $\ell_1/\ell_2$ norms for sparse recovery. This model is an advancement over the $\ell_0$ norm, which is often computationally intractable and less effective in handling practical scenarios. Our approach is grounded in the concept of effective sparsity, which robustly measures the number of effective coordinates in a signal. We demonstrate that our model is a powerful alternative for sparse signal estimation, with the $\tau_2$-model offering computational advantages and practical applicability. The model's formulation and the accompanying algorithm, based on Dinkelbach's procedure combined with a difference of convex functions strategy, are detailed. We further explore the properties of our model, including the existence of solutions under certain conditions, and discuss the algorithm's convergence properties. Numerical experiments with various sensing matrices are conducted to validate the effectiveness of our model.


title: Convex Network Flows

abstract: We introduce a general framework for flow problems over hypergraphs. In our problem formulation, which we call the convex flow problem, we have a concave utility function for the net flow at every node and a concave utility function for each edge flow. The objective is to maximize the sum of these utilities, subject to constraints on the flows allowed at each edge, which we only assume to be a convex set. This framework not only includes many classic problems in network optimization, such as max flow, min-cost flow, and multi-commodity flows, but also generalizes these problems to allow, for example, concave edge gain functions. In addition, our framework includes applications spanning a number of fields: optimal power flow over lossy networks, routing and resource allocation in ad-hoc wireless networks, Arrow-Debreu Nash bargaining, and order routing through financial exchanges, among others. We show that the convex flow problem has a dual with a number of interesting interpretations, and that this dual decomposes over the edges of the hypergraph. Using this decomposition, we propose a fast solution algorithm that parallelizes over the edges and admits a clean problem interface. We provide an open source implementation of this algorithm in the Julia programming language, which we show is significantly faster than the state-of-the-art commercial convex solver Mosek.


title: SoK: The Faults in our Graph Benchmarks

abstract: Graph-structured data is prevalent in domains such as social networks, financial transactions, brain networks, and protein interactions. As a result, the research community has produced new databases and analytics engines to process such data. Unfortunately, there is not yet widespread benchmark standardization in graph processing, and the heterogeneity of evaluations found in the literature can lead researchers astray. Evaluations frequently ignore datasets' statistical idiosyncrasies, which significantly affect system performance. Scalability studies often use datasets that fit easily in memory on a modest desktop. Some studies rely on synthetic graph generators, but these generators produce graphs with unnatural characteristics that also affect performance, producing misleading results. Currently, the community has no consistent and principled manner with which to compare systems and provide guidance to developers who wish to select the system most suited to their application. We provide three different systematizations of benchmarking practices. First, we present a 12-year literary review of graph processing benchmarking, including a summary of the prevalence of specific datasets and benchmarks used in these papers. Second, we demonstrate the impact of two statistical properties of datasets that drastically affect benchmark performance. We show how different assignments of IDs to vertices, called vertex orderings, dramatically alter benchmark performance due to the caching behavior they induce. We also show the impact of zero-degree vertices on the runtime of benchmarks such as breadth-first search and single-source shortest path. We show that these issues can cause performance to change by as much as 38% on several popular graph processing systems. Finally, we suggest best practices to account for these issues when evaluating graph systems.


title: Intensity-based 3D motion correction for cardiac MR images

abstract: Cardiac magnetic resonance (CMR) image acquisition requires subjects to hold their breath while 2D cine images are acquired. This process assumes that the heart remains in the same position across all slices. However, differences in breathhold positions or patient motion introduce 3D slice misalignments. In this work, we propose an algorithm that simultaneously aligns all SA and LA slices by maximizing the pair-wise intensity agreement between their intersections. Unlike previous works, our approach is formulated as a subject-specific optimization problem and requires no prior knowledge of the underlying anatomy. We quantitatively demonstrate that the proposed method is robust against a large range of rotations and translations by synthetically misaligning 10 motion-free datasets and aligning them back using the proposed method.


title: Adversarially-Robust Inference on Trees via Belief Propagation

abstract: We introduce and study the problem of posterior inference on tree-structured graphical models in the presence of a malicious adversary who can corrupt some observed nodes. In the well-studied broadcasting on trees model, corresponding to the ferromagnetic Ising model on a $d$-regular tree with zero external field, when a natural signal-to-noise ratio exceeds one (the celebrated Kesten-Stigum threshold), the posterior distribution of the root given the leaves is bounded away from $\mathrm{Ber}(1/2)$, and carries nontrivial information about the sign of the root. This posterior distribution can be computed exactly via dynamic programming, also known as belief propagation. We first confirm a folklore belief that a malicious adversary who can corrupt an inverse-polynomial fraction of the leaves of their choosing makes this inference impossible. Our main result is that accurate posterior inference about the root vertex given the leaves is possible when the adversary is constrained to make corruptions at a $\rho$-fraction of randomly-chosen leaf vertices, so long as the signal-to-noise ratio exceeds $O(\log d)$ and $\rho \leq c \varepsilon$ for some universal $c > 0$. Since inference becomes information-theoretically impossible when $\rho \gg \varepsilon$, this amounts to an information-theoretically optimal fraction of corruptions, up to a constant multiplicative factor. Furthermore, we show that the canonical belief propagation algorithm performs this inference.


title: An Active Perception Game for Robust Autonomous Exploration

abstract: We formulate active perception for an autonomous agent that explores an unknown environment as a two-player zero-sum game: the agent aims to maximize information gained from the environment while the environment aims to minimize the information gained by the agent. In each episode, the environment reveals a set of actions with their potentially erroneous information gain. In order to select the best action, the robot needs to recover the true information gain from the erroneous one. The robot does so by minimizing the discrepancy between its estimate of information gain and the true information gain it observes after taking the action. We propose an online convex optimization algorithm that achieves sub-linear expected regret $O(T^{3/4})$ for estimating the information gain. We also provide a bound on the regret of active perception performed by any (near-)optimal prediction and trajectory selection algorithms. We evaluate this approach using semantic neural radiance fields (NeRFs) in simulated realistic 3D environments to show that the robot can discover up to 12% more objects using the improved estimate of the information gain. On the M3ED dataset, the proposed algorithm reduced the error of information gain prediction in occupancy map by over 67%. In real-world experiments using occupancy maps on a Jackal ground robot, we show that this approach can calculate complicated trajectories that efficiently explore all occluded regions.


title: Low-loss liquid metal interconnects for modular superconducting quantum systems

abstract: Building modular architecture with superconducting quantum computing chips is one of the means to achieve qubit scalability, allowing the screening, selection, replacement, and integration of individual qubit modules into large quantum systems. However, the non-destructive replacement of modules within a compact architecture remains a challenge. Liquid metals (LM), specifically gallium alloys, can be alternatives to solid-state galvanic interconnects. This is motivated by their self-healing, self-aligning, and other desirable fluidic properties, potentially enabling non-destructive replacement of modules at room temperatures, even after operating the entire system at millikelvin regimes. In this study, we present high-internal-quality-factor coplanar waveguide resonators (CPWR) interconnected by gallium alloy droplets, demonstrating performance on par with the continuous solid-state CPWRs. Leveraging the desirable fluidic properties of gallium alloys at room temperature and their compact design, we envision a modular quantum system enabled by liquid metals.


title: Metric dimensions of generalized Sierpi\'{n}ski graphs over squares

abstract: Metric dimension is a valuable parameter that helps address problems related to network design, localization, and information retrieval by identifying the minimum number of landmarks required to uniquely determine distances between vertices in a graph. Generalized Sierpi\'{n}ski graphs represent a captivating class of fractal-inspired networks that have gained prominence in various scientific disciplines and practical applications. Their fractal nature has also found relevance in antenna design, image compression, and the study of porous materials. The hypercube is a prevalent interconnection network architecture known for its symmetry, vertex transitivity, regularity, recursive structure, high connectedness, and simple routing. Various variations of hypercubes have emerged in literature to meet the demands of practical applications. Sometimes, they are the spanning subgraphs of it. This study examines the generalized Sierpi\'{n}ski graphs over $C_4$, which are spanning subgraphs of hypercubes and determines the metric dimension and their variants. This is in contrast to hypercubes, where these properties are inherently complicated. Along the way, the role of twin vertices in the theory of metric dimensions is further elaborated.


title: One Stone, Two Birds: Using Vapor Kinetic Energy to Detect and Understand Atmospheric Rivers

abstract: Poleward water vapor transport in the midlatitudes mainly occurs in meandering filaments of intense water vapor transport, spanning thousands of kilometers long and hundreds of kilometers wide and drifting eastward. The water vapor filaments are known as atmospheric rivers (ARs). They can cause extreme wind gusts, intense precipitation, and flooding along densely populated coastal regions. Many recent studies about ARs focused on the statistical analyses of ARs, but a process-level understanding of ARs remains elusive. Here we show that ARs are streams of air with enhanced vapor kinetic energy (VKE) and derive a governing equation for Integrated VKE (IVKE) to understand what contributes to the evolution of ARs. We find that ARs grow mainly because of potential energy conversion to kinetic energy, decay largely owing to condensation and turbulence, and the eastward drift is primarily due to horizontal advection of VKE. Our VKE framework complements the integrated vapor transport framework, which is popular for identifying ARs but lacks a prognostic equation for understanding the physical processes.


title: Half-sided Translations and the Information Recovery from Radiation

abstract: The island paradigm asserts that after the Page time the operators in the interior of an AdS2 eternal black hole in equilibrium with a finite temperature non-gravitating bath can not be reconstructed using the operators in the black hole region outside the horizon. In a recent paper, we demonstrated this using the black hole interior reconstruction proposal due to Leutheusser and Liu, based on the half-sided translations. This was done by introducing a notion of the reduced half-sided translations associated with the algebra of operators restricted to the black hole region outside the horizon, and by showing that albeit the reduced half-sided translations translate operators in the black hole region outside the horizon to the black hole interior before the Page time, it fails to do so after the Page time. In this paper, we demonstrate the second assertion of the island paradigm, which states that after the Page time the operators in the black hole interior can be reconstructed using the operators in the bath. We show that even though before the Page time the reduced half-sided translations associated with the algebra of operators restricted to the bath do not translate operators in the bath to the black hole interior, after the Page time they take them to the black hole interior.


title: SOAR: Improved Indexing for Approximate Nearest Neighbor Search

abstract: This paper introduces SOAR: Spilling with Orthogonality-Amplified Residuals, a novel data indexing technique for approximate nearest neighbor (ANN) search. SOAR extends upon previous approaches to ANN search, such as spill trees, that utilize multiple redundant representations while partitioning the data to reduce the probability of missing a nearest neighbor during search. Rather than training and computing these redundant representations independently, however, SOAR uses an orthogonality-amplified residual loss, which optimizes each representation to compensate for cases where other representations perform poorly. This drastically improves the overall index quality, resulting in state-of-the-art ANN benchmark performance while maintaining fast indexing times and low memory consumption.


title: Measuring audio prompt adherence with distribution-based embedding distances

abstract: An increasing number of generative music models can be conditioned on an audio prompt that serves as musical context for which the model is to create an accompaniment (often further specified using a text prompt). Evaluation of how well model outputs adhere to the audio prompt is often done in a model or problem specific manner, presumably because no generic evaluation method for audio prompt adherence has emerged. Such a method could be useful both in the development and training of new models, and to make performance comparable across models. In this paper we investigate whether commonly used distribution-based distances like Fr\'echet Audio Distance (FAD), can be used to measure audio prompt adherence. We propose a simple procedure based on a small number of constituents (an embedding model, a projection, an embedding distance, and a data fusion method), that we systematically assess using a baseline validation. In a follow-up experiment we test the sensitivity of the proposed audio adherence measure to pitch and time shift perturbations. The results show that the proposed measure is sensitive to such perturbations, even when the reference and candidate distributions are from different music collections. Although more experimentation is needed to answer unaddressed questions like the robustness of the measure to acoustic artifacts that do not affect the audio prompt adherence, the current results suggest that distribution-based embedding distances provide a viable way of measuring audio prompt adherence. An python/pytorch implementation of the proposed measure is publicly available as a github repository.


title: PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learning

abstract: We present PyTorch Frame, a PyTorch-based framework for deep learning over multi-modal tabular data. PyTorch Frame makes tabular deep learning easy by providing a PyTorch-based data structure to handle complex tabular data, introducing a model abstraction to enable modular implementation of tabular models, and allowing external foundation models to be incorporated to handle complex columns (e.g., LLMs for text columns). We demonstrate the usefulness of PyTorch Frame by implementing diverse tabular models in a modular way, successfully applying these models to complex multi-modal tabular data, and integrating our framework with PyTorch Geometric, a PyTorch library for Graph Neural Networks (GNNs), to perform end-to-end learning over relational databases.


title: Privacy-preserving Optics for Enhancing Protection in Face De-identification

abstract: The modern surge in camera usage alongside widespread computer vision technology applications poses significant privacy and security concerns. Current artificial intelligence (AI) technologies aid in recognizing relevant events and assisting in daily tasks in homes, offices, hospitals, etc. The need to access or process personal information for these purposes raises privacy concerns. While software-level solutions like face de-identification provide a good privacy/utility trade-off, they present vulnerabilities to sniffing attacks. In this paper, we propose a hardware-level face de-identification method to solve this vulnerability. Specifically, our approach first learns an optical encoder along with a regression model to obtain a face heatmap while hiding the face identity from the source image. We also propose an anonymization framework that generates a new face using the privacy-preserving image, face heatmap, and a reference face image from a public dataset as input. We validate our approach with extensive simulations and hardware experiments.


title: Coset constructions and Kac-Wakimoto Hypothesis

abstract: Categorical coset constructions are investigated and Kac-Wakimoto Hypothesis associated with pseudo unitary modular tensor categories is proved. In particular, the field identifications are obtained. These results are applied to the coset constructions in the theory of vertex operator algebra.


title: Charge and spin current pumping by ultrafast demagnetization dynamics

abstract: The surprising discovery of ultrafast demagnetization -- where electric field of femtosecond laser pulse couples to electrons of a ferromagnetic (FM) layer causing its magnetization vector {\em to shrink while not rotating}, is also assumed to be accompanied by generation of spin current in the direction orthogonal to electric field. However, understanding of the microscopic origin of such spin current and how efficiently it can be converted into charge current, as the putative source of THz radiation, is lacking despite nearly three decades of intense studies. Here we connect the standard pumping phenomena driven by microwave precession of magnetization vector replacing periodic time-dependence of magnetization precession with nonperiodic time-dependence of demagnetization, as obtained from experiments on ultrafast-light-driven Ni layer. Applying time-dependent nonequilibrium Green's functions, able to evolve such setup with arbitrary time dependence, reveals how demagnetization dynamics pumps both charge and spin currents in directions both parallel and orthogonal to electric field of laser pulse, even in the absence of spin-orbit coupling and thereby induced spin-to-charge conversion mechanisms. Although pumped currents follow $dM_z/dt$ in some setups, this becomes obscured when NM layers are disconnected and pumped currents start to reflect from FM boundaries (as is the case of experimental setups). Finally, we use the Jefimenko equations to compute electromagnetic radiation by charge current pumped in disconnected setup during demagnetization, or later during its slow recovery, unraveling that radiated electric field only in the former time interval exhibits features in 0.1--30 THz frequency range probed experimentally or explored for applications of spintronic THz emitters.


title: Cooperative Gradient Coding for Collaborative Federated Learning

abstract: We investigate federated learning (FL) in the presence of stragglers, with emphasis on wireless scenarios where the power-constrained edge devices collaboratively train a global model on their local datasets and transmit local model updates through fading channels. To tackle stragglers resulting from link disruptions without requiring accurate prior information on connectivity or dataset sharing, we propose a gradient coding (GC) scheme based on cooperative communication, which remains valid for general collaborative federated learning. Furthermore, we conduct an outage analysis of the proposed scheme, based on which we conduct the convergence analysis. The simulation results reveal the superiority of the proposed strategy in the presence of stragglers, especially under imbalanced data distribution.


title: Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning

abstract: Deep representation learning methods struggle with continual learning, suffering from both catastrophic forgetting of useful units and loss of plasticity, often due to rigid and unuseful units. While many methods address these two issues separately, only a few currently deal with both simultaneously. In this paper, we introduce Utility-based Perturbed Gradient Descent (UPGD) as a novel approach for the continual learning of representations. UPGD combines gradient updates with perturbations, where it applies smaller modifications to more useful units, protecting them from forgetting, and larger modifications to less useful units, rejuvenating their plasticity. We use a challenging streaming learning setup where continual learning problems have hundreds of non-stationarities and unknown task boundaries. We show that many existing methods suffer from at least one of the issues, predominantly manifested by their decreasing accuracy over tasks. On the other hand, UPGD continues to improve performance and surpasses or is competitive with all methods in all problems. Finally, in extended reinforcement learning experiments with PPO, we show that while Adam exhibits a performance drop after initial learning, UPGD avoids it by addressing both continual learning issues.


title: Fixed point theorem for generalized Chatterjea type mappings

abstract: We introduce a new type of mappings in metric space which are three-point analogue of the well-known Chatterjea type mappings, and call them generalized Chatterjea type mappings. It is shown that such mappings can be discontinuous as is the case of Chatterjea type mappings and this new class includes the class of Chatterjea type mappings. The fixed point theorem for generalized Chatterjea type mappings is proven.


title: Potentials of the Metaverse for Robotized Applications in Industry 4.0 and Industry 5.0

abstract: As a digital environment of interconnected virtual ecosystems driven by measured and synthesized data, the Metaverse has so far been mostly considered from its gaming perspective that closely aligns with online edutainment. Although it is still in its infancy and more research as well as standardization efforts remain to be done, the Metaverse could provide considerable advantages for smart robotized applications in the industry.Workflow efficiency, collective decision enrichment even for executives, as well as a natural, resilient, and sustainable robotized assistance for the workforce are potential advantages. Hence, the Metaverse could consolidate the connection between Industry 4.0 and Industry 5.0. This paper identifies and puts forward potential advantages of the Metaverse for robotized applications and highlights how these advantages support goals pursued by the Industry 4.0 and Industry 5.0 visions. Keywords: Robotics, Metaverse, Digital Twin, VR/AR, AI/ML, Foundation Model;


title: Estimating sample paths of Gauss-Markov processes from noisy data

abstract: I derive the pointwise conditional means and variances of an arbitrary Gauss-Markov process, given noisy observations of points on a sample path. These moments depend on the process's mean and covariance functions, and on the conditional moments of the sampled points. I study the Brownian motion and bridge as special cases.


title: Disentangling Hippocampal Shape Variations: A Study of Neurological Disorders Using Graph Variational Autoencoder with Contrastive Learning

abstract: This paper presents a comprehensive study focused on disentangling hippocampal shape variations from diffusion tensor imaging (DTI) datasets within the context of neurological disorders. Leveraging a Graph Variational Autoencoder (VAE) enhanced with Supervised Contrastive Learning, our approach aims to improve interpretability by disentangling two distinct latent variables corresponding to age and the presence of diseases. In our ablation study, we investigate a range of VAE architectures and contrastive loss functions, showcasing the enhanced disentanglement capabilities of our approach. This evaluation uses synthetic 3D torus mesh data and real 3D hippocampal mesh datasets derived from the DTI hippocampal dataset. Our supervised disentanglement model outperforms several state-of-the-art (SOTA) methods like attribute and guided VAEs in terms of disentanglement scores. Our model distinguishes between age groups and disease status in patients with Multiple Sclerosis (MS) using the hippocampus data. Our Graph VAE with Supervised Contrastive Learning shows the volume changes of the hippocampus of MS populations at different ages, and the result is consistent with the current neuroimaging literature. This research provides valuable insights into the relationship between neurological disorder and hippocampal shape changes in different age groups of MS populations using a Graph VAE with Supervised Contrastive loss.


title: There and Back Again: A Netlist's Tale with Much Egraphin'

abstract: EDA toolchains are notoriously unpredictable, incomplete, and error-prone; the generally-accepted remedy has been to re-imagine EDA tasks as compilation problems. However, any compiler framework we apply must be prepared to handle the wide range of EDA tasks, including not only compilation tasks like technology mapping and optimization (the "there"} in our title), but also decompilation tasks like loop rerolling (the "back again"). In this paper, we advocate for equality saturation -- a term rewriting framework -- as the framework of choice when building hardware toolchains. Through a series of case studies, we show how the needs of EDA tasks line up conspicuously well with the features equality saturation provides.


title: Effect of cathode porosity on the Lithium air cell oxygen reduction reaction

abstract: The kinetics of the oxygen reduction reaction (ORR) on the practical air cathode in a Lithium air cell, which is conventionally composed of porous carbon with or without catalysts supported on it, was investigated. The mechanism and kinetics of the oxygen reduction reaction (ORR) was studied on a porous carbon electrode in an oxygen saturated solution of 0.1M Lithium bis-trifluoromethanesulfonimidate (LiTFSI) in Dimethoxyethane (DME) using cyclic voltammetery (CV) and the rotating ring-disk electrode (RRDE) technique. The oxygen reduction and evolution reactions were found to occur at similar potentials to those observed on a smooth, planar glassy carbon (GC) electrode. The effect of the porosity and the resultant increase in surface area were readily observed in the increase in the transient time required for the intermediates to reach the ring and the much larger disk currents (compared to smooth, planar GC) recorded respectively. The RRDE data was analyzed using a kinetic model previously developed by us and the rate constant of the elementary reactions calculated. The rates constant for the electrochemical reactions were found to be similar in magnitude to the rate constants calculated for smooth GC disks. The porosity of the electrode was found to decrease the rate of desorption of the intermediate and the product and delay their diffusion by shifting it from a Fickian regime in the electrolyte bulk to the Knudsen regime in the film pores. Thus, it is shown that the effect of the electrode porosity on the kinetics of the ORR is physical rather than electrochemical.


title: A Novel Stratified Analysis Method for Testing and Estimating Overall Treatment Effects on Time-to-Event Outcomes Using Average Hazard with Survival Weight

abstract: Given the limitations of using the Cox hazard ratio to summarize the magnitude of the treatment effect, alternative measures that do not have these limitations are gaining attention. One of the recently proposed alternative methods uses the average hazard with survival weight (AH). This population quantity can be interpreted as the average intensity of the event occurrence in a given time window that does not involve study-specific censoring. Inference procedures for the ratio of AH and difference in AH have already been proposed in simple randomized controlled trial settings to compare two groups. However, methods with stratification factors have not been well discussed, although stratified analysis is often used in practice to adjust for confounding factors and increase the power to detect a between-group difference. The conventional stratified analysis or meta-analysis approach, which integrates stratum-specific treatment effects using an optimal weight, directly applies to the ratio of AH and difference in AH. However, this conventional approach has significant limitations similar to the Cochran-Mantel-Haenszel method for a binary outcome and the stratified Cox procedure for a time-to-event outcome. To address this, we propose a new stratified analysis method for AH using standardization. With the proposed method, one can summarize the between-group treatment effect in both absolute difference and relative terms, adjusting for stratification factors. This can be a valuable alternative to the traditional stratified Cox procedure to estimate and report the magnitude of the treatment effect on time-to-event outcomes using hazard.


title: A Comparative Analysis of Poetry Reading Audio: Singing, Narrating, or Somewhere In Between?

abstract: This paper provides a computational analysis of poetry reading audio signals at a large scale to unveil the musicality within professionally-read poems. Although the acoustic characteristics of other types of spoken language have been extensively studied, most of the literature is limited to narrative speech or singing voice, discussing how different they are from each other. In this work, we develop signal processing methods, which are tailored to capture the unique acoustic characteristics of poetry reading based on their silence patterns, temporal variations of local pitch, and beat stability. Our large-scale statistical analyses on three big corpora, each of which consists of narration (LibriSpeech), singing voice (Intonation), and poetry reading (from The Poetry Foundation), discover that poetry reading does share some musical characteristics with singing voice, although it may also resemble narrative speech.


title: Rehearsal-Free Modular and Compositional Continual Learning for Language Models

abstract: Continual learning aims at incrementally acquiring new knowledge while not forgetting existing knowledge. To overcome catastrophic forgetting, methods are either rehearsal-based, i.e., store data examples from previous tasks for data replay, or isolate parameters dedicated to each task. However, rehearsal-based methods raise privacy and memory issues, and parameter-isolation continual learning does not consider interaction between tasks, thus hindering knowledge transfer. In this work, we propose MoCL, a rehearsal-free Modular and Compositional Continual Learning framework which continually adds new modules to language models and composes them with existing modules. Experiments on various benchmarks show that MoCL outperforms state of the art and effectively facilitates knowledge transfer.


title: Personalized Neural Speech Codec

abstract: In this paper, we propose a personalized neural speech codec, envisioning that personalization can reduce the model complexity or improve perceptual speech quality. Despite the common usage of speech codecs where only a single talker is involved on each side of the communication, personalizing a codec for the specific user has rarely been explored in the literature. First, we assume speakers can be grouped into smaller subsets based on their perceptual similarity. Then, we also postulate that a group-specific codec can focus on the group's speech characteristics to improve its perceptual quality and computational efficiency. To this end, we first develop a Siamese network that learns the speaker embeddings from the LibriSpeech dataset, which are then grouped into underlying speaker clusters. Finally, we retrain the LPCNet-based speech codec baselines on each of the speaker clusters. Subjective listening tests show that the proposed personalization scheme introduces model compression while maintaining speech quality. In other words, with the same model complexity, personalized codecs produce better speech quality.


title: Entropy bounds for device-independent quantum key distribution with local Bell test

abstract: One of the main challenges in device-independent quantum key distribution (DIQKD) is achieving the required Bell violation over long distances, as the channel losses result in low overall detection efficiencies. Recent works have explored the concept of certifying nonlocal correlations over extended distances through the use of a local Bell test. Here, an additional quantum device is placed in close proximity to one party, using short-distance correlations to verify nonlocal behavior at long distances. However, existing works have either not resolved the question of DIQKD security against active attackers in this setup, or used methods that do not yield tight bounds on the keyrates. In this work, we introduce a general formulation of the key rate computation task in this setup that can be combined with recently developed methods for analyzing standard DIQKD. Using this method, we show that if the short-distance devices exhibit sufficiently high detection efficiencies, positive key rates can be achieved in the long-distance branch with lower detection efficiencies as compared to standard DIQKD setups. This highlights the potential for improved performance of DIQKD over extended distances in scenarios where short-distance correlations are leveraged to validate quantum correlations.


title: Learning the mechanisms of network growth

abstract: We propose a novel model-selection method for dynamic networks. Our approach involves training a classifier on a large body of synthetic network data. The data is generated by simulating nine state-of-the-art random graph models for dynamic networks, with parameter range chosen to ensure exponential growth of the network size in time. We design a conceptually novel type of dynamic features that count new links received by a group of vertices in a particular time interval. The proposed features are easy to compute, analytically tractable, and interpretable. Our approach achieves a near-perfect classification of synthetic networks, exceeding the state-of-the-art by a large margin. Applying our classification method to real-world citation networks gives credibility to the claims in the literature that models with preferential attachment, fitness and aging fit real-world citation networks best, although sometimes, the predicted model does not involve vertex fitness.


title: Optimal bounds on the polynomial Schur's theorem

abstract: Liu, Pach and S\'andor recently characterized all polynomials $p(z)$ such that the equation $x+y=p(z)$ is $2$-Ramsey, that is, any $2$-coloring of $\mathbb{N}$ contains infinitely many monochromatic solutions for $x+y=p(z)$. In this paper, we find asymptotically tight bounds for the following two quantitative questions. $\bullet$ For $n\in \mathbb{N}$, what is the longest interval $[n,f(n)]$ of natural numbers which admits a $2$-coloring with no monochromatic solutions of $x+y=p(z)$? $\bullet$ For $n\in \mathbb{N}$ and a $2$-coloring of the first $n$ integers $[n]$, what is the smallest possible number $g(n)$ of monochromatic solutions of $x+y=p(z)$? Our theorems determine $f(n)$ up to a multiplicative constant $2+o(1)$, and determine the asymptotics for $g(n)$.


title: Towards Practical Requirement Analysis and Verification: A Case Study on Software IP Components in Aerospace Embedded Systems

abstract: IP-based software design is a crucial research field that aims to improve efficiency and reliability by reusing complex software components known as intellectual property (IP) components. To ensure the reusability of these components, particularly in security-sensitive software systems, it is necessary to analyze the requirements and perform formal verification for each IP component. However, converting the requirements of IP components from natural language descriptions to temporal logic and subsequently conducting formal verification demands domain expertise and non-trivial manpower. This paper presents a case study on software IP components derived from aerospace embedded systems, with the objective of automating the requirement analysis and verification process. The study begins by employing Large Language Models to convert unstructured natural language into formal specifications. Subsequently, three distinct verification techniques are employed to ascertain whether the source code meets the extracted temporal logic properties. By doing so, five real-world IP components from the China Academy of Space Technology (CAST) have been successfully verified.


title: CARL: Congestion-Aware Reinforcement Learning for Imitation-based Perturbations in Mixed Traffic Control

abstract: Human-driven vehicles (HVs) exhibit complex and diverse behaviors. Accurately modeling such behavior is crucial for validating Robot Vehicles (RVs) in simulation and realizing the potential of mixed traffic control. However, existing approaches like parameterized models and data-driven techniques struggle to capture the full complexity and diversity. To address this, in this work, we introduce CARL, a hybrid technique combining imitation learning for close proximity car-following and probabilistic sampling for larger headways. We also propose two classes of RL-based RVs: a safety RV focused on maximizing safety and an efficiency RV focused on maximizing efficiency. Our experiments show that the safety RV increases Time-to-Collision above the critical 4 second threshold and reduces Deceleration Rate to Avoid a Crash by up to 80%, while the efficiency RV achieves improvements in throughput of up to 49%. These results demonstrate the effectiveness of CARL in enhancing both safety and efficiency in mixed traffic.


title: Metarobotics for Industry and Society: Vision, Technologies, and Opportunities

abstract: Metarobotics aims to combine next generation wireless communication, multi-sense immersion, and collective intelligence to provide a pervasive, itinerant, and non-invasive access and interaction with distant robotized applications. Industry and society are expected to benefit from these functionalities. For instance, robot programmers will no longer travel worldwide to plan and test robot motions, even collaboratively. Instead, they will have a personalized access to robots and their environments from anywhere, thus spending more time with family and friends. Students enrolled in robotics courses will be taught under authentic industrial conditions in real-time. This paper describes objectives of Metarobotics in society, industry, and in-between. It identifies and surveys technologies likely to enable their completion and provides an architecture to put forward the interplay of key components of Metarobotics. Potentials for self-determination, self-efficacy, and work-life-flexibility in robotics-related applications in Society 5.0, Industry 4.0, and Industry 5.0 are outlined.


title: On Difficulties of Attention Factorization through Shared Memory

abstract: Transformers have revolutionized deep learning in numerous fields, including natural language processing, computer vision, and audio processing. Their strength lies in their attention mechanism, which allows for the discovering of complex input relationships. However, this mechanism's quadratic time and memory complexity pose challenges for larger inputs. Researchers are now investigating models like Linear Unified Nested Attention (Luna) or Memory Augmented Transformer, which leverage external learnable memory to either reduce the attention computation complexity down to linear, or to propagate information between chunks in chunk-wise processing. Our findings challenge the conventional thinking on these models, revealing that interfacing with the memory directly through an attention operation is suboptimal, and that the performance may be considerably improved by filtering the input signal before communicating with memory.


title: Existence for noncoercive nonlinear elliptic equations with two lower-order terms

abstract: This paper considers a class of noncoercive nonlinear elliptic problems with coefficients defined in Marcinkiewicz and Lorentz spaces. We prove the existence of a solution for the corresponding Dirichlet problem and investigate the higher integrability properties of the solution.


title: Methane and oxygen from energy-efficient, low temperature in situ resource utilization enables missions to Mars

abstract: NASA mandate is a human mission to Mars in the 2030s and sustained exploration of Mars requires in-situ resource utilization (ISRU). Exploiting the Martian water cycle (alongside perchlorate salts that depress the freezing point of water to less than 213K) and the available 95 volume percent atmospheric CO2, we detail an ultra-low temperature (255K) CO2-H2O electrolyzer to produce methane fuel and life-supporting oxygen on Mars. Methane production is thermodynamically favored across a range of operational pressures and temperatures and our electrolyzer polarization model concurred with reported experimental performance. A hypothetical 10-cell, 100 square cm electrode-area-per-cell electrolyzer produced 0.31g per W per day of CH4 and 3.54g per W per day of O2 at 2V per cell (operating voltage) versus 0.8g per W per day of O2 produced by the Mars Oxygen in-situ Resource Utilization Experiment (MOXIE) from the Mars 2020 mission (MOXIE produces no fuel). Material performance requirements are presented to show that this technology is an energy-efficient complement to the MOXIE high temperature approach.


title: $R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding

abstract: Video temporal grounding (VTG) is a fine-grained video understanding problem that aims to ground relevant clips in untrimmed videos given natural language queries. Most existing VTG models are built upon frame-wise final-layer CLIP features, aided by additional temporal backbones (e.g., SlowFast) with sophisticated temporal reasoning mechanisms. In this work, we claim that CLIP itself already shows great potential for fine-grained spatial-temporal modeling, as each layer offers distinct yet useful information under different granularity levels. Motivated by this, we propose Reversed Recurrent Tuning ($R^2$-Tuning), a parameter- and memory-efficient transfer learning framework for video temporal grounding. Our method learns a lightweight $R^2$ Block containing only 1.5% of the total parameters to perform progressive spatial-temporal modeling. Starting from the last layer of CLIP, $R^2$ Block recurrently aggregates spatial features from earlier layers, then refines temporal correlation conditioning on the given query, resulting in a coarse-to-fine scheme. $R^2$-Tuning achieves state-of-the-art performance across three VTG tasks (i.e., moment retrieval, highlight detection, and video summarization) on six public benchmarks (i.e., QVHighlights, Charades-STA, Ego4D-NLQ, TACoS, YouTube Highlights, and TVSum) even without the additional backbone, demonstrating the significance and effectiveness of the proposed scheme. Our code is available at https://github.com/yeliudev/R2-Tuning.


title: The Mechanics and Physics of Twisted and Coiled Polymer Actuators

abstract: Twisted and coiled polymer actuators (TCPAs) generate large contractile mechanical work mimicking natural muscles, which makes them suitable for robotics and health-assistive devices. Understanding the mechanism of nylon TCPA remains challenging due to the interplay between their intricate geometry, chirality, residual stresses, and material microstructure. This study integrates a material microstructure model with rod theory to analytically predict the equilibrium helical shape of the nylon TCPA after fabrication and to explain the observed contraction mechanism upon stimulation. The first ingredient of the model is to treat nylon as a two-phase thermomechanical microstructure system capable of storing strain energy and exchanging it among the two phases. This is validated by characterizing the torsional actuation response of twisted and annealed nylon fibers. The second ingredient of the model is to use the classic Kirchhoff Rod Theory and add a necessary term that couples the bending and twisting energy. Validation with experiments shows that the model captures the equilibrium and longitudinal stiffness of the TCPA in both active and passive states, and the stimulated contraction under external load. Importantly, the model quantifies the influence of the stored energy level on the actuation performance. These concepts can be extended to other types of TCPAs and could enable new material design.


title: Plumbing the wormholes of string theory flux compactifications

abstract: Thus far, the known wormholes in string theory connecting disjoint boundaries represented by finite volume quotients of hyperbolic spaces leak: they are non-perturbatively unstable towards brane-anti-brane nucleation in the flux backgrounds that support these wormholes. Turning on additional fluxes suppressed this instability, but would not completely eliminate it. We present the first example of a non-perturbatively stable wormhole in type IIB supergravity on a warped squashed conifold with fluxes.


title: Higher Dimensional Birkhoff attractors

abstract: We extend to higher dimensions the notion of Birkhoff attractor of a dissipative map. We prove that this notion coincides with the classical Birkhoff attractor. We prove that for the dissipative system associated to the discounted Hamilton-Jacobi equation the graph of a solution is contained in the Birkhoff attractor. We also study what happens when we perturb a Hamiltonian system to make it dissipative and let the perturbation go to zero. The paper contains two important results on $\gamma$-supports and elements of the $\gamma$-completion of the space of exact Lagrangians. Firstly the $\gamma$-support of a Lagrangian in a cotangent bundle carries the cohomology of the base and secondly given an exact Lagrangian $L$, any Floer theoretic equivalent Lagrangian is the $\gamma$-limit of Hamiltonian images of $L$.


title: An OpenStreetMaps based tool to study the energy demand and emissions impact of electrification of medium and heavy-duty freight trucks

abstract: In this paper, we present the mathematical formulation of an OpenStreetMaps (OSM) based tool that compares the costs and emissions of long-haul medium and heavy-duty (M&HD) electric and diesel freight trucks, and determines the spatial distribution of added energy demand due to M&HD EVs. The optimization utilizes a combination of information on routes from OSM, utility rate design data across the United States, and freight volume data, to determine these values. In order to deal with the computational complexity of this problem, we formulate the problem as a convex optimization problem that is scalable to a large geographic area. In our analysis, we further evaluate various scenarios of utility rate design (energy charges) and EV penetration rate across different geographic regions and their impact on the operating cost and emissions of the freight trucks. Our approach determines the net emissions reduction benefits of freight electrification by considering the primary energy source in different regions. Such analysis will provide insights to policy makers in designing utility rates for electric vehicle supply equipment (EVSE) operators depending upon the specific geographic region and to electric utilities in deciding infrastructure upgrades based on the spatial distribution of the added energy demand of M&HD EVs. To showcase the results, a case study for the U.S. state of Texas is conducted.


title: Algorithmic Collusion by Large Language Models

abstract: The rise of algorithmic pricing raises concerns of algorithmic collusion. We conduct experiments with algorithmic pricing agents based on Large Language Models (LLMs), and specifically GPT-4. We find that (1) LLM-based agents are adept at pricing tasks, (2) LLM-based pricing agents autonomously collude in oligopoly settings to the detriment of consumers, and (3) variation in seemingly innocuous phrases in LLM instructions ("prompts") may increase collusion. These results extend to auction settings. Our findings underscore the need for antitrust regulation regarding algorithmic pricing, and uncover regulatory challenges unique to LLM-based pricing agents.


title: GAMA-IR: Global Additive Multidimensional Averaging for Fast Image Restoration

abstract: Deep learning-based methods have shown remarkable success for various image restoration tasks such as denoising and deblurring. The current state-of-the-art networks are relatively deep and utilize (variants of) self attention mechanisms. Those networks are significantly slower than shallow convolutional networks, which however perform worse. In this paper, we introduce an image restoration network that is both fast and yields excellent image quality. The network is designed to minimize the latency and memory consumption when executed on a standard GPU, while maintaining state-of-the-art performance. The network is a simple shallow network with an efficient block that implements global additive multidimensional averaging operations. This block can capture global information and enable a large receptive field even when used in shallow networks with minimal computational overhead. Through extensive experiments and evaluations on diverse tasks, we demonstrate that our network achieves comparable or even superior results to existing state-of-the-art image restoration networks with less latency. For instance, we exceed the state-of-the-art result on real-world SIDD denoising by 0.11dB, while being 2 to 10 times faster.


title: Using Explainable AI and Hierarchical Planning for Outreach with Robots

abstract: Understanding how robots plan and execute tasks is crucial in today's world, where they are becoming more prevalent in our daily lives. However, teaching non-experts the complexities of robot planning can be challenging. This work presents an open-source platform that simplifies the process using a visual interface that completely abstracts the complex internals of hierarchical planning that robots use for performing task and motion planning. Using the principles developed in the field of explainable AI, this intuitive platform enables users to create plans for robots to complete tasks, and provides helpful hints and natural language explanations for errors. The platform also has a built-in simulator to demonstrate how robots execute submitted plans. This platform's efficacy was tested in a user study on university students with little to no computer science background. Our results show that this platform is highly effective in teaching novice users the intuitions of robot task planning.


title: Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfake

abstract: In this work, we investigate multilingual speech Pre-Trained models (PTMs) for Audio deepfake detection (ADD). We hypothesize that multilingual PTMs trained on large-scale diverse multilingual data gain knowledge about diverse pitches, accents, and tones, during their pre-training phase and making them more robust to variations. As a result, they will be more effective for detecting audio deepfakes. To validate our hypothesis, we extract representations from state-of-the-art (SOTA) PTMs including monolingual, multilingual as well as PTMs trained for speaker and emotion recognition, and evaluated them on ASVSpoof 2019 (ASV), In-the-Wild (ITW), and DECRO benchmark databases. We show that representations from multilingual PTMs, with simple downstream networks, attain the best performance for ADD compared to other PTM representations, which validates our hypothesis. We also explore the possibility of fusion of selected PTM representations for further improvements in ADD, and we propose a framework, MiO (Merge into One) for this purpose. With MiO, we achieve SOTA performance on ASV and ITW and comparable performance on DECRO with current SOTA works.


title: Off-the-grid regularisation for Poisson inverse problems

abstract: Off-the-grid regularisation has been extensively employed over the last decade in the context of ill-posed inverse problems formulated in the continuous setting of the space of Radon measures $\mathcal{M}(\mathcal{X})$. These approaches enjoy convexity and counteract the discretisation biases as well the numerical instabilities typical of their discrete counterparts. In the framework of sparse reconstruction of discrete point measures (sum of weighted Diracs), a Total Variation regularisation norm in $\mathcal{M}(\mathcal{X})$ is typically combined with an $L^2$ data term modelling additive Gaussian noise. To asses the framework of off-the-grid regularisation in the presence of signal-dependent Poisson noise, we consider in this work a variational model coupling the Total Variation regularisation with a Kullback-Leibler data term under a non-negativity constraint. Analytically, we study the optimality conditions of the composite functional and analyse its dual problem. Then, we consider an homotopy strategy to select an optimal regularisation parameter and use it within a Sliding Frank-Wolfe algorithm. Several numerical experiments on both 1D/2D simulated and real 3D fluorescent microscopy data are reported.


title: Ore-type conditions for existence of a jellyfish in a graph

abstract: The famous Dirac's Theorem states that for each $n\geq 3$ every $n$-vertex graph $G$ with minimum degree $\delta(G)\geq n/2$ has a hamiltonian cycle. When $\delta(G)< n/2$, this cannot be guaranteed, but the existence of some other specific subgraphs can be provided. Gargano, Hell, Stacho and Vaccaro proved that every connected $n$-vertex graph $G$ with $\delta(G)\geq (n-1)/3$ contains a spanning {\em spider}, i.e., a spanning tree with at most one vertex of degree at least $3$. Later, Chen, Ferrara, Hu, Jacobson and Liu proved the stronger (and exact) result that for $n\geq 56$ every connected $n$-vertex graph $G$ with $\delta(G)\geq (n-2)/3$ contains a spanning {\em broom}, i.e., a spanning spider obtained by joining the center of a star to an endpoint of a path. They also showed that a $2$-connected graph $G$ with $\delta(G)\geq (n-2)/3$ and some additional properties contains a spanning {\em jellyfish} which is a graph obtained by gluing the center of a star to a vertex in a cycle disjoint from that star. Note that every spanning jellyfish contains a spanning broom. The goal of this paper is to prove an exact Ore-type bound which guarantees the existence of a spanning jellyfish: We prove that if $G$ is a $2$-connected graph on $n$ vertices such that every non-adjacent pair of vertices $(u,v)$ satisfies $d(u) + d(v) \geq \frac{2n-3}{3}$, then $G$ has a spanning jellyfish. As corollaries, we obtain strengthenings of two results by Chen et al.: a minimum degree condition guaranteeing the existence of a spanning jellyfish, and an Ore-type sufficient condition for the existence of a spanning broom. The corollaries are sharp for infinitely many $n$. One of the main ingredients of our proof is a modification of the Hopping Lemma due to Woodall.


title: No Complete Problem for Constant-Cost Randomized Communication

abstract: We prove that the class of communication problems with public-coin randomized constant-cost protocols, called $BPP^0$, does not contain a complete problem. In other words, there is no randomized constant-cost problem $Q \in BPP^0$, such that all other problems $P \in BPP^0$ can be computed by a constant-cost deterministic protocol with access to an oracle for $Q$. We also show that the $k$-Hamming Distance problems form an infinite hierarchy within $BPP^0$. Previously, it was known only that Equality is not complete for $BPP^0$. We introduce a new technique, using Ramsey theory, that can prove lower bounds against arbitrary oracles in $BPP^0$, and more generally, we show that $k$-Hamming Distance matrices cannot be expressed as a Boolean combination of any constant number of matrices which forbid large Greater-Than subproblems.


title: Unraveling subsurface crustal dynamics: exploring electrical and seismic refraction methods from theories to existing and machine learning-based emerging prospects

abstract: This comprehensive review explores electrical and seismic refraction methods, including their emerging techniques, namely electrical resistivity tomography (ERT) and seismic refraction tomography (SRT). It discusses their crucial roles in understanding surface-subsurface crustal dynamics, outlining their principles, strengths, and limitations. Additionally, it provides insights into the induced polarization method and briefly discusses the self-potential method. The review thoroughly examines the mapping of surface-subsurface resistivity and velocity structures, crucial for comprehending Earth's surface, deep crustal, and hazard processes. Despite the numerous benefits of these techniques, challenges persist, necessitating multidisciplinary approaches due to lithology heterogeneities, geological process nuances, and geophysical data uncertainties. Hence, the emergence of machine learning and deep learning in ERT and SRT significantly enhances their accuracy in inversion modeling and geological feature identification. This integration of domain-specific knowledge with data- and image-driven approaches effectively addresses subsurface characterization challenges. Case studies utilizing real-time field electrical and seismic P-wave velocity datasets illustrate concepts, accompanied by the development of new methodological frameworks and analytical modeling. These frameworks provide systematic data modeling, facilitating velocity-resistivity relationships for enhanced geological characterization. This evidence underscores the importance of leveraging state-of-the-art techniques to obtain a broader range of parameters for subsurface structure delineation, environmental risk assessment, and informed decision-making. Ongoing research innovation is anticipated to continue improving capabilities in subsurface geophysical exploration.


title: Imposing Exact Safety Specifications in Neural Reachable Tubes

abstract: Hamilton-Jacobi (HJ) reachability analysis is a verification tool that provides safety and performance guarantees for autonomous systems. It is widely adopted because of its ability to handle nonlinear dynamical systems with bounded adversarial disturbances and constraints on states and inputs. However, it involves solving a PDE to compute a safety value function, whose computational and memory complexity scales exponentially with the state dimension, making its direct usage in large-scale systems intractable. Recently, a learning-based approach called DeepReach, has been proposed to approximate high-dimensional reachable tubes using neural networks. While DeepReach has been shown to be effective, the accuracy of the learned solution decreases with the increase in system complexity. One of the reasons for this degradation is the inexact imposition of safety constraints during the learning process, which corresponds to the PDE's boundary conditions. Specifically, DeepReach imposes boundary conditions as soft constraints in the loss function, which leaves room for error during the value function learning. Moreover, one needs to carefully adjust the relative contributions from the imposition of boundary conditions and the imposition of the PDE in the loss function. This, in turn, induces errors in the overall learned solution. In this work, we propose a variant of DeepReach that exactly imposes safety constraints during the learning process by restructuring the overall value function as a weighted sum of the boundary condition and neural network output. This eliminates the need for a boundary loss during training, thus bypassing the need for loss adjustment. We demonstrate the efficacy of the proposed approach in significantly improving the accuracy of learned solutions for challenging high-dimensional reachability tasks, such as rocket-landing and multivehicle collision-avoidance problems.


title: Towards Realistic Scene Generation with LiDAR Diffusion Models

abstract: Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like patterns and 3D geometry of LiDAR scenes, which consumes much of their representation power. In this paper, we propose LiDAR Diffusion Models (LiDMs) to generate LiDAR-realistic scenes from a latent space tailored to capture the realism of LiDAR scenes by incorporating geometric priors into the learning pipeline. Our method targets three major desiderata: pattern realism, geometry realism, and object realism. Specifically, we introduce curve-wise compression to simulate real-world LiDAR patterns, point-wise coordinate supervision to learn scene geometry, and patch-wise encoding for a full 3D object context. With these three core designs, our method achieves competitive performance on unconditional LiDAR generation in 64-beam scenario and state of the art on conditional LiDAR generation, while maintaining high efficiency compared to point-based DMs (up to 107$\times$ faster). Furthermore, by compressing LiDAR scenes into a latent space, we enable the controllability of DMs with various conditions such as semantic maps, camera views, and text prompts.


title: HeteroMILE: a Multi-Level Graph Representation Learning Framework for Heterogeneous Graphs

abstract: Heterogeneous graphs are ubiquitous in real-world applications because they can represent various relationships between different types of entities. Therefore, learning embeddings in such graphs is a critical problem in graph machine learning. However, existing solutions for this problem fail to scale to large heterogeneous graphs due to their high computational complexity. To address this issue, we propose a Multi-Level Embedding framework of nodes on a heterogeneous graph (HeteroMILE) - a generic methodology that allows contemporary graph embedding methods to scale to large graphs. HeteroMILE repeatedly coarsens the large sized graph into a smaller size while preserving the backbone structure of the graph before embedding it, effectively reducing the computational cost by avoiding time-consuming processing operations. It then refines the coarsened embedding to the original graph using a heterogeneous graph convolution neural network. We evaluate our approach using several popular heterogeneous graph datasets. The experimental results show that HeteroMILE can substantially reduce computational time (approximately 20x speedup) and generate an embedding of better quality for link prediction and node classification.


title: Towards CRES-Based Non-destructive Electron Momentum Estimation for the PTOLEMY Relic Neutrino Detector

abstract: The novel electron spectrometry method proposed by the PTOLEMY relic neutrino experiment requires a real-time, non-destructive estimate of the parallel and transverse momentum splits of tritium $\beta$-decay electrons. The collaboration has proposed to obtain this estimate using cyclotron-radiation emission spectroscopy (CRES), in which the kinetic energy of a charged particle is determined by measuring the relativistic frequency shift of the cyclotron radiation emitted by the particle in a magnetic field. However, no suitable approach to extract this information in a non-destructive manner has been developed to date. In this paper, we characterize the performance of a configuration that can be feasibly integrated directly into the existing design for the transverse drift filter proposed by the PTOLEMY collaboration. We study a geometry incorporating a cavity resonator to enhance a ${\sim}\mathcal{O}(1) \hspace{1mm}\mathrm{fW}$ cyclotron radiation signal and derive key features of the expected observed radiation specific to our radio-frequency (RF) tracking configuration. We estimate the performance of our design using electromagnetic simulations and propose a general signal reconstruction algorithm capable of matching an observed signal to electron kinematic parameters. The projected signal-to-noise ratio (SNR) of this technique suggests that a non-destructive RF tracking system based on an array of these components as building blocks is applicable for extracting the kinematic parameters of tritium endpoint electrons to the precision required for the PTOLEMY experiment.


title: Nonreciprocal superfluidlike topological spin transport

abstract: We study superfluidlike spin transport facilitated by thermal diffusion of magnetic domain walls, where the positive and negative chiralities of domain walls act as opposite topological charges. The topological charge conservation leads to algebraic decay of the topological current, allowing for the transport of spin over extended distances. We demonstrate that the presence of the Dzyaloshinskii-Moriya interaction can lead to nonreciprocity in topological flow. In one scenario, the nonreciprocity arises due to diode-like behavior where the nucleation of domain walls is governed by thermal activation for one direction of spin current and by viscous injection for the other direction of spin current. We confirm our predictions by micromagnetic simulations of domain walls in TmIG nanowire.


title: Ultra-relativistic quark-nucleus scattering on quantum computers

abstract: Quantum computing provides a promising approach for solving the real-time dynamics of systems consist of quarks and gluons from first-principle calculations that are intractable with classical computers. In this work, we start with an initial problem of the ultra-relativistic quark-nucleus scattering and present an efficient and precise approach to quantum simulate the dynamics on the light front. This approach employs the eigenbasis of the asymptotic scattering system and implements the compact scheme for basis encoding. It exploits the operator structure of the light-front Hamiltonian of the scattering system, which enables the Hamiltonian input scheme that utilizes the quantum Fourier transform for efficiency. It utilizes the truncated Taylor series for the dynamics simulations. The qubit cost of our approach scales logarithmically with the Hilbert space dimension of the scattering system. The gate cost has optimal scaling with the simulation error and near optimal scaling with the simulation time. These scalings make our approach advantageous for large-scale dynamics simulations on future fault-tolerant quantum computers. We demonstrate our approach with a simple scattering problem and benchmark the results with those from the Trotter algorithm and the classical calculations, where good agreement between the results is found.


title: Visual analysis of bivariate dependence between continuous random variables

abstract: Scatter plots are widely recognized as fundamental tools for illustrating the relationship between two numerical variables. Despite this, based on solid theoretical foundations, scatter plots generated from pairs of continuous random variables may not serve as reliable tools for assessing dependence. Sklar's Theorem implies that scatter plots created from ranked data are preferable for such analysis as they exclusively convey information pertinent to dependence. This is in stark contrast to conventional scatter plots, which also encapsulate information about the variables' marginal distributions. Such additional information is extraneous to dependence analysis and can obscure the visual interpretation of the variables' relationship. In this article, we delve into the theoretical underpinnings of these ranked data scatter plots, hereafter referred to as rank plots. We offer insights into interpreting the information they reveal and examine their connections with various association measures, including Pearson's and Spearman's correlation coefficients, as well as Schweizer-Wolff's measure of dependence. Furthermore, we introduce a novel graphical combination for dependence analysis, termed a dplot, and demonstrate its efficacy through real data examples.


title: Intrinsic conductance of ferroelectric domain walls

abstract: Ferroelectric domain walls hold great promise for innovative applications in ferroelectric devices. However, the underlying mechanisms behind the observed giant conductance of charged domain walls remain poorly understood. Using a first-principles approach that incorporates Boltzmann transport theory and the relaxation time approximation, we determine the carrier concentration, mobility, and conductivity of domain walls with head-to-head and tail-to-tail polarization orientations. Our systematic exploration reveals that the accumulation of carriers, particularly their concentration, plays a dominant role in the domain wall conductance mechanism. However, the observed conductance differences between head-to-head and tail-to-tail domain walls are primarily due to differences in carrier mobility. The width of the domain wall is a key factor determining the device scale. Our calculated domain wall width is significantly smaller than previously reported values. This method, not limited to a certain ferroelectric material, can be used for the optimization and application development of various domain wall materials and devices.


title: Impact of heterogeneity on infection probability: Insights from single-hit dose-response models

abstract: The process of infection of a host is complex, influenced by factors such as microbial variation within and between hosts as well as differences in dose across hosts. This study uses dose-response and microbial growth models to delve into the impact of these factors on infection probability. It is rigorously demonstrated that within-host heterogeneity in microbial infectivity enhances the probability of infection. The effect of infectivity and dose variation between hosts is studied in terms of the expected value of the probability of infection. General analytical findings, derived under the assumption of small infectivity, reveal that both types of heterogeneity reduce the expected infection probability. Interestingly, this trend appears consistent across specific dose-response models, suggesting a limited role for the small infectivity condition. Additionally, the vital dynamics behind heterogeneous infectivity are investigated with a microbial growth model which enhances the biological significance of single-hit dose-response models. Testing these mathematical predictions inspire new and challenging laboratory experiments that could deepen our understanding of infections.


title: Octupolar edge state in an $e_g$ orbital system on a square lattice

abstract: A tight-binding model for $e_g$ orbitals on a square lattice is investigated. We consider only the nearest-neighbor hopping and the model is characterized by two hopping parameters, $t_1$ and $t_2$. There are Dirac points in the electronic band structure and the type of the Dirac points (type-I or type-II) depends on the ratio $t_2/t_1$. For the case of the type-I Dirac points, edge states appear for a lattice with edges perpendicular to the $[11]$ direction. The edge states at a certain momentum along the edges have octupole moments with opposite signs between the right and left edges. Thus, these edge states can be called helical octupolar edge states. This study bridges the research fields of topological phenomena and multipole physics.


title: Identifying a piecewise affine signal from its nonlinear observation -- application to DNA replication analysis

abstract: DNA replication stands as one of the fundamental biological processes crucial for cellular functioning. Recent experimental developments enable the study of replication dynamics at the single-molecule level for complete genomes, facilitating a deeper understanding of its main parameters. In these new data, replication dynamics is reported by the incorporation of an exogenous chemical, whose intra-cellular concentration follows a nonlinear function. The analysis of replication traces thus gives rise to a nonlinear inverse problem, presenting a nonconvex optimization challenge. We demonstrate that under noiseless conditions, the replication dynamics can be uniquely identified by the proposed model. Computing a global solution to this optimization problem is specially challenging because of its multiple local minima. We present the DNA-inverse optimization method that is capable of finding this global solution even in the presence of noise. Comparative analysis against state-of-the-art optimization methods highlights the superior computational efficiency of our approach. DNA-inverse enables the automatic recovery of all configurations of the replication dynamics, which was not possible with previous methods.


title: Using Machine Learning to Forecast Market Direction with Efficient Frontier Coefficients

abstract: We propose a novel method to improve estimation of asset returns for portfolio optimization. This approach first performs a monthly directional market forecast using an online decision tree. The decision tree is trained on a novel set of features engineered from portfolio theory: the efficient frontier functional coefficients. Efficient frontiers can be decomposed to their functional form, a square-root second-order polynomial, and the coefficients of this function captures the information of all the constituents that compose the market in the current time period. To make these forecasts actionable, these directional forecasts are integrated to a portfolio optimization framework using expected returns conditional on the market forecast as an estimate for the return vector. This conditional expectation is calculated using the inverse Mills ratio, and the Capital Asset Pricing Model is used to translate the market forecast to individual asset forecasts. This novel method outperforms baseline portfolios, as well as other feature sets including technical indicators and the Fama-French factors. To empirically validate the proposed model, we employ a set of market sector ETFs.


title: Extracting Social Determinants of Health from Pediatric Patient Notes Using Large Language Models: Novel Corpus and Methods

abstract: Social determinants of health (SDoH) play a critical role in shaping health outcomes, particularly in pediatric populations where interventions can have long-term implications. SDoH are frequently studied in the Electronic Health Record (EHR), which provides a rich repository for diverse patient data. In this work, we present a novel annotated corpus, the Pediatric Social History Annotation Corpus (PedSHAC), and evaluate the automatic extraction of detailed SDoH representations using fine-tuned and in-context learning methods with Large Language Models (LLMs). PedSHAC comprises annotated social history sections from 1,260 clinical notes obtained from pediatric patients within the University of Washington (UW) hospital system. Employing an event-based annotation scheme, PedSHAC captures ten distinct health determinants to encompass living and economic stability, prior trauma, education access, substance use history, and mental health with an overall annotator agreement of 81.9 F1. Our proposed fine-tuning LLM-based extractors achieve high performance at 78.4 F1 for event arguments. In-context learning approaches with GPT-4 demonstrate promise for reliable SDoH extraction with limited annotated examples, with extraction performance at 82.3 F1 for event triggers.


title: SONIC: Synergizing VisiON Foundation Models for Stress RecogNItion from ECG signals

abstract: Stress recognition through physiological signals such as Electrocardiogram (ECG) signals has garnered significant attention. Traditionally, research in this field predominantly focused on utilizing handcrafted features or raw signals as inputs for learning algorithms. However, there is now a burgeoning interest within the community in leveraging large-scale vision foundation models (VFMs) like ResNet50, VGG19, and others. These VFMs are increasingly preferred due to their ability to capture complex features, enhancing the accuracy and effectiveness of stress recognition systems. However, no particular focus has been given on combining these VFMs. The combination of VFMs offers promising benefits by harnessing their collective knowledge to extract richer representations for improved stress recognition. So, to mitigate this research gap, we focus on combining different VFMs for stress recognition from ECG and propose SONIC, a novel framework that combines VFMs through their logits and training a fully connected network on the combined logits. Through extensive experimentation, SONIC showed the top performance against individual VFMs performance on the WESAD benchmark. With SONIC, we report state-of-the-art (SOTA) performance in WESAD with 99.36% and 99.24% (stress vs non-stress) and 97.66% and 97.10% (amusement vs stress vs baseline) in accuracy and F1 respectively.