title: Microscopic theory of spin Seebeck effect in antiferromagnets

abstract: We develop a microscopic theory for the spin Seebeck effect (SSE) in N\'eel and canted phases of antiferromagnetic insulators. We calculate the DC spin current tunneling from the antiferromagnet to an attached metal, incorporating the spin-wave theory and the non-equilibrium Green's function approach. Our result shows a sign change of the spin current at the spin-flop phase transition between N\'eel and canted phases, which is in agreement with a recent experiment for the SSE of $\rm Cr_2O_3$ in a semi-quantitative level. The sign change can be interpreted from the argument based on the density of states of up- and down-spin magnons, which is related to the polarized-neutron scattering spectra. The theory also demonstrates that the spin current in the N\'eel phase is governed by the magnon correlation, while that in the canted phase consists of two parts: Contributions from not only the magnon dynamics but also the static transverse magnetization. This result leads to a prediction that at sufficiently low temperatures, the spin current non-monotonically changes as a function of magnetic field in the canted phase. Towards a more unified understanding of the SSE in antiferromagnets, we further discuss some missing links of theories of SSE: Interface properties, effects of the transverse spin moment in the canted phase, the spin-orbit coupling in the metal, etc. Finally, we compare the SSE of antiferromagnets with those of different magnetic phases such as ferromagnets, ferrimagnets, an one-dimensional spin liquid, a spin-nematic liquid, and a spin-Peierls (dimerized) phase.


title: A ballistic electron source with magnetically-controlled valley polarization in bilayer graphene

abstract: The achievement of valley-polarized electron currents is a cornerstone for the realization of valleytronic devices. Here, we report on ballistic coherent transport experiments where two opposite quantum point contacts (QPCs) are defined by electrostatic gating in a bilayer graphene (BLG) channel. By steering the ballistic currents with an out-of-plane magnetic field we observe two current jets, a consequence of valley-dependent trigonal warping. Tuning the BLG carrier density and number of QPC modes (m) with a gate voltage we find that the two jets are present for m=1 and up to m=6, indicating the robustness of the effect. Semiclassical simulations which account for size quantization and trigonal warping of the Fermi surface quantitatively reproduce our data without fitting parameters, confirming the origin of the signals. In addition, our model shows that the ballistic currents collected for non-zero magnetic fields are valley-polarized independently of m, but their polarization depends on the magnetic field sign, envisioning such devices as ballistic current sources with tuneable valley-polarization.


title: Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Filling

abstract: Recently slot filling has witnessed great development thanks to deep learning and the availability of large-scale annotated data. However, it poses a critical challenge to handle a novel domain whose samples are never seen during training. The recognition performance might be greatly degraded due to severe domain shifts. Most prior works deal with this problem in a two-pass pipeline manner based on metric learning. In practice, these dominant pipeline models may be limited in computational efficiency and generalization capacity because of non-parallel inference and context-free discrete label embeddings. To this end, we re-examine the typical metric-based methods, and propose a new adaptive end-to-end metric learning scheme for the challenging zero-shot slot filling. Considering simplicity, efficiency and generalizability, we present a cascade-style joint learning framework coupled with context-aware soft label representations and slot-level contrastive representation learning to mitigate the data and label shift problems effectively. Extensive experiments on public benchmarks demonstrate the superiority of the proposed approach over a series of competitive baselines.


title: An index theorem for Z/2-harmonic spinors branching along a graph

abstract: We prove an index formula for the Dirac operator acting on two-valued spinors on a $3$-manifold $M$ which branch along a smoothly embedded graph $\Sigma \subset M$, and with respect to a boundary condition along $\Sigma$ inspired by an instance of this setting related to the deformation theory of $\mathbb Z_2$-harmonic spinors. When $\Sigma$ is a smooth embedded curve, this index vanishes; this was proved earlier by one of us, but the proof here is different and extends to the more general setting where $\Sigma$ also has vertices. We focus primarily on the Dirac operator itself, but also show how our results apply to more general twisted Dirac operators and to the closely related $\mathbb Z_2$ harmonic $1$-forms.


title: DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM

abstract: In the burgeoning field of natural language processing (NLP), Neural Topic Models (NTMs) , Large Language Models (LLMs) and Diffusion model have emerged as areas of significant research interest. Despite this, NTMs primarily utilize contextual embeddings from LLMs, which are not optimal for clustering or capable for topic based text generation. NTMs have never been combined with diffusion model for text generation. Our study addresses these gaps by introducing a novel framework named Diffusion-Enhanced Topic Modeling using Encoder-Decoder-based LLMs (DeTiME). DeTiME leverages Encoder-Decoder-based LLMs to produce highly clusterable embeddings that could generate topics that exhibit both superior clusterability and enhanced semantic coherence compared to existing methods. Additionally, by exploiting the power of diffusion model, our framework also provides the capability to do topic based text generation. This dual functionality allows users to efficiently produce highly clustered topics and topic based text generation simultaneously. DeTiME's potential extends to generating clustered embeddings as well. Notably, our proposed framework(both encoder-decoder based LLM and diffusion model) proves to be efficient to train and exhibits high adaptability to other LLMs and diffusion model, demonstrating its potential for a wide array of applications.


title: A broadband pulse amplifier for Joule heating experiments in diamond anvil cells

abstract: Decades of measurements of the thermophysical properties of hot metals show that pulsed Joule heating is an effective method to heat solid and liquid metals that are chemically reactive or difficult to contain. In order to extend such measurements to megabar pressures, pulsed heating methods must be integrated with diamond anvil cells. We report the design and characterization of a new pulse amplifier that can heat $\sim 5$ to $50$ $\mu$m-diameter metal wires to 1000s of kelvin at megabar pressures using diamond anvil cells. Pulse durations and peak currents can each be varied over 3 orders of magnitude, from 5 $\mu$s to 10 ms and 0.2 to 200 A. The pulse amplifier is integrated with a current probe. Two voltage probes attached to the body of a diamond anvil cell can be used to measure voltage in a four point probe geometry. The accuracy of four point probe resistance measurements for a dummy sample with 0.1 $\Omega$ resistance are typically better than $5 \%$ at all times from 2 $\mu$s to 10 ms after the beginning of the pulse.


title: TaskDiff: A Similarity Metric for Task-Oriented Conversations

abstract: The popularity of conversational digital assistants has resulted in the availability of large amounts of conversational data which can be utilized for improved user experience and personalized response generation. Building these assistants using popular large language models like ChatGPT also require additional emphasis on prompt engineering and evaluation methods. Textual similarity metrics are a key ingredient for such analysis and evaluations. While many similarity metrics have been proposed in the literature, they have not proven effective for task-oriented conversations as they do not take advantage of unique conversational features. To address this gap, we present TaskDiff, a novel conversational similarity metric that utilizes different dialogue components (utterances, intents, and slots) and their distributions to compute similarity. Extensive experimental evaluation of TaskDiff on a benchmark dataset demonstrates its superior performance and improved robustness over other related approaches.


title: Neural Network with Local Converging Input (NNLCI) for Supersonic Flow Problems with Unstructured Grids

abstract: In recent years, surrogate models based on deep neural networks (DNN) have been widely used to solve partial differential equations, which were traditionally handled by means of numerical simulations. This kind of surrogate models, however, focuses on global interpolation of the training dataset, and thus requires a large network structure. The process is both time consuming and computationally costly, thereby restricting their use for high-fidelity prediction of complex physical problems. In the present study, we develop a neural network with local converging input (NNLCI) for high-fidelity prediction using unstructured data. The framework utilizes the local domain of dependence with converging coarse solutions as input, which greatly reduces computational resource and training time. As a validation case, the NNLCI method is applied to study inviscid supersonic flows in channels with bumps. Different bump geometries and locations are considered to benchmark the effectiveness and versability of the proposed approach. Detailed flow structures, including shock-wave interactions, are examined systematically.

categories: math.NA cs.AI cs.LG cs.NA physics.flu-dyn


title: Effects of nuclear structure and quantum interference on diffractive vector meson production in ultra-peripheral nuclear collisions

abstract: We study diffractive vector meson production in ultra-peripheral collisions (UPCs) of heavy nuclei, utilizing a theoretical framework based on the Color Glass Condensate (CGC) formalism. We focus on Au+Au, U+U, Ru+Ru, Zr+Zr, and Pb+Pb collisions, examining the transverse momentum dependence of vector meson production cross-sections and ${\rm cos(2\Delta\Phi)}$ asymmetries in the decay product distributions to explore the role of nuclear geometry. The angular modulation is due to the linear polarization of the incoming photons and quantum interference effects. We extract nuclear radii and find them to be consistent with experimental data from the STAR collaboration. The amplitudes of the ${\rm cos(2\Delta\Phi)}$ modulation in the cross-section and the extracted radii depend on the nuclear geometry. This dependence is dominated by the geometry-dependent variation of the minimum impact parameter required for ultra-peripheral collisions.


title: ADMarker: A Multi-Modal Federated Learning System for Monitoring Digital Biomarkers of Alzheimer's Disease

abstract: Alzheimer's Disease (AD) and related dementia are a growing global health challenge due to the aging population. In this paper, we present ADMarker, the first end-to-end system that integrates multi-modal sensors and new federated learning algorithms for detecting multidimensional AD digital biomarkers in natural living environments. ADMarker features a novel three-stage multi-modal federated learning architecture that can accurately detect digital biomarkers in a privacy-preserving manner. Our approach collectively addresses several major real-world challenges, such as limited data labels, data heterogeneity, and limited computing resources. We built a compact multi-modality hardware system and deployed it in a four-week clinical trial involving 91 elderly participants. The results indicate that ADMarker can accurately detect a comprehensive set of digital biomarkers with up to 93.8% accuracy and identify early AD with an average of 88.9% accuracy. ADMarker offers a new platform that can allow AD clinicians to characterize and track the complex correlation between multidimensional interpretable digital biomarkers, demographic factors of patients, and AD diagnosis in a longitudinal manner.


title: Toward a Critical Toponymy Framework for Named Entity Recognition: A Case Study of Airbnb in New York City

abstract: Critical toponymy examines the dynamics of power, capital, and resistance through place names and the sites to which they refer. Studies here have traditionally focused on the semantic content of toponyms and the top-down institutional processes that produce them. However, they have generally ignored the ways in which toponyms are used by ordinary people in everyday discourse, as well as the other strategies of geospatial description that accompany and contextualize toponymic reference. Here, we develop computational methods to measure how cultural and economic capital shape the ways in which people refer to places, through a novel annotated dataset of 47,440 New York City Airbnb listings from the 2010s. Building on this dataset, we introduce a new named entity recognition (NER) model able to identify important discourse categories integral to the characterization of place. Our findings point toward new directions for critical toponymy and to a range of previously understudied linguistic signals relevant to research on neighborhood status, housing and tourism markets, and gentrification.


title: Parallel Quantum Rapidly-Exploring Random Trees

abstract: In this paper, we present the Parallel Quantum Rapidly-Exploring Random Tree (Pq-RRT) algorithm, a parallel version of the Quantum Rapidly-Exploring Random Trees (q-RRT) algorithm. Parallel Quantum RRT is a parallel quantum algorithm formulation of a sampling-based motion planner that uses Quantum Amplitude Amplification to search databases of reachable states for addition to a tree. In this work we investigate how parallel quantum devices can more efficiently search a database, as the quantum measurement process involves the collapse of the superposition to a base state, erasing probability information and therefore the ability to efficiently find multiple solutions. Pq-RRT uses a manager/parallel-quantum-workers formulation, inspired by traditional parallel motion planning, to perform simultaneous quantum searches of a feasible state database. We present results regarding likelihoods of multiple parallel units finding any and all solutions contained with a shared database, with and without reachability errors, allowing efficiency predictions to be made. We offer simulations in dense obstacle environments showing efficiency, density/heatmap, and speed comparisons for Pq-RRT against q-RRT, classical RRT, and classical parallel RRT. We then present Quantum Database Annealing, a database construction strategy for Pq-RRT and q-RRT that uses a temperature construct to define database creation over time for balancing exploration and exploitation.


title: Birth and Early Growth of Entanglement by sd Exchange with Gate-Voltage-Controllable Destiny

abstract: We investigate bipartite entanglement between two distant parties, \textit{A} and \textit{B}, comprising local magnetic impurities (or qudits) induced by the quench through \textit{sd} exchange in a field-effect-transistor geometry. A wave-function-based time-dependent formalism is employed by including non-dissipative responses that allow for the control of entanglement via gate voltages. Our study focuses on the birth and early growth of entanglement, by introducing environment support states that render site- and layer-resolved logarithmic negativity (LN) and mutual information (MI). In the minimal set, where party \textit{A} (\textit{B}) consists of a qubit, we identify entanglement sudden deaths (ESDs), which are explained by a visualization picture analyzing the density matrix. Vibrating electron currents facilitate the birth of entanglement, while they are not required for its growth and subsistence. The LN emerges near the edge layers in \textit{A} and \textit{B}, while MI shows up outside these two parties within the spacing layer. The MI is born earlier than the LN. When a gate voltage large enough to disjoint part of the system is applied within the spacing region, it partially suppresses the entanglement, quantified by the LN. This suppression does not appear immediately after the presence of the disjoint voltage. Applying this disjoint voltage to the site(s) hosting the qudit(s) helps prevent the site- and layer-resolved LN from encountering ESDs. The local impurities in parties \textit{A} and \textit{B} are initially of opposite spin directions in an unentangled state, as can be prepared by two of our proposed protocols. However, the features described above do not depend on the chosen protocols.


title: Stress and frequency optimization of prismatic sandwich beams with joints: Performance improvements through topology optimization

abstract: Prismatic sandwich panels fabricated from metals offer a compelling alternative to more traditional panels across diverse industries, primarily due to their superior strength-to-weight ratio. Although several core types were proposed in the past, further improvements in performance could be achieved by devising the topology of the core through a topology optimization framework, which is explored in this article for the first time. Another novelty is the inclusion of joints between the sandwich beams and its surroundings in the analysis and optimization. Stress is minimized under uniform pressure loading on the beams and natural frequency maximized using the Method of Moving Asymptotes. The results are compared with X-core, Y-core, corrugated-core, and web-core sandwich beams, a few conventional prismatic sandwich types, which are optimized using a prominent global evolutionary algorithm. Manufacturing requirements are considered through practical limitations on the design variables. It is shown that structures produced by topology optimization outperform the conventional sandwich beams by up to 44% at intermediate to high mass levels, where volume fraction is between 0.2 and 0.4, but often through increased topological complexity. The new core topologies bear a certain resemblance with the conventional core types, underscoring engineering ingenuity that went into their development over the years. The topology of the optimized joints differs from the conventional joint. The results also show some limitations of the topology optimization framework, for example that it does not offer better-performing beams for volume fractions below 0.2.


title: Strichartz inequalities: some recent developments

abstract: Strichartz inequalities, originating from Fourier restriction theory, play a central role in the analysis of dispersive partial differential equations. They serve as a cornerstone for many subsequent developments. We survey some of them in memory of Strichartz, highlighting connections to recent developments in Fourier decoupling.


title: Feasibility study of a hard x-ray FEL oscillator at 3 to 4 GeV based on harmonic lasing and transverse gradient undulator

abstract: We studied the feasibility of a hard x-ray FEL oscillator (XFELO) based on a 3 to 4 GeV storage ring considered for the low-emittance upgrade of NSLS-II. We present a more detailed derivation of a formula for the small-gain gain calculation for 3 GeV XFELO published in the proceedings of IPAC'21 [1]. We modified the small-signal low-gain formula developed by K.J. Kim, et.al. [4{6] so that the gain can be derived without taking the \no focusing approximation" and a strong focusing can be applied. In this formula, the gain is cast in the form of a product of two factors with one of them depending only on the harmonic number, undulator period, and gap. Using this factor, we show that it is favorable to use harmonic lasing to achieve hard x-ray FEL working in the small-signal low-gain regime with the medium-energy electron beam (3-4 GeV). Our formula also allows FEL optimization by varying the vertical gradient of the undulator, the vertical dispersion, and the horizontal and vertical focusing, independently. Since a quite high peak current is required for the FEL, the collective effects of beam dynamics in medium-energy synchrotrons significantly affect the electron beam parameters. We carried out a multiple-parameter optimization taking collective effects into account and the result indicates the XFELO is feasible for storage ring energy as low as 3 GeV, with local correction of betatron coupling.


title: SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understanding

abstract: The landscape of publicly available vision foundation models (VFMs), such as CLIP and Segment Anything Model (SAM), is expanding rapidly. VFMs are endowed with distinct capabilities stemming from their pre-training objectives. For instance, CLIP excels in semantic understanding, while SAM specializes in spatial understanding for segmentation. In this work, we introduce a simple recipe to efficiently merge VFMs into a unified model that absorbs their expertise. Our method integrates techniques of multi-task learning, continual learning, and distillation. Further, it demands significantly less computational cost compared to traditional multi-task training from scratch, and it only needs a small fraction of the pre-training datasets that were initially used to train individual models. By applying our method to SAM and CLIP, we obtain SAM-CLIP: a unified model that combines the capabilities of SAM and CLIP into a single vision transformer. Compared with deploying SAM and CLIP independently, our merged model, SAM-CLIP, reduces storage and compute costs for inference, making it well-suited for edge device applications. We show that SAM-CLIP not only retains the foundational strengths of SAM and CLIP, but also introduces synergistic functionalities, notably in zero-shot semantic segmentation, where SAM-CLIP establishes new state-of-the-art results on 5 benchmarks. It outperforms previous models that are specifically designed for this task by a large margin, including +6.8% and +5.9% mean IoU improvement on Pascal-VOC and COCO-Stuff datasets, respectively.


title: Lead-free Magnetic Double Perovskites for Photovoltaic and Photocatalysis Applications

abstract: The magnetic spin degrees of freedom in magnetic materials serve as additional capability to tune materials properties, thereby invoking magneto-optical response. Herein, we report the magneto-optoelectronic properties of a family of lead-free magnetic double perovskites Cs_{2}AgTX_{6} (T = Sc, Ti, V, Cr, Mn, Fe, Co, Ni, Cu; X=Cl, Br, I). This turns out to provide an extremely fertile series, giving rise to potential candidate materials for photovoltaic(PV) applications. In conjunction with high absorption coefficient and high simulated power conversion efficiency for PV applications, few compounds in this series exhibit novel magnetic character useful for spintronic applications. The interaction between magnetism and light can have far-reaching results on the photovoltaic properties as a consequence of the shift in the defect energy levels due to Zeeman effect. This subsequently affects the recombination rate of minority carriers, and hence the photoconversion efficiency. Moreover, the distinct ferromagnetic and anti-ferromagnetic ordering driven by hybridization and super-exchange mechanism can play a significant role to break the time-reversal and/or inversion symmetry. Such a coalescence of magnetism and efficient optoelectronic response has the potential to trigger magnetic/spin anomalous photovoltaic (non-linear Optical) effect in this Cs$_{2}$AgTX$_{6}$ family. These insights can thus channelize the advancement of lead-free double perovskites in magnetic/spin anomalous photovoltaic field as well.


title: A direct solution to the interpolative inverse non-uniform fast Fourier transform problem for spectral analyses of non-equidistant time-series data

abstract: A simple least-squares optimisation enables the determination of the spectrum for irregularly sampled data that is readily reconstructed using an adjoint transformation of the Non-Uniform Fast Fourier Transform (NFFT). This is an improvement upon previously reported iterative methods for such problems, and is competitive in terms of time complexity with more recently proposed direct NFFT inversions when considering comparable matrix pre-computation steps. The software is highly portable, and available as a convenient Python package using standard libraries. Given its mathematical simplicity however, it can be easily implemented on any platform.


title: Entropy production and thermodynamic inference for stochastic microswimmers

abstract: The question of characterization of the degree of non-equilibrium activity in active matter systems is studied in the context of a stochastic microswimmer model driven by a chemical cycle. The resulting dynamical properties and entropy production rate unravel a complex interplay between the chemical and the hydrodynamic degrees of freedom beyond linear response, which is not captured by conventional phenomenological approaches. By studying the precision-dissipation trade-off, a new protocol is proposed in which microscopic chemical driving forces can be inferred experimentally. Our findings highlight subtleties associated with the stochastic thermodynamics of autonomous microswimmers.


title: A short proof of the Almkvist-Meurman theorem

abstract: We give a short generating function proof of the Almkvist-Meurman theorem: For integers $h$ and $k\ne0$, define the numbers $M_n(h,k)$ by $kx(e^{hx}-1)/(e^{kx}-1)=\sum_{n=0}^\infty M_n(h,k) x^n/n!$. Equivalently, $M_n(h,k) = k^n(B_n(h/k) - B_n)$, where $B_n(u)$ is the Bernoulli polynomial. Then $M_n(h,k)$ is an integer. The proof is related to Postnikov's functional equation for the generating function for intransitive trees.


title: How to choose a decoder for a fault-tolerant quantum computer? The speed vs accuracy trade-off

abstract: Achieving practical quantum advantage requires a classical decoding algorithm to identify and correct faults during computation. This classical decoding algorithm must deliver both accuracy and speed, but in what combination? When is a decoder "fast enough" or "accurate enough"? In the case of surface codes, tens of decoding algorithms have been proposed, with different accuracies and speeds. However, it has been unclear how to choose the best decoder for a given quantum architecture. Should a faster decoder be used at the price of reduced accuracy? Or should a decoder sacrifice accuracy to fit within a given time constraint? If a decoder is too slow, it may be stopped upon reaching a time bound, at the price of some time-out failures and an increased failure rate. What then is the optimal stopping time of the decoder? By analyzing the speed vs. accuracy tradeoff, we propose strategies to select the optimal stopping time for a decoder for different tasks. We design a protocol to select the decoder that minimizes the spacetime cost per logical gate, for logical computation of a given depth. Our protocol enables comparison of different decoders, and the selection of an appropriate decoder for a given fault-tolerant quantum computing architecture. We illustrate our protocol for the surface code equipped with a desktop implementation of the PyMatching decoder. We estimate PyMatching is fast enough to implement thousands of logical gates with a better accuracy than physical qubits. However, we find it is not sufficiently fast to reach 10^5 logical gates, under certain assumptions, due to the decoding delay which forces qubits to idle and accumulate errors while idling. We expect further improvements to PyMatching are possible by running it on a better machine or by reducing the OS interference.


title: Combining linear-scaling quantum transport and machine-learning molecular dynamics to study thermal and electronic transports in complex materials

abstract: We propose an efficient approach for simultaneous prediction of thermal and electronic transport properties in complex materials. Firstly, a highly efficient machine-learned neuroevolution potential is trained using reference data from quantum-mechanical density-functional theory calculations. This trained potential is then applied in large-scale molecular dynamics simulations, enabling the generation of realistic structures and accurate characterization of thermal transport properties. In addition, molecular dynamics simulations of atoms and linear-scaling quantum transport calculations of electrons are coupled to account for the electron-phonon scattering and other disorders that affect the charge carriers governing the electronic transport properties. We demonstrate the usefulness of this unified approach by studying thermoelectric transport properties of a graphene antidot lattice.


title: Prospects for Neutron Star Parameter Estimation using Gravitational Waves from f-modes Associated with Magnetar Flares

abstract: Magnetar vibrational modes are theorized to be associated with energetic X-ray flares. Regular searches for gravitational waves from these modes have been performed by Advanced LIGO and Advanced Virgo, with no detections so far. Presently, search results are given in limits on the root-sum-square of the integrated gravitational-wave strain. However, the increased sensitivity of current detectors and the promise of future detectors invite the consideration of more astrophysically motivated methods. We present a framework for augmenting gravitational wave searches to measure or place direct limits on magnetar astrophysical properties in various search scenarios using a set of phenomenological and analytic models.


title: Probing Representations for Document-level Event Extraction

abstract: The probing classifiers framework has been employed for interpreting deep neural network models for a variety of natural language processing (NLP) applications. Studies, however, have largely focused on sentencelevel NLP tasks. This work is the first to apply the probing paradigm to representations learned for document-level information extraction (IE). We designed eight embedding probes to analyze surface, semantic, and event-understanding capabilities relevant to document-level event extraction. We apply them to the representations acquired by learning models from three different LLM-based document-level IE approaches on a standard dataset. We found that trained encoders from these models yield embeddings that can modestly improve argument detections and labeling but only slightly enhance event-level tasks, albeit trade-offs in information helpful for coherence and event-type prediction. We further found that encoder models struggle with document length and cross-sentence discourse.


title: Exploring the Potential of Large Language Models in Generating Code-Tracing Questions for Introductory Programming Courses

abstract: In this paper, we explore the application of large language models (LLMs) for generating code-tracing questions in introductory programming courses. We designed targeted prompts for GPT4, guiding it to generate code-tracing questions based on code snippets and descriptions. We established a set of human evaluation metrics to assess the quality of questions produced by the model compared to those created by human experts. Our analysis provides insights into the capabilities and potential of LLMs in generating diverse code-tracing questions. Additionally, we present a unique dataset of human and LLM-generated tracing questions, serving as a valuable resource for both the education and NLP research communities. This work contributes to the ongoing dialogue on the potential uses of LLMs in educational settings.


title: HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networks

abstract: Graphs have emerged as a natural choice to represent and analyze the intricate patterns and rich information of the Web, enabling applications such as online page classification and social recommendation. The prevailing "pre-train, fine-tune" paradigm has been widely adopted in graph machine learning tasks, particularly in scenarios with limited labeled nodes. However, this approach often exhibits a misalignment between the training objectives of pretext tasks and those of downstream tasks. This gap can result in the "negative transfer" problem, wherein the knowledge gained from pre-training adversely affects performance in the downstream tasks. The surge in prompt-based learning within Natural Language Processing (NLP) suggests the potential of adapting a "pre-train, prompt" paradigm to graphs as an alternative. However, existing graph prompting techniques are tailored to homogeneous graphs, neglecting the inherent heterogeneity of Web graphs. To bridge this gap, we propose HetGPT, a general post-training prompting framework to improve the predictive performance of pre-trained heterogeneous graph neural networks (HGNNs). The key is the design of a novel prompting function that integrates a virtual class prompt and a heterogeneous feature prompt, with the aim to reformulate downstream tasks to mirror pretext tasks. Moreover, HetGPT introduces a multi-view neighborhood aggregation mechanism, capturing the complex neighborhood structure in heterogeneous graphs. Extensive experiments on three benchmark datasets demonstrate HetGPT's capability to enhance the performance of state-of-the-art HGNNs on semi-supervised node classification.


title: Hallucination Detection for Grounded Instruction Generation

abstract: We investigate the problem of generating instructions to guide humans to navigate in simulated residential environments. A major issue with current models is hallucination: they generate references to actions or objects that are inconsistent with what a human follower would perform or encounter along the described path. We develop a model that detects these hallucinated references by adopting a model pre-trained on a large corpus of image-text pairs, and fine-tuning it with a contrastive loss that separates correct instructions from instructions containing synthesized hallucinations. Our final model outperforms several baselines, including using word probability estimated by the instruction-generation model, and supervised models based on LSTM and Transformer.


title: Conflating point of interest (POI) data: A systematic review of matching methods

abstract: Point of interest (POI) data provide digital representations of places in the real world, and have been increasingly used to understand human-place interactions, support urban management, and build smart cities. Many POI datasets have been developed, which often have different geographic coverages, attribute focuses, and data quality. From time to time, researchers may need to conflate two or more POI datasets in order to build a better representation of the places in the study areas. While various POI conflation methods have been developed, there lacks a systematic review, and consequently, it is difficult for researchers new to POI conflation to quickly grasp and use these existing methods. This paper fills such a gap. Following the protocol of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), we conduct a systematic review by searching through three bibliographic databases using reproducible syntax to identify related studies. We then focus on a main step of POI conflation, i.e., POI matching, and systematically summarize and categorize the identified methods. Current limitations and future opportunities are discussed afterwards. We hope that this review can provide some guidance for researchers interested in conflating POI datasets for their research.


title: How language of interaction affects the user perception of a robot

abstract: Spoken language is the most natural way for a human to communicate with a robot. It may seem intuitive that a robot should communicate with users in their native language. However, it is not clear if a user's perception of a robot is affected by the language of interaction. We investigated this question by conducting a study with twenty-three native Czech participants who were also fluent in English. The participants were tasked with instructing the Pepper robot on where to place objects on a shelf. The robot was controlled remotely using the Wizard-of-Oz technique. We collected data through questionnaires, video recordings, and a post-experiment feedback session. The results of our experiment show that people perceive an English-speaking robot as more intelligent than a Czech-speaking robot (z = 18.00, p-value = 0.02). This finding highlights the influence of language on human-robot interaction. Furthermore, we discuss the feedback obtained from the participants via the post-experiment sessions and its implications for HRI design.


title: The equivalence principle for a plane gravitational wave in torsion based and non-metricity based teleparallel equivalents of general relativity

abstract: We study the energy-momentum characteristics of the plane ``+''-polarised gravitational wave solution of general relativity in the Teleparallel Equivalent of General Relativity (TEGR) and the Symmetric Teleparallel Equivalent of General Relativity (STEGR) using the previously constructed Noether currents. The current components describe locally measured by observer energy-momentum if the displacement vector $\xi$ is equal to the observer's 4-velocity. To determine the non-dynamical connection in these theories we use the unified ``turning of'' gravity principle. For a constructive analysis of the values of Noether currents and superpotentials in TEGR and STEGR, we use the concept of ``gauges''. The gauge changing can affect the Noether current values. We study under what conditions the Noether current for the freely falling observer is zero. When they are established, zero result can be interpreted as a correspondence to the equivalence principle, and it is a novelty for gravitational waves in TEGR and STEGR. We highlight two important cases with positive and zero energy, which reproduce the results of previous works with a different approach to determine gravitational energy-momentum in TEGR, and give their interpretation.


title: How gravity stabilises instability: the case of magnetic micro-convection

abstract: Finding solutions for better mixing in microfluidics remains an important challenge, including understanding fundamental aspects of these processes. Here we investigate the magnetic micro-convection on water and miscible magnetic fluid interface in a vertical microfluidic chip to understand what is the role of gravity, as fluids have different densities. Our model is reduced to two dimensionless quantities - magnetic and gravitational Rayleigh numbers. Numerical simulation results show that static magnetic field generate rich dynamics. This is confirmed quantitatively with careful experiments in initially stagnant fluids. We also show that the length of resulting mixing is limited by gravity. For this we construct a master curve, exploiting the measurements of critical field. A three-fluid layer model and linear stability analysis on its interfaces allows us to explain the limitation mechanism. Our results can help in the development of instability based micromixers.


title: Videoprompter: an ensemble of foundational models for zero-shot video understanding

abstract: Vision-language models (VLMs) classify the query video by calculating a similarity score between the visual features and text-based class label representations. Recently, large language models (LLMs) have been used to enrich the text-based class labels by enhancing the descriptiveness of the class names. However, these improvements are restricted to the text-based classifier only, and the query visual features are not considered. In this paper, we propose a framework which combines pre-trained discriminative VLMs with pre-trained generative video-to-text and text-to-text models. We introduce two key modifications to the standard zero-shot setting. First, we propose language-guided visual feature enhancement and employ a video-to-text model to convert the query video to its descriptive form. The resulting descriptions contain vital visual cues of the query video, such as what objects are present and their spatio-temporal interactions. These descriptive cues provide additional semantic knowledge to VLMs to enhance their zeroshot performance. Second, we propose video-specific prompts to LLMs to generate more meaningful descriptions to enrich class label representations. Specifically, we introduce prompt techniques to create a Tree Hierarchy of Categories for class names, offering a higher-level action context for additional visual cues, We demonstrate the effectiveness of our approach in video understanding across three different zero-shot settings: 1) video action recognition, 2) video-to-text and textto-video retrieval, and 3) time-sensitive video tasks. Consistent improvements across multiple benchmarks and with various VLMs demonstrate the effectiveness of our proposed framework. Our code will be made publicly available.


title: LXMERT Model Compression for Visual Question Answering

abstract: Large-scale pretrained models such as LXMERT are becoming popular for learning cross-modal representations on text-image pairs for vision-language tasks. According to the lottery ticket hypothesis, NLP and computer vision models contain smaller subnetworks capable of being trained in isolation to full performance. In this paper, we combine these observations to evaluate whether such trainable subnetworks exist in LXMERT when fine-tuned on the VQA task. In addition, we perform a model size cost-benefit analysis by investigating how much pruning can be done without significant loss in accuracy. Our experiment results demonstrate that LXMERT can be effectively pruned by 40%-60% in size with 3% loss in accuracy.


title: Specialist or Generalist? Instruction Tuning for Specific NLP Tasks

abstract: The potential of large language models (LLMs) to simultaneously perform a wide range of natural language processing (NLP) tasks has been the subject of extensive research. Although instruction tuning has proven to be a data-efficient method for transforming LLMs into such generalist models, their performance still lags behind specialist models trained exclusively for specific tasks. In this paper, we investigate whether incorporating broad-coverage generalist instruction tuning can contribute to building a specialist model. We hypothesize that its efficacy depends on task specificity and skill requirements. Our experiments assess four target tasks with distinct coverage levels, revealing that integrating generalist instruction tuning consistently enhances model performance when the task coverage is broad. The effect is particularly pronounced when the amount of task-specific training data is limited. Further investigation into three target tasks focusing on different capabilities demonstrates that generalist instruction tuning improves understanding and reasoning abilities. However, for tasks requiring factual knowledge, generalist data containing hallucinatory information may negatively affect the model's performance. Overall, our work provides a systematic guide for developing specialist models with general instruction tuning. Our code and other related resources can be found at https://github.com/DavidFanzz/Generalist_or_Specialist.


title: On Quark Substructures in an Inspired Unified Model

abstract: Motivated by the growing attention devoted to the Quantum Chromodynamics sector of the Standard Model, and the recent observations of non-standard hadronic states, a possible substructure of quarks $q_{f}\equiv C_{ij}|k_{i}k_{j}\rangle $ in terms of four colorless bound particles $% k_{i(=0,\ldots,3)}$ "hyperquarks" is investigated in a $SO(10)$-inspired unified model. This aims to define a subtle structure of matter as well as an explanation of some particularities of quarks. Precisley, these hyperquarks $k_{i}$ are bound by a $SU(3)_{h}$ "hyperstrong force" under which they are assumed to be charged. Exploiting certain known data, the masses and the charges of such fundamental particles are discussed along with the emerged four extra quarks $q_{f}\equiv \delta_{ii}|k_{i}k_{i}\rangle $ and three hyperweak bosons $W_{h}$.


title: DeepVox and SAVE-CT: a contrast- and dose-independent 3D deep learning approach for thoracic aorta segmentation and aneurysm prediction using computed tomography scans

abstract: Thoracic aortic aneurysm (TAA) is a fatal disease which potentially leads to dissection or rupture through progressive enlargement of the aorta. It is usually asymptomatic and screening recommendation are limited. The gold-standard evaluation is performed by computed tomography angiography (CTA) and radiologists time-consuming assessment. Scans for other indications could help on this screening, however if acquired without contrast enhancement or with low dose protocol, it can make the clinical evaluation difficult, besides increasing the scans quantity for the radiologists. In this study, it was selected 587 unique CT scans including control and TAA patients, acquired with low and standard dose protocols, with or without contrast enhancement. A novel segmentation model, DeepVox, exhibited dice score coefficients of 0.932 and 0.897 for development and test sets, respectively, with faster training speed in comparison to models reported in the literature. The novel TAA classification model, SAVE-CT, presented accuracies of 0.930 and 0.922 for development and test sets, respectively, using only the binary segmentation mask from DeepVox as input, without hand-engineered features. These two models together are a potential approach for TAA screening, as they can handle variable number of slices as input, handling thoracic and thoracoabdominal sequences, in a fully automated contrast- and dose-independent evaluation. This may assist to decrease TAA mortality and prioritize the evaluation queue of patients for radiologists.


title: Serverless Federated Learning with flwr-serverless

abstract: Federated learning is becoming increasingly relevant and popular as we witness a surge in data collection and storage of personally identifiable information. Alongside these developments there have been many proposals from governments around the world to provide more protections for individuals' data and a heightened interest in data privacy measures. As deep learning continues to become more relevant in new and existing domains, it is vital to develop strategies like federated learning that can effectively train data from different sources, such as edge devices, without compromising security and privacy. Recently, the Flower (\texttt{Flwr}) Python package was introduced to provide a scalable, flexible, and easy-to-use framework for implementing federated learning. However, to date, Flower is only able to run synchronous federated learning which can be costly and time-consuming to run because the process is bottlenecked by client-side training jobs that are slow or fragile. Here, we introduce \texttt{flwr-serverless}, a wrapper around the Flower package that extends its functionality to allow for both synchronous and asynchronous federated learning with minimal modification to Flower's design paradigm. Furthermore, our approach to federated learning allows the process to run without a central server, which increases the domains of application and accessibility of its use. This paper presents the design details and usage of this approach through a series of experiments that were conducted using public datasets. Overall, we believe that our approach decreases the time and cost to run federated training and provides an easier way to implement and experiment with federated learning systems.


title: Towards the Theory of Unsupervised Federated Learning: Non-asymptotic Analysis of Federated EM Algorithms

abstract: While supervised federated learning approaches have enjoyed significant success, the domain of unsupervised federated learning remains relatively underexplored. Several federated EM algorithms have gained popularity in practice, however, their theoretical foundations are often lacking. In this paper, we first introduce a federated gradient EM algorithm (FedGrEM) designed for the unsupervised learning of mixture models, which supplements the existing federated EM algorithms by considering task heterogeneity and potential adversarial attacks. We present a comprehensive finite-sample theory that holds for general mixture models, then apply this general theory on specific statistical models to characterize the explicit estimation error of model parameters and mixture proportions. Our theory elucidates when and how FedGrEM outperforms local single-task learning with insights extending to existing federated EM algorithms. This bridges the gap between their practical success and theoretical understanding. Our numerical results validate our theory, and demonstrate FedGrEM's superiority over existing unsupervised federated learning benchmarks.


title: Engineering higher order Van Hove singularities in two dimensions: the example of the surface layer of Sr$_2$RuO$_4$

abstract: The properties of correlated electron materials are often intricately linked to Van Hove singularities (VHs) in the vicinity of the Fermi energy. The class of these VHs is of great importance, with higher order ones -- with power-law divergence in the density of states -- leaving frequently distinct signatures in physical properties. We use a new theoretical method to detect and analyse higher order Van Hove singularities (HOVHs) in two-dimensional materials and apply it to the electronic structure of the surface layer of Sr$_2$RuO$_4$. We then constrain a low energy model of the VHs of the surface layer of Sr$_2$RuO$_4$ against angle-resolved photoemission spectroscopy and quasiparticle interference data to analyse the VHs near the Fermi level. We show how these VHs can be engineered into HOVHs.


title: Rigidity of Curvature Bounds of Quotient Spaces Of Isometric Actions

abstract: Let $G\curvearrowright M$ be an isometric action of a Lie Group on a complete orientable Riemannian manifold. We disintegrate absolutely continuous measures with respect to the volume measure of $M$ along the principal orbits of $G\curvearrowright M$ and define a functional on the probability measures with support on the principal orbits of the action to further prove that the convexity properties of this functional guarantees necessary and sufficient conditions to the Ricci curvature of $M$ to be bound below by a given real number $K$.


title: Safe and Interpretable Estimation of Optimal Treatment Regimes

abstract: Recent statistical and reinforcement learning methods have significantly advanced patient care strategies. However, these approaches face substantial challenges in high-stakes contexts, including missing data, inherent stochasticity, and the critical requirements for interpretability and patient safety. Our work operationalizes a safe and interpretable framework to identify optimal treatment regimes. This approach involves matching patients with similar medical and pharmacological characteristics, allowing us to construct an optimal policy via interpolation. We perform a comprehensive simulation study to demonstrate the framework's ability to identify optimal policies even in complex settings. Ultimately, we operationalize our approach to study regimes for treating seizures in critically ill patients. Our findings strongly support personalized treatment strategies based on a patient's medical history and pharmacological features. Notably, we identify that reducing medication doses for patients with mild and brief seizure episodes while adopting aggressive treatment for patients in intensive care unit experiencing intense seizures leads to more favorable outcomes.


title: ADMM Training Algorithms for Residual Networks: Convergence, Complexity and Parallel Training

abstract: We design a series of serial and parallel proximal point (gradient) ADMMs for the fully connected residual networks (FCResNets) training problem by introducing auxiliary variables. Convergence of the proximal point version is proven based on a Kurdyka-Lojasiewicz (KL) property analysis framework, and we can ensure a locally R-linear or sublinear convergence rate depending on the different ranges of the Kurdyka-Lojasiewicz (KL) exponent, in which a necessary auxiliary function is constructed to realize our goal. Moreover, the advantages of the parallel implementation in terms of lower time complexity and less (per-node) memory consumption are analyzed theoretically. To the best of our knowledge, this is the first work analyzing the convergence, convergence rate, time complexity and (per-node) runtime memory requirement of the ADMM applied in the FCResNets training problem theoretically. Experiments are reported to show the high speed, better performance, robustness and potential in the deep network training tasks. Finally, we present the advantage and potential of our parallel training in large-scale problems.


title: Photometric candidate selection and spectroscopic confirmation of new PNe and SySts in the Galactic plane

abstract: About 3,500 planetary nebulae (PNe) are currently known in the Milky Way, which shows a great discrepancy with the expected number for these objects, regardless of the reference used, $33-59 \times 10^{3}$. The same holds for symbiotic stars (SySts) as well, since the expected number in the Galaxy ($3-400 \times 10^{3}$) differs considerably from the amount of known ones (approximately 300). Studies on PNe and SySts are of great importance because they provide vital clues to the understanding of the late-stage of stellar evolution for low-to-intermediate mass stars. In addition, these classes of objects play a large role in the chemical evolution of the Galaxy through the ejection of their material to the interstellar medium (ISM), enriching it with the various chemical elements produced throughout their evolution. This project aims to contribute to the detection of new PNe and SySts in the Galaxy, thus decreasing the discrepancy between the observed and theoretical populations. Using simultaneously the third data release from the optical survey VPHAS+ (The VST Photometric H$\alpha$ Survey of the Southern Galactic Plane and Bulge), which maps the southern hemisphere of the Galaxy's plane with the $r$, $i$, and H{$\alpha$} filters, and the IR colors of the catalog AllWISE (Wide-field Infrared Survey Explorer + The Two Micron All Sky Survey), we end up with a number of PN and SySt candidates. Subsequently, we confirm the nature of these objects through spectroscopic observations at the SOAR telescope (Southern Astrophysical Research Telescope). So far, we have selected PN candidates and performed the spectroscopic follow-up of 8 of them. In this presentation we show the project's preliminary results, which consist of the discovery of at least one new planetary nebula, and other emission-line sources still to be confirmed either as PN or SySt.


title: Misaligned precessing jets are choked by the accretion disk wind

abstract: We analytically and numerically study the hydrodynamic propagation of a precessing jet in the context of tidal disruption events (TDEs) where the star's angular momentum is misaligned with the black hole spin. We assume that a geometrically thick accretion disk undergoes Lense-Thirring precession around the black hole spin axis and that the jet is aligned with the instantaneous disk angular momentum. At large spin-orbit misalignment angles, the duty cycle along a given direction that the jet sweeps across is much smaller than unity. The faster jet and slower disk wind alternately fill a given angular region, which leads to strong shock interactions between the two. We show that precessing jets can only break out of the wind confinement if the misalignment angle is less than a few times the jet opening angle. The very small event rate of observed jetted TDEs is then explained by the condition of double alignment: both the stellar angular momentum and the observer's line of sight are nearly aligned with the black hole spin. In most TDEs, the jets are initially choked by the disk wind and may only break out later when the disk eventually aligns itself with the spin axis due to the viscous damping of the precession. Such late-time jets may produce delayed radio rebrightening as seen in many optically selected TDEs.


title: Moral Foundations of Large Language Models

abstract: Moral foundations theory (MFT) is a psychological assessment tool that decomposes human moral reasoning into five factors, including care/harm, liberty/oppression, and sanctity/degradation (Graham et al., 2009). People vary in the weight they place on these dimensions when making moral decisions, in part due to their cultural upbringing and political ideology. As large language models (LLMs) are trained on datasets collected from the internet, they may reflect the biases that are present in such corpora. This paper uses MFT as a lens to analyze whether popular LLMs have acquired a bias towards a particular set of moral values. We analyze known LLMs and find they exhibit particular moral foundations, and show how these relate to human moral foundations and political affiliations. We also measure the consistency of these biases, or whether they vary strongly depending on the context of how the model is prompted. Finally, we show that we can adversarially select prompts that encourage the moral to exhibit a particular set of moral foundations, and that this can affect the model's behavior on downstream tasks. These findings help illustrate the potential risks and unintended consequences of LLMs assuming a particular moral stance.


title: The Adaptive Optics System for the Gemini Infrared Multi-Object Spectrograph: Performance Modeling

abstract: The Gemini Infrared Multi-Object Spectrograph (GIRMOS) will be a near-infrared, multi-object, medium spectral resolution, integral field spectrograph (IFS) for Gemini North Telescope, designed to operate behind the future Gemini North Adaptive Optics system (GNAO). In addition to a first ground layer Adaptive Optics (AO) correction in closed loop carried out by GNAO, each of the four GIRMOS IFSs will independently perform additional multi-object AO correction in open loop, resulting in an improved image quality that is critical to achieve top level science requirements. We present the baseline parameters and simulated performance of GIRMOS obtained by modeling both the GNAO and GIRMOS AO systems. The image quality requirement for GIRMOS is that 57% of the energy of an unresolved point-spread function ensquared within a 0.1 x 0.1 arcsecond at 2.0 {\mu} m. It was established that GIRMOS will be an order 16 x 16 adaptive optics (AO) system after examining the tradeoffs between performance, risks and costs. The ensquared energy requirement will be met in median atmospheric conditions at Maunakea at 30{\deg} from zenith.


title: Non-invertible Symmetries in 2D from Type IIB String Theory

abstract: We propose a top-down approach to non-invertible symmetries in 2D QFTs and their associated symmetry topological field theories. We focus on the gauge theory engineered on D1-branes probing a particular Calabi-Yau 4-fold singularity. We show how to derive the symmetry topological field theory, a 3D Dijkgraaf-Witten theory, from the IIB supergravity under dimensional reduction. We also identify branes behind the non-invertible topological lines by dimensionally reducing their worldvolume actions. The action of non-invertible lines on charged local operators is then realized as the Hanany-Witten transition.


title: Calculational Design of [In]Correctness Transformational Program Logics by Abstract Interpretation

abstract: We study transformational program logics for correctness and incorrectness that we extend to explicitly handle both termination and nontermination. We show that the logics are abstract interpretations of the right image transformer for a natural relational semantics covering both finite and infinite executions. This understanding of logics as abstractions of a semantics facilitates their comparisons through their respective abstractions of the semantics (rather that the much more difficult comparison through their formal proof systems). More importantly, the formalization provides a calculational method for constructively designing the sound and complete formal proof system by abstraction of the semantics. As an example, we extend Hoare logic to cover all possible behaviors of nondeterministic programs and design a new precondition (in)correctness logic.


title: On the monotonicity of $Q^2$ spectral element method for Laplacian on quasi-uniform rectangular meshes

abstract: The monotonicity of discrete Laplacian implies discrete maximum principle, which in general does not hold for high order schemes. The $Q^2$ spectral element method has been proven monotone on a uniform rectangular mesh. In this paper we prove the monotonicity of the $Q^2$ spectral element method on quasi-uniform rectangular meshes under certain mesh constraints. In particular, we propose a relaxed Lorenz's condition for proving monotonicity.


title: Towards Hybrid-grained Feature Interaction Selection for Deep Sparse Network

abstract: Deep sparse networks are widely investigated as a neural network architecture for prediction tasks with high-dimensional sparse features, with which feature interaction selection is a critical component. While previous methods primarily focus on how to search feature interaction in a coarse-grained space, less attention has been given to a finer granularity. In this work, we introduce a hybrid-grained feature interaction selection approach that targets both feature field and feature value for deep sparse networks. To explore such expansive space, we propose a decomposed space which is calculated on the fly. We then develop a selection algorithm called OptFeature, which efficiently selects the feature interaction from both the feature field and the feature value simultaneously. Results from experiments on three large real-world benchmark datasets demonstrate that OptFeature performs well in terms of accuracy and efficiency. Additional studies support the feasibility of our method.


title: Burgers' pinns with implicit euler transfer learning

abstract: The Burgers equation is a well-established test case in the computational modeling of several phenomena such as fluid dynamics, gas dynamics, shock theory, cosmology, and others. In this work, we present the application of Physics-Informed Neural Networks (PINNs) with an implicit Euler transfer learning approach to solve the Burgers equation. The proposed approach consists in seeking a time-discrete solution by a sequence of Artificial Neural Networks (ANNs). At each time step, the previous ANN transfers its knowledge to the next network model, which learns the current time solution by minimizing a loss function based on the implicit Euler approximation of the Burgers equation. The approach is tested for two benchmark problems: the first with an exact solution and the other with an alternative analytical solution. In comparison to the usual PINN models, the proposed approach has the advantage of requiring smaller neural network architectures with similar accurate results and potentially decreasing computational costs.


title: Modeling and Testing Superconducting Artificial CPW Lines Suitable for Parametric Amplification

abstract: Achieving amplification with high gain and quantum-limited noise is a difficult problem to solve. Parametric amplification using a superconducting transmission line with high kinetic inductance is a promising technology not only to solve this problem but also adding several benefits. When compared with other technologies, they have the potential of improving power saturation, achieving larger fractional bandwidths and operating at higher frequencies. In this type of amplifiers, selecting the proper transmission line is a key element in their design. Given current fabrication limitations, traditional lines such as coplanar waveguides (CPW), are not ideal for this purpose since it is difficult to make them with the proper characteristic impedance for good matching and slow-enough phase velocity for making them more compact. Capacitively-loaded lines, also known as artificial lines, are a good solution to this problem. However, few design rules or models have been presented to guide their accurate design. This fact is even more crucial considering that they are usually fabricated in the form of Floquet lines that have to be designed carefully to suppress undesired harmonics appearing in the parametric process. In this article we present, firstly, a new modelling strategy, based on the use of electromagnetic-simulation software, and, secondly, a first-principles model that facilitate and speed the design of CPW artificial lines and of Floquet lines made out of them. Then, we present comparisons with experimental results that demonstrate their accuracy. Finally, the theoretical model allows to predict the high-frequency behaviour of the artificial lines showing that they are good candidates for implementing parametric amplifiers above 100 GHz.


title: Photometric Binaries in 14 Magellanic Cloud Star Clusters

abstract: Binary stars play a major role in determining the dynamic evolution of star clusters. We used images collected with the Hubble Space Telescope to study fourteen Magellanic Clouds star clusters that span an age interval between $\sim 0.6$ and $2.1$ Gyr and masses of $10^{4}-10^{5}$ M$_{\odot}$. We estimated the fraction of binary systems composed of two main-sequence stars and the fraction of candidate blue-straggler stars (BSSs). Moreover, we derived the structural parameters of the cluster, including the core radius, the central density, the mass function, and the total mass. We find that the fraction of binaries with a mass ratio larger than 0.7 ranges from $\sim$7%, in NGC1846, to $\sim$20%, in NGC2108. The radial and luminosity distribution can change from one cluster to another. However, when we combine the results from all the clusters, we find that binaries follow a flat radial trend and no significant correlation with the mass of the primary star. We find no evidence for a relation between the fractions of binaries and BSSs. We combined the results on binaries in the studied Magellanic Cloud clusters with those obtained for 67 Galactic globular clusters and 78 open clusters. We detect a significant anti-correlation between the binary fraction in the core and the mass of the host cluster. However, star clusters with similar masses exhibit a wide range of binary fractions. Conversely, there is no evidence of a correlation between the fraction of binaries and either the cluster age or the dynamic age.


title: Generation of THz radiation through molecular modulation in hydrogen-filled hybrid anti-resonant fibers

abstract: We study the generation of narrowband terahertz (THz) pulses by stimulated Raman scattering and molecular modulation in hydrogen-filled hybrid hollow-core fibers. Using a judicious combination of materials and transverse structures, this waveguide design enables simultaneous confinement of optical and THz signals with reasonably low attenuation, as well as high nonlinear overlap. The THz pulses are then generated as the second Stokes band of a ns-long near-infrared pump pulse, aided by Raman coherence waves excited in the gaseous core by the beat-note created by the pump and its first Stokes band. Optimization of the fiber characteristics facilitates phase matching between the corresponding transitions and coherence waves while avoiding coherent gain suppression, resulting in optical-to-THz conversion efficiencies up to 60%, as confirmed by rigorous numerical modelling under ideal conditions. When the current optical material constraints are considered, however, the attainable efficiencies relax to 0.2%, a still competitive value compared to other systems. The approach is in principle power and energy scalable, as well as tunable in the 1 - 10 THz range without any spectral gaps, thereby opening new pathways to the development of fiber-based THz sources complementary to other mature technologies such as quantum cascade lasers.


title: Controller implementability: a data-driven approach

abstract: We study the controller implementability problem, which seeks to determine if a controller can make the closed-loop behavior of a given plant match that of a desired reference behavior. We establish necessary and sufficient conditions for controller implementability which only rely on raw data. Subsequently, we consider the problem of constructing controllers directly from data. By leveraging the concept of canonical controller, we provide a formula to directly construct controllers that implement plant-compatible reference behaviors using measurements of both reference and plant behaviors.


title: Quench-induced spontaneous currents in rings of ultracold fermionic atoms

abstract: We have observed the spontaneous appearance of currents in a ring of ultracold fermionic atoms (6Li) with attractive interactions, following a quench to a BCS-like pair superfluid. We have measured the winding number probability distribution for a range of quench rates, with a quench protocol using simultaneous forced evaporation and interaction ramps to achieve faster effective quench rates with less atom loss than a purely evaporative quench. We find that for the fastest quenches the mean square winding number of the current follows a scaling law in the quench rate with exponent {\sigma} = 0.24(2), which is somewhat lower than that predicted by the Kibble-Zurek mechanism (KZM) for the three-dimensional XY model (1/3), and unexpectedly closer to the value obtained from mean-field theory (1/4). For slower quenches non-universal effects become significant, and we observe a lower rate of spontaneous current formation that does not follow a simple scaling law.


title: Scalable machine learning-assisted clear-box characterization for optimally controlled photonic circuits

abstract: Photonic integrated circuits offer a compact and stable platform for generating, manipulating, and detecting light. They are instrumental for classical and quantum applications. Imperfections stemming from fabrication constraints, tolerances and operation wavelength impose limitations on the accuracy and thus utility of current photonic integrated devices. Mitigating these imperfections typically necessitates a model of the underlying physical structure and the estimation of parameters that are challenging to access. Direct solutions are currently lacking for mesh configurations extending beyond trivial cases. We introduce a scalable and innovative method to characterize photonic chips through an iterative machine learning-assisted procedure. Our method is based on a clear-box approach that harnesses a fully modeled virtual replica of the photonic chip to characterize. The process is sample-efficient and can be carried out with a continuous-wave laser and powermeters. The model estimates individual passive phases, crosstalk, beamsplitter reflectivity values and relative input/output losses. Building upon the accurate characterization results, we mitigate imperfections to enable enhanced control over the device. We validate our characterization and imperfection mitigation methods on a 12-mode Clements-interferometer equipped with 126 phase shifters, achieving beyond state-of-the-art chip control with an average 99.77 % amplitude fidelity on 100 implemented Haar-random unitary matrices.


title: Metastability and dynamic modes in magnetic island chains

abstract: The uniform states of a model for one-dimensional chains of thin magnetic islands on a nonmagnetic substrate coupled via dipolar interactions are described here. Magnetic islands oriented with their long axes perpendicular to the chain direction are assumed, whose shape anisotropy imposes a preference for the dipoles to point perpendicular to the chain. The competition between anisotropy and dipolar interactions leads to three types of uniform states of distinctly different symmetries, including metastable transverse or remanent states, transverse antiferromagnetic states, and longitudinal states where all dipoles align with the chain direction. The stability limits and normal modes of oscillation are found for all three types of states, even including infinite range dipole interactions. The normal mode frequencies are shown to be determined from the eigenvalues of the stability problem.


title: Random Exploration in Bayesian Optimization: Order-Optimal Regret and Computational Efficiency

abstract: We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random exploration approach achieves the optimal error rates. Our analysis is based on novel concentration bounds in an infinite dimensional Hilbert space established in this work, which may be of independent interest. We further develop an algorithm based on random exploration with domain shrinking and establish its order-optimal regret guarantees under both noise-free and noisy settings. In the noise-free setting, our analysis closes the existing gap in regret performance and thereby resolves a COLT open problem. The proposed algorithm also enjoys a computational advantage over prevailing methods due to the random exploration that obviates the expensive optimization of a non-convex acquisition function for choosing the query points at each iteration.


title: Rydberg-atom-based single-photon detection for haloscope axion searches

abstract: We propose a Rydberg-atom-based single-photon detector for signal readout in dark matter haloscope experiments between 40 ${\mu}$eV and 200 ${\mu}$eV (10 GHz and 50 GHz). At these frequencies, standard haloscope readout using linear amplifiers is limited by quantum measurement noise, which can be avoided by using a single-photon detector. Our single-photon detection scheme can offer scan rate enhancements up to a factor of $10^4$ over traditional linear amplifier readout, and is compatible with many different haloscope cavities. We identify multiple haloscope designs that could use our Rydberg-atom-based single-photon detector to search for QCD axions with masses above 40 ${\mu}$eV (10 GHz), currently a minimally explored parameter space.


title: The noisy Werner-Holevo channel and its properties

abstract: The interest in the Werner-Holevo channel $\Lambda_{1} (\rho)=\frac{1}{2}(\text{tr}(\rho)I-\rho^T)$ has been mainly due to its abstract mathematical properties. We show that in three dimensions and with a slight modification, this channel can be realized as the rotation of qutrit states in random directions by random angles. Our modification takes the form $\Lambda_x(\rho)=(1-x)\rho+x\Lambda_1(\rho)$. Therefore and in view of the potential use of qutrits in quantum processing tasks and their realization in many different platforms, the modified Werner-Holevo channel can be used as a very simple and realistic noise model, in the same way that the depolarizing channel is for qubits. We will make a detailed study of this channel and derive its various properties. In particular, we will use the recently proposed flag extension and other techniques to derive analytical expressions and bounds for the different capacities of this channel. The role of symmetry is revealed in these derivations. We also rigorously prove that the channel $\Lambda_x$ is anti-degradable and hence has zero quantum capacity, in the region $\frac{4}{7}\leq x\leq 1.$


title: Data-driven representations of conical, convex, and affine behaviors

abstract: The paper studies conical, convex, and affine models in the framework of behavioral systems theory. We investigate basic properties of such behaviors and address the problem of constructing models from measured data. We prove that closed, shift-invariant, conical, convex, and affine models have the intersection property, thereby enabling the definition of most powerful unfalsified models based on infinite-horizon measurements. We then provide necessary and sufficient conditions for representing conical, convex, and affine finite-horizon behaviors using raw data matrices, expressing persistence of excitation requirements in terms of non-negative rank conditions. The applicability of our results is demonstrated by a numerical example arising in population ecology.


title: Why LLMs Hallucinate, and How to Get (Evidential) Closure: Perceptual, Intensional, and Extensional Learning for Faithful Natural Language Generation

abstract: We show that LLMs hallucinate because their output is not constrained to be synonymous with claims for which they have evidence: a condition that we call evidential closure. Information about the truth or falsity of sentences is not statistically identified in the standard neural probabilistic language model setup, and so cannot be conditioned on to generate new strings. We then show how to constrain LLMs to produce output that does satisfy evidential closure. A multimodal LLM must learn about the external world (perceptual learning); it must learn a mapping from strings to states of the world (extensional learning); and, to achieve fluency when generalizing beyond a body of evidence, it must learn mappings from strings to their synonyms (intensional learning). The output of a unimodal LLM must be synonymous with strings in a validated evidence set. Finally, we present a heuristic procedure, Learn-Babble-Prune, that yields faithful output from an LLM by rejecting output that is not synonymous with claims for which the LLM has evidence.


title: Lie Group Variational Collision Integrators for a Class of Hybrid Systems

abstract: The problem of 3-dimensional, convex rigid-body collision over a plane is fully investigated; this includes bodies with sharp corners that is resolved without the need for nonsmooth convex analysis of tangent and normal cones. In particular, using nonsmooth Lagrangian mechanics, the equations of motion and jump equations are derived, which are largely dependent on the collision detection function. Following the variational approach, a Lie group variational collision integrator (LGVCI) is systematically derived that is symplectic, momentum-preserving, and has excellent long-time, near energy conservation. Furthermore, systems with corner impacts are resolved adeptly using $\epsilon$-rounding on the sign distance function (SDF) of the body. Extensive numerical experiments are conducted to demonstrate the conservation properties of the LGVCI.


title: What topics of peer interactions correlate with student performance in physics courses?

abstract: Research suggests that interacting with more peers about physics course material is correlated with higher student performance. Some studies, however, have demonstrated that different topics of peer interactions may correlate with their performance in different ways, or possibly not at all. In this study, we probe both the peers with whom students interact about their physics course and the particular aspects of the course material about which they interacted in six different introductory physics courses: four lecture courses and two lab courses. Drawing on methods in social network analysis, we replicate prior work demonstrating that, on average, students who interact with more peers in their physics courses have higher final course grades. Expanding on this result, we find that students discuss a wide range of aspects of course material with their peers: concepts, small-group work, assessments, lecture, and homework. We observe that in the lecture courses, interacting with peers about concepts is most strongly correlated with final course grade, with smaller correlations also arising for small-group work and homework. In the lab courses, on the other hand, small-group work is the only interaction topic that significantly correlates with final course grade. We use these findings to discuss how course structures (e.g., grading schemes and weekly course schedules) may shape student interactions and add nuance to prior work by identifying how specific types of student interactions are associated (or not) with performance.


title: Learning Fair Representations with High-Confidence Guarantees

abstract: Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus important because it can prevent unfairness towards disadvantaged groups for all downstream prediction tasks. To prevent unfairness towards disadvantaged groups in all downstream tasks, it is crucial to provide representation learning algorithms that provide fairness guarantees. In this paper, we formally define the problem of learning representations that are fair with high confidence. We then introduce the Fair Representation learning with high-confidence Guarantees (FRG) framework, which provides high-confidence guarantees for limiting unfairness across all downstream models and tasks, with user-defined upper bounds. After proving that FRG ensures fairness for all downstream models and tasks with high probability, we present empirical evaluations that demonstrate FRG's effectiveness at upper bounding unfairness for multiple downstream models and tasks.


title: Optimal scenario for road evacuation in an urban environment

abstract: How to free a road from vehicle traffic as efficiently as possible and in a given time, in order to allow for example the passage of emergency vehicles? We are interested in this question which we reformulate as an optimal control problem. We consider a macroscopic road traffic model on networks, semi-discretized in space and decide to give ourselves the possibility to control the flow at junctions. Our target is to smooth the traffic along a given path within a fixed time. A parsimony constraint is imposed on the controls, in order to ensure that the optimal strategies are feasible in practice. We perform an analysis of the resulting optimal control problem, proving the existence of an optimal control and deriving optimality conditions, which we rewrite as a single functional equation. We then use this formulation to derive a new mixed algorithm interpreting it as a mix between two methods: a descent method combined with a fixed point method allowing global perturbations. We verify with numerical experiments the efficiency of this method on examples of graphs, first simple, then more complex. We highlight the efficiency of our approach by comparing it to standard methods. We propose an open source code implementing this approach in the Julia language.


title: Algorithm for Invalidation of Cached Results of Queries to a Single Table

abstract: One of the most popular setups for a back-end of a high performance website consists of a relational database and a cache which stores results of performed queries. Several application frameworks support caching of queries made to the database, but few of them handle cache invalidation correctly, resorting to simpler solutions such as short TTL values, or flushing the whole cache after any write to the database. In this paper a simple, correct, efficient and tested in real world application solution is presented, which allows for infinite TTL, and very fine grained cache invalidation. Algorithm is proven to be correct in a concurrent environment, both theoretically and in practice.


title: Curved Space-Filling Tiles Using Voronoi Decomposition with Line, and Curve Segments Closed Under Wallpaper Symmetries

abstract: In this paper, we present a new approach to obtain symmetric tiles with curved edges. Our approach is based on using higher-order Voronoi sites that are closed under wallpaper symmetries. The resulting Voronoi tessellations provide us with symmetric tiles with curved edges. We have developed a web application that provides real-time tile design. Our application can be found at https://voronoi.viz.tamu.edu. One of our key findings in this paper is that not all symmetry operations are useful for creating curved tiles. In particular, all symmetries that use mirror operation produce straight lines that are useless for creating new tiles. This result is interesting because it suggests that we need to avoid mirror transformations to produce unusual space-filling tiles in 2D and 3D using Voronoi tessellations.


title: Determinantal structure of the conditional expectation of the overlaps for the induced Ginibre unitary ensemble

abstract: As is widely known, a non-Hermitian matrix exhibits distinct left and right eigenvectors, which form a bi-orthogonal system. Chalker and Mehling initiated the study of the joint statistics of the eigenvalues and the overlaps defined by the left and right eigenvectors of the Ginibre unitary ensemble. Later, Akemann et al. continued their investigation by studying the $k$-th correlation function weighted by the on- and off-overlaps of the Ginibre unitary ensemble. In this paper, as a natural extension of their work, we investigate the $k$-th correlation function weighted by the on- and off-diagonal overlaps of the induced Ginibre unitary ensemble. Similar to the Ginibre unitary ensemble case, we will demonstrate the determinantal structure. As a result, we will confirm the universality of the $k$-th correlation function weighted by the on- and off-diagonal overlaps in both the bulk and edge scaling limits in the strongly non-unitary regime. Furthermore, in the weakly non-unitary regime and at the singular origin, we will report new relationships between the overlap and such spectral regimes.


title: An Optimal Algorithm for Higher-Order Voronoi Diagrams in the Plane: The Usefulness of Nondeterminism

abstract: We present the first optimal randomized algorithm for constructing the order-$k$ Voronoi diagram of $n$ points in two dimensions. The expected running time is $O(n\log n + nk)$, which improves the previous, two-decades-old result of Ramos (SoCG'99) by a $2^{O(\log^*k)}$ factor. To obtain our result, we (i) use a recent decision-tree technique of Chan and Zheng (SODA'22) in combination with Ramos's cutting construction, to reduce the problem to verifying an order-$k$ Voronoi diagram, and (ii) solve the verification problem by a new divide-and-conquer algorithm using planar-graph separators. We also describe a deterministic algorithm for constructing the $k$-level of $n$ lines in two dimensions in $O(n\log n + nk^{1/3})$ time, and constructing the $k$-level of $n$ planes in three dimensions in $O(n\log n + nk^{3/2})$ time. These time bounds (ignoring the $n\log n$ term) match the current best upper bounds on the combinatorial complexity of the $k$-level. Previously, the same time bound in two dimensions was obtained by Chan (1999) but with randomization.


title: Filter-adapted spatiotemporal sampling for real-time rendering

abstract: Stochastic sampling techniques are ubiquitous in real-time rendering, where performance constraints force the use of low sample counts, leading to noisy intermediate results. To remove this noise, the post-processing step of temporal and spatial denoising is an integral part of the real-time graphics pipeline. The main insight presented in this paper is that we can optimize the samples used in stochastic sampling such that the post-processing error is minimized. The core of our method is an analytical loss function which measures post-filtering error for a class of integrands - multidimensional Heaviside functions. These integrands are an approximation of the discontinuous functions commonly found in rendering. Our analysis applies to arbitrary spatial and spatiotemporal filters, scalar and vector sample values, and uniform and non-uniform probability distributions. We show that the spectrum of Monte Carlo noise resulting from our sampling method is adapted to the shape of the filter, resulting in less noisy final images. We demonstrate improvements over state-of-the-art sampling methods in three representative rendering tasks: ambient occlusion, volumetric ray-marching, and color image dithering. Common use noise textures, and noise generation code is available at https://github.com/electronicarts/fastnoise.


title: Prandtl number effects on extreme mixing events in forced stratified turbulence

abstract: Relatively strongly stratified turbulent flows tend to self-organise into a 'layered anisotropic stratified turbulence' (LAST) regime, characterised by relatively deep and well-mixed density 'layers' separated by relatively thin 'interfaces' of enhanced density gradient. Understanding the associated mixing dynamics is a central problem in geophysical fluid dynamics. It is challenging to study 'LAST' mixing, as it is associated with Reynolds numbers $Re := UL/\nu \gg 1$ and Froude numbers $Fr :=(2\pi U)/(L N) \ll 1$, ($U$ and $L$ being characteristic velocity and length scales, $\nu$ being the kinematic viscosity and $N$ the buoyancy frequency). Since a sufficiently large dynamic range (largely) unaffected by stratification and viscosity is required, it is also necessary for the buoyancy Reynolds number $Re_{b} := \epsilon/(\nu N^{2}) \gg 1$ where $\epsilon$ is the (appropriately volume-averaged) turbulent kinetic energy dissipation rate. This requirement is exacerbated for oceanically relevant flows, as the Prandtl number $Pr := \nu/\kappa = \mathcal{O}(10)$ in thermally-stratified water (where $\kappa$ is the thermal diffusivity), thus leading (potentially) to even finer density field structures. We report here on four forced fully resolved direct numerical simulations of stratified turbulence at various Froude ($Fr=0.5, 2$) and Prandtl numbers ($Pr=1, 7$) forced so that $Re_{b}=50$, with resolutions up to $30240 \times 30240 \times 3780$. We find that, as $Pr$ increases, emergent 'interfaces' become finer and their contribution to bulk mixing characteristics decreases at the expense of the small-scale density structures populating the well-mixed 'layers'. However, extreme mixing events (as quantified by significantly elevated local destruction rates of buoyancy variance $\chi_0$) are always preferentially found in the (statically stable) interfaces, irrespective of the value of $Pr$.


title: Immediate Afterglow Physical Characteristics and Broadband Spectra Evidence Synchrotron self-Compton Emission as the Reason for VHE Production in TeV GRB 190114C

abstract: Long GRB 190114C, identified on January 14th, 2019, was the first Gamma-ray Burst that substantially violated the defined 10 GeV energy limit of the Synchrotron model, with an observed emission between 0.2 - 1 TeV and a low redshift of z = 0.425. This paper analyzes its immediate afterglow broadband spectrum from 10$^{17}$ to 10$^{26}$ Hz based on observations by the Swift X-ray Telescope (XRT), Fermi Gamma-Ray Burst Monitor (GBM), Swift Burst Alert Telescope (BAT), Fermi Large Area Telescope (LAT), and Major Atmospheric Gamma Imaging Cherenkov Telescope (MAGIC). We first calculate the physical characteristics necessary to understand the conditions in the burst's emitting region, then conduct temporal and spectral analyses by deriving light curves and spectra using a chain polynomial best-fit in the context of the forward shock model in a homogeneous circumburst density. The Spectral Energy Distributions are found to be double-peaked for T$_0$ + 68-180s, and we show the distribution consists of a distinct Synchrotron component followed by an inverse Compton component explained by high-energy electrons up-scattering Synchrotron photons. We find our calculated Bulk Lorentz Factor = 351 sufficiently explains the peak of the inverse Compton component at sub-TeV energy levels in the immediate afterglow, and that the Comptonization of the burst proceeds in the Klein-Nishina regime. We conclude this further evidences Synchrotron self-Compton emission as the mechanism behind the production of Very-High-Energy photons in GRB 190114C.


title: Hodge theory for tropical fans

abstract: This paper is the first in a series devoted to the development of a Hodge theory for tropical varieties. We introduce a notion of T-stability for tropical fans and prove that various geometric properties of tropical fans are T-stable. As a consequence, we establish K\"ahler properties for the Chow ring in a large class of tropical fans, going beyond the case of matroids and their Bergman fans. As a by-product, we obtain a new proof of the K\"ahler package for combinatorial geometries. The approach makes it possible to deal with tropical fans with general weights.


title: Deep Integrated Explanations

abstract: This paper presents Deep Integrated Explanations (DIX) - a universal method for explaining vision models. DIX generates explanation maps by integrating information from the intermediate representations of the model, coupled with their corresponding gradients. Through an extensive array of both objective and subjective evaluations spanning diverse tasks, datasets, and model configurations, we showcase the efficacy of DIX in generating faithful and accurate explanation maps, while surpassing current state-of-the-art methods.


title: Layer-by-Layer Assembled Nanowire Networks Enable Graph Theoretical Design of Multifunctional Coatings

abstract: Multifunctional coatings are central for information, biomedical, transportation and energy technologies. These coatings must possess hard-to-attain properties and be scalable, adaptable, and sustainable, which makes layer-by-layer assembly (LBL) of nanomaterials uniquely suitable for these technologies. What remains largely unexplored is that LBL enables computational methodologies for structural design of these composites. Utilizing silver nanowires (NWs), we develop and validate a graph theoretical (GT) description of their LBL composites. GT successfully describes the multilayer structure with nonrandom disorder and enables simultaneous rapid assessment of several properties of electrical conductivity, electromagnetic transparency, and anisotropy. GT models for property assessment can be rapidly validated due to (1) quasi-2D confinement of NWs and (2) accurate microscopy data for stochastic organization of the NW networks. We finally show that spray-assisted LBL offers direct translation of the GT-based design of composite coatings to additive, scalable manufacturing of drone wings with straightforward extensions to other technologies.


title: Thermodynamics and Rate Thermodynamics

abstract: Approach of mesoscopic state variables to time independent equilibrium sates (zero law of thermodynamics) gives birth to the classical equilibrium thermodynamics. Approach of fluxes and forces to fixed points (equilibrium fluxes and forces) that drive reduced mesoscopic dynamics gives birth to the rate thermodynamics that is applicable to driven systems. We formulate the rate thermodynamics and dynamics, investigate its relation to the classical thermodynamics, to extensions involving more details, to the hierarchy reformulations of dynamical theories, and to the Onsager variational principle. We also compare thermodynamic and dynamic critical behavior observed in closed and open systems. Dynamics and thermodynamics of the van der Waals gas provides an illustration.


title: Vicinal Feature Statistics Augmentation for Federated 3D Medical Volume Segmentation

abstract: Federated learning (FL) enables multiple client medical institutes collaboratively train a deep learning (DL) model with privacy protection. However, the performance of FL can be constrained by the limited availability of labeled data in small institutes and the heterogeneous (i.e., non-i.i.d.) data distribution across institutes. Though data augmentation has been a proven technique to boost the generalization capabilities of conventional centralized DL as a "free lunch", its application in FL is largely underexplored. Notably, constrained by costly labeling, 3D medical segmentation generally relies on data augmentation. In this work, we aim to develop a vicinal feature-level data augmentation (VFDA) scheme to efficiently alleviate the local feature shift and facilitate collaborative training for privacy-aware FL segmentation. We take both the inner- and inter-institute divergence into consideration, without the need for cross-institute transfer of raw data or their mixup. Specifically, we exploit the batch-wise feature statistics (e.g., mean and standard deviation) in each institute to abstractly represent the discrepancy of data, and model each feature statistic probabilistically via a Gaussian prototype, with the mean corresponding to the original statistic and the variance quantifying the augmentation scope. From the vicinal risk minimization perspective, novel feature statistics can be drawn from the Gaussian distribution to fulfill augmentation. The variance is explicitly derived by the data bias in each individual institute and the underlying feature statistics characterized by all participating institutes. The added-on VFDA consistently yielded marked improvements over six advanced FL methods on both 3D brain tumor and cardiac segmentation.

categories: eess.IV cs.AI cs.CV cs.LG physics.med-ph


title: EpiK-Eval: Evaluation for Language Models as Epistemic Models

abstract: In the age of artificial intelligence, the role of large language models (LLMs) is becoming increasingly central. Despite their growing prevalence, their capacity to consolidate knowledge from different training documents - a crucial ability in numerous applications - remains unexplored. This paper presents the first study examining the capability of LLMs to effectively combine such information within their parameter space. We introduce EpiK-Eval, a novel question-answering benchmark tailored to evaluate LLMs' proficiency in formulating a coherent and consistent knowledge representation from segmented narratives. Evaluations across various LLMs reveal significant weaknesses in this domain. We contend that these shortcomings stem from the intrinsic nature of prevailing training objectives. Consequently, we advocate for refining the approach towards knowledge consolidation, as it harbors the potential to dramatically improve their overall effectiveness and performance. The findings from this study offer insights for developing more robust and reliable LLMs. Our code and benchmark are available at https://github.com/chandar-lab/EpiK-Eval