title: Practical End-to-End Optical Music Recognition for Pianoform Music

abstract: The majority of recent progress in Optical Music Recognition (OMR) has been achieved with Deep Learning methods, especially models following the end-to-end paradigm, reading input images and producing a linear sequence of tokens. Unfortunately, many music scores, especially piano music, cannot be easily converted to a linear sequence. This has led OMR researchers to use custom linearized encodings, instead of broadly accepted structured formats for music notation. Their diversity makes it difficult to compare the performance of OMR systems directly. To bring recent OMR model progress closer to useful results: (a) We define a sequential format called Linearized MusicXML, allowing to train an end-to-end model directly and maintaining close cohesion and compatibility with the industry-standard MusicXML format. (b) We create a dev and test set for benchmarking typeset OMR with MusicXML ground truth based on the OpenScore Lieder corpus. They contain 1,438 and 1,493 pianoform systems, each with an image from IMSLP. (c) We train and fine-tune an end-to-end model to serve as a baseline on the dataset and employ the TEDn metric to evaluate the model. We also test our model against the recently published synthetic pianoform dataset GrandStaff and surpass the state-of-the-art results.


title: Positive sectional curvature is not preserved under the Ricci flow in dimensions seven and thirteen

abstract: We prove that there exist $\mathsf{SU}_{3}$-invariant metrics on Aloff-Wallach spaces $W^7_{k_1, k_2}$, as well as $\mathsf{SU}_{5}$-invariant metrics on the Berger space $B^{13}$, which have positive sectional curvature and evolve under the Ricci flow to metrics with non-positively curved planes.


title: Towards Principled Representation Learning from Videos for Reinforcement Learning

abstract: We study pre-training representations for decision-making using video data, which is abundantly available for tasks such as game agents and software testing. Even though significant empirical advances have been made on this problem, a theoretical understanding remains absent. We initiate the theoretical investigation into principled approaches for representation learning and focus on learning the latent state representations of the underlying MDP using video data. We study two types of settings: one where there is iid noise in the observation, and a more challenging setting where there is also the presence of exogenous noise, which is non-iid noise that is temporally correlated, such as the motion of people or cars in the background. We study three commonly used approaches: autoencoding, temporal contrastive learning, and forward modeling. We prove upper bounds for temporal contrastive learning and forward modeling in the presence of only iid noise. We show that these approaches can learn the latent state and use it to do efficient downstream RL with polynomial sample complexity. When exogenous noise is also present, we establish a lower bound result showing that the sample complexity of learning from video data can be exponentially worse than learning from action-labeled trajectory data. This partially explains why reinforcement learning with video pre-training is hard. We evaluate these representational learning methods in two visual domains, yielding results that are consistent with our theoretical findings.


title: Statistical estimation of full-sky radio maps from 21cm array visibility data using Gaussian Constrained Realisations

abstract: An important application of next-generation wide-field radio interferometers is making high dynamic range maps of radio emission. Traditional deconvolution methods like CLEAN can give poor recovery of diffuse structure, prompting the development of wide-field alternatives like Direct Optimal Mapping and $m$-mode analysis. In this paper, we propose an alternative Bayesian method to infer the coefficients of a full-sky spherical harmonic basis for a drift-scan telescope with potentially thousands of baselines. The can precisely encode the uncertainties and correlations between the parameters used to build the recovered image. We use Gaussian Constrained Realisations (GCR) to efficiently draw samples of the spherical harmonic coefficients, despite the very large parameter space and extensive sky-regions of missing data. Each GCR solution provides a complete, statistically-consistent gap-free realisation of a full-sky map conditioned on the available data, even when the interferometer's field of view is small. Many realisations can be generated and used for further analysis and robust propagation of statistical uncertainties. In this paper, we present the mathematical formalism of the spherical harmonic GCR-method for radio interferometers. We focus on the recovery of diffuse emission as a use case, along with validation of the method against simulations with a known diffuse emission component.


title: Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors

abstract: Power spectrum estimators are an important tool in efforts to detect the 21 cm brightness temperature fluctuations from neutral hydrogen at early times. An initial detection will likely be statistical in nature, meaning that it will not be possible to make a coherent map of the brightness temperature fluctuations; instead, only their variance will be measured against a background of noise and residual systematic effects. Optimal Quadratic Estimator (OQE)-based methods often apply an inverse covariance weighting to the data. However, inaccurate covariance modelling can lead to reduced sensitivity and, in some cases, severe signal loss. We recently proposed a Bayesian method to jointly estimate the 21 cm fluctuations, their power spectrum, and foreground emission. Instead of requiring a fixed a priori estimate of the covariance, we estimate the covariance as part of the inference. Choices of parametrization, particularly of the foregrounds, are subject to model errors and could lead to biases and other ill effects if not properly controlled. In this paper, we investigate the effects of inaccurate foreground models on 21 cm power spectrum recovery. Using simulated visibilities, we find that, even in the most extreme scenarios tested, our approach is capable of recovering 21 cm delay power spectrum estimates consistent with a known input signal for delays $\gtrsim300$ ns ($\sim$88\% of the available Fourier modes). This is true even when using foreground models derived from modified foreground catalogs containing spatial and spectral perturbations at the quoted level of uncertainty on our foreground catalogs.


title: Disentangling the anisotropic radio sky: Fisher forecasts for 21cm arrays

abstract: The existence of a radio synchrotron background (RSB) excess is implied by a number of measurements, including excess emission seen by the ARCADE~2 and LWA experiments. Highly sensitive wideband radio arrays, of the kind used to measure the cosmic 21cm signal, provide a promising way to further constrain the RSB excess through its anisotropy, providing additional insight into its origin. We present a framework for evaluating the potential of 21cm arrays to disentangle different components of the diffuse radio sky based on the combination of their frequency spectrum and angular power spectrum (APS). The formalism is designed to calculate uncertainties due to the intrinsic cosmic variance alone or together with instrumental noise. In particular, we predict the potential for measuring the anisotropy of a broad generalised class of excess radio background models using the low-frequency HERA array as an example. We find that a HERA-like array can distinguish an RSB excess from other sky components based on its angular clustering and spectral dependence, even if these are quite similar to one or more of the other components -- but only in the case that the RSB excess is relatively bright.


title: High-dimensional inference of radio interferometer beam patterns I: Parametric model of the HERA beams

abstract: Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity mapping, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement and calibration methods. In this paper series, we present a Bayesian framework to infer per-element beam patterns from the interferometric visibilities for large arrays with complex beam structure, assuming a particular (but potentially uncertain) sky model and calibration solution. In this first paper, we develop a compact basis for the beam so that the Bayesian computation is tractable with high-dimensional sampling methods. We use the Hydrogen Epoch of Reionization Array (HERA) as an example, verifying that the basis is capable of describing its single-element E-field beam (i.e. without considering array effects like mutual coupling) with a relatively small number of coefficients. We find that 32 coefficients per feed, incident polarization, and frequency, are sufficient to give percent-level and $\sim$10\% errors in the mainlobe and sidelobes respectively for the current HERA Vivaldi feeds, improving to $\sim 0.1\%$ and $\sim 1\%$ for 128 coefficients.


title: A convergent adaptive finite element stochastic Galerkin method based on multilevel expansions of random fields

abstract: The subject of this work is an adaptive stochastic Galerkin finite element method for parametric or random elliptic partial differential equations, which generates sparse product polynomial expansions with respect to the parametric variables of solutions. For the corresponding spatial approximations, an independently refined finite element mesh is used for each polynomial coefficient. The method relies on multilevel expansions of input random fields and achieves error reduction with uniform rate. In particular, the saturation property for the refinement process is ensured by the algorithm. The results are illustrated by numerical experiments, including cases with random fields of low regularity.


title: Describe-and-Dissect: Interpreting Neurons in Vision Networks with Language Models

abstract: In this paper, we propose Describe-and-Dissect (DnD), a novel method to describe the roles of hidden neurons in vision networks. DnD utilizes recent advancements in multimodal deep learning to produce complex natural language descriptions, without the need for labeled training data or a predefined set of concepts to choose from. Additionally, DnD is training-free, meaning we don't train any new models and can easily leverage more capable general purpose models in the future. We have conducted extensive qualitative and quantitative analysis to show that DnD outperforms prior work by providing higher quality neuron descriptions. Specifically, our method on average provides the highest quality labels and is more than 2 times as likely to be selected as the best explanation for a neuron than the best baseline.


title: Anomalous diffusion in polydisperse granular gases: Monte Carlo simulations

abstract: We perform a direct Monte Carlo simulation of the diffusion in a multicomponent granular medium. We investigate the diffusion coefficients and mean-squared displacements of granular particles in a polydisperse granular gas in a homogeneous cooling state containing an arbitrary number of species of different sizes and masses using both models of constant and time-dependent restitution coefficients. In our study, we used a powerful low-rank algorithm that allows for efficient simulation of highly polydisperse granular systems. Mean square displacements in Monte Carlo simulations are in good agreement with theoretical predictions.


title: The Limits of Identification in Discrete Choice

abstract: We study identification and linear independence in random utility models. We characterize the dimension of the random utility model as the cyclomatic complexity of a specific graphical representation of stochastic choice data. We show that, as the number of alternatives grows, any linearly independent set of preferences is a vanishingly small subset of the set of all preferences. We introduce a new condition on sets of preferences which is sufficient for linear independence. We demonstrate by example that the condition is not necessary, but is strictly weaker than other existing sufficient conditions.


title: Corner and Edge States in Topological Sierpinski Carpet Systems

abstract: Fractal lattices, with their self-similar and intricate structures, offer potential platforms for engineering physical properties on the nanoscale and also for realizing and manipulating high order topological insulator states in novel ways. Here we present a theoretical discussion on localized corner and edge states, as well as electronic properties emerging from topological phases in Sierpinski Carpet within a $\pi$-flux regime. A topological hopping parameter phase diagram is constructed from which different spatial localized states are identified following signatures of distinct fractal generations. The specific geometry and scaling properties of the fractal systems can guide the supported topological states types and their associated functionalities. A conductive device is proposed by coupling identical Sierpinski Carpet units providing transport response through projected edge states that carrier the details of the Sierpinski Carpet topology.


title: Gradings on associative triple systems of the second kind

abstract: On this work we study associative triple systems of the second kind. We show that for simple triple systems the automorphism group scheme is isomorphic to the automorphism group scheme of the $3$-graded associative algebra with involution constructed by Loos. This result will allow us to prove our main result which is a complete classification up to isomorphism of the gradings of structurable algebras.


title: Accurate heat currents via reorganised master equation

abstract: The accurate characterisation of energy exchanges between nanoscale quantum systems and their environments is of paramount importance for quantum technologies, and central to quantum thermodynamics. Here, we show that, in order to accurately approximate steady-state heat currents via perturbative master equations, the coupling-induced reorganisation correction to the system's energy must be carefully taken into account. Not doing so, may yield sizeable errors, especially at low, or even moderate temperatures. In particular, we show how a 'reorganised master equation' can produce very accurate estimates for the heat currents when the reorganisation energy is weak and one works with environments with a broad spectrum. Notably, such master equation outperforms its 'non-reorganised' counterpart in the calculation of heat currents, at modelling dynamics, and at correctly capturing equilibration. This is so even if both types of equation are derived to the same order of perturbation theory. Most importantly, working with reorganised master equations does not involve additional complications when compared with alternative approaches. Also, invoking the secular approximation to secure thermodynamic consistency does not compromise their precision.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: Embedding Pose Graph, Enabling 3D Foundation Model Capabilities with a Compact Representation

abstract: This paper presents the Embedding Pose Graph (EPG), an innovative method that combines the strengths of foundation models with a simple 3D representation suitable for robotics applications. Addressing the need for efficient spatial understanding in robotics, EPG provides a compact yet powerful approach by attaching foundation model features to the nodes of a pose graph. Unlike traditional methods that rely on bulky data formats like voxel grids or point clouds, EPG is lightweight and scalable. It facilitates a range of robotic tasks, including open-vocabulary querying, disambiguation, image-based querying, language-directed navigation, and re-localization in 3D environments. We showcase the effectiveness of EPG in handling these tasks, demonstrating its capacity to improve how robots interact with and navigate through complex spaces. Through both qualitative and quantitative assessments, we illustrate EPG's strong performance and its ability to outperform existing methods in re-localization. Our work introduces a crucial step forward in enabling robots to efficiently understand and operate within large-scale 3D spaces.


title: Certified Human Trajectory Prediction

abstract: Trajectory prediction plays an essential role in autonomous vehicles. While numerous strategies have been developed to enhance the robustness of trajectory prediction models, these methods are predominantly heuristic and do not offer guaranteed robustness against adversarial attacks and noisy observations. In this work, we propose a certification approach tailored for the task of trajectory prediction. To this end, we address the inherent challenges associated with trajectory prediction, including unbounded outputs, and mutli-modality, resulting in a model that provides guaranteed robustness. Furthermore, we integrate a denoiser into our method to further improve the performance. Through comprehensive evaluations, we demonstrate the effectiveness of the proposed technique across various baselines and using standard trajectory prediction datasets. The code will be made available online: https://s-attack.github.io/


title: Multi-scale Traffic Flow Modeling: A Renormalization Group Approach

abstract: Traffic flow modeling is typically performed at one of three different scales (microscopic, mesoscopic, or macroscopic), each with distinct modeling approaches. Recent works that attempt to merge models at different scales have yielded some success, but there still exists a need for a single modeling framework that can seamlessly model traffic flow across several spatiotemporal scales. The presented work utilizes a renormalization group (RG) theoretic approach, building upon our prior research on statistical mechanics-inspired traffic flow modeling. Specifically, we use an Ising model-inspired cellular automata model to represent traffic flow dynamics. RG transformations are applied to this model to obtain coarse-grained parameters (interaction and field coefficients) to simulate traffic at coarser spatiotemporal scales and different vehicular densities. We measure the accuracy of the coarse-grained traffic flow simulation using a pixel-based image correlation metric and find good correlation between the dynamics at different scales. Importantly, emergent traffic dynamics such as backward moving congestion waves are retained at coarser scales with this approach. The presented work has the potential to spur the development of a unified traffic flow modeling framework for transportation analysis across varied spatiotemporal scales, while retaining an analytical relationship between the model parameters at these scales.


title: Information-Theoretic Distillation for Reference-less Summarization

abstract: The current winning recipe for automatic summarization is using proprietary large-scale language models (LLMs) such as ChatGPT as is, or imitation learning from them as teacher models. While increasingly ubiquitous dependence on such large-scale language models is convenient, there remains an important question of whether small-scale models could have achieved competitive results, if we were to seek an alternative learning method -- that allows for a more cost-efficient, controllable, yet powerful summarizer. We present InfoSumm, a novel framework to distill a powerful summarizer based on the information-theoretic objective for summarization, without relying on either the LLM's capability or human-written references. To achieve this, we first propose a novel formulation of the desiderata of summarization (saliency, faithfulness and brevity) through the lens of mutual information between the original document and the summary. Based on this formulation, we start off from Pythia-2.8B as the teacher model, which is not yet capable of summarization, then self-train the model to optimize for the information-centric measures of ideal summaries. Distilling from the improved teacher, we arrive at a compact but powerful summarizer with only 568M parameters that performs competitively against ChatGPT, without ever relying on ChatGPT's capabilities. Extensive analysis demonstrates that our approach outperforms in-domain supervised models in human evaluation, let alone state-of-the-art unsupervised methods, and wins over ChatGPT in controllable summarization.


title: Sparse Implementation of Versatile Graph-Informed Layers

abstract: Graph Neural Networks (GNNs) have emerged as effective tools for learning tasks on graph-structured data. Recently, Graph-Informed (GI) layers were introduced to address regression tasks on graph nodes, extending their applicability beyond classic GNNs. However, existing implementations of GI layers lack efficiency due to dense memory allocation. This paper presents a sparse implementation of GI layers, leveraging the sparsity of adjacency matrices to reduce memory usage significantly. Additionally, a versatile general form of GI layers is introduced, enabling their application to subsets of graph nodes. The proposed sparse implementation improves the concrete computational efficiency and scalability of the GI layers, permitting to build deeper Graph-Informed Neural Networks (GINNs) and facilitating their scalability to larger graphs.


title: Surfactant-Driven Dynamic Changes in Rheology of Activated Carbon Slurry Electrodes

abstract: Slurry electrodes are an effective means to improve flow battery performance by reducing electrode fouling and increasing the active surface area necessary for electrochemical reactions. It is critical to understand how the slurry formulation impacts its rheological profile and ultimately battery performance. We study the linear and nonlinear rheology of activated carbon (AC) based slurry electrode used in an all-iron flow battery in the presence of a nonionic surfactant (Triton X-100). Our results show the slurry mimics a colloidal gel with elasticity remaining constant despite increasing surfactant concentration until $\alpha$(=C$_{surf.}$/C$_{AC}$) < 0.65. However, at $\alpha \ge$ 0.65, the slurry abruptly transitions to a fluid with no measurable yield stress. This critical surfactant concentration at which the rheological profile undergoes a dynamic change matches the concentration found previously for gel collapse of this system. Moreover, this transition is accompanied by a complete loss of electrical conductivity. These data show that site specific adsorption of surfactant molecules often used in slurry formulation have a significant and dramatic impact on flow behavior, which should be considered when formulating a slurry electrode.


title: A Convex Formulation of Frictional Contact for the Material Point Method and Rigid Bodies

abstract: In this paper, we introduce a novel convex formulation that seamlessly integrates the Material Point Method (MPM) with articulated rigid body dynamics in frictional contact scenarios. We extend the linear corotational hyperelastic model into the realm of elastoplasticity and include an efficient return mapping algorithm. This approach is particularly effective for MPM simulations involving significant deformation and topology changes, while preserving the convexity of the optimization problem. Our method ensures global convergence, enabling the use of large simulation time steps without compromising robustness. We have validated our approach through rigorous testing and performance evaluations, highlighting its superior capabilities in managing complex simulations relevant to robotics. Compared to previous MPM based robotic simulators, our method significantly improves the stability of contact resolution -- a critical factor in robot manipulation tasks. We make our method available in the open-source robotics toolkit, Drake.


title: The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligence

abstract: Generative AI (GAI) offers unprecedented opportunities for research and innovation, but its commercialization has raised concerns about transparency, reproducibility, and safety. Many open GAI models lack the necessary components for full understanding and reproducibility, and some use restrictive licenses whilst claiming to be ``open-source''. To address these concerns, we propose the Model Openness Framework (MOF), a ranked classification system that rates machine learning models based on their completeness and openness, following principles of open science, open source, open data, and open access. The MOF requires specific components of the model development lifecycle to be included and released under appropriate open licenses. This framework aims to prevent misrepresentation of models claiming to be open, guide researchers and developers in providing all model components under permissive licenses, and help individuals and organizations identify models that can be safely adopted without restrictions. By promoting transparency and reproducibility, the MOF combats ``openwashing'' practices and establishes completeness and openness as primary criteria alongside the core tenets of responsible AI. Wide adoption of the MOF will foster a more open AI ecosystem, benefiting research, innovation, and adoption of state-of-the-art models.


title: Towards an extension of Fault Trees in the Predictive Maintenance Scenario

abstract: One of the most appreciated features of Fault Trees (FTs) is their simplicity, making them fit into industrial processes. As such processes evolve in time, considering new aspects of large modern systems, modelling techniques based on FTs have adapted to these needs. This paper proposes an extension of FTs to take into account the problem of Predictive Maintenance, one of the challenges of the modern dependability field of study. The paper sketches the Predictive Fault Tree language and proposes some use cases to support their modelling and analysis in concrete industrial settings.


title: Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contexts

abstract: Automatic coding patient behaviors is essential to support decision making for psychotherapists during the motivational interviewing (MI), a collaborative communication intervention approach to address psychiatric issues, such as alcohol and drug addiction. While the behavior coding task has rapidly adapted machine learning to predict patient states during the MI sessions, lacking of domain-specific knowledge and overlooking patient-therapist interactions are major challenges in developing and deploying those models in real practice. To encounter those challenges, we introduce the Chain-of-Interaction (CoI) prompting method aiming to contextualize large language models (LLMs) for psychiatric decision support by the dyadic interactions. The CoI prompting approach systematically breaks down the coding task into three key reasoning steps, extract patient engagement, learn therapist question strategies, and integrates dyadic interactions between patients and therapists. This approach enables large language models to leverage the coding scheme, patient state, and domain knowledge for patient behavioral coding. Experiments on real-world datasets can prove the effectiveness and flexibility of our prompting method with multiple state-of-the-art LLMs over existing prompting baselines. We have conducted extensive ablation analysis and demonstrate the critical role of dyadic interactions in applying LLMs for psychotherapy behavior understanding.


title: RewardBench: Evaluating Reward Models for Language Modeling

abstract: Reward models (RMs) are at the crux of successfully using RLHF to align pretrained models to human preferences, yet there has been relatively little study that focuses on evaluation of those models. Evaluating reward models presents an opportunity to understand the opaque technologies used for alignment of language models and which values are embedded in them. Resources for reward model training and understanding are sparse in the nascent open-source community around them. To enhance scientific understanding of reward models, we present RewardBench, a benchmark dataset and code-base for evaluation. The RewardBench dataset is a collection of prompt-chosen-rejected trios spanning chat, reasoning, and safety, to benchmark how reward models perform on challenging, structured and out-of-distribution queries. We create specific comparison datasets for RMs that have subtle, but verifiable reasons (e.g. bugs, incorrect facts) why one answer should be preferred to another. On the RewardBench leaderboard, we evaluate reward models trained with a variety of methods, such as the direct MLE training of classifiers and the implicit reward modeling of Direct Preference Optimization (DPO). We present many findings on propensity for refusals, reasoning limitations, and instruction following shortcomings of various reward models towards a better understanding of the RLHF process.


title: DepthFM: Fast Monocular Depth Estimation with Flow Matching

abstract: Monocular depth estimation is crucial for numerous downstream vision tasks and applications. Current discriminative approaches to this problem are limited due to blurry artifacts, while state-of-the-art generative methods suffer from slow sampling due to their SDE nature. Rather than starting from noise, we seek a direct mapping from input image to depth map. We observe that this can be effectively framed using flow matching, since its straight trajectories through solution space offer efficiency and high quality. Our study demonstrates that a pre-trained image diffusion model can serve as an adequate prior for a flow matching depth model, allowing efficient training on only synthetic data to generalize to real images. We find that an auxiliary surface normals loss further improves the depth estimates. Due to the generative nature of our approach, our model reliably predicts the confidence of its depth estimates. On standard benchmarks of complex natural scenes, our lightweight approach exhibits state-of-the-art performance at favorable low computational cost despite only being trained on little synthetic data.


title: The sPHENIX Micromegas Outer Tracker

abstract: The sPHENIX Time Projection Chamber Outer Tracker (TPOT) is a Micromegas based detector. It is a part of the sPHENIX experiment that aims to facilitate the calibration of the Time Projection Chamber, in particular the correction of the time-averaged and beam-induced distortions of the electron drift. This paper describes the detector mission, setup, construction, installation, commissioning and performance during the first year of sPHENIX data taking.


title: Probing Hilbert Space Fragmentation with Strongly Interacting Rydberg Atoms

abstract: Hilbert space fragmentation provides a mechanism to break ergodicity in closed many-body systems. Here, we propose a realistic scheme to comprehensively explore this exotic paradigm on a Rydberg quantum simulator. We show that the Rydberg Ising model in the large detuning regime can be mapped to a generalized folded XXZ model featuring a strongly fragmented Hilbert space. The emergent Hamiltonian, however, displays distinct time scales for the transport of a magnon and a hole excitation. This interesting property facilitates a continuous tuning of the Krylov-subspace ergodicity, from the integrable regime, to the Krylov-restricted thermal phase, and eventually to the statistical bubble localization region. By further introducing nonlocal interactions, we find that both the fragmentation behavior and the ergodicity of the Krylov subspace can be significantly enriched. We also examine the role of atomic position disorders and identify a symmetry-selective many-body localization transition. We demonstrate that these phenomena manifest themselves in quench dynamics, which can be readily probed in state-of-the-art Rydberg array setups.


title: New Stochastic Fubini Theorems

abstract: The classic stochastic Fubini theorem says that if one stochastically integrates with respect to a semimartingale $S$ an $\eta(dz)$-mixture of $z$-parametrized integrands $\psi^z$, the result is just the $\eta(dz)$-mixture of the individual $z$-parametrized stochastic integrals $\int\psi^z{d}S.$ But if one wants to use such a result for the study of Volterra semimartingales of the form $ X_t =\int_0^t \Psi_{t,s}dS_s, t \geq0,$ the classic assumption that one has a fixed measure $\eta$ is too restrictive; the mixture over the integrands needs to be taken instead with respect to a stochastic kernel on the parameter space. To handle that situation and prove a corresponding new stochastic Fubini theorem, we introduce a new notion of measure-valued stochastic integration with respect to a general multidimensional semimartingale. As an application, we show how this allows to handle a class of quite general stochastic Volterra semimartingales.


title: Moderate Deviations of Triangle Counts in the Erd\H{o}s-R\'enyi Random Graph $G(n,m)$: The Lower Tail

abstract: Let $N_{\triangle}(G)$ be the number of triangles in a graph $G$. In [14] and [25] (respectively) the following bounds were proved on the lower tail behaviour of triangle counts in the dense Erd\H{o}s-R\'enyi random graphs $G_m\sim G(n,m)$: \[ \mathbb{P}\big(N_{\triangle}(G_m) \, < \, (1-\delta)\mathbb{E}[N_{\triangle}(G_m)]\big) \,=\, \exp\left(-\Theta\left(\delta^2n^3\right)\right) \qquad \text{if $n^{-3/2}\ll \delta\ll n^{-1}$} \] and \[ \mathbb{P}\big(N_{\triangle}(G_m) \, < \, (1-\delta)\mathbb{E}[N_{\triangle}(G_m)]\big) \,=\, \exp\left(-\Theta(\delta^{2/3}n^2) \right) \qquad \text{if $n^{-3/4} \ll \delta \ll 1$.} \] Neeman, Radin and Sadun [25] also conjectured that the probability should be of the form $\exp\left(-\Theta\left(\delta^2n^3\right)\right)$ in the "missing interval" $n^{-1}\ll \delta\ll n^{-3/4}$. We prove this conjecture. As part of our proof we also prove that some random graph statistics, related to degrees and codegrees, are normally distributed with high probability.


title: Evaluating Frontier Models for Dangerous Capabilities

abstract: To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations cover four areas: (1) persuasion and deception; (2) cyber-security; (3) self-proliferation; and (4) self-reasoning. We do not find evidence of strong dangerous capabilities in the models we evaluated, but we flag early warning signs. Our goal is to help advance a rigorous science of dangerous capability evaluation, in preparation for future models.


title: Cosmic shear with small scales: DES-Y3, KiDS-1000 and HSC-DR1

abstract: We present a cosmological analysis of the combination of the DES-Y3, KiDS-1000 and HSC-DR1 weak lensing samples under a joint harmonic-space pipeline making use of angular scales down to $\ell_{\rm max}=4500$, corresponding to significantly smaller scales ($\delta\theta\sim2.4'$) than those commonly used in cosmological weak lensing studies. We are able to do so by accurately modelling non-linearities and the impact of baryonic effects using Baccoemu. We find $S_8\equiv\sigma_8\sqrt{\Omega_{\rm m}/0.3}=0.795^{+0.015}_{-0.017}$, in relatively good agreement with CMB constraints from Planck (less than $\sim1.8\sigma$ tension), although we obtain a low value of $\Omega_{\rm m}=0.212^{+0.017}_{-0.032}$, in tension with Planck at the $\sim3\sigma$ level. We show that this can be recast as an $H_0$ tension if one parametrises the amplitude of fluctuations and matter abundance in terms of variables without hidden dependence on $H_0$. Furthermore, we find that this tension reduces significantly after including a prior on the distance-redshift relationship from BAO data, without worsening the fit. In terms of baryonic effects, we show that failing to model and marginalise over them on scales $\ell\lesssim2000$ does not significantly affect the posterior constraints for DES-Y3 and KiDS-1000, but has a mild effect on deeper samples, such as HSC-DR1. This is in agreement with our ability to only mildly constrain the parameters of the Baryon Correction Model with these data


title: PyVRP: a high-performance VRP solver package

abstract: We introduce PyVRP, a Python package that implements hybrid genetic search in a state-of-the-art vehicle routing problem (VRP) solver. The package is designed for the VRP with time windows (VRPTW), but can be easily extended to support other VRP variants. PyVRP combines the flexibility of Python with the performance of C++, by implementing (only) performance critical parts of the algorithm in C++, while being fully customisable at the Python level. PyVRP is a polished implementation of the algorithm that ranked 1st in the 2021 DIMACS VRPTW challenge and, after improvements, ranked 1st on the static variant of the EURO meets NeurIPS 2022 vehicle routing competition. The code follows good software engineering practices, and is well-documented and unit tested. PyVRP is freely available under the liberal MIT license. Through numerical experiments we show that PyVRP achieves state-of-the-art results on the VRPTW and capacitated VRP. We hope that PyVRP enables researchers and practitioners to easily and quickly build on a state-of-the-art VRP solver.


title: The VELOCE Modulation Zoo I. Spectroscopic detection of non-radial modes in the first-overtone Cepheids BG Crucis, QZ Normae, V0391 Normae, and V0411 Lacertae

abstract: The photometric observations from the recent decade revolutionized our view on classical pulsators. Low-amplitude signals have been detected photometrically in addition to the dominant high-amplitude radial mode pulsations in many RR Lyrae stars and classical Cepheids. First overtone (1O) pulsators with an additional low-amplitude signal at a period ratio of around 0.61 with the main mode, the so-called 0.61 stars, form the most populous group among these stars. The nature of this signal has been attributed to non-radial pulsations. Another mysterious group are stars, where the additional signal forms a period ratio of around 0.68 - the 0.68 stars. The origin of the signal remains unknown. Here, we search for similar phenomena in spectroscopic observations of 1O classical Cepheids collected as part of the VELOCE project. We performed frequency analysis of several parameters derived from cross-correlation functions (CCFs), including radial velocity, FWHM, bisector inverse span, and CCF depth. Using standard prewhitening, we searched for additional low-amplitude signals. We identify the location of these stars in various sequences of the Petersen diagram. We detect additional signals in four 1O classical Cepheids: BG Cru, QZ Nor, V391 Nor, and V411 Lac. We classified BG Cru, QZ Nor, and V391 Nor as 0.61 stars based on period ratios. V411 Lac, however, exhibits a ratio of 0.68 between the two modes, and the additional signal has a longer period. This kind of multiperiodicity remains unexplained. VELOCE CCFs yield the first spectroscopic detections of non-radial pulsation modes in classical Cepheids. This opens an asteroseismic window for pursuing a more detailed understanding of these important stars. While the 0.61 signal of BG Cru, QZ Nor, V391 Nor is understood to originate due to non-radial modes of moderate degrees, the 0.68 signal of V411 Lac still lacks a physical explanation.


title: Bridge the Modality and Capacity Gaps in Vision-Language Model Selection

abstract: Vision Language Models (VLMs) excel in zero-shot image classification by pairing images with textual category names. The expanding variety of Pre-Trained VLMs enhances the likelihood of identifying a suitable VLM for specific tasks. Thus, a promising zero-shot image classification strategy is selecting the most appropriate Pre-Trained VLM from the VLM Zoo, relying solely on the text data of the target dataset without access to the dataset's images. In this paper, we analyze two inherent challenges in assessing the ability of a VLM in this Language-Only VLM selection: the "Modality Gap" -- the disparity in VLM's embeddings across two different modalities, making text a less reliable substitute for images; and the "Capability Gap" -- the discrepancy between the VLM's overall ranking and its ranking for target dataset, hindering direct prediction of a model's dataset-specific performance from its general performance. We propose VLM Selection With gAp Bridging (SWAB) to mitigate the negative impact of these two gaps. SWAB first adopts optimal transport to capture the relevance between open-source datasets and target dataset with a transportation matrix. It then uses this matrix to transfer useful statistics of VLMs from open-source datasets to the target dataset for bridging those two gaps and enhancing the VLM's capacity estimation for VLM selection. Experiments across various VLMs and image classification datasets validate SWAB's effectiveness.


title: Hierarchical NeuroSymbolic Approach for Comprehensive and Explainable Action Quality Assessment

abstract: Action quality assessment (AQA) applies computer vision to quantitatively assess the performance or execution of a human action. Current AQA approaches are end-to-end neural models, which lack transparency and tend to be biased because they are trained on subjective human judgements as ground-truth. To address these issues, we introduce a neuro-symbolic paradigm for AQA, which uses neural networks to abstract interpretable symbols from video data and makes quality assessments by applying rules to those symbols. We take diving as the case study. We found that domain experts prefer our system and find it more informative than purely neural approaches to AQA in diving. Our system also achieves state-of-the-art action recognition and temporal segmentation, and automatically generates a detailed report that breaks the dive down into its elements and provides objective scoring with visual evidence. As verified by a group of domain experts, this report may be used to assist judges in scoring, help train judges, and provide feedback to divers. Annotated training data and code: https://github.com/laurenok24/NSAQA.


title: Reverse Training to Nurse the Reversal Curse

abstract: Large language models (LLMs) have a surprising failure: when trained on "A has a feature B", they do not generalize to "B is a feature of A", which is termed the Reversal Curse. Even when training with trillions of tokens this issue still appears due to Zipf's law - hence even if we train on the entire internet. This work proposes an alternative training scheme, called reverse training, whereby all words are used twice, doubling the amount of available tokens. The LLM is trained in both forward and reverse directions by reversing the training strings while preserving (i.e., not reversing) chosen substrings, such as entities. We show that data-matched reverse-trained models provide superior performance to standard models on standard tasks, and compute-matched reverse-trained models provide far superior performance on reversal tasks, helping resolve the reversal curse issue.


title: TimeRewind: Rewinding Time with Image-and-Events Video Diffusion

abstract: This paper addresses the novel challenge of ``rewinding'' time from a single captured image to recover the fleeting moments missed just before the shutter button is pressed. This problem poses a significant challenge in computer vision and computational photography, as it requires predicting plausible pre-capture motion from a single static frame, an inherently ill-posed task due to the high degree of freedom in potential pixel movements. We overcome this challenge by leveraging the emerging technology of neuromorphic event cameras, which capture motion information with high temporal resolution, and integrating this data with advanced image-to-video diffusion models. Our proposed framework introduces an event motion adaptor conditioned on event camera data, guiding the diffusion model to generate videos that are visually coherent and physically grounded in the captured events. Through extensive experimentation, we demonstrate the capability of our approach to synthesize high-quality videos that effectively ``rewind'' time, showcasing the potential of combining event camera technology with generative models. Our work opens new avenues for research at the intersection of computer vision, computational photography, and generative modeling, offering a forward-thinking solution to capturing missed moments and enhancing future consumer cameras and smartphones. Please see the project page at https://timerewind.github.io/ for video results and code release.


title: Natural Language as Policies: Reasoning for Coordinate-Level Embodied Control with LLMs

abstract: We demonstrate experimental results with LLMs that address robotics task planning problems. Recently, LLMs have been applied in robotics task planning, particularly using a code generation approach that converts complex high-level instructions into mid-level policy codes. In contrast, our approach acquires text descriptions of the task and scene objects, then formulates task planning through natural language reasoning, and outputs coordinate level control commands, thus reducing the necessity for intermediate representation code as policies with pre-defined APIs. Our approach is evaluated on a multi-modal prompt simulation benchmark, demonstrating that our prompt engineering experiments with natural language reasoning significantly enhance success rates compared to its absence. Furthermore, our approach illustrates the potential for natural language descriptions to transfer robotics skills from known tasks to previously unseen tasks. The project website: https://natural-language-as-policies.github.io/


title: ZigMa: A DiT-style Zigzag Mamba Diffusion Model

abstract: The diffusion model has long been plagued by scalability and quadratic complexity issues, especially within transformer-based structures. In this study, we aim to leverage the long sequence modeling capability of a State-Space Model called Mamba to extend its applicability to visual data generation. Firstly, we identify a critical oversight in most current Mamba-based vision methods, namely the lack of consideration for spatial continuity in the scan scheme of Mamba. Secondly, building upon this insight, we introduce a simple, plug-and-play, zero-parameter method named Zigzag Mamba, which outperforms Mamba-based baselines and demonstrates improved speed and memory utilization compared to transformer-based baselines. Lastly, we integrate Zigzag Mamba with the Stochastic Interpolant framework to investigate the scalability of the model on large-resolution visual datasets, such as FacesHQ $1024\times 1024$ and UCF101, MultiModal-CelebA-HQ, and MS COCO $256\times 256$ . Code will be released at https://taohu.me/zigma/


title: Bounding Box Stability against Feature Dropout Reflects Detector Generalization across Environments

abstract: Bounding boxes uniquely characterize object detection, where a good detector gives accurate bounding boxes of categories of interest. However, in the real-world where test ground truths are not provided, it is non-trivial to find out whether bounding boxes are accurate, thus preventing us from assessing the detector generalization ability. In this work, we find under feature map dropout, good detectors tend to output bounding boxes whose locations do not change much, while bounding boxes of poor detectors will undergo noticeable position changes. We compute the box stability score (BoS score) to reflect this stability. Specifically, given an image, we compute a normal set of bounding boxes and a second set after feature map dropout. To obtain BoS score, we use bipartite matching to find the corresponding boxes between the two sets and compute the average Intersection over Union (IoU) across the entire test set. We contribute to finding that BoS score has a strong, positive correlation with detection accuracy measured by mean average precision (mAP) under various test environments. This relationship allows us to predict the accuracy of detectors on various real-world test sets without accessing test ground truths, verified on canonical detection tasks such as vehicle detection and pedestrian detection. Code and data are available at https://github.com/YangYangGirl/BoS.


title: Learning from Models and Data for Visual Grounding

abstract: We introduce SynGround, a novel framework that combines data-driven learning and knowledge transfer from various large-scale pretrained models to enhance the visual grounding capabilities of a pretrained vision-and-language model. The knowledge transfer from the models initiates the generation of image descriptions through an image description generator. These descriptions serve dual purposes: they act as prompts for synthesizing images through a text-to-image generator, and as queries for synthesizing text, from which phrases are extracted using a large language model. Finally, we leverage an open-vocabulary object detector to generate synthetic bounding boxes for the synthetic images and texts. We finetune a pretrained vision-and-language model on this dataset by optimizing a mask-attention consistency objective that aligns region annotations with gradient-based model explanations. The resulting model improves the grounding capabilities of an off-the-shelf vision-and-language model. Particularly, SynGround improves the pointing game accuracy of ALBEF on the Flickr30k dataset from 79.38% to 87.26%, and on RefCOCO+ Test A from 69.35% to 79.06% and on RefCOCO+ Test B from 53.77% to 63.67%.


title: RAR: Retrieving And Ranking Augmented MLLMs for Visual Recognition

abstract: CLIP (Contrastive Language-Image Pre-training) uses contrastive learning from noise image-text pairs to excel at recognizing a wide array of candidates, yet its focus on broad associations hinders the precision in distinguishing subtle differences among fine-grained items. Conversely, Multimodal Large Language Models (MLLMs) excel at classifying fine-grained categories, thanks to their substantial knowledge from pre-training on web-level corpora. However, the performance of MLLMs declines with an increase in category numbers, primarily due to growing complexity and constraints of limited context window size. To synergize the strengths of both approaches and enhance the few-shot/zero-shot recognition abilities for datasets characterized by extensive and fine-grained vocabularies, this paper introduces RAR, a Retrieving And Ranking augmented method for MLLMs. We initially establish a multi-modal retriever based on CLIP to create and store explicit memory for different categories beyond the immediate context window. During inference, RAR retrieves the top-k similar results from the memory and uses MLLMs to rank and make the final predictions. Our proposed approach not only addresses the inherent limitations in fine-grained recognition but also preserves the model's comprehensive knowledge base, significantly boosting accuracy across a range of vision-language recognition tasks. Notably, our approach demonstrates a significant improvement in performance on 5 fine-grained visual recognition benchmarks, 11 few-shot image recognition datasets, and the 2 object detection datasets under the zero-shot recognition setting.


title: RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS

abstract: Recent advances in view synthesis and real-time rendering have achieved photorealistic quality at impressive rendering speeds. While Radiance Field-based methods achieve state-of-the-art quality in challenging scenarios such as in-the-wild captures and large-scale scenes, they often suffer from excessively high compute requirements linked to volumetric rendering. Gaussian Splatting-based methods, on the other hand, rely on rasterization and naturally achieve real-time rendering but suffer from brittle optimization heuristics that underperform on more challenging scenes. In this work, we present RadSplat, a lightweight method for robust real-time rendering of complex scenes. Our main contributions are threefold. First, we use radiance fields as a prior and supervision signal for optimizing point-based scene representations, leading to improved quality and more robust optimization. Next, we develop a novel pruning technique reducing the overall point count while maintaining high quality, leading to smaller and more compact scene representations with faster inference speeds. Finally, we propose a novel test-time filtering approach that further accelerates rendering and allows to scale to larger, house-sized scenes. We find that our method enables state-of-the-art synthesis of complex captures at 900+ FPS.


title: Editing Massive Concepts in Text-to-Image Diffusion Models

abstract: Text-to-image diffusion models suffer from the risk of generating outdated, copyrighted, incorrect, and biased content. While previous methods have mitigated the issues on a small scale, it is essential to handle them simultaneously in larger-scale real-world scenarios. We propose a two-stage method, Editing Massive Concepts In Diffusion Models (EMCID). The first stage performs memory optimization for each individual concept with dual self-distillation from text alignment loss and diffusion noise prediction loss. The second stage conducts massive concept editing with multi-layer, closed form model editing. We further propose a comprehensive benchmark, named ImageNet Concept Editing Benchmark (ICEB), for evaluating massive concept editing for T2I models with two subtasks, free-form prompts, massive concept categories, and extensive evaluation metrics. Extensive experiments conducted on our proposed benchmark and previous benchmarks demonstrate the superior scalability of EMCID for editing up to 1,000 concepts, providing a practical approach for fast adjustment and re-deployment of T2I diffusion models in real-world applications.


title: On Pretraining Data Diversity for Self-Supervised Learning

abstract: We explore the impact of training with more diverse datasets, characterized by the number of unique samples, on the performance of self-supervised learning (SSL) under a fixed computational budget. Our findings consistently demonstrate that increasing pretraining data diversity enhances SSL performance, albeit only when the distribution distance to the downstream data is minimal. Notably, even with an exceptionally large pretraining data diversity achieved through methods like web crawling or diffusion-generated data, among other ways, the distribution shift remains a challenge. Our experiments are comprehensive with seven SSL methods using large-scale datasets such as ImageNet and YFCC100M amounting to over 200 GPU days. Code and trained models will be available at https://github.com/hammoudhasan/DiversitySSL .


title: Predicting Confinement Effect of Carbon Fiber Reinforced Polymers on Strength of Concrete using Metaheuristics-based Artificial Neural Networks

abstract: This article deals with the study of predicting the confinement effect of carbon fiber reinforced polymers (CFRPs) on concrete cylinder strength using metaheuristics-based artificial neural networks. A detailed database of 708 CFRP confined concrete cylinders is developed from previously published research with information on 8 parameters including geometrical parameters like the diameter (d) and height (h) of a cylinder, unconfined compressive strength of concrete (fco'), thickness (nt), the elastic modulus of CFRP (Ef), unconfined concrete strain confined concrete strain and the ultimate compressive strength of confined concrete fcc'. Three metaheuristic models are implemented including particle swarm optimization (PSO), grey wolf optimizer (GWO), and bat algorithm (BA). These algorithms are trained on the data using an objective function of mean square error and their predicted results are validated against the experimental studies and finite element analysis. The study shows that the hybrid model of PSO predicted the strength of CFRP-confined concrete cylinders with maximum accuracy of 99.13% and GWO predicted the results with an accuracy of 98.17%. The high accuracy of axial compressive strength predictions demonstrated that these prediction models are a reliable solution to the empirical methods. The prediction models are especially suitable for avoiding full-scale time-consuming experimental tests that make the process quick and economical.


title: The Majorana Hopping and Constraints in the Anti-de Sitter Spacetime

abstract: Comformally flat spacetime converts the Anti-de Sitter (AdS) spacetime into a z-dependent metric. We take advantage of this metric to solve Dirac equations in the AdS geometry analytically, including Dirac, Majorana, Dirac tachyon and Majorana tachyon. Constraints on Majorana wavefunctions limit the mass. Besides, there gives rise flatlands and Majorana particles hop in between, just mimicking the D-brane stack and open strings. Furthermore, a plausible way of ion-trapped experiment is suggested.


title: Interaction of photons with silver and indium nuclei at energies up to 20 MeV

abstract: The yields of photonuclear reactions in the 107Ag, 113In, and 115In nuclei have been measured. Monte Carlo simulations have been performed using the Geant4 code, and the results have been compared with the experimental ones. The isomeric ratios of the yields in the reactions 107Ag({\gamma},n)106m,gAg and 113In({\gamma},n)112m,gIn have been determined. The cross sections for the reactions 107Ag({\gamma},n)106gAg and 107Ag({\gamma},2n)105Ag at an energy of 20 MeV have been calculated on the basis of the experimental data.


title: Quantitative Analysis of AI-Generated Texts in Academic Research: A Study of AI Presence in Arxiv Submissions using AI Detection Tool

abstract: Many people are interested in ChatGPT since it has become a prominent AIGC model that provides high-quality responses in various contexts, such as software development and maintenance. Misuse of ChatGPT might cause significant issues, particularly in public safety and education, despite its immense potential. The majority of researchers choose to publish their work on Arxiv. The effectiveness and originality of future work depend on the ability to detect AI components in such contributions. To address this need, this study will analyze a method that can see purposely manufactured content that academic organizations use to post on Arxiv. For this study, a dataset was created using physics, mathematics, and computer science articles. Using the newly built dataset, the following step is to put originality.ai through its paces. The statistical analysis shows that Originality.ai is very accurate, with a rate of 98%.


title: Intercomparison exercise on Monte Carlo simulations of electron spectra and energy depositions by a single gold nanoparticle under X-ray irradiation

abstract: Computational approaches, such as Monte Carlo (MC) radiation transport simulations, are used to estimate the dosimetric effects of GNPs, where results differing by orders of magnitudes have been reported by different investigators. This has motivated an intercomparison exercise, which was conducted as a joint activity of EURADOS Working Groups 6 "Computational Dosimetry" and 7 "Internal Dosimetry". The aim of this exercise was to determine the extent of such discrepancies between the results obtained by different researchers and different codes in a very simple simulation setup. Several individual EURADOS associate members and two code developer groups from outside Europe participated in this exercise applying seven different MC codes to perform the simulations of a simple defined geometry set-up of one single GNP irradiated in water by kilo-voltage X-rays. Two GNP diameters of 50 nm and 100 nm of were considered and two photon spectra as generated by X-ray tubes operated at 50 kV and 100 kV peak voltages. The geometry set-up and X-ray spectra were provided by the EURADOS task group. The participants were asked to determine for each combination of GNP size and X-ray spectrum the dose enhancement ratio (DER) of 10 nm-thick water shells up to 1000 nm and 1 $\mu$m-thick water shells up to 50 $\mu$m around the GNP. Furthermore, the electron spectra emitted from the GNP and the energy depositions in water shells around it were also to be reported. This EURADOS report summarizes the motivation and background for the exercise, the tasks to be solved, the codes used, the results reported by the participants, the consistency checks applied in their evaluation and a best estimates and uncertainty bands derived from the final results for the energy spectra of emitted electrons and the energy imparted in the vicinity of the GNP.


title: DyFeO3 electrode material with ultra-wide voltage window for aqueous symmetric supercapacitors

abstract: Aqueous supercapacitors (SCs) encounter limitations in operational voltage and energy density due to the low decomposition voltage of water. Here, we fabricate aqueous symmetric supercapacitors (ASSCs) employing DyFeO3 as an electrode material. This hybrid SC in a 0.5 M Na2SO4 aqueous electrolyte exhibits a significantly high working voltage of 2.5 V, with an energy density of 41.81 Wh/kg at a power density of 1250 W/kg, maintaining 94% capacitance retention after 5000 cycles. By incorporating 20% volume of acetonitrile with water in the electrolyte, we extend the potential window to 3.1 V, with an energy density of 84.43 Wh/kg at a power density of 1550 W/kg. The as-fabricated ASSC shows promising stability during a 300-hour float voltage test with almost intact capacitance retention and Coulombic efficiency. For the first time, our study unveils the potential of porous DyFeO3 as an electrode material for advancing ASSCs, featuring an unprecedented ultra-wide voltage window, along with significantly large energy and power densities.


title: Autonomous microARPES

abstract: Angle-resolved photoemission spectroscopy (ARPES) is a technique used to map the occupied electronic structure of solids. Recent progress in X-ray focusing optics has led to the development of ARPES into a microscopic tool, permitting the electronic structure to be spatially mapped across the surface of a sample. This comes at the expense of a time-consuming scanning process to cover not only a three-dimensional energy-momentum ($E, k_z, k_y$) space but also the two-dimensional surface area. Here, we implement a protocol to autonomously search both $\mathbf{k}$- and real space in order to find positions of particular interest, either because of their high photoemission intensity or because of sharp spectral features. The search is based on the use of Gaussian process regression and can easily be expanded to include additional parameters or optimisation criteria. This autonomous experimental control is implemented on the SGM4 micro-focus beamline of the synchrotron radiation source ASTRID2.


title: Combined X-ray diffraction, electrical resistivity, and $ab$ $initio$ study of (TMTTF)$_2$PF$_6$ under pressure: implications to the unified phase diagram

abstract: We present a combined experimental and theoretical study on the quasi-one-dimensional organic conductor (TMTTF)$_2$PF$_6$, and elucidate the variation of its physical properties under pressure. We fully resolve the crystal structure by single crystal x-ray diffraction measurements using a diamond anvil cell up to 8 GPa, and based on the structural data, we perform first-principles density-functional theory calculations and derive the $ab$ $initio$ extended Hubbard-type Hamiltonians. Furthermore, we compare the behavior of the resistivity measured up to 3 GPa using a BeCu clamp-type cell and the ground state properties of the obtained model numerically calculated by the many-variable variational Monte Carlo method. Our main findings are as follows: i) The crystal was rapidly compressed up to about 3 GPa where the volume drops to 80% and gradually varies down to 70% at 8 GPa. The transfer integrals increase following such behavior whereas the screened Coulomb interactions decrease, resulting in a drastic reduction of correlation effect. ii) The degree of dimerization in the intrachain transfer integrals, as the result of the decrease in structural dimerization together with the change in the intermolecular configuration, almost disappears above 4 GPa; the interchain transfer integrals also show characteristic variations under pressure. iii) The results of identifying the characteristic temperatures in the resistivity and the charge and spin orderings in the calculations show an overall agreement: The charge ordering sensitively becomes unstable above 1 GPa, while the spin ordering survives up to higher pressures. These results shed light on the similarities and differences between applying external pressure and substituting the chemical species (chemical pressure).


title: Exploring magnetic anisotropy in bcc-structured ferromagnetic thin films with three spin layers using the fourth order perturbed Heisenberg Hamiltonian

abstract: This study investigates into the analysis of ferromagnetic thin films with a body centered cubic lattice and three spin layers, utilizing the solution of the fourth-order perturbed Heisenberg Hamiltonian equation with seven magnetic energy parameters. Spin-exchange interaction, magnetic dipole interaction, second-order magnetic anisotropy,fourth-order magnetic anisotropy, applied magnetic field, demagnetization energy, and stress-induced anisotropy were all taken into account. According to 3D plots, the minimum order of energy was observed when the second order magnetic anisotropy constant in the middle spin layer is less than those of the bottom and top spin layers. In all cases, the values of stress-induced anisotropy at the maxima of 3D plots are exactly the same when the values of the second-order magnetic anisotropy constants of the bottom, middle, and top spin layers are interchanged with each other. In 2D plots, the angle between consecutive magnetic easy and hard directions is approximately 90 degrees in all cases. Additionally, the magnetic easy and hard directions were observed to have exactly the same values when the second-order magnetic anisotropy constant of the spin layers changes. These results were compared with the results obtained using the second and third order perturbed Heisenberg Hamiltonian.


title: Experimental Investigation of an Incremental Contact Model for Hyperelastic Solids Using In-Situ Optical Interferometric Technique

abstract: The hyperelastic materials would contribute to the intricacies of rough surface contact, primarily due to the heightened nonlinearity caused by stress concentration. In our previous research, an incremental contact model tailored for hyperelastic materials is proposed and validated by finite element (FEM) simulations. From an experimental perspective, this study employs an in-situ optical interferometric technique to precisely document the actual contact zone between hyperelastic solids and quartz glass. Simultaneously, the contact force is meticulously recorded in sync by a force sensor positioned beneath the hyperelastic samples. Comparing with the predictions of incremental contact model for hyperelastic materials, a significant agreement becomes evident, almost in a range of nearly complete contact. Its significance extends to practical domains such as sealing mechanisms, leakage prevention, and structural integrity, offering valuable insights for these applications.


title: A machine learning approach to predict university enrolment choices through students' high school background in Italy

abstract: This paper explores the influence of Italian high school students' proficiency in mathematics and the Italian language on their university enrolment choices, specifically focusing on STEM (Science, Technology, Engineering, and Mathematics) courses. We distinguish between students from scientific and humanistic backgrounds in high school, providing valuable insights into their enrolment preferences. Furthermore, we investigate potential gender differences in response to similar previous educational choices and achievements. The study employs gradient boosting methodology, known for its high predicting performance and ability to capture non-linear relationships within data, and adjusts for variables related to the socio-demographic characteristics of the students and their previous educational achievements. Our analysis reveals significant differences in the enrolment choices based on previous high school achievements. The findings shed light on the complex interplay of academic proficiency, gender, and high school background in shaping students' choices regarding university education, with implications for educational policy and future research endeavours.


title: Identity information based on human magnetocardiography signals

abstract: We have developed an individual identification system based on magnetocardiography (MCG) signals captured using optically pumped magnetometers (OPMs). Our system utilizes pattern recognition to analyze the signals obtained at different positions on the body, by scanning the matrices composed of MCG signals with a 2*2 window. In order to make use of the spatial information of MCG signals, we transform the signals from adjacent small areas into four channels of a dataset. We further transform the data into time-frequency matrices using wavelet transforms and employ a convolutional neural network (CNN) for classification. As a result, our system achieves an accuracy rate of 97.04% in identifying individuals. This finding indicates that the MCG signal holds potential for use in individual identification systems, offering a valuable tool for personalized healthcare management.


title: Offensive Lineup Analysis in Basketball with Clustering Players Based on Shooting Style and Offensive Role

abstract: In a basketball game, scoring efficiency holds significant importance due to the numerous offensive possessions per game. Enhancing scoring efficiency necessitates effective collaboration among players with diverse playing styles. In previous studies, basketball lineups have been analyzed, but their playing style compatibility has not been quantitatively examined. The purpose of this study is to analyze more specifically the impact of playing style compatibility on scoring efficiency, focusing only on offense. This study employs two methods to capture the playing styles of players on offense: shooting style clustering using tracking data, and offensive role clustering based on annotated playtypes and advanced statistics. For the former, interpretable hand-crafted shot features and Wasserstein distances between shooting style distributions were utilized. For the latter, soft clustering was applied to playtype data for the first time. Subsequently, based on the lineup information derived from these two clusterings, machine learning models Bayesian models that predict statistics representing scoring efficiency were trained and interpreted. These approaches provide insights into which combinations of five players tend to be effective and which combinations of two players tend to produce good effects.


title: An Effective Learning Management System for Revealing Student Performance Attributes

abstract: A learning management system streamlines the management of the teaching process in a centralized place, recording, tracking, and reporting the delivery of educational courses and student performance. Educational knowledge discovery from such an e-learning system plays a crucial role in rule regulation, policy establishment, and system development. However, existing LMSs do not have embedded mining modules to directly extract knowledge. As educational modes become more complex, educational data mining efficiency from those heterogeneous student learning behaviours is gradually degraded. Therefore, an LMS incorporated with an advanced educational mining module is proposed in this study, as a means to mine efficiently from student performance records to provide valuable insights for educators in helping plan effective learning pedagogies, improve curriculum design, and guarantee quality of teaching. Through two illustrative case studies, experimental results demonstrate increased mining efficiency of the proposed mining module without information loss compared to classic educational mining algorithms. The mined knowledge reveals a set of attributes that significantly impact student academic performance, and further classification evaluation validates the identified attributes. The design and application of such an effective LMS can enable educators to learn from past student performance experiences, empowering them to guide and intervene with students in time, and eventually improve their academic success.


title: ML-based Calibration and Control of the GlueX Central Drift Chamber

abstract: The GlueX Central Drift Chamber (CDC) in Hall D at Jefferson Lab, used for detecting and tracking charged particles, is calibrated and controlled during data taking using a Gaussian process. The system dynamically adjusts the high voltage applied to the anode wires inside the chamber in response to changing environmental and experimental conditions such that the gain is stabilized. Control policies have been established to manage the CDC's behavior. These policies are activated when the model's uncertainty exceeds a configurable threshold or during human-initiated tests during normal production running. We demonstrate the system reduces the time detector experts dedicate to calibration of the data offline, leading to a marked decrease in computing resource usage without compromising detector performance.


title: Hopfions of massive gauge bosons in early universe

abstract: This letter presents a novel model that characterizes the curvature of space-time, influenced by a massive gauge field in the early universe. This curvature can lead to a multitude of observations, including the Hubble tension issue and the isotropic stochastic gravitational-wave background. We introduce, for the first time, the concept of gauge field Hopfions, which exist in the space-time. We further investigate how hopfions can influence Hubble parameter values. Our findings open the door to utilizing hopfions as a topological source which links both gravitation and the gauge field.


title: Deep Generative Models for Ultra-High Granularity Particle Physics Detector Simulation: A Voyage From Emulation to Extrapolation

abstract: Simulating ultra-high-granularity detector responses in Particle Physics represents a critical yet computationally demanding task. This thesis aims to overcome this challenge for the Pixel Vertex Detector (PXD) at the Belle II experiment, which features over 7.5M pixel channels-the highest spatial resolution detector simulation dataset ever analysed with generative models. This thesis starts off by a comprehensive and taxonomic review on generative models for simulating detector signatures. Then, it presents the Intra-Event Aware Generative Adversarial Network (IEA-GAN), a new geometry-aware generative model that introduces a relational attentive reasoning and Self-Supervised Learning to approximate an "event" in the detector. This study underscores the importance of intra-event correlation for downstream physics analyses. Building upon this, the work drifts towards a more generic approach and presents YonedaVAE, a Category Theory-inspired generative model that tackles the open problem of Out-of-Distribution (OOD) simulation. YonedaVAE introduces a learnable Yoneda embedding to capture the entirety of an event based on its sensor relationships, formulating a Category theoretical language for intra-event relational reasoning. This is complemented by introducing a Self-Supervised learnable prior for VAEs and an Adaptive Top-q sampling mechanism, enabling the model to sample point clouds with variable intra-category cardinality in a zero-shot manner. Variable Intra-event cardinality has not been approached before and is vital for simulating irregular detector geometries. Trained on an early experiment data, YonedaVAE can reach a reasonable OOD simulation precision of a later experiment with almost double luminosity. This study introduces, for the first time, the results of using deep generative models for ultra-high granularity detector simulation in Particle Physics.

categories: physics.ins-det cs.AI cs.LG hep-ex hep-ph


title: Measuring Diversity in Co-creative Image Generation

abstract: Quality and diversity have been proposed as reasonable heuristics for assessing content generated by co-creative systems, but to date there has been little agreement around what constitutes the latter or how to measure it. Proposed approaches for assessing generative models in terms of diversity have limitations in that they compare the model's outputs to a ground truth that in the era of large pre-trained generative models might not be available, or entail an impractical number of computations. We propose an alternative based on entropy of neural network encodings for comparing diversity between sets of images that does not require ground-truth knowledge and is easy to compute. We also compare two pre-trained networks and show how the choice relates to the notion of diversity that we want to evaluate. We conclude with a discussion of the potential applications of these measures for ideation in interactive systems, model evaluation, and more broadly within computational creativity.


title: Self-Supervised Path Planning in UAV-aided Wireless Networks based on Active Inference

abstract: This paper presents a novel self-supervised path-planning method for UAV-aided networks. First, we employed an optimizer to solve training examples offline and then used the resulting solutions as demonstrations from which the UAV can learn the world model to understand the environment and implicitly discover the optimizer's policy. UAV equipped with the world model can make real-time autonomous decisions and engage in online planning using active inference. During planning, UAV can score different policies based on the expected surprise, allowing it to choose among alternative futures. Additionally, UAV can anticipate the outcomes of its actions using the world model and assess the expected surprise in a self-supervised manner. Our method enables quicker adaptation to new situations and better performance than traditional RL, leading to broader generalizability.


title: Optimal State Estimation in the Presence of Non-Gaussian Uncertainty via Wasserstein Distance Minimization

abstract: This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally reaches the Dirac delta distribution with minimal effort. The Wasserstein metric is used to quantify the effort of transporting from one distribution to another. We hypothesize that minimizing the Wasserstein distance between the posterior error and the Dirac delta distribution results in optimal information fusion and posterior state uncertainty. Framework validation is demonstrated by the successful recovery of the classical Kalman filter for linear systems with Gaussian uncertainties. Notably, the proposed Wasserstein filter does not rely on particle representation of uncertainty. Furthermore, the classical result for the Gaussian Sum Filter (GSF) is retrieved from the Wasserstein framework. This approach analytically exhibits the suboptimality of GSF and enables the use of nonlinear optimization techniques to enhance the accuracy of the Gaussian sum estimator.


title: DecompOpt: Controllable and Decomposed Diffusion Models for Structure-based Molecular Optimization

abstract: Recently, 3D generative models have shown promising performances in structure-based drug design by learning to generate ligands given target binding sites. However, only modeling the target-ligand distribution can hardly fulfill one of the main goals in drug discovery -- designing novel ligands with desired properties, e.g., high binding affinity, easily synthesizable, etc. This challenge becomes particularly pronounced when the target-ligand pairs used for training do not align with these desired properties. Moreover, most existing methods aim at solving \textit{de novo} design task, while many generative scenarios requiring flexible controllability, such as R-group optimization and scaffold hopping, have received little attention. In this work, we propose DecompOpt, a structure-based molecular optimization method based on a controllable and decomposed diffusion model. DecompOpt presents a new generation paradigm which combines optimization with conditional diffusion models to achieve desired properties while adhering to the molecular grammar. Additionally, DecompOpt offers a unified framework covering both \textit{de novo} design and controllable generation. To achieve so, ligands are decomposed into substructures which allows fine-grained control and local optimization. Experiments show that DecompOpt can efficiently generate molecules with improved properties than strong de novo baselines, and demonstrate great potential in controllable generation tasks.


title: Bridging Text and Molecule: A Survey on Multimodal Frameworks for Molecule

abstract: Artificial intelligence has demonstrated immense potential in scientific research. Within molecular science, it is revolutionizing the traditional computer-aided paradigm, ushering in a new era of deep learning. With recent progress in multimodal learning and natural language processing, an emerging trend has targeted at building multimodal frameworks to jointly model molecules with textual domain knowledge. In this paper, we present the first systematic survey on multimodal frameworks for molecules research. Specifically,we begin with the development of molecular deep learning and point out the necessity to involve textual modality. Next, we focus on recent advances in text-molecule alignment methods, categorizing current models into two groups based on their architectures and listing relevant pre-training tasks. Furthermore, we delves into the utilization of large language models and prompting techniques for molecular tasks and present significant applications in drug discovery. Finally, we discuss the limitations in this field and highlight several promising directions for future research.


title: Dual-sided transparent display

abstract: In the past decade, display technology has been reimagined to meet the needs of the virtual world. By mapping information onto a scene through a transparent display, users can simultaneously visualize both the real world and layers of virtual elements. However, advances in augmented reality (AR) technology have primarily focused on wearable gear or personal devices. Here we present a single display capable of delivering visual information to observers positioned on either side of the transparent device. This dual-sided display system employs a polymer stabilized liquid crystal waveguide technology to achieve a transparency window of 65% while offering active-matrix control. An early-stage prototype exhibits full-color information via time-sequential processing of a red-green-blue (RGB) light-emitting diode (LED) strip. The dual-sided display provides a perspective on transparent mediums as display devices for human-centric and service-related experiences that can support both enhanced bi-directional user interactions and new media platforms.


title: Analytical solutions for single and multiple scattering from rib-stiffened plates in water

abstract: The interaction of an acoustic plane wave with a pair of plates connected by periodically spaced stiffeners in water is considered. The rib-stiffened structure is called a "flex-layer" because its low frequency response is dominated by bending stiffness. The quasi-static behavior is equivalent a homogeneous layer of compressible fluid, which we identify as air for the purposes of comparison. In this way an air layer is acoustically the same as a pair of thin elastic plates connected by a periodic spacing of ribs. At discrete higher frequencies the flex-layer exhibits perfect acoustic transmission, the cause of which is identified as fluid-loaded plate waves propagating back and forth between the ribs. Both the low and finite frequency behavior of the flex-layer are fully explained by closed-form solutions for reflection and transmission. The analytical model is extended to two flex-layers in series, introducing new low and high frequency phenomena that are explained in terms of simple lumped parameter models.


title: Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks

abstract: In this paper, we first identify activation shift, a simple but remarkable phenomenon in a neural network in which the preactivation value of a neuron has non-zero mean that depends on the angle between the weight vector of the neuron and the mean of the activation vector in the previous layer. We then propose linearly constrained weights (LCW) to reduce the activation shift in both fully connected and convolutional layers. The impact of reducing the activation shift in a neural network is studied from the perspective of how the variance of variables in the network changes through layer operations in both forward and backward chains. We also discuss its relationship to the vanishing gradient problem. Experimental results show that LCW enables a deep feedforward network with sigmoid activation functions to be trained efficiently by resolving the vanishing gradient problem. Moreover, combined with batch normalization, LCW improves generalization performance of both feedforward and convolutional networks.


title: Few-shot Learning on Heterogeneous Graphs: Challenges, Progress, and Prospects

abstract: Few-shot learning on heterogeneous graphs (FLHG) is attracting more attention from both academia and industry because prevailing studies on heterogeneous graphs often suffer from label sparsity. FLHG aims to tackle the performance degradation in the face of limited annotated data and there have been numerous recent studies proposing various methods and applications. In this paper, we provide a comprehensive review of existing FLHG methods, covering challenges, research progress, and future prospects. Specifically, we first formalize FLHG and categorize its methods into three types: single-heterogeneity FLHG, dual-heterogeneity FLHG, and multi-heterogeneity FLHG. Then, we analyze the research progress within each category, highlighting the most recent and representative developments. Finally, we identify and discuss promising directions for future research in FLHG. To the best of our knowledge, this paper is the first systematic and comprehensive review of FLHG.


title: SMART: Automatically Scaling Down Language Models with Accuracy Guarantees for Reduced Processing Fees

abstract: The advancement of Large Language Models (LLMs) has significantly boosted performance in natural language processing (NLP) tasks. However, the deployment of high-performance LLMs incurs substantial costs, primarily due to the increased number of parameters aimed at enhancing model performance. This has made the use of state-of-the-art LLMs more expensive for end-users. AI service providers, such as OpenAI and Anthropic, often offer multiple versions of LLMs with varying prices and performance. However, end-users still face challenges in choosing the appropriate LLM for their tasks that balance result quality with cost. We introduce SMART, Scaling Models Adaptively for Reduced Token Fees, a novel LLM framework designed to minimize the inference costs of NLP tasks while ensuring sufficient result quality. It enables users to specify an accuracy constraint in terms of the equivalence of outputs to those of the most powerful LLM. SMART then generates results that deviate from the outputs of this LLM only with a probability below a user-defined threshold. SMART employs a profiling phase that evaluates the performance of multiple LLMs to identify those that meet the user-defined accuracy level. SMART optimizes the tradeoff between profiling overheads and the anticipated cost savings resulting from profiling. Moreover, our approach significantly reduces inference costs by strategically leveraging a mix of LLMs. Our experiments on three real-world datasets show that, based on OpenAI models, SMART achieves significant cost savings, up to 25.6x in comparison to GPT-4.


title: Tree-based Learning for High-Fidelity Prediction of Chaos

abstract: Model-free forecasting of the temporal evolution of chaotic systems is crucial but challenging. Existing solutions require hyperparameter tuning, significantly hindering their wider adoption. In this work, we introduce a tree-based approach not requiring hyperparameter tuning: TreeDOX. It uses time delay overembedding as explicit short-term memory and Extra-Trees Regressors to perform feature reduction and forecasting. We demonstrate the state-of-the-art performance of TreeDOX using the Henon map, Lorenz and Kuramoto-Sivashinsky systems, and the real-world Southern Oscillation Index.

categories: cs.LG math.DS nlin.CD physics.data-an stat.ML


title: Modeling and Simulation of Inelastic Effects in Composite Cables

abstract: The present work aims at describing hysteresis behaviour arising from cyclic bending experiments on cables by means of the Preisach operator. Pure bending experiments conducted in previous work show that slender structures such as electric cables behave inelastically and open hysteresis loops arise, with noticeable difference between the first load cycle and the following ones. The Preisach operator plays an important role in describing the input-output relation in hysteresis behaviours and it can be expressed as a superposition of relay operators. Here, we utilise data collected from pure bending experiments for a first approach. We introduce a mathematical formulation of the problem, and starting from the curvature of the cable specimen, we recursively define the Preisach plane for this specific case. Therefore, we derive a suitable kernel function in a way that the integration of such function over the Preisach plane results in the bending moment of the specimen.


title: Circuit Transformer: End-to-end Circuit Design by Predicting the Next Gate

abstract: Language, a prominent human ability to express through sequential symbols, has been computationally mastered by recent advances of large language models (LLMs). By predicting the next word recurrently with huge neural models, LLMs have shown unprecedented capabilities in understanding and reasoning. Circuit, as the "language" of electronic design, specifies the functionality of an electronic device by cascade connections of logic gates. Then, can circuits also be mastered by a a sufficiently large "circuit model", which can conquer electronic design tasks by simply predicting the next logic gate? In this work, we take the first step to explore such possibilities. Two primary barriers impede the straightforward application of LLMs to circuits: their complex, non-sequential structure, and the intolerance of hallucination due to strict constraints (e.g., equivalence). For the first barrier, we encode a circuit as a memory-less, depth-first traversal trajectory, which allows Transformer-based neural models to better leverage its structural information, and predict the next gate on the trajectory as a circuit model. For the second barrier, we introduce an equivalence-preserving decoding process, which ensures that every token in the generated trajectory adheres to the specified equivalence constraints. Moreover, the circuit model can also be regarded as a stochastic policy to tackle optimization-oriented circuit design tasks. Experimentally, we trained a Transformer-based model of 88M parameters, named "Circuit Transformer", which demonstrates impressive performance in end-to-end logic synthesis. With Monte-Carlo tree search, Circuit Transformer significantly improves over resyn2 while retaining strict equivalence, showcasing the potential of generative AI in conquering electronic design challenges.


title: depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers

abstract: PyTorch \texttt{2.x} introduces a compiler designed to accelerate deep learning programs. However, for machine learning researchers, adapting to the PyTorch compiler to full potential can be challenging. The compiler operates at the Python bytecode level, making it appear as an opaque box. To address this, we introduce \texttt{depyf}, a tool designed to demystify the inner workings of the PyTorch compiler. \texttt{depyf} decompiles bytecode generated by PyTorch back into equivalent source code, and establishes connections between in-memory code objects and their on-disk source code counterparts. This feature enables users to step through the source code line by line using debuggers, thus enhancing their understanding of the underlying processes. Notably, \texttt{depyf} is non-intrusive and user-friendly, primarily relying on two convenient context managers for its core functionality. The project is \href{https://github.com/thuml/depyf}{ openly available} and is recognized as a \href{https://pytorch.org/ecosystem/}{PyTorch ecosystem project}.


title: Whose Side Are You On? Investigating the Political Stance of Large Language Models

abstract: Large Language Models (LLMs) have gained significant popularity for their application in various everyday tasks such as text generation, summarization, and information retrieval. As the widespread adoption of LLMs continues to surge, it becomes increasingly crucial to ensure that these models yield responses that are politically impartial, with the aim of preventing information bubbles, upholding fairness in representation, and mitigating confirmation bias. In this paper, we propose a quantitative framework and pipeline designed to systematically investigate the political orientation of LLMs. Our investigation delves into the political alignment of LLMs across a spectrum of eight polarizing topics, spanning from abortion to LGBTQ issues. Across topics, the results indicate that LLMs exhibit a tendency to provide responses that closely align with liberal or left-leaning perspectives rather than conservative or right-leaning ones when user queries include details pertaining to occupation, race, or political affiliation. The findings presented in this study not only reaffirm earlier observations regarding the left-leaning characteristics of LLMs but also surface particular attributes, such as occupation, that are particularly susceptible to such inclinations even when directly steered towards conservatism. As a recommendation to avoid these models providing politicised responses, users should be mindful when crafting queries, and exercise caution in selecting neutral prompt language.


title: Integrating Wearable Sensor Data and Self-reported Diaries for Personalized Affect Forecasting

abstract: Emotional states, as indicators of affect, are pivotal to overall health, making their accurate prediction before onset crucial. Current studies are primarily centered on immediate short-term affect detection using data from wearable and mobile devices. These studies typically focus on objective sensory measures, often neglecting other forms of self-reported information like diaries and notes. In this paper, we propose a multimodal deep learning model for affect status forecasting. This model combines a transformer encoder with a pre-trained language model, facilitating the integrated analysis of objective metrics and self-reported diaries. To validate our model, we conduct a longitudinal study, enrolling college students and monitoring them over a year, to collect an extensive dataset including physiological, environmental, sleep, metabolic, and physical activity parameters, alongside open-ended textual diaries provided by the participants. Our results demonstrate that the proposed model achieves predictive accuracy of 82.50% for positive affect and 82.76% for negative affect, a full week in advance. The effectiveness of our model is further elevated by its explainability.


title: Analyzing the Variations in Emergency Department Boarding and Testing the Transferability of Forecasting Models across COVID-19 Pandemic Waves in Hong Kong: Hybrid CNN-LSTM approach to quantifying building-level socioecological risk

abstract: Emergency department's (ED) boarding (defined as ED waiting time greater than four hours) has been linked to poor patient outcomes and health system performance. Yet, effective forecasting models is rare before COVID-19, lacking during the peri-COVID era. Here, a hybrid convolutional neural network (CNN)-Long short-term memory (LSTM) model was applied to public-domain data sourced from Hong Kong's Hospital Authority, Department of Health, and Housing Authority. In addition, we sought to identify the phase of the COVID-19 pandemic that most significantly perturbed our complex adaptive healthcare system, thereby revealing a stable pattern of interconnectedness among its components, using deep transfer learning methodology. Our result shows that 1) the greatest proportion of days with ED boarding was found between waves four and five; 2) the best-performing model for forecasting ED boarding was observed between waves four and five, which was based on features representing time-invariant residential buildings' built environment and sociodemographic profiles and the historical time series of ED boarding and case counts, compared to during the waves when best-performing forecasting is based on time-series features alone; and 3) when the model built from the period between waves four and five was applied to data from other waves via deep transfer learning, the transferred model enhanced the performance of indigenous models.