title: A Fully Screen-Printed Vanadium-Dioxide Switches Based Wideband Reconfigurable Intelligent Surface for 5G Bands

abstract: Reconfigurable Intelligent Surface (RIS) is attracting more and more research interest because of its ability to reprogram the radio environment. Designing and implementing the RIS, however, is challenging because of limitations of printed circuit board (PCB) technology related to manufacturing of large sizes as well as the cost of switches. Thus, a low-cost manufacturing process suitable for large size and volume of devices, such as screen-printing is necessary. In this paper, for the first time, a fully screen-printed reconfigurable intelligent surface (RIS) with vanadium dioxide (VO2) switches for 5G and beyond communications is proposed. A VO2 ink has been prepared and batches of switches have been printed and integrated with the resonator elements. These switches are a fraction of the cost of commercial switches. Furthermore, the printing of these switches directly on metal patterns negates the need of any minute soldering of the switches. To avoid the complications of multilayer printing and realizing the RIS without vias, the resonators and the biasing lines are realized on a single layer. However, this introduces the challenge of interference between the biasing lines and the resonators, which is tackled in this work by designing the bias lines as part of the resonator. By adjusting the unit cell periodicity and the dimension of the H-shaped resonator, we achieve a 220 to 170{\deg} phase shift from 23.5 GHz to 29.5 GHz covering both n257 and n258 bands. Inside the wide bandwidth, the maximum ON reflection magnitude is 74%, and the maximum OFF magnitude is 94%. The RIS array comprises 20x20 unit cells (4.54x4.54{\lambda}^2 at 29.5 GHz). Each column of unit cells is serially connected to a current biasing circuit. To validate the array's performance, we conduct full-wave simulations as well as near-field and far-field measurements.


title: Character Sums and the Riemann Hypothesis

abstract: We prove that an innocent looking inequality implies the Riemann Hypothesis and show a way to approach this inequality through sums of Legendre symbols.


title: Exploring the hierarchy of quantum correlations under thermal effects in two gravitational cat states

abstract: In this article, we investigate the hierarchy of quantum correlations between two gravitational cats states (modeled by two qubits). We use concurrence to quantify the entanglement between the two gravitational cat states. Quantum steering is employed to measure the steerabilities. We consider geometric quantum discord to quantify quantum correlations beyond entanglement. We show that the concurrence persists even when steerability is lost under thermal effects. We also show that the temperature influences the degree of quantum correlations between the two gravitational cat states. Besides, when the energy difference between the ground state and the first excited level becomes significant, the states become separable.


title: Landmark Alternating Diffusion

abstract: Alternating Diffusion (AD) is a commonly applied diffusion-based sensor fusion algorithm. While it has been successfully applied to various problems, its computational burden remains a limitation. Inspired by the landmark diffusion idea considered in the Robust and Scalable Embedding via Landmark Diffusion (ROSELAND), we propose a variation of AD, called Landmark AD (LAD), which captures the essence of AD while offering superior computational efficiency. We provide a series of theoretical analyses of LAD under the manifold setup and apply it to the automatic sleep stage annotation problem with two electroencephalogram channels to demonstrate its application.

categories: cs.LG math.ST physics.data-an stat.ML stat.TH


title: Finding Product and Sum Patterns in non-commutative settings

abstract: Hindman conjectured that any finite partition of $\mathbb{N}$ has a monochromatic $\{x,y,x+y,xy\}$. Recently, Bowen proved the result for all 2-partition. In this paper, we extend Bowen's result to any semiring $(S,+,\cdot)$ such that $Ss$ is piecewise syndetic for all $s\in S$. As a method, we gave a combinatorial proof for a piecewise syndetic version of Bergerson and Glasscock's IP$_r^*$ Szemer\'edi Theorem, and discussed the case when the operation is not commutative.


title: Provably Robust Conformal Prediction with Improved Efficiency

abstract: Conformal prediction is a powerful tool to generate uncertainty sets with guaranteed coverage using any predictive model, under the assumption that the training and test data are i.i.d.. Recently, it has been shown that adversarial examples are able to manipulate conformal methods to construct prediction sets with invalid coverage rates, as the i.i.d. assumption is violated. To address this issue, a recent work, Randomized Smoothed Conformal Prediction (RSCP), was first proposed to certify the robustness of conformal prediction methods to adversarial noise. However, RSCP has two major limitations: (i) its robustness guarantee is flawed when used in practice and (ii) it tends to produce large uncertainty sets. To address these limitations, we first propose a novel framework called RSCP+ to provide provable robustness guarantee in evaluation, which fixes the issues in the original RSCP method. Next, we propose two novel methods, Post-Training Transformation (PTT) and Robust Conformal Training (RCT), to effectively reduce prediction set size with little computation overhead. Experimental results in CIFAR10, CIFAR100, and ImageNet suggest the baseline method only yields trivial predictions including full label set, while our methods could boost the efficiency by up to $4.36\times$, $5.46\times$, and $16.9\times$ respectively and provide practical robustness guarantee. Our codes are available at https://github.com/Trustworthy-ML-Lab/Provably-Robust-Conformal-Prediction.


title: VimTS: A Unified Video and Image Text Spotter for Enhancing the Cross-domain Generalization

abstract: Text spotting, a task involving the extraction of textual information from image or video sequences, faces challenges in cross-domain adaption, such as image-to-image and image-to-video generalization. In this paper, we introduce a new method, termed VimTS, which enhances the generalization ability of the model by achieving better synergy among different tasks. Typically, we propose a Prompt Queries Generation Module and a Tasks-aware Adapter to effectively convert the original single-task model into a multi-task model suitable for both image and video scenarios with minimal additional parameters. The Prompt Queries Generation Module facilitates explicit interaction between different tasks, while the Tasks-aware Adapter helps the model dynamically learn suitable features for each task. Additionally, to further enable the model to learn temporal information at a lower cost, we propose a synthetic video text dataset (VTD-368k) by leveraging the Content Deformation Fields (CoDeF) algorithm. Notably, our method outperforms the state-of-the-art method by an average of 2.6% in six cross-domain benchmarks such as TT-to-IC15, CTW1500-to-TT, and TT-to-CTW1500. For video-level cross-domain adaption, our method even surpasses the previous end-to-end video spotting method in ICDAR2015 video and DSText v2 by an average of 5.5% on the MOTA metric, using only image-level data. We further demonstrate that existing Large Multimodal Models exhibit limitations in generating cross-domain scene text spotting, in contrast to our VimTS model which requires significantly fewer parameters and data. The code and datasets will be made available at the https://VimTextSpotter.github.io.


title: BAD-NEUS: Rapidly converging trajectory stratification

abstract: An issue for molecular dynamics simulations is that events of interest often involve timescales that are much longer than the simulation time step, which is set by the fastest timescales of the model. Because of this timescale separation, direct simulation of many events is prohibitively computationally costly. This issue can be overcome by aggregating information from many relatively short simulations that sample segments of trajectories involving events of interest. This is the strategy of Markov state models (MSMs) and related approaches, but such methods suffer from approximation error because the variables defining the states generally do not capture the dynamics fully. By contrast, once converged, the weighted ensemble (WE) method aggregates information from trajectory segments so as to yield unbiased estimates of both thermodynamic and kinetic statistics. Unfortunately, errors decay no faster than unbiased simulation in WE. Here we introduce a theoretical framework for describing WE that shows that introduction of an element of stratification, as in nonequilibrium umbrella sampling (NEUS), accelerates convergence. Then, building on ideas from MSMs and related methods, we propose an improved stratification that allows approximation error to be reduced systematically. We show that the improved stratification can decrease simulation times required to achieve a desired precision by orders of magnitude.


title: Masked Multi-Query Slot Attention for Unsupervised Object Discovery

abstract: Unsupervised object discovery is becoming an essential line of research for tackling recognition problems that require decomposing an image into entities, such as semantic segmentation and object detection. Recently, object-centric methods that leverage self-supervision have gained popularity, due to their simplicity and adaptability to different settings and conditions. However, those methods do not exploit effective techniques already employed in modern self-supervised approaches. In this work, we consider an object-centric approach in which DINO ViT features are reconstructed via a set of queried representations called slots. Based on that, we propose a masking scheme on input features that selectively disregards the background regions, inducing our model to focus more on salient objects during the reconstruction phase. Moreover, we extend the slot attention to a multi-query approach, allowing the model to learn multiple sets of slots, producing more stable masks. During training, these multiple sets of slots are learned independently while, at test time, these sets are merged through Hungarian matching to obtain the final slots. Our experimental results and ablations on the PASCAL-VOC 2012 dataset show the importance of each component and highlight how their combination consistently improves object localization. Our source code is available at: https://github.com/rishavpramanik/maskedmultiqueryslot


title: The Local Dark Matter Kinematic Substructure Based on LAMOST K Giants

abstract: Numerical simulations indicate that correlations exist between the velocity distributions of stars and dark matter (DM). We study the local DM velocity distribution based on these correlations. We select K giants from LAMOST DR8 cross-matched with Gaia DR3, which has robust measurements of three-dimensional velocity and metallicity, and separate them into the disk, halo substructure and main halo components in the chemo-dynamical space utilizing the Gaussian Mixture Model. The substructure component is highly radially anisotropic, and possibly related to the Gaia-Enceladus-Sausage (GES) merger event, while the halo component is isotropic and accreted from the earliest mergers following the Maxwell-Boltzmann Distribution (Standard Halo Model, SHM). We find that the GES-like substructure contributes $\sim85\%$ of the local non-disk stars in the Solar neighbourhood, which is nearly invariant when applying different volume cuts or additional angular momentum constraints. Utilizing the metallicity-stellar-mass relation and the stellar-mass-halo-mass relation, we find that $\sim25_{-15}^{+24}\%$ of local DM is in the kinematic substructure. Combined with the stellar distributions of non-disk components, we compute the velocity distribution of local DM. The modified heliocentric velocity distribution of local DM shifts to a lower speed and has a sharper peak compared to the SHM, which yields updated detection limits for the DM direct detection experiments. Our work confirms that the local DM velocity distribution deviates from the SHM, and needs to be properly accounted in the DM detection experiments.


title: Towards Scenario- and Capability-Driven Dataset Development and Evaluation: An Approach in the Context of Mapless Automated Driving

abstract: The foundational role of datasets in defining the capabilities of deep learning models has led to their rapid proliferation. At the same time, published research focusing on the process of dataset development for environment perception in automated driving has been scarce, thereby reducing the applicability of openly available datasets and impeding the development of effective environment perception systems. Sensor-based, mapless automated driving is one of the contexts where this limitation is evident. While leveraging real-time sensor data, instead of pre-defined HD maps promises enhanced adaptability and safety by effectively navigating unexpected environmental changes, it also increases the demands on the scope and complexity of the information provided by the perception system. To address these challenges, we propose a scenario- and capability-based approach to dataset development. Grounded in the principles of ISO 21448 (safety of the intended functionality, SOTIF), extended by ISO/TR 4804, our approach facilitates the structured derivation of dataset requirements. This not only aids in the development of meaningful new datasets but also enables the effective comparison of existing ones. Applying this methodology to a broad range of existing lane detection datasets, we identify significant limitations in current datasets, particularly in terms of real-world applicability, a lack of labeling of critical features, and an absence of comprehensive information for complex driving maneuvers.


title: The Unreasonable Effectiveness of the Tunneling Potential

abstract: The Tunneling Potential Formalism was introduced to calculate the tunneling actions that control vacuum decay as an alternative to the standard Euclidean Formalism. The new approach sets the problem as a simple variational problem in field space with decay described by a tunneling potential function $V_t$ that extremizes a simple action functional $S[V_t]$ and has a number of appealing properties that have been presented elsewhere. In this note I discuss several instances in which this $V_t$ approach seems to give more than one would have expected a priori, as the following: the $V_t$ describing the decay is a minimum of the new action $S[V_t]$ rather than a saddle point; the decay of AdS, dS or Minkowski vacua are governed by a unique universal $S[V_t]$ which also gives the Hawking-Moss instanton in the appropriate limit; physically relevant solutions beyond the Coleman-De Luccia (CdL) bounce, like pseudo-bounces or bubbles of nothing (BoNs), show up in a straightforward way as generalizations of the CdL bounce, with the correct boundary conditions; in cases for which the Euclidean action calculation requires the inclusion of particular boundary terms (like for BoNs or for the decay of AdS maxima above the Breitenlohner-Freedman bound) $S[V_t]$ gives the correct result without the need of including any boundary term.


title: Gravitational Lensing Using Werner's Method in Cartesian-like Coordinates

abstract: The Gibbons-Werner method for calculating deflection angles using the Gauss-Bonnet theorem and optical/Jacobi metric has become widely popular in recent years. Werner extended this method to stationary spacetimes, where the optical/Jacobi metric takes the form of a Finsler metric of Randers type, by adopting an osculating Riemannian metric. Werner's method is significant as it provides a concise expression for the deflection angle, retains applicability for gravitational lensing in Finsler geometry beyond the Randers type, and has the potential to stimulate widespread application of Finsler geometry across diverse fields. However, because of the cumbersome calculations required in Werner's method using conventional coordinates $(r,\phi)$, it has not been widely adopted. The aim of this paper is to alleviate the computational burden associated with Werner's method. To this end, we introduce Cartesian-like coordinates $(X,Y)$ to construct the osculating Riemannian metric and calculate the deflection angle using the Gauss-Bonnet theorem. We illustrate the current method with examples of the deflection of massive particles in Kerr spacetime, rotating Bardeen (Hayward) regular spacetime, and Teo rotating wormhole spacetime, respectively.


title: Regularization of Riemannian optimization: Application to process tomography and quantum machine learning

abstract: Gradient descent algorithms on Riemannian manifolds have been used recently for the optimization of quantum channels. In this contribution, we investigate the influence of various regularization terms added to the cost function of these gradient descent approaches. Motivated by Lasso regularization, we apply penalties for large ranks of the quantum channel, favoring solutions that can be represented by as few Kraus operators as possible. We apply the method to quantum process tomography and a quantum machine learning problem. Suitably regularized models show faster convergence of the optimization as well as better fidelities in the case of process tomography. Applied to quantum classification scenarios, the regularization terms can simplify the classifying quantum channel without degrading the accuracy of the classification, thereby revealing the minimum channel rank needed for the given input data.


title: Decoder Decomposition for the Analysis of the Latent Space of Nonlinear Autoencoders With Wind-Tunnel Experimental Data

abstract: Turbulent flows are chaotic and multi-scale dynamical systems, which have large numbers of degrees of freedom. Turbulent flows, however, can be modelled with a smaller number of degrees of freedom when using the appropriate coordinate system, which is the goal of dimensionality reduction via nonlinear autoencoders. Autoencoders are expressive tools, but they are difficult to interpret. The goal of this paper is to propose a method to aid the interpretability of autoencoders. This is the decoder decomposition. First, we propose the decoder decomposition, which is a post-processing method to connect the latent variables to the coherent structures of flows. Second, we apply the decoder decomposition to analyse the latent space of synthetic data of a two-dimensional unsteady wake past a cylinder. We find that the dimension of latent space has a significant impact on the interpretability of autoencoders. We identify the physical and spurious latent variables. Third, we apply the decoder decomposition to the latent space of wind-tunnel experimental data of a three-dimensional turbulent wake past a bluff body. We show that the reconstruction error is a function of both the latent space dimension and the decoder size, which are correlated. Finally, we apply the decoder decomposition to rank and select latent variables based on the coherent structures that they represent. This is useful to filter unwanted or spurious latent variables, or to pinpoint specific coherent structures of interest. The ability to rank and select latent variables will help users design and interpret nonlinear autoencoders.


title: PCA for Point Processes

abstract: We introduce a novel statistical framework for the analysis of replicated point processes that allows for the study of point pattern variability at a population level. By treating point process realizations as random measures, we adopt a functional analysis perspective and propose a form of functional Principal Component Analysis (fPCA) for point processes. The originality of our method is to base our analysis on the cumulative mass functions of the random measures which gives us a direct and interpretable analysis. Key theoretical contributions include establishing a Karhunen-Lo\`{e}ve expansion for the random measures and a Mercer Theorem for covariance measures. We establish convergence in a strong sense, and introduce the concept of principal measures, which can be seen as latent processes governing the dynamics of the observed point patterns. We propose an easy-to-implement estimation strategy of eigenelements for which parametric rates are achieved. We fully characterize the solutions of our approach to Poisson and Hawkes processes and validate our methodology via simulations and diverse applications in seismology, single-cell biology and neurosiences, demonstrating its versatility and effectiveness. Our method is implemented in the pppca R-package.


title: Central Limit Theorem for tensor products of free variables

abstract: We establish a central limit theorem for tensor product random variables $c_k:=a_k \otimes a_k$, where $(a_k)_{k \in \mathbb{N}}$ is a free family of variables. We show that if the variables $a_k$ are centered, the limiting law is the semi-circle. Otherwise, the limiting law depends on the mean and variance of the variables $a_k$ and corresponds to a free interpolation between the semi-circle law and the classical convolution of two semi-circle laws.


title: Constrained maximization of conformal capacity

abstract: We consider constellations of disks which are unions of disjoint hyperbolic disks in the unit disk with fixed radii and unfixed centers. We study the problem of maximizing the conformal capacity of a constellation under constraints on the centers in two cases. In the first case the constraint is that the centers are at most at distance $R \in(0,1)$ from the origin and in the second case it is required that the centers are on the subsegment $[-R,R]$ of a diameter of the unit disk. We study also similar types of constellations with hyperbolic segments instead of the hyperbolic disks. Our computational experiments suggest that a dispersion phenomenon occurs: the disks/segments go as close to the unit circle as possible under these constraints and stay as far as possible from each other. The computation of capacity reduces to the Dirichlet problem for the Laplace equation which we solve with a fast boundary integral equation method. The results are double-checked with the $hp$-FEM method.


title: Towards Generalist Robot Learning from Internet Video: A Survey

abstract: This survey presents an overview of methods for learning from video (LfV) in the context of reinforcement learning (RL) and robotics. We focus on methods capable of scaling to large internet video datasets and, in the process, extracting foundational knowledge about the world's dynamics and physical human behaviour. Such methods hold great promise for developing general-purpose robots. We open with an overview of fundamental concepts relevant to the LfV-for-robotics setting. This includes a discussion of the exciting benefits LfV methods can offer (e.g., improved generalization beyond the available robot data) and commentary on key LfV challenges (e.g., missing information in video and LfV distribution shifts). Our literature review begins with an analysis of video foundation model techniques that can extract knowledge from large, heterogeneous video datasets. Next, we review methods that specifically leverage video data for robot learning. Here, we categorise work according to which RL knowledge modality (KM) benefits from the use of video data. We additionally highlight techniques for mitigating LfV challenges, including reviewing action representations that address missing action labels in video. Finally, we examine LfV datasets and benchmarks, before concluding with a discussion of challenges and opportunities in LfV. Here, we advocate for scalable foundation model approaches that can leverage the full range of internet video data, and that target the learning of the most promising RL KMs: the policy and dynamics model. Overall, we hope this survey will serve as a comprehensive reference for the emerging field of LfV, catalysing further research in the area and facilitating progress towards the development of general-purpose robots.


title: ATOMMIC: An Advanced Toolbox for Multitask Medical Imaging Consistency to facilitate Artificial Intelligence applications from acquisition to analysis in Magnetic Resonance Imaging

abstract: AI is revolutionizing MRI along the acquisition and processing chain. Advanced AI frameworks have been developed to apply AI in various successive tasks, such as image reconstruction, quantitative parameter map estimation, and image segmentation. Existing frameworks are often designed to perform tasks independently or are focused on specific models or datasets, limiting generalization. We introduce ATOMMIC, an open-source toolbox that streamlines AI applications for accelerated MRI reconstruction and analysis. ATOMMIC implements several tasks using DL networks and enables MultiTask Learning (MTL) to perform related tasks integrated, targeting generalization in the MRI domain. We first review the current state of AI frameworks for MRI through a comprehensive literature search and by parsing 12,479 GitHub repositories. We benchmark 25 DL models on eight publicly available datasets to present distinct applications of ATOMMIC on accelerated MRI reconstruction, image segmentation, quantitative parameter map estimation, and joint accelerated MRI reconstruction and image segmentation utilizing MTL. Our findings demonstrate that ATOMMIC is the only MTL framework with harmonized complex-valued and real-valued data support. Evaluations on single tasks show that physics-based models, which enforce data consistency by leveraging the physical properties of MRI, outperform other models in reconstructing highly accelerated acquisitions. Physics-based models that produce high reconstruction quality can accurately estimate quantitative parameter maps. When high-performing reconstruction models are combined with robust segmentation networks utilizing MTL, performance is improved in both tasks. ATOMMIC facilitates MRI reconstruction and analysis by standardizing workflows, enhancing data interoperability, integrating unique features like MTL, and effectively benchmarking DL models.

categories: physics.med-ph cs.AI cs.SE math-ph math.MP


title: Beyond MOS: Subjective Image Quality Score Preprocessing Method Based on Perceptual Similarity

abstract: Image quality assessment often relies on raw opinion scores provided by subjects in subjective experiments, which can be noisy and unreliable. To address this issue, postprocessing procedures such as ITU-R BT.500, ITU-T P.910, and ITU-T P.913 have been standardized to clean up the original opinion scores. These methods use annotator-based statistical priors, but they do not take into account extensive information about the image itself, which limits their performance in less annotated scenarios. Generally speaking, image quality datasets usually contain similar scenes or distortions, and it is inevitable for subjects to compare images to score a reasonable score when scoring. Therefore, In this paper, we proposed Subjective Image Quality Score Preprocessing Method perceptual similarity Subjective Preprocessing (PSP), which exploit the perceptual similarity between images to alleviate subjective bias in less annotated scenarios. Specifically, we model subjective scoring as a conditional probability model based on perceptual similarity with previously scored images, called subconscious reference scoring. The reference images are stored by a neighbor dictionary, which is obtained by a normalized vector dot-product based nearest neighbor search of the images' perceptual depth features. Then the preprocessed score is updated by the exponential moving average (EMA) of the subconscious reference scoring, called similarity regularized EMA. Our experiments on multiple datasets (LIVE, TID2013, CID2013) show that this method can effectively remove the bias of the subjective scores. Additionally, Experiments prove that the Preprocesed dataset can improve the performance of downstream IQA tasks very well.


title: Non-semisimple Crane-Yetter theory varying over the character stack

abstract: We construct a relative version of the Crane-Yetter topological quantum field theory in four dimensions, from non-semisimple data. Our theory is defined relative to the classical $G$-gauge theory in five dimensions -- this latter theory assigns to each manifold $M$ the appropriate linearization of the moduli stack of $G$-local systems, called the character stack. Our main result is to establish a relative invertibility property for our construction. This invertibility echoes -- recovers and greatly generalizes -- the key invertibility property of the original Crane-Yetter theory which allowed it to capture the framing anomaly of the celebrated Witten-Reshetikhin-Turaev theory. In particular our invertibilty statement at the level of surfaces implies a categorical, stacky version of the unicity theorem for skein algebras; at the level of 3-manifolds it equips the character stack with a canonical line bundle. Regarded as a topological symmetry defect of classical gauge theory, our work establishes invertibility of this defect by a gauging procedure.


title: SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks

abstract: Weight quantization is used to deploy high-performance deep learning models on resource-limited hardware, enabling the use of low-precision integers for storage and computation. Spiking neural networks (SNNs) share the goal of enhancing efficiency, but adopt an 'event-driven' approach to reduce the power consumption of neural network inference. While extensive research has focused on weight quantization, quantization-aware training (QAT), and their application to SNNs, the precision reduction of state variables during training has been largely overlooked, potentially diminishing inference performance. This paper introduces two QAT schemes for stateful neurons: (i) a uniform quantization strategy, an established method for weight quantization, and (ii) threshold-centered quantization, which allocates exponentially more quantization levels near the firing threshold. Our results show that increasing the density of quantization levels around the firing threshold improves accuracy across several benchmark datasets. We provide an ablation analysis of the effects of weight and state quantization, both individually and combined, and how they impact models. Our comprehensive empirical evaluation includes full precision, 8-bit, 4-bit, and 2-bit quantized SNNs, using QAT, stateful QAT (SQUAT), and post-training quantization methods. The findings indicate that the combination of QAT and SQUAT enhance performance the most, but given the choice of one or the other, QAT improves performance by the larger degree. These trends are consistent all datasets. Our methods have been made available in our Python library snnTorch: https://github.com/jeshraghian/snntorch.


title: Enhancing Predictive Accuracy in Pharmaceutical Sales Through An Ensemble Kernel Gaussian Process Regression Approach

abstract: This research employs Gaussian Process Regression (GPR) with an ensemble kernel, integrating Exponential Squared, Revised Mat\'ern, and Rational Quadratic kernels to analyze pharmaceutical sales data. Bayesian optimization was used to identify optimal kernel weights: 0.76 for Exponential Squared, 0.21 for Revised Mat\'ern, and 0.13 for Rational Quadratic. The ensemble kernel demonstrated superior performance in predictive accuracy, achieving an \( R^2 \) score near 1.0, and significantly lower values in Mean Squared Error (MSE), Mean Absolute Error (MAE), and Root Mean Squared Error (RMSE). These findings highlight the efficacy of ensemble kernels in GPR for predictive analytics in complex pharmaceutical sales datasets.


title: Magnetic trapping of an ultracold $^{39}$K-$^{40}$K mixture with a versatile potassium laser system

abstract: We present a dual isotope magneto-optical trap (MOT), simultaneous sub-Doppler laser cooling, and magnetic trapping of a spin-polarized $^{39}$K-$^{40}$K Bose-Fermi mixture realized in a single-chamber setup with an unenriched potassium dispenser as the source of atoms. We are able to magnetically confine more than $2.2\times10^5$ fermions ($F=9/2\,m_F=9/2$) and $1.4\times10^7$ bosons ($F=2\,m_F=2$) with a lifetime exceeding 1.2 s. For this work, we have developed a versatile laser tailored for sub-Doppler cooling of all naturally occurring potassium isotopes and their mixtures. This laser system incorporates innovative features, such as the capability to select an isotope by activating or deactivating specific acousto-optic modulators that control the light seeding tapered amplifiers. Switching between isotopes takes $\sim$1 $\mathrm{\mu}$s without any mechanical adjustment of the components. As a final step in characterizing the laser system, we demonstrate sub-Doppler cooling of $^{41}$K.


title: ML-based handover prediction over a real O-RAN deployment using RAN Intelligent controller

abstract: O-RAN introduces intelligent and flexible network control in all parts of the network. The use of controllers with open interfaces allow us to gather real time network measurements and make intelligent/informed decision. The work in this paper focuses on developing a use-case for open and reconfigurable networks to investigate the possibility to predict handover events and understand the value of such predictions for all stakeholders that rely on the communication network to conduct their business. We propose a Long-Short Term Memory Machine Learning approach that takes standard Radio Access Network measurements to predict handover events. The models were trained on real network data collected from a commercial O-RAN setup deployed in our OpenIreland testbed. Our results show that the proposed approach can be optimized for either recall or precision, depending on the defined application level objective. We also link the performance of the Machine Learning (ML) algorithm to the network operation cost. Our results show that ML-based matching between the required and available resources can reduce operational cost by more than 80%, compared to long term resource purchases.


title: Specific Wasserstein divergence between continuous martingales

abstract: Defining a divergence between the laws of continuous martingales is a delicate task, owing to the fact that these laws tend to be singular to each other. An important idea, put forward by N. Gantert, is to instead consider a scaling limit of the relative entropy between such continuous martingales sampled over a finite time grid. This gives rise to the concept of specific relative entropy. In order to develop a general theory of divergences between continuous martingales, it is only natural to replace the role of the relative entropy in this construction by a different notion of discrepancy between finite dimensional probability distributions. In the present work we take a first step in this direction, taking a power $p$ of the Wasserstein distance instead of the relative entropy. We call the newly obtained scaling limit the specific $p$-Wasserstein divergence. In our first main result we prove that the specific $p$-Wasserstein divergence is well-defined, and exhibit an explicit expression for it in terms of the quadratic variations of the martingales involved. This is obtained under vastly weaker assumptions than the corresponding results for the specific relative entropy. Next we illustrate the usefulness of the concept, by considering the problem of optimizing the specific $p$-Wasserstein divergence over the set of win-martingales. In our second main result we characterize the solution of this optimization problem for all $p>0$ and, somewhat surprisingly, we single out the case $p=1/2$ as the one with the best probabilistic properties. For instance, the optimal martingale in this case is very explicit and can be connected, through a space transformation, to the solution of a variant of the Schr\"odinger problem.


title: Neural Controlled Differential Equations with Quantum Hidden Evolutions

abstract: We introduce a class of neural controlled differential equation inspired by quantum mechanics. Neural quantum controlled differential equations (NQDEs) model the dynamics by analogue of the Schr\"{o}dinger equation. Specifically, the hidden state represents the wave function, and its collapse leads to an interpretation of the classification probability. We implement and compare the results of four variants of NQDEs on a toy spiral classification problem.


title: Derivative learning of tensorial quantities -- Predicting finite temperature infrared spectra from first principles

abstract: We develop a strategy that integrates machine learning and first-principles calculations to achieve technical accurate predictions of infrared spectra. Specifically, the methodology allows to predict infrared spectra for complex systems at finite temperatures. The method's effectiveness is demonstrated in challenging scenarios, such as the analysis of water and the organic-inorganic halide perovskite MAPbI$_{3}$, where our results consistently align with experimental data. A distinctive feature of the methodology is the incorporation of derivative learning, which proves indispensable for obtaining accurate polarization data in bulk materials and facilitates the training of a machine learning surrogate model of the polarization adapted to rotational and translational symmetries. We achieve polarisation prediction accuracies of about 1 % by training only on the predicted Born effective charges.


title: Deep Learning for Educational Data Science

abstract: With the ever-growing presence of deep artificial neural networks in every facet of modern life, a growing body of researchers in educational data science -- a field consisting of various interrelated research communities -- have turned their attention to leveraging these powerful algorithms within the domain of education. Use cases range from advanced knowledge tracing models that can leverage open-ended student essays or snippets of code to automatic affect and behavior detectors that can identify when a student is frustrated or aimlessly trying to solve problems unproductively -- and much more. This chapter provides a brief introduction to deep learning, describes some of its advantages and limitations, presents a survey of its many uses in education, and discusses how it may further come to shape the field of educational data science.


title: The Nature of X-Rays from Young Stellar Objects in the Orion Nebula Cluster -- A Chandra HETGS Legacy Project

abstract: The Orion Nebula Cluster (ONC) is the closest site of very young ($\sim$ 1 Myrs) massive star formation. The ONC hosts more than 1600 young and X-ray bright stars with masses ranging from $\sim$ 0.1 to 35 $M_\odot$. The Chandra HETGS Orion Legacy Project observed the ONC with the Chandra high energy transmission grating spectrometer (HETGS) for $2.1\,$Ms. We describe the spectral extraction and cleaning processes necessary to separate overlapping spectra. We obtained 36 high resolution spectra which includes a high brilliance X-ray spectrum of $\theta^1$ Ori C with over 100 highly significant X-ray lines. The lines show Doppler broadening between 300 and $400\;\mathrm{km}\;\mathrm{s}^{-1}$. Higher spectral diffraction orders allow us to resolve line components of high Z He-like triplets in $\theta^1$ Ori C with unprecedented spectral resolution. Long term light curves spanning $\sim$20 years show all stars to be highly variable, including the massive stars. Spectral fitting with thermal coronal emission line models reveals that most sources show column densities of up to a few times $10^{22}\,$cm$^{-2}$ and high coronal temperatures of 10 to 90 MK. We observe a bifurcation of the high temperature component where some stars show a high component of 40 MK, while others show above 60 MK indicating heavy flaring activity. Some lines are resolved with Doppler broadening above our threshold of $\sim200\;\mathrm{km}\;\mathrm{s}^{-1}$, up to $500\;\mathrm{km}\;\mathrm{s}^{-1}$. This data set represents the largest collection of HETGS high resolution X-ray spectra from young pre-MS stars in a single star-forming region to date.


title: A Comprehensive Analysis of Pegasus Spyware and Its Implications for Digital Privacy and Security

abstract: This paper comprehensively analyzes the Pegasus spyware and its implications for digital privacy and security. The Israeli cyber intelligence company NSO Group's Pegasus has gained recognition as a potent surveillance tool capable of hacking into smartphones and extracting data without the user's knowledge [49], [50]. The research emphasizes the technical aspects of this spyware, its deployment methods, and the controversies surrounding its use. The research also emphasizes the growing worries surrounding digital privacy and security as a result of the prevalent use of advanced spyware. By delving into legal, ethical, and policy issues, the objective of this study is to deliver a holistic understanding of the challenges posed by Pegasus and similar spyware tools. Through a comprehensive examination of the subject, the paper presents potential solutions to mitigate the threats and protect users from invasive surveillance techniques.


title: Density-wave-like gap evolution in La$_3$Ni$_2$O$_7$ under high pressure revealed by ultrafast optical spectroscopy

abstract: We explore the quasiparticle dynamics in bilayer nickelate La$_3$Ni$_2$O$_7$ crystal using ultrafast optical pump-probe spectroscopy at high pressure up to 34.2 GPa. At ambient pressure, the temperature dependence of relaxation indicates appearance of phonon bottleneck effect due to the opening of density-wave-like gap at 151 K. By analyzing the data with RT model, we identified the energy scale of the gap to be 70 meV at ambient pressure. The relaxation bottleneck effect is suppressed gradually by the pressure and disappears around 26 GPa. At high pressure above 29.4 GPa, we discover a new density-wave like order with transition temperature of $\sim$130 K. Our results not only provide the first experimental evidence of the density-wave like gap evolution under high pressure, but also offering insight into the underline interplay between the density wave order and superconductivity in pressured La$_3$Ni$_2$O$_7$.


title: Tuning the coherent interaction of an electron qubit and a nuclear magnon

abstract: A central spin qubit interacting coherently with an ensemble of proximal spins can be used to engineer entangled collective states or a multi-qubit register. Making full use of this many-body platform requires tuning the interaction between the central spin and its spin register. GaAs quantum dots offer a model realization of the central spin system where an electron qubit interacts with multiple ensembles of $\sim 10^{4}$ nuclear spins. In this work, we demonstrate tuning of the interaction between the electron qubit and the nuclear many-body system in a GaAs quantum dot. The homogeneity of the GaAs system allows us to perform high-precision and isotopically selective nuclear sideband spectroscopy, which reveals the single-nucleus electronic Knight field. Together with time-resolved spectroscopy of the nuclear field, this fully characterizes the electron-nuclear interaction for a priori control. An algorithmic feedback sequence selects the nuclear polarization precisely, which adjusts the electron-nuclear exchange interaction in situ via the electronic g-factor anisotropy. This allows us to tune directly the activation rate of a collective nuclear excitation (magnon) and the coherence time of the electron qubit. Our method is applicable to similar central-spin systems and enables the programmable tuning of coherent interactions in the many-body regime.


title: Many-body quantum register for a spin qubit

abstract: Quantum networks require quantum nodes with coherent optical interfaces and multiple stationary qubits. In terms of optical properties, semiconductor quantum dots are highly compelling, but their adoption as quantum nodes has been impaired by the lack of auxiliary qubits. Here, we demonstrate a functional quantum register in a semiconductor quantum dot leveraging the dense, always-present nuclear spin ensemble. We prepare 13,000 host nuclear spins into a single many-body dark state to operate as the register logic state $|0\rangle$. The logic state $|1\rangle$ is defined as a single nuclear magnon excitation, enabling controlled quantum-state transfer between the electron spin qubit and the nuclear magnonic register. Using 130-ns SWAP gates, we implement a full write-store-retrieve-readout protocol with 68.6(4)% raw overall fidelity and a storage time of 130(16) $\mu$s in the absence of dynamical decoupling. Our work establishes how many-body physics can add step-change functionality to quantum devices, in this case transforming quantum dots into multi-qubit quantum nodes with deterministic registers.


title: Metrization of Gromov-Hausdorff-type topologies on boundedly-compact metric spaces

abstract: We present a new general framework for metrization of Gromov-Hausdorff-type topologies on non-compact metric spaces. We also give easy-to-check conditions for separability and completeness and hence the measure theoretic requirements are provided to study convergence of random spaces with additional random objects. In particular, our framework enables us to define a metric inducing a suitable Gromov-Hausdorff-type topology on the space of rooted boundedly-compact metric spaces with laws of stochastic processes and/or random fields, which was not clear how to do in previous frameworks. In addition to general theory, this paper includes several examples of Gromov-Hausdorff-type topologies, verifying that classical examples such as the Gromov-Hausdorff topology and the Gromov-Hausdorff-Prohorov topology are contained within our framework.


title: General Relativity: New insights from a Geometric Algebra approach

abstract: Geometric algebra (GA) is a formalism capable of describing all fields of physics with elegance, simplifying mathematics and providing new physical insights. Due to the coordinate dependence of tensor formalism, General Relativity(GR) is a challenging subject known for its complicated calculations and interpretation, which has not been thoroughly translated into GA until now. In this paper, we introduce GR with GA, emphasizing the physical interpretation of quantities and providing a step-by-step guide on performing calculations. In doing so, we show how GA provides insightful information on the physical meaning of the connection coefficients, the Riemann tensor and other physical quantities.


title: Collaborative Control Method of Transit Signal Priority Based on Cooperative Game and Reinforcement Learning

abstract: To address the low efficiency in priority signal control within intelligent transportation systems, this study introduces a novel eight-phase priority signal control method, CBQL-TSP, leveraging a hybrid decision-making framework that integrates cooperative game theory and reinforcement learning. This approach conceptualizes the allocation of bus signal priorities as a multi-objective decision-making problem across an eight-phase signal sequence, differentiating between priority and non-priority phases. It employs a cooperative game model to facilitate this differentiation. The developed hybrid decision-making algorithm, CBQL, effectively tackles the multi-objective decision-making challenges inherent in the eight-phase signal sequence. By computing the Shapley value function, it quantifies the marginal contributions of each participant, which in turn inform the construction of a state transition probability equation based on Shapley value ratios. Compared to conventional control methods, the CBQL-TSP method not only upholds the fairness principles of cooperative game theory but also harnesses the adaptive learning capabilities of Q-Learning. This enables dynamic adjustments to signal timing in response to real-time traffic conditions, significantly enhancing the flexibility and efficiency of priority signal control.


title: Exponential localization for eigensections of the Bochner-Schr\"odinger operator

abstract: We study asymptotic spectral properties of the Bochner-Schr\"odinger operator $H_{p}=\frac 1p\Delta^{L^p\otimes E}+V$ on high tensor powers of a Hermitian line bundle $L$ twisted by a Hermitian vector bundle $E$ on a Riemannian manifold $X$ of bounded geometry under assumption that the curvature form of $L$ is non-degenerate. At an arbitrary point $x_0$ of $X$ the operator $H_p$ can be approximated by a model operator $\mathcal H^{(x_0)}$, which is a Schr\"odinger operator with constant magnetic field. For large $p$, the spectrum of $H_p$ asymptotically coincides, up to order $p^{-1/4}$, with the union of the spectra of the model operators $\mathcal H^{(x_0)}$ over $X$. We show that, if the union of the spectra of $\mathcal H^{(x_0)}$ over the complement of a compact subset of $X$ has a gap, then the spectrum of $H_{p}$ in the gap is discrete and the corresponding eigensections decay exponentially away the compact subset.


title: Enhanced twist-and-turn dynamics of spin squeezing in internal bosonic Josephson junctions

abstract: The twist-and-turn dynamics of spin squeezing results from the interplay of the (nonlinear) one-axis-twisting- and the (linear) transverse-field turning term in the underlying Hamiltonian, both with constant (time-independent) respective coupling strengths. Using the methods of shortcuts to adiabaticity (STA) and their recently proposed enhanced version (eSTA), we demonstrate here that dynamics of this type can be utilized for a fast and robust preparation of spin-squeezed states in internal bosonic Josephson junctions -- condensates of cold bosonic atoms in two different internal (hyperfine) states (single-boson modes). Assuming that the initial state of this system is the coherent spin state with all the bosons in the equal superposition of the two single-boson modes and that the nonlinear-coupling strength in this system remains constant, we set out to determine the time-dependence of the linear-coupling strength using the STA and eSTA approaches. We then quantitatively characterize the modified twist-and-turn dynamics in this system by evaluating the coherent spin-squeezing- and number-squeezing parameters, as well as the fidelity of the target spin-squeezed states. In this manner, we show that the eSTA approach allows for a particularly robust experimental realization of strongly spin-squeezed states in this system, consistently outperforming its adiabatic and STA-based counterparts, even for systems with several hundred particles.


title: ColosSUMO: Evaluating Cooperative Driving Applications with Colosseum

abstract: The quest for safer and more efficient transportation through cooperative, connected and automated mobility (CCAM) calls for realistic performance analysis tools, especially with respect to wireless communications. While the simulation of existing and emerging communication technologies is an option, the most realistic results can be obtained by employing real hardware, as done for example in field operational tests (FOTs). For CCAM, however, performing FOTs requires vehicles, which are generally expensive. and performing such tests can be very demanding in terms of manpower, let alone considering safety issues. Mobility simulation with hardware-in-the-loop (HIL) serves as a middle ground, but current solutions lack flexibility and reconfigurability. This work thus proposes ColosSUMO as a way to couple Colosseum, the world's largest wireless network emulator, with the SUMO mobility simulator, showing its design concept, how it can be exploited to simulate realistic vehicular environments, and its flexibility in terms of communication technologies.


title: On the lack of selection for the transport equation over a dense set of vector fields

abstract: The purpose of this work is to demonstrate that the lack of selection by smooth regularisation for the continuity equation with a bounded, divergence-free vector field as demonstrated in \cite{DeLellis_Giri22} by De Lellis and Giri takes place over a dense set of vector fields. More precisely, we construct a set of bounded vector fields $D$ dense in $L^p_{loc}([0,2]\times \R^2;\R^2)$ such that for each vector field $\bb\in D$, there are two smooth regularisations of $\bb$, for which the unique solution of the Cauchy problem for the continuity equation along each regularisation converges to two distinct solutions of the Cauchy problem along $\bb$.


title: The density of Gabor systems in expansible locally compact abelian groups

abstract: We investigate the reproducing properties of Gabor systems within the context of expansible groups. These properties are established in terms of density conditions. The concept of density that we employ mirrors the well-known Beurling density defined in Euclidean space, which is made possible due to the expansive structure. Along the way, for groups with an open and compact subgroup, we demonstrate that modulation spaces are continuously embedded in Wiener spaces. Utilizing this result, we derive the Bessel condition of Gabor systems. Additionally, we construct Gabor orthonormal bases with arbitrarily small or large densities, enabling us to conclude that a Comparison Theorem, such as the one proven to be valid in the Euclidean case, cannot hold in this context. Finally, we establish that Gabor frames possess the Homogeneous Approximation Property.


title: Continuum limit of $p$-biharmonic equations on graphs

abstract: This paper studies the $p$-biharmonic equation on graphs, which arises in point cloud processing and can be interpreted as a natural extension of the graph $p$-Laplacian from the perspective of hypergraph. The asymptotic behavior of the solution is investigated when the random geometric graph is considered and the number of data points goes to infinity. We show that the continuum limit is an appropriately weighted $p$-biharmonic equation with homogeneous Neumann boundary conditions. The result relies on the uniform $L^p$ estimates for solutions and gradients of nonlocal and graph Poisson equations. The $L^\infty$ estimates of solutions are also obtained as a byproduct.


title: FAUST XV. A disk wind mapped by CH$_3$OH and SiO in the inner 300 au of the NGC 1333 IRAS 4A2 protostar

abstract: Context. Understanding the connection between outflows, winds, accretion and disks in the inner protostellar regions is crucial for comprehending star and planet formation process. Aims. We aim to we explore the inner 300 au of the protostar IRAS 4A2 as part of the ALMA FAUST Large Program. Methods. We analysed the kinematical structures of SiO and CH$_3$OH emission with 50 au resolution. Results. The emission arises from three zones: i) a very compact and unresolved region ($<$50 au) dominated by the ice sublimation zone, at $\pm$1.5 km s$^{-1}$ with respect to vsys, traced by methanol; ii) an intermediate region (between 50 au and 150 au) traced by both SiO and CH$_3$OH, between 2 and 6 km s$^{-1}$ with respect to vsys, with an inverted velocity gradient (with respect to the large scale emission), whose origin is not clear; iii) an extended region ($>$150 au) traced by SiO, above 7 km s$^{-1}$ with respect to vsys, and dominated by the outflow. In the intermediate region we estimated a CH$_3$OH/SiO abundance ratio of about 120-400 and a SiO/H$_2$ abundance of 10$^{-8}$. We explored various possibilities to explain the origin of this region such as, rotating disk/inner envelope, jet on the plane of the sky/precessing, wide angle disk wind. Conclusions. We propose that CH$_3$OH and SiO in the inner 100 au probe the base of a wide-angle disk wind. The material accelerated in the wind crosses the plane of the sky, giving rise to the observed inverted velocity gradient, and sputtering the grain mantles and cores releasing CH$_3$OH and SiO. This is the first detection of a disk wind candidate in SiO, and the second ever in CH$_3$OH.


title: Optical ray tracing of echelle spectrographs applied to the wavelength solution for precise radial velocities

abstract: We present $\texttt{moes}$, a ray tracing software package that computes the path of rays through echelle spectrographs. Our algorithm is based on sequential direct tracing with Seidel aberration corrections applied at the detector plane. As a test case, we model the CARMENES VIS spectrograph. After subtracting the best model from the data, the residuals yield an rms of 0.024 pix, setting a new standard to the precision of the wavelength solution of state-of-the-art radial velocity instruments. By including the influence of the changes of the environment in the ray propagation, we are able to predict instrumental radial velocity systematics at the 1 m/s level.


title: The finite-$T$ Lorentz number and the thermal conductivity. Aluminum and carbon conductivities from ambient to millions of degrees Kelvin

abstract: Theoretical prediction of the thermal conductivity $\kappa$ of metal-like electron-ion systems would be greatly simplified if a convenient generalization of the Lorentz number $L_N$ for arbitrary temperatures ($T$) and densities were available. Such calculations are needed in astrophysics, high-energy-density physics, semiconductor physics as well as in materials science. We present a finite-$T$ form of $L_N(T)$, expressed in terms of elementary Fermi integrals. It is a universal function of $t=T/E_F$, where $E_F$ is the Fermi energy of the electrons. A convenient four-parameter fit to $L_N(t)$ for $t=0-\infty$ further simplifies the applications. The effect of electron-electron interactions is also briefly discussed. Calculations for $L_N(t)$ and thermal conductivities $\kappa$ for Al and C are presented at several compressions and into the million-Kelvin range. Experimental isobaric conductivities for Al just above the meting point, and isochoric conductivities for Al and C from available density-functional theory simulations and average-atom calculations are used as comparisons.


title: SwipeGANSpace: Swipe-to-Compare Image Generation via Efficient Latent Space Exploration

abstract: Generating preferred images using generative adversarial networks (GANs) is challenging owing to the high-dimensional nature of latent space. In this study, we propose a novel approach that uses simple user-swipe interactions to generate preferred images for users. To effectively explore the latent space with only swipe interactions, we apply principal component analysis to the latent space of the StyleGAN, creating meaningful subspaces. We use a multi-armed bandit algorithm to decide the dimensions to explore, focusing on the preferences of the user. Experiments show that our method is more efficient in generating preferred images than the baseline methods. Furthermore, changes in preferred images during image generation or the display of entirely different image styles were observed to provide new inspirations, subsequently altering user preferences. This highlights the dynamic nature of user preferences, which our proposed approach recognizes and enhances.


title: Scalar perturbations from inflation in the presence of gauge fields

abstract: We study how Abelian-gauge-field production during inflation affects scalar perturbations in the case when the gauge field interacts with the inflaton directly (by means of generic kinetic and axial couplings) and via gravity. The homogeneous background solution is defined by self-consistently taking into account the backreaction of the gauge field on the evolution of the inflaton and the scale factor. For the perturbations on top of this background, all possible scalar contributions coming from the inflaton, the metric, and the gauge field are considered. We derive a second-order differential equation for the curvature perturbation, $\zeta$, capturing the impact of the gauge field, both on the background dynamics and on the evolution of scalar perturbations. The latter is described by a source term in the $\zeta$-equation, which is quadratic in the gauge-field operators and leads to non-Gaussianities in the curvature perturbations. We derive general expressions for the induced scalar power spectrum and bispectrum. Finally, we apply our formalism to the well-known case of axion inflation without backreaction. Numerical results show that, in this example, the effect of including metric perturbations is small for values of the gauge-field production parameter $\xi> 3$. This is in agreement with the previous results in the literature. However, in the region of smaller values, $\xi\lesssim 2$, our new results exhibit order-of-unity deviations when compared to previous results.


title: Early dark energy and scalarization in a scalar-tensor model

abstract: We present a model in which the Gauss-Bonnet invariant holds the quintessence at a fixed point, respecting an initial $Z_2$ symmetry in the radiation-dominated era. This results in an early dark energy, which becomes significant around the matter-radiation equality era. However, due to $Z_2$ symmetry breaking, scalarization occurs, leading to a rapid reduction in the early dark energy density. The model then quickly behaves like the $\Lambda$CDM model. This scenario alleviates the Hubble tension and aligns with the assumption that the gravitational wave speed is infinitesimally close to the speed of light.


title: Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners

abstract: 3D visual grounding is a challenging task that often requires direct and dense supervision, notably the semantic label for each object in the scene. In this paper, we instead study the naturally supervised setting that learns from only 3D scene and QA pairs, where prior works underperform. We propose the Language-Regularized Concept Learner (LARC), which uses constraints from language as regularization to significantly improve the accuracy of neuro-symbolic concept learners in the naturally supervised setting. Our approach is based on two core insights: the first is that language constraints (e.g., a word's relation to another) can serve as effective regularization for structured representations in neuro-symbolic models; the second is that we can query large language models to distill such constraints from language properties. We show that LARC improves performance of prior works in naturally supervised 3D visual grounding, and demonstrates a wide range of 3D visual reasoning capabilities-from zero-shot composition, to data efficiency and transferability. Our method represents a promising step towards regularizing structured visual reasoning frameworks with language-based priors, for learning in settings without dense supervision.


title: Fibering polarizations and Mabuchi rays on symmetric spaces of compact type

abstract: In this paper, we describe holomorphic quantizations of the cotangent bundle of a symmetric space of compact type $T^*(U/K)\cong U_\mathbb{C}/K_\mathbb{C}$, along Mabuchi rays of $U$-invariant K\"ahler structures. At infinite geodesic time, the K\"ahler polarizations converge to a mixed polarization $\mathcal{P}_\infty$. We show how a generalized coherent state transform relates the quantizations along the Mabuchi geodesics such that holomorphic sections converge, as geodesic time goes to infinity, to distributional $\mathcal{P}_\infty$-polarized sections. Unlike in the case of $T^*U$, the gCST mapping from the Hilbert space of vertically polarized sections are not asymptotically unitary due to the appearance of representation dependent factors associated to the isotypical decomposition for the $U$-action. In agreement with the general program outlined in [Bai+23], we also describe how the quantization in the limit polarization $\mathcal{P}_\infty$ is given by the direct sum of the quantizations for all the symplectic reductions relative to the invariant torus action associated to the Hamiltonian action of $U$.


title: Structural properties of Krylov subspaces and applications to unbounded self-adjoint operators

abstract: This paper presents a study of the inherent structural properties of Krylov subspaces, in particular for the self-adjoint class of operators, and how they relate with the important phenomenon of `Krylov solvability' of linear inverse problems. Owing to the complexity of the problem in the unbounded setting, recently developed perturbative techniques are used that exploit the use of the weak topology on $\mathcal{H}$. We also make a strong connection between the approximative properties of the Krylov subspace and the famous Hamburger problem of moments, in particular the determinacy condition.


title: Generative AI Usage and Academic Performance

abstract: This study evaluates the impact of students' usage of generative artificial intelligence (GenAI) tools such as ChatGPT on their academic performance. We analyze student essays using GenAI detection systems to identify GenAI users among the cohort. Employing multivariate regression analysis, we find that students using GenAI tools score on average 6.71 (out of 100) points lower than non-users. While GenAI tools may offer benefits for learning and engagement, the way students actually use it correlates with diminished academic outcomes. Exploring the underlying mechanism, additional analyses show that the effect is particularly detrimental to students with high learning potential, suggesting an effect whereby GenAI tool usage hinders learning. Our findings provide important empirical evidence for the ongoing debate on the integration of GenAI in higher education and underscores the necessity for educators, institutions, and policymakers to carefully consider its implications for student performance.


title: Comparing Multivariate Distributions: A Novel Approach Using Optimal Transport-based Plots

abstract: Quantile-Quantile (Q-Q) plots are widely used for assessing the distributional similarity between two datasets. Traditionally, Q-Q plots are constructed for univariate distributions, making them less effective in capturing complex dependencies present in multivariate data. In this paper, we propose a novel approach for constructing multivariate Q-Q plots, which extend the traditional Q-Q plot methodology to handle high-dimensional data. Our approach utilizes optimal transport (OT) and entropy-regularized optimal transport (EOT) to align the empirical quantiles of the two datasets. Additionally, we introduce another technique based on OT and EOT potentials which can effectively compare two multivariate datasets. Through extensive simulations and real data examples, we demonstrate the effectiveness of our proposed approach in capturing multivariate dependencies and identifying distributional differences such as tail behaviour. We also propose two test statistics based on the Q-Q and potential plots to compare two distributions rigorously.


title: Dynamics of particle aggregation in dewetting films of complex liquids

abstract: We consider the dynamic wetting and dewetting processes of films and droplets of complex liquids on planar surfaces, focusing on the case of colloidal suspensions, where the particle interactions can be sufficiently attractive to cause agglomeration of the colloids within the film. This leads to an interesting array of dynamic behaviours within the liquid and of the liquid-air interface. Incorporating concepts from thermodynamics and using the thin-film approximation, we construct a model consisting of a pair of coupled partial differential equations that represent the evolution of the liquid film and the effective colloidal height profiles. We determine the relevant phase behaviour of the uniform system, including finding associated binodal and spinodal curves, helping to uncover how the emerging behaviour depends on the particle interactions. Performing a linear stability analysis of our system enables us to identify parameter regimes where agglomerates form, which we independently confirm through numerical simulations and continuation of steady states, to construct bifurcation diagrams. We obtain various dynamics such as uniform colloidal profiles in an unstable situation evolving into agglomerates and thus elucidate the interplay between dewetting and particle aggregation in complex liquids on surfaces.


title: GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting

abstract: We propose GS-LRM, a scalable large reconstruction model that can predict high-quality 3D Gaussian primitives from 2-4 posed sparse images in 0.23 seconds on single A100 GPU. Our model features a very simple transformer-based architecture; we patchify input posed images, pass the concatenated multi-view image tokens through a sequence of transformer blocks, and decode final per-pixel Gaussian parameters directly from these tokens for differentiable rendering. In contrast to previous LRMs that can only reconstruct objects, by predicting per-pixel Gaussians, GS-LRM naturally handles scenes with large variations in scale and complexity. We show that our model can work on both object and scene captures by training it on Objaverse and RealEstate10K respectively. In both scenarios, the models outperform state-of-the-art baselines by a wide margin. We also demonstrate applications of our model in downstream 3D generation tasks. Our project webpage is available at: https://sai-bi.github.io/project/gs-lrm/ .


title: $C$-embedding, Lindel\"ofness, \v{C}ech-completeness

abstract: We show that in the class of Lindel\"of \v{C}ech-complete spaces the property of being $C$-embedded is quite well-behaved. It admits a useful characterization that can be used to show that products and perfect preimages of $C$-embedded spaces are again $C$-embedded. We also show that both properties, Lindel\"of and \v{C}ech-complete, are needed in the product result.


title: Slice rank and analytic rank for trilinear forms

abstract: In this note, we present an elementary proof of the fact that the slice rank of a trilinear form over a finite field is bounded above by a linear expression in the analytic rank. The existing proofs by Adiprasito-Kazhdan-Ziegler and Cohen-Moshkovitz both rely on results of Derksen via geometric invariant theory. A novel feature of our proof is that the linear forms appearing in the slice rank decomposition are obtained from the trilinear form by fixing coordinates.


title: When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectively

abstract: In this paper, we demonstrate how Large Language Models (LLMs) can effectively learn to use an off-the-shelf information retrieval (IR) system specifically when additional context is required to answer a given question. Given the performance of IR systems, the optimal strategy for question answering does not always entail external information retrieval; rather, it often involves leveraging the parametric memory of the LLM itself. Prior research has identified this phenomenon in the PopQA dataset, wherein the most popular questions are effectively addressed using the LLM's parametric memory, while less popular ones require IR system usage. Following this, we propose a tailored training approach for LLMs, leveraging existing open-domain question answering datasets. Here, LLMs are trained to generate a special token, <RET>, when they do not know the answer to a question. Our evaluation of the Adaptive Retrieval LLM (Adapt-LLM) on the PopQA dataset showcases improvements over the same LLM under three configurations: (i) retrieving information for all the questions, (ii) using always the parametric memory of the LLM, and (iii) using a popularity threshold to decide when to use a retriever. Through our analysis, we demonstrate that Adapt-LLM is able to generate the <RET> token when it determines that it does not know how to answer a question, indicating the need for IR, while it achieves notably high accuracy levels when it chooses to rely only on its parametric memory.


title: RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splatting

abstract: We present Real-time Gaussian SLAM (RTG-SLAM), a real-time 3D reconstruction system with an RGBD camera for large-scale environments using Gaussian splatting. The system features a compact Gaussian representation and a highly efficient on-the-fly Gaussian optimization scheme. We force each Gaussian to be either opaque or nearly transparent, with the opaque ones fitting the surface and dominant colors, and transparent ones fitting residual colors. By rendering depth in a different way from color rendering, we let a single opaque Gaussian well fit a local surface region without the need of multiple overlapping Gaussians, hence largely reducing the memory and computation cost. For on-the-fly Gaussian optimization, we explicitly add Gaussians for three types of pixels per frame: newly observed, with large color errors, and with large depth errors. We also categorize all Gaussians into stable and unstable ones, where the stable Gaussians are expected to well fit previously observed RGBD images and otherwise unstable. We only optimize the unstable Gaussians and only render the pixels occupied by unstable Gaussians. In this way, both the number of Gaussians to be optimized and pixels to be rendered are largely reduced, and the optimization can be done in real time. We show real-time reconstructions of a variety of large scenes. Compared with the state-of-the-art NeRF-based RGBD SLAM, our system achieves comparable high-quality reconstruction but with around twice the speed and half the memory cost, and shows superior performance in the realism of novel view synthesis and camera tracking accuracy.


title: Identification by non-Gaussianity in structural threshold and smooth transition vector autoregressive models

abstract: Linear structural vector autoregressive models can be identified statistically without imposing restrictions on the model if the shocks are mutually independent and at most one of them is Gaussian. We show that this result extends to structural threshold and smooth transition vector autoregressive models incorporating a time-varying impact matrix defined as a weighted sum of the impact matrices of the regimes. We also discuss labelling of the shocks, maximum likelihood estimation of the parameters, and stationarity the model. The introduced methods are implemented to the accompanying R package sstvars. Our empirical application studies the effects of the climate policy uncertainty shock on the U.S. macroeconomy. In a structural logistic smooth transition vector autoregressive model consisting of two regimes, we find that a positive climate policy uncertainty shock decreases production in times of low economic policy uncertainty but slightly increases it in times of high economic policy uncertainty.


title: Harmonic LLMs are Trustworthy

abstract: We introduce an intuitive method to test the robustness (stability and explainability) of any black-box LLM in real-time, based upon the local deviation from harmoniticity, denoted as $\gamma$. To the best of our knowledge this is the first completely model-agnostic and unsupervised method of measuring the robustness of any given response from an LLM, based upon the model itself conforming to a purely mathematical standard. We conduct human annotation experiments to show the positive correlation of $\gamma$ with false or misleading answers, and demonstrate that following the gradient of $\gamma$ in stochastic gradient ascent efficiently exposes adversarial prompts. Measuring $\gamma$ across thousands of queries in popular LLMs (GPT-4, ChatGPT, Claude-2.1, Mixtral-8x7B, Smaug-72B, Llama2-7B, and MPT-7B) allows us to estimate the liklihood of wrong or hallucinatory answers automatically and quantitatively rank the reliability of these models in various objective domains (Web QA, TruthfulQA, and Programming QA). Across all models and domains tested, human ratings confirm that $\gamma \to 0$ indicates trustworthiness, and the low-$\gamma$ leaders among these models are GPT-4, ChatGPT, and Smaug-72B.


title: SRG/ART-XC discovery of SRGAJ144459.2-604207: a well-tempered bursting accreting millisecond X-ray pulsar

abstract: We report on the discovery of the new accreting millisecond X-ray pulsar SRGAJ144459.2-604207 using the SRG/ART-XC data. The source was observed twice in February 2024 during the declining phase of the outburst. Timing analysis revealed a coherent signal near 447.8~Hz modulated by the Doppler effect due to the orbital motion. The derived parameters for the binary system are consistent with the circular orbit with a period of $\sim5.2$~h. The pulse profiles of the persistent emission, showing a sine-like part during half a period with a plateau in between, can well be modelled by emission from two circular spots partially eclipsed by the accretion disk. Additionally, during our 133~ks exposure observations, we detected 19 thermonuclear X-ray bursts. All bursts have similar shapes and energetics, and do not show any signs of photospheric radius expansion. The burst rate decreases linearly from one per $\sim$1.6~h at the beginning of observations to one per $\sim$2.2~h at the end and anticorrelates with the persistent flux. Spectral evolution during the bursts is consistent with the models of the neutron star atmospheres heated by accretion and imply a neutron star radius of 11--12~km and the distance to the source of 8--9~kpc. We also detected pulsations during the bursts and showed that the pulse profiles differ substantially from those observed in the persistent emission. However, we could not find a simple physical model explaining the pulse profiles detected during the bursts.


title: A rank decomposition for the topological classification of neural representations

abstract: Neural networks can be thought of as applying a transformation to an input dataset. The way in which they change the topology of such a dataset often holds practical significance for many tasks, particularly those demanding non-homeomorphic mappings for optimal solutions, such as classification problems. In this work, we leverage the fact that neural networks are equivalent to continuous piecewise-affine maps, whose rank can be used to pinpoint regions in the input space that undergo non-homeomorphic transformations, leading to alterations in the topological structure of the input dataset. Our approach enables us to make use of the relative homology sequence, with which one can study the homology groups of the quotient of a manifold $\mathcal{M}$ and a subset $A$, assuming some minimal properties on these spaces. As a proof of principle, we empirically investigate the presence of low-rank (topology-changing) affine maps as a function of network width and mean weight. We show that in randomly initialized narrow networks, there will be regions in which the (co)homology groups of a data manifold can change. As the width increases, the homology groups of the input manifold become more likely to be preserved. We end this part of our work by constructing highly non-random wide networks that do not have this property and relating this non-random regime to Dale's principle, which is a defining characteristic of biological neural networks. Finally, we study simple feedforward networks trained on MNIST, as well as on toy classification and regression tasks, and show that networks manipulate the topology of data differently depending on the continuity of the task they are trained on.


title: Elevating electron energy gain and betatron X-ray emission in proton-driven wakefield acceleration

abstract: The long proton beams present at CERN have the potential to evolve into a train of microbunches through the self-modulation instability process. The resonant wakefield generated by a periodic train of proton microbunches can establish a high acceleration field within the plasma, facilitating electron acceleration. This paper investigates the impact of plasma density on resonant wakefield excitation, thus influencing acceleration of a witness electron bunch and its corresponding betatron radiation within the wakefield. Various scenarios involving different plasma densities are explored through particle-in-cell simulations. The peak wakefield in each scenario is calculated by considering a long pre-modulated proton driver with a fixed peak current. Subsequently, the study delves into the witness beam acceleration in the wakefield and its radiation emission. Elevated plasma density increases both the number of microbunches and the accelerating gradient of each microbunch, consequently resulting in heightened resonant wakefield. Nevertheless, the scaling is disrupted by the saturation of the resonant wakefield due to the nonlinearities. The simulation results reveal that at high plasma densities an intense and broadband radiation spectrum extending into the domain of the hard X-rays and gamma rays is generated. Furthermore, in such instances, the energy gain of the witness beam is significantly enhanced. The impact of wakefield on the witness energy gain and the corresponding radiation spectrum is clearly evident at extremely elevated densities.


title: QuTracer: Mitigating Quantum Gate and Measurement Errors by Tracing Subsets of Qubits

abstract: Quantum error mitigation plays a crucial role in the current noisy-intermediate-scale-quantum (NISQ) era. As we advance towards achieving a practical quantum advantage in the near term, error mitigation emerges as an indispensable component. One notable prior work, Jigsaw, demonstrates that measurement crosstalk errors can be effectively mitigated by measuring subsets of qubits. Jigsaw operates by running multiple copies of the original circuit, each time measuring only a subset of qubits. The localized distributions yielded from measurement subsetting suffer from less crosstalk and are then used to update the global distribution, thereby achieving improved output fidelity. Inspired by the idea of measurement subsetting, we propose QuTracer, a framework designed to mitigate both gate and measurement errors in subsets of qubits by tracing the states of qubit subsets throughout the computational process. In order to achieve this goal, we introduce a technique, qubit subsetting Pauli checks (QSPC), which utilizes circuit cutting and Pauli Check Sandwiching (PCS) to trace the qubit subsets distribution to mitigate errors. The QuTracer framework can be applied to various algorithms including, but not limited to, VQE, QAOA, quantum arithmetic circuits, QPE, and Hamiltonian simulations. In our experiments, we perform both noisy simulations and real device experiments to demonstrate that QuTracer is scalable and significantly outperforms the state-of-the-art approaches.


title: Automated Generation of High-Quality Medical Simulation Scenarios Through Integration of Semi-Structured Data and Large Language Models

abstract: This study introduces a transformative framework for medical education by integrating semi-structured data with Large Language Models (LLMs), primarily OpenAIs ChatGPT3.5, to automate the creation of medical simulation scenarios. Traditionally, developing these scenarios was a time-intensive process with limited flexibility to meet diverse educational needs. The proposed approach utilizes AI to efficiently generate detailed, clinically relevant scenarios that are tailored to specific educational objectives. This innovation has significantly reduced the time and resources required for scenario development, allowing for a broader variety of simulations. Preliminary feedback from educators and learners has shown enhanced engagement and improved knowledge acquisition, confirming the effectiveness of this AI-enhanced methodology in simulation-based learning. The integration of structured data with LLMs not only streamlines the creation process but also offers a scalable, dynamic solution that could revolutionize medical training, highlighting the critical role of AI in advancing educational outcomes and patient care standards.


title: ThangDLU at #SMM4H 2024: Encoder-decoder models for classifying text data on social disorders in children and adolescents

abstract: This paper describes our participation in Task 3 and Task 5 of the #SMM4H (Social Media Mining for Health) 2024 Workshop, explicitly targeting the classification challenges within tweet data. Task 3 is a multi-class classification task centered on tweets discussing the impact of outdoor environments on symptoms of social anxiety. Task 5 involves a binary classification task focusing on tweets reporting medical disorders in children. We applied transfer learning from pre-trained encoder-decoder models such as BART-base and T5-small to identify the labels of a set of given tweets. We also presented some data augmentation methods to see their impact on the model performance. Finally, the systems obtained the best F1 score of 0.627 in Task 3 and the best F1 score of 0.841 in Task 5.


title: Assessing LLMs in Malicious Code Deobfuscation of Real-world Malware Campaigns

abstract: The integration of large language models (LLMs) into various pipelines is increasingly widespread, effectively automating many manual tasks and often surpassing human capabilities. Cybersecurity researchers and practitioners have recognised this potential. Thus, they are actively exploring its applications, given the vast volume of heterogeneous data that requires processing to identify anomalies, potential bypasses, attacks, and fraudulent incidents. On top of this, LLMs' advanced capabilities in generating functional code, comprehending code context, and summarising its operations can also be leveraged for reverse engineering and malware deobfuscation. To this end, we delve into the deobfuscation capabilities of state-of-the-art LLMs. Beyond merely discussing a hypothetical scenario, we evaluate four LLMs with real-world malicious scripts used in the notorious Emotet malware campaign. Our results indicate that while not absolutely accurate yet, some LLMs can efficiently deobfuscate such payloads. Thus, fine-tuning LLMs for this task can be a viable potential for future AI-powered threat intelligence pipelines in the fight against obfuscated malware.


title: Controlled Spalling of Single Crystal 4H-SiC Bulk Substrates

abstract: We detail several scientific and engineering innovations which enable the controlled spalling of 10 - 50 micron thick films of single crystal 4H silicon carbide (4H-SiC) from bulk substrates. 4H-SiC's properties, including high thermal conductivity and a wide bandgap, make it an ideal candidate for high-temperature, high-voltage power electronic devices. Moreover, 4H-SiC has been shown to be an excellent host of solid-state atomic defect qubits for quantum computing and quantum networking. Because 4H-SiC single crystal substrates are expensive (due to long growth times and limited yield), techniques for removal and transfer of layers in the tens-of-microns thickness range are highly desirable for substrate reuse and heterogenous integration of separated layers. In this work we utilize novel approaches for stressor layer thickness control and spalling crack initiation to demonstrate controlled spalling of 4H-SiC, the highest fracture toughness material spalled to date. Additionally, we demonstrate substrate re-use, bonding of the spalled films to carrier substrates, and explore the spin coherence of the spalled films. In preliminary studies we are able to achieve coherent spin control of neutral divacancy ($VV^{0}$) qubit ensembles and measure a spin T2* of 0.581 $\mu$s in such spalled films.


title: Automated, Reliable, and Efficient Continental-Scale Replication of 7.3 Petabytes of Climate Simulation Data: A Case Study

abstract: We report on our experiences replicating 7.3 petabytes (PB) of Earth System Grid Federation (ESGF) climate simulation data from Lawrence Livermore National Laboratory (LLNL) in California to Argonne National Laboratory (ANL) in Illinois and Oak Ridge National Laboratory (ORNL) in Tennessee. This movement of some 29 million files, twice, undertaken in order to establish new ESGF nodes at ANL and ORNL, was performed largely automatically by a simple replication tool, a script that invoked Globus to transfer large bundles of files while tracking progress in a database. Under the covers, Globus organized transfers to make efficient use of the high-speed Energy Sciences network (ESnet) and the data transfer nodes deployed at participating sites, and also addressed security, integrity checking, and recovery from a variety of transient failures. This success demonstrates the considerable benefits that can accrue from the adoption of performant data replication infrastructure.


title: Roman Domination on Graphings

abstract: We study a variant of domination, called Roman domination, where we must assign to each vertex one of the labels 0, 1, or 2 and require that every vertex with label 0 has a neighbour with label 2. We study the problem of finding a low-cost Roman dominating function on Lebesgue-measurable graphings, that is, on infinite graphs whose vertices are the points of a probability space. We provide a framework to tackle optimisation problems in the measurable combinatorial setting. In particular, we fully answer the Roman domination problem on irrational cycle graphs, a specific type of graphing on the space $\mathbb{R}/\mathbb{Z}$ where an irrational number ${\alpha}$ is given and two vertices are adjacent if and only if their distance is ${\alpha}$.


title: The lazy (NTK) and rich ($\mu$P) regimes: a gentle tutorial

abstract: A central theme of the modern machine learning paradigm is that larger neural networks achieve better performance on a variety of metrics. Theoretical analyses of these overparameterized models have recently centered around studying very wide neural networks. In this tutorial, we provide a nonrigorous but illustrative derivation of the following fact: in order to train wide networks effectively, there is only one degree of freedom in choosing hyperparameters such as the learning rate and the size of the initial weights. This degree of freedom controls the richness of training behavior: at minimum, the wide network trains lazily like a kernel machine, and at maximum, it exhibits feature learning in the so-called $\mu$P regime. In this paper, we explain this richness scale, synthesize recent research results into a coherent whole, offer new perspectives and intuitions, and provide empirical evidence supporting our claims. In doing so, we hope to encourage further study of the richness scale, as it may be key to developing a scientific theory of feature learning in practical deep neural networks.


title: Efficient Multiparty Quantum Key Distribution over Quantum Networks

abstract: Multiparty quantum key distribution (QKD) is useful for many applications that involve secure communication or collaboration among multiple parties. While it can be achieved using pairwise QKD, a more efficient approach is to achieve it using multipartite entanglement distributed over quantum networks that connect the multiple parties. Existing studies on multipartite entanglement distribution, however, are not designed for multiparty QKD, and hence do not aim to maximize secret key generation rate. In this paper, we design efficient strategies for multiparty QKD over quantum networks. For 3-party QKD, we derive closed-form expressions for analyzing key distribution over quantum networks. We then use it to develop an efficient strategy for 3-party QKD by packing multiple stars that connect the 3 parties. For the general form of N-party QKD, we develop an approach that packs multiple trees to connect the N parties, while directly incorporating the estimated key rates on network paths. Extensive evaluation of our strategies, in both grid and random graphs, under a wide range of settings, demonstrates that our schemes achieve high key rate, which degrades gracefully when increasing the number of parties.


title: PANGeA: Procedural Artificial Narrative using Generative AI for Turn-Based Video Games

abstract: This research introduces Procedural Artificial Narrative using Generative AI (PANGeA), a structured approach for leveraging large language models (LLMs), guided by a game designer's high-level criteria, to generate narrative content for turn-based role-playing video games (RPGs). Distinct from prior applications of LLMs used for video game design, PANGeA innovates by not only generating game level data (which includes, but is not limited to, setting, key items, and non-playable characters (NPCs)), but by also fostering dynamic, free-form interactions between the player and the environment that align with the procedural game narrative. The NPCs generated by PANGeA are personality-biased and express traits from the Big 5 Personality Model in their generated responses. PANGeA addresses challenges behind ingesting free-form text input, which can prompt LLM responses beyond the scope of the game narrative. A novel validation system that uses the LLM's intelligence evaluates text input and aligns generated responses with the unfolding narrative. Making these interactions possible, PANGeA is supported by a server that hosts a custom memory system that supplies context for augmenting generated responses thus aligning them with the procedural narrative. For its broad application, the server has a REST interface enabling any game engine to integrate directly with PANGeA, as well as an LLM interface adaptable with local or private LLMs. PANGeA's ability to foster dynamic narrative generation by aligning responses with the procedural narrative is demonstrated through an empirical study and ablation test of two versions of a demo game. These are, a custom, browser-based GPT and a Unity demo. As the results show, PANGeA holds potential to assist game designers in using LLMs to generate narrative-consistent content even when provided varied and unpredictable, free-form text input.


title: PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarios

abstract: We address the challenge of content diversity and controllability in pedestrian simulation for driving scenarios. Recent pedestrian animation frameworks have a significant limitation wherein they primarily focus on either following trajectory [46] or the content of the reference video [57], consequently overlooking the potential diversity of human motion within such scenarios. This limitation restricts the ability to generate pedestrian behaviors that exhibit a wider range of variations and realistic motions and therefore restricts its usage to provide rich motion content for other components in the driving simulation system, e.g., suddenly changed motion to which the autonomous vehicle should respond. In our approach, we strive to surpass the limitation by showcasing diverse human motions obtained from various sources, such as generated human motions, in addition to following the given trajectory. The fundamental contribution of our framework lies in combining the motion tracking task with trajectory following, which enables the tracking of specific motion parts (e.g., upper body) while simultaneously following the given trajectory by a single policy. This way, we significantly enhance both the diversity of simulated human motion within the given scenario and the controllability of the content, including language-based control. Our framework facilitates the generation of a wide range of human motions, contributing to greater realism and adaptability in pedestrian simulations for driving scenarios. More information is on our project page https://wangjingbo1219.github.io/papers/CVPR2024_PACER_PLUS/PACERPLUSPage.html .


title: Attention-Constrained Inference for Robust Decoder-Only Text-to-Speech

abstract: Recent popular decoder-only text-to-speech models are known for their ability of generating natural-sounding speech. However, such models sometimes suffer from word skipping and repeating due to the lack of explicit monotonic alignment constraints. In this paper, we notice from the attention maps that some particular attention heads of the decoder-only model indicate the alignments between speech and text. We call the attention maps of those heads Alignment-Emerged Attention Maps (AEAMs). Based on this discovery, we propose a novel inference method without altering the training process, named Attention-Constrained Inference (ACI), to facilitate monotonic synthesis. It first identifies AEAMs using the Attention Sweeping algorithm and then applies constraining masks on AEAMs. Our experimental results on decoder-only TTS model VALL-E show that the WER of synthesized speech is reduced by up to 20.5% relatively with ACI while the naturalness and speaker similarity are comparable.


title: Sound and Complete Proof Rules for Probabilistic Termination

abstract: Termination is a fundamental question in the analysis of probabilistic imperative programs. We consider the qualitative and quantitative probabilistic termination problems for an imperative programming model with discrete probabilistic choice and demonic bounded nondeterminism. The qualitative question asks if the program terminates almost surely, no matter how nondeterminism is resolved; the quantitative question asks for a bound on the probability of termination. Despite a long and rich literature on the topic, no sound and relatively complete proof systems were known for this problem. We provide the first sound and relatively complete proof rules for proving qualitative and quantitative termination in the assertion language of arithmetic. Our proof rules use supermartingales as estimates of likelihood of the prgroam's evolution - the key insight is to use appropriately defined finite-state sub-instances. Our completeness result shows how to construct a suitable supermartingales from an almost-surely terminating program. We also show that proofs of termination in many existing proof systems can be transformed to proofs in our system, pointing to its applicability in practice. As an application of our proof rule, we show a proof of almost sure termination for the two-dimensional random walker.