title: High-Entanglement Capabilities for Variational Quantum Algorithms: The Poisson Equation Case

abstract: The discretized Poisson equation matrix (DPEM) is vital to the field of computational fluid dynamics (CFD), and an algorithm that solves it on a quantum computer could potentially grant exponential space and time complexity speedups. However, the DPEM in 1D has been shown to have trouble being represented as a decomposition in the Pauli basis. Additionally, traditional ansatz for Variational Quantum Algorithms (VQAs) that are used to heuristically solve linear systems (such as the DPEM) have large numbers of parameters, making them harder to train. This research attempts to resolve these problems by utilizing the IonQ Aria quantum computer capabilities that boast all-to-all connectivity of qubits. We propose a decomposition of the DPEM that is based on 2- or 3-qubit entanglement gates and is shown to have $O(1)$ terms with respect to system size, with one term having an $O(n^2)$ circuit depth and the rest having only an $O(1)$ circuit depth (where $n$ is the number of qubits defining the system size). To test these new improvements, we ran numerical simulations to examine how well the VQAs performed with varying system sizes, showing that the new setup offers an $O(n)$ scaling of the number of iterations required for convergence, providing an exponential speedup over their classical computing counterparts. This project shows that the future of computational fluid dynamics may involve quantum computers to provide significant time and space complexity speedups.


title: RoboGolf: Mastering Real-World Minigolf with a Reflective Multi-Modality Vision-Language Model

abstract: Minigolf, a game with countless court layouts, and complex ball motion, constitutes a compelling real-world testbed for the study of embodied intelligence. As it not only challenges spatial and kinodynamic reasoning but also requires reflective and corrective capacities to address erroneously designed courses. We introduce RoboGolf, a framework that perceives dual-camera visual inputs with nested VLM-empowered closed-loop control and reflective equilibrium loop. Extensive experiments demonstrate the effectiveness of RoboGolf on challenging minigolf courts including those that are impossible to finish.


title: Harnessing GPU Power for Enhanced OLTP: A Study in Concurrency Control Schemes

abstract: GPUs, whose performance has gone through a huge leap over the past decade, have proved their ability to accelerate Online Analytical Processing (OLAP) operations. On the other hand, there is still a huge gap in the field of GPU-accelerated Online Transaction Processing (OLTP) operations since it was generally believed that GPUswere not suitable for OLTP in the past. However, the massive parallelism and high memory bandwidth give GPUs the potential to process thousands of transactions concurrently. Among the components of OLTP systems, Concurrency Control (CC) schemes have a great impact on the performance of transaction processing and they may behave differently on GPUs because of the different hardware architectures between GPUs and CPUs. In this paper, we design and build the first test-bed gCCTB for CCschemes on GPUsandimplement eight CC schemes for gCCTB. These schemes include six common schemes previously designed for CPUs and two schemes designed for GPUs. Then we make a comprehensive evaluation of these CC schemes with YCSB and TPC-C benchmarks and a number of launch parameters on GPUs. The experience accumulated on our test-bed can assist researchers andengineers to design andimplementnewGPU-acceleratedOLTP systems. Furthermore, the results of our evaluation cast light on research directions of high performance CC schemes on GPUs.


title: Probing entanglement dynamics and topological transitions on noisy intermediate-scale quantum computers

abstract: We simulate quench dynamics of the Su-Schrieffer-Heeger (SSH) chain on the IBM quantum computers, calculating the R\'enyi entanglement entropy, the twist order parameter and the Berry phase. The latter two quantities can be deduced from a slow-twist operator defined in the Lieb-Schultz-Mattis theorem. The R\'enyi entropy is obtained using a recently developed randomized measurement scheme. The twist order parameter and the Berry phase are measured without the need for additional gates or ancilla qubits. We consider quench protocols in which a trivial initial state evolves dynamically in time under the topological SSH Hamiltonian in the fully dimerized limit (the flat-band limit). During these quenches, there are persistent and periodic oscillations in the time evolution of both entanglement entropy and twist order parameter. Through the implementation of error mitigation techniques using a global depolarizing ansatz and postselection, our simulations on the IBM devices yield results that closely match exact solutions.


title: One-pass Multiple Conformer and Foundation Speech Systems Compression and Quantization Using An All-in-one Neural Model

abstract: We propose a novel one-pass multiple ASR systems joint compression and quantization approach using an all-in-one neural model. A single compression cycle allows multiple nested systems with varying Encoder depths, widths, and quantization precision settings to be simultaneously constructed without the need to train and store individual target systems separately. Experiments consistently demonstrate the multiple ASR systems compressed in a single all-in-one model produced a word error rate (WER) comparable to, or lower by up to 1.01\% absolute (6.98\% relative) than individually trained systems of equal complexity. A 3.4x overall system compression and training time speed-up was achieved. Maximum model size compression ratios of 12.8x and 3.93x were obtained over the baseline Switchboard-300hr Conformer and LibriSpeech-100hr fine-tuned wav2vec2.0 models, respectively, incurring no statistically significant WER increase.


title: On the Computability of Robust PAC Learning

abstract: We initiate the study of computability requirements for adversarially robust learning. Adversarially robust PAC-type learnability is by now an established field of research. However, the effects of computability requirements in PAC-type frameworks are only just starting to emerge. We introduce the problem of robust computable PAC (robust CPAC) learning and provide some simple sufficient conditions for this. We then show that learnability in this setup is not implied by the combination of its components: classes that are both CPAC and robustly PAC learnable are not necessarily robustly CPAC learnable. Furthermore, we show that the novel framework exhibits some surprising effects: for robust CPAC learnability it is not required that the robust loss is computably evaluable! Towards understanding characterizing properties, we introduce a novel dimension, the computable robust shattering dimension. We prove that its finiteness is necessary, but not sufficient for robust CPAC learnability. This might yield novel insights for the corresponding phenomenon in the context of robust PAC learnability, where insufficiency of the robust shattering dimension for learnability has been conjectured, but so far a resolution has remained elusive.


title: Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models

abstract: In reinforcement learning, specification gaming occurs when AI systems learn undesired behaviors that are highly rewarded due to misspecified training goals. Specification gaming can range from simple behaviors like sycophancy to sophisticated and pernicious behaviors like reward-tampering, where a model directly modifies its own reward mechanism. However, these more pernicious behaviors may be too complex to be discovered via exploration. In this paper, we study whether Large Language Model (LLM) assistants which find easily discovered forms of specification gaming will generalize to perform rarer and more blatant forms, up to and including reward-tampering. We construct a curriculum of increasingly sophisticated gameable environments and find that training on early-curriculum environments leads to more specification gaming on remaining environments. Strikingly, a small but non-negligible proportion of the time, LLM assistants trained on the full curriculum generalize zero-shot to directly rewriting their own reward function. Retraining an LLM not to game early-curriculum environments mitigates, but does not eliminate, reward-tampering in later environments. Moreover, adding harmlessness training to our gameable environments does not prevent reward-tampering. These results demonstrate that LLMs can generalize from common forms of specification gaming to more pernicious reward tampering and that such behavior may be nontrivial to remove.


title: MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformers

abstract: Recently, 3D assets created via reconstruction and generation have matched the quality of manually crafted assets, highlighting their potential for replacement. However, this potential is largely unrealized because these assets always need to be converted to meshes for 3D industry applications, and the meshes produced by current mesh extraction methods are significantly inferior to Artist-Created Meshes (AMs), i.e., meshes created by human artists. Specifically, current mesh extraction methods rely on dense faces and ignore geometric features, leading to inefficiencies, complicated post-processing, and lower representation quality. To address these issues, we introduce MeshAnything, a model that treats mesh extraction as a generation problem, producing AMs aligned with specified shapes. By converting 3D assets in any 3D representation into AMs, MeshAnything can be integrated with various 3D asset production methods, thereby enhancing their application across the 3D industry. The architecture of MeshAnything comprises a VQ-VAE and a shape-conditioned decoder-only transformer. We first learn a mesh vocabulary using the VQ-VAE, then train the shape-conditioned decoder-only transformer on this vocabulary for shape-conditioned autoregressive mesh generation. Our extensive experiments show that our method generates AMs with hundreds of times fewer faces, significantly improving storage, rendering, and simulation efficiencies, while achieving precision comparable to previous methods.


title: Exact Quantum Electrodynamics in Radiative Photonic Environments

abstract: We present a comprehensive second quantization scheme for radiative photonic devices. We canonically quantize the continuum of photonic eigenmodes by transforming them into a discrete set of pseudomodes that provide a \textit{complete} and \textit{exact} description of quantum emitters interacting with electromagnetic environments. This method avoids all reservoir approximations, and offers new insights into quantum correlations, accurately capturing all non-Markovian dynamics. This method overcomes challenges in quantizing non-Hermitian systems and is applicable to diverse nanophotonic geometries.


title: CarLLaVA: Vision language models for camera-only closed-loop driving

abstract: In this technical report, we present CarLLaVA, a Vision Language Model (VLM) for autonomous driving, developed for the CARLA Autonomous Driving Challenge 2.0. CarLLaVA uses the vision encoder of the LLaVA VLM and the LLaMA architecture as backbone, achieving state-of-the-art closed-loop driving performance with only camera input and without the need for complex or expensive labels. Additionally, we show preliminary results on predicting language commentary alongside the driving output. CarLLaVA uses a semi-disentangled output representation of both path predictions and waypoints, getting the advantages of the path for better lateral control and the waypoints for better longitudinal control. We propose an efficient training recipe to train on large driving datasets without wasting compute on easy, trivial data. CarLLaVA ranks 1st place in the sensor track of the CARLA Autonomous Driving Challenge 2.0 outperforming the previous state of the art by 458% and the best concurrent submission by 32.6%.


title: Misam: Using ML in Dataflow Selection of Sparse-Sparse Matrix Multiplication

abstract: Sparse matrix-matrix multiplication (SpGEMM) is a critical operation in numerous fields, including scientific computing, graph analytics, and deep learning. These applications exploit the sparsity of matrices to reduce storage and computational demands. However, the irregular structure of sparse matrices poses significant challenges for performance optimization. Traditional hardware accelerators are tailored for specific sparsity patterns with fixed dataflow schemes - inner, outer, and row-wise but often perform suboptimally when the actual sparsity deviates from these predetermined patterns. As the use of SpGEMM expands across various domains, each with distinct sparsity characteristics, the demand for hardware accelerators that can efficiently handle a range of sparsity patterns is increasing. This paper presents a machine learning based approach for adaptively selecting the most appropriate dataflow scheme for SpGEMM tasks with diverse sparsity patterns. By employing decision trees and deep reinforcement learning, we explore the potential of these techniques to surpass heuristic-based methods in identifying optimal dataflow schemes. We evaluate our models by comparing their performance with that of a heuristic, highlighting the strengths and weaknesses of each approach. Our findings suggest that using machine learning for dynamic dataflow selection in hardware accelerators can provide upto 28 times gains.


title: 4DRecons: 4D Neural Implicit Deformable Objects Reconstruction from a single RGB-D Camera with Geometrical and Topological Regularizations

abstract: This paper presents a novel approach 4DRecons that takes a single camera RGB-D sequence of a dynamic subject as input and outputs a complete textured deforming 3D model over time. 4DRecons encodes the output as a 4D neural implicit surface and presents an optimization procedure that combines a data term and two regularization terms. The data term fits the 4D implicit surface to the input partial observations. We address fundamental challenges in fitting a complete implicit surface to partial observations. The first regularization term enforces that the deformation among adjacent frames is as rigid as possible (ARAP). To this end, we introduce a novel approach to compute correspondences between adjacent textured implicit surfaces, which are used to define the ARAP regularization term. The second regularization term enforces that the topology of the underlying object remains fixed over time. This regularization is critical for avoiding self-intersections that are typical in implicit-based reconstructions. We have evaluated the performance of 4DRecons on a variety of datasets. Experimental results show that 4DRecons can handle large deformations and complex inter-part interactions and outperform state-of-the-art approaches considerably.


title: Study of the Coulomb and nuclear breakup of $^{11}$Be using a Halo-EFT description at N$^2$LO

abstract: Background: The halo effective field theory (Halo-EFT) provides a very efficient description of loosely-bound nuclei in models of reaction. It offers a very systematical ranking of the significance of nuclear-structure observables in reaction calculations. This greatly helps to infer reliable structure information from reaction cross sections. However, for a meaningful analysis, the Halo-EFT scheme needs to have converged. Purpose: In a previous study [P. Capel, D. R. Phillips, and H.-W. Hammer, Phys. Rev. C 98, 034610 (2018)], NLO descriptions of 11Be have been developed and lead to excellent agreement with existing breakup data. However, the convergence of the scheme at NLO was not fully demonstrated. Moreover, a significant dependence on the regulator of the effective 10Be-n interaction has been observed. Method: We develop Halo-EFT descriptions of 11Be at N2LO and use them in an accurate breakup-reaction code. We compare our theoretical cross sections with experiment on Pb and C targets at about 70 MeV/nucleon. Results: On Pb, the N2LO descriptions of 11Be lead to little change to the NLO results of the previous study, confirming the convergence of that scheme. On C, the reaction is significantly affected by the presence of d resonances in the low-energy spectrum of 11Be. In the Halo-EFT power counting these resonances appear only at N2LO; our new descriptions include them naturally. Going to N2LO removes also the cutoff dependence observed in the previous study. Conclusions: We demonstrate the convergence of the Halo-EFT description of 11Be at NLO for Coulomb breakup and at N2LO for nuclear-dominated dissociation. The reliability of the nuclear-structure information inferred in the previous study is thus confirmed.


title: The quantumness of relic gravitons

abstract: Since the relic gravitons are produced in entangled states of opposite (comoving) three-momenta, their distributions and their averaged multiplicities must determine the maximal frequency of the spectrum above which the created pairs are exponentially suppressed. The absolute upper bound on the maximal frequency derived in this manner coincides with the THz domain and does not rely on the details of the cosmological scenario. The THz limit also translates into a constraint of the order of $10^{-33}$ on the minimal chirp amplitudes that should be effectively reached by all classes of hypothetical detectors aiming at the direct scrutiny of a signal in the frequency domain that encompasses the MHz and the GHz bands. The obtained high-frequency limit is deeply rooted in the quantumness of the produced gravitons whose multiparticle final sates are macroscopic but always non-classical. Since the unitary evolution preserves their coherence, the quantumness of the gravitons can be associated with an entanglement entropy that is associated with the loss of the complete information on the underlying quantum field. It turns out that the reduction of the density matrix in different bases leads to the same Von Neumann entropy whose integral over all the modes of the spectrum is dominated by the maximal frequency. Thanks to the THz bound the total integrated entropy of the gravitons can be comparable with the cosmic microwave background entropy but not larger. Besides the well known cosmological implications, we then suggest that a potential detection of gravitons between the MHz and the THz may therefore represent a direct evidence of macroscopic quantum states associated with the gravitational field.

categories: hep-th astro-ph.CO gr-qc hep-ph quant-ph


title: Emergence of inflaton potential from asymptotically safe gravity

abstract: The Asymptotic Safety Hypothesis for gravity relies on the existence of an interacting fixed point of the Wilsonian renormalization group flow, which controls the microscopic dynamics, and provides a UV completion of the theory. Connecting such UV completion to observable physics has become an active area of research in the last decades. In this work we show such connection within the framework of scalar-tensor models. More specifically, we found that cosmological inflation naturally emerges from the integration of the RG flow equations, and that the predicted parameters of the emergent effective potentials provide a slow-roll model of inflation compatible with current observations. Furthermore, the RG evolution of the effective action starting at the UV fixed point, provides a prediction for the initial value of the inflaton field.


title: Multivariate Predictors of LyC Escape I: A Survival Analysis of the Low-redshift Lyman Continuum Survey

abstract: To understand how galaxies reionized the universe, we must determine how the escape fraction of Lyman Continuum (LyC) photons (fesc) depends on galaxy properties. Using the z~0.3 Low-redshift Lyman Continuum Survey (LzLCS), we develop and analyze new multivariate predictors of fesc. These predictions use the Cox proportional hazards model, a survival analysis technique that incorporates both detections and upper limits. Our best model predicts the LzLCS fesc detections with a root-mean-square (RMS) scatter of 0.31 dex, better than single-variable correlations. According to ranking techniques, the most important predictors of fesc are the equivalent width (EW) of Lyman-series absorption lines and the UV dust attenuation, which track line-of-sight absorption due to HI and dust. The HI absorption EW is uniquely crucial for predicting fesc for the strongest LyC emitters, which show properties similar to weaker LyC emitters and whose high fesc may therefore result from favorable orientation. In the absence of HI information, star formation rate surface density ($\Sigma_{\rm SFR}$) and [O III]/[O II] ratio are the most predictive variables and highlight the connection between feedback and fesc. We generate a model suitable for z>6, which uses only the UV slope, $\Sigma_{\rm SFR}$, and [O III]/[O II]. We find that $\Sigma_{\rm SFR}$ is more important in predicting fesc at higher stellar masses, whereas [O III]/[O II] plays a greater role at lower masses. We also analyze predictions for other parameters, such as the ionizing-to-non ionizing flux ratio and Ly=alpha escape fraction. These multivariate models represent a promising tool for predicting fesc at high redshift.


title: Datasets for Multilingual Answer Sentence Selection

abstract: Answer Sentence Selection (AS2) is a critical task for designing effective retrieval-based Question Answering (QA) systems. Most advancements in AS2 focus on English due to the scarcity of annotated datasets for other languages. This lack of resources prevents the training of effective AS2 models in different languages, creating a performance gap between QA systems in English and other locales. In this paper, we introduce new high-quality datasets for AS2 in five European languages (French, German, Italian, Portuguese, and Spanish), obtained through supervised Automatic Machine Translation (AMT) of existing English AS2 datasets such as ASNQ, WikiQA, and TREC-QA using a Large Language Model (LLM). We evaluated our approach and the quality of the translated datasets through multiple experiments with different Transformer architectures. The results indicate that our datasets are pivotal in producing robust and powerful multilingual AS2 models, significantly contributing to closing the performance gap between English and other languages.


title: IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce

abstract: Enhancing Language Models' (LMs) ability to understand purchase intentions in E-commerce scenarios is crucial for their effective assistance in various downstream tasks. However, previous approaches that distill intentions from LMs often fail to generate meaningful and human-centric intentions applicable in real-world E-commerce contexts. This raises concerns about the true comprehension and utilization of purchase intentions by LMs. In this paper, we present IntentionQA, a double-task multiple-choice question answering benchmark to evaluate LMs' comprehension of purchase intentions in E-commerce. Specifically, LMs are tasked to infer intentions based on purchased products and utilize them to predict additional purchases. IntentionQA consists of 4,360 carefully curated problems across three difficulty levels, constructed using an automated pipeline to ensure scalability on large E-commerce platforms. Human evaluations demonstrate the high quality and low false-negative rate of our benchmark. Extensive experiments across 19 language models show that they still struggle with certain scenarios, such as understanding products and intentions accurately, jointly reasoning with products and intentions, and more, in which they fall far behind human performances. Our code and data are publicly available at https://github.com/HKUST-KnowComp/IntentionQA.


title: Let the Poem Hit the Rhythm: Using a Byte-Based Transformer for Beat-Aligned Poetry Generation

abstract: The intersection between poetry and music provides an interesting case for computational creativity, yet remains relatively unexplored. This paper explores the integration of poetry and music through the lens of beat patterns, investigating whether a byte-based language model can generate words that fit specific beat patterns within the context of poetry. Drawing on earlier studies, we developed a method to train a byte-based transformer model, ByT5, to align poems with beat patterns. The results demonstrate a high level of beat alignment while maintaining semantic coherence. Future work will aim to improve the model's ability to create complete beat-aligned poems.


title: Enhancing Incomplete Multi-modal Brain Tumor Segmentation with Intra-modal Asymmetry and Inter-modal Dependency

abstract: Deep learning-based brain tumor segmentation (BTS) models for multi-modal MRI images have seen significant advancements in recent years. However, a common problem in practice is the unavailability of some modalities due to varying scanning protocols and patient conditions, making segmentation from incomplete MRI modalities a challenging issue. Previous methods have attempted to address this by fusing accessible multi-modal features, leveraging attention mechanisms, and synthesizing missing modalities using generative models. However, these methods ignore the intrinsic problems of medical image segmentation, such as the limited availability of training samples, particularly for cases with tumors. Furthermore, these methods require training and deploying a specific model for each subset of missing modalities. To address these issues, we propose a novel approach that enhances the BTS model from two perspectives. Firstly, we introduce a pre-training stage that generates a diverse pre-training dataset covering a wide range of different combinations of tumor shapes and brain anatomy. Secondly, we propose a post-training stage that enables the model to reconstruct missing modalities in the prediction results when only partial modalities are available. To achieve the pre-training stage, we conceptually decouple the MRI image into two parts: `anatomy' and `tumor'. We pre-train the BTS model using synthesized data generated from the anatomy and tumor parts across different training samples. ... Extensive experiments demonstrate that our proposed method significantly improves the performance over the baseline and achieves new state-of-the-art results on three brain tumor segmentation datasets: BRATS2020, BRATS2018, and BRATS2015.


title: Scattering on the Worldvolume: Amplitude Relations in Brower-Goddard String Models

abstract: We investigate the Brower-Goddard extension of the Veneziano and Virasoro-Shapiro four-point amplitudes obtained by generalizing the Koba-Nielsen integrals to $d$-dimensional conformally invariant integrals. The amplitudes derived from this framework exhibit polynomial residues and can be shown to adhere to polynomial bounds at high energies. In odd dimensions, the amplitudes decompose into sums of three partial amplitudes, enabling the formulation of general amplitude relations that subsume the Kawai-Lewellen-Tye (KLT) formula as a particular case. The amplitudes contain multiple tachyons in their spectra. Still, we demonstrate that their residues comply with the positivity conditions mandated by unitarity for spacetime dimensions at or below critical values $D_\text{crit}(d)$, where $D_\text{crit}(6)=26$ and $D_\text{crit}(\infty)=10$. In closing, we contemplate physical applications for membranes and potential extensions of the formalism.


title: Inclusive ASR for Disfluent Speech: Cascaded Large-Scale Self-Supervised Learning with Targeted Fine-Tuning and Data Augmentation

abstract: Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity of large, annotated disfluent speech datasets. Therefore, we present an inclusive ASR design approach, leveraging large-scale self-supervised learning on standard speech followed by targeted fine-tuning and data augmentation on a smaller, curated dataset of disfluent speech. Our data augmentation technique enriches training datasets with various disfluencies, enhancing ASR processing of these speech patterns. Results show that fine-tuning wav2vec 2.0 with even a relatively small, labeled dataset, alongside data augmentation, can significantly reduce word error rates for disfluent speech. Our approach not only advances ASR inclusivity for people who stutter, but also paves the way for ASRs that can accommodate wider speech variations.


title: Finite temperature detection of quantum critical points: a comparative study

abstract: We comparatively study three of the most useful quantum information tools to detect quantum critical points (QCPs) when only finite temperature data are available. We investigate quantitatively how the quantum discord, the quantum teleportation based QCP detectors, and the quantum coherence spectrum pinpoint the QCPs of several spin-$1/2$ chains. We work in the thermodynamic limit (infinite number of spins) and with the spin chains in equilibrium with a thermal reservoir at temperature $T$. The models here studied are the $XXZ$ model with and without an external longitudinal magnetic field, the Ising transverse model, and the $XY$ model subjected to an external transverse magnetic field.


title: Multivariate Predictors of LyC Escape II: Predicting LyC Escape Fractions for High-Redshift Galaxies

abstract: JWST is uncovering the properties of ever increasing numbers of galaxies at z>6, during the epoch of reionization. Connecting these observed populations to the process of reionization requires understanding how efficiently they produce Lyman continuum (LyC) photons and what fraction (fesc) of these photons escape into the intergalactic medium. By applying the Cox proportional hazards model, a survival analysis technique, to the Low-redshift Lyman Continuum Survey (LzLCS), we develop new, empirical, multivariate predictions for fesc. The models developed from the LzLCS reproduce the observed fesc for z~3 samples, which suggests that LyC emitters may share similar properties at low and high redshift. Our best-performing models for the z~3 galaxies include information about dust attenuation, ionization, and/or morphology. We then apply these models to z$\gtrsim$6 galaxies. For large photometric samples, we find a median predicted fesc=0.047-0.14. For smaller spectroscopic samples, which may include stronger emission line galaxies, we find that $\geq$33% of the galaxies have fesc >0.2, and we identify several candidate extreme leakers with fesc $\geq$0.5. The current samples show no strong trend between predicted fesc and UV magnitude, but limited spectroscopic information makes this result uncertain. Multivariate predictions can give significantly different results from single variable predictions, and the predicted fesc for high-redshift galaxies can differ significantly depending on whether star formation rate surface density or radius is used as a measure of galaxy morphology. We provide all parameters necessary to predict fesc for additional samples of high-redshift galaxies using these models.


title: MeshPose: Unifying DensePose and 3D Body Mesh reconstruction

abstract: DensePose provides a pixel-accurate association of images with 3D mesh coordinates, but does not provide a 3D mesh, while Human Mesh Reconstruction (HMR) systems have high 2D reprojection error, as measured by DensePose localization metrics. In this work we introduce MeshPose to jointly tackle DensePose and HMR. For this we first introduce new losses that allow us to use weak DensePose supervision to accurately localize in 2D a subset of the mesh vertices ('VertexPose'). We then lift these vertices to 3D, yielding a low-poly body mesh ('MeshPose'). Our system is trained in an end-to-end manner and is the first HMR method to attain competitive DensePose accuracy, while also being lightweight and amenable to efficient inference, making it suitable for real-time AR applications.


title: Practical offloading for fine-tuning LLM on commodity GPU via learned subspace projectors

abstract: Fine-tuning large language models (LLMs) requires significant memory, often exceeding the capacity of a single GPU. A common solution to this memory challenge is offloading compute and data from the GPU to the CPU. However, this approach is hampered by the limited bandwidth of commodity hardware, which constrains communication between the CPU and GPU. In this paper, we present an offloading framework, LSP_Offload, that enables near-native speed LLM fine-tuning on commodity hardware through learned subspace projectors. Our data-driven approach involves learning an efficient sparse compressor that minimizes communication with minimal precision loss. Additionally, we introduce a novel layer-wise communication schedule to maximize parallelism between communication and computation. As a result, our framework can fine-tune a 1.3 billion parameter model on a 4GB laptop GPU and a 7 billion parameter model on an NVIDIA RTX 4090 GPU with 24GB memory, achieving only a 31% slowdown compared to fine-tuning with unlimited memory. Compared to state-of-the-art offloading frameworks, our approach increases fine-tuning throughput by up to 3.33 times and reduces end-to-end fine-tuning time by 33.1%~62.5% when converging to the same accuracy.


title: Goldblat-Thomason Theorems for Fundamental (Modal) Logic

abstract: Holliday recently introduced a non-classical logic called Fundamental Logic, which intends to capture exactly those properties of the connectives "and", "or" and "not" that hold in virtue of their introduction and elimination rules in Fitch's natural deduction system for propositional logic. Holliday provides an intuitive relational semantics for fundamental logic which generalizes both Goldblatt's semantics for orthologic and Kripke semantics for intuitionistic logic. In this paper, we further the analysis of this semantics by providing a Goldblatt-Thomason theorem for Fundamental Logic. We identify necessary and sufficient conditions on a class K of fundamental frames for it to be axiomatic, i.e., to be the class of frames satisfying some logic extending Fundamental Logic. As a straightforward application of our main result, we also obtain a Goldblatt-Thomason theorem for Fundamental Modal Logic, which extends Fundamental Logic with standard Box and Diamond operators.


title: A SART-Based Iterative Inversion Methodology to Infer the Solar Rotation Rate from Global Helioseismic Data

abstract: We present a new iterative rotation inversion technique based on the Simultaneous Algebraic Reconstruction Technique developed for image reconstruction. We describe in detail our algorithmic implementation and compare it to the classical inversion techniques like the Regularized Least Squares (RLS) and the Optimally Localized Averages (OLA) methods. In our implementation, we are able to estimate the formal uncertainty on the inferred solution using standard error propagation, and derive the averaging kernels without recourse to any Monte-Carlo simulation. We present the potential of this new technique using simulated rotational frequency splittings. We use noiseless sets that cover the range of observed modes and associate to these artificial splittings observational uncertainties. We also add random noise to present the noise magnification immunity of the method. Since the technique is iterative we also show its potential when using an apriori solution. With the right regularization this new method can outperform our RLS implementation in precision, scope and resolution. Since it results in very different averaging kernels where the solution is poorly constrained, this technique infers different values. Adding such a technique to our compendium of inversion methods will allow us to improve the robustness of our inferences when inverting real observations and better understand where they might be biased and/or unreliable, as we push our techniques to maximize the diagnostic potential of our observations.


title: Hyperbolic embedding of brain networks as a tool for epileptic seizures forecasting

abstract: The evidence indicates that intracranial EEG connectivity, as estimated from daily resting state recordings from epileptic patients, may be capable of identifying preictal states. In this study, we employed hyperbolic embedding of brain networks to capture non-trivial patterns that discriminate between connectivity networks from days with (preictal) and without (interictal) seizure. A statistical model was constructed by combining hyperbolic geometry and machine learning tools, which allowed for the estimation of the probability of an upcoming seizure. The results demonstrated that representing brain networks in a hyperbolic space enabled an accurate discrimination (85%) between interictal (no-seizure) and preictal (seizure within the next 24 hours) states. The proposed method also demonstrated excellent prediction performances, with an overall accuracy of 87% and an F1-score of 89% (mean Brier score and Brier skill score of 0.12 and 0.37, respectively). In conclusion, our findings indicate that representations of brain connectivity in a latent geometry space can reveal a daily and reliable signature of the upcoming seizure(s), thus providing a promising biomarker for seizure forecasting.


title: Detecting and Evaluating Medical Hallucinations in Large Vision Language Models

abstract: Large Vision Language Models (LVLMs) are increasingly integral to healthcare applications, including medical visual question answering and imaging report generation. While these models inherit the robust capabilities of foundational Large Language Models (LLMs), they also inherit susceptibility to hallucinations-a significant concern in high-stakes medical contexts where the margin for error is minimal. However, currently, there are no dedicated methods or benchmarks for hallucination detection and evaluation in the medical field. To bridge this gap, we introduce Med-HallMark, the first benchmark specifically designed for hallucination detection and evaluation within the medical multimodal domain. This benchmark provides multi-tasking hallucination support, multifaceted hallucination data, and hierarchical hallucination categorization. Furthermore, we propose the MediHall Score, a new medical evaluative metric designed to assess LVLMs' hallucinations through a hierarchical scoring system that considers the severity and type of hallucination, thereby enabling a granular assessment of potential clinical impacts. We also present MediHallDetector, a novel Medical LVLM engineered for precise hallucination detection, which employs multitask training for hallucination detection. Through extensive experimental evaluations, we establish baselines for popular LVLMs using our benchmark. The findings indicate that MediHall Score provides a more nuanced understanding of hallucination impacts compared to traditional metrics and demonstrate the enhanced performance of MediHallDetector. We hope this work can significantly improve the reliability of LVLMs in medical applications. All resources of this work will be released soon.


title: Impurities with a cusp: general theory and 3d Ising

abstract: In CFTs, the partition function of a line defect with a cusp depends logarithmically on the size of the line with an angle-dependent coefficient: the cusp anomalous dimension. In the first part of this work, we study the general properties of the cusp anomalous dimension. We relate the small cusp angle limit to the effective field theory of defect fusion, making predictions for the first couple of terms in the expansion. Using a concavity property of the cusp anomalous dimension we argue that the Casimir energy between a line defect and its orientation reversal is always negative ("opposites attract"). We use these results to determine the fusion algebra of Wilson lines in $\mathcal{N}=4$ SYM as well as pinning field defects in the Wilson-Fisher fixed points. In the second part of the paper we obtain nonperturbative numerical results for the cusp anomalous dimension of pinning field defects in the Ising model in $d=3$, using the recently developed fuzzy-sphere regularization. We also compute the pinning field cusp anomalous dimension in the $O(N)$ model at one-loop in the $\varepsilon$-expansion. Our results are in agreement with the general theory developed in the first part of the work, and we make several predictions for impurities in magnets.


title: Piezoelectrically driven diamond phononic nanocavity by phonon-matching scheme for quantum applications

abstract: Efficiently exciting and controlling phonons in diamond nanoresonators represents a fundamental challenge for quantum applications. Here, we theoretically demonstrate the possibility to excite mechanical modes within a double-hybrid-cavity (DHC), formed by adjoining to a diamond cavity a second cavity, made of aluminum nitride. The latter is piezoelectric and serves as a microwave-to-phonon transducer, activating mechanical modes in the entire DHC. We show the process to match the cavities phononic properties, making them work coordinately in the DHC and obtaining a well confined mode. In the diamond part of the cavity, this mode replicates the fundamental mode of the individual diamond cavity, showing that the piezoelectric transducer doesn't alter the diamond individual fundamental mode. In the piezoelectric part, the strong confinement of stress and electric field results in a high piezoelectric coupling rate, demonstrating the effectiveness of a phononic cavity as a transducer. The study is contextualized in the framework of a quantum networking application, where the DHC serves as a spin qubit, exploiting the spin-mechanical coupling within diamond color centers.


title: $L^{\vec{p}}-L^{\vec{q}}$ Boundedness of Multiparameter Forelli-Rudin Type Operators on the Siegel Upper Half-space

abstract: In this article,we present exactly when two classes of multiparameter Forelli-Rudin type integral operators are bounded from one weighted mixed-norm Lebesgue space $L^{\vec{p}}$ to another space $L^{\vec{q}}$ over the Siegel upper half-space.


title: Topological rigidity of small RCD(K,N) spaces with maximal rank

abstract: For a polycyclic group $\Lambda$, rank$(\Lambda )$ is defined as the number of $\mathbb{Z}$ factors in a polycyclic decomposition of $\Lambda$. For a finitely generated group $G$, rank$(G)$ is defined as the infimum of rank$(\Lambda )$ among finite index polycyclic subgroups $\Lambda \leq G$. For a compact RCD$(K,N)$ space $(X,\mathsf{d}, \mathfrak{m} )$ with diam$(X) \leq \varepsilon (K,N)$, the rank of $\pi_1(X)$ is at most $N$. In this note we show that in case of equality, $X$ is homeomorphic to an infranilmanifold, generalizing to the non-smooth setting a result by Kapovitch--Wilking. We also fill a gap in the proof that if $\pi_1(X) = \mathbb{Z}^N$, then $X$ is bi-H\"older homeomorphic to a flat torus (diffeomorphic in the smooth case).


title: CHIRON: Rich Character Representations in Long-Form Narratives

abstract: Characters are integral to long-form narratives, but are poorly understood by existing story analysis and generation systems. While prior work has simplified characters via graph-based methods and brief character descriptions, we aim to better tackle the problem of representing complex characters by taking inspiration from advice given to professional writers. We propose CHIRON, a new `character sheet' based representation that organizes and filters textual information about characters. We construct CHIRON sheets in two steps: a Generation Module that prompts an LLM for character information via question-answering and a Validation Module that uses automated reasoning and a domain-specific entailment model to eliminate false facts about a character. We validate CHIRON via the downstream task of masked-character prediction, where our experiments show CHIRON is better and more flexible than comparable summary-based baselines. We also show that metrics derived from CHIRON can be used to automatically infer character-centricity in stories, and that these metrics align with human judgments.


title: Sobolev spaces of vector-valued functions on compact groups

abstract: This paper deals with a class of Sobolev spaces of vector-valued functions on a compact group. Some Sobolev embedding theorems are proved.


title: On Graph Odd Edge-Colorings and Odd Edge-Coverings

abstract: In this paper, we fully resolve two major conjectures on odd edge-colorings and odd edge-coverings of graphs, proposed by Petru{\v{s}}evski and {\v{S}}krekovski ({\it European Journal of Combinatorics,} 91:103225, 2021). The first conjecture states that for any loopless and connected graph $G$ with $\chi_{\text{odd}}'(G)=4$, there exists an edge $e$ such that $G\backslash \{e\}$ is odd $3$-edge-colorable. The second conjecture states that any simple graph $G$ with $\chi_{\text{odd}}'(G)=4$ admits an odd $3$-edge-covering in which only one edge receives two or three colors. In addition, we strongly confirm the second conjecture by demonstrating that there exists an odd $3$-edge-covering in which only one edge receives two colors.


title: Three-dimensional quantum Griffiths singularity in bulk iron-pnictide superconductors

abstract: The quantum Griffiths singularity (QGS) is a phenomenon driven by quenched disorders that break conventional scaling invariance and result in a divergent dynamical critical exponent during quantum phase transitions (QPT). While this phenomenon has been well-documented in low-dimensional conventional superconductors and in three-dimensional (3D) magnetic metal systems, its presence in 3D superconducting systems and in unconventional high-temperature superconductors (high-Tc SCs) remains unclear. In this study, we report the observation of robust QGS in the superconductor-metal transition (SMT) of both quasi-2D and 3D anisotropic unconventional high-Tc superconductor CaFe1-xNixAsF (x < 5%) bulk single crystals, where the QGS states persist to up to 5.3 K. A comprehensive quantum phase diagram is established that delineates the 3D anisotropic QGS of SMT induced by perpendicular and parallel magnetic field. Our findings reveal the universality of QGS in 3D superconducting systems and unconventional high-Tc SCs, thereby substantially expanding the range of applicability of QGS.


title: Entanglement entropy bounds for pure states of rapid decorrelation

abstract: For pure states of multi-dimensional quantum lattice systems, which in a convenient computational basis have amplitude and phase structure of sufficiently rapid decorrelation, we construct high fidelity approximations of relatively low complexity. These are used for a conditional proof of area-law bounds for the states' entanglement entropy. The condition is also shown to imply exponential decay of the state's mutual information between disjoint regions, and hence exponential clustering of local observables. The applicability of the general results is demonstrated on the quantum Ising model in transverse field. Combined with available model-specific information on spin-spin correlations, we establish an area-law type bound on the entanglement in the model's subcritical ground states, valid in all dimensions and up to the model's quantum phase transition.


title: Matrix-product unitaries: Beyond quantum cellular automata

abstract: Matrix-product unitaries (MPU) are 1D tensor networks describing time evolution and unitary symmetries of quantum systems. MPU which are formed by a single repeated tensor are known to coincide with 1D quantum cellular automata (QCA), i.e., unitaries with an exact light cone. However, this correspondence breaks down for MPU with open boundary conditions, even if the resulting operator is translation-invariant. Here we make the first steps towards a theory of MPU with uniform bulk but arbitrary boundary. In particular, we study the structure of a subclass with a direct-sum form which maximally violates the QCA property. We also consider the general case of MPU formed by site-dependent (nonuniform) tensors and show a correspondence between MPU and locally maximally entanglable states.

categories: quant-ph cond-mat.str-el math-ph math.MP


title: TRIP-PAL: Travel Planning with Guarantees by Combining Large Language Models and Automated Planners

abstract: Travel planning is a complex task that involves generating a sequence of actions related to visiting places subject to constraints and maximizing some user satisfaction criteria. Traditional approaches rely on problem formulation in a given formal language, extracting relevant travel information from web sources, and use an adequate problem solver to generate a valid solution. As an alternative, recent Large Language Model (LLM) based approaches directly output plans from user requests using language. Although LLMs possess extensive travel domain knowledge and provide high-level information like points of interest and potential routes, current state-of-the-art models often generate plans that lack coherence, fail to satisfy constraints fully, and do not guarantee the generation of high-quality solutions. We propose TRIP-PAL, a hybrid method that combines the strengths of LLMs and automated planners, where (i) LLMs get and translate travel information and user information into data structures that can be fed into planners; and (ii) automated planners generate travel plans that guarantee constraint satisfaction and optimize for users' utility. Our experiments across various travel scenarios show that TRIP-PAL outperforms an LLM when generating travel plans.


title: Crafting Parts for Expressive Object Composition

abstract: Text-to-image generation from large generative models like Stable Diffusion, DALLE-2, etc., have become a common base for various tasks due to their superior quality and extensive knowledge bases. As image composition and generation are creative processes the artists need control over various parts of the images being generated. We find that just adding details about parts in the base text prompt either leads to an entirely different image (e.g., missing/incorrect identity) or the extra part details simply being ignored. To mitigate these issues, we introduce PartCraft, which enables image generation based on fine-grained part-level details specified for objects in the base text prompt. This allows more control for artists and enables novel object compositions by combining distinctive object parts. PartCraft first localizes object parts by denoising the object region from a specific diffusion process. This enables each part token to be localized to the right object region. After obtaining part masks, we run a localized diffusion process in each of the part regions based on fine-grained part descriptions and combine them to produce the final image. All the stages of PartCraft are based on repurposing a pre-trained diffusion model, which enables it to generalize across various domains without training. We demonstrate the effectiveness of part-level control provided by PartCraft qualitatively through visual examples and quantitatively in comparison to the contemporary baselines.


title: Finite-size analysis of prepare-and-measure and decoy-state QKD via entropy accumulation

abstract: An important goal in quantum key distribution (QKD) is the task of providing a finite-size security proof without the assumption of collective attacks. For prepare-and-measure QKD, one approach for obtaining such proofs is the generalized entropy accumulation theorem (GEAT), but thus far it has only been applied to study a small selection of protocols. In this work, we present techniques for applying the GEAT in finite-size analysis of generic prepare-and-measure protocols, with a focus on decoy-state protocols. In particular, we present an improved approach for computing entropy bounds for decoy-state protocols, which has the dual benefits of providing tighter bounds than previous approaches (even asymptotically) and being compatible with methods for computing min-tradeoff functions in the GEAT. Furthermore, we develop methods to incorporate some improvements to the finite-size terms in the GEAT, and implement techniques to automatically optimize the min-tradeoff function. Our approach also addresses some numerical stability challenges specific to prepare-and-measure protocols, which were not addressed in previous works.


abstract: We consider a new variant of the multi-robot task allocation problem - Inverse Risk-sensitive Multi-Robot Task Allocation (IR-MRTA). "Forward" MRTA - the process of deciding which robot should perform a task given the reward (cost)-related parameters, is widely studied in the multi-robot literature. In this setting, the reward (cost)-related parameters are assumed to be already known: parameters are first fixed offline by domain experts, followed by coordinating robots online. What if we need these parameters to be adjusted by non-expert human supervisors who oversee the robots during tasks to adapt to new situations? We are interested in the case where the human supervisor's perception of the allocation risk may change and suggest different allocations for robots compared to that from the MRTA algorithm. In such cases, the robots need to change the parameters of the allocation problem based on evolving human preferences. We study such problems through the lens of inverse task allocation, i.e., the process of finding parameters given solutions to the problem. Specifically, we propose a new formulation IR-MRTA, in which we aim to find a new set of parameters of the human behavioral risk model that minimally deviates from the current MRTA parameters and can make a greedy task allocation algorithm allocate robot resources in line with those suggested by humans. We show that even in the simple case such a problem is a non-convex optimization problem. We propose a Branch $\&$ Bound algorithm (BB-IR-MRTA) to solve such problems. In numerical simulations of a case study on multi-robot target capture, we demonstrate how to use BB-IR-MRTA and we show that the proposed algorithm achieves significant advantages in running time and peak memory usage compared to a brute-force baseline.


title: SSTFB: Leveraging self-supervised pretext learning and temporal self-attention with feature branching for real-time video polyp segmentation

abstract: Polyps are early cancer indicators, so assessing occurrences of polyps and their removal is critical. They are observed through a colonoscopy screening procedure that generates a stream of video frames. Segmenting polyps in their natural video screening procedure has several challenges, such as the co-existence of imaging artefacts, motion blur, and floating debris. Most existing polyp segmentation algorithms are developed on curated still image datasets that do not represent real-world colonoscopy. Their performance often degrades on video data. We propose a video polyp segmentation method that performs self-supervised learning as an auxiliary task and a spatial-temporal self-attention mechanism for improved representation learning. Our end-to-end configuration and joint optimisation of losses enable the network to learn more discriminative contextual features in videos. Our experimental results demonstrate an improvement with respect to several state-of-the-art (SOTA) methods. Our ablation study also confirms that the choice of the proposed joint end-to-end training improves network accuracy by over 3% and nearly 10% on both the Dice similarity coefficient and intersection-over-union compared to the recently proposed method PNS+ and Polyp-PVT, respectively. Results on previously unseen video data indicate that the proposed method generalises.


title: Representation Theory of General Linear Supergroups in Characteristic 2

abstract: We develop representation theory of general linear groups in the category $\text{Ver}_4^+$, the simplest tensor category which is not Frobenius exact. Since $\text{Ver}_4^+$ is a reduction of the category of supervector spaces to characteristic $2$ (by a result of Venkatesh, arXiv:1507.05142), these groups may be viewed as general linear supergroups in characteristic $2$. More precisely, every object in $\text{Ver}_4^+$ has the form $m\mathbf{1}+nP$ where $P$ is the indecomposable projective, and $\text{GL}(m\mathbf{1}+nP)$ is the reduction to characteristic $2$ of $\text{GL}(m+n|n)$. We explicitly describe the irreducible representations of $\text{GL}(P)$ and then use this description to classify the irreducible representations of $\text{GL}(m\mathbf{1}+nP)$ for general $m,n$. We also define some subgroups of $\text{GL}(m\mathbf{1}+nP)$ and classify their irreducible representations. Finally, we conjecture a Steinberg tensor product theorem for $\text{Ver}_4^+$ involving the square of the Frobenius map.


title: DESI and the Hubble tension in light of modified recombination

abstract: Recent measurements and analyses from the Dark Energy Spectroscopic Instrument (DESI) Collaboration and supernova surveys combined with cosmic microwave background (CMB) observations, indicate that the dark energy density changes over time. Here we explore the possibility that the dark energy density is constant, but that the cosmological recombination history differs substantially from that in $\Lambda$CDM. When we free up the ionization history, but otherwise assume the standard cosmological model, we find the combination of CMB and DESI data prefer i) early recombination qualitatively similar to models with small-scale clumping, ii) a value of $H_0$ consistent with the estimate from the SH0ES Collaboration at the $2\sigma$ level, and iii) a higher CMB lensing power, which takes pressure off of otherwise tight constraints on the sum of neutrino masses. Our work provides additional motivation for finding physical models that lead to the small-scale clumping that can theoretically explain the ionization history preferred by DESI and CMB data.


title: A Fundamental Trade-off in Aligned Language Models and its Relation to Sampling Adaptors

abstract: The relationship between the quality of a string and its probability $p(\boldsymbol{y})$ under a language model has been influential in the development of techniques to build good text generation systems. For example, several decoding algorithms have been motivated to manipulate $p(\boldsymbol{y})$ to produce higher-quality text. In this work, we examine the probability--quality relationship in language models explicitly aligned to human preferences, e.g., through Reinforcement Learning through Human Feedback (RLHF). We find that, given a general language model and its aligned version, for corpora sampled from an aligned language model, there exists a trade-off between the average reward and average log-likelihood of the strings under the general language model. We provide a formal treatment of this issue and demonstrate how a choice of sampling adaptor allows for a selection of how much likelihood we exchange for the reward.


title: Systematic analysis of search strategies for $L_\mu-L_\tau$ gauge bosons at Belle II

abstract: Extensions of the Standard Model with masses at or below the GeV scale are motivated by searches for dark matter and precision measurements in the quark and lepton flavour sectors, including that of the muon anomalous magnetic moment. An excellent experimental environment to test such light new physics is given by the Belle II experiment, which foresees to take up to 50 ab$^{-1}$ of data. Here we consider a model with an additional gauged $U(1)_{L_\mu - L_\tau}$ symmetry that introduces a neutral gauge boson, a Dark Photon, with possibly large couplings to muon- and tau-flavored leptons, including neutrinos. Dark Photon mixing with the Standard Model photon is loop induced, allowing it to couple to electrically charged fermions other than muons and taus. We systematically investigate the possible search strategies for Dark Photons with four fermions final states. We identified search channels with muons as the most promising ones, and we analyse the kinematic distributions to obtain cuts that optimise the sensitivity of Belle II searches for the Dark Photon. Summarising the sensitivities from the most promising search channels we provide a comprehensive overview of future searches at Belle II.


title: AlignNet: Learning dataset score alignment functions to enable better training of speech quality estimators

abstract: We develop two complementary advances for training no-reference (NR) speech quality estimators with independent datasets. Multi-dataset finetuning (MDF) pretrains an NR estimator on a single dataset and then finetunes it on multiple datasets at once, including the dataset used for pretraining. AlignNet uses an AudioNet to generate intermediate score estimates before using the Aligner to map intermediate estimates to the appropriate score range. AlignNet is agnostic to the choice of AudioNet so any successful NR speech quality estimator can benefit from its Aligner. The methods can be used in tandem, and we use two studies to show that they improve on current solutions: one study uses nine smaller datasets and the other uses four larger datasets. AlignNet with MDF improves on other solutions because it efficiently and effectively removes misalignments that impair the learning process, and thus enables successful training with larger amounts of more diverse data.


title: Operator Space Entangling Power of Quantum Dynamics and Local Operator Entanglement Growth in Dual-Unitary Circuits

abstract: Operator entanglement is a well-established measure of operator complexity across a system bipartition. In this work, we introduce a measure for the ability of a unitary channel to generate operator entanglement, representing an operator-level generalization of the state-space entangling power. This operator space entangling power is demonstrated to be linked to the scrambling properties of the unitary channel via the recently introduced concept of mutual averaged non-commutativity of quantum operator algebras. An upper bound for the operator space entangling power is identified, corresponding to unitary channels with scrambling properties akin to those of typical unitaries. Additionally, for Hamiltonian dynamics, we find that the short-time growth rate of the operator space entangling power matches the Gaussian scrambling rate of the bipartite out-of-time-order-correlator, establishing a direct link between information scrambling and operator entanglement generation for short time scales. Finally, we examine the average growth of local operator entanglement across a symmetric bipartition of a spin-chain. For dual-unitary circuits, a combination of analytical and numerical investigations demonstrates that the average growth of local operator entanglement exhibits two distinct regimes in relation to the operator space entangling power of the building-block gate.


title: Latitudinal Asymmetry in the Dayside Atmosphere of WASP-43b

abstract: We present two-dimensional near-infrared temperature maps of the canonical hot Jupiter WASP-43b using a phase-curve observation with JWST NIRSpec/G395H. From the white-light planetary transit, we improve constraints on the planet's orbital parameters and measure a planet-to-star radius ratio of $0.15883^{+0.00056}_{-0.00053}$. Using the white-light phase curve, we measure a longitude of maximum brightness of $6.9^{+0^\circ.5}_{-0^\circ.5}$ east of the substellar point and a phase-curve offset of $10.0^{+0^\circ.8}_{-0^\circ.8}$. We also find an $\approx4\sigma$ detection of a latitudinal hotspot offset of $-13.4^{+3^\circ.2}_{-1^\circ.7}$, the first significant detection of a non-equatorial hotspot in an exoplanet atmosphere. We show that this detection is robust to variations within planetary parameter uncertainties, but only if the transit is used to improve constraints, showing the importance of transit observations to eclipse mapping. Maps retrieved from the NRS1 and NRS2 detectors are similar, with hotspot locations consistent between the two detectors at the $1\sigma$ level. Our JWST data show brighter (hotter) nightsides and a dimmer (colder) dayside at the shorter wavelengths relative to fits to \textit{Spitzer} 3.6 and 4.5 \microns\ phase curves. Through comparison between our phase curves and a set of general circulation models, we find evidence for clouds on the nightside and atmospheric drag or high metallicity reducing the eastward hotspot offset.


title: Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Rendering

abstract: Recently, Glyph-ByT5 has achieved highly accurate visual text rendering performance in graphic design images. However, it still focuses solely on English and performs relatively poorly in terms of visual appeal. In this work, we address these two fundamental limitations by presenting Glyph-ByT5-v2 and Glyph-SDXL-v2, which not only support accurate visual text rendering for 10 different languages but also achieve much better aesthetic quality. To achieve this, we make the following contributions: (i) creating a high-quality multilingual glyph-text and graphic design dataset consisting of more than 1 million glyph-text pairs and 10 million graphic design image-text pairs covering nine other languages, (ii) building a multilingual visual paragraph benchmark consisting of 1,000 prompts, with 100 for each language, to assess multilingual visual spelling accuracy, and (iii) leveraging the latest step-aware preference learning approach to enhance the visual aesthetic quality. With the combination of these techniques, we deliver a powerful customized multilingual text encoder, Glyph-ByT5-v2, and a strong aesthetic graphic generation model, Glyph-SDXL-v2, that can support accurate spelling in 10 different languages. We perceive our work as a significant advancement, considering that the latest DALL-E3 and Ideogram 1.0 still struggle with the multilingual visual text rendering task.


title: Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs

abstract: Large language models can memorize and repeat their training data, causing privacy and copyright risks. To mitigate memorization, we introduce a subtle modification to the next-token training objective that we call the goldfish loss. During training, a randomly sampled subset of tokens are excluded from the loss computation. These dropped tokens are not memorized by the model, which prevents verbatim reproduction of a complete chain of tokens from the training set. We run extensive experiments training billion-scale Llama-2 models, both pre-trained and trained from scratch, and demonstrate significant reductions in extractable memorization with little to no impact on downstream benchmarks.


title: Make It Count: Text-to-Image Generation with an Accurate Number of Objects

abstract: Despite the unprecedented success of text-to-image diffusion models, controlling the number of depicted objects using text is surprisingly hard. This is important for various applications from technical documents, to children's books to illustrating cooking recipes. Generating object-correct counts is fundamentally challenging because the generative model needs to keep a sense of separate identity for every instance of the object, even if several objects look identical or overlap, and then carry out a global computation implicitly during generation. It is still unknown if such representations exist. To address count-correct generation, we first identify features within the diffusion model that can carry the object identity information. We then use them to separate and count instances of objects during the denoising process and detect over-generation and under-generation. We fix the latter by training a model that predicts both the shape and location of a missing object, based on the layout of existing ones, and show how it can be used to guide denoising with correct object count. Our approach, CountGen, does not depend on external source to determine object layout, but rather uses the prior from the diffusion model itself, creating prompt-dependent and seed-dependent layouts. Evaluated on two benchmark datasets, we find that CountGen strongly outperforms the count-accuracy of existing baselines.


title: DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography Reconstruction

abstract: Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it is difficult to train a diffusion model directly on the entire volume of high-dimensional data to obtain an efficient 3D diffusion prior. Existing works utilizing diffusion priors on single 2D image slice with hand-crafted cross-slice regularization would sacrifice the z-axis consistency, which results in severe artifacts along the z-axis. In this work, we propose a novel framework that enables learning the 3D image prior through position-aware 3D-patch diffusion score blending for reconstructing large-scale 3D medical images. To the best of our knowledge, we are the first to utilize a 3D-patch diffusion prior for 3D medical image reconstruction. Extensive experiments on sparse view and limited angle CT reconstruction show that our DiffusionBlend method significantly outperforms previous methods and achieves state-of-the-art performance on real-world CT reconstruction problems with high-dimensional 3D image (i.e., $256 \times 256 \times 500$). Our algorithm also comes with better or comparable computational efficiency than previous state-of-the-art methods.


title: NeST: Neural Stress Tensor Tomography by leveraging 3D Photoelasticity

abstract: Photoelasticity enables full-field stress analysis in transparent objects through stress-induced birefringence. Existing techniques are limited to 2D slices and require destructively slicing the object. Recovering the internal 3D stress distribution of the entire object is challenging as it involves solving a tensor tomography problem and handling phase wrapping ambiguities. We introduce NeST, an analysis-by-synthesis approach for reconstructing 3D stress tensor fields as neural implicit representations from polarization measurements. Our key insight is to jointly handle phase unwrapping and tensor tomography using a differentiable forward model based on Jones calculus. Our non-linear model faithfully matches real captures, unlike prior linear approximations. We develop an experimental multi-axis polariscope setup to capture 3D photoelasticity and experimentally demonstrate that NeST reconstructs the internal stress distribution for objects with varying shape and force conditions. Additionally, we showcase novel applications in stress analysis, such as visualizing photoelastic fringes by virtually slicing the object and viewing photoelastic fringes from unseen viewpoints. NeST paves the way for scalable non-destructive 3D photoelastic analysis.


title: Selecting Interpretability Techniques for Healthcare Machine Learning models

abstract: In healthcare there is a pursuit for employing interpretable algorithms to assist healthcare professionals in several decision scenarios. Following the Predictive, Descriptive and Relevant (PDR) framework, the definition of interpretable machine learning as a machine-learning model that explicitly and in a simple frame determines relationships either contained in data or learned by the model that are relevant for its functioning and the categorization of models by post-hoc, acquiring interpretability after training, or model-based, being intrinsically embedded in the algorithm design. We overview a selection of eight algorithms, both post-hoc and model-based, that can be used for such purposes.


title: Universal randomised signatures for generative time series modelling

abstract: Randomised signature has been proposed as a flexible and easily implementable alternative to the well-established path signature. In this article, we employ randomised signature to introduce a generative model for financial time series data in the spirit of reservoir computing. Specifically, we propose a novel Wasserstein-type distance based on discrete-time randomised signatures. This metric on the space of probability measures captures the distance between (conditional) distributions. Its use is justified by our novel universal approximation results for randomised signatures on the space of continuous functions taking the underlying path as an input. We then use our metric as the loss function in a non-adversarial generator model for synthetic time series data based on a reservoir neural stochastic differential equation. We compare the results of our model to benchmarks from the existing literature.


title: DevBench: A multimodal developmental benchmark for language learning

abstract: How (dis)similar are the learning trajectories of vision-language models and children? Recent modeling work has attempted to understand the gap between models' and humans' data efficiency by constructing models trained on less data, especially multimodal naturalistic data. However, such models are often evaluated on adult-level benchmarks, with limited breadth in language abilities tested, and without direct comparison to behavioral data. We introduce DevBench, a multimodal benchmark comprising seven language evaluation tasks spanning the domains of lexical, syntactic, and semantic ability, with behavioral data from both children and adults. We evaluate a set of vision-language models on these tasks, comparing models and humans not only on accuracy but on their response patterns. Across tasks, models exhibit variation in their closeness to human response patterns, and models that perform better on a task also more closely resemble human behavioral responses. We also examine the developmental trajectory of OpenCLIP over training, finding that greater training results in closer approximations to adult response patterns. DevBench thus provides a benchmark for comparing models to human language development. These comparisons highlight ways in which model and human language learning processes diverge, providing insight into entry points for improving language models.


title: Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs

abstract: Reward models trained on human preference data have been proven to be effective for aligning Large Language Models (LLMs) with human intent within the reinforcement learning from human feedback (RLHF) framework. However, the generalization capabilities of current reward models to unseen prompts and responses are limited. This limitation can lead to an unexpected phenomenon known as reward over-optimization, where excessive optimization of rewards results in a decline in actual performance. While previous research has advocated for constraining policy optimization, our study proposes a novel approach to enhance the reward model's generalization ability against distribution shifts by regularizing the hidden states. Specifically, we retain the base model's language model head and incorporate a suite of text-generation losses to preserve the hidden states' text generation capabilities, while concurrently learning a reward head behind the same hidden states. Our experimental results demonstrate that the introduced regularization technique markedly improves the accuracy of learned reward models across a variety of out-of-distribution (OOD) tasks and effectively alleviate the over-optimization issue in RLHF, offering a more reliable and robust preference learning paradigm.


title: MINDS. A multi-instrument investigation into the molecule-rich JWST-MIRI spectrum of the DF Tau binary system

abstract: Most stars form in multiple systems whose properties can significantly impact circumstellar disk evolution. We investigate the physical and chemical properties of the equal-mass, small separation (~66 mas, ~9 au) DF Tau binary system. Previous observations indicated that only DF Tau A has a circumstellar disk. We present JWST-MIRI MRS observations of DF Tau. The MIRI spectrum shows a forest of H2O lines and emission from CO, C2H2, HCN, CO2, and OH. LTE slab models are used to determine the properties of the gas, and we analyze high angular spatial and spectral resolution data from ALMA, VLTI-GRAVITY, and IRTF-iSHELL to aid in the interpretation of the JWST data. The 1.3 mm ALMA continuum data show two equal-brightness sources of compact (R<3 au) emission, with separations and movement consistent with astrometry from VLTI-GRAVITY and the known orbit. This is interpreted as a robust detection of a disk around DF Tau B, which we suggest may host a small (~1 au) cavity to reconcile all observations. The disk around DF Tau A is expected to be a full disk, and spatially and spectrally resolved dust and gas emission points to hot, close-in (<0.2 au) material. Hot (~500-1000 K) H2O, HCN, and C2H2 emission in the MIRI data likely originate in the DF Tau A disk, while a cold (<200 K) H2O component with an extended emitting area is consistent with an origin from both disks. Despite the very compact outer disks, the inner disk composition and conditions are similar to isolated systems, suggesting that the close binary nature is not a driving factor in setting the inner disk chemistry. However, constraining the geometry of the disks, for instance, via higher resolution ALMA observations, would provide additional insight into the mid-infrared gas emission. JWST observations of spatially resolved binaries will be important for understanding the impact of binarity on inner disk chemistry more generally.


title: Semantic Membership Inference Attack against Large Language Models

abstract: Membership Inference Attacks (MIAs) determine whether a specific data point was included in the training set of a target model. In this paper, we introduce the Semantic Membership Inference Attack (SMIA), a novel approach that enhances MIA performance by leveraging the semantic content of inputs and their perturbations. SMIA trains a neural network to analyze the target model's behavior on perturbed inputs, effectively capturing variations in output probability distributions between members and non-members. We conduct comprehensive evaluations on the Pythia and GPT-Neo model families using the Wikipedia dataset. Our results show that SMIA significantly outperforms existing MIAs; for instance, SMIA achieves an AUC-ROC of 67.39% on Pythia-12B, compared to 58.90% by the second-best attack.


title: PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splatting

abstract: Recent advancements in novel view synthesis have enabled real-time rendering speeds and high reconstruction accuracy. 3D Gaussian Splatting (3D-GS), a foundational point-based parametric 3D scene representation, models scenes as large sets of 3D Gaussians. Complex scenes can comprise of millions of Gaussians, amounting to large storage and memory requirements that limit the viability of 3D-GS on devices with limited resources. Current techniques for compressing these pretrained models by pruning Gaussians rely on combining heuristics to determine which ones to remove. In this paper, we propose a principled spatial sensitivity pruning score that outperforms these approaches. It is computed as a second-order approximation of the reconstruction error on the training views with respect to the spatial parameters of each Gaussian. Additionally, we propose a multi-round prune-refine pipeline that can be applied to any pretrained 3D-GS model without changing the training pipeline. After pruning 88.44% of the Gaussians, we observe that our PUP 3D-GS pipeline increases the average rendering speed of 3D-GS by 2.65$\times$ while retaining more salient foreground information and achieving higher image quality metrics than previous pruning techniques on scenes from the Mip-NeRF 360, Tanks & Temples, and Deep Blending datasets.


title: Dispersion relation from Lorentzian inversion in 1d CFT

abstract: Starting from the Lorentzian inversion formula, we derive a dispersion relation which computes a four-point function in 1d CFTs as an integral over its double discontinuity. The crossing symmetric kernel of the integral is given explicitly for the case of identical operators with integer or half-integer scaling dimension. This derivation complements the one that uses analytic functionals. We use the dispersion relation to evaluate holographic correlators defined on the half-BPS Wilson line of planar $\mathcal{N}=4$ super Yang-Mills, reproducing results up to fourth order in an expansion at large t'Hooft coupling.


title: Short Film Dataset (SFD): A Benchmark for Story-Level Video Understanding

abstract: Recent advances in vision-language models have significantly propelled video understanding. Existing datasets and tasks, however, have notable limitations. Most datasets are confined to short videos with limited events and narrow narratives. For example, datasets with instructional and egocentric videos often document the activities of one person in a single scene. Although some movie datasets offer richer content, they are often limited to short-term tasks, lack publicly available videos and frequently encounter data leakage given the use of movie forums and other resources in LLM training. To address the above limitations, we propose the Short Film Dataset (SFD) with 1,078 publicly available amateur movies, a wide variety of genres and minimal data leakage issues. SFD offers long-term story-oriented video tasks in the form of multiple-choice and open-ended question answering. Our extensive experiments emphasize the need for long-term reasoning to solve SFD tasks. Notably, we find strong signals in movie transcripts leading to the on-par performance of people and LLMs. We also show significantly lower performance of current models compared to people when using vision data alone.


title: Ultra-low noise laser and optical frequency comb-based timing system for the Black Hole Explorer (BHEX) mission

abstract: In this effort, we demonstrate the performance of a highly stable time reference for the proposed Black Hole Explorer (BHEX) mission, a space-based extension to the Event Horizon Telescope (EHT) Very Long Baseline Interferometry (VLBI) project. This precision timing system is based on the use of a space-qualified, ultra-low noise laser developed as part of the Laser Interferometer Space Antenna (LISA) mission as the timing reference, and an optical frequency comb to transfer the stability of this laser to the microwave regime for instrumentation use. We describe the implementation of this system and experimental setup to characterize the stability performance. We present the results of this experiment that demonstrate the performance of this system meets requirements for the BHEX mission.


title: Diffusion Synthesizer for Efficient Multilingual Speech to Speech Translation

abstract: We introduce DiffuseST, a low-latency, direct speech-to-speech translation system capable of preserving the input speaker's voice zero-shot while translating from multiple source languages into English. We experiment with the synthesizer component of the architecture, comparing a Tacotron-based synthesizer to a novel diffusion-based synthesizer. We find the diffusion-based synthesizer to improve MOS and PESQ audio quality metrics by 23\% each and speaker similarity by 5\% while maintaining comparable BLEU scores. Despite having more than double the parameter count, the diffusion synthesizer has lower latency, allowing the entire model to run more than 5$\times$ faster than real-time.


title: EFM3D: A Benchmark for Measuring Progress Towards 3D Egocentric Foundation Models

abstract: The advent of wearable computers enables a new source of context for AI that is embedded in egocentric sensor data. This new egocentric data comes equipped with fine-grained 3D location information and thus presents the opportunity for a novel class of spatial foundation models that are rooted in 3D space. To measure progress on what we term Egocentric Foundation Models (EFMs) we establish EFM3D, a benchmark with two core 3D egocentric perception tasks. EFM3D is the first benchmark for 3D object detection and surface regression on high quality annotated egocentric data of Project Aria. We propose Egocentric Voxel Lifting (EVL), a baseline for 3D EFMs. EVL leverages all available egocentric modalities and inherits foundational capabilities from 2D foundation models. This model, trained on a large simulated dataset, outperforms existing methods on the EFM3D benchmark.


title: SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models

abstract: During the acquisition of satellite images, there is generally a trade-off between spatial resolution and temporal resolution (acquisition frequency) due to the onboard sensors of satellite imaging systems. High-resolution satellite images are very important for land crop monitoring, urban planning, wildfire management and a variety of applications. It is a significant yet challenging task to achieve high spatial-temporal resolution in satellite imaging. With the advent of diffusion models, we can now learn strong generative priors to generate realistic satellite images with high resolution, which can be utilized to promote the super-resolution task as well. In this work, we propose a novel diffusion-based fusion algorithm called \textbf{SatDiffMoE} that can take an arbitrary number of sequential low-resolution satellite images at the same location as inputs, and fuse them into one high-resolution reconstructed image with more fine details, by leveraging and fusing the complementary information from different time points. Our algorithm is highly flexible and allows training and inference on arbitrary number of low-resolution images. Experimental results show that our proposed SatDiffMoE method not only achieves superior performance for the satellite image super-resolution tasks on a variety of datasets, but also gets an improved computational efficiency with reduced model parameters, compared with previous methods.


title: Joint estimation of noise and nonlinearity in Kerr systems

abstract: We address characterization of lossy and dephasing channels in the presence of self-Kerr interaction using coherent probes. In particular, we investigate the ultimate bounds to precision in the joint estimation of loss and nonlinearity and of dephasing and nonlinearity. To this aim, we evaluate the quantum Fisher information matrix (QFIM), and compare the symmetric quantum Cram\'er-Rao bound (QCR) to the bound obtained with Fisher information matrix (FIM) of feasible quantum measurements, i.e., homodyne and double-homodyne detection. For lossy Kerr channels, our results show the loss characterization is enhanced in the presence of Kerr nonlinearity, especially in the relevant limit of small losses and low input energy, whereas the estimation of nonlinearity itself is unavoidably degraded by the presence of loss. In the low energy regime, homodyne detection of a suitably optimized quadrature represents a nearly optimal measurement. The Uhlmann curvature does not vanish, therefore loss and nonlinearity can be jointly estimated only with the addition of intrinsic quantum noise. For dephasing Kerr channels, the QFIs of the two parameters are independent of the nonlinearity, and therefore no enhancement is observed. Homodyne and double-homodyne detection are suboptimal for the estimation of dephasing and nearly optimal for nonlinearity. Also in this case, the Uhlmann curvature is nonzero, proving that the parameters cannot be jointly estimated with maximum precision.


title: VideoGUI: A Benchmark for GUI Automation from Instructional Videos

abstract: Graphical User Interface (GUI) automation holds significant promise for enhancing human productivity by assisting with computer tasks. Existing task formulations primarily focus on simple tasks that can be specified by a single, language-only instruction, such as "Insert a new slide." In this work, we introduce VideoGUI, a novel multi-modal benchmark designed to evaluate GUI assistants on visual-centric GUI tasks. Sourced from high-quality web instructional videos, our benchmark focuses on tasks involving professional and novel software (e.g., Adobe Photoshop or Stable Diffusion WebUI) and complex activities (e.g., video editing). VideoGUI evaluates GUI assistants through a hierarchical process, allowing for identification of the specific levels at which they may fail: (i) high-level planning: reconstruct procedural subtasks from visual conditions without language descriptions; (ii) middle-level planning: generate sequences of precise action narrations based on visual state (i.e., screenshot) and goals; (iii) atomic action execution: perform specific actions such as accurately clicking designated elements. For each level, we design evaluation metrics across individual dimensions to provide clear signals, such as individual performance in clicking, dragging, typing, and scrolling for atomic action execution. Our evaluation on VideoGUI reveals that even the SoTA large multimodal model GPT4o performs poorly on visual-centric GUI tasks, especially for high-level planning.


title: VEGA: Learning Interleaved Image-Text Comprehension in Vision-Language Large Models

abstract: The swift progress of Multi-modal Large Models (MLLMs) has showcased their impressive ability to tackle tasks blending vision and language. Yet, most current models and benchmarks cater to scenarios with a narrow scope of visual and textual contexts. These models often fall short when faced with complex comprehension tasks, which involve navigating through a plethora of irrelevant and potentially misleading information in both text and image forms. To bridge this gap, we introduce a new, more demanding task known as Interleaved Image-Text Comprehension (IITC). This task challenges models to discern and disregard superfluous elements in both images and text to accurately answer questions and to follow intricate instructions to pinpoint the relevant image. In support of this task, we further craft a new VEGA dataset, tailored for the IITC task on scientific content, and devised a subtask, Image-Text Association (ITA), to refine image-text correlation skills. Our evaluation of four leading closed-source models, as well as various open-source models using VEGA, underscores the rigorous nature of IITC. Even the most advanced models, such as Gemini-1.5-pro and GPT4V, only achieved modest success. By employing a multi-task, multi-scale post-training strategy, we have set a robust baseline for MLLMs on the IITC task, attaining an $85.8\%$ accuracy rate in image association and a $0.508$ Rouge score. These results validate the effectiveness of our dataset in improving MLLMs capabilities for nuanced image-text comprehension.


title: Quantifying Variance in Evaluation Benchmarks

abstract: Evaluation benchmarks are the cornerstone of measuring capabilities of large language models (LLMs), as well as driving progress in said capabilities. Originally designed to make claims about capabilities (or lack thereof) in fully pretrained models, evaluation benchmarks are now also extensively used to decide between various training choices. Despite this widespread usage, we rarely quantify the variance in our evaluation benchmarks, which dictates whether differences in performance are meaningful. Here, we define and measure a range of metrics geared towards measuring variance in evaluation benchmarks, including seed variance across initialisations, and monotonicity during training. By studying a large number of models -- both openly available and pretrained from scratch -- we provide empirical estimates for a variety of variance metrics, with considerations and recommendations for practitioners. We also evaluate the utility and tradeoffs of continuous versus discrete performance measures and explore options for better understanding and reducing this variance. We find that simple changes, such as framing choice tasks (like MMLU) as completion tasks, can often reduce variance for smaller scale ($\sim$7B) models, while more involved methods inspired from human testing literature (such as item analysis and item response theory) struggle to meaningfully reduce variance. Overall, our work provides insights into variance in evaluation benchmarks, suggests LM-specific techniques to reduce variance, and more generally encourages practitioners to carefully factor in variance when comparing models.


title: Topological invariant of velocity field in quantum systems

abstract: We introduce the velocity field of the Bloch electrons and propose the velocity field approach to characterize the topological invariants of quantum states. We find that the zero modes of the velocity field flow play the roles of effective topological charges or defects. A key global property of the zero modes is topological invariant against the parameter deformation. These can be characterized by the Euler characteristic based on the Poincar\'{e}-Hopf theorem. We demonstrate the validity of this approach by using the quantum sphere and torus models. The topological invariants of the velocity field in the quantum sphere and torus are consistent with the mathematical results of the vector fields in the manifolds of the sphere and torus, Euler characteristic $\chi=2$ for sphere and $\chi=0$ for torus. We also discuss the non-Hermitian quantum torus model and compare differences in the topological invariants obtained using the velocity field and Chern number methods. The topological invariant characterized by the velocity field is homeomorphic in the Brillouin zone and the subbase manifold of the SU(2)-bundle of the system, whereas the Chern number characterizes a homotopic invariant that is associated with the exceptional points in the Brillouin zone. These results enrich the topological invariants of quantum states and provide novel insights into the topological invariants of quantum states.


title: Sign Language Recognition based on YOLOv5 Algorithm for the Telugu Sign Language

abstract: Sign language recognition (SLR) technology has enormous promise to improve communication and accessibility for the difficulty of hearing. This paper presents a novel approach for identifying gestures in TSL using the YOLOv5 object identification framework. The main goal is to create an accurate and successful method for identifying TSL gestures so that the deaf community can use slr. After that, a deep learning model was created that used the YOLOv5 to recognize and classify gestures. This model benefited from the YOLOv5 architecture's high accuracy, speed, and capacity to handle complex sign language features. Utilizing transfer learning approaches, the YOLOv5 model was customized to TSL gestures. To attain the best outcomes, careful parameter and hyperparameter adjustment was carried out during training. With F1-score and mean Average Precision (mAP) ratings of 90.5% and 98.1%, the YOLOv5-medium model stands out for its outstanding performance metrics, demonstrating its efficacy in Telugu sign language identification tasks. Surprisingly, this model strikes an acceptable balance between computational complexity and training time to produce these amazing outcomes. Because it offers a convincing blend of accuracy and efficiency, the YOLOv5-medium model, trained for 200 epochs, emerges as the recommended choice for real-world deployment. The system's stability and generalizability across various TSL gestures and settings were evaluated through rigorous testing and validation, which yielded outstanding accuracy. This research lays the foundation for future advancements in accessible technology for linguistic communities by providing a cutting-edge application of deep learning and computer vision techniques to TSL gesture identification. It also offers insightful perspectives and novel approaches to the field of sign language recognition.


title: Object criticality for safer navigation

abstract: Object detection in autonomous driving consists in perceiving and locating instances of objects in multi-dimensional data, such as images or lidar scans. Very recently, multiple works are proposing to evaluate object detectors by measuring their ability to detect the objects that are most likely to interfere with the driving task. Detectors are then ranked according to their ability to detect the most relevant objects, rather than the highest number of objects. However there is little evidence so far that the relevance of predicted object may contribute to the safety and reliability improvement of the driving task. This position paper elaborates on a strategy, together with partial results, to i) configure and deploy object detectors that successfully extract knowledge on object relevance, and ii) use such knowledge to improve the trajectory planning task. We show that, given an object detector, filtering objects based on their relevance, in combination with the traditional confidence threshold, reduces the risk of missing relevant objects, decreases the likelihood of dangerous trajectories, and improves the quality of trajectories in general.


title: In Situ Dynamic Four-Dimensional Strong Field Ionization Tomography

abstract: We present an approach for in situ dynamic four-dimensional (4D=3D space + 1D time) laser induced strong field ionization tomography, particularly suited for measuring far-from-equilibrium systems, such as supersonic and hypersonic pulsed gas jets. The inherent physical nature of strong-field interaction leads to significantly enhanced spatial resolution, with unique intensity-resolution coupling and localization of measurement depth. By employing femtosecond laser, temporal resolution is primarily limited by electronic jitter, typically to a few tens of picoseconds.