title: PeriodGrad: Towards Pitch-Controllable Neural Vocoder Based on a Diffusion Probabilistic Model

abstract: This paper presents a neural vocoder based on a denoising diffusion probabilistic model (DDPM) incorporating explicit periodic signals as auxiliary conditioning signals. Recently, DDPM-based neural vocoders have gained prominence as non-autoregressive models that can generate high-quality waveforms. The neural vocoders based on DDPM have the advantage of training with a simple time-domain loss. In practical applications, such as singing voice synthesis, there is a demand for neural vocoders to generate high-fidelity speech waveforms with flexible pitch control. However, conventional DDPM-based neural vocoders struggle to generate speech waveforms under such conditions. Our proposed model aims to accurately capture the periodic structure of speech waveforms by incorporating explicit periodic signals. Experimental results show that our model improves sound quality and provides better pitch control than conventional DDPM-based neural vocoders.


title: Joint AP-UE Association and Power Factor Optimization for Distributed Massive MIMO

abstract: The uplink sum-throughput of distributed massive multiple-input-multiple-output (mMIMO) networks depends majorly on Access point (AP)-User Equipment (UE) association and power control. The AP-UE association and power control both are important problems in their own right in distributed mMIMO networks to improve scalability and reduce front-haul load of the network, and to enhance the system performance by mitigating the interference and boosting the desired signals, respectively. Unlike previous studies, which focused primarily on addressing these two problems separately, this work addresses the uplink sum-throughput maximization problem in distributed mMIMO networks by solving the joint AP-UE association and power control problem, while maintaining Quality-of-Service (QoS) requirements for each UE. To improve scalability, we present an l1-penalty function that delicately balances the trade-off between spectral efficiency (SE) and front-haul signaling load. Our proposed methodology leverages fractional programming, Lagrangian dual formation, and penalty functions to provide an elegant and effective iterative solution with guaranteed convergence. Extensive numerical simulations validate the efficacy of the proposed technique for maximizing sum-throughput while considering the joint AP-UE association and power control problem, demonstrating its superiority over approaches that address these problems individually. Furthermore, the results show that the introduced penalty function can help us effectively control the maximum front-haul load.


title: A Quick Introduction to Quantum Machine Learning for Non-Practitioners

abstract: This paper provides an introduction to quantum machine learning, exploring the potential benefits of using quantum computing principles and algorithms that may improve upon classical machine learning approaches. Quantum computing utilizes particles governed by quantum mechanics for computational purposes, leveraging properties like superposition and entanglement for information representation and manipulation. Quantum machine learning applies these principles to enhance classical machine learning models, potentially reducing network size and training time on quantum hardware. The paper covers basic quantum mechanics principles, including superposition, phase space, and entanglement, and introduces the concept of quantum gates that exploit these properties. It also reviews classical deep learning concepts, such as artificial neural networks, gradient descent, and backpropagation, before delving into trainable quantum circuits as neural networks. An example problem demonstrates the potential advantages of quantum neural networks, and the appendices provide detailed derivations. The paper aims to help researchers new to quantum mechanics and machine learning develop their expertise more efficiently.


title: QIS : Interactive Segmentation via Quasi-Conformal Mappings

abstract: Image segmentation plays a crucial role in extracting important objects of interest from images, enabling various applications. While existing methods have shown success in segmenting clean images, they often struggle to produce accurate segmentation results when dealing with degraded images, such as those containing noise or occlusions. To address this challenge, interactive segmentation has emerged as a promising approach, allowing users to provide meaningful input to guide the segmentation process. However, an important problem in interactive segmentation lies in determining how to incorporate minimal yet meaningful user guidance into the segmentation model. In this paper, we propose the quasi-conformal interactive segmentation (QIS) model, which incorporates user input in the form of positive and negative clicks. Users mark a few pixels belonging to the object region as positive clicks, indicating that the segmentation model should include a region around these clicks. Conversely, negative clicks are provided on pixels belonging to the background, instructing the model to exclude the region near these clicks from the segmentation mask. Additionally, the segmentation mask is obtained by deforming a template mask with the same topology as the object of interest using an orientation-preserving quasiconformal mapping. This approach helps to avoid topological errors in the segmentation results. We provide a thorough analysis of the proposed model, including theoretical support for the ability of QIS to include or exclude regions of interest or disinterest based on the user's indication. To evaluate the performance of QIS, we conduct experiments on synthesized images, medical images, natural images and noisy natural images. The results demonstrate the efficacy of our proposed method.


title: On Schr\"odingerization based quantum algorithms for linear dynamical systems with inhomogeneous terms

abstract: We analyze the Schr\"odingerisation method for quantum simulation of a general class of non-unitary dynamics with inhomogeneous source terms. The Schr\"odingerisation technique, introduced in \cite{JLY22a,JLY23}, transforms any linear ordinary and partial differential equations with non-unitary dynamics into a system under unitary dynamics via a warped phase transition that maps the equations into a higher dimension, making them suitable for quantum simulation. This technique can also be applied to these equations with inhomogeneous terms modeling source or forcing terms or boundary and interface conditions, and discrete dynamical systems such as iterative methods in numerical linear algebra, through extra equations in the system. Difficulty airses with the presense of inhomogeneous terms since it can change the stability of the original system. In this paper, we systematically study--both theoretically and numerically--the important issue of recovering the original variables from the Schr\"odingerized equations, even when the evolution operator contains unstable modes. We show that even with unstable modes, one can still construct a stable scheme, yet to recover the original variable one needs to use suitable data in the extended space. We analyze and compare both the discrete and continuous Fourier transforms used in the extended dimension, and derive corresponding error estimates, which allows one to use the more appropriate transform for specific equations. We also provide a smoother initialization for the Schrod\"odingerized system to gain higher order accuracy in the extended space. We homogenize the inhomogeneous terms with a stretch transformation, making it easier to recover the original variable. Our recovering technique also provides a simple and generic framework to solve general ill-posed problems in a computationally stable way.


title: Useful variants and perturbations of completely entangled subspaces and spans of unextendible product bases

abstract: Finite dimensional entanglement for pure states has been used extensively in quantum information theory. Depending on the tensor product structure, even set of separable states can show non-intuitive characters. Two situations are well studied in the literature, namely the unextendible product basis by Bennett et al [Phys. Rev. Lett. 82, 5385, (1999)], and completely entangled subspaces explicitly given by Parthasarathy in [Proc. Indian Acad. Sci. Math. Sci. 114, 4 (2004)]. More recently Boyer, Liss, and Mor [Phys. Rev. A 95, 032308 (2017)]; Boyer and Mor [Preprints 2023080529, (2023)]; and Liss, Mor, and Winter [arXiv: 2309.05144, (2023)] have studied spaces which have only finitely many pure product states. We carry this further and consider the problem of perturbing different spaces, such as the orthogonal complement of an unextendible product basis and also Parthasarathy's completely entangled spaces, by taking linear spans with specified product vectors. To this end, we develop methods and theory of variations and perturbations of the linear spans of certain unextendible product bases, their orthogonal complements, and also Parthasarathy's completely entangled sub-spaces. Finally we give examples of perturbations with infinitely many pure product states.


title: Using construction waste hauling trucks' GPS data to classify earthwork-related locations: A Chengdu case study

abstract: Earthwork-related locations (ERLs), such as construction sites, earth dumping ground, and concrete mixing stations, are major sources of urban dust pollution (particulate matters). The effective management of ERLs is crucial and requires timely and efficient tracking of these locations throughout the city. This work aims to identify and classify urban ERLs using GPS trajectory data of over 16,000 construction waste hauling trucks (CWHTs), as well as 58 urban features encompassing geographic, land cover, POI and transport dimensions. We compare several machine learning models and examine the impact of various spatial-temporal features on classification performance using real-world data in Chengdu, China. The results demonstrate that 77.8% classification accuracy can be achieved with a limited number of features. This classification framework was implemented in the Alpha MAPS system in Chengdu, which has successfully identified 724 construction cites/earth dumping ground, 48 concrete mixing stations, and 80 truck parking locations in the city during December 2023, which has enabled local authority to effectively manage urban dust pollution at low personnel costs.


title: Continuity of extensions of Lipschitz maps and of monotone maps

abstract: Let $X$ be a subset of a Hilbert space. We prove that if $v\colon X\to \mathbb{R}^m$ is such that \begin{equation*} \Big\lVert v(x)-\sum_{i=1}^m t_iv(x_i)\Big\rVert\leq \Big\lVert x-\sum_{i=1}^m t_ix_i\Big\rVert \end{equation*} for all $x,x_1,\dotsc,x_m\in\mathbb{R}^m$ and all non-negative $t_1,\dotsc,t_m$ that add up to one, then for any $1$-Lipschitz $u\colon A\to\mathbb{R}^m$, with $A\subset X$, there exists a $1$-Lipschitz extension $\tilde{u}\colon X\to\mathbb{R}^m$ of $u$ such that the uniform distance on $X$ between $\tilde{u}$ and $v$ is the same as the uniform distance on $A$ between $u$ and $v$. Morever, if either $m\in \{1,2,3\}$ or $X$ is convex, we prove the converse: we show that a map $v\colon X\to\mathbb{R}^m$ that allows for a $1$-Lipschitz, uniform distance preserving extension of any $1$-Lipschitz map on a subset of $X$ also satisfies the above set of inequalities. We also prove a similar continuity result concerning extensions of monotone maps. Our results hold true also for maps taking values in infinite-dimensional spaces.


title: Unveiling Linguistic Regions in Large Language Models

abstract: Large Language Models (LLMs) have demonstrated considerable cross-lingual alignment and generalization ability. Current research primarily focuses on improving LLMs' cross-lingual generalization capabilities. However, there is still a lack of research on the intrinsic mechanisms of how LLMs achieve cross-lingual alignment. From the perspective of region partitioning, this paper conducts several investigations on the linguistic competence of LLMs. We discover a core region in LLMs that corresponds to linguistic competence, accounting for approximately 1% of the total model parameters. Removing this core region by setting parameters to zero results in a significant performance decrease across 30 different languages. Furthermore, this core region exhibits significant dimensional dependence, perturbations to even a single parameter on specific dimensions leading to a loss of linguistic competence. Moreover, we discover that distinct monolingual regions exist for different languages, and disruption to these specific regions substantially reduces the LLMs' proficiency in those corresponding languages. Our research also indicates that freezing the core linguistic region during further pre-training can mitigate the issue of catastrophic forgetting (CF), a common phenomenon observed during further pre-training of LLMs. Overall, exploring the LLMs' functional regions provides insights into the foundation of their intelligence.


title: COMPASS: Computational Mapping of Patient-Therapist Alliance Strategies with Language Modeling

abstract: The therapeutic working alliance is a critical factor in predicting the success of psychotherapy treatment. Traditionally, working alliance assessment relies on questionnaires completed by both therapists and patients. In this paper, we present COMPASS, a novel framework to directly infer the therapeutic working alliance from the natural language used in psychotherapy sessions. Our approach utilizes advanced large language models to analyze transcripts of psychotherapy sessions and compare them with distributed representations of statements in the working alliance inventory. Analyzing a dataset of over 950 sessions covering diverse psychiatric conditions, we demonstrate the effectiveness of our method in microscopically mapping patient-therapist alignment trajectories and providing interpretability for clinical psychiatry and in identifying emerging patterns related to the condition being treated. By employing various neural topic modeling techniques in combination with generative language prompting, we analyze the topical characteristics of different psychiatric conditions and incorporate temporal modeling to capture the evolution of topics at a turn-level resolution. This combined framework enhances the understanding of therapeutic interactions, enabling timely feedback for therapists regarding conversation quality and providing interpretable insights to improve the effectiveness of psychotherapy.


title: InfFeed: Influence Functions as a Feedback to Improve the Performance of Subjective Tasks

abstract: Recently, influence functions present an apparatus for achieving explainability for deep neural models by quantifying the perturbation of individual train instances that might impact a test prediction. Our objectives in this paper are twofold. First we incorporate influence functions as a feedback into the model to improve its performance. Second, in a dataset extension exercise, using influence functions to automatically identify data points that have been initially `silver' annotated by some existing method and need to be cross-checked (and corrected) by annotators to improve the model performance. To meet these objectives, in this paper, we introduce InfFeed, which uses influence functions to compute the influential instances for a target instance. Toward the first objective, we adjust the label of the target instance based on its influencer(s) label. In doing this, InfFeed outperforms the state-of-the-art baselines (including LLMs) by a maximum macro F1-score margin of almost 4% for hate speech classification, 3.5% for stance classification, and 3% for irony and 2% for sarcasm detection. Toward the second objective we show that manually re-annotating only those silver annotated data points in the extension set that have a negative influence can immensely improve the model performance bringing it very close to the scenario where all the data points in the extension set have gold labels. This allows for huge reduction of the number of data points that need to be manually annotated since out of the silver annotated extension dataset, the influence function scheme picks up ~1/1000 points that need manual correction.


title: On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluation

abstract: We study off-policy evaluation (OPE) in partially observable environments with complex observations, with the goal of developing estimators whose guarantee avoids exponential dependence on the horizon. While such estimators exist for MDPs and POMDPs can be converted to history-based MDPs, their estimation errors depend on the state-density ratio for MDPs which becomes history ratios after conversion, an exponential object. Recently, Uehara et al. (2022) proposed future-dependent value functions as a promising framework to address this issue, where the guarantee for memoryless policies depends on the density ratio over the latent state space. However, it also depends on the boundedness of the future-dependent value function and other related quantities, which we show could be exponential-in-length and thus erasing the advantage of the method. In this paper, we discover novel coverage assumptions tailored to the structure of POMDPs, such as outcome coverage and belief coverage. These assumptions not only enable polynomial bounds on the aforementioned quantities, but also lead to the discovery of new algorithms with complementary properties.


title: An LLM-Enhanced Adversarial Editing System for Lexical Simplification

abstract: Lexical Simplification (LS) aims to simplify text at the lexical level. Existing methods rely heavily on annotated data, making it challenging to apply in low-resource scenarios. In this paper, we propose a novel LS method without parallel corpora. This method employs an Adversarial Editing System with guidance from a confusion loss and an invariance loss to predict lexical edits in the original sentences. Meanwhile, we introduce an innovative LLM-enhanced loss to enable the distillation of knowledge from Large Language Models (LLMs) into a small-size LS system. From that, complex words within sentences are masked and a Difficulty-aware Filling module is crafted to replace masked positions with simpler words. At last, extensive experimental results and analyses on three benchmark LS datasets demonstrate the effectiveness of our proposed method.


title: Engineering and Revealing Dirac Strings in Spinor Condensates

abstract: Artificial monopoles have been engineered in various systems, yet there has been no systematic study of the singular vector potentials associated with the monopole field. We show that the Dirac string, the line singularity of the vector potential, can be engineered, manipulated, and made manifest in a spinor atomic condensate. We elucidate the connection among spin, orbital degrees of freedom, and the artificial gauge, and show that there exists a mapping between the vortex filament and the Dirac string. We also devise a proposal where preparing initial spin states with relevant symmetries can result in different vortex patterns, revealing an underlying correspondence between the internal spin states and the spherical vortex structures. Such a mapping also leads to a new way of constructing spherical Landau levels, and monopole harmonics. Our observation provides insights into the behavior of quantum matter possessing internal symmetries in curved spaces.


title: Birth of Rapidly Spinning, Overmassive Black Holes in the Early Universe

abstract: The James Webb Space Telescope (JWST) has unveiled numerous massive black holes (BHs) in faint, broad-line active galactic nuclei (AGNs). The discovery highlights the presence of dust-reddened AGN populations, referred to as little red dots (LRDs), more abundant than X-ray selected AGNs, which are less influenced by obscuration. This finding indicates that the cosmic growth rate of BHs within this population does not decrease but rather increases at higher redshifts beyond $z\sim 6$. The BH accretion rate density deduced from their luminosity function is remarkably higher than that from other AGN surveys in X-ray and infrared bands. To align the cumulative mass density accreted to BHs with the observed BH mass density at $z\simeq 4-5$, as derived from the integration of the BH mass function, the radiative efficiency must be doubled from the canonical 10% value, achieving significance beyond the $>2\sigma$ confidence level. This suggests the presence of rapid spins with 96% of the maximum limit among these BHs, maintained by prolonged mass accretion instead of chaotic accretion with randomly oriented inflows. Moreover, we derive an upper bound for the stellar mass of galaxies hosting these LRDs, ensuring consistency with galaxy formation in the standard cosmological model, where the host stellar mass is limited by the available baryonic reservoir. Our analysis gives a lower bound for the BH-to-galaxy mass ratio that exceeds the typical value known in the nearby universe and aligns with that for JWST-detected unobscured AGNs. Accordingly, we propose a hypothesis that the dense, dust-rich environments within LRDs facilitate the emergence of rapidly spinning and overmassive BH populations during the epoch of reionization. This scenario predicts a potential association between relativistic jets and other high-energy phenomena with overmassive BHs in the early universe.


title: Two-stage Cytopathological Image Synthesis for Augmenting Cervical Abnormality Screening

abstract: Automatic thin-prep cytologic test (TCT) screening can assist pathologists in finding cervical abnormality towards accurate and efficient cervical cancer diagnosis. Current automatic TCT screening systems mostly involve abnormal cervical cell detection, which generally requires large-scale and diverse training data with high-quality annotations to achieve promising performance. Pathological image synthesis is naturally raised to minimize the efforts in data collection and annotation. However, it is challenging to generate realistic large-size cytopathological images while simultaneously synthesizing visually plausible appearances for small-size abnormal cervical cells. In this paper, we propose a two-stage image synthesis framework to create synthetic data for augmenting cervical abnormality screening. In the first Global Image Generation stage, a Normal Image Generator is designed to generate cytopathological images full of normal cervical cells. In the second Local Cell Editing stage, normal cells are randomly selected from the generated images and then are converted to different types of abnormal cells using the proposed Abnormal Cell Synthesizer. Both Normal Image Generator and Abnormal Cell Synthesizer are built upon Stable Diffusion, a pre-trained foundation model for image synthesis, via parameter-efficient fine-tuning methods for customizing cytopathological image contents and extending spatial layout controllability, respectively. Our experiments demonstrate the synthetic image quality, diversity, and controllability of the proposed synthesis framework, and validate its data augmentation effectiveness in enhancing the performance of abnormal cervical cell detection.


title: CaT-GNN: Enhancing Credit Card Fraud Detection via Causal Temporal Graph Neural Networks

abstract: Credit card fraud poses a significant threat to the economy. While Graph Neural Network (GNN)-based fraud detection methods perform well, they often overlook the causal effect of a node's local structure on predictions. This paper introduces a novel method for credit card fraud detection, the \textbf{\underline{Ca}}usal \textbf{\underline{T}}emporal \textbf{\underline{G}}raph \textbf{\underline{N}}eural \textbf{N}etwork (CaT-GNN), which leverages causal invariant learning to reveal inherent correlations within transaction data. By decomposing the problem into discovery and intervention phases, CaT-GNN identifies causal nodes within the transaction graph and applies a causal mixup strategy to enhance the model's robustness and interpretability. CaT-GNN consists of two key components: Causal-Inspector and Causal-Intervener. The Causal-Inspector utilizes attention weights in the temporal attention mechanism to identify causal and environment nodes without introducing additional parameters. Subsequently, the Causal-Intervener performs a causal mixup enhancement on environment nodes based on the set of nodes. Evaluated on three datasets, including a private financial dataset and two public datasets, CaT-GNN demonstrates superior performance over existing state-of-the-art methods. Our findings highlight the potential of integrating causal reasoning with graph neural networks to improve fraud detection capabilities in financial transactions.


title: High-resolution spectroscopic analysis of four unevolved barium stars

abstract: A classical Local Thermodynamic Equilibrium analysis, based on high-resolution spectroscopic data, is performed for a sample of three potential barium dwarf candidates and one star already recognized as such. We derived their atmospheric parameters, estimated their masses and luminosities, and determined chemical abundances for a set of 21 elements, including CNO. Some elemental abundances are derived for the first time in HD~15096, HD~37792, and HD~141804. The program stars are dwarfs/subgiants with metallicities typical of disc stars, exhibiting moderate carbon enhancements, with $\rm{[C/Fe]}$ ratios ranging from $+0.29$ to $+0.66$ dex, and high levels of \textit{slow} neutron-capture ($s$-process) elements, with $\rm{[\textit{s}/Fe]}\gtrsim +1.0$~dex. As spectroscopic binaries, their peculiarities are attributable to mass transfer events. The observed neutron-capture patterns of were individually compared with two sets of $s$-process nucleosynthesis models (Monash and {\sc fruity}), yielding dilution factors and masses estimates for the former polluting Asymptotic Giant Branch stars. Low-mass ($\lesssim 3.0~\rm{M}_{\odot}$) models successfully reproduce the observations. In addition, we estimated mean neutron exposures of the order of 0.6 -- 0.7 mb$^{-1}$ for the $s$-processed material observed in their envelopes. Applying an empirical initial-final mass relation, we constraint in $\sim 0.7\,\textrm{M}_{\odot}$ the mass of their dim white-dwarf companions. Moreover, our kinematic study revealed that the program stars are members of the thin disk, with probabilities greater than 70\%. Hence, we identified HD~15096 and HD~37792 as new barium dwarfs and confirmed that HD~141804 is a barium dwarf. Thus, the number of barium dwarfs identified in the literature from high-resolution spectroscopy increases to 71 objects.


title: IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpus

abstract: Large Language Models (LLMs) demonstrate remarkable potential across various domains; however, they exhibit a significant performance gap in Information Extraction (IE). Note that high-quality instruction data is the vital key for enhancing the specific capabilities of LLMs, while current IE datasets tend to be small in scale, fragmented, and lack standardized schema. To this end, we introduce IEPile, a comprehensive bilingual (English and Chinese) IE instruction corpus, which contains approximately 0.32B tokens. We construct IEPile by collecting and cleaning 33 existing IE datasets, and introduce schema-based instruction generation to unearth a large-scale corpus. Experimentally, IEPile enhance the performance of LLMs for IE, with notable improvements in zero-shot generalization. We open-source the resource and pre-trained models, hoping to provide valuable support to the NLP community.


title: Observability for Nonlinear Systems: Connecting Variational Dynamics, Lyapunov Exponents, and Empirical Gramians

abstract: Observability is a key problem in dynamic network sciences. While it has been thoroughly studied for linear systems, observability for nonlinear networks is less intuitive and more cumbersome. One common approach to quantify observability for nonlinear systems is via the Empirical Gramian (Empr-Gram) -- a generalized form of the Gramian of linear systems. In this technical note, we produce three new results. First, we establish that a variational form of nonlinear systems (computed via perturbing initial conditions) yields a so-called Variational Gramian (Var-Gram) that is equivalent to the classic Empr-Gram; the former being easier to compute than the latter. Via Lyapunov exponents derived from Lyapunov's direct method, the technical note's second result derives connections between vintage observability measures and Var-Gram. The third result demonstrates the applicability of these new notions for sensor selection/placement in nonlinear systems. Numerical case studies demonstrate these three developments and their merits.


title: Gilbert-Varshamov Bound for Codes in $L_1$ Metric using Multivariate Analytic Combinatorics

abstract: Analytic combinatorics in several variables refers to a suite of tools that provide sharp asymptotic estimates for certain combinatorial quantities. In this paper, we apply these tools to determine the Gilbert--Varshamov lower bound on the rate of optimal codes in $L_1$ metric. Several different code spaces are analyzed, including the simplex and the hypercube in $\mathbb{Z^n}$, all of which are inspired by concrete data storage and transmission models such as the sticky insertion channel, the permutation channel, the adjacent transposition (bit-shift) channel, the multilevel flash memory channel, etc.


title: Deep Learning Models for Conditioning Extremely Noisy Signals

abstract: This paper presents a comparison of several Convolutional Neural Network (CNN) models for extracting target signals in highly noisy measurement conditions. Four CNN architectures were investigated. The first comprises six consecutive convolutional blocks while the second employs a U-Net structure. The third architecture introduces a new model inspired by the principles of wavelet transform. It consists of three CNN blocks with varied kernel sizes branching from the input layer before merging into consecutive concatenation and dense layers. The fourth is a Multilevel Wavelet Convolutional Neural Network (MWCNN), resembling U-net but the upsampling and downsampling are replaced by Discrete Wavelet transform and its inverse respectively. To evaluate these architectures, synthetic data were generated using pulse trains corrupted with various degrees of Gaussian noise to simulate measurement conditions with signal-to-noise ratios (SNR) as low as -20 dB. The methodology encompassed the generation and processing of signals with varied parameters: period (5-25 ms), duty cycle (0.1-0.5), and amplitude (1-150 mV). Subsequently, the machine learning models were trained, validated and tested. Finally, the output is processed to recover the signal amplitude before standardisation. The modified MWCNN model demonstrated superior performance achieving a median of 25.9 dB with a mean Root Mean Square Error (RMSE) that decreases with the amplitude of the signal reaching an average RMSE of 0.000128 mV for 1 mV signals. However, for this architecture, the output SNR drops by a factor of 1.23 when the input SNR decreases by 1 dB. All of the architectures exhibited consistency when testing output SNR for different signal amplitudes, periods and duty cycles. These findings indicate that CNN architectures can be used to denoise signals with SNR as low as -20 dB[...]


title: Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models

abstract: This report introduces \texttt{EEVE-Korean-v1.0}, a Korean adaptation of large language models that exhibit remarkable capabilities across English and Korean text understanding. Building on recent highly capable but English-centric LLMs, such as SOLAR-10.7B and Phi-2, where non-English texts are inefficiently processed with English-centric tokenizers, we present an efficient and effective vocabulary expansion (EEVE) method, which encompasses parameter freezing and subword initialization. In contrast to previous efforts that believe new embeddings require trillions of training tokens, we show that our method can significantly boost non-English proficiency within just 2 billion tokens. Surpassing most instruction-tuned LLMs on the Open Ko-LLM Leaderboard, as of January 2024, our model \texttt{EEVE-Korean-10.8B-v1.0} ranks as the leading Korean pre-trained model in the open-source community, according to Hugging Face's leaderboard. We open-source our models on Huggingface to empower the open research community in various languages.


title: Towards the quark mass dependence of $T_{cc}^+$ from lattice QCD

abstract: The $DD^*$ scattering phase shifts in the $T_{cc}^+=cc\bar{u}\bar{d}$ channel are extracted from lattice QCD for five different charm quark masses and a fixed light-quark mass corresponding to $m_\pi\simeq 280$~MeV. The phase shifts are analysed employing two approaches: effective range expansion and Lippmann--Schwinger equation derived in the effective field theory. In the latter case, the results imply an attraction at short range parametrised by contact terms and a slight repulsion at long range mediated by one-pion exchange with $m_\pi >m_{D^*}-m_D$. The poles in the amplitude across the complex energy plane are extracted and their trajectories are discussed as the charm quark mass is varied. Two complex conjugate poles corresponding to a resonance below threshold are found for $m_c$ close to the physical value. They turn into a pair of virtual states at the largest $m_c$ studied. With further increasing $m_c$, one virtual pole representing $T_{cc}^+$ is expected to move towards the two-body threshold and turn into a bound state. The light-quark mass dependence of the $T_{cc}^+$ pole is briefly discussed using the data on $DD^*$ scattering from other lattice collaborations.


title: Balanced Truncation of Descriptor Systems with a Quadratic Output

abstract: This work discusses model reduction for differential-algebraic systems with quadratic output equations. Under mild conditions, these systems can be transformed into a Weierstra{\ss} canonical form and, thus, be decoupled into differential equations and algebraic equations. The corresponding decoupled states are referred to as proper and improper states. Due to the quadratic function of the state as an output, the proper and improper states are coupled in the output equation, which imposes a challenge from a model reduction viewpoint. Keeping the coupling in mind, our goal in this work is to find important subspaces of the proper and improper states and to reduce the system accordingly. To that end, we first propose the system's matrices, the so-called Gramians, to characterize the system's dominant subspaces. We pay particular attention to the computation of the observability Gramians that take into account the nonlinear coupling between the proper and the improper states. We furthermore show that the proposed Gramians are related to certain kernel functions, which are used to identify important subspaces. This allows us to propose a reduction algorithm to obtain reduced-order systems by removing the subspaces that are difficult to reach, as well as, difficult to observe. Moreover, we quantify the error between the full-order and reduced-order models and demonstrate the proposed methodology using three numerical experiments.


title: Optimal schedules for annealing algorithms

abstract: Annealing algorithms such as simulated annealing and population annealing are widely used both for sampling the Gibbs distribution and solving optimization problems (i.e. finding ground states). For both statistical mechanics and optimization, additional parameters beyond temperature are often needed such as chemical potentials, external fields or Lagrange multipliers enforcing constraints. In this paper we derive a formalism for optimal annealing schedules in multidimensional parameter spaces using methods from non-equilibrium statistical mechanics. The results are closely related to work on optimal control of thermodynamic systems [Sivak and Crooks, PRL 108, 190602 (2012)]. Within the formalism, we compare the efficiency of population annealing and multiple weighted runs of simulated annealing ("annealed importance sampling") and discuss the effects of non-ergodicity on both algorithms. Theoretical results are supported by numerical simulations of spin glasses.


title: Quantum Annealing Inspired Algorithms for Track Reconstruction at High Energy Colliders

abstract: Charged particle reconstruction or track reconstruction is one of the most crucial components of pattern recognition in high energy collider physics. It is known for enormous consumption of the computing resources, especially when the particle multiplicity is high. This would indeed be the conditions at future colliders such as the High Luminosity Large Hadron Collider and Super Proton Proton Collider. Track reconstruction can be formulated as a quadratic unconstrained binary optimization (QUBO) problem, for which various quantum algorithms have been investigated and evaluated with both the quantum simulator and hardware. Simulated bifurcation algorithms are a set of quantum annealing inspired algorithms, and are serious competitors to the quantum annealing, other Ising machines and their classical counterparts. In this study, we show that the simulated bifurcation algorithms can be employed for solving the particle tracking problem. As the simulated bifurcation algorithms run on classical computers and are suitable for parallel processing and usage of the graphical processing units, they can handle significantly large data at high speed. These algorithms exhibit compatible or sometimes improved reconstruction efficiency and purity than the simulated annealing, but the running time can be reduced by as much as four orders of magnitude. These results suggest that QUBO models together with the quantum annealing inspired algorithms are valuable for the current and future particle tracking problems.


title: The cosmological constant and scale hierarchies with emergent gauge symmetries

abstract: Motivated by the stability of the electroweak Higgs vacuum we consider the possibility that the Standard Model might work up to large scales between about $10^{10}$ GeV and close to the Planck scale. A plausible scenario is an emergent Standard Model with gauge symmetries originating in some topological like phase transition deep in the ultraviolet. In this case the cosmological constant scale and neutrino masses should be of similar size, suppressed by factor of the large scale of emergence. The key physics involves a subtle interplay of Poincar\'e invariance, mass generation and renormalisation group invariance. The Higgs mass would be environmentally selected in connection with vacuum stability. Consequences for dark matter scenarios are discussed.


title: A Transformer Model for Boundary Detection in Continuous Sign Language

abstract: Sign Language Recognition (SLR) has garnered significant attention from researchers in recent years, particularly the intricate domain of Continuous Sign Language Recognition (CSLR), which presents heightened complexity compared to Isolated Sign Language Recognition (ISLR). One of the prominent challenges in CSLR pertains to accurately detecting the boundaries of isolated signs within a continuous video stream. Additionally, the reliance on handcrafted features in existing models poses a challenge to achieving optimal accuracy. To surmount these challenges, we propose a novel approach utilizing a Transformer-based model. Unlike traditional models, our approach focuses on enhancing accuracy while eliminating the need for handcrafted features. The Transformer model is employed for both ISLR and CSLR. The training process involves using isolated sign videos, where hand keypoint features extracted from the input video are enriched using the Transformer model. Subsequently, these enriched features are forwarded to the final classification layer. The trained model, coupled with a post-processing method, is then applied to detect isolated sign boundaries within continuous sign videos. The evaluation of our model is conducted on two distinct datasets, including both continuous signs and their corresponding isolated signs, demonstrates promising results.


title: Anomalous Giant Superradiance in Molecular Aggregates Coupled to Polaritons

abstract: In this study, we unveil an eccentric superradiance phenomenon in molecular aggregates coupled to surface plasmon polaritons. Through the quantization of electromagnetic fields in media, we demonstrate that superradiance can be significantly enhanced by polaritons and its behavior distinguishably surpasses the Dick's $N$ scaling law. To understand the mechanism of this anomalous phenomenon, we derive an analytical expression of the superradiance rate, which is general for molecular aggregates in arbitrary dispersive and absorbing media. Furthermore, we show the importance of intermolecular distance for this extraordinary superradiance.


title: A method for describing the maximal ideal in universal affine vertex algebras at non-admissible levels

abstract: The problem of determining maximal ideals in universal affine vertex algebras is difficult for levels beyond admissible, since there are no simple character formulas which can be applied. Here we investigate when certain quotient $\mathcal V$ of universal affine vertex algebra $V^k(\mathfrak{g})$ is simple. We present a new method for proving simplicity of quotients of universal affine vertex algebras in the case of affine vertex algebra $L_{k_n}(\mathfrak{sl}_{2n})$ at level $k_n:=-\frac{2n+1}{2}$. In that way we describe the maximal ideal in $V^{k_n}(\mathfrak{sl}_{2n})$. For that purpose, we use the representation theory of minimal affine $W$-algebra $W^{min}_{k_{n+1}}(\mathfrak{sl}_{2n+2})$ developed in [2]. In particular, we use the embedding $L_{k_n}(\mathfrak{sl}_{2n}) \subset W^{min}_{k_{n+1}}(\mathfrak{sl}_{2n+2})$ and fusion rules for $L_{k_n}(\mathfrak{sl}_{2n})$--modules. We apply this result in the cases $n=3,4$ and prove that a maximal ideal is generated by one singular vector of conformal weight $4$. As a byproduct, we classify irreducible modules in the category $\mathcal{O}$ for the simple affine vertex algebra $L_{-7/2}(\mathfrak{sl}_{6})$.


title: Run Time Assurance for Simultaneous Constraint Satisfaction During Spacecraft Attitude Maneuvering

abstract: A fundamental capability for On-orbit Servicing, Assembly, and Manufacturing (OSAM) is inspection of the vehicle to be serviced, or the structure being assembled. This research assumes autonomous slewing to maintain situational awareness of multiple vehicles operating in close proximity where several safety constraints must be satisfied. A variety of techniques may be used as the primary controller. The focus of this research is developing Run Time Assurance (RTA) filters that monitor system behavior and the output of the primary controller to enforce safety constraint satisfaction. Specifically, this research explores combining a subset of the constraints into an Active Set Invariance Filter (ASIF) RTA defined using control barrier functions. This method is minimally invasive to the primary control by minimizing deviation from the desired control output of the primary controller, while simultaneously enforcing all safety constraints. The RTA is designed to ensure the spacecraft maintains attitude requirements for communication and data transfer with a ground station during scheduled communication windows, adheres to conical attitude keep out zones, limits thermally unfavorable attitude duration, maintains attitude requirements for sufficient power generation, ensures maneuvers are below threshold to cause structural damage, ensures maximum angular velocity is below limits to maintain ability to respond quickly to new slewing commands, and conserves actuator use to prevent wear when possible. Slack variables are introduced into the ASIF controller to prioritize safety constraints when a solution to all safety constraints is infeasible. Monte Carlo simulation results as well as plots of example cases are shown and evaluated for a three degree of freedom spacecraft with reaction wheel attitude control.


title: Rotating Rayleigh-Benard convection: Attractors, bifurcations and heat transport via a Galerkin hierarchy

abstract: Motivated by the need for energetically consistent climate models, the Boussinessq-Coriolis (BC) equations are studied with a focus on the Nusselt number, defined as the averaged vertical heat transport. The Howard-Krishnamurthy-Coriolis (HKC) hierarchy is defined by explicitly computing the Galerkin truncations and selecting the Fourier modes in a particular way, such that this hierarchy can be shown to energy relations consistent with the PDE. Well-posedness and the existence of an attractor are then proven for the BC model, and an explicit upper bound on the attractor dimension is given. By studying the local bifurcations at the origin, a lower bound on the attractor dimension is provided. Finally, a series of numerical studies are performed by implementing the HKC hierarchy in MATLAB, which investigate convergence of the Nusselt number as one ascends HKC hierarchy as well as other issues related to heat transport parameterization.


title: Full quantum tomography of top quark decays

abstract: Quantum tomography in high-energy physics processes has usually been restricted to the spin degrees of freedom. We address the case of top quark decays $t \to W b$, in which the angular momentum ($L$) and the spins of $W$ and $b$ are intertwined into a 54-dimensional $LWb$ density operator. The entanglement between $L$ and the $W$ or $b$ spin is large and could be determined for decays of single top quarks produced at the Large Hadron Collider, well above $5\sigma$ (statistical only) from the separability hypothesis. These would be the first entanglement measurements between orbital and spin angular momenta in elementary particle physics. The method presented paves the way for similar measurements in other processes.


title: Incorporating Expert Rules into Neural Networks in the Framework of Concept-Based Learning

abstract: A problem of incorporating the expert rules into machine learning models for extending the concept-based learning is formulated in the paper. It is proposed how to combine logical rules and neural networks predicting the concept probabilities. The first idea behind the combination is to form constraints for a joint probability distribution over all combinations of concept values to satisfy the expert rules. The second idea is to represent a feasible set of probability distributions in the form of a convex polytope and to use its vertices or faces. We provide several approaches for solving the stated problem and for training neural networks which guarantee that the output probabilities of concepts would not violate the expert rules. The solution of the problem can be viewed as a way for combining the inductive and deductive learning. Expert rules are used in a broader sense when any logical function that connects concepts and class labels or just concepts with each other can be regarded as a rule. This feature significantly expands the class of the proposed results. Numerical examples illustrate the approaches. The code of proposed algorithms is publicly available.


title: Solitons of the mean curvature flow in $\mathbb{s}^2\times\mathbb{R}$

abstract: A soliton of the mean curvature flow in the product space $\mathbb{s}^2\times\mathbb{R}$ as a surface whose mean curvature $H$ satisfies the equation $H=\langle N,X\rangle$, where $N$ is the unit normal of the surface and $X$ is a Killing vector field. In this paper we consider the vector field tangent to the fibers and the vector field associated to a rotations about an axis of $\mathbb{s}^2$, respectively. We give a classification of the solitons with respect to these vector fields assuming that the surface is invariant under a one-parameter group of vertical translations or under a group of rotations of $\mathbb{s}^2$.


title: The European Commitment to Human-Centered Technology: The Integral Role of HCI in the EU AI Act's Success

abstract: The evolution of AI is set to profoundly reshape the future. The European Union, recognizing this impending prominence, has enacted the AI Act, regulating market access for AI-based systems. A salient feature of the Act is to guard democratic and humanistic values by focusing regulation on transparency, explainability, and the human ability to understand and control AI systems. Hereby, the EU AI Act does not merely specify technological requirements for AI systems. The EU issues a democratic call for human-centered AI systems and, in turn, an interdisciplinary research agenda for human-centered innovation in AI development. Without robust methods to assess AI systems and their effect on individuals and society, the EU AI Act may lead to repeating the mistakes of the General Data Protection Regulation of the EU and to rushed, chaotic, ad-hoc, and ambiguous implementation, causing more confusion than lending guidance. Moreover, determined research activities in Human-AI interaction will be pivotal for both regulatory compliance and the advancement of AI in a manner that is both ethical and effective. Such an approach will ensure that AI development aligns with human values and needs, fostering a technology landscape that is innovative, responsible, and an integral part of our society.


title: On the difficulty of determining Karman 'constants' from DNS

abstract: The difficulty of determining the slope of the famed logarithmic law in the mean velocity profile in wall-bounded turbulent flows, the inverse of the Karman 'constant' $\kappa$, from direct numerical simulations (DNS) is discussed for channel flow. Unusual approaches, as well as the analysis of the standard log-indicator function are considered and analyzed, leading to the conclusion that a definitive determination of the channel flow $\kappa$ from DNS with an uncertainty of, say, 2-3% will require the residue of the mean stream-wise momentum equation in the simulations to be reduced by at least an order of magnitude.


abstract: We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance, $\mathrm{E}(3)$-equivariance on $\mathbb{R}^3$ and Poincar\'e-equivariance on Minkowski spacetime $\mathbb{R}^{1,3}$. Our approach is based on an implicit parametrization of $\mathrm{O}(p,q)$-steerable kernels via Clifford group equivariant neural networks. We significantly and consistently outperform baseline methods on fluid dynamics as well as relativistic electrodynamics forecasting tasks.


title: Lefschetz operators on convex valuations

abstract: We investigate the action of Alesker's Lefschetz operators on translation invariant valuations on convex bodies. For scalar valued valuations, we describe this action on the level of Klain-Schneider functions by a Radon type transform, generalizing a result by Schuster and Wannerer. In the case of rotationally equivariant Minkowski valuations, the Lefschetz operators act on the generating function as a convolution transform. We show that the convolution kernel satisfies a Legendre type differential equation, and thus, is a strictly positive function that is smooth up to one point.


title: A concept of largeness of combinatorially rich sets

abstract: In \cite[Proposition 8.21 Page-169]{F} Using the methods of topological dynamics, H. Furstenberg introduced the notion of central set and proved the famous Central Sets Theorem. Later, in \cite{DHS}, D. De, H. Hindman and D. Struss established a strong Central Sets Theorem, where they introduced the notion of $J$-set. Like $J$-set, in \cite{BG} V. Bergelson and D. Glasscock introduced the notion of combinatorially rich set ( $CR$-set). Let $u,v\in\mathbb{N}$ and $A$ be a $u\times v$ matrix with rational entries. In \cite{HS23}, N. Hindman and D. Strauss established that whenever $B$ is a piecewise syndetic set (resp. $J$-set) in $\mathbb{Z}$, $\left\{ \vec{x}\in\mathbb{Z}^{v}:A\vec{x}\in B^{u}\right\} $ is a piecewise syndetic set ( resp. $J$-set) in $\mathbb{Z}^{v}$. In this article, we prove the same result for $CR$-sets using an equivalent definition of $CR$-set in \cite{HHST} by N. Hindman, H. Hosseini, D. Strauss and M. Tootkaboni.


title: Constraining spherically symmetric metrics by the gap between photon rings

abstract: Gravitational lensing of luminous matter that surrounds a black hole or some other sufficiently compact object produces an infinite sequence of images. Besides the direct (or primary) image, it comprises demagnified and deformed replicas of the original known as photon rings which are progressively nearing the boundary of the socalled shadow. In the present paper, we present analytical approximation formulas for higher-order photon rings for an asymptotically flat, static, spherically symmetric spacetime that admits a photon sphere. We consider a geometrically thin disk of light sources in the equatorial plane and an observer at arbitrary inclination far away from the center. Fixing the emission radius and leveraging the strong deflection limit, which provides an analytical logarithmic approximation for the deflection angle, we find the deformed shape of higher-order photon rings in the form of a polar equation on the observer's screen. It has been suggested by other authors to use the relative size of photon rings for characterizing the underlying spacetime. In particular, the relative separation between two neighboring photon rings, which we call "gap parameter", was considered. We analytically calculate the gap parameter of higher-order photon rings for metrics of the considered class that may depend on multiple parameters. The advantage of using this quantity is in the fact that, to within the assumed approximations, it is independent of the mass of the central object (or of some other characteristic parameter if the mass is zero) and of the distance of the observer. Measurements of the gap parameter, which may become possible in the near future, will restrict the spacetime models that are in agreement with the observations. Even without knowing the inner and outer radii of the shining disk, it will conclusively rule out some metrics. Some examples are provided.


title: The Spectrum of He$^+$ as a Proving Ground for Bohr's Model of the Atom: A Legacy of Williamina Fleming's Astrophysical Discovery

abstract: In 1896, Edward Charles Pickering (1846-1919), Director of the Harvard College Observatory (HCO), reported in a trio of publications the observation of "peculiar spectra" of the southern star $\zeta$ Puppis, which he attributed to an "element not yet found in other stars or on earth." Supported by laboratory spectra obtained by Alfred Fowler (1868-1940), Niels Bohr (1885-1962) showed in 1913 that this "element" was in fact ionized helium, He$^+$. Its spectrum has become known as the Pickering Series, even though Pickering credited Williamina Fleming (1857-1911) for the discovery. Fleming was one of HCO's "computers" and the future Curator of the Astronomical Photographic Glass Plate Collection. The series of spectral lines associated with Pickering's name played a unique role on the path to quantum mechanics by serving as a proving ground for Bohr's model of the atom. Our examination of the discovery of the Pickering series relied on the records held at the Center for Astrophysics $\vert$ Harvard \& Smithsonian (the successor institution to HCO), especially the Notebooks and Diaries of Williamina Fleming and others as well as on the Center's Glass Plate Collection. Glimpses of the "peculiar sociology" of a research institution, half of whose staff were women employed on grossly unequal terms with men, are given in the course of the narrative.


title: How Transformers Learn Causal Structure with Gradient Descent

abstract: The incredible success of transformers on sequence modeling tasks can be largely attributed to the self-attention mechanism, which allows information to be transferred between different parts of a sequence. Self-attention allows transformers to encode causal structure which makes them particularly suitable for sequence modeling. However, the process by which transformers learn such causal structure via gradient-based training algorithms remains poorly understood. To better understand this process, we introduce an in-context learning task that requires learning latent causal structure. We prove that gradient descent on a simplified two-layer transformer learns to solve this task by encoding the latent causal graph in the first attention layer. The key insight of our proof is that the gradient of the attention matrix encodes the mutual information between tokens. As a consequence of the data processing inequality, the largest entries of this gradient correspond to edges in the latent causal graph. As a special case, when the sequences are generated from in-context Markov chains, we prove that transformers learn an induction head (Olsson et al., 2022). We confirm our theoretical findings by showing that transformers trained on our in-context learning task are able to recover a wide variety of causal structures.


title: Grouped approximate control variate estimators

abstract: This paper analyzes the approximate control variate (ACV) approach to multifidelity uncertainty quantification in the case where weighted estimators are combined to form the components of the ACV. The weighted estimators enable one to precisely group models that share input samples to achieve improved variance reduction. We demonstrate that this viewpoint yields a generalized linear estimator that can assign any weight to any sample. This generalization shows that other linear estimators in the literature, particularly the multilevel best linear unbiased estimator (ML-BLUE) of Schaden and Ullman in 2020, becomes a specific version of the ACV estimator of Gorodetsky, Geraci, Jakeman, and Eldred, 2020. Moreover, this connection enables numerous extensions and insights. For example, we empirically show that having non-independent groups can yield better variance reduction compared to the independent groups used by ML-BLUE. Furthermore, we show that such grouped estimators can use arbitrary weighted estimators, not just the simple Monte Carlo estimators used in ML-BLUE. Furthermore, the analysis enables the derivation of ML-BLUE directly from a variance reduction perspective, rather than a regression perspective.


title: Eavesdropping with Intelligent Reflective Surfaces: Near-Optimal Configuration Cycling

abstract: Intelligent reflecting surfaces (IRSs) have several prominent advantages, including improving the level of wireless communication security and privacy. In this work, we focus on the latter aspect and introduce a strategy to counteract the presence of passive eavesdroppers overhearing transmissions from a base station towards legitimate users that are facilitated by the presence of IRSs. Specifically, we envision a transmission scheme that cycles across a number of IRS-to-user assignments, and we select them in a near-optimal fashion, thus guaranteeing both a high data rate and a good secrecy rate. Unlike most of the existing works addressing passive eavesdropping, the strategy we envision has low complexity and is suitable for scenarios where nodes are equipped with a limited number of antennas. Through our performance evaluation, we highlight the trade-off between the legitimate users' data rate and secrecy rate, and how the system parameters affect such a trade-off.


title: Signals of Detailed Balance Violation in Nonequilibrium Stationary States: Subtle, Manifest, and Extraordinary

abstract: The evolution of physical systems are often modeled by simple Markovian processes. When settled into stationary states, the probability distributions of such systems are time independent, by definition. However, they do not necessarily fall within the framework of equilibrium statistical mechanics. Instead, they may be non-equilibrium steady states (NESS). One distinguished feature of NESS is the presence of time reversal asymmetry (TRA) and persistent probability current loops. These loops lead naturally to the notion of probability angular momenta, which play a role on the same footing as the noise covariance in stochastic processes. Illustrating with simulations of simple models and physical data, we present ways to detect these signals of TRA, from the subtle to the prominent.


title: Autonomy Oriented Digital Twins for Real2Sim2Real Autoware Deployment

abstract: Modeling and simulation of autonomous vehicles plays a crucial role in achieving enterprise-scale realization that aligns with technical, business and regulatory requirements. Contemporary trends in digital lifecycle treatment have proven beneficial to support SBD as well as V&V of these complex systems. Although, the development of appropriate fidelity simulation models capable of capturing the intricate real-world physics and graphics (real2sim), while enabling real-time interactivity for decision-making, has remained a challenge. Nevertheless, recent advances in AI-based tools and workflows, such as online deep-learning algorithms leveraging live-streaming data sources, offer the tantalizing potential for real-time system-identification and adaptive modeling to simulate vehicles, environments, as well as their interactions. This transition from virtual prototypes to digital twins not only improves simulation fidelity and real-time factor, but can also support the development of online adaption/augmentation techniques that can help bridge the gap between simulation and reality (sim2real). In such a milieu, this work focuses on developing autonomy-oriented digital twins of vehicles across different scales and configurations to help support the streamlined development and deployment of Autoware stack, using a unified real2sim2real toolchain. Particularly, the core deliverable for this project was to integrate the Autoware stack with AutoDRIVE Ecosystem to demonstrate end-to-end task of map-based autonomous navigation. This work discusses the development of vehicle and environment digital twins using AutoDRIVE Ecosystem, along with various APIs and HMIs to connect with the same, followed by a detailed section on AutoDRIVE-Autoware integration. Furthermore, this study describes the first-ever off-road deployment of the Autoware stack, expanding the ODD beyond on-road autonomous navigation.


title: Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs

abstract: AI alignment in the shape of Reinforcement Learning from Human Feedback (RLHF) is increasingly treated as a crucial ingredient for high performance large language models. Proximal Policy Optimization (PPO) has been positioned by recent literature as the canonical method for the RL part of RLHF. However, it involves both high computational cost and sensitive hyperparameter tuning. We posit that most of the motivational principles that led to the development of PPO are less of a practical concern in RLHF and advocate for a less computationally expensive method that preserves and even increases performance. We revisit the formulation of alignment from human preferences in the context of RL. Keeping simplicity as a guiding principle, we show that many components of PPO are unnecessary in an RLHF context and that far simpler REINFORCE-style optimization variants outperform both PPO and newly proposed "RL-free" methods such as DPO and RAFT. Our work suggests that careful adaptation to LLMs alignment characteristics enables benefiting from online RL optimization at low cost.


title: Zero-Shot Pediatric Tuberculosis Detection in Chest X-Rays using Self-Supervised Learning

abstract: Tuberculosis (TB) remains a significant global health challenge, with pediatric cases posing a major concern. The World Health Organization (WHO) advocates for chest X-rays (CXRs) for TB screening. However, visual interpretation by radiologists can be subjective, time-consuming and prone to error, especially in pediatric TB. Artificial intelligence (AI)-driven computer-aided detection (CAD) tools, especially those utilizing deep learning, show promise in enhancing lung disease detection. However, challenges include data scarcity and lack of generalizability. In this context, we propose a novel self-supervised paradigm leveraging Vision Transformers (ViT) for improved TB detection in CXR, enabling zero-shot pediatric TB detection. We demonstrate improvements in TB detection performance ($\sim$12.7% and $\sim$13.4% top AUC/AUPR gains in adults and children, respectively) when conducting self-supervised pre-training when compared to fully-supervised (i.e., non pre-trained) ViT models, achieving top performances of 0.959 AUC and 0.962 AUPR in adult TB detection, and 0.697 AUC and 0.607 AUPR in zero-shot pediatric TB detection. As a result, this work demonstrates that self-supervised learning on adult CXRs effectively extends to challenging downstream tasks such as pediatric TB detection, where data are scarce.


title: New scattered linearized quadrinomials

abstract: Let $1<t<n$ be integers, where $t$ is a divisor of $n$. An R-$q^t$-partially scattered polynomial is a $\mathbb F_q$-linearized polynomial $f$ in $\mathbb F_{q^n}[X]$ that satisfies the condition that for all $x,y\in\mathbb F_{q^n}^*$ such that $x/y\in\mathbb F_{q^t}$, if $f(x)/x=f(y)/y$, then $x/y\in\mathbb F_q$; $f$ is called scattered if this implication holds for all $x,y\in\mathbb F_{q^n}^*$. Two polynomials in $\mathbb F_{q^n}[X]$ are said to be equivalent if their graphs are in the same orbit under the action of the group $\Gamma L(2,q^n)$. For $n>8$ only three families of scattered polynomials in $\mathbb F_{q^n}[X]$ are known: $(i)$~monomials of pseudoregulus type, $(ii)$~binomials of Lunardon-Polverino type, and $(iii)$~a family of quadrinomials defined in [1,10] and extended in [8,13]. In this paper we prove that the polynomial $\varphi_{m,q^J}=X^{q^{J(t-1)}}+X^{q^{J(2t-1)}}+m(X^{q^J}-X^{q^{J(t+1)}})\in\mathbb F_{q^{2t}}[X]$, $q$ odd, $t\ge3$ is R-$q^t$-partially scattered for every value of $m\in\mathbb F_{q^t}^*$ and $J$ coprime with $2t$. Moreover, for every $t>4$ and $q>5$ there exist values of $m$ for which $\varphi_{m,q}$ is scattered and new with respect to the polynomials mentioned in $(i)$, $(ii)$ and $(iii)$ above. The related linear sets are of $\Gamma L$-class at least two.


title: Dependency Annotation of Ottoman Turkish with Multilingual BERT

abstract: This study introduces a pretrained large language model-based annotation methodology for the first dependency treebank in Ottoman Turkish. Our experimental results show that, iteratively, i) pseudo-annotating data using a multilingual BERT-based parsing model, ii) manually correcting the pseudo-annotations, and iii) fine-tuning the parsing model with the corrected annotations, we speed up and simplify the challenging dependency annotation process. The resulting treebank, that will be a part of the Universal Dependencies (UD) project, will facilitate automated analysis of Ottoman Turkish documents, unlocking the linguistic richness embedded in this historical heritage.


title: Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation

abstract: This paper introduces a novel approach using Large Language Models (LLMs) integrated into an agent framework for flexible and effective personal mobility generation. LLMs overcome the limitations of previous models by effectively processing semantic data and offering versatility in modeling various tasks. Our approach addresses three research questions: aligning LLMs with real-world urban mobility data, developing reliable activity generation strategies, and exploring LLM applications in urban mobility. The key technical contribution is a novel LLM agent framework that accounts for individual activity patterns and motivations, including a self-consistency approach to align LLMs with real-world activity data and a retrieval-augmented strategy for interpretable activity generation. We evaluate our LLM agent framework and compare it with state-of-the-art personal mobility generation approaches, demonstrating the effectiveness of our approach and its potential applications in urban mobility. Overall, this study marks the pioneering work of designing an LLM agent framework for activity generation based on real-world human activity data, offering a promising tool for urban mobility analysis.


title: Epimorphisms between finitely generated algebras

abstract: A quasivariety has the weak ES property when the epimorphisms between its finitely generated members are surjective. A characterization of quasivarieties with the weak ES property is obtained and a method for detecting failures of this property in quasivarieties with a near unanimity term and in congruence permutable varieties is given. It is also shown that under reasonable assumptions the weak ES property implies arithmeticity. In particular, every filtral variety with the weak ES property is a discriminator variety.


title: Scaling Efficient LLMs

abstract: Trained LLMs are typically sparse in that most of the parameters are zero, raising questions on efficiency. In response, we inquire into efficient LLMs, i.e. those with the fewest parameters that achieve the desired accuracy on a training corpus. Specifically, we compare theoretical and empirical estimates for training loss at current scale to obtain upper and lower bounds on the number of unique sequences in a natural training corpus as a function of its size. Our result implies (1) to double the number of skills represented in a training corpus, the corpus must scale roughly between three and five fold (2) for efficient LLMs, the number of parameters $N$ and the size $D$ of a natural training corpus scale as $N \sim D^{0.58}$ (3) if the number of parameters of an LLM is smaller than the number of unique sequences in the training corpus, scaling up can uncover emergent skills.


title: Inequality indices for heterogeneous systems: a tool for failure prediction

abstract: We have numerically studied a mean-field fiber bundle model of fracture at a non-zero temperature and acted by a constant external tensile stress. The individual fibers fail (local damage) due to creep-like dynamics that lead up to a catastrophic breakdown (global failure). We quantify the variations in sizes of the resulting avalanches by calculating the Lorenz function and two inequality indices -- Gini ($g$) and Kolkata ($k$) indices -- derived from the Lorenz function. We show that the two indices cross just prior to the failure point when the dynamics goes through intermittent avalanches. For a continuous failure dynamics (finite numbers of fibers breaking at each time step), the crossing does not happen. However, in that phase, the usual prediction method i.e., linear relation between the time of minimum strain-rate and failure time, holds. The boundary between continuous and intermittent dynamics is very close to the boundary between crossing and non-crossing of the two indices in the temperature-stress phase space.


title: TMD factorisation for diffractive jets in photon-nucleus interactions

abstract: Using the colour dipole picture and the colour glass condensate effective theory, we study the diffractive production of two or three jets via coherent photon-nucleus interactions at high energy. We consider the hard regime where the photon virtuality and/or the transverse momenta of the produced jets are much larger than the saturation momentum $Q_s$ of the nuclear target. We show that, despite this hardness, the leading-twist contributions are controlled by relatively large parton configurations, with transverse sizes $R\sim 1/Q_s$, which undergo strong scattering and probe gluon saturation. For exclusive dijets, this implies that both final jets have semi-hard transverse momenta ($P_\perp\sim Q_s$) and that one of them is aligned with the photon. The dominant contributions to the diffractive production of hard dijets ($P_\perp\gg Q_s$) rather come from three-jet final states, which are very asymmetric and will be referred to as 2+1 jets: two of the jets are hard, while the third one is semi-hard. We demonstrate that the leading-twist contributions to both exclusive dijets and the diffractive production of 2+1 jets admit transverse-momentum dependent (TMD) factorisation, in terms of quark and gluon diffractive TMD distribution functions, for which we obtain explicit expressions from first principles. We show that the contribution of 2+1 jets to diffractive SIDIS (semi-inclusive deep inelastic scattering) takes the form of one step in the DGLAP evolution of the quark diffractive PDF.


title: Catani's generalization of collinear factorization breaking

abstract: We consider the most general form of soft and collinear factorization for hard-scattering amplitudes to all orders in perturbative Quantum Chromodynamics. Specifically, we present the generalization of collinear factorization to configurations with several collinear directions, where the most singular behaviour is encoded by generalized collinear splitting amplitudes that manifestly embed the breaking of strict collinear factorization in space-like collinear configurations. We also extend the analysis to the simultaneous soft-collinear factorization with multiple collinear directions and show how na\"{\i}ve multiplicative factorization do not hold.


title: Testing Spacecraft Formation Flying with Crazyflie Drones as Satellite Surrogates

abstract: As the space domain becomes increasingly congested, autonomy is proposed as one approach to enable small numbers of human ground operators to manage large constellations of satellites and tackle more complex missions such as on-orbit or in-space servicing, assembly, and manufacturing. One of the biggest challenges in developing novel spacecraft autonomy is mechanisms to test and evaluate their performance. Testing spacecraft autonomy on-orbit can be high risk and prohibitively expensive. An alternative method is to test autonomy terrestrially using satellite surrogates such as attitude test beds on air bearings or drones for translational motion visualization. Against this background, this work develops an approach to evaluate autonomous spacecraft behavior using a surrogate platform, namely a micro-quadcopter drone developed by the Bitcraze team, the Crazyflie 2.1. The Crazyflie drones are increasingly becoming ubiquitous in flight testing labs because they are affordable, open source, readily available, and include expansion decks which allow for features such as positioning systems, distance and/or motion sensors, wireless charging, and AI capabilities. In this paper, models of Crazyflie drones are used to simulate the relative motion dynamics of spacecraft under linearized Clohessy-Wiltshire dynamics in elliptical natural motion trajectories, in pre-generated docking trajectories, and via trajectories output by neural network control systems.


title: On the communication complexity of finding a king in a tournament

abstract: A tournament is a complete directed graph. A king in a tournament is a vertex v such that every other vertex is reachable from v via a path of length at most 2. It is well known that every tournament has at least one king, one of which is a maximum out-degree vertex. The tasks of finding a king, a maximum out-degree vertex and a source in a tournament has been relatively well studied in the context of query complexity. We study the communication complexity of these tasks, where the edges are partitioned between two players. The following are our main results for n-vertex tournaments: 1) The deterministic communication complexity of finding whether a source exists is tilde{Theta}(log^2 n). 2) The deterministic and randomized communication complexities of finding a king are Theta(n). The quantum communication complexity is tilde{Theta}(sqrt{n}). 3) The deterministic, randomized and quantum communication complexities of finding a maximum out-degree vertex are Theta(n log n), tilde{Theta}(n) and tilde{Theta}(sqrt{n}), respectively. Our upper bounds hold for all partitions of edges, and the lower bounds for a specific partition of the edges. To show the first bullet above, we show, perhaps surprisingly, that finding a source in a tournament is equivalent to the well-studied Clique vs. Independent Set (CIS) problem on undirected graphs. Our bounds for finding a source then follow from known bounds on the complexity of the CIS problem. In view of this equivalence, we can view the task of finding a king in a tournament to be a natural generalization of CIS. One of our lower bounds uses a fooling-set based argument, and all our other lower bounds follow from carefully-constructed reductions from Set-Disjointness.


title: Limitations and Separations in the Quantum Sum-of-squares, and the Quantum Knapsack Problem

abstract: We answer two questions regarding the sum-of-squares for the SYK model left open in Ref. 1, both of which are related to graphs. First (a "limitation"), we show that a fragment of the sum-of-squares, in which one considers commutation relations of degree-$4$ Majorana operators but does not impose any other relations on them, does not give the correct order of magnitude bound on the ground state energy. Second (a "separation"), we show that the graph invariant $\Psi(G)$ defined in Ref. 1 may be strictly larger than the independence number $\alpha(G)$. The invariant $\Psi(G)$ is a bound on the norm of a Hamiltonian whose terms obey commutation relations determined by the graph $G$, and it was shown that $\alpha(G)\leq \Psi(G) \leq \vartheta(G)$, where $\vartheta(\cdot)$ is the Lovasz theta function. We briefly discuss the case of $q\neq 4$ in the SYK model. Separately, we define a problem that we call the quantum knapsack problem.


title: Prompting a Pretrained Transformer Can Be a Universal Approximator

abstract: Despite the widespread adoption of prompting, prompt tuning and prefix-tuning of transformer models, our theoretical understanding of these fine-tuning methods remains limited. A key question is whether one can arbitrarily modify the behavior of pretrained model by prompting or prefix-tuning it. Formally, whether prompting and prefix-tuning a pretrained model can universally approximate sequence-to-sequence functions. This paper answers in the affirmative and demonstrates that much smaller pretrained models than previously thought can be universal approximators when prefixed. In fact, the attention mechanism is uniquely suited for universal approximation with prefix-tuning a single attention head being sufficient to approximate any continuous function. Moreover, any sequence-to-sequence function can be approximated by prefixing a transformer with depth linear in the sequence length. Beyond these density-type results, we also offer Jackson-type bounds on the length of the prefix needed to approximate a function to a desired precision.


title: Towards homological projective duality for $\mathrm{Gr}(2, 2n)$

abstract: Consider a Grassmannian $\mathrm{Gr}(2, V)$ for an even-dimensional vector space $V$. Its derived category of coherent sheaves has a Lefschetz exceptional collection with respect to the Pl\"ucker embedding. We consider a variety $X_1$ of pairs consisting of a degenerate $2$-form on $V$ and a line in its kernel. Note that $X_1$ is generically a $\mathbb{P}^1$-fibration over the Pfaffian variety of degenerate $2$-forms on $V$. We construct an exceptional collection of coherent sheaves on $X_1$ such that the subcategory of $D^b_{\mathrm{coh}}(X_1)$ generated by that collection is conjecturally equivalent to the homologically projectively dual category of the Grassmannian.


title: Entanglement Detection by Approximate Entanglement Witnesses

abstract: The problem of determining whether a given quantum state is separable is known to be computationally difficult. We develop an approach to this problem based on approximations of convex polytopes in high dimensions. By showing that a convex polytope constructed from a polynomial number of hyperplanes approximates the Euclidean ball arbitrarily well in high dimensions, we find evidence that a polynomial-sized set of approximate entanglement witnesses is potentially sufficient to determine the entanglement of a state with high probability.


title: A study guide for the $\ell^2$ decoupling theorem for the paraboloid

abstract: This article serves as a study guide for the $\ell^2$ decoupling theorem for the paraboloid originally proved by Bourgain and Demeter. Given its popularity and importance, many expositions about the $\ell^2$ decoupling theorem already exist. Our study guide is intended to complement and combine these existing resources in order to provide a more gentle introduction to the subject.


title: SHM-Traffic: DRL and Transfer learning based UAV Control for Structural Health Monitoring of Bridges with Traffic

abstract: This work focuses on using advanced techniques for structural health monitoring (SHM) for bridges with Traffic. We propose an approach using deep reinforcement learning (DRL)-based control for Unmanned Aerial Vehicle (UAV). Our approach conducts a concrete bridge deck survey while traffic is ongoing and detects cracks. The UAV performs the crack detection, and the location of cracks is initially unknown. We use two edge detection techniques. First, we use canny edge detection for crack detection. We also use a Convolutional Neural Network (CNN) for crack detection and compare it with canny edge detection. Transfer learning is applied using CNN with pre-trained weights obtained from a crack image dataset. This enables the model to adapt and improve its performance in identifying and localizing cracks. Proximal Policy Optimization (PPO) is applied for UAV control and bridge surveys. The experimentation across various scenarios is performed to evaluate the performance of the proposed methodology. Key metrics such as task completion time and reward convergence are observed to gauge the effectiveness of the approach. We observe that the Canny edge detector offers up to 40\% lower task completion time, while the CNN excels in up to 12\% better damage detection and 1.8 times better rewards.


title: Batch and match: black-box variational inference with a score-based divergence

abstract: Most leading implementations of black-box variational inference (BBVI) are based on optimizing a stochastic evidence lower bound (ELBO). But such approaches to BBVI often converge slowly due to the high variance of their gradient estimates and their sensitivity to hyperparameters. In this work, we propose batch and match (BaM), an alternative approach to BBVI based on a score-based divergence. Notably, this score-based divergence can be optimized by a closed-form proximal update for Gaussian variational families with full covariance matrices. We analyze the convergence of BaM when the target distribution is Gaussian, and we prove that in the limit of infinite batch size the variational parameter updates converge exponentially quickly to the target mean and covariance. We also evaluate the performance of BaM on Gaussian and non-Gaussian target distributions that arise from posterior inference in hierarchical and deep generative models. In these experiments, we find that BaM typically converges in fewer (and sometimes significantly fewer) gradient evaluations than leading implementations of BBVI based on ELBO maximization.


title: Generalising realisability in statistical learning theory under epistemic uncertainty

abstract: The purpose of this paper is to look into how central notions in statistical learning theory, such as realisability, generalise under the assumption that train and test distribution are issued from the same credal set, i.e., a convex set of probability distributions. This can be considered as a first step towards a more general treatment of statistical learning under epistemic uncertainty.


title: Generalizing Reward Modeling for Out-of-Distribution Preference Learning

abstract: Preference learning (PL) with large language models (LLMs) aims to align the LLMs' generations with human preferences. Previous work on reinforcement learning from human feedback (RLHF) has demonstrated promising results in in-distribution PL. However, due to the difficulty of obtaining human feedback, discretely training reward models for every encountered distribution is challenging. Thus, out-of-distribution (OOD) PL is practically useful for enhancing the generalization ability of LLMs with limited preference feedback. This work addresses OOD PL by optimizing a general reward model through a meta-learning approach. During meta-training, a bilevel optimization algorithm is utilized to learn a reward model capable of guiding policy learning to align with human preferences across various distributions. When encountering a test distribution, the meta-test procedure conducts regularized policy optimization using the learned reward model for PL. We theoretically demonstrate the convergence rate of the bilevel optimization algorithm under reasonable assumptions. Additionally, we conduct experiments on two text generation tasks across 20 held-out domains and outperform a variety of strong baselines across various evaluation metrics.


title: Summing the "exactly one 42" and similar subsums of the harmonic series

abstract: For $b>1$ and $\alpha\beta$ a string of two digits in base $b$, let $K_1$ be the subsum of the harmonic series with only those integers having exactly one occurrence of $\alpha\beta$. We obtain a theoretical representation of such $K_1$ series which, say for $b=10$, allows computing them all to thousands of digits. This is based on certain specific measures on the unit interval and the use of their Stieltjes transforms at negative integers. Integral identities of a combinatorial nature both explain the relation to the $K_1$ sums and lead to recurrence formulas for the measure moments allowing in the end the straightforward numerical implementation.


title: MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues

abstract: The advent of Large Language Models (LLMs) has drastically enhanced dialogue systems. However, comprehensively evaluating the dialogue abilities of LLMs remains a challenge. Previous benchmarks have primarily focused on single-turn dialogues or provided coarse-grained and incomplete assessments of multi-turn dialogues, overlooking the complexity and fine-grained nuances of real-life dialogues. To address this issue, we introduce MT-Bench-101, specifically designed to evaluate the fine-grained abilities of LLMs in multi-turn dialogues. By conducting a detailed analysis of real multi-turn dialogue data, we construct a three-tier hierarchical ability taxonomy comprising 4208 turns across 1388 multi-turn dialogues in 13 distinct tasks. We then evaluate 21 popular LLMs based on MT-Bench-101, conducting comprehensive analyses from both ability and task perspectives and observing differing trends in LLMs performance across dialogue turns within various tasks. Further analysis indicates that neither utilizing common alignment techniques nor chat-specific designs has led to obvious enhancements in the multi-turn abilities of LLMs. Extensive case studies suggest that our designed tasks accurately assess the corresponding multi-turn abilities. The data and code are available at \url{https://github.com/mtbench101/mt-bench-101}.


title: Functional Spatial Autoregressive Models

abstract: This study introduces a novel spatial autoregressive model in which the dependent variable is a function that may exhibit functional autocorrelation with the outcome functions of nearby units. This model can be characterized as a simultaneous integral equation system, which, in general, does not necessarily have a unique solution. For this issue, we provide a simple condition on the magnitude of the spatial interaction to ensure the uniqueness in data realization. For estimation, to account for the endogeneity caused by the spatial interaction, we propose a regularized two-stage least squares estimator based on a basis approximation for the functional parameter. The asymptotic properties of the estimator including the consistency and asymptotic normality are investigated under certain conditions. Additionally, we propose a simple Wald-type test for detecting the presence of spatial effects. As an empirical illustration, we apply the proposed model and method to analyze age distributions in Japanese cities.


title: A Combinatorial Central Limit Theorem for Stratified Randomization

abstract: This paper establishes a combinatorial central limit theorem for stratified randomization, which holds under a Lindeberg-type condition. The theorem allows for an arbitrary number or sizes of strata, with the sole requirement being that each stratum contains at least two units. This flexibility accommodates both a growing number of large and small strata simultaneously, while imposing minimal conditions. We then apply this result to derive the asymptotic distributions of two test statistics proposed for instrumental variables settings in the presence of potentially many strata of unrestricted sizes.


title: Proposed real-time charge noise measurement via valley state reflectometry

abstract: We theoretically propose a method to perform in situ measurements of charge noise during logical operations in silicon quantum dot spin qubits. Our method does not require ancillary spectator qubits but makes use of the valley degree of freedom in silicon. Sharp interface steps or alloy disorder in the well provide a valley transition dipole element that couples to the field of an on-chip microwave resonator, allowing rapid reflectometry of valley splitting fluctuations caused by charge noise. We derive analytic expressions for the signal-to-noise ratio that can be expected and use tight binding simulations to extract the key parameters (valley splitting and valley dipole elements) under realistic disorder. We find that unity signal-to-noise ratio can often be obtained with measurement times below 1ms, faster than typical decoherence times, opening the potential for closed-loop control, real-time recalibration, and feedforward circuits


title: Environment Semantic Communication: Enabling Distributed Sensing Aided Networks

abstract: Millimeter-wave (mmWave) and terahertz (THz) communication systems require large antenna arrays and use narrow directive beams to ensure sufficient receive signal power. However, selecting the optimal beams for these large antenna arrays incurs a significant beam training overhead, making it challenging to support applications involving high mobility. In recent years, machine learning (ML) solutions have shown promising results in reducing the beam training overhead by utilizing various sensing modalities such as GPS position and RGB images. However, the existing approaches are mainly limited to scenarios with only a single object of interest present in the wireless environment and focus only on co-located sensing, where all the sensors are installed at the communication terminal. This brings key challenges such as the limited sensing coverage compared to the coverage of the communication system and the difficulty in handling non-line-of-sight scenarios. To overcome these limitations, our paper proposes the deployment of multiple distributed sensing nodes, each equipped with an RGB camera. These nodes focus on extracting environmental semantics from the captured RGB images. The semantic data, rather than the raw images, are then transmitted to the basestation. This strategy significantly alleviates the overhead associated with the data storage and transmission of the raw images. Furthermore, semantic communication enhances the system's adaptability and responsiveness to dynamic environments, allowing for prioritization and transmission of contextually relevant information. Experimental results on the DeepSense 6G dataset demonstrate the effectiveness of the proposed solution in reducing the sensing data transmission overhead while accurately predicting the optimal beams in realistic communication environments.


title: DualFocus: Integrating Macro and Micro Perspectives in Multi-modal Large Language Models

abstract: We present DualFocus, a novel framework for integrating macro and micro perspectives within multi-modal large language models (MLLMs) to enhance vision-language task performance. Current MLLMs typically singularly focus on inputs at a predefined resolution, resulting in deficiencies in detailed questions involving local regions. We introduced a DualFocus mechanism where the model concentrates on the image from a macro perspective, responses to the question, and identifies suitable sub-regions to zoom in for subsequent micro perspective analysis. Via the integration of answers from both macro and micro perspectives, the model is adept at addressing tasks that encompass global, detailed, and combined considerations. To endows the DualFocus mechanism in MLLMs, we curated a tailored dataset derived from the Visual Genome (VG) and adapted it to align with the training regimen of DualFocus. Through comparative studies across different model sizes and benchmarks, we demonstrate DualFocus's superiority in balancing detailed examination with holistic insight, significantly reducing hallucination instances in MLLMs and improving their performance in various vision-language tasks.


title: Using Hybrid System Dynamics and Discrete Event Simulations to Identify High Leverage Targets for Process Improvement in a Skill-based Organizational Structure

abstract: This paper is based on a case study of an IT organization in a large, US-based healthcare provider, and develops simluation models to identify areas for performance improvement. These organizations are often grouped into departments by technical skill and support both operational work (tickets) and project work (tasks) of various priorities. From a practical standpoint, resource managers and staff regularly manage all work as queued and assign / complete it based on the priorities of the day. Using project and operational metrics from the case study organization, the hybrid model using both system dynamics and discrete event simulation developed through this research depicts the flow of work through a skill-based team as well as many of the key factors that influence that workflow, both positive and negative. Experience indicates that the interaction between project and operational work -- as well as between teams with differing skills -- entangles work queues and wait times within those queues in a way that rapidly scales in complexity as the number of interacting individuals and teams increases. Results from model simulation bear out this intuition. Scaling the models to accommodate multiple teams is a topic of future research.


title: Generalized eikonal identities for charged currents

abstract: We discuss QED radiative corrections to contact operators coupling two heavy fields and one light field. New eikonal identities are derived in the static limit that demonstrate the equivalence of a class of ladder graphs to an equivalent theory with a single heavy-light vertex and a background Coulomb field which communicates exclusively with the light field. We apply these new identities to nuclear beta decays and demonstrates that the "independent particle model" used by Jaus, Rasche, Sirlin \& Zucchini is closely related, though not identical, to a model independent EFT calculation.


title: A numerical study of rigidity of hyperbolic splittings in simple two-dimensional maps

abstract: Chaotic hyperbolic dynamical systems enjoy a surprising degree of rigidity, a fact which is well known in the mathematics community but perhaps less so in theoretical physics circles. Low-dimensional hyperbolic systems are either conjugate to linear automorphisms, that is, dynamically equivalent to the Arnold cat map and its variants, or their hyperbolic structure is not smooth. We illustrate this dichotomy using a family of analytic maps, for which we show by means of numerical simulations that the corresponding hyperbolic structure is not smooth, thereby providing an example for a global mechanism which produces non-smooth phase space structures in an otherwise smooth dynamical system.


title: A Lehmer-Type Lower Bound for the Canonical Height on Elliptic Curves Over Function Fields

abstract: Let $\mathbb{F}$ be the function field of a curve over an algebraically closed field with $\operatorname{char}(\mathbb{F})\ne2,3$, and let $E/\mathbb{F}$ be an elliptic curve. Then for all finite extensions $\mathbb{K}/\mathbb{F}$ and all non-torsion points $P\in{E(\mathbb{K})}$, the $\mathbb{F}$-normalized canonical height of $P$ is bounded below by \[ \hat{h}_E(P) \ge \frac{1}{10500\cdot h_{\mathbb{F}}(j_E)^{2}\cdot [\mathbb{K}:\mathbb{F}]^{2}}. \]


title: The Banach-Tarski paradox for some subsets of finite-dimensional normed spaces over non-Archimedean valued fields

abstract: We show some results related to the classical Banach-Tarski paradox in the setting of finite-dimensional normed spaces over a non-Archimedean valued field $K$. For instance, all balls and spheres in $K^n$, and the whole space $K^n$ (for $n\ge 2$) are paradoxical with respect to certain groups of isometries of $K^n$. If $K$ is locally compact (e.g., $K$ is the field $\mathbb{Q}_p$ of $p$-adic numbers for any prime number $p$), any two bounded subsets of $K^n$ with nonempty interiors are equidecomposable (and paradoxical) with respect to a certain group of isometries of $K^n$ (for $n\ge 2$).


title: On universality for the kinetic wave equation

abstract: On compact Riemannian manifolds with chaotic geometries, specifically those exhibiting the random wave model conjectured by Berry, we derive heuristically a homogeneous kinetic wave equation that is universal for all such manifolds.

categories: math.AP cond-mat.stat-mech math-ph math.MP