title: Never Miss A Beat: An Efficient Recipe for Context Window Extension of Large Language Models with Consistent "Middle" Enhancement

abstract: Recently, many methods have been developed to extend the context length of pre-trained large language models (LLMs), but they often require fine-tuning at the target length ($\gg4K$) and struggle to effectively utilize information from the middle part of the context. To address these issues, we propose $\textbf{C}$ontinuity-$\textbf{R}$elativity ind$\textbf{E}$xing with g$\textbf{A}$ussian $\textbf{M}$iddle (CREAM), which interpolates positional encodings by manipulating position indices. Apart from being simple, CREAM is training-efficient: it only requires fine-tuning at the pre-trained context window (eg, Llama 2-4K) and can extend LLMs to a much longer target context length (eg, 256K). To ensure that the model focuses more on the information in the middle, we introduce a truncated Gaussian to encourage sampling from the middle part of the context during fine-tuning, thus alleviating the ``Lost-in-the-Middle'' problem faced by long-context LLMs. Experimental results show that CREAM successfully extends LLMs to the target length for both Base and Chat versions of $\texttt{Llama2-7B}$ with ``Never Miss A Beat''. Our code will be publicly available soon.


title: Increased accuracy and signal-to-noise ratio through recent improvements in Infra-Red Video Bolometer fabrication and calibration

abstract: The Infra-Red Video Bolometer (IRVB) is a diagnostic equipped with an infra-red camera that measures the total radiated power in thousands of LOSs within a large field of view (FOV). Recently validated in MAST-U, it offers a high spatial resolution map of the radiated power in the divertor region, where large gradients are expected. The IRVB's sensing element comprises a thin layer of high Z absorbing material, typically Platinum, usually coated with Carbon to reduce reflections. It is here explored the possibility of using a relatively inert material like Titanium, that can be produced in layers up to 1mum compared to 2.5mum for Pt, and then coat it with Pt of the desired thickness (0.3mum per side here) and Carbon. This leads to a higher temperature signal (2 to 3 times), and better spatial resolution (about 4 times), resulting in higher accuracy in the measured power. This assembly is also expected to improve foil uniformity, as the Pt layer is obtained via deposition rather than mechanical processes. Given its multi-material composition, measuring the thermal properties of the foil assembly is vital. Various methods using a calibrated laser as a heat source have been developed, analysing the temperature profile shape or fitting the calculated laser power for different intensities and frequencies. It is here presented a simpler approach, that relies on analysing the separate components of the foil heat equation for a single laser exposure in a given area. This can then be iterated over the entire foil to capture local deviations.


title: Constraints on Lorentz invariance violation from the extraordinary Mrk 421 flare of 2014 using a novel analysis method

abstract: The Lorentz Invariance Violation (LIV), a proposed consequence of certain quantum gravity (QG) scenarios, could instigate an energy-dependent group velocity for ultra-relativistic particles. This energy dependence, although suppressed by the massive QG energy scale $E_\mathrm{QG}$, expected to be on the level of the Planck energy $1.22 \times 10^{19}$ GeV, is potentially detectable in astrophysical observations. In this scenario, the cosmological distances traversed by photons act as an amplifier for this effect. By leveraging the observation of a remarkable flare from the blazar Mrk\,421, recorded at energies above 100 GeV by the MAGIC telescopes on the night of April 25 to 26, 2014, we look for time delays scaling linearly and quadratically with the photon energies. Using for the first time in LIV studies a binned-likelihood approach we set constraints on the QG energy scale. For the linear scenario, we set $95\%$ lower limits $E_\mathrm{QG}>2.7\times10^{17}$ GeV for the subluminal case and $E_\mathrm{QG}> 3.6 \times10^{17}$ GeV for the superluminal case. For the quadratic scenario, the $95\%$ lower limits for the subluminal and superluminal cases are $E_\mathrm{QG}>2.6 \times10^{10}$ GeV and $E_\mathrm{QG}>2.5\times10^{10}$ GeV, respectively.


title: Identifiable Object-Centric Representation Learning via Probabilistic Slot Attention

abstract: Learning modular object-centric representations is crucial for systematic generalization. Existing methods show promising object-binding capabilities empirically, but theoretical identifiability guarantees remain relatively underdeveloped. Understanding when object-centric representations can theoretically be identified is crucial for scaling slot-based methods to high-dimensional images with correctness guarantees. To that end, we propose a probabilistic slot-attention algorithm that imposes an aggregate mixture prior over object-centric slot representations, thereby providing slot identifiability guarantees without supervision, up to an equivalence relation. We provide empirical verification of our theoretical identifiability result using both simple 2-dimensional data and high-resolution imaging datasets.


title: Local Time Statistics and Permeable Barrier Crossing: from Poisson to Birth-Death Diffusion Equations

abstract: Barrier crossing is a widespread phenomenon across natural and engineering systems. While an abundant cross-disciplinary literature on the topic has emerged over the years, the stochastic underpinnings of the process are yet to be fully understood. We fill this knowledge gap by considering a diffusing particle and presenting a stochastic definition of Brownian motion in the presence of a permeable barrier. This definition relies on reflected Brownian motion and on the crossing events being Poisson processes subordinated by the local time of the underlying motion at the barrier. Within this paradigm we derive the exact expression for the distribution of the number of crossings, and find an experimentally measurable statistical definition of permeability. We employ Feynman-Kac theory to derive and solve a set of governing birth-death diffusion equations and extend them to when barrier permeability is asymmetric. As an application we study a system of infinite, identical and periodically placed asymmetric barriers for which we derive analytically effective transport parameters. This periodic arrangement induces an effective drift at long times whose magnitude depends on the difference in the permeability on either side of the barrier as well as on their absolute values. As the asymmetric permeabilities act akin to localised ``ratchet'' potentials that break spatial symmetry and detailed balance, the proposed arrangement of asymmetric barriers provides an example of a noise-induced drift without the need to time-modulate any external force or create temporal correlations on the motion of a diffusing particle.


title: From many-body ab initio to effective excitonic models: a versatile mapping approach including environmental embedding effects

abstract: We present an original multi-state projective diabatization scheme based on the Green's function formalism that allows the systematic mapping of many-body ab initio calculations onto effective excitonic models. This method inherits the ability of the Bethe-Salpeter equation to describe Frenkel molecular excitons and intermolecular charge-transfer states equally well, as well as the possibility for an effective description of environmental effects in a QM/MM framework. The latter is found to be a crucial element in order to obtain accurate model parameters for condensed phases and to ensure their transferability to excitonic models for extended systems. The method is presented through a series of examples illustrating its quality, robustness, and internal consistency.


title: Ion Energy Tuning for Enhanced sp3 Carbon Fraction in Electron Cyclotron Resonance Ion Beam Deposited Diamond-Like Carbon Coatings: a Computational and Experimental Approach

abstract: A novel high-energy electron cyclotron resonance (ECR) ion beam deposition (IBD) technique was used to fabricate DLC films at different ion beam energies. The ratios of sp2/sp3 bonding in the DLC coatings were determined by Raman spectroscopy and XPS, with the confirmation of being hydrogen-free due to the lack of photoluminescence (PL) background in the Raman spectra. The results indicate that the sp3 percentage ranges from 45% - 85% for the ECR-IBD fabricated DLC films in this study. Monte-Carlo based SRIM simulation was used to extract the energy and angular distribution of the sputtered particles from the carbon target and correlate it to the highest sp3 fraction in the manufactured ECR-IBD DLCs. This study demonstrates a method of depositing DLC thin films under ambient conditions (room temperature with no post-annealing or additional bias voltage applied) which produces high-sp3 coatings (higher than those traditionally reported for other sputtering methods) suitable for applications where high quality DLC coatings are required.


title: Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Models

abstract: In large deep neural networks that seem to perform surprisingly well on many tasks, we also observe a few failures related to accuracy, social biases, and alignment with human values, among others. Therefore, before deploying these models, it is crucial to characterize this failure landscape for engineers to debug and legislative bodies to audit models. Nevertheless, it is infeasible to exhaustively test for all possible combinations of factors that could lead to a model's failure. In this paper, we introduce a post-hoc method that utilizes \emph{deep reinforcement learning} to explore and construct the landscape of failure modes in pre-trained discriminative and generative models. With the aid of limited human feedback, we then demonstrate how to restructure the failure landscape to be more desirable by moving away from the discovered failure modes. We empirically show the effectiveness of the proposed method across common Computer Vision, Natural Language Processing, and Vision-Language tasks.


title: Benchmarking and Boosting Radiology Report Generation for 3D High-Resolution Medical Images

abstract: Automatic radiology report generation can significantly benefit the labor-intensive process of report writing by radiologists, especially for 3D radiographs like CT scans, which are crucial for broad clinical diagnostics yet underexplored compared to 2D radiographs. Existing methods often handle 3D volumes either slice-wise or with aggressive downsampling due to current GPU memory limitations, which results in a loss of the inherent 3D nature and critical details. To overcome these issues, we introduce a novel framework that efficiently and effectively generates radiology reports for high-resolution (HR) 3D volumes, based on large language models (LLMs). Specifically, our framework utilizes low-resolution (LR) visual tokens as queries to mine information from HR tokens, preserving detailed HR information while reducing computational costs by only processing HR informed LR visual queries. Further benefiting the field, we curate and release BIMCV-RG, a new dataset with 5,328 HR 3D volumes and paired reports, establishing the first benchmarks for report generation from 3D HR medical images. Our method consistently surpasses existing methods on this benchmark across three different settings: normal-resolution, high-resolution inputs, and zero-shot domain transfer, all at an acceptable computational cost, trainable on a single A100-80G.


title: Wearable Device-Based Physiological Signal Monitoring: An Assessment Study of Cognitive Load Across Tasks

abstract: This study employs cutting-edge wearable monitoring technology to conduct high-precision, high-temporal-resolution cognitive load assessment on EEG data from the FP1 channel and heart rate variability (HRV) data of secondary vocational students(SVS). By jointly analyzing these two critical physiological indicators, the research delves into their application value in assessing cognitive load among SVS students and their utility across various tasks. The study designed two experiments to validate the efficacy of the proposed approach: Initially, a random forest classification model, developed using the N-BACK task, enabled the precise decoding of physiological signal characteristics in SVS students under different levels of cognitive load, achieving a classification accuracy of 97%. Subsequently, this classification model was applied in a cross-task experiment involving the National Computer Rank Examination, demonstrating the method's significant applicability and cross-task transferability in diverse learning contexts. Conducted with high portability, this research holds substantial theoretical and practical significance for optimizing teaching resource allocation in secondary vocational education, as well as for cognitive load assessment methods and monitoring. Currently, the research findings are undergoing trial implementation in the school.


title: Astrocytic NMDA Receptors Modulate the Dynamics of Continuous Attractors

abstract: Neuronal networking supports complex brain functions, with neurotransmitters facilitating communication through chemical synapses. The release probability of neurotransmitters varies and is influenced by pre-synaptic neuronal activity. Recent findings suggest that blocking astrocytic N-Methyl-D-Aspartate (NMDA) receptors reduces this variation. However, the theoretical implications of this reduction on neuronal dynamics have not been thoroughly investigated. Utilizing continuous attractor neural network (CANN) models with short-term synaptic depression (STD), we explore the effects of reduced release probability variation. Our results show that blocking astrocytic NMDA receptors stabilizes attractor states and diminishes their mobility. These insights enhance our understanding of NMDA receptors' role in astrocytes and their broader impact on neural computation and memory, with potential implications for neurological conditions involving NMDA receptor antagonists.


title: From Policy to Practice: The Cost of Europe's Green Hydrogen Ambitions

abstract: The European Commission's new definition of green hydrogen provides clear guidelines and legal certainty for producers and consumers. However, the strict criteria for electrolysis production, requiring additionality, temporal correlation, and geographical correlation, could increase hydrogen costs, affecting its competitiveness as an energy carrier. This study examines the impact of these European regulations using a stochastic capacity expansion model for the European energy market up to 2048. We analyze how these requirements influence costs and investment decisions. Our results show that green hydrogen production requirements will raise system costs by 82 Euro billion from 2024 to 2048, driven mainly by a rapid transition from fossil fuels to renewable energy. The additionality requirement, which mandates the use of new renewable energy installations for electrolysis, emerges as the most expensive to comply with but also the most effective in accelerating the transition to renewable power, particularly before 2030.


title: Partial yet definite emergence of the Kardar-Parisi-Zhang class in isotropic spin chains

abstract: Integrable spin chains with a continuous non-Abelian symmetry, such as the one-dimensional isotropic Heisenberg model, show superdiffusive transport with little theoretical understanding. Although recent studies reported a surprising connection to the Kardar-Parisi-Zhang (KPZ) universality class in that case, this view was most recently questioned by discrepancies in full counting statistics. Here, by combining extensive numerical simulations of the Landau-Lifshitz one-dimensional magnet, with a framework developed by exact studies of the KPZ class, we characterize various two-point quantities that remain hitherto unexplored in spin chains, and find full agreement with KPZ scaling laws. This establishes the partial emergence of the KPZ class in isotropic spin chains. Moreover, we reveal that the KPZ scaling laws are intact in the presence of an energy current, under the appropriate Galilean boost required by the propagation of spacetime correlation.


title: EEG-ImageNet: An Electroencephalogram Dataset and Benchmarks with Image Visual Stimuli of Multi-Granularity Labels

abstract: Identifying and reconstructing what we see from brain activity gives us a special insight into investigating how the biological visual system represents the world. While recent efforts have achieved high-performance image classification and high-quality image reconstruction from brain signals collected by Functional Magnetic Resonance Imaging (fMRI) or magnetoencephalogram (MEG), the expensiveness and bulkiness of these devices make relevant applications difficult to generalize to practical applications. On the other hand, Electroencephalography (EEG), despite its advantages of ease of use, cost-efficiency, high temporal resolution, and non-invasive nature, has not been fully explored in relevant studies due to the lack of comprehensive datasets. To address this gap, we introduce EEG-ImageNet, a novel EEG dataset comprising recordings from 16 subjects exposed to 4000 images selected from the ImageNet dataset. EEG-ImageNet consists of 5 times EEG-image pairs larger than existing similar EEG benchmarks. EEG-ImageNet is collected with image stimuli of multi-granularity labels, i.e., 40 images with coarse-grained labels and 40 with fine-grained labels. Based on it, we establish benchmarks for object classification and image reconstruction. Experiments with several commonly used models show that the best models can achieve object classification with accuracy around 60% and image reconstruction with two-way identification around 64%. These results demonstrate the dataset's potential to advance EEG-based visual brain-computer interfaces, understand the visual perception of biological systems, and provide potential applications in improving machine visual models.


title: High-performance in-vacuum optical system for quantum optics experiments in a Penning-trap

abstract: Accurate measurements with implications in many branches in Physics have been accessed using Penning traps and conventional techniques within a temperature regime where each eigenmotion of a charged particle is still a classical harmonic oscillator. Cooling the particle directly or indirectly with lasers allows reaching the quantum regime of each oscillator, controlling subtle effects in the precision frontier by detecting photons instead of electric current. In this paper, we present a new in-vacuum optical system designed to detecting 397-nm fluorescence photons from individual calcium ions and Coulomb crystals in a 7-T Penning trap. Based on the outcome of computer simulations, our design shows diffraction-limited performance. The system has been characterized using a single laser-cooled ion as a point-like source, reaching a final resolution of 3.69(3) $\mu$m and 2.75(3) $\mu$m for the trap's axial and radial directions, respectively, after correcting aberrations.


title: EEG classification for visual brain decoding with spatio-temporal and transformer based paradigms

abstract: In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is based on a CNN-BiLSTM model. The other involves a CNN-Transformer architecture which inherently involves the more versatile attention based learning paradigm. In both cases, a special 1D-CNN feature extraction module is used to generate the initial embeddings with 1D convolutions in the time and the EEG channel domains. Considering the EEG signals are noisy, non stationary and the discriminative features are even less clear (than in semantically structured data such as text or image), we also follow a window-based classification followed by majority voting during inference, to yield labels at a signal level. To illustrate how brain patterns correlate with different image classes, we visualize t-SNE plots of the BiLSTM embeddings alongside brain activation maps for the top 10 classes. These visualizations provide insightful revelations into the distinct neural signatures associated with each visual category, showcasing the BiLSTM's capability to capture and represent the discriminative brain activity linked to visual stimuli. We demonstrate the performance of our approach on the updated EEG-Imagenet dataset with positive comparisons with state-of-the-art methods.


title: A portrait of the rotation of Ultra-Cool Dwarfs revealed by TESS

abstract: This study presents the results of a search for rotation signature in 250 Gaia DR3 Ultra-Cool Dwarfs (UCDs) with TESS light curves. We identified 71 targets with unambiguous periodicities, of which 61 present rotation signatures and a single source behavior, with periods between 0.133 and 5.81 days. Five UCDs show double-dip features, namely variations with two periods, one approximately double or half the other. The remaining ten UCDs with unambiguous variability present a likely non-single behavior. We also found 20 UCDs showing complex behavior in their light curves, with noticeable fluctuations and irregular structure, with a few exhibiting apparent changes in their temporal structure. The remaining 159 targets show noisy light curves corresponding to low-amplitude signals, whose temporal variation cannot be easily identified. The distribution of the UCDs with rotation signature in the CMD diagram points to a lack of rotating objects within about $11.5<M_{G}<12.5$ and $G-G_{RP}<1.5$ separating them into two regimes, one mainly composed of less massive late-M stars with $P_{rot} \geq 1.0$ d, and another mainly composed of more massive early-M stars with $P_{rot}<1.0$ d. It is important to emphasize that by separating stars into age intervals, one observes that UCDs with $P_{rot} \geq 1.0$ d tend to be located in regions of younger objects, and, in contrast, those with $P_{rot}<1.0$ d are mainly concentrated in regions of older objects. Whether these trends of stars contrasting the sample separation is physical or produced by observational biases is a question to be verified in future studies.


title: Scaling Large-Language-Model-based Multi-Agent Collaboration

abstract: Pioneering advancements in large language model-powered agents have underscored the design pattern of multi-agent collaboration, demonstrating that collective intelligence can surpass the capabilities of each individual. Inspired by the neural scaling law, which posits that increasing neurons leads to emergent abilities, this study investigates whether a similar principle applies to increasing agents in multi-agent collaboration. Technically, we propose multi-agent collaboration networks (MacNet), which utilize directed acyclic graphs to organize agents and streamline their interactive reasoning via topological ordering, with solutions derived from their dialogues. Extensive experiments show that MacNet consistently outperforms baseline models, enabling effective agent collaboration across various network topologies and supporting cooperation among more than a thousand agents. Notably, we observed a small-world collaboration phenomenon, where topologies resembling small-world properties achieved superior performance. Additionally, we identified a collaborative scaling law, indicating that normalized solution quality follows a logistic growth pattern as scaling agents, with collaborative emergence occurring much earlier than previously observed instances of neural emergence. The code and data will be available at https://github.com/OpenBMB/ChatDev.


title: Four-qubit photonic system for publicly verifiable quantum random numbers and generation of public and private key

abstract: We theoretically propose and experimentally demonstrate the use of a configurable four-qubit photonic system to generate a publicly verifiable quantum random numbers, to perform entanglement verification, and to generate a secure public and private key. Quantum circuits, to generate the desired four-qubit states and its experimental realization in the photonic architecture is carried out using photon pairs entangled in polarization and path degree of freedom. By performing measurements on the four-qubit system and accessing partial information of the four-qubit state for public verification, we generate publicly verified and purely secured random bits at the rate of 370 kbps. When the system is used for generating public and private keys, an equal number of public and private keys are generated simultaneously. We also record about 97.9\% of sampled bits from four-qubit states passing entanglement verification. The theoretical model of noise on the four-qubit state and its effect on the generation rate of verified and secured bits are in perfect agreement with the experimental results. This demonstrates the practical use of the small-scale multi-qubit photonic system for quantum-safe applications by providing the option for real-time verification of the security feature of the quantum system.


title: Machine learning potential for the Cu-W system

abstract: Combining the excellent thermal and electrical properties of Cu with the high abrasion resistance and thermal stability of W, Cu-W nanoparticle-reinforced metal matrix composites and nano-multilayers (NMLs) are finding applications as brazing fillers and shielding material for plasma and radiation. Due to the large lattice mismatch between fcc Cu and bcc W, these systems have complex interfaces that are beyond the scales suitable for ab initio methods, thus motivating the development of chemically accurate interatomic potentials. Here, a neural network potential (NNP) for Cu-W is developed within the Behler-Parrinello framework using a curated training dataset that captures metallurgically-relevant local atomic environments. The Cu-W NNP accurately predicts (i) the metallurgical properties (elasticity, stacking faults, dislocations, thermodynamic behavior) in elemental Cu and W, (ii) energies and structures of Cu-W intermetallics and solid solutions, and (iii) a range of fcc Cu/bcc W interfaces, and exhibits physically-reasonable behavior for solid W/liquid Cu systems. As will be demonstrated in forthcoming work, this near-ab initio-accurate NNP can be applied to understand complex phenomena involving interface-driven processes and properties in Cu-W composites.


title: Quantum repeaters based on stationary Gottesman-Kitaev-Preskill qubits

abstract: Quantum repeaters that incorporate quantum error correction codes have been shown to be a promising alternative compared with the original quantum repeaters that rely upon probabilistic quantum error detection depending on classical communication over remote repeater stations. A particularly efficient way of encoding qubits into an error correction code is through bosonic codes where even a single oscillator mode serves as a sufficiently large, physical system. Here we consider the bosonic Gottesman-Kitaev-Preskill (GKP) code as a natural choice for a loss-correction-based quantum repeater. However, unlike existing treatments, we focus on the excitation loss that occurs in the local, stationary memory qubits as represented by, for instance, collective atomic spin modes. We analyze and assess the performance of such a GKP-based quantum repeater where, apart from the initial state generations and distributions, all operations can be performed via deterministic linear mode transformations, as opposed to other existing memory-based quantum repeater schemes.


title: Eigenstate plateau transition and equilibration in 1D quantum lattice models

abstract: We report on a remarkable spectral phenomenon in a generic type of quantum lattice gas model. As the interaction strength increases, eigenstates spontaneously reorganize and lead to plateaus of the interaction energy, with gaps opening akin to continuous phase transitions. Perturbation theory identifies a hidden structure underlying eigenstates within each plateau, resulting in a statistical shift in the wavefunction amplitudes described by extreme value theory. The structured eigenstates manifest themselves naturally in far-from-equilibrium dynamics proceeding through multiple universal stages. Our findings reveal a profound connection between emergent properties in high-energy states and out-of-equilibrium dynamics, providing insights into the impact of interactions across the entire energy spectrum. The results are directly relevant to experiments probing equilibration in quantum spin and lattice gases.


title: Deep Learning-Based Approach for User Activity Detection with Grant-Free Random Access in Cell-Free Massive MIMO

abstract: Modern wireless networks must reliably support a wide array of connectivity demands, encompassing various user needs across diverse scenarios. Machine-Type Communication (mMTC) is pivotal in these networks, particularly given the challenges posed by massive connectivity and sporadic device activation patterns. Traditional grant-based random access (GB-RA) protocols face limitations due to constrained orthogonal preamble resources. In response, the adoption of grant-free random access (GF-RA) protocols offers a promising solution. This paper explores the application of supervised machine learning models to tackle activity detection issues in scenarios where non-orthogonal preamble design is considered. We introduce a data-driven algorithm specifically designed for user activity detection in Cell-Free Massive Multiple-Input Multiple-Output (CF-mMIMO) networks operating under GF-RA protocols. Additionally, this study presents a novel clustering strategy that simplifies and enhances activity detection accuracy, assesses the resilience of the algorithm to input perturbations, and investigates the effects of adopting floating-to-fixed-point conversion on algorithm performance. Simulations conducted adhere to 3GPP standards, ensuring accurate channel modeling, and employ a deep learning approach to boost the detection capabilities of mMTC GF-RA devices. The results are compelling: the algorithm achieves an exceptional 99\% accuracy rate, confirming its efficacy in real-world applications.


title: ACCO: Automated Causal CNN Scheduling Optimizer for Real-Time Edge Accelerators

abstract: Spatio-Temporal Convolutional Neural Networks (ST-CNN) allow extending CNN capabilities from image processing to consecutive temporal-pattern recognition. Generally, state-of-the-art (SotA) ST-CNNs inflate the feature maps and weights from well-known CNN backbones to represent the additional time dimension. However, edge computing applications would suffer tremendously from such large computation or memory overhead. Fortunately, the overlapping nature of ST-CNN enables various optimizations, such as the dilated causal convolution structure and Depth-First (DF) layer fusion to reuse the computation between time steps and CNN sliding windows, respectively. Yet, no hardware-aware approach has been proposed that jointly explores the optimal strategy from a scheduling as well as a hardware point of view. To this end, we present ACCO, an automated optimizer that explores efficient Causal CNN transformation and DF scheduling for ST-CNNs on edge hardware accelerators. By cost-modeling the computation and data movement on the accelerator architecture, ACCO automatically selects the best scheduling strategy for the given hardware-algorithm target. Compared to the fixed dilated causal structure, ST-CNNs with ACCO reach an ~8.4x better Energy-Delay-Product. Meanwhile, ACCO improves ~20% in layer-fusion optimals compared to the SotA DF exploration toolchain. When jointly optimizing ST-CNN on the temporal and spatial dimension, ACCO's scheduling outcomes are on average 19x faster and 37x more energy-efficient than spatial DF schemes.


title: EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark

abstract: Speech emotion recognition (SER) is an important part of human-computer interaction, receiving extensive attention from both industry and academia. However, the current research field of SER has long suffered from the following problems: 1) There are few reasonable and universal splits of the datasets, making comparing different models and methods difficult. 2) No commonly used benchmark covers numerous corpus and languages for researchers to refer to, making reproduction a burden. In this paper, we propose EmoBox, an out-of-the-box multilingual multi-corpus speech emotion recognition toolkit, along with a benchmark for both intra-corpus and cross-corpus settings. For intra-corpus settings, we carefully designed the data partitioning for different datasets. For cross-corpus settings, we employ a foundation SER model, emotion2vec, to mitigate annotation errors and obtain a test set that is fully balanced in speakers and emotions distributions. Based on EmoBox, we present the intra-corpus SER results of 10 pre-trained speech models on 32 emotion datasets with 14 languages, and the cross-corpus SER results on 4 datasets with the fully balanced test sets. To the best of our knowledge, this is the largest SER benchmark, across language scopes and quantity scales. We hope that our toolkit and benchmark can facilitate the research of SER in the community.


title: FaceGPT: Self-supervised Learning to Chat about 3D Human Faces

abstract: We introduce FaceGPT, a self-supervised learning framework for Large Vision-Language Models (VLMs) to reason about 3D human faces from images and text. Typical 3D face reconstruction methods are specialized algorithms that lack semantic reasoning capabilities. FaceGPT overcomes this limitation by embedding the parameters of a 3D morphable face model (3DMM) into the token space of a VLM, enabling the generation of 3D faces from both textual and visual inputs. FaceGPT is trained in a self-supervised manner as a model-based autoencoder from in-the-wild images. In particular, the hidden state of LLM is projected into 3DMM parameters and subsequently rendered as 2D face image to guide the self-supervised learning process via image-based reconstruction. Without relying on expensive 3D annotations of human faces, FaceGPT obtains a detailed understanding about 3D human faces, while preserving the capacity to understand general user instructions. Our experiments demonstrate that FaceGPT not only achieves high-quality 3D face reconstructions but also retains the ability for general-purpose visual instruction following. Furthermore, FaceGPT learns fully self-supervised to generate 3D faces based on complex textual inputs, which opens a new direction in human face analysis.


title: Collective dynamics of active dumbbells near a circular obstacle

abstract: In this article, we present the collective dynamics of active dumbbells in the presence of a static circular obstacle using Brownian dynamics simulation. The active dumbbells aggregate on the surface of a circular obstacle beyond a critical radius. The aggregation is non-uniform along the circumference, and the aggregate size increases with the activity and the curvature radius. The dense aggregate of active dumbbells displays persistent rotational motion with a certain angular speed, which linearly increases with the activity. Further, we show the strong polar ordering of the active dumbbells within the aggregate. The polar ordering exhibits a long-range correlation, with the correlation length corresponding to the aggregate size. Additionally, we show that the residence time of an active dumbbell on the obstacle surface grows rapidly with area fraction due to many-body interactions that lead to a slowdown of the rotational diffusion. The article further considers the dynamical behavior of a tracer particle in the solution of active dumbbells. Interestingly, the speed of the passive tracer particle displays a crossover from monotonically decreasing to increasing with the tracer particle's size upon increasing the dumbbells' speed. Furthermore, the effective diffusion of the tracer particle displays the non-monotonic behavior with area fraction; the initial increase of the diffusivity is followed by a decrease for larger area fraction.


title: Realizing RF Wavefront Copying with RIS for Future Extended Reality Applications

abstract: Lately a new approach to Extended Reality (XR), denoted as XR-RF, has been proposed which is realized by combining Radio Frequency (RF) Imaging and programmable wireless environments (PWEs). RF Imaging is a technique that aims to detect geometric and material features of an object through RF waves. On the other hand, the PWE focuses on the the conversion of the wireless RF propagation in a controllable, by software, entity through the utilization of Reconfigurable Intelligent Surfaces (RISs), which can have a controllable interaction with impinging RF waves. In that sense, this dynamic synergy leverages the potential of RF Imaging to detect the structure of an object through RF wavefronts and the PWE's ability to selectively replicate those RF wavefronts from one spatial location to wherever an XR-RF mobile user is presently located. Then the captured wavefront, through appropriate hardware, is mapped to the visual representation of the object through machine learning models. As a key aspect of the XR-RF's system workflow is the wavefront copying mechanism, this work introduces a new PWE configuration algorithm for XR-RF. Moreover, it is shown that the waveform replication process inevitably yields imprecision in the replication process. After statistical analysis, based on simulation results, it is shown that this imprecision can be effectively modeled by the gamma distribution.


title: Ultrametric-preserving functions as monoid endomorphisms

abstract: Let $\mathbb{R}^{+}=[0, \infty)$ and let $\mathbf{End}_{\mathbb{R}^+}$ be the set of all endomorphisms of the monoid $(\mathbb{R}^+, \vee)$. The set $\mathbf{End}_{\mathbb{R}^+}$ is a monoid with respect to the operation of the function composition $g \circ f$. It is shown that $g : \mathbb{R}^+ \to \mathbb{R}^+$ is pseudoultrametric-preserving iff $g \in \mathbf{End}_{\mathbb{R}^+}$. In particular, a function $f : \mathbb{R}^+ \to \mathbb{R}^+$ is ultrametrics-preserving iff it is an endomorphism of $(\mathbb{R}^+,\vee)$ with kernel consisting only the zero point. We prove that a given $\mathbf{A} \subseteq \mathbf{End}_{\mathbb{R}^+}$ is a submonoid of $(\mathbf{End}, \circ)$ iff there is a class $\mathbf{X}$ of pseudoultrametric spaces such that $\mathbf{A}$ coincides with the set of all functions which preserve the spaces from $\mathbf{X}$. An explicit construction of such $\mathbf{X}$ is given.


title: On the pathwise uniqueness of stochastic 2D Euler equations with Kraichnan noise and $L^p$-data

abstract: In the recent work [arXiv:2308.03216], Coghi and Maurelli proved pathwise uniqueness of solutions to the vorticity form of stochastic 2D Euler equation, with Kraichnan transport noise and initial data in $L^1\cap L^p$ for $p>3/2$. The aim of this note is to remove the constraint on $p$, showing that pathwise uniqueness holds for all $L^1\cap L^p$ initial data with arbitrary $p>1$.


title: Teaching Language Models to Self-Improve by Learning from Language Feedback

abstract: Aligning Large Language Models (LLMs) with human intentions and values is crucial yet challenging. Current methods primarily rely on human preferences, which are costly and insufficient in capturing nuanced feedback expressed in natural language. In this paper, we present Self-Refinement Tuning (SRT), a method that leverages model feedback for alignment, thereby reducing reliance on human annotations. SRT uses a base language model (e.g., Tulu2) to generate initial responses, which are critiqued and refined by a more advanced model (e.g., GPT-4-Turbo). This process enables the base model to self-evaluate and improve its outputs, facilitating continuous learning. SRT further optimizes the model by learning from its self-generated feedback and refinements, creating a feedback loop that promotes model improvement. Our empirical evaluations demonstrate that SRT significantly outperforms strong baselines across diverse tasks and model sizes. When applied to a 70B parameter model, SRT increases the win rate from 9.6\% to 25.8\% on the AlpacaEval 2.0 benchmark, surpassing well-established systems such as GPT-4-0314, Claude 2, and Gemini. Our analysis highlights the crucial role of language feedback in the success of SRT, suggesting potential for further exploration in this direction.


title: RecMoDiffuse: Recurrent Flow Diffusion for Human Motion Generation

abstract: Human motion generation has paramount importance in computer animation. It is a challenging generative temporal modelling task due to the vast possibilities of human motion, high human sensitivity to motion coherence and the difficulty of accurately generating fine-grained motions. Recently, diffusion methods have been proposed for human motion generation due to their high sample quality and expressiveness. However, generated sequences still suffer from motion incoherence, and are limited to short duration, and simpler motion and take considerable time during inference. To address these limitations, we propose \textit{RecMoDiffuse: Recurrent Flow Diffusion}, a new recurrent diffusion formulation for temporal modelling. Unlike previous work, which applies diffusion to the whole sequence without any temporal dependency, an approach that inherently makes temporal consistency hard to achieve. Our method explicitly enforces temporal constraints with the means of normalizing flow models in the diffusion process and thereby extends diffusion to the temporal dimension. We demonstrate the effectiveness of RecMoDiffuse in the temporal modelling of human motion. Our experiments show that RecMoDiffuse achieves comparable results with state-of-the-art methods while generating coherent motion sequences and reducing the computational overhead in the inference stage.


title: VoxNeuS: Enhancing Voxel-Based Neural Surface Reconstruction via Gradient Interpolation

abstract: Neural Surface Reconstruction learns a Signed Distance Field~(SDF) to reconstruct the 3D model from multi-view images. Previous works adopt voxel-based explicit representation to improve efficiency. However, they ignored the gradient instability of interpolation in the voxel grid, leading to degradation on convergence and smoothness. Besides, previous works entangled the optimization of geometry and radiance, which leads to the deformation of geometry to explain radiance, causing artifacts when reconstructing textured planes. In this work, we reveal that the instability of gradient comes from its discontinuity during trilinear interpolation, and propose to use the interpolated gradient instead of the original analytical gradient to eliminate the discontinuity. Based on gradient interpolation, we propose VoxNeuS, a lightweight surface reconstruction method for computational and memory efficient neural surface reconstruction. Thanks to the explicit representation, the gradient of regularization terms, i.e. Eikonal and curvature loss, are directly solved, avoiding computation and memory-access overhead. Further, VoxNeuS adopts a geometry-radiance disentangled architecture to handle the geometry deformation from radiance optimization. The experimental results show that VoxNeuS achieves better reconstruction quality than previous works. The entire training process takes 15 minutes and less than 3 GB of memory on a single 2080ti GPU.


title: Enhancing Membrane-Based Scanning Force Microscopy Through an Optical Cavity

abstract: The new generation of strained silicon nitride resonators harbors great promise for scanning force microscopy, especially when combined with the extensive toolbox of cavity optomechanics. However, accessing a mechanical resonator inside an optical cavity with a scanning tip is challenging. Here, we experimentally demonstrate a cavity-based scanning force microscope based on a silicon nitride membrane sensor. We overcome geometric constraints by making use of the extended nature of the mechanical resonator normal modes, which allows us to spatially separate the scanning and readout sites of the membrane. Our microscope is geared towards low-temperature applications in the zeptonewton regime, such as nanoscale nuclear spin detection and imaging.


title: Pushing an Altermagnet to the Ultimate 2D Limit: Evidence of Symmetry Breaking in Monolayers of GdAlSi

abstract: Altermagnets have emerged as a class of materials combining certain ferromagnetic properties with zero net magnetization. This combination is highly promising for spintronics, especially if a material can be brought to a nanoscale size. However, experimental studies of the 2D limit of altermagnets and evolution of their properties with thickness are lacking. Here, we study epitaxial films on silicon of the Weyl altermagnet GdAlSi ranging from more than a hundred unit cells to a single unit cell. The films are synthesized by molecular beam epitaxy and, expectedly, do not show any discernible net magnetic moments. Electron transport studies reveal a remarkable transformation of the electron state with the film thickness. Thick films exhibit negative longitudinal magnetoresistance associated with the chiral anomaly but do not demonstrate altermagnetic properties in electron transport due to symmetry restrictions. In ultrathin films, a spontaneous anomalous Hall effect manifests itself, indicating a non-relativistic spin splitting in the electronic structure. The transformation is associated with crystal symmetry breaking accompanying the 3D-to-2D crossover. The work highlights the role of dimensionality in altermagnetism and provides a platform for studies of altermagnets aiming at ultra-compact spintronics.


title: Large deviation principle for generalized multiple intersection local times of multidimensional Brownian motion

abstract: In this paper we consider examples of positive generalized Wiener functions and we establish a large deviation principle for the generalized multiple intersection local time of the multidimensional Brownian motion.


title: ULog: Unsupervised Log Parsing with Large Language Models through Log Contrastive Units

abstract: Log parsing serves as an essential prerequisite for various log analysis tasks. Recent advancements in this field have improved parsing accuracy by leveraging the semantics in logs through fine-tuning large language models (LLMs) or learning from in-context demonstrations. However, these methods heavily depend on labeled examples to achieve optimal performance. In practice, collecting sufficient labeled data is challenging due to the large scale and continuous evolution of logs, leading to performance degradation of existing log parsers after deployment. To address this issue, we propose ULog, an unsupervised LLM-based method for efficient and off-the-shelf log parsing. Our key insight is that while LLMs may struggle with direct log parsing, their performance can be significantly enhanced through comparative analysis across multiple logs that differ only in their parameter parts. We refer to such groups of logs as Log Contrastive Units (LCUs). Given the vast volume of logs, obtaining LCUs is difficult. Therefore, ULog introduces a hybrid ranking scheme to effectively search for LCUs by jointly considering the commonality and variability among logs. Additionally, ULog crafts a novel parsing prompt for LLMs to identify contrastive patterns and extract meaningful log structures from LCUs. Experiments on large-scale public datasets demonstrate that ULog significantly outperforms state-of-the-art log parsers in terms of accuracy and efficiency, providing an effective and scalable solution for real-world deployment.


title: Phase Diagram of growth modes in Graphene Growth on Cooper by Vapor Deposition

abstract: Understanding the atomistic mechanism in graphene growth is crucial for controlling the number of layers or domain sizes to meet practical needs. In this work, focusing on the growth of graphene by chemical vapor deposition on copper substrates, the surface kinetics in the growth are systematically investigated by first-principles calculations. The phase diagram, predicting whether the growth mode is monolayer graphene or bilayer graphene under various experimental conditions, is constructed based on classical nucleation theory. Our phase diagram well illustrates the effect of high hydrogen pressure on bilayer graphene growth and clarifies the mechanism of the most widely used experimental growth approaches. The phase diagram can provide guidance and predictions for experiments and inspires the study of other two-dimensional materials with graphene-like growth mechanisms.


title: RAD: A Comprehensive Dataset for Benchmarking the Robustness of Image Anomaly Detection

abstract: Robustness against noisy imaging is crucial for practical image anomaly detection systems. This study introduces a Robust Anomaly Detection (RAD) dataset with free views, uneven illuminations, and blurry collections to systematically evaluate the robustness of current anomaly detection methods. Specifically, RAD aims to identify foreign objects on working platforms as anomalies. The collection process incorporates various sources of imaging noise, such as viewpoint changes, uneven illuminations, and blurry collections, to replicate real-world inspection scenarios. Subsequently, we assess and analyze 11 state-of-the-art unsupervised and zero-shot methods on RAD. Our findings indicate that: 1) Variations in viewpoint, illumination, and blurring affect anomaly detection methods to varying degrees; 2) Methods relying on memory banks and assisted by synthetic anomalies demonstrate stronger robustness; 3) Effectively leveraging the general knowledge of foundational models is a promising avenue for enhancing the robustness of anomaly detection methods.


title: TernaryLLM: Ternarized Large Language Model

abstract: Large language models (LLMs) have achieved remarkable performance on Natural Language Processing (NLP) tasks, but they are hindered by high computational costs and memory requirements. Ternarization, an extreme form of quantization, offers a solution by reducing memory usage and enabling energy-efficient floating-point additions. However, applying ternarization to LLMs faces challenges stemming from outliers in both weights and activations. In this work, observing asymmetric outliers and non-zero means in weights, we introduce Dual Learnable Ternarization (DLT), which enables both scales and shifts to be learnable. We also propose Outlier-Friendly Feature Knowledge Distillation (OFF) to recover the information lost in extremely low-bit quantization. The proposed OFF can incorporate semantic information and is insensitive to outliers. At the core of OFF is maximizing the mutual information between features in ternarized and floating-point models using cosine similarity. Extensive experiments demonstrate that our TernaryLLM surpasses previous low-bit quantization methods on the standard text generation and zero-shot benchmarks for different LLM families. Specifically, for one of the most powerful open-source models, LLaMA-3, our approach (W1.58A16) outperforms the previous state-of-the-art method (W2A16) by 5.8 in terms of perplexity on C4 and by 8.2% in terms of average accuracy on zero-shot tasks.


title: Gelfand--Phillips type properties of locally convex spaces

abstract: Let $1\leq p\leq q\leq\infty.$ Being motivated by the classical notions of the Gelfand--Phillips property and the (coarse) Gelfand--Phillips property of order $p$ of Banach spaces, we introduce and study different types of the Gelfand--Phillips property of order $(p,q)$ (the $GP_{(p,q)}$ property) and the coarse Gelfand--Phillips property of order $p$ in the realm of all locally convex spaces. We compare these classes and show that they are stable under taking direct product, direct sums and closed subspaces. It is shown that any locally convex space is a quotient space of a locally convex space with the $GP_{(p,q)}$ property. Characterizations of locally convex spaces with the introduced Gelfand--Phillips type properties are given.


title: Comparative Analysis of $k$-essence and Quintessence Scalar Field Models: A Data Analysis Approach

abstract: We perform a comparative analysis of quintessence and $k$-essence scalar field models in the data analysis perspective. We study the quintessence field with an exponential potential and the $k$-essence field with an inverse square potential in the present work. Before delving into data analysis, we provide a brief perspective on dynamical evolution on both of the models and obtain the stability constraints on the model parameters. We adopt Bayesian inference procedure to estimate the model parameters that best-fit the data. A comprehensive analysis utilizing Observational Hubble data (OHD) and Pantheon+ compilation of Type Ia supernovae (SNIa) shows that $k$-essence model fits the data slightly better than the quintessence model while the evidence of these models in comparison with the $\Lambda$CDM model is weak. The value of the Hubble constant predicted by both the models is in close agreement with the value obtained by the Planck2018 collaboration assuming the $\Lambda$CDM model.

categories: astro-ph.CO gr-qc hep-ph physics.data-an


title: Detailed chemical abundances of the globular cluster Terzan 6 in the inner bulge

abstract: We used near-infrared spectroscopy at medium-high resolution (R=8,000$-$25,000) to perform the first comprehensive chemical study of the intermediate luminosity bulge globular cluster Terzan~6. We derived detailed abundances and abundance patterns of 27 giant stars, likely members of Terzan~6, based on their accurate Hubble Space Telescope proper motions and line-of-sight radial velocities. From the spectral analysis of these stars, we determined an average heliocentric radial velocity of 143.3$\pm$1.0 km s$^{-1}$ with a velocity dispersion of 5.1$\pm$0.7 km s$^{-1}$ and an average [Fe/H]=$-0.65\pm0.01$ and a low 1$\sigma$ dispersion of 0.03 dex. We also measured some depletion of [Mn/Fe] with respect to the solar-scaled values and enhancement of for [Ca/Fe], [Si/Fe], [Mg/Fe], [Ti/Fe], [O/Fe], [Al/Fe], [Na/Fe], and, to a lower extent, for [K/Fe], consistent with previous measurements of other bulge globular clusters and favoring the scenario of a rapid bulge formation and chemical enrichment. Some spread in the light element abundances suggest the presence of first- and second-generation stars, typical of genuine globulars. Finally, we measured some depletion of carbon and low $\rm ^{12}C/^{13}C$ isotopic ratios, as in previous studies of field and cluster bulge giants, indicating that extra-mixing mechanisms should be at work during the post main sequence evolution in the high metallicity regime as well.


title: Well-posedness and stability for the two-phase periodic quasistationary Stokes flow

abstract: The two-phase horizontally periodic quasistationary Stokes flow in $\mathbb{R}^2$, describing the motion of two immiscible fluids with equal viscosities that are separated by a sharp interface, which is parameterized as the graph of a function $f=f(t)$, is considered in the general case when both gravity and surface tension effects are included. Using potential theory, the moving boundary problem is formulated as a fully nonlinear and nonlocal parabolic problem for the function $f$. Based on abstract parabolic theory, it is proven that the problem is well-posed in all subcritical spaces $\mathrm{H}^r(\mathbb{S})$, $r\in(3/2,2)$. Moreover, the stability properties of the flat equilibria are analyzed in dependence on the physical properties of the fluids.


title: Modelling formation of stationary periodic patterns in growing population of motile bacteria

abstract: Biological pattern formation is one of the most intriguing phenomena in nature. Simplest examples of such patterns are represented by travelling waves and stationary periodic patterns which occur during various biological processes including morphogenesis and population dynamics. Formation of these patterns in populations of motile microorganisms such as Dictyostelium discoideum and E. coli have been shown in a number of experimental studies. Conditions for formation of various types of patterns are commonly addressed in mathematical studies of dynamical systems containing diffusive and advection terms. In this work, we do mathematical study of spatio-temporal patterns forming in growing population of chemotactically active bacteria. In particular, we perform linear analysis to find conditions for formation of stationary periodic patterns, and nonlinear (Fourier) analysis to find characteristics, such as amplitude and wavelength, of these patterns. We verify our analytical results by means of numerical simulations.


title: Constructions of $A_\alpha$-cospectral graphs using some corona operations

abstract: Let $ G_1 \circledast G_2$,$ G_1 \sqcupdot G_2 $ and $ G_1 \sqcupplus G_2$ denote the total corona, $Q$-vertex corona and $Q$-edge corona of two graphs $ G_1$ and $ G_2 $, respectively. In this paper, we compute the $A_\alpha$-spectrum of $ G_1 \circledast G_2$,$ G_1 \sqcupdot G_2 $ and $ G_1 \sqcupplus G_2$ for regular graphs $ G_1$ and $ G_2$. As an application, we construct infinitely many pairs of $A_\alpha$-cospectral graphs.


title: Bilevel optimization with sustainability perspective: a survey on applications

abstract: Bilevel optimization, a well-established field for modeling hierarchical decision-making problems, has recently intersected with sustainability studies and practices, resulting in a series of works focusing on bilevel optimization problems involving multiple decision makers with diverse economic, environmental, and social objectives. This survey offers a comprehensive overview of sustainable bilevel optimization applications. First, we introduce the main concepts related to the nature of bilevel optimization problems and present some typical mathematical formulations for bilevel pricing problems that cover the majority of the collected applications. Then, we review the most relevant works published in sustainable bilevel optimization, giving a classification based on the application domains and their association with well-known operations research problems, while briefly discussing the proposed solution methodologies. We survey applications on transportation and logistics, production planning and manufacturing, water, waste, and agriculture management, supply chains, and disaster prevention and response. Finally, we outline a list of open questions and opportunities for future research in this domain.


title: A Well-Balanced Method for an Unstaggered Central Scheme, the two-space Dimensional Case

abstract: We develop a second-order accurate central scheme for the two-dimensional hyperbolic system of in-homogeneous conservation laws. The main idea behind the scheme is that we combine the well-balanced deviation method with the Kurganov-Tadmor (KT) scheme. The approach satisfies the well-balanced property and retains the advantages of KT scheme: Riemann-solver-free and the avoidance of oversampling on the regions between Riemann-fans. The scheme is implemented and applied to a number of numerical experiments for the Euler equations with gravitational source term and the results are non-oscillatory. Based on the same idea, we construct a semi-discrete scheme where we combine the above two methods and illustrate the maximum principle.


title: Information Aggregation with Costly Information Acquisition

abstract: We study information aggregation in a dynamic trading model with partially informed traders. Ostrovsky [2012] showed that 'separable' securities aggregate information in all equilibria, however, separability is not robust to small changes in the traders' private information. To remedy this problem, we enhance the model by allowing traders to acquire signals with cost $\kappa$, in every period. We show that '$\kappa$ separable securities' aggregate information and, as the cost decreases, nearly all securities become $\kappa$ separable, irrespective of the traders' initial private information. Moreover, the switch to $\kappa$ separability happens not gradually but discontinuously, hence even a small decrease in costs can result in a security aggregating information. Finally, even with myopic traders, cheaper information may accelerate or decelerate information aggregation for all but Arrow-Debreu securities.


title: Quantum Speedup of the Dispersion and Codebook Design Problems

abstract: We propose new formulations of max-sum and max-min dispersion problems that enable solutions via the Grover adaptive search (GAS) quantum algorithm, offering quadratic speedup. Dispersion problems are combinatorial optimization problems classified as NP-hard, which appear often in coding theory and wireless communications applications involving optimal codebook design. In turn, GAS is a quantum exhaustive search algorithm that can be used to implement full-fledged maximum-likelihood optimal solutions. In conventional naive formulations however, it is typical to rely on a binary vector spaces, resulting in search space sizes prohibitive even for GAS. To circumvent this challenge, we instead formulate the search of optimal dispersion problem over Dicke states, an equal superposition of binary vectors with equal Hamming weights, which significantly reduces the search space leading to a simplification of the quantum circuit via the elimination of penalty terms. Additionally, we propose a method to replace distance coefficients with their ranks, contributing to the reduction of the number of qubits. Our analysis demonstrates that as a result of the proposed techniques a reduction in query complexity compared to the conventional GAS using Hadamard transform is achieved, enhancing the feasibility of the quantum-based solution of the dispersion problem.


title: Merging Improves Self-Critique Against Jailbreak Attacks

abstract: The robustness of large language models (LLMs) against adversarial manipulations, such as jailbreak attacks, remains a significant challenge. In this work, we propose an approach that enhances the self-critique capability of the LLM and further fine-tunes it over sanitized synthetic data. This is done with the addition of an external critic model that can be merged with the original, thus bolstering self-critique capabilities and improving the robustness of the LLMs response to adversarial prompts. Our results demonstrate that the combination of merging and self-critique can reduce the attack success rate of adversaries significantly, thus offering a promising defense mechanism against jailbreak attacks. Code, data and models released at https://github.com/vicgalle/merging-self-critique-jailbreaks .


title: RGB-Sonar Tracking Benchmark and Spatial Cross-Attention Transformer Tracker

abstract: Vision camera and sonar are naturally complementary in the underwater environment. Combining the information from two modalities will promote better observation of underwater targets. However, this problem has not received sufficient attention in previous research. Therefore, this paper introduces a new challenging RGB-Sonar (RGB-S) tracking task and investigates how to achieve efficient tracking of an underwater target through the interaction of RGB and sonar modalities. Specifically, we first propose an RGBS50 benchmark dataset containing 50 sequences and more than 87000 high-quality annotated bounding boxes. Experimental results show that the RGBS50 benchmark poses a challenge to currently popular SOT trackers. Second, we propose an RGB-S tracker called SCANet, which includes a spatial cross-attention module (SCAM) consisting of a novel spatial cross-attention layer and two independent global integration modules. The spatial cross-attention is used to overcome the problem of spatial misalignment of between RGB and sonar images. Third, we propose a SOT data-based RGB-S simulation training method (SRST) to overcome the lack of RGB-S training datasets. It converts RGB images into sonar-like saliency images to construct pseudo-data pairs, enabling the model to learn the semantic structure of RGB-S-like data. Comprehensive experiments show that the proposed spatial cross-attention effectively achieves the interaction between RGB and sonar modalities and SCANet achieves state-of-the-art performance on the proposed benchmark. The code is available at https://github.com/LiYunfengLYF/RGBS50.


title: Superscaling analysis of inclusive electron and (anti)neutrino scattering within the coherent density fluctuation model

abstract: The experimental data from quasielastic electron and (anti)neutrino scattering on $^{12}$C are reanalyzed in terms of a new scaling variable $\psi^*$ suggested by the interacting relativistic Fermi gas with scalar and vector interactions, which is known to generate a relativistic effective mass for the interacting nucleons. We construct a new scaling function $f^\text{QE}(\psi^*)$ for the inclusive lepton scattering from nuclei within the coherent density fluctuation model (CDFM). The latter is a natural extension of the relativistic Fermi gas model to finite nuclei. In this work, on the basis of the scaling function obtained within CDFM with a relativistic effective mass $m_N^* =0.8 m_N$, we calculate and compare the theoretical predictions with a large set of experimental data for inclusive ($e,e'$) and (anti)neutrino cross sections. The model also includes the contribution of weak two-body currents in the two-particle two-hole sector, evaluated within a fully relativistic Fermi gas. Good agreement with experimental data is found over the whole range of electron and (anti)neutrino energies.


title: MeMSVD: Long-Range Temporal Structure Capturing Using Incremental SVD

abstract: This paper is on long-term video understanding where the goal is to recognise human actions over long temporal windows (up to minutes long). In prior work, long temporal context is captured by constructing a long-term memory bank consisting of past and future video features which are then integrated into standard (short-term) video recognition backbones through the use of attention mechanisms. Two well-known problems related to this approach are the quadratic complexity of the attention operation and the fact that the whole feature bank must be stored in memory for inference. To address both issues, we propose an alternative to attention-based schemes which is based on a low-rank approximation of the memory obtained using Singular Value Decomposition. Our scheme has two advantages: (a) it reduces complexity by more than an order of magnitude, and (b) it is amenable to an efficient implementation for the calculation of the memory bases in an incremental fashion which does not require the storage of the whole feature bank in memory. The proposed scheme matches or surpasses the accuracy achieved by attention-based mechanisms while being memory-efficient. Through extensive experiments, we demonstrate that our framework generalises to different architectures and tasks, outperforming the state-of-the-art in three datasets.


title: Convergence of bi-spatial pullback random attractors and stochastic Liouville type equations for nonautonomous stochastic p-Laplacian lattice system

abstract: We consider convergence properties of the long-term behaviors with respect to the coefficient of the stochastic term for a nonautonomous stochastic $p$-Laplacian lattice equation with multiplicative noise. First, the upper semi-continuity of pullback random $(\ell^2,\ell^q)$-attractor is proved for each $q\in[1,+\infty)$. Then, a convergence result of the time-dependent invariant sample Borel probability measures is obtained in $\ell^2$. Next, we show that the invariant sample measures satisfy a stochastic Liouville type equation and a termwise convergence of the stochastic Liouville type equations is verified. Furthermore, each family of the invariant sample measures is turned out to be a sample statistical solution, which hence also fulfills a convergence consequence.


title: Accurate estimate of the ESPRESSO fiber-injection losses inferred from integrated field-stabilization images

abstract: Ground-based astronomy is unavoidably subject to the adverse effect of atmospheric turbulence, a.k.a. the seeing, which blurs the images and limits the achievable spatial resolution. For spectroscopic observations, it leads to slit or fiber-injection losses, since not all photons distributed over the extended seeing disk can be captured. These losses might have a very substantial impact on the overall efficiency of a spectrograph and are naturally highly variable. Assessing the fiber-injection losses requires accurate information about the image quality (IQ) delivered by the telescope to the instrument over the course of the observations, which, however, is often not directly available. ESPRESSO provides acquisition and field-stabilization images attached to the science data and thus offers the opportunity for a post-processing analysis. Here, we present a novel method to infer the IQ profile and fiber-injection losses from the integrated field-stabilization images, utilizing the spill-over light that does not get injected into the fiber. We validate these measurements against the IQ observed in the acquisition images and determine that our method delivers unbiased estimates with a scatter of 0.11" for the FWHM of the profile and 15% in terms of fiber-injection losses. This compares favorably to the estimates derived from either the differential image motion monitor (DIMM) or the telescope guide probe sensors and therefore represents a valuable tool to characterize the instrument efficiency and to correct raw spectra for fiber-injection losses.


title: Supporting Changes in Digital Ownership and Data Sovereignty Across the Automotive Value Chain with Catena-X

abstract: Digital Twins have evolved as a concept describing digital representations of physical assets. They can be used to facilitate simulations, monitoring, or optimization of product lifecycles. Considering the concept of a Circular Economy, which entails several lifecycles of, e.g., vehicles, their components, and materials, it is important to investigate how the respective Digital Twins are managed over the lifecycle of their physical assets. This publication presents and compares three approaches for managing Digital Twins in industrial use cases. The analysis considers aspects such as updates, data ownership, and data sovereignty. The results based on the research project Catena-X


title: Binary asteroid candidates in Gaia DR3 astrometry

abstract: Asteroids with companions constitute an excellent sample for studying the collisional and dynamical evolution of minor planets. The currently known binary population were discovered by different complementary techniques that produce, for the moment, a strongly biased distribution, especially in a range of intermediate asteroid sizes (approximately 20 to 100 km) where both mutual photometric events and high-resolution adaptive optic imaging are poorly efficient. A totally independent technique of binary asteroid discovery, based on astrometry, can help to reveal new binary systems and populate a range of sizes and separations that remain nearly unexplored. In this work, we describe a dedicated period detection method and its results for the Gaia DR3 data set. This method looks for the presence of a periodic signature in the orbit post-fit residuals. After conservative filtering and validation based on statistical and physical criteria, we are able to present a first sample of astrometric binary candidates, to be confirmed by other observation techniques such as photometric light curves and stellar occultations.


title: A search for Galactic post-AGB stars in Gaia DR3

abstract: Context. When low and intermediate-mass stars leave the Asymptotic Giant Branch (AGB) phase, and before they reach the Planetary Nebulae stage, they enter a very brief and rather puzzling stellar evolutionary stage named post-AGB. Aims. To provide a reliable catalogue of galactic post-AGB stars together with their physical and evolutionary properties obtained through Gaia DR3 astrometry and photometry. Methods. We started by identifying post-AGB stars or possible candidates from the bibliography with their Gaia DR3 counterpart sources. Using the available photometry, interstellar extinction, literature spectroscopically derived temperatures or spectral types and parallax-derived distances from Gaia DR3, we fitted their Spectral Energy Distributions and we estimated their luminosities and circumstellar extinctions. When compared to models, luminosity values allowed us to disclose objects that are likely post-AGB stars from other target types. Their position on the HR diagram allows direct comparison with updated post-AGB evolutionary tracks and an estimation of their masses and evolutionary ages. Results. We obtained a sample of 69 reliable post-AGB candidates that meet our classification criteria, providing their coordinates, distances, effective temperature, total extinction, luminosity, mass, and evolutionary age. In addition, similar data for other stellar objects in our initial compilation, such as supergiant stars or young stellar objects, is provided. Conclusions. We have filtered out the data that have the best precision in parallaxes and distances to obtain more accurate luminosities, which allows us to classify with confidence the objects of the sample among different stellar phases. This allows us to provide a small but reliable sample of post-AGB objects. Derived mean evolutionary time and average mass values are in agreement with theoretical expectations.


title: A numerical model for time-multiplexed Ising machines based on delay-line oscillators

abstract: Ising machines (IM) have recently been proposed as unconventional hardware-based computation accelerators for solving NP-hard problems. In this work, we present a model for a time-multiplexed IM based on the nonlinear oscillations in a delay line-based resonator and numerically study the effects that the circuit parameters, specifically the compression gain $\beta_r$ and frequency nonlinearity $\beta_i$, have on the IM solutions. We find that the likelihood of reaching the global minimum -- the global minimum probability (GMP) -- is the highest for a certain range of $\beta_r$ and $\beta_i$ located near the edge of the synchronization region of the oscillators. The optimal range remains unchanged for all tested coupling topologies and network connections. We also observe a sharp transition line in the ($\beta_i, \beta_r$) space above which the GMP falls to zero. In all cases, small variations in the natural frequency of the oscillators do not modify the results, allowing us to extend this model to realistic systems.


title: Target Speech Diarization with Multimodal Prompts

abstract: Traditional speaker diarization seeks to detect ``who spoke when'' according to speaker characteristics. Extending to target speech diarization, we detect ``when target event occurs'' according to the semantic characteristics of speech. We propose a novel Multimodal Target Speech Diarization (MM-TSD) framework, which accommodates diverse and multi-modal prompts to specify target events in a flexible and user-friendly manner, including semantic language description, pre-enrolled speech, pre-registered face image, and audio-language logical prompts. We further propose a voice-face aligner module to project human voice and face representation into a shared space. We develop a multi-modal dataset based on VoxCeleb2 for MM-TSD training and evaluation. Additionally, we conduct comparative analysis and ablation studies for each category of prompts to validate the efficacy of each component in the proposed framework. Furthermore, our framework demonstrates versatility in performing various signal processing tasks, including speaker diarization and overlap speech detection, using task-specific prompts. MM-TSD achieves robust and comparable performance as a unified system compared to specialized models. Moreover, MM-TSD shows capability to handle complex conversations for real-world dataset.


title: Spectral Methods for Coastal-Trapped Waves and Instabilities in a Background Flow

abstract: Here we present a numerical method for finding non-hydrostatic coastal-trapped wave and instability solutions to the non-hydrostatic Boussinesq equations in the presence of a background flow and complicated coastal topography. We use spectral methods to discretise the two-dimensional eigenvalue problem and solve the resulting discrete problem by standard methods. Our approach is applied to three examples and shown to be consistent with previous numerical and analytical results. In particular, we show that our method is able to reliably identify coastal-trapped wave solutions that correspond to waves seen in realistic simulations of the Southeast Greenland shelf.


title: A Multi-step Approach for Minimizing Risk in Decentralized Exchanges

abstract: Decentralized Exchanges are becoming even more predominant in today's finance. Driven by the need to study this phenomenon from an academic perspective, the SIAG/FME Code Quest 2023 was announced. Specifically, participating teams were asked to implement, in Python, the basic functions of an Automated Market Maker and a liquidity provision strategy in an Automated Market Maker to minimize the Conditional Value at Risk, a critical measure of investment risk. As the competition's winning team, we highlight our approach in this work. In particular, as the dependence of the final return on the initial wealth distribution is highly non-linear, we cannot use standard ad-hoc approaches. Additionally, classical minimization techniques would require a significant computational load due to the cost of the target function. For these reasons, we propose a three-step approach. In the first step, the target function is approximated by a Kernel Ridge Regression. Then, the approximating function is minimized. In the final step, the previously discovered minimum is utilized as the starting point for directly optimizing the desired target function. By using this procedure, we can both reduce the computational complexity and increase the accuracy of the solution. Finally, the overall computational load is further reduced thanks to an algorithmic trick concerning the returns simulation and the usage of Cython.


title: Exact blow-up profiles for the parabolic-elliptic Keller-Segel system in dimensions $N\ge 3$

abstract: In this paper, we obtain the exact blow-up profiles of solutions of the Keller-Segel-Patlak system in the space with dimensions $N\ge 3$, which solves an open problem proposed by P. Souplet and M. Winkler in 2019. To establish this achievement, we develop the zero number argument for nonlinear equations with unbounded coefficients and construct a family of auxiliary backward self-similar solutions through nontrivial ODE analysis.


title: Can Foundation Models Reliably Identify Spatial Hazards? A Case Study on Curb Segmentation

abstract: Curbs serve as vital borders that delineate safe pedestrian zones from potential vehicular traffic hazards. Curbs also represent a primary spatial hazard during dynamic navigation with significant stumbling potential. Such vulnerabilities are particularly exacerbated for persons with blindness and low vision (PBLV). Accurate visual-based discrimination of curbs is paramount for assistive technologies that aid PBLV with safe navigation in urban environments. Herein, we investigate the efficacy of curb segmentation for foundation models. We introduce the largest curb segmentation dataset to-date to benchmark leading foundation models. Our results show that state-of-the-art foundation models face significant challenges in curb segmentation. This is due to their high false-positive rates (up to 95%) with poor performance distinguishing curbs from curb-like objects or non-curb areas, such as sidewalks. In addition, the best-performing model averaged a 3.70-second inference time, underscoring problems in providing real-time assistance. In response, we propose solutions including filtered bounding box selections to achieve more accurate curb segmentation. Overall, despite the immediate flexibility of foundation models, their application for practical assistive technology applications still requires refinement. This research highlights the critical need for specialized datasets and tailored model training to address navigation challenges for PBLV and underscores implicit weaknesses in foundation models.


title: ParaCLAP -- Towards a general language-audio model for computational paralinguistic tasks

abstract: Contrastive language-audio pretraining (CLAP) has recently emerged as a method for making audio analysis more generalisable. Specifically, CLAP-style models are able to `answer' a diverse set of language queries, extending the capabilities of audio models beyond a closed set of labels. However, CLAP relies on a large set of (audio, query) pairs for pretraining. While such sets are available for general audio tasks, like captioning or sound event detection, there are no datasets with matched audio and text queries for computational paralinguistic (CP) tasks. As a result, the community relies on generic CLAP models trained for general audio with limited success. In the present study, we explore training considerations for ParaCLAP, a CLAP-style model suited to CP, including a novel process for creating audio-language queries. We demonstrate its effectiveness on a set of computational paralinguistic tasks, where it is shown to surpass the performance of open-source state-of-the-art models.


title: Manifestation of superfluidity in atom-number-imbalanced two-component Bose-Einstein condensates

abstract: Superfluid and dissipative regimes in the dynamics of a two-component quasi-one-dimensional Bose-Einstein condensate (BEC) with unequal atom numbers in the components have been explored. The system supports localized waves of the symbiotic type owing to the same-species repulsion and cross-species attraction. The minority BEC component moves through the majority component and creates excitations. To quantify the emerging excitations we introduce a time-dependent function called disturbance. Through numerical simulations of the coupled Gross-Pitaevskii equations with periodic boundary conditions, we have revealed a critical velocity of the localized wave, above which a transition from superfluid to dissipative regime occurs, evidenced by a sharp increase in the disturbance function. The factors responsible for the discrepancy between the actual critical velocity and the speed of sound, expected from theoretical arguments, have been discussed.


title: Sensing food quality by silicene nanosheets : a Density Functional Theory study

abstract: Volatile organic compounds (VOCs) emitted by food products are considered markers for assessing quality of food. In this work, first-principles Density Functional Theory (DFT) and Non-equilibrium Green's function (NEGF) methods have been employed to model chemo-resistive gas sensor based on two-dimensional silicene based nanosheets that can sense the six different VOCs emitted by standard food products. Our calculations with unpassivated and flourine passivated silicene(F-silicene) sheets as sensor materials show that flourine passivated silicene has significantly better sensitivity towards all six VOC molecules (Acetone, Dimethylsulfide, Ethanol, Methanol, Methylacetate and Toluene). Moreover, flourinated silicene sensor is found to be capable of separately recognising four VOCs, a much better performance than r-GO used in a recent experiment. We analyse the microscopic picture influencing sensing capabilities of un-passivated and fluorinated silicene from the perspectives of adsorption energy, charge transfer and changes in the electronic structure. We find that better sensing ability of fluorinated silicene nanosheet can be correlated with the changes in the electronic structures near the Fermi level upon adsorption of different VOCs. The results imply that passivated silicene can work better as a sensor than r-GO in case of generic food VOCs. The results are important since modelling of various two-dimensional nano-sensors can be done in the similar way for detection of more complex VOCs emitted by specific food products.


title: Mean-Field Magnetohydrodynamics Models as Scaling Limits of Stochastic Induction Equations

abstract: We study the asymptotic properties of a stochastic model for the induction equations of the magnetic field in a three dimensional periodic domain. The turbulent velocity field driving the electromotive force on the magnetic field is modeled by a noise white in time. For this model we rigorously take a scaling limit leading to a deterministic model. While in case of isotropic turbulence this produces an additional dissipation in the limit model which influences also the decay rate of the Magnetic field in the stochastic model, the case of turbulence devoloped in a preferential direction allows us to find a dynamo effect.


title: Model order reduction for seismic applications

abstract: We propose a model order reduction approach to speed up the computation of seismograms, i.e. the solution of the seismic wave equation evaluated at a receiver location, for different model parameters. Our approach achieves a reduction of the unknowns by a factor of approximately 1000 for various numerical experiments for a 2D subsurface model of Groningen, the Netherlands, even if the wave speeds of the subsurface are relatively varied. Moreover, using parallel computing, the reduced model can approximate the (time domain) seismogram in a lower wall clock time than an implicit Newmark-beta method. To realize this reduction, we exploit the fact that seismograms are low-pass filtered for the observed seismic events by considering the Laplace-transformed problem in frequency domain. Therefore, we can avoid the high frequencies that would require many reduced basis functions to reach the desired accuracy and generally make the reduced order approximation of wave problems challenging. Instead, we can prove for our ansatz that for a fixed subsurface model the reduced order approximation converges exponentially fast in the frequency range of interest in the Laplace domain. We build the reduced model from solutions of the Laplace-transformed problem via a (Proper Orthogonal Decomposition-)Greedy algorithm targeting the construction of the reduced model to the time domain seismograms; the latter is achieved by using an a posteriori error estimator that does not require computing any time domain counterparts. Finally, we show that we obtain a stable reduced model thus overcoming the challenge that standard model reduction approaches do not necessarily yield a stable reduced model for wave problems.


title: Database-assisted automata learning

abstract: This paper presents DAALder (Database-Assisted Automata Learning, with Dutch suffix from leerder), a new algorithm for learning state machines, or automata, specifically deterministic finite-state automata (DFA). When learning state machines from log data originating from software systems, the large amount of log data can pose a challenge. Conventional state merging algorithms cannot efficiently deal with this, as they require a large amount of memory. To solve this, we utilized database technologies to efficiently query a big trace dataset and construct a state machine from it, as databases allow to save large amounts of data on disk while still being able to query it efficiently. Building on research in both active learning and passive learning, the proposed algorithm is a combination of the two. It can quickly find a characteristic set of traces from a database using heuristics from a state merging algorithm. Experiments show that our algorithm has similar performance to conventional state merging algorithms on large datasets, but requires far less memory.


title: MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidance

abstract: Recent advancements in text-to-image generation models have dramatically enhanced the generation of photorealistic images from textual prompts, leading to an increased interest in personalized text-to-image applications, particularly in multi-subject scenarios. However, these advances are hindered by two main challenges: firstly, the need to accurately maintain the details of each referenced subject in accordance with the textual descriptions; and secondly, the difficulty in achieving a cohesive representation of multiple subjects in a single image without introducing inconsistencies. To address these concerns, our research introduces the MS-Diffusion framework for layout-guided zero-shot image personalization with multi-subjects. This innovative approach integrates grounding tokens with the feature resampler to maintain detail fidelity among subjects. With the layout guidance, MS-Diffusion further improves the cross-attention to adapt to the multi-subject inputs, ensuring that each subject condition acts on specific areas. The proposed multi-subject cross-attention orchestrates harmonious inter-subject compositions while preserving the control of texts. Comprehensive quantitative and qualitative experiments affirm that this method surpasses existing models in both image and text fidelity, promoting the development of personalized text-to-image generation.


title: The green hydrogen ambition and implementation gap

abstract: Green hydrogen is critical for decarbonising hard-to-electrify sectors, but faces high costs and investment risks. Here we define and quantify the green hydrogen ambition and implementation gap, showing that meeting hydrogen expectations will remain challenging despite surging announcements of projects and subsidies. Tracking 137 projects over three years, we identify a wide 2022 implementation gap with only 2% of global capacity announcements finished on schedule. In contrast, the 2030 ambition gap towards 1.5{\deg}C scenarios is gradually closing as the announced project pipeline has nearly tripled to 441 GW within three years. However, we estimate that, without carbon pricing, realising all these projects would require global subsidies of \$1.6 trillion (\$1.2 - 2.6 trillion range), far exceeding announced subsidies. Given past and future implementation gaps, policymakers must prepare for prolonged green hydrogen scarcity. Policy support needs to secure hydrogen investments, but should focus on applications where hydrogen is indispensable.


title: Contributions of QED diagrams with vacuum polarization insertions to the lepton anomaly within the Mellin--Barnes representation

abstract: We investigate the radiative QED corrections to the lepton ($L=e,~\mu$ and $\tau$) anomalous magnetic moment arising from vacuum polarization diagrams by four closed lepton loops. The method is based on the consecutive application of dispersion relations for the polarization operator and the Mellin--Barnes transform for the propagators of massive particles. This allows one to obtain, for the first time, exact analytical expressions for the radiative corrections to the anomalous magnetic moments of leptons from diagrams with insertions of four identical lepton loops all of the same type $\ell$ different from the external one, $L$. The result is expressed in terms of the mass ratio $r=m_\ell/m_L$. We investigate the behaviour of the exact analytical expressions at $r\to 0$ and $r\to \infty$ and compare with the corresponding asymptotic expansions known in the literature.


title: Towards Human-AI Collaboration in Healthcare: Guided Deferral Systems with Large Language Models

abstract: Large language models (LLMs) present a valuable technology for various applications in healthcare, but their tendency to hallucinate introduces unacceptable uncertainty in critical decision-making situations. Human-AI collaboration (HAIC) can mitigate this uncertainty by combining human and AI strengths for better outcomes. This paper presents a novel guided deferral system that provides intelligent guidance when AI defers cases to human decision-makers. We leverage LLMs' verbalisation capabilities and internal states to create this system, demonstrating that fine-tuning smaller LLMs with data from larger models enhances performance while maintaining computational efficiency. A pilot study showcases the effectiveness of our deferral system.


title: Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learning

abstract: This work aims to investigate semantic communication in high-speed mobile Internet of vehicles (IoV) environments, with a focus on the spectrum sharing between vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communications. We specifically address spectrum scarcity and network traffic and then propose a semantic-aware spectrum sharing algorithm (SSS) based on the deep reinforcement learning (DRL) soft actor-critic (SAC) approach. Firstly, we delve into the extraction of semantic information. Secondly, we redefine metrics for semantic information in V2V and V2I spectrum sharing in IoV environments, introducing high-speed semantic spectrum efficiency (HSSE) and semantic transmission rate (HSR). Finally, we employ the SAC algorithm for decision optimization in V2V and V2I spectrum sharing based on semantic information. This optimization encompasses the optimal link of V2V and V2I sharing strategies, the transmission power for vehicles sending semantic information and the length of transmitted semantic symbols, aiming at maximizing HSSE of V2I and enhancing success rate of effective semantic information transmission (SRS) of V2V. Experimental results demonstrate that the SSS algorithm outperforms other baseline algorithms, including other traditional-communication-based spectrum sharing algorithms and spectrum sharing algorithm using other reinforcement learning approaches. The SSS algorithm exhibits a 15% increase in HSSE and approximately a 7% increase in SRS.


title: Robustness of perfect transmission resonances to asymmetric perturbation

abstract: We investigate the perfect transmission resonances (PTRs) of perturbed 1D finite periodic systems with mirror symmetric cells. The unperturbed scattering region consists of $N$ identical cells and the related transmission spectrum possesses at least $N-1$ PTRs in each pass band of the Bloch dispersion of the unit cell. On the other hand, the perturbation is breaking the periodicity and, a priori, is able to eliminate all the PTRs. We show how PTRs could still appear in the perturbed case with a suitable design of the perturbation. We also reveal a connection between two apparently independent PTRs, a connection that lies in the symmetry of the finite Kronig-Penney systems and which implies that if one PTR is preserved then another one, among the $N-1$ PTRs in a pass band, is necessarily also preserved.


title: DSig: Breaking the Barrier of Signatures in Data Centers

abstract: Data centers increasingly host mutually distrustful users on shared infrastructure. A powerful tool to safeguard such users are digital signatures. Digital signatures have revolutionized Internet-scale applications, but current signatures are too slow for the growing genre of microsecond-scale systems in modern data centers. We propose DSig, the first digital signature system to achieve single-digit microsecond latency to sign, transmit, and verify signatures in data center systems. DSig is based on the observation that, in many data center applications, the signer of a message knows most of the time who will verify its signature. We introduce a new hybrid signature scheme that combines cheap single-use hash-based signatures verified in the foreground with traditional signatures pre-verified in the background. Compared to prior state-of-the-art signatures, DSig reduces signing time from 18.9 to 0.7 us and verification time from 35.6 to 5.1 us, while keeping signature transmission time below 2.5 us. Moreover, DSig achieves 2.5x higher signing throughput and 6.9x higher verification throughput than the state of the art. We use DSig to (a) bring auditability to two key-value stores (HERD and Redis) and a financial trading system (based on Liquibook) for 86% lower added latency than the state of the art, and (b) replace signatures in BFT broadcast and BFT replication, reducing their latency by 73% and 69%, respectively


title: The Semantics of Effects: Centrality, Quantum Control and Reversible Recursion

abstract: This thesis revolves around an area of computer science called "semantics". We work with operational semantics, equational theories, and denotational semantics. The first contribution of this thesis is a study of the commutativity of effects through the prism of monads. Monads are the generalisation of algebraic structures such as monoids, which have a notion of centre: the centre of a monoid is made of elements which commute with all others. We provide the necessary and sufficient conditions for a monad to have a centre. We also detail the semantics of a language with effects that carry information on which effects are central. Moreover, we provide a strong link between its equational theories and its denotational semantics. The second focus of the thesis is quantum computing, seen as a reversible effect. Physically permissible quantum operations are all reversible, except measurement; however, measurement can be deferred at the end of the computation, allowing us to focus on the reversible part first. We define a simply-typed reversible programming language performing quantum operations called "unitaries". A denotational semantics and an equational theory adapted to the language are presented, and we prove that the former is complete. Furthermore, we study recursion in reversible programming, providing adequate operational and denotational semantics to a Turing-complete, reversible, functional programming language. The denotational semantics uses the dcpo enrichment of rig join inverse categories. This mathematical account of higher-order reasoning on reversible computing does not directly generalise to its quantum counterpart. In the conclusion, we detail the limitations and possible future for higher-order quantum control through guarded recursion.