title: Euclid: Early Release Observations -- A preview of the Euclid era through a galaxy cluster magnifying lens

abstract: We present the first analysis of the Euclid Early Release Observations (ERO) program that targets fields around two lensing clusters, Abell 2390 and Abell 2764. We use VIS and NISP imaging to produce photometric catalogs for a total of $\sim 500\,000$ objects. The imaging data reach a $5\,\sigma$ typical depth in the range 25.1-25.4 AB in the NISP bands, and 27.1-27.3 AB in the VIS band. Using the Lyman-break method in combination with photometric redshifts, we identify $30$ Lyman-break galaxy (LBG) candidates at $z>6$ and 139 extremely red sources (ERSs), most likely at lower redshift. The deeper VIS imaging compared to NISP means we can routinely identify high-redshift Lyman breaks of the order of $3$ magnitudes, which reduces contamination by brown dwarf stars and low-redshift galaxies. Spectroscopic follow-up campaigns of such bright sources will help constrain both the bright end of the ultraviolet galaxy luminosity function and the quasar luminosity function at $z>6$, and constrain the physical nature of these objects. Additionally, we have performed a combined strong lensing and weak lensing analysis of A2390, and demonstrate how Euclid will contribute to better constraining the virial mass of galaxy clusters. From these data, we also identify optical and near-infrared counterparts of known $z>0.6$ clusters, which exhibit strong lensing features, establishing the ability of Euclid to characterize high-redshift clusters. Finally, we provide a glimpse of Euclid's ability to map the intracluster light out to larger radii than current facilities, enabling a better understanding of the cluster assembly history and mapping of the dark matter distribution. This initial dataset illustrates the diverse spectrum of legacy science that will be enabled by the Euclid survey.


title: Euclid: ERO -- NISP-only sources and the search for luminous $z=6-8$ galaxies

abstract: This paper presents a search for high redshift galaxies from the Euclid Early Release Observations program "Magnifying Lens." The 1.5 deg$^2$ area covered by the twin Abell lensing cluster fields is comparable in size to the few other deep near-infrared surveys such as COSMOS, and so provides an opportunity to significantly increase known samples of rare UV-bright galaxies at $z\approx6-8$ ($M_{\rm UV}\lesssim-22$). Beyond their still uncertain role in reionisation, these UV-bright galaxies are ideal laboratories from which to study galaxy formation and constrain the bright-end of the UV luminosity function. Of the 501994 sources detected from a combined $Y_{\rm E}$, $J_{\rm E}$, and $H_{\rm E}$ NISP detection image, 168 do not have any appreciable VIS/$I_{\rm E}$ flux. These objects span a range in spectral colours, separated into two classes: 139 extremely red sources; and 29 Lyman-break galaxy candidates. Best-fit redshifts and spectral templates suggest the former is composed of both $z\gtrsim5$ dusty star-forming galaxies and $z\approx1-3$ quiescent systems. The latter is composed of more homogeneous Lyman break galaxies at $z\approx6-8$. In both cases, contamination by L- and T-type dwarfs cannot be ruled out with Euclid images alone. Additional contamination from instrumental persistence is investigated using a novel time series analysis. This work lays the foundation for future searches within the Euclid Deep Fields, where thousands more $z\gtrsim6$ Lyman break systems and extremely red sources will be identified.


title: Large Deviations in Safety-Critical Hamiltonian Systems with Probabilistic Initial Conditions

abstract: We address the problem of determining the least improbable deviations leading to an unsafe rare event in a weakly perturbed mechanical system with probabilistic initial conditions. These deviations are obtained as the solution to a variational problem formulated using rigorous approximation techniques grounded in the principles of large deviations theory. These types of results have been extended to accommodate stochastic uncertainty in the initial states, which is a common assumption in mechanical systems. Furthermore, we demonstrate the applicability of the method by solving the problem for a rare collision event between two space objects, i.e. a high-dimensional and non-linear problem, resulting in the most likely sample paths leading to the realization of the unsafe rare event. The solution is validated against the necessary conditions for optimality derived from the maximum principle. Access to these unsafe sample paths offers relevant information regarding the dangerous configurations of rare events and can be used to design control strategies to reduce the probability of realization.


title: Superconducting meron phase in locally noncentrosymmetric superconductors

abstract: Theory of the superconducting parity transition is extended by incorporating the vortex degree of freedom. We employ the bilayer Rashba model representing locally noncentrosymmetric layered superconductors and derive the Ginzburg-Landau free energy functional. This formulation reveals the parity transition, where the even-parity superconducting state changes to the odd-parity one upon increasing the magnetic field under the vortex states. The H-T phase diagram of CeRh${}_{2}$As${}_{2}$ is quantitatively reproduced and a novel superconducting state with a meron (half-skyrmion) lattice pseudospin texture is predicted.


title: Furutsu-Novikov--like cross-correlation--response relations for systems driven by shot noise

abstract: We consider a dynamic system that is driven by an intensity-modulated Poisson process with intensity $\Lambda(t)=\lambda(t)+\varepsilon\nu(t)$. We derive an exact relation between the input-output cross-correlation in the spontaneous state ($\varepsilon=0$) and the linear response to the modulation ($\varepsilon>0$). This can be regarded as a variant of the Furutsu-Novikov theorem for the case of shot noise. As we show, the relation is still valid in the presence of additional independent noise. Furthermore, we derive an extension to Cox-process input, i.e. to colored shot noise. We discuss applications to particle detection and to neuroscience. Using the new relation, we obtain a fluctuation-response-relation for a leaky integrate-and-fire neuron. We also show how the new relation can be used in a remote control problem in a recurrent neural network. The relations are numerically tested for both stationary and non-stationary dynamics. Lastly, extensions to marked Poisson processes and to higher-order statistics are presented.


title: Learn to formulate: A surrogate model framework for generalized assignment problem with routing constraints

abstract: The generalized assignment problem with routing constraints, e.g. the vehicle routing problem, has essential practical relevance. This paper focuses on addressing the complexities of the problem by learning a surrogate model with reduced variables and reconstructed constraints. A surrogate model framework is presented with a class of surrogate models and a learning method to acquire parameters. The paper further provides theoretical results regarding the representational power and statistical properties to explore the effectiveness of this framework. Numerical experiments based on two practical problem classes demonstrate the accuracy and efficiency of the framework. The resulting surrogate models perform comparably to or surpass the state-of-the-art heuristics on average. Our findings provide empirical evidence for the effectiveness of utilizing size-reduced and reconstructed surrogate models in producing high-quality solutions.


title: Additional Studies on Displacement Mapping with Restrictions

abstract: The theory of monotone operators plays a major role in modern optimization and many areas of nonlinera analysis. The central classes of monotone operators are matrices with a positive semidefinite symmetric part and subsifferential operators. In this paper, we complete our study to the displacement mappings. We derive formulas for set-valued and Moore-Penrose inverses. We also give a comprehensive study of the the operators ($(1/2) {\rm Id} + T$ and its inverse) and provide a formula for $((1/2) {\rm Id} + T)^{-1}$. We illustrate our results by considering the reflected and the projection operators to closed linear subspaces.


title: Latent Space Alignment for Semantic Channel Equalization

abstract: We relax the constraint of a shared language between agents in a semantic and goal-oriented communication system to explore the effect of language mismatch in distributed task solving. We propose a mathematical framework, which provides a modelling and a measure of the semantic distortion introduced in the communication when agents use distinct languages. We then propose a new approach to semantic channel equalization with proven effectiveness through numerical evaluations.


title: Coverage Path Planning for Thermal Interface Materials

abstract: Thermal management of power electronics and Electronic Control Units is crucial in times of increasing power densities and limited assembly space. Electric and autonomous vehicles are a prominent application field. Thermal Interface Materials are used to transfer heat from a semiconductor to a heatsink. They are applied along a dispense path onto the semiconductor and spread over its entire surface once the heatsink is joined. To plan this application path, design engineers typically perform an iterative trial-and-error procedure of elaborate simulations and manual experiments. We propose a fully automated optimization approach, which clearly outperforms the current manual path planning and respects all relevant manufacturing constraints. An optimum dispense path increases the reliability of the thermal interface and makes the manufacturing more sustainable by reducing material waste. We show results on multiple real products from automotive series production, including an experimental validation on actual series manufacturing equipment.


title: An Asymptotic CVaR Measure of Risk for Markov Chains

abstract: Risk sensitive decision making finds important applications in current day use cases. Existing risk measures consider a single or finite collection of random variables, which do not account for the asymptotic behaviour of underlying systems. Conditional Value at Risk (CVaR) is the most commonly used risk measure, and has been extensively utilized for modelling rare events in finite horizon scenarios. Naive extension of existing risk criteria to asymptotic regimes faces fundamental challenges, where basic assumptions of existing risk measures fail. We present a complete simulation based approach for sequentially computing Asymptotic CVaR (ACVaR), a risk measure we define on limiting empirical averages of markovian rewards. Large deviations theory, density estimation, and two-time scale stochastic approximation are utilized to define a 'tilted' probability kernel on the underlying state space to facilitate ACVaR simulation. Our algorithm enjoys theoretical guarantees, and we numerically evaluate its performance over a variety of test cases.


title: Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation

abstract: End-to-end (E2E) automatic speech recognition (ASR) can operate in two modes: streaming and non-streaming, each with its pros and cons. Streaming ASR processes the speech frames in real-time as it is being received, while non-streaming ASR waits for the entire speech utterance; thus, professionals may have to operate in either mode to satisfy their application. In this work, we present joint optimization of streaming and non-streaming ASR based on multi-decoder and knowledge distillation. Primarily, we study 1) the encoder integration of these ASR modules, followed by 2) separate decoders to make the switching mode flexible, and enhancing performance by 3) incorporating similarity-preserving knowledge distillation between the two modular encoders and decoders. Evaluation results show 2.6%-5.3% relative character error rate reductions (CERR) on CSJ for streaming ASR, and 8.3%-9.7% relative CERRs for non-streaming ASR within a single model compared to multiple standalone modules.


title: Multi-Scale Feature Fusion Quantum Depthwise Convolutional Neural Networks for Text Classification

abstract: In recent years, with the development of quantum machine learning, quantum neural networks (QNNs) have gained increasing attention in the field of natural language processing (NLP) and have achieved a series of promising results. However, most existing QNN models focus on the architectures of quantum recurrent neural network (QRNN) and self-attention mechanism (QSAM). In this work, we propose a novel QNN model based on quantum convolution. We develop the quantum depthwise convolution that significantly reduces the number of parameters and lowers computational complexity. We also introduce the multi-scale feature fusion mechanism to enhance model performance by integrating word-level and sentence-level features. Additionally, we propose the quantum word embedding and quantum sentence embedding, which provide embedding vectors more efficiently. Through experiments on two benchmark text classification datasets, we demonstrate our model outperforms a wide range of state-of-the-art QNN models. Notably, our model achieves a new state-of-the-art test accuracy of 96.77% on the RP dataset. We also show the advantages of our quantum model over its classical counterparts in its ability to improve test accuracy using fewer parameters. Finally, an ablation test confirms the effectiveness of the multi-scale feature fusion mechanism and quantum depthwise convolution in enhancing model performance.


title: LIRE: listwise reward enhancement for preference alignment

abstract: Recently, tremendous strides have been made to align the generation of Large Language Models (LLMs) with human values to mitigate toxic or unhelpful content. Leveraging Reinforcement Learning from Human Feedback (RLHF) proves effective and is widely adopted by researchers. However, implementing RLHF is complex, and its sensitivity to hyperparameters renders achieving stable performance and scalability challenging. Furthermore, prevailing approaches to preference alignment primarily concentrate on pairwise comparisons, with limited exploration into multi-response scenarios, thereby overlooking the potential richness within the candidate pool. For the above reasons, we propose a new approach: Listwise Reward Enhancement for Preference Alignment (LIRE), a gradient-based reward optimization approach that incorporates the offline rewards of multiple responses into a streamlined listwise framework, thus eliminating the need for online sampling during training. LIRE is straightforward to implement, requiring minimal parameter tuning, and seamlessly aligns with the pairwise paradigm while naturally extending to multi-response scenarios. Moreover, we introduce a self-enhancement algorithm aimed at iteratively refining the reward during training. Our experiments demonstrate that LIRE consistently outperforms existing methods across several benchmarks on dialogue and summarization tasks, with good transferability to out-of-distribution data, assessed using proxy reward models and human annotators.


title: WaterPool: A Watermark Mitigating Trade-offs among Imperceptibility, Efficacy and Robustness

abstract: With the increasing use of large language models (LLMs) in daily life, concerns have emerged regarding their potential misuse and societal impact. Watermarking is proposed to trace the usage of specific models by injecting patterns into their generated texts. An ideal watermark should produce outputs that are nearly indistinguishable from those of the original LLM (imperceptibility), while ensuring a high detection rate (efficacy), even when the text is partially altered (robustness). Despite many methods having been proposed, none have simultaneously achieved all three properties, revealing an inherent trade-off. This paper utilizes a key-centered scheme to unify existing watermarking techniques by decomposing a watermark into two distinct modules: a key module and a mark module. Through this decomposition, we demonstrate for the first time that the key module significantly contributes to the trade-off issues observed in prior methods. Specifically, this reflects the conflict between the scale of the key sampling space during generation and the complexity of key restoration during detection. To this end, we introduce \textbf{WaterPool}, a simple yet effective key module that preserves a complete key sampling space required by imperceptibility while utilizing semantics-based search to improve the key restoration process. WaterPool can integrate with most watermarks, acting as a plug-in. Our experiments with three well-known watermarking techniques show that WaterPool significantly enhances their performance, achieving near-optimal imperceptibility and markedly improving efficacy and robustness (+12.73\% for KGW, +20.27\% for EXP, +7.27\% for ITS).


title: PerSense: Personalized Instance Segmentation in Dense Images

abstract: Leveraging large-scale pre-training, vision foundational models showcase notable performance benefits. While recent years have witnessed significant advancements in segmentation algorithms, existing models still face challenges to automatically segment personalized instances in dense and crowded scenarios. The primary factor behind this limitation stems from bounding box-based detections, which are constrained by occlusions, background clutter, and object orientation, particularly when dealing with dense images. To this end, we propose PerSense, an end-to-end, training-free, and model-agnostic one-shot framework to address the personalized instance segmentation in dense images. Towards developing this framework, we make following core contributions. (a) We propose an Instance Detection Module (IDM) and leverage a Vision-Language Model, a grounding object detector, and a few-shot object counter (FSOC) to realize a new baseline. (b) To tackle false positives within candidate point prompts, we design Point Prompt Selection Module (PPSM). Both IDM and PPSM transform density maps from FSOC into personalized instance-level point prompts for segmentation and offer a seamless integration in our model-agnostic framework. (c) We introduce a feedback mechanism which enables PerSense to harness the full potential of FSOC by automating the exemplar selection process. (d) To promote algorithmic advances and effective tools for this relatively underexplored task, we introduce PerSense-D, a dataset exclusive to personalized instance segmentation in dense images. We validate the effectiveness of PerSense on the task of personalized instance segmentation in dense images on PerSense-D and comparison with SOTA. Additionally, our qualitative findings demonstrate the adaptability of our framework to images captured in-the-wild.


title: Multi-fidelity topology optimization of flow boiling heat transfer in microchannels

abstract: Topology optimization (TO) is a powerful method to design innovative structures with improved heat transfer performance. In the present study, a multi-fidelity TO method with a delicately defined objective function is developed for flow boiling heat transfer in microchannels. Low-fidelity TO is conducted for the reduced-order process of single-phase laminar convective heat transfer, which generates a set of structure candidates for subsequent high-fidelity evaluation of flow boiling heat transfer. To avoid the possible iteration between the low-fidelity TO and high-fidelity evaluation which leads to inefficient solution of the multi-fidelity TO, distributions of velocity, temperature and two-phase in microchannels with single-phase and/or flow boiling heat transfer are investigated and compared in detail, based on which a new objective function is delicately defined, which can be employed in the low-fidelity TO yet can stand for the performance of the high-fidelity problem. With the help of the new objective function, the efficiency of the multi-fidelity TO is significantly improved and TO structures are designed with hot spots eliminated, thermal resistance reduced and temperature uniformity improved. The present work provides a new method for TO of complicated heat and mass transfer problems. Keywords: topology optimization, flow boiling, multi-fidelity optimization, microchannels, convective heat transfer


title: Network Inpainting via Optimal Transport

abstract: In this work, we present a novel tool for reconstructing networks from corrupted images. The reconstructed network is the result of a minimization problem that has a misfit term with respect to the observed data, and a physics-based regularizing term coming from the theory of optimal transport. Through a range of numerical tests, we demonstrate that our suggested approach can effectively rebuild the primary features of damaged networks, even when artifacts are present.


title: Run-and-tumble particle with saturating rates

abstract: We consider a run-and-tumble particle whose speed and tumbling rate are space-dependent on an infinite line. Unlike most of the previous work on such models, here we make the physical assumption that at large distances, these rates saturate to a constant. For our choice of rate functions, we show that a stationary state exists, and the exact steady state distribution decays exponentially or faster and can be unimodal or bimodal. The effect of boundedness of rates is seen in the mean-squared displacement of the particle that displays qualitative features different from those observed in the previous studies where it approaches the stationary state value monotonically in time; in contrast, here we find that if the initial position of the particle is sufficiently far from the origin, the variance in its position either varies nonmonotonically or plateaus before reaching the stationary state. These results are captured quantitatively by the exact solution of the Green's function when the particle has uniform speed but the tumbling rates change as a step-function in space; the insights provided by this limiting case are found to be consistent with the numerical results for the general model.


title: Beyond Trend and Periodicity: Guiding Time Series Forecasting with Textual Cues

abstract: This work introduces a novel Text-Guided Time Series Forecasting (TGTSF) task. By integrating textual cues, such as channel descriptions and dynamic news, TGTSF addresses the critical limitations of traditional methods that rely purely on historical data. To support this task, we propose TGForecaster, a robust baseline model that fuses textual cues and time series data using cross-attention mechanisms. We then present four meticulously curated benchmark datasets to validate the proposed framework, ranging from simple periodic data to complex, event-driven fluctuations. Our comprehensive evaluations demonstrate that TGForecaster consistently achieves state-of-the-art performance, highlighting the transformative potential of incorporating textual information into time series forecasting. This work not only pioneers a novel forecasting task but also establishes a new benchmark for future research, driving advancements in multimodal data integration for time series models.


title: Induced Isotensor Interactions in Heavy-Ion Double-Charge-Exchange Reactions and the Role of Initial and Final State Interactions

abstract: The role of initial state (ISI) and final state (FSI) ion-ion interactions in heavy-ion double-charge-exchange (DCE) reactions $A(Z,N)\to A(Z\pm 2,N\mp 2)$ are studied for double single-charge-exchange (DSCE) reactions given by sequential actions of the isovector nucleon-nucleon (NN) T-matrix. In momentum representation, the second-order DSCE reaction amplitude is shown to be given in factorized form by projectile and target nuclear matrix elements and a reaction kernel containing ISI and FSI. Expanding the intermediate propagator in a Taylor series with respect to auxiliary energy allows us to perform the summation in the leading-order term over intermediate nuclear states in closure approximation. %Please ensure meaning has been retained - corrected HL. The nuclear matrix element attains a form given by the products of two-body interactions directly exciting the $n^2p^{-2}$ and $p^2n^{-2}$ DCE transitions in the projectile and the target nucleus, respectively. %Please ensure meaning has been retained - corrected HL. A surprising result is that the intermediate propagation induces correlations between the transition vertices, showing that DSCE reactions are a two-nucleon process that resembles a system of interacting spin-isospin dipoles. Transformation of the DSCE NN T-matrix interactions from the reaction theoretical t-channel form to the s-channel operator structure required for spectroscopic purposes is elaborated in detail, showing that, in general, a rich spectrum of spin scalar, spin vector and higher-rank spin tensor multipole transitions will contribute to a DSCE reaction. Similarities (and differences) to two-neutrino double-beta decay (DBD) are discussed. ISI/FSI distortion and absorption effects are illustrated in black sphere approximation and in an illustrative application to data.


title: Equivariant neural networks for robust $\textit{CP}$ observables

abstract: We introduce the usage of equivariant neural networks in the search for violations of the charge-parity ($\textit{CP}$) symmetry in particle interactions at the CERN Large Hadron Collider. We design neural networks that take as inputs kinematic information of recorded events and that transform equivariantly under the a symmetry group related to the $\textit{CP}$ transformation. We show that this algorithm allows to define observables reflecting the properties of the $\textit{CP}$ symmetry, showcasing its performance in several reference processes in top quark and electroweak physics. Imposing equivariance as an inductive bias in the algorithm improves the numerical convergence properties with respect to other methods that do not rely on equivariance and allows to construct optimal observables that significantly improve the state-of-the-art methodology in the searches considered.


title: Rearrangement collision theory of phonon-driven exciton dissociation

abstract: Understanding the processes governing the dissociation of excitons to free charge carriers in semiconductors and insulators is of central importance for photovoltaic applications. Dyson's $\mathcal{S}$-matrix formalism provides a framework for computing scattering rates between quasiparticle states derived from the same underlying Hamiltonian, often reducing to familiar Fermi's golden rule like expressions at first order. By presenting a rigorous formalism for multi-channel scattering, we extend this approach to describe scattering between composite quasiparticles and in particular, the process of exciton dissociation mediated by the electron-phonon interaction. Subsequently, we derive rigorous expressions for the exciton dissociation rate, a key quantity of interest in optoelectronic materials, which enforce correct energy conservation and may be readily used in ab initio calculations. We apply our formalism to a three-dimensional model system to compare temperature-dependent exciton rates obtained for different scattering channels.


title: Understanding Virtual Nodes: Oversmoothing, Oversquashing, and Node Heterogeneity

abstract: Message passing neural networks (MPNNs) have been shown to have limitations in terms of expressivity and modeling long-range interactions. Augmenting MPNNs with a virtual node (VN) removes the locality constraint of the layer aggregation and has been found to improve performance on a range of benchmarks. We provide a comprehensive theoretical analysis of the role of VNs and benefits thereof, through the lenses of oversmoothing, oversquashing, and sensitivity analysis. First, in contrast to prior belief, we find that VNs typically avoid replicating anti-smoothing approaches to maintain expressive power. Second, we characterize, precisely, how the improvement afforded by VNs on the mixing abilities of the network and hence in mitigating oversquashing, depends on the underlying topology. Finally, we highlight that, unlike Graph-Transformers (GT), classical instantiations of the VN are often constrained to assign uniform importance to different nodes. Consequently, we propose a variant of VN with the same computational complexity, which can have different sensitivity to nodes based on the graph structure. We show that this is an extremely effective and computationally efficient baseline on graph-level tasks.


title: End-to-End Real-World Polyphonic Piano Audio-to-Score Transcription with Hierarchical Decoding

abstract: Piano audio-to-score transcription (A2S) is an important yet underexplored task with extensive applications for music composition, practice, and analysis. However, existing end-to-end piano A2S systems faced difficulties in retrieving bar-level information such as key and time signatures, and have been trained and evaluated with only synthetic data. To address these limitations, we propose a sequence-to-sequence (Seq2Seq) model with a hierarchical decoder that aligns with the hierarchical structure of musical scores, enabling the transcription of score information at both the bar and note levels by multi-task learning. To bridge the gap between synthetic data and recordings of human performance, we propose a two-stage training scheme, which involves pre-training the model using an expressive performance rendering (EPR) system on synthetic audio, followed by fine-tuning the model using recordings of human performance. To preserve the voicing structure for score reconstruction, we propose a pre-processing method for **Kern scores in scenarios with an unconstrained number of voices. Experimental results support the effectiveness of our proposed approaches, in terms of both transcription performance on synthetic audio data in comparison to the current state-of-the-art, and the first experiment on human recordings.


title: ElastiBench: Scalable Continuous Benchmarking on Cloud FaaS Platforms

abstract: Running microbenchmark suites often and early in the development process enables developers to identify performance issues in their application. Microbenchmark suites of complex applications can comprise hundreds of individual benchmarks and take multiple hours to evaluate meaningfully, making running those benchmarks as part of CI/CD pipelines infeasible. In this paper, we reduce the total execution time of microbenchmark suites by leveraging the massive scalability and elasticity of FaaS (Function-as-a-Service) platforms. While using FaaS enables users to quickly scale up to thousands of parallel function instances to speed up microbenchmarking, the performance variation and low control over the underlying computing resources complicate reliable benchmarking. We demonstrate an architecture for executing microbenchmark suites on cloud FaaS platforms and evaluate it on code changes from an open-source time series database. Our evaluation shows that our prototype can produce reliable results (~95% of performance changes accurately detected) in a quarter of the time (<=15min vs.~4h) and at lower cost ($0.49 vs. ~$1.18) compared to cloud-based virtual machines.


title: The correlation between nativelike selection and prototypicality: a multilingual onomasiological case study using semantic embedding

abstract: In native speakers' lexical choices, a concept can be more readily expressed by one expression over another grammatical one, a phenomenon known as nativelike selection (NLS). In previous research, arbitrary chunks such as collocations have been considered crucial for this phenomenon. However, this study examines the possibility of analyzing the semantic motivation and deducibility behind some NLSs by exploring the correlation between NLS and prototypicality, specifically the onomasiological hypothesis of Grondelaers and Geeraerts (2003, Towards a pragmatic model of cognitive onomasiology. In Hubert Cuyckens, Ren\'e Dirven & John R. Taylor (eds.), Cognitive approaches to lexical semantics, 67-92. Berlin: De Gruyter Mouton). They hypothesized that "[a] referent is more readily named by a lexical item if it is a salient member of the category denoted by that item". To provide a preliminary investigation of this important but rarely explored phenomenon, a series of innovative methods and procedures, including the use of semantic embedding and interlingual comparisons, is designed. Specifically, potential NLSs are efficiently discovered through an automatic exploratory analysis using topic modeling techniques, and then confirmed by manual inspection through frame semantics. Finally, to account for the NLS in question, cluster analysis and behavioral profile analysis are conducted to uncover a language-specific prototype for the Chinese verb shang 'harm', providing supporting evidence for the correlation between NLS and prototypicality.


title: Through energy droughts: hydropower's ability to sustain a high output

abstract: Previous research has raised concerns about energy droughts in renewables-based energy systems. This study explores the ability of reservoir hydropower to sustain a high output and, thereby, mitigate such energy droughts. Using detailed modelling, we estimate that Swedish hydropower can sustain 67-92% of its installed capacity for 3 weeks, with higher values possible in springtime. The variation of the sustained output, equivalent to the capacity of 3-4 Swedish nuclear reactors, under-scores the importance of understanding the potential output levels when devising strategies to counteract energy droughts. Moreover, we find that regulations imposed on the flows in river bottlenecks hinder higher sustained output levels. With the upcoming renewal of environmental permits for hydropower plants in Sweden, these findings provide valuable insights for policymakers. Furthermore, the sustained output capabilities demonstrated in this study challenge the prevalent simplified representations of hydropower in energy models, suggesting a need for more-sophisticated modelling approaches.


title: A stereographic test of spherical uniformity

abstract: We introduce a test of uniformity for (hyper)spherical data motivated by the stereographic projection. The closed-form expression of the test statistic and its null asymptotic distribution are derived using Gegenbauer polynomials. The power against rotationally symmetric local alternatives is provided, and simulations illustrate the non-null asymptotic results. The stereographic test outperforms other tests in a testing scenario with antipodal dependence.


title: What Makes Good Few-shot Examples for Vision-Language Models?

abstract: Despite the notable advancements achieved by leveraging pre-trained vision-language (VL) models through few-shot tuning for downstream tasks, our detailed empirical study highlights a significant dependence of few-shot learning outcomes on the careful selection of training examples - a facet that has been previously overlooked in research. In this study, we delve into devising more effective strategies for the meticulous selection of few-shot training examples, as opposed to relying on random sampling, to enhance the potential of existing few-shot prompt learning methodologies. To achieve this, we assess the effectiveness of various Active Learning (AL) techniques for instance selection, such as Entropy and Margin of Confidence, within the context of few-shot training. Furthermore, we introduce two innovative selection methods - Representativeness (REPRE) and Gaussian Monte Carlo (Montecarlo) - designed to proactively pinpoint informative examples for labeling in relation to pre-trained VL models. Our findings demonstrate that both REPRE and Montecarlo significantly surpass both random selection and AL-based strategies in few-shot training scenarios. The research also underscores that these instance selection methods are model-agnostic, offering a versatile enhancement to a wide array of few-shot training methodologies.


title: The restricted Siegel disc as coadjoint orbit

abstract: The restricted Siegel disc is a homogeneous space related to the connected component $T_0(1)$ of the Universal Teichm\"uller space via the period mapping. In this paper we show that it is a coadjoint orbit of the universal central extension of the restricted symplectic group or, equivalently, an affine coadjoint orbit of the restricted symplectic group with cocycle given by the Schwinger term.


title: Ascending Chains of Free Quasiconvex Subgroups

abstract: We prove that a hyperbolic group cannot contain a strictly ascending chain of free quasiconvex subgroups of constant rank.


title: Generalized Laplace Approximation

abstract: In recent years, the inconsistency in Bayesian deep learning has garnered increasing attention. Tempered or generalized posterior distributions often offer a direct and effective solution to this issue. However, understanding the underlying causes and evaluating the effectiveness of generalized posteriors remain active areas of research. In this study, we introduce a unified theoretical framework to attribute Bayesian inconsistency to model misspecification and inadequate priors. We interpret the generalization of the posterior with a temperature factor as a correction for misspecified models through adjustments to the joint probability model, and the recalibration of priors by redistributing probability mass on models within the hypothesis space using data samples. Additionally, we highlight a distinctive feature of Laplace approximation, which ensures that the generalized normalizing constant can be treated as invariant, unlike the typical scenario in general Bayesian learning where this constant varies with model parameters post-generalization. Building on this insight, we propose the generalized Laplace approximation, which involves a simple adjustment to the computation of the Hessian matrix of the regularized loss function. This method offers a flexible and scalable framework for obtaining high-quality posterior distributions. We assess the performance and properties of the generalized Laplace approximation on state-of-the-art neural networks and real-world datasets.


title: Attention Mechanisms Don't Learn Additive Models: Rethinking Feature Importance for Transformers

abstract: We address the critical challenge of applying feature attribution methods to the transformer architecture, which dominates current applications in natural language processing and beyond. Traditional attribution methods to explainable AI (XAI) explicitly or implicitly rely on linear or additive surrogate models to quantify the impact of input features on a model's output. In this work, we formally prove an alarming incompatibility: transformers are structurally incapable to align with popular surrogate models for feature attribution, undermining the grounding of these conventional explanation methodologies. To address this discrepancy, we introduce the Softmax-Linked Additive Log-Odds Model (SLALOM), a novel surrogate model specifically designed to align with the transformer framework. Unlike existing methods, SLALOM demonstrates the capacity to deliver a range of faithful and insightful explanations across both synthetic and real-world datasets. Showing that diverse explanations computed from SLALOM outperform common surrogate explanations on different tasks, we highlight the need for task-specific feature attributions rather than a one-size-fits-all approach.


title: Sequential Bayesian inference for stochastic epidemic models of cumulative incidence

abstract: Epidemics are inherently stochastic, and stochastic models provide an appropriate way to describe and analyse such phenomena. Given temporal incidence data consisting of, for example, the number of new infections or removals in a given time window, a continuous-time discrete-valued Markov process provides a natural description of the dynamics of each model component, typically taken to be the number of susceptible, exposed, infected or removed individuals. Fitting the SEIR model to time-course data is a challenging problem due incomplete observations and, consequently, the intractability of the observed data likelihood. Whilst sampling based inference schemes such as Markov chain Monte Carlo are routinely applied, their computational cost typically restricts analysis to data sets of no more than a few thousand infective cases. Instead, we develop a sequential inference scheme that makes use of a computationally cheap approximation of the most natural Markov process model. Crucially, the resulting model allows a tractable conditional parameter posterior which can be summarised in terms of a set of low dimensional statistics. This is used to rejuvenate parameter samples in conjunction with a novel bridge construct for propagating state trajectories conditional on the next observation of cumulative incidence. The resulting inference framework also allows for stochastic infection and reporting rates. We illustrate our approach using synthetic and real data applications.


title: Ultra-Fast Adaptive Track Detection Network

abstract: Railway detection is critical for the automation of railway systems. Existing models often prioritize either speed or accuracy, but achieving both remains a challenge. To address the limitations of presetting anchor groups that struggle with varying track proportions from different camera angles, an ultra-fast adaptive track detection network is proposed in this paper. This network comprises a backbone network and two specialized branches (Horizontal Coordinate Locator and Perspective Identifier). The Perspective Identifier selects the suitable anchor group from preset anchor groups, thereby determining the row coordinates of the railway track. Subsequently, the Horizontal Coordinate Locator provides row classification results based on multiple preset anchor groups. Then, utilizing the results from the Perspective Identifier, it generates the column coordinates of the railway track. This network is evaluated on multiple datasets, with the lightweight version achieving an F1 score of 98.68% on the SRail dataset and a detection rate of up to 473 FPS. Compared to the SOTA, the proposed model is competitive in both speed and accuracy. The dataset and code are available at https://github.com/idnihai/UFATD


title: Turbulent Thermal Equilibration of Collisionless Magnetospheric Plasmas

abstract: How thermal equilibrium is determined in a weakly collisional plasma is a fundamental question in plasma physics. This letter shows that the turbulence driven by the magnetic curvature and density gradient tends to equilibrate the temperature between species without collisions in a magnetospheric plasma. The classical stability analysis in terms of energetic consideration reveals the interchangeable roles of electrons and ions for destabilization depending on their temperatures. Nonlinear gyrokinetic simulations confirm that the higher-temperature destabilizing species gives free energy to heat the other species to achieve the equal temperature state.


title: Directly Denoising Diffusion Models

abstract: In this paper, we present the Directly Denoising Diffusion Model (DDDM): a simple and generic approach for generating realistic images with few-step sampling, while multistep sampling is still preserved for better performance. DDDMs require no delicately designed samplers nor distillation on pre-trained distillation models. DDDMs train the diffusion model conditioned on an estimated target that was generated from previous training iterations of its own. To generate images, samples generated from the previous time step are also taken into consideration, guiding the generation process iteratively. We further propose Pseudo-LPIPS, a novel metric loss that is more robust to various values of hyperparameter. Despite its simplicity, the proposed approach can achieve strong performance in benchmark datasets. Our model achieves FID scores of 2.57 and 2.33 on CIFAR-10 in one-step and two-step sampling respectively, surpassing those obtained from GANs and distillation-based models. By extending the sampling to 1000 steps, we further reduce FID score to 1.79, aligning with state-of-the-art methods in the literature. For ImageNet 64x64, our approach stands as a competitive contender against leading models.


title: Annotation-Efficient Preference Optimization for Language Model Alignment

abstract: Preference optimization is a standard approach to fine-tuning large language models to align with human preferences. The quality, diversity, and quantity of the preference dataset are critical to the effectiveness of preference optimization. However, obtaining a large amount of high-quality and diverse preference annotations is difficult in many applications. This raises the question of how to use the limited annotation budget to create an effective preference dataset. To this end, we propose Annotation-Efficient Preference Optimization (AEPO). Instead of exhaustively annotating preference over all available response texts, AEPO selects a subset of responses that maximizes quality and diversity from the available responses, and then annotates preference over the selected ones. In this way, AEPO focuses the annotation budget on labeling preference over a smaller subset of responses with diversity and of high quality. We evaluate the performance of Direct Preference Optimization (DPO) using AEPO and show that it outperforms models trained using a standard DPO with the same annotation budget. Our code is available at https://github.com/CyberAgentAILab/annotation-efficient-po


title: Towards Safe Mid-Air Drone Interception: Strategies for Tracking & Capture

abstract: A unique approach for the mid-air autonomous aerial interception of non-cooperating UAV by a flying robot equipped with a net is presented in this paper. A novel interception guidance method dubbed EPN is proposed, designed to catch agile maneuvering targets while relying on onboard state estimation and tracking. The proposed method is compared with state-of-the-art approaches in simulations using 100 different trajectories of the target with varying complexity comprising almost 14 hours of flight data, and EPN demonstrates the shortest response time and the highest number of interceptions, which are key parameters of agile interception. To enable robust transfer from theory and simulation to a real-world implementation, we aim to avoid overfitting to specific assumptions about the target, and to tackle interception of a target following an unknown general trajectory. Furthermore, we identify several often overlooked problems related to tracking and estimation of the target's state that can have a significant influence on the overall performance of the system. We propose the use of a novel state estimation filter based on the IMM filter and a new measurement model. Simulated experiments show that the proposed solution provides significant improvements in estimation accuracy over the commonly employed KF approaches when considering general trajectories. Based on these results, we employ the proposed filtering and guidance methods to implement a complete autonomous interception system, which is thoroughly evaluated in realistic simulations and tested in real-world experiments with a maneuvering target going far beyond the performance of any state-of-the-art solution.


title: Towards a Distributed Platform for Normative Reasoning and Value Alignment in Multi-Agent Systems

abstract: This paper presents an extended version of the SPADE platform, which aims to empower intelligent agent systems with normative reasoning and value alignment capabilities. Normative reasoning involves evaluating social norms and their impact on decision-making, while value alignment ensures agents' actions are in line with desired principles and ethical guidelines. The extended platform equips agents with normative awareness and reasoning capabilities based on deontic logic, allowing them to assess the appropriateness of their actions and make informed decisions. By integrating normative reasoning and value alignment, the platform enhances agents' social intelligence and promotes responsible and ethical behaviors in complex environments.


title: Fractional quantum mechanics meets quantum gravity phenomenology

abstract: This paper extends previous findings on the modified Schr\"odinger evolution inspired by quantum gravity phenomenology. By establishing a connection between this approach and fractional quantum mechanics, we provide insights into a potential deep infrared regime of quantum gravity, characterized by the emergence of fractal dimensions, similar to behaviors observed in the deep ultraviolet regime. Additionally, we briefly explore the requirements for experimental investigations of this regime using Bose-Einstein condensates. Notably, our analysis reveals a direct implication of this analogy: experiments probing fractional quantum mechanics may serve as equivalent models of quantum gravity. We identify instances of nonlocal behavior in such systems, suggesting an analogous phenomenon of nonlocality in quantum gravity.


title: Optimal transient growth and transition to turbulence in the MHD pipe flow subject to a transverse magnetic field

abstract: We consider the influence of a transverse magnetic field on the transient growth of perturbations in a liquid-metal circular pipe flow with an electrically insulating or conducting wall. In this configuration, the mean flow profile and the amplification of perturbations are strongly affected by the applied magnetic field, leading to a rich dynamical landscape depending on its intensity. The analysis is performed for Reynolds numbers 5000 and 10 000, close to the transitional regime for moderate values of the Hartmann number, a non-dimensional parameter proportional to the applied magnetic field's intensity. Aside from a slight modification of hydrodynamic optimal perturbations at very small Hartmann numbers, we observe three other characteristic topologies of optimal perturbations depending on the intensity of the magnetic field. Their growth mechanisms differ, with the lift-up effect dominating at low Hartmann numbers and the Orr-mechanism becoming increasingly important as the magnetic field intensity is increased. In particular, we show in the intermediate regime of Hartmann numbers how transient growth occurs in two stages, with initial growth through the lift-up effect followed by a further increase of energy through the Orr-mechanism. We also conduct three-dimensional nonlinear simulations to track the time evolution of optimal perturbations, illustrating their nonlinear growth and eventual breakdown to a sustained turbulent state or the return of the system to a laminar state.


title: Knowledge-Driven Cross-Document Relation Extraction

abstract: Relation extraction (RE) is a well-known NLP application often treated as a sentence- or document-level task. However, a handful of recent efforts explore it across documents or in the cross-document setting (CrossDocRE). This is distinct from the single document case because different documents often focus on disparate themes, while text within a document tends to have a single goal. Linking findings from disparate documents to identify new relationships is at the core of the popular literature-based knowledge discovery paradigm in biomedicine and other domains. Current CrossDocRE efforts do not consider domain knowledge, which are often assumed to be known to the reader when documents are authored. Here, we propose a novel approach, KXDocRE, that embed domain knowledge of entities with input text for cross-document RE. Our proposed framework has three main benefits over baselines: 1) it incorporates domain knowledge of entities along with documents' text; 2) it offers interpretability by producing explanatory text for predicted relations between entities 3) it improves performance over the prior methods.


title: HighwayLLM: Decision-Making and Navigation in Highway Driving with RL-Informed Language Model

abstract: Autonomous driving is a complex task which requires advanced decision making and control algorithms. Understanding the rationale behind the autonomous vehicles' decision is crucial to ensure their safe and effective operation on highway driving. This study presents a novel approach, HighwayLLM, which harnesses the reasoning capabilities of large language models (LLMs) to predict the future waypoints for ego-vehicle's navigation. Our approach also utilizes a pre-trained Reinforcement Learning (RL) model to serve as a high-level planner, making decisions on appropriate meta-level actions. The HighwayLLM combines the output from the RL model and the current state information to make safe, collision-free, and explainable predictions for the next states, thereby constructing a trajectory for the ego-vehicle. Subsequently, a PID-based controller guides the vehicle to the waypoints predicted by the LLM agent. This integration of LLM with RL and PID enhances the decision-making process and provides interpretability for highway autonomous driving.


title: ECLIPSE: Semantic Entropy-LCS for Cross-Lingual Industrial Log Parsing

abstract: Log parsing, a vital task for interpreting the vast and complex data produced within software architectures faces significant challenges in the transition from academic benchmarks to the industrial domain. Existing log parsers, while highly effective on standardized public datasets, struggle to maintain performance and efficiency when confronted with the sheer scale and diversity of real-world industrial logs. These challenges are two-fold: 1) massive log templates: The performance and efficiency of most existing parsers will be significantly reduced when logs of growing quantities and different lengths; 2) Complex and changeable semantics: Traditional template-matching algorithms cannot accurately match the log templates of complicated industrial logs because they cannot utilize cross-language logs with similar semantics. To address these issues, we propose ECLIPSE, Enhanced Cross-Lingual Industrial log Parsing with Semantic Entropy-LCS, since cross-language logs can robustly parse industrial logs. On the one hand, it integrates two efficient data-driven template-matching algorithms and Faiss indexing. On the other hand, driven by the powerful semantic understanding ability of the Large Language Model (LLM), the semantics of log keywords were accurately extracted, and the retrieval space was effectively reduced. Notably, we launch a Chinese and English cross-platform industrial log parsing benchmark ECLIPSE- BENCH to evaluate the performance of mainstream parsers in industrial scenarios. Our experimental results across public benchmarks and ECLIPSE- BENCH underscore the superior performance and robustness of our proposed ECLIPSE. Notably, ECLIPSE both delivers state-of-the-art performance when compared to strong baselines and preserves a significant edge in processing efficiency.


title: Multi-Objective Optimization-Based Waveform Design for Multi-User and Multi-Target MIMO-ISAC Systems

abstract: Integrated sensing and communication (ISAC) opens up new service possibilities for sixth-generation (6G) systems, where both communication and sensing (C&S) functionalities co-exist by sharing the same hardware platform and radio resource. In this paper, we investigate the waveform design problem in a downlink multi-user and multi-target ISAC system under different C&S performance preferences. The multi-user interference (MUI) may critically degrade the communication performance. To eliminate the MUI, we employ the constructive interference mechanism into the ISAC system, which saves the power budget for communication. However, due to the conflict between C&S metrics, it is intractable for the ISAC system to achieve the optimal performance of C&S objective simultaneously. Therefore, it is important to strike a tradeoff between C&S objectives. By virtue of the multi-objective optimization theory, we propose a weighted Tchebycheff-based transformation method to re-frame the C&S trade-off problem as a Pareto-optimal problem, thus effectively tackling the constraints in ISAC systems. Finally, simulation results reveal the trade-off relation between C&S performances, which provides insights for the flexible waveform design under different C&S performance preferences in MIMO-ISAC systems.


title: Warning Signs for Boundary Noise and their Application to an Ocean Boussinesq Model

abstract: In this paper, we construct and discuss early-warning signs of the approach of a parameter to a deterministic bifurcation on a stochastic partial differential equation (SPDE) model with Gaussian white-noise on the boundary. We specifically focus on the qualitative behaviour of the time-asymptotic autocovariance and autocorrelation of the solutions of the linearized system. We also discuss the reliability of the tools from an analytic perspective and through various examples. Among those, the application of the early-warning signs for an ocean Boussinesq model is explored through numerical simulations. The analytic results obtained expand on previous work and present valuable early-warning signs for various applications.


title: Large Language Models are Effective Priors for Causal Graph Discovery

abstract: Causal structure discovery from observations can be improved by integrating background knowledge provided by an expert to reduce the hypothesis space. Recently, Large Language Models (LLMs) have begun to be considered as sources of prior information given the low cost of querying them relative to a human expert. In this work, firstly, we propose a set of metrics for assessing LLM judgments for causal graph discovery independently of the downstream algorithm. Secondly, we systematically study a set of prompting designs that allows the model to specify priors about the structure of the causal graph. Finally, we present a general methodology for the integration of LLM priors in graph discovery algorithms, finding that they help improve performance on common-sense benchmarks and especially when used for assessing edge directionality. Our work highlights the potential as well as the shortcomings of the use of LLMs in this problem space.


title: Quantum gravitational corrections to the Schwarzschild spacetime and quasinormal frequencies

abstract: Quantum gravitational corrections to the entropy of the Schwarzschild black hole, derived using the Wald entropy formula within an effective field theory framework, were presented in [X. Calmet, F. Kuipers Phys.Rev.D 104 (2021) 6, 066012]. These corrections result in a Schwarzschild spacetime that is deformed by the quantum correction. However, it is observed that the proposed quantum-corrected metric describes not a black hole but a wormhole. Nevertheless, further expansion of the metric function in terms of the quantum correction parameter yields a well-defined black hole metric whose geometry closely resembles that of a wormhole. We also explore methods for distinguishing between these quantum-corrected spacetimes based on the quasinormal frequencies they emit.


title: Hidden semi-Markov models with inhomogeneous state dwell-time distributions

abstract: The well-established methodology for the estimation of hidden semi-Markov models (HSMMs) as hidden Markov models (HMMs) with extended state spaces is further developed to incorporate covariate influences across all aspects of the state process model, in particular, regarding the distributions governing the state dwell time. The special case of periodically varying covariate effects on the state dwell-time distributions - and possibly the conditional transition probabilities - is examined in detail to derive important properties of such models, namely the periodically varying unconditional state distribution as well as the overall state dwell-time distribution. Through simulation studies, we ascertain key properties of these models and develop recommendations for hyperparameter settings. Furthermore, we provide a case study involving an HSMM with periodically varying dwell-time distributions to analyse the movement trajectory of an arctic muskox, demonstrating the practical relevance of the developed methodology.


title: The Influencer Next Door: How Misinformation Creators Use GenAI

abstract: Advances in generative AI (GenAI) have raised concerns about detecting and discerning AI-generated content from human-generated content. Most existing literature assumes a paradigm where 'expert' organized disinformation creators and flawed AI models deceive 'ordinary' users. Based on longitudinal ethnographic research with misinformation creators and consumers between 2022-2023, we instead find that GenAI supports bricolage work, where non-experts increasingly use GenAI to remix, repackage, and (re)produce content to meet their personal needs and desires. This research yielded four key findings: First, participants primarily used GenAI for creation, rather than truth-seeking. Second, a spreading 'influencer millionaire' narrative drove participants to become content creators, using GenAI as a productivity tool to generate a volume of (often misinformative) content. Third, GenAI lowered the barrier to entry for content creation across modalities, enticing consumers to become creators and significantly increasing existing creators' output. Finally, participants used Gen AI to learn and deploy marketing tactics to expand engagement and monetize their content. We argue for shifting analysis from the public as consumers of AI content to bricoleurs who use GenAI creatively, often without a detailed understanding of its underlying technology. We analyze how these understudied emergent uses of GenAI produce new or accelerated misinformation harms, and their implications for AI products, platforms and policies.


title: A Perspective Analysis of Handwritten Signature Technology

abstract: Handwritten signatures are biometric traits at the center of debate in the scientific community. Over the last 40 years, the interest in signature studies has grown steadily, having as its main reference the application of automatic signature verification, as previously published reviews in 1989, 2000, and 2008 bear witness. Ever since, and over the last 10 years, the application of handwritten signature technology has strongly evolved, and much research has focused on the possibility of applying systems based on handwritten signature analysis and processing to a multitude of new fields. After several years of haphazard growth of this research area, it is time to assess its current developments for their applicability in order to draw a structured way forward. This perspective reports a systematic review of the last 10 years of the literature on handwritten signatures with respect to the new scenario, focusing on the most promising domains of research and trying to elicit possible future research directions in this subject.


title: The effect of reducible Markov modulation on tail probabilities in models of random growth

abstract: A recent economic literature deals with models of random growth in which the size (say, log-wealth) of an individual economic agent is subject to light-tailed random additive shocks over time. The distribution of these shocks depends on a latent Markov modulator. It has been shown that if Markov modulation is irreducible then the models give rise to a distribution of sizes across agents whose upper tail resembles, in a particular sense, that of an exponential distribution. We show that while this need not be the case under reducible Markov modulation, the upper tail will nevertheless resemble that of an Erlang distribution. A novel extension of the Rothblum index theorem from an affine setting to a holomorphic one allows us to characterize the shape parameter for the relevant Erlang distribution.


title: MotionCraft: Physics-based Zero-Shot Video Generation

abstract: Generating videos with realistic and physically plausible motion is one of the main recent challenges in computer vision. While diffusion models are achieving compelling results in image generation, video diffusion models are limited by heavy training and huge models, resulting in videos that are still biased to the training dataset. In this work we propose MotionCraft, a new zero-shot video generator to craft physics-based and realistic videos. MotionCraft is able to warp the noise latent space of an image diffusion model, such as Stable Diffusion, by applying an optical flow derived from a physics simulation. We show that warping the noise latent space results in coherent application of the desired motion while allowing the model to generate missing elements consistent with the scene evolution, which would otherwise result in artefacts or missing content if the flow was applied in the pixel space. We compare our method with the state-of-the-art Text2Video-Zero reporting qualitative and quantitative improvements, demonstrating the effectiveness of our approach to generate videos with finely-prescribed complex motion dynamics. Project page: https://mezzelfo.github.io/MotionCraft/


title: The ESO-VLT MIKiS survey reloaded: the internal kinematics of the core of M75

abstract: We present the results of a study aimed at characterizing the kinematics of the inner regions of the halo globular cluster M75 (NGC 6864) based on data acquired as part of the ESO-VLT Multi-Instrument Kinematic Survey (MIKiS) of Galactic globular clusters. Our analysis includes the first determination of the line-of-sight velocity dispersion profile in the core region of M75. By using MUSE/NFM observations, we obtained a sample of $\sim 1900$ radial velocity measurements from individual stars located within $16''$ (corresponding to about $r < 3 r_c$ where $r_c$ is the estimated core radius of the system) from the cluster center. After an appropriate selection of the most accurate velocity measures, we determined the innermost portion of the velocity dispersion profile, finding that it is characterized by a constant behavior and a central velocity dispersion of $\sigma_0\sim 9$ km s$^{-1}$. The simultaneous King model fitting to the projected velocity dispersion and density profiles allowed us to check and update previous determinations of the main structural parameters of the system. We also detected a mild hint of rotation in the central $\sim 7''$ from the center, with an amplitude of just $\sim 1.0$ km s$^{-1}$ and a position angle of the rotation axis of PA$_0 = 174\deg$. Intriguingly, the position angle is consistent with that previously quoted for the suspected rotation signal in the outer region of the cluster. Taking advantage of the high quality of the photometric catalog used for the analysis of the MUSE spectra, we also provide updated estimates of the cluster distance, age, and reddening.


title: Identification of microstructure from macroscopic measurement using inverse multiscale analysis

abstract: Most of the tailored materials are heterogeneous at the ingredient level. Analysis of those heterogeneous structures requires the knowledge of microstructure. With the knowledge of microstructure, multiscale analysis is carried out with homogenization at the micro level. Second-order homogenization is carried out whenever the ingredient size is comparable to the structure size. Therefore, knowledge of microstructure and its size is indispensable to analyzing those heterogeneous structures. Again, any structural response contains all the information of microstructure, like microstructure distribution, volume fraction, size of ingredients, etc. Here, inverse analysis is carried out to identify a heterogeneous microstructure from macroscopic measurement. Two-step inverse analysis is carried out in the identification process; in the first step, the macrostructures length scale and effective properties are identified from the macroscopic measurement using gradient-based optimization. In the second step, those effective properties and length scales are used to determine the microstructure in inverse second-order homogenization.


title: Navigating User Experience of ChatGPT-based Conversational Recommender Systems: The Effects of Prompt Guidance and Recommendation Domain

abstract: Conversational recommender systems (CRS) enable users to articulate their preferences and provide feedback through natural language. With the advent of large language models (LLMs), the potential to enhance user engagement with CRS and augment the recommendation process with LLM-generated content has received increasing attention. However, the efficacy of LLM-powered CRS is contingent upon the use of prompts, and the subjective perception of recommendation quality can differ across various recommendation domains. Therefore, we have developed a ChatGPT-based CRS to investigate the impact of these two factors, prompt guidance (PG) and recommendation domain (RD), on the overall user experience of the system. We conducted an online empirical study (N = 100) by employing a mixed-method approach that utilized a between-subjects design for the variable of PG (with vs. without) and a within-subjects design for RD (book recommendations vs. job recommendations). The findings reveal that PG can substantially enhance the system's explainability, adaptability, perceived ease of use, and transparency. Moreover, users are inclined to perceive a greater sense of novelty and demonstrate a higher propensity to engage with and try recommended items in the context of book recommendations as opposed to job recommendations. Furthermore, the influence of PG on certain user experience metrics and interactive behaviors appears to be modulated by the recommendation domain, as evidenced by the interaction effects between the two examined factors. This work contributes to the user-centered evaluation of ChatGPT-based CRS by investigating two prominent factors and offers practical design guidance.


title: How to Answer Questions of the Type: If you toss a coin n times, how likely is HH to show up more than HT?

abstract: On March 16, 2024, Daniel Litt, in an X-post, proposed the following brainteaser: "Flip a fair coin 100 times. It gives a sequence of heads (H) and tails (T). For each HH in the sequence of flips, Alice gets a point; for each HT, Bob does, so e.g. for the sequence THHHT Alice gets 2 points and Bob gets 1 point. Who is most likely to win?" We show the power of symbolic computation, in particular the (continuous) Almkvist-Zeilberger algorithm, to answer this, and far more general, questions of this kind.


title: Rare and Exotic Higgs decays at ATLAS and CMS

abstract: After the Higgs boson discovery in 2012, the experiments at the LHC are continuing to study this particle and look for physics beyond the standard model. Some of the Higgs boson properties, such as the mass, has been measured with sub-percent level accuracy. Yet the present integrated luminosity is still a limiting factor for measuring the Higgs boson self-coupling or the first generation Yukawa couplings. The current constraints on the Higgs boson couplings would still allow for a sizeable branching fraction into undetected final states, which motivates the direct searches for rare and exotic decay modes. This presentation discusses several new results from these searches utilizing advanced online selection methods or analysis techniques with the entire Run 2 data.


title: Algorithmic Planning of Ventilation Systems: Optimising for Life-Cycle Costs and Acoustic Comfort

abstract: The increasing significance of energy efficiency in the building sector necessitates innovative planning to reduce energy consumption while maintaining occupant comfort. With the rise in mechanically ventilated buildings, traditional sequential planning methods, which first ensure outdoor air supply before addressing acoustics, are being reassessed due to their risk for suboptimal solutions. This study introduces a holistic algorithmic methodology for ventilation system design to minimise life-cycle costs while ensuring acoustically feasible solutions. Utilising discrete mathematics, the approach models components' impact on airflow, acoustics, power consumption, and costs, across multiple load cases, culminating in a 2-stage stochastic Mixed-Integer Nonlinear Program. A case study demonstrates the methodology's applicability and the trade-off between energy efficiency and noise levels, highlighting its potential for more complex buildings. This integrated approach marks a significant advancement in ventilation system optimisation, promoting more holistic and efficient building designs while allowing for a more transparent decision-making.


title: Hybrid Event-triggered Control of Nonlinear System with Full State Constraints and Disturbance

abstract: This article focuses on the problem of adaptive tracking control for a specific type of nonlinear system that is subject to full-state constraints via a hybrid event-triggered control (HETC) strategy. With the auxiliary system, we proposed a 'log' function to deal with the full-state constraint. Additionally, a disturbance observer (DO) is constructed to handle the unmeasurable external disturbance. Then, by employing radial basis function neural networks (RBFNNs) and a first-order differentiator, an opportune backstepping design procedure is given to avoid the problem of "explosion of complexity". The HETC strategy, including the fixed and relative threshold, is presented to provide more flexibility in balancing the system performances and network burdens. Finally, to demonstrate the effectiveness of the aforementioned control scheme, a simulation example is presented to validate its effectiveness.


title: AI-Assisted Assessment of Coding Practices in Modern Code Review

abstract: Modern code review is a process in which an incremental code contribution made by a code author is reviewed by one or more peers before it is committed to the version control system. An important element of modern code review is verifying that code contributions adhere to best practices. While some of these best practices can be automatically verified, verifying others is commonly left to human reviewers. This paper reports on the development, deployment, and evaluation of AutoCommenter, a system backed by a large language model that automatically learns and enforces coding best practices. We implemented AutoCommenter for four programming languages (C++, Java, Python, and Go) and evaluated its performance and adoption in a large industrial setting. Our evaluation shows that an end-to-end system for learning and enforcing coding best practices is feasible and has a positive impact on the developer workflow. Additionally, this paper reports on the challenges associated with deploying such a system to tens of thousands of developers and the corresponding lessons learned.


title: Bounds on the approximation error for deep neural networks applied to dispersive models: Nonlinear waves

abstract: We present a comprehensive framework for deriving rigorous and efficient bounds on the approximation error of deep neural networks in PDE models characterized by branching mechanisms, such as waves, Schr\"odinger equations, and other dispersive models. This framework utilizes the probabilistic setting established by Henry-Labord\`ere and Touzi. We illustrate this approach by providing rigorous bounds on the approximation error for both linear and nonlinear waves in physical dimensions $d=1,2,3$, and analyze their respective computational costs starting from time zero. We investigate two key scenarios: one involving a linear perturbative source term, and another focusing on pure nonlinear internal interactions.


title: Accessing Semi-Addressable Self Assembly with Efficient Structure Enumeration

abstract: Modern experimental methods enable the creation of self-assembly building blocks with tunable interactions, but optimally exploiting this tunability for the self-assembly of desired structures remains an important challenge. Many studies of this inverse problem start with the so-called fully-addressable limit, where every particle in a target structure is different. This leads to clear design principles that often result in high assembly yield, but it is not a scaleable approach -- at some point, one must grapple with ``reusing'' building blocks, which lowers the degree of addressability and may cause a multitude of off-target structures to form. While the existence of off-target structures does not necessarily preclude high yield assembly of the target structure(s), it massively complicates the design process because it is often unclear if or how these off-target structures can be controlled. Here, we solve a key obstacle preventing robust inverse design in the ``semi-addressable regime'' by developing a highly efficient algorithm that enumerates all structures that can be formed from a given set of building blocks. By combining this with established partition-function-based yield calculations, we successfully inverse design for target structures while minimizing the required number of distinct building block species. Furthermore, we show that it is almost always possible to find semi-addressable designs where the entropic gain from reusing building blocks outweighs the presence of off-target structures and even increases the yield of the target. Thus, not only does our enumeration algorithm enable robust and scalable inverse design in the semi-addressable regime, our results demonstrate that it is possible to operate in this regime while maintaining the level of control often associated with full addressability.


title: CPE-Identifier: Automated CPE identification and CVE summaries annotation with Deep Learning and NLP

abstract: With the drastic increase in the number of new vulnerabilities in the National Vulnerability Database (NVD) every year, the workload for NVD analysts to associate the Common Platform Enumeration (CPE) with the Common Vulnerabilities and Exposures (CVE) summaries becomes increasingly laborious and slow. The delay causes organisations, which depend on NVD for vulnerability management and security measurement, to be more vulnerable to zero-day attacks. Thus, it is essential to come out with a technique and tool to extract the CPEs in the CVE summaries accurately and quickly. In this work, we propose the CPE-Identifier system, an automated CPE annotating and extracting system, from the CVE summaries. The system can be used as a tool to identify CPE entities from new CVE text inputs. Moreover, we also automate the data generating and labeling processes using deep learning models. Due to the complexity of the CVE texts, new technical terminologies appear frequently. To identify novel words in future CVE texts, we apply Natural Language Processing (NLP) Named Entity Recognition (NER), to identify new technical jargons in the text. Our proposed model achieves an F1 score of 95.48%, an accuracy score of 99.13%, a precision of 94.83%, and a recall of 96.14%. We show that it outperforms prior works on automated CVE-CPE labeling by more than 9% on all metrics.


title: Synchronization through frequency shuffling

abstract: A wide variety of engineered and natural systems are modelled as networks of coupled nonlinear oscillators. In nature, the intrinsic frequencies of these oscillators are not constant in time. Here, we probe the effect of such a temporal heterogeneity on coupled oscillator networks, through the lens of the Kuramoto model. To do this, we shuffle repeatedly the intrinsic frequencies among the oscillators at either random or regular time intervals. What emerges is the remarkable effect that frequent shuffling induces earlier onset (i.e., at a lower coupling) of synchrony among the oscillator phases. Our study provides a novel strategy to induce and control synchrony under resource constraints. We demonstrate our results analytically and in experiments with a network of Wien Bridge oscillators with internal frequencies being shuffled in time.


title: MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation

abstract: The recent advancement of generative foundational models has ushered in a new era of image generation in the realm of natural images, revolutionizing art design, entertainment, environment simulation, and beyond. Despite producing high-quality samples, existing methods are constrained to generating images of scenes at a limited scale. In this paper, we present MetaEarth, a generative foundation model that breaks the barrier by scaling image generation to a global level, exploring the creation of worldwide, multi-resolution, unbounded, and virtually limitless remote sensing images. In MetaEarth, we propose a resolution-guided self-cascading generative framework, which enables the generating of images at any region with a wide range of geographical resolutions. To achieve unbounded and arbitrary-sized image generation, we design a novel noise sampling strategy for denoising diffusion models by analyzing the generation conditions and initial noise. To train MetaEarth, we construct a large dataset comprising multi-resolution optical remote sensing images with geographical information. Experiments have demonstrated the powerful capabilities of our method in generating global-scale images. Additionally, the MetaEarth serves as a data engine that can provide high-quality and rich training data for downstream tasks. Our model opens up new possibilities for constructing generative world models by simulating Earth visuals from an innovative overhead perspective.


title: Cross-Modal Distillation in Industrial Anomaly Detection: Exploring Efficient Multi-Modal IAD

abstract: Recent studies of multi-modal Industrial Anomaly Detection (IAD) based on point clouds and RGB images indicated the importance of exploiting redundancy and complementarity among modalities for accurate classification and segmentation. However, achieving multi-modal IAD in practical production lines remains a work in progress that requires consideration of the trade-offs between costs and benefits associated with introducing new modalities, while ensuring compatibility with current processes. Combining fast in-line inspections with high-resolution, time-consuming, near-line characterization techniques to enhance detection accuracy fits well into the existing quality control process, but only part of the samples can be tested with expensive near-line methods. Thus, the model must have the ability to leverage multi-modal training and handle incomplete modalities during inference. One solution is generating cross-modal hallucination to transfer knowledge among modalities for missing modality issues. In this paper, we propose CMDIAD, a Cross-Modal Distillation framework for IAD to demonstrate the feasibility of Multi-modal Training, Few-modal Inference pipeline. Moreover, we investigate reasons behind the asymmetric performance improvement using point clouds or RGB images as main modality of inference. This lays the foundation of our future multi-modal dataset construction for efficient IAD from manufacturing scenarios.


title: Illustrating the Efficiency of Popular Evolutionary Multi-Objective Algorithms Using Runtime Analysis

abstract: Runtime analysis has recently been applied to popular evolutionary multi-objective (EMO) algorithms like NSGA-II in order to establish a rigorous theoretical foundation. However, most analyses showed that these algorithms have the same performance guarantee as the simple (G)SEMO algorithm. To our knowledge, there are no runtime analyses showing an advantage of a popular EMO algorithm over the simple algorithm for deterministic problems. We propose such a problem and use it to showcase the superiority of popular EMO algorithms over (G)SEMO: OneTrapZeroTrap is a straightforward generalization of the well-known Trap function to two objectives. We prove that, while GSEMO requires at least $n^n$ expected fitness evaluations to optimise OneTrapZeroTrap, popular EMO algorithms NSGA-II, NSGA-III and SMS-EMOA, all enhanced with a mild diversity mechanism of avoiding genotype duplication, only require $O(n \log n)$ expected fitness evaluations. Our analysis reveals the importance of the key components in each of these sophisticated algorithms and contributes to a better understanding of their capabilities.


title: Learning Manipulation Skills through Robot Chain-of-Thought with Sparse Failure Guidance

abstract: Defining reward functions for skill learning has been a long-standing challenge in robotics. Recently, vision-language models (VLMs) have shown promise in defining reward signals for teaching robots manipulation skills. However, existing works often provide reward guidance that is too coarse, leading to inefficient learning processes. In this paper, we address this issue by implementing more fine-grained reward guidance. We decompose tasks into simpler sub-tasks, using this decomposition to offer more informative reward guidance with VLMs. We also propose a VLM-based self imitation learning process to speed up learning. Empirical evidence demonstrates that our algorithm consistently outperforms baselines such as CLIP, LIV, and RoboCLIP. Specifically, our algorithm achieves a $5.4 \times$ higher average success rate compared to the best baseline, RoboCLIP, across a series of manipulation tasks.


title: Reinforcement Learning for Adaptive MCMC

abstract: An informal observation, made by several authors, is that the adaptive design of a Markov transition kernel has the flavour of a reinforcement learning task. Yet, to-date it has remained unclear how to actually exploit modern reinforcement learning technologies for adaptive MCMC. The aim of this paper is to set out a general framework, called Reinforcement Learning Metropolis--Hastings, that is theoretically supported and empirically validated. Our principal focus is on learning fast-mixing Metropolis--Hastings transition kernels, which we cast as deterministic policies and optimise via a policy gradient. Control of the learning rate provably ensures conditions for ergodicity are satisfied. The methodology is used to construct a gradient-free sampler that out-performs a popular gradient-free adaptive Metropolis--Hastings algorithm on $\approx 90 \%$ of tasks in the PosteriorDB benchmark.


title: PDMLP: Patch-based Decomposed MLP for Long-Term Time Series Forecasting

abstract: Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we remain skeptical of Transformers as a solution for LTSF. We attribute the effectiveness of these models largely to the adopted Patch mechanism, which enhances sequence locality to an extent yet fails to fully address the loss of temporal information inherent to the permutation-invariant self-attention mechanism. Further investigation suggests that simple linear layers augmented with the Patch mechanism may outperform complex Transformer-based LTSF models. Moreover, diverging from models that use channel independence, our research underscores the importance of cross-variable interactions in enhancing the performance of multivariate time series forecasting. The interaction information between variables is highly valuable but has been misapplied in past studies, leading to suboptimal cross-variable models. Based on these insights, we propose a novel and simple Patch-based Decomposed MLP (PDMLP) for LTSF tasks. Specifically, we employ simple moving averages to extract smooth components and noise-containing residuals from time series data, engaging in semantic information interchange through channel mixing and specializing in random noise with channel independence processing. The PDMLP model consistently achieves state-of-the-art results on several real-world datasets. We hope this surprising finding will spur new research directions in the LTSF field and pave the way for more efficient and concise solutions.


title: FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Research

abstract: With the advent of Large Language Models (LLMs), the potential of Retrieval Augmented Generation (RAG) techniques have garnered considerable research attention. Numerous novel algorithms and models have been introduced to enhance various aspects of RAG systems. However, the absence of a standardized framework for implementation, coupled with the inherently intricate RAG process, makes it challenging and time-consuming for researchers to compare and evaluate these approaches in a consistent environment. Existing RAG toolkits like LangChain and LlamaIndex, while available, are often heavy and unwieldy, failing to meet the personalized needs of researchers. In response to this challenge, we propose FlashRAG, an efficient and modular open-source toolkit designed to assist researchers in reproducing existing RAG methods and in developing their own RAG algorithms within a unified framework. Our toolkit implements 12 advanced RAG methods and has gathered and organized 32 benchmark datasets. Our toolkit has various features, including customizable modular framework, rich collection of pre-implemented RAG works, comprehensive datasets, efficient auxiliary pre-processing scripts, and extensive and standard evaluation metrics. Our toolkit and resources are available at https://github.com/RUC-NLPIR/FlashRAG.


title: Fast computation of integral bases

abstract: We obtain new complexity bounds for computing a triangular integral basis of a number field or a function field. We reach for function fields a softly linear cost with respect to the size of the output when the residual characteristic is zero or big enough. Analogous results are obtained for integral basis of fractional ideals, key ingredients towards fast computation of Riemann-Roch spaces. The proof is based on the recent fast OM algorithm of the authors and on the MaxMin algorithm of Stainsby, together with optimal truncation bounds and a precise complexity analysis.


title: ConTrans: Weak-to-Strong Alignment Engineering via Concept Transplantation

abstract: Ensuring large language models (LLM) behave consistently with human goals, values, and intentions is crucial for their safety but yet computationally expensive. To reduce the computational cost of alignment training of LLMs, especially for those with a huge number of parameters, and to reutilize learned value alignment, we propose ConTrans, a novel framework that enables weak-to-strong alignment transfer via concept transplantation. From the perspective of representation engineering, ConTrans refines concept vectors in value alignment from a source LLM (usually a weak yet aligned LLM). The refined concept vectors are then reformulated to adapt to the target LLM (usually a strong yet unaligned base LLM) via affine transformation. In the third step, ConTrans transplants the reformulated concept vectors into the residual stream of the target LLM. Experiments demonstrate the successful transplantation of a wide range of aligned concepts from 7B models to 13B and 70B models across multiple LLMs and LLM families. Remarkably, ConTrans even surpasses instruction-tuned models in terms of truthfulness. Experiment results validate the effectiveness of both inter-LLM-family and intra-LLM-family concept transplantation. Our work successfully demonstrates an alternative way to achieve weak-to-strong alignment generalization and control.


title: On character expansion and Gaussian regularization of Itzykson-Zuber measure

abstract: Character expansions are among the most important approaches to modern quantum field theory, which substitute integrals by combinations of peculiar special functions from the Schur-Macdonald family. These formulas allow various deformations, which are not transparent in integral formulation. We analyze from this point of view the Itzykson-Zuber integral over unitary matrices which is exactly solvable, but difficult to deform in $\beta$ and $(q,t)$ directions. Character expansion straightforwardly resolves this problem. However, taking averages with the so defined measure can look problematic, because integrals of individual expansion terms often diverge and well defined is only the sum of them. We explain a way to overcome this problem by Gaussian regularization, which can have a broad range of further applications.


title: AltChart: Enhancing VLM-based Chart Summarization Through Multi-Pretext Tasks

abstract: Chart summarization is a crucial task for blind and visually impaired individuals as it is their primary means of accessing and interpreting graphical data. Crafting high-quality descriptions is challenging because it requires precise communication of essential details within the chart without vision perception. Many chart analysis methods, however, produce brief, unstructured responses that may contain significant hallucinations, affecting their reliability for blind people. To address these challenges, this work presents three key contributions: (1) We introduce the AltChart dataset, comprising 10,000 real chart images, each paired with a comprehensive summary that features long-context, and semantically rich annotations. (2) We propose a new method for pretraining Vision-Language Models (VLMs) to learn fine-grained chart representations through training with multiple pretext tasks, yielding a performance gain with ${\sim}2.5\%$. (3) We conduct extensive evaluations of four leading chart summarization models, analyzing how accessible their descriptions are. Our dataset and codes are publicly available on our project page: https://github.com/moured/AltChart.


title: Safety Alignment for Vision Language Models

abstract: Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs is vulnerable, with attackers easily bypassing LLMs' safety alignment through visual modality features to launch attacks. To address this issue, we enhance the existing VLMs' visual modality safety alignment by adding safety modules, including a safety projector, safety tokens, and a safety head, through a two-stage training process, effectively improving the model's defense against risky images. For example, building upon the LLaVA-v1.5 model, we achieve a safety score of 8.26, surpassing the GPT-4V on the Red Teaming Visual Language Models (RTVLM) benchmark. Our method boasts ease of use, high flexibility, and strong controllability, and it enhances safety while having minimal impact on the model's general performance. Moreover, our alignment strategy also uncovers some possible risky content within commonly used open-source multimodal datasets. Our code will be open sourced after the anonymous review.


title: Dual-Capability Machine Learning Models for Quantum Hamiltonian Parameter Estimation and Dynamics Prediction

abstract: Recent advancements in quantum hardware and classical computing simulations have significantly enhanced the accessibility of quantum system data, leading to an increased demand for precise descriptions and predictions of these systems. Accurate prediction of quantum Hamiltonian dynamics and identification of Hamiltonian parameters are crucial for advancements in quantum simulations, error correction, and control protocols. This study introduces a machine learning model with dual capabilities: it can deduce time-dependent Hamiltonian parameters from observed changes in local observables within quantum many-body systems, and it can predict the evolution of these observables based on Hamiltonian parameters. Our model's validity was confirmed through theoretical simulations across various scenarios and further validated by two experiments. Initially, the model was applied to a Nuclear Magnetic Resonance quantum computer, where it accurately predicted the dynamics of local observables. The model was then tested on a superconducting quantum computer with initially unknown Hamiltonian parameters, successfully inferring them. Our approach aims to enhance various quantum computing tasks, including parameter estimation, noise characterization, feedback processes, and quantum control optimization.


title: Tools at the Frontiers of Quantitative Verification

abstract: The analysis of formal models that include quantitative aspects such as timing or probabilistic choices is performed by quantitative verification tools. Broad and mature tool support is available for computing basic properties such as expected rewards on basic models such as Markov chains. Previous editions of QComp, the comparison of tools for the analysis of quantitative formal models, focused on this setting. Many application scenarios, however, require more advanced property types such as LTL and parameter synthesis queries as well as advanced models like stochastic games and partially observable MDPs. For these, tool support is in its infancy today. This paper presents the outcomes of QComp 2023: a survey of the state of the art in quantitative verification tool support for advanced property types and models. With tools ranging from first research prototypes to well-supported integrations into established toolsets, this report highlights today's active areas and tomorrow's challenges in tool-focused research for quantitative verification.


title: Emulating Full Client Participation: A Long-Term Client Selection Strategy for Federated Learning

abstract: Client selection significantly affects the system convergence efficiency and is a crucial problem in federated learning. Existing methods often select clients by evaluating each round individually and overlook the necessity for long-term optimization, resulting in suboptimal performance and potential fairness issues. In this study, we propose a novel client selection strategy designed to emulate the performance achieved with full client participation. In a single round, we select clients by minimizing the gradient-space estimation error between the client subset and the full client set. In multi-round selection, we introduce a novel individual fairness constraint, which ensures that clients with similar data distributions have similar frequencies of being selected. This constraint guides the client selection process from a long-term perspective. We employ Lyapunov optimization and submodular functions to efficiently identify the optimal subset of clients, and provide a theoretical analysis of the convergence ability. Experiments demonstrate that the proposed strategy significantly improves both accuracy and fairness compared to previous methods while also exhibiting efficiency by incurring minimal time overhead.