title: An Opacity-Free Method of Testing the Cosmic Distance Duality Relation Using Strongly Lensed Gravitational Wave Signals

abstract: The cosmic distance duality relation (CDDR), expressed as DL(z) = (1 + z)2DA(z), plays an important role in modern cosmology. In this paper, we propose a new method of testing CDDR using strongly lensed gravitational wave (SLGW) signals. Under the geometric optics approximation, we calculate the gravitational lens effects of two lens models, the point mass and singular isothermal sphere. We use functions of {\eta}1(z) = 1 + {\eta}0z and {\eta}2(z) = 1 + {\eta}0z=(1 + z) to parameterize the deviation of CDDR. By reparameterizing the SLGW waveform with CDDR and the distance-redshift relation, we include the deviation parameters {\eta}0 of CDDR as waveform parameters. We evaluate the ability of this method by calculating the parameter estimation of simulated SLGW signals from massive binary black holes. We apply the Fisher information matrix and Markov Chain Monte Carlo methods to calculate parameter estimation. We find that with only one SLGW signal, the measurement precision of {\eta}0 can reach a considerable level of 0.5-1.3% for {\eta}1(z) and 1.1-2.6% for {\eta}2(z), depending on the lens model and parameters.


title: Towards an Enforceable GDPR Specification

abstract: While Privacy by Design (PbD) is prescribed by modern privacy regulations such as the EU's GDPR, achieving PbD in real software systems is a notoriously difficult task. One emerging technique to realize PbD is Runtime enforcement (RE), in which an enforcer, loaded with a specification of a system's privacy requirements, observes the actions performed by the system and instructs it to perform actions that will ensure compliance with these requirements at all times. To be able to use RE techniques for PbD, privacy regulations first need to be translated into an enforceable specification. In this paper, we report on our ongoing work in formalizing the GDPR. We first present a set of requirements and an iterative methodology for creating enforceable formal specifications of legal provisions. Then, we report on a preliminary case study in which we used our methodology to derive an enforceable specification of part of the GDPR. Our case study suggests that our methodology can be effectively used to develop accurate enforceable specifications.


title: ICP-Flow: LiDAR Scene Flow Estimation with ICP

abstract: Scene flow characterizes the 3D motion between two LiDAR scans captured by an autonomous vehicle at nearby timesteps. Prevalent methods consider scene flow as point-wise unconstrained flow vectors that can be learned by either large-scale training beforehand or time-consuming optimization at inference. However, these methods do not take into account that objects in autonomous driving often move rigidly. We incorporate this rigid-motion assumption into our design, where the goal is to associate objects over scans and then estimate the locally rigid transformations. We propose ICP-Flow, a learning-free flow estimator. The core of our design is the conventional Iterative Closest Point (ICP) algorithm, which aligns the objects over time and outputs the corresponding rigid transformations. Crucially, to aid ICP, we propose a histogram-based initialization that discovers the most likely translation, thus providing a good starting point for ICP. The complete scene flow is then recovered from the rigid transformations. We outperform state-of-the-art baselines, including supervised models, on the Waymo dataset and perform competitively on Argoverse-v2 and nuScenes. Further, we train a feedforward neural network, supervised by the pseudo labels from our model, and achieve top performance among all models capable of real-time inference. We validate the advantage of our model on scene flow estimation with longer temporal gaps, up to 0.4 seconds where other models fail to deliver meaningful results.


title: Search for neutrino emission from the Cygnus Bubble based on LHAASO $\gamma$-ray observations

abstract: The Cygnus region, which contains massive molecular and atomic clouds and young stars, is a promising Galactic neutrino source candidate. Cosmic rays transport in the region can produce neutrinos and $\gamma$-rays. Recently, the Large High Altitude Air Shower Observatory (LHAASO) detected an ultrahigh-energy $\gamma$-ray bubble (Cygnus Bubble) in this region. Using publicly available track events detected by the IceCube Neutrino Observatory in 7 years of full detector operation, we conduct searches for correlated neutrino signals from the Cygnus Bubble with neutrino emission templates based on LHAASO $\gamma$-ray observations. No significant signals were found for any employed templates. With the 7 TeV $\gamma$-ray flux template, we set a flux upper limit of 90% confidence level (C.L.) for the neutrino emission from the Cygnus Bubble to be $5.7\times10^{-13}\, \mathrm{TeV}^{-1}\mathrm{cm}^{-2}\mathrm{s}^{-1}$ at 5 TeV.


title: H\"ormander type Fourier multiplier theorem and Nikolskii inequality on quantum tori, and applications

abstract: In this paper, we study H\"ormander type Fourier multiplier theorem and the Nikolskii inequality on quantum tori. On the way to obtain these results, we also prove some classical inequalities such as Paley type, Hausdorff-Young-Paley, Hardy-Littlewood, and Logarithmic Sobolev inequalities on quantum tori. As applications we establish embedding theorems between Sobolev, Besov spaces as well as embeddings between Besov and Wiener and Beurling spaces on quantum tori. We also analyse $\beta$-versions of Wiener and Beurling spaces and their embeddings, and interpolation properties of all these spaces on quantum tori. As an applications of the analysis, we also derive a version of the Nash inequality, and the time decay for solutions of a heat type equation.


title: Comment on "Mode Structure and Orbital Angular Momentum of Spatiotemporal Optical Vortex (STOV) Pulses"

abstract: We report a mathematical error and a misinterpretation in arXiv:2103.03263v4 [Phys. Rev. Lett. 127, 193901 (2021)] that has led to a debate about the nature of the transverse orbital angular momentum (OAM) of spatiotemporal optical vortices (STOVs). The transverse OAM of STOVs evaluated theoretically in that Letter is actually only the intrinsic contribution, while the operators used to evaluate the intrinsic and extrinsic contributions are not Hermitian operators as they may lead to complex-valued expectation values.


title: RECOST: External Knowledge Guided Data-efficient Instruction Tuning

abstract: In the current landscape of large language models (LLMs), the process of instruction tuning serves as an essential step. Considering the high computing power overhead, data-efficient instruction tuning was proposed to reduce the training data size in this process, aiming at selecting high-quality instructional data. Nevertheless, we argue that most current data-efficient instruction-tuning methods are highly dependent on the quality of the original instruction-tuning dataset. When it comes to datasets synthesized by LLMs, a common scenario in this field, dirty samples will even be selected with a higher probability than other samples. To address these challenges, we utilized external knowledge (relevant examples or paragraphs) to evaluate those samples synthesized by LLMs with an in-context-based relative predictive entropy. Based on the new metric, we proposed a framework, dubbed as \textbf{RECOST}, which integrates external-knowledge-base re-ranking and diversity-consistent sampling into a single pipeline. Through extensive experiments on several synthetic datasets (Alpaca and Alpaca-gpt4), we demonstrate the effectiveness of our method and achieve even better results with only \textbf{1\%} of the full dataset.


title: Modulation of chiral anomaly and bilinear magnetoconductivity in Weyl semimetals by impurity-resonance states

abstract: The phenomenon of nonlinear transport has attracted tremendous interest within the condensed matter community. We present a theoretical framework for nonlinear transport based on the nonequilibrium retarded Green's function, and examine the impact of disorder on nonlinear magnetotransport in Weyl semimetals (WSMs). It is demonstrated that bilinear magnetoconductivity can be induced in disordered WSMs by several mechanisms, including impurity-induced tilting of the Weyl cones, Lorentz-force-induced normal orbital magnetic moment, and chiral anomaly arising from the Berry-curvature-induced anomalous orbital magnetic moment. Additionally, we observe that the localization of Weyl fermions by impurity scattering will lead to resonant dips in both the chiral chemical potential and magnetoconductivity when the Fermi energy approaches the impurity resonance states. Our findings offer a theoretical proposition for modulating nonreciprocal transport in topological semimetals.


title: A robust parameterized enhanced shift-splitting preconditioner for three-by-three block saddle point problems

abstract: This paper proposes a new parameterized enhanced shift-splitting (PESS) preconditioner to solve the three-by-three block saddle point problem (SPP). Additionally, we introduce a local PESS (LPESS) preconditioner by relaxing the PESS preconditioner. Necessary and sufficient criteria are established for the convergence of the proposed PESS iterative process for any random initial guess. Furthermore, we meticulously investigate the spectral bounds of the PESS and LPESS preconditioned matrices. Moreover, empirical investigations have been performed for the sensitivity analysis of the proposed PESS preconditioner, which unveils its robustness. Numerical experiments are carried out to demonstrate the enhanced efficiency and robustness of the proposed PESS and LPESS preconditioners compared to the existing block diagonal and shift-splitting preconditioners.


title: SoFA: Shielded On-the-fly Alignment via Priority Rule Following

abstract: The alignment problem in Large Language Models (LLMs) involves adapting them to the broad spectrum of human values. This requirement challenges existing alignment methods due to diversity of preferences and regulatory standards. This paper introduces a novel alignment paradigm, priority rule following, which defines rules as the primary control mechanism in each dialog, prioritizing them over user instructions. Our preliminary analysis reveals that even the advanced LLMs, such as GPT-4, exhibit shortcomings in understanding and prioritizing the rules. Therefore, we present PriorityDistill, a semi-automated approach for distilling priority following signals from LLM simulations to ensure robust rule integration and adherence. Our experiments show that this method not only effectively minimizes misalignments utilizing only one general rule but also adapts smoothly to various unseen rules, ensuring they are shielded from hijacking and that the model responds appropriately.


title: Limit Order Book Simulations: A Review

abstract: Limit Order Books (LOBs) serve as a mechanism for buyers and sellers to interact with each other in the financial markets. Modelling and simulating LOBs is quite often necessary for calibrating and fine-tuning the automated trading strategies developed in algorithmic trading research. The recent AI revolution and availability of faster and cheaper compute power has enabled the modelling and simulations to grow richer and even use modern AI techniques. In this review we examine the various kinds of LOB simulation models present in the current state of the art. We provide a classification of the models on the basis of their methodology and provide an aggregate view of the popular stylized facts used in the literature to test the models. We additionally provide a focused study of price impact's presence in the models since it is one of the more crucial phenomena to model in algorithmic trading. Finally, we conduct a comparative analysis of various qualities of fits of these models and how they perform when tested against empirical data.


title: CAPT: Category-level Articulation Estimation from a Single Point Cloud Using Transformer

abstract: The ability to estimate joint parameters is essential for various applications in robotics and computer vision. In this paper, we propose CAPT: category-level articulation estimation from a point cloud using Transformer. CAPT uses an end-to-end transformer-based architecture for joint parameter and state estimation of articulated objects from a single point cloud. The proposed CAPT methods accurately estimate joint parameters and states for various articulated objects with high precision and robustness. The paper also introduces a motion loss approach, which improves articulation estimation performance by emphasizing the dynamic features of articulated objects. Additionally, the paper presents a double voting strategy to provide the framework with coarse-to-fine parameter estimation. Experimental results on several category datasets demonstrate that our methods outperform existing alternatives for articulation estimation. Our research provides a promising solution for applying Transformer-based architectures in articulated object analysis.


title: A granular model for crowd motion and pedestrian flow

abstract: We study a granular model for congested crowd motion and pedestrian flow. Our approach is based on an approximation through a Hele-Shaw type equation involving a degenerate operator of $p$-Laplacian type and a linear drift, for which we prove existence and uniqueness using nonlinear semigroup methods and the doubling variables technique. Our main result shows that, as $p \to \infty$, the weak solutions of the $p-$problem converge to a solution of the congested crowd motion problem.


title: Ambisonics Encoding For Arbitrary Microphone Arrays Incorporating Residual Channels For Binaural Reproduction

abstract: In the rapidly evolving fields of virtual and augmented reality, accurate spatial audio capture and reproduction are essential. For these applications, Ambisonics has emerged as a standard format. However, existing methods for encoding Ambisonics signals from arbitrary microphone arrays face challenges, such as errors due to the irregular array configurations and limited spatial resolution resulting from a typically small number of microphones. To address these limitations and challenges, a mathematical framework for studying Ambisonics encoding is presented, highlighting the importance of incorporating the full steering function, and providing a novel measure for predicting the accuracy of encoding each Ambisonics channel from the steering functions alone. Furthermore, novel residual channels are formulated supplementing the Ambisonics channels. A simulation study for several array configurations demonstrates a reduction in binaural error for this approach.


title: CGGM: A conditional graph generation model with adaptive sparsity for node anomaly detection in IoT networks

abstract: Dynamic graphs are extensively employed for detecting anomalous behavior in nodes within the Internet of Things (IoT). Generative models are often used to address the issue of imbalanced node categories in dynamic graphs. Nevertheless, the constraints it faces include the monotonicity of adjacency relationships, the difficulty in constructing multi-dimensional features for nodes, and the lack of a method for end-to-end generation of multiple categories of nodes. This paper presents a novel graph generation model, called CGGM, designed specifically to generate a larger number of nodes belonging to the minority class. The mechanism for generating an adjacency matrix, through adaptive sparsity, enhances flexibility in its structure. The feature generation module, called multidimensional features generator (MFG) to generate node features along with topological information. Labels are transformed into embedding vectors, serving as conditional constraints to control the generation of synthetic data across multiple categories. Using a multi-stage loss, the distribution of synthetic data is adjusted to closely resemble that of real data. In extensive experiments, we show that CGGM's synthetic data outperforms state-of-the-art methods across various metrics. Our results demonstrate efficient generation of diverse data categories, robustly enhancing multi-category classification model performance.


title: Learning Dynamic Tetrahedra for High-Quality Talking Head Synthesis

abstract: Recent works in implicit representations, such as Neural Radiance Fields (NeRF), have advanced the generation of realistic and animatable head avatars from video sequences. These implicit methods are still confronted by visual artifacts and jitters, since the lack of explicit geometric constraints poses a fundamental challenge in accurately modeling complex facial deformations. In this paper, we introduce Dynamic Tetrahedra (DynTet), a novel hybrid representation that encodes explicit dynamic meshes by neural networks to ensure geometric consistency across various motions and viewpoints. DynTet is parameterized by the coordinate-based networks which learn signed distance, deformation, and material texture, anchoring the training data into a predefined tetrahedra grid. Leveraging Marching Tetrahedra, DynTet efficiently decodes textured meshes with a consistent topology, enabling fast rendering through a differentiable rasterizer and supervision via a pixel loss. To enhance training efficiency, we incorporate classical 3D Morphable Models to facilitate geometry learning and define a canonical space for simplifying texture learning. These advantages are readily achievable owing to the effective geometric representation employed in DynTet. Compared with prior works, DynTet demonstrates significant improvements in fidelity, lip synchronization, and real-time performance according to various metrics. Beyond producing stable and visually appealing synthesis videos, our method also outputs the dynamic meshes which is promising to enable many emerging applications.


title: A Search for Radio Pulsars in Supernova Remnants Using FAST with One Pulsar Discovered

abstract: We report on the results of a search for radio pulsars in five supernova remnants (SNRs) with FAST. The observations were made using the 19-beam receiver in the Snapshot mode. The integration time for each pointing is 10 min. We discovered a new pulsar PSR J1845$-$0306 which has a spin period of 983.6 ms and a dispersion measure of 444.6$\pm$2.0 cm$^{-3}$ pc in observations of SNR G29.6+0.1. To judge the association between the pulsar and the SNR, further verification is needed. We also re-detected some known pulsars in the data from SNRs G29.6+0.1 and G29.7$-$0.3. No pulsars were detected in observations of other three SNRs.


title: The risks of risk assessment: causal blind spots when using prediction models for treatment decisions

abstract: Prediction models are increasingly proposed for guiding treatment decisions, but most fail to address the special role of treatments, leading to inappropriate use. This paper highlights the limitations of using standard prediction models for treatment decision support. We identify `causal blind spots' in three common approaches to handling treatments in prediction modelling: including treatment as a predictor, restricting data based on treatment status and ignoring treatments. When predictions are used to inform treatment decisions, confounders, colliders and mediators, as well as changes in treatment protocols over time may lead to misinformed decision-making. We illustrate potential harmful consequences in several medical applications. We advocate for an extension of guidelines for development, reporting and evaluation of prediction models to ensure that the intended use of the model is matched to an appropriate risk estimand. When prediction models are intended to inform treatment decisions, prediction models should specify upfront the treatment decisions they aim to support and target a prediction estimand in line with that goal. This requires a shift towards developing predictions under the specific treatment options under consideration (`predictions under interventions'). Predictions under interventions need causal reasoning and inference techniques during development and validation. We argue that this will improve the efficacy of prediction models in guiding treatment decisions and prevent potential negative effects on patient outcomes.


title: Superconducting Electronic Device Response Linearity Calculation Method Using Discrete Fourier Analysis

abstract: A method for estimating the linearity of superconducting electronic devices is discussed. The method allows the obtaining of expected spurious-free dynamic range values based on the results of preliminary numerical modeling and solving optimization problems. A description of the method and an analysis of measurement errors are provided.


title: Coupled-cluster approach to Coster-Kronig decay and Auger decay in hydrogen sulfide and argon

abstract: We perform ab initio simulations of the total and partial Auger decay widths of 1s^-1, 2s^-1, and 2p^-1 ionized hydrogen sulfide and 2s^-1 ionized argon with non-Hermitian quantum chemistry. We use coupled cluster theory with single and double substitutions (CCSD) and equation of motion CCSD (EOM-CCSD) and discuss the novel application of (equation of motion-) second order M{\o}ller-Plesset perturbation theory (MP2). We find good agreement between the methods for the 1s^-1 hole of H2S, whereas for the other holes we can only use the EOM methods. We obtain very large decay widths of the 2s^-1-vacant states due to intense Coster-Kronig transitions with excellent agreement to experiments. The three 2p^-1 holes show completely different spectra because a decay channel is only significant when one of the final holes is spatially aligned with the initial hole. Lastly, we observe that triplet channels are much more important for the 2s^-1 and 2p^-1 holes than for the 1s^-1 hole, for which it is well known that triplet channels only contribute weakly to the total Auger intensity.


title: Computing Functions of Symmetric Hierarchically Semiseparable Matrices

abstract: The aim of this work is to develop a fast algorithm for approximating the matrix function $f(A)$ of a square matrix $A$ that is symmetric and has hierarchically semiseparable (HSS) structure. Appearing in a wide variety of applications, often in the context of discretized (fractional) differential and integral operators, HSS matrices have a number of attractive properties facilitating the development of fast algorithms. In this work, we use an unconventional telescopic decomposition of $A$, inspired by recent work of Levitt and Martinsson on approximating an HSS matrix from matrix-vector products with a few random vectors. This telescopic decomposition allows us to approximate $f(A)$ by recursively performing low-rank updates with rational Krylov subspaces while keeping the size of the matrices involved in the rational Krylov subspaces small. In particular, no large-scale linear system needs to be solved, which yields favorable complexity estimates and reduced execution times compared to existing methods, including an existing divide-and-conquer strategy. The advantages of our newly proposed algorithms are demonstrated for a number of examples from the literature, featuring the exponential, the inverse square root, and the sign function of a matrix. Even for matrix inversion, our algorithm exhibits superior performance, even if not specifically designed for this task.


title: An Efficient MLP-based Point-guided Segmentation Network for Ore Images with Ambiguous Boundary

abstract: The precise segmentation of ore images is critical to the successful execution of the beneficiation process. Due to the homogeneous appearance of the ores, which leads to low contrast and unclear boundaries, accurate segmentation becomes challenging, and recognition becomes problematic. This paper proposes a lightweight framework based on Multi-Layer Perceptron (MLP), which focuses on solving the problem of edge burring. Specifically, we introduce a lightweight backbone better suited for efficiently extracting low-level features. Besides, we design a feature pyramid network consisting of two MLP structures that balance local and global information thus enhancing detection accuracy. Furthermore, we propose a novel loss function that guides the prediction points to match the instance edge points to achieve clear object boundaries. We have conducted extensive experiments to validate the efficacy of our proposed method. Our approach achieves a remarkable processing speed of over 27 frames per second (FPS) with a model size of only 73 MB. Moreover, our method delivers a consistently high level of accuracy, with impressive performance scores of 60.4 and 48.9 in~$AP_{50}^{box}$ and~$AP_{50}^{mask}$ respectively, as compared to the currently available state-of-the-art techniques, when tested on the ore image dataset. The source code will be released at \url{https://github.com/MVME-HBUT/ORENEXT}.


title: A Dataset for Metaphor Detection in Early Medieval Hebrew Poetry

abstract: There is a large volume of late antique and medieval Hebrew texts. They represent a crucial linguistic and cultural bridge between Biblical and modern Hebrew. Poetry is prominent in these texts and one of its main haracteristics is the frequent use of metaphor. Distinguishing figurative and literal language use is a major task for scholars of the Humanities, especially in the fields of literature, linguistics, and hermeneutics. This paper presents a new, challenging dataset of late antique and medieval Hebrew poetry with expert annotations of metaphor, as well as some baseline results, which we hope will facilitate further research in this area.


title: Coupled Laplacian Eigenmaps for Locally-Aware 3D Rigid Point Cloud Matching

abstract: Point cloud matching, a crucial technique in computer vision, medical and robotics fields, is primarily concerned with finding correspondences between pairs of point clouds or voxels. In some practical scenarios, emphasizing local differences is crucial for accurately identifying a correct match, thereby enhancing the overall robustness and reliability of the matching process. Commonly used shape descriptors have several limitations and often fail to provide meaningful local insights on the paired geometries. In this work, we propose a new technique, based on graph Laplacian eigenmaps, to match point clouds by taking into account fine local structures. To deal with the order and sign ambiguity of Laplacian eigenmaps, we introduce a new operator, called Coupled Laplacian, that allows to easily generate aligned eigenspaces for multiple rigidly-registered geometries. We show that the similarity between those aligned high-dimensional spaces provides a locally meaningful score to match shapes. We initially evaluate the performance of the proposed technique in a point-wise manner, specifically focusing on the task of object anomaly localization using the MVTec 3D-AD dataset. Additionally, we define a new medical task, called automatic Bone Side Estimation (BSE), which we address through a global similarity score derived from coupled eigenspaces. In order to test it, we propose a benchmark collecting bone surface structures from various public datasets. Our matching technique, based on Coupled Laplacian, outperforms other methods by reaching an impressive accuracy on both tasks. The code to reproduce our experiments is publicly available at https://github.com/matteo-bastico/CoupledLaplacian and in the Supplementary Code.


title: An improved dense class in Sobolev spaces to manifolds

abstract: We consider the strong density problem in the Sobolev space $ W^{s,p}(Q^{m};\mathscr{N}) $ of maps with values into a compact Riemannian manifold $ \mathscr{N} $. It is known, from the seminal work of Bethuel, that such maps may always be strongly approximated by $ \mathscr{N} $-valued maps that are smooth outside of a finite union of $ (m -\lfloor sp \rfloor - 1) $-planes. Our main result establishes the strong density in $ W^{s,p}(Q^{m};\mathscr{N}) $ of an improved version of the class introduced by Bethuel, where the maps have a singular set without crossings. This answers a question raised by Brezis and Mironescu. In the special case where $ \mathscr{N} $ has a sufficiently simple topology and for some values of $ s $ and $ p $, this result was known to follow from the method of projection, which takes its roots in the work of Federer and Fleming. As a first result, we implement this method in the full range of $ s $ and $ p $ in which it was expected to be applicable. In the case of a general target manifold, we devise a topological argument that allows to remove the self-intersections in the singular set of the maps obtained via Bethuel's technique.


title: Quasi-Bayesian Estimation and Inference with Control Functions

abstract: We consider a quasi-Bayesian method that combines a frequentist estimation in the first stage and a Bayesian estimation/inference approach in the second stage. The study is motivated by structural discrete choice models that use the control function methodology to correct for endogeneity bias. In this scenario, the first stage estimates the control function using some frequentist parametric or nonparametric approach. The structural equation in the second stage, associated with certain complicated likelihood functions, can be more conveniently dealt with using a Bayesian approach. This paper studies the asymptotic properties of the quasi-posterior distributions obtained from the second stage. We prove that the corresponding quasi-Bayesian credible set does not have the desired coverage in large samples. Nonetheless, the quasi-Bayesian point estimator remains consistent and is asymptotically equivalent to a frequentist two-stage estimator. We show that one can obtain valid inference by bootstrapping the quasi-posterior that takes into account the first-stage estimation uncertainty.


title: Impact of Computation in Integral Reinforcement Learning for Continuous-Time Control

abstract: Integral reinforcement learning (IntRL) demands the precise computation of the utility function's integral at its policy evaluation (PEV) stage. This is achieved through quadrature rules, which are weighted sums of utility functions evaluated from state samples obtained in discrete time. Our research reveals a critical yet underexplored phenomenon: the choice of the computational method -- in this case, the quadrature rule -- can significantly impact control performance. This impact is traced back to the fact that computational errors introduced in the PEV stage can affect the policy iteration's convergence behavior, which in turn affects the learned controller. To elucidate how computation impacts control, we draw a parallel between IntRL's policy iteration and Newton's method applied to the Hamilton-Jacobi-Bellman equation. In this light, computational error in PEV manifests as an extra error term in each iteration of Newton's method, with its upper bound proportional to the computational error. Further, we demonstrate that when the utility function resides in a reproducing kernel Hilbert space (RKHS), the optimal quadrature is achievable by employing Bayesian quadrature with the RKHS-inducing kernel function. We prove that the local convergence rates for IntRL using the trapezoidal rule and Bayesian quadrature with a Mat\'ern kernel to be $O(N^{-2})$ and $O(N^{-b})$, where $N$ is the number of evenly-spaced samples and $b$ is the Mat\'ern kernel's smoothness parameter. These theoretical findings are finally validated by two canonical control tasks.


title: Accelerating Diffusion Sampling with Optimized Time Steps

abstract: Diffusion probabilistic models (DPMs) have shown remarkable performance in high-resolution image synthesis, but their sampling efficiency is still to be desired due to the typically large number of sampling steps. Recent advancements in high-order numerical ODE solvers for DPMs have enabled the generation of high-quality images with much fewer sampling steps. While this is a significant development, most sampling methods still employ uniform time steps, which is not optimal when using a small number of steps. To address this issue, we propose a general framework for designing an optimization problem that seeks more appropriate time steps for a specific numerical ODE solver for DPMs. This optimization problem aims to minimize the distance between the ground-truth solution to the ODE and an approximate solution corresponding to the numerical solver. It can be efficiently solved using the constrained trust region method, taking less than $15$ seconds. Our extensive experiments on both unconditional and conditional sampling using pixel- and latent-space DPMs demonstrate that, when combined with the state-of-the-art sampling method UniPC, our optimized time steps significantly improve image generation performance in terms of FID scores for datasets such as CIFAR-10 and ImageNet, compared to using uniform time steps.


title: KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark

abstract: As language models are often deployed as chatbot assistants, it becomes a virtue for models to engage in conversations in a user's first language. While these models are trained on a wide range of languages, a comprehensive evaluation of their proficiency in low-resource languages such as Korean has been lacking. In this work, we introduce KoDialogBench, a benchmark designed to assess language models' conversational capabilities in Korean. To this end, we collect native Korean dialogues on daily topics from public sources, or translate dialogues from other languages. We then structure these conversations into diverse test datasets, spanning from dialogue comprehension to response selection tasks. Leveraging the proposed benchmark, we conduct extensive evaluations and analyses of various language models to measure a foundational understanding of Korean dialogues. Experimental results indicate that there exists significant room for improvement in models' conversation skills. Furthermore, our in-depth comparisons across different language models highlight the effectiveness of recent training techniques in enhancing conversational proficiency. We anticipate that KoDialogBench will promote the progress towards conversation-aware Korean language models.


title: Warm-Starting the VQE with Approximate Complex Amplitude Encoding

abstract: The Variational Quantum Eigensolver (VQE) is a Variational Quantum Algorithm (VQA) to determine the ground state of quantum-mechanical systems. As a VQA, it makes use of a classical computer to optimize parameter values for its quantum circuit. However, each iteration of the VQE requires a multitude of measurements, and the optimization is subject to obstructions, such as barren plateaus, local minima, and subsequently slow convergence. We propose a warm-starting technique, that utilizes an approximation to generate beneficial initial parameter values for the VQE aiming to mitigate these effects. The warm-start is based on Approximate Complex Amplitude Encoding, a VQA using fidelity estimations from classical shadows to encode complex amplitude vectors into quantum states. Such warm-starts open the path to fruitful combinations of classical approximation algorithms and quantum algorithms. In particular, the evaluation of our approach shows that the warm-started VQE reaches higher quality solutions earlier than the original VQE.


title: A comparative study of flavour-sensitive observables in hadronic Higgs decays

abstract: Jet production from hadronic Higgs decays at future lepton colliders will have significantly different phenomenological implications than jet production via off-shell photon and $Z$-boson decays, owing to the fact that Higgs bosons decay to both pairs of quarks and gluons. We compute observables involving flavoured jets in hadronic Higgs decays to three partons at Born level including next-to-leading order corrections in QCD (i.e up to $\mathcal{O}(\alpha_\mathrm{S}^2))$. The calculation is performed in the framework of an effective theory in which the Higgs boson couples directly to gluons and massless $b$-quarks retaining a non-vanishing Yukawa coupling. For the energy of the leading and subleading flavoured jet, the angular separation and the invariant mass of the leading $b$-$\bar{b}$ pair, we contrast the results obtained in both Higgs decay categories and using either of the infrared-safe flavoured jet algorithms flavour-$k_\mathrm{T}$ and flavour-dressing.


title: $\ast$-conformal Einstein solitons on N(k)-contact metric manifolds

abstract: The main goal of this paper is devoted to N(k)-contact metric manifolds admitting $\ast$-conformal Einstein soliton and also $\ast$-conformal gradient Einstein soliton. In this settings the nature of the manifold, and the potential vector field, potential function of solitons are characterized, and conditions for the $\ast$-conformal Einstein soliton to be expanding, steady, or shrinking are also given. Furthermore, the nature of the potential vector field is evolved when the metric g of N(k)-contact metric manifold satisfies $\ast$-conformal gradient Einstein soliton. Finally, an illustrative example of a N(k)-contact metric manifold is discussed to verify our findings.


title: Prospects of Identifying Hierarchical Triple Mergers for the Third-generation Ground-based Detectors

abstract: A hierarchical triple merger (HTM) constitutes a type of event in which two successive black hole (BH) mergers occur sequentially within the observational window of gravitational wave (GW) detectors, which has important role in testing general relativity and studying BH population. In this work, we conduct an analysis to determine the feasibility of identifying HTMs from a large GW event catalog using the third-generation ground-based GW detectors. By comparing the Bhattacharyya coefficient that measures the overlap between the posterior distributions of the remnant and progenitor BH parameters, we find that the overlap between the event pair can serve as a preliminary filter, which balances between computational demand and the probability of false alarms. Following this initial, time-efficient, yet less accurate screening, a subset of potential HTM candidates will be retained. These candidates will subsequently be subjected to a more precise, albeit time-intensive, method of joint parameter estimation for verification. Ultimately, this process will enable us to robustly identify HTMs.


title: Detection of a cyclotron line in the Be X-ray pulsar IGR J06074$+$2205

abstract: IGR J0607.4+2205 is a transient Be X-ray binary discovered two decades ago. IGR J0607.4+2205 underwent an outburst in 2023 during which it was observed twice with \textit{NuSTAR}. The main goal of this work is to model the broadband X-ray spectrum of IGR J0607.4+2205 during the outburst and to study the variations of the spectral and timing features at different intensities. We extracted the light curve and spectrum of the source from the two \textit{NuSTAR} observations carried out during the recent outburst in the energy range of 3$-$78 keV. We used the epoch folding technique to find pulsation from the source and to study the changes in emission characteristics from the source with energy across an order of magnitude variation in source luminosity. IGR J0607.4+2205 shows pulsations with a period of $\sim$347.6 s during both the observations, with a pulse fraction of $\geq$50\%. The broadband spectrum of the source was modelled using a power-law continuum with a high-energy cutoff. During the first observation, a cyclotron absorption line at $\sim$51 keV was also present in the source with an optical depth of $\sim$1.3. However, no cyclotron line feature was detected in the second observation when the source was an order of magnitude fainter. Additionally, soft excess was detected in the second observation, which was modelled with a black body component emerging from close to the neutron star (NS). We report the first ever detection of a cyclotron line in the broadband spectrum of IGR J0607.4+2205 centred at 51$\pm$1 keV. The magnetic field strength of the NS is estimated to be $\sim$4$\times$$10^{12}$ G from the centroid energy of the absorption line. A significant change is observed in the pulse profile with luminosity during the decay of the outburst, indicating an associated change in the beaming pattern.


title: BSW phenomenon for near-fine-tuned particles with external force: general classification of scenarios

abstract: If two particles moving towards a black hole collide in the vicinity of the horizon, the energy $E_{c.m.}$ in the center of mass frame can grow indefinitely if one of particles is fine-tuned. This is the Ba\~{n}ados, Silk and West (BSW) effect. One of objections against this effect consists in that for some types of a horizon fine-tuned particles cannot reach the horizon. However, this difficulty can be overcome if instead of exact fine-tuning, one of particle is nearly fine-tuned, with the value of small detuning being adjusted to the distance to the horizon. Such particles are called near-fine-tuned. We give classification of such particles and describe possible high energy scenarios of collision in which they participate. We analyze the ranges of possible motion for each type of particle and determine under which condition such particles can reach the horizon. We analyze collision energy $E_{c.m.}\,$and determine under which conditions it may grow indefinitely. We also include into consideration the forces acting on particles and find when the BSW effect with nearly-fine-tuned particles is possible with finite forces. We demonstrate that the BSW effect with particles under discussion is consistent with the principle of kinematic censorship. According to this principle, $E_{c.m.}\,$cannot be literally infinite in any event of collision (if no singularity is present), although it can be made as large as one likes.


title: Ultraviolet and Chromospheric activity and Habitability of M stars

abstract: M-type stars are crucial for stellar activity studies since they cover two types of magnetic dynamos and particularly intriguing for habitability studies due to their abundance and long lifespans during the main-sequence stage. In this paper, we used the LAMOST DR9 catalog and the GALEX UV archive data to investigate the chromospheric and UV activities of M-type stars. All the chromospheric and UV activity indices clearly show the saturated and unsaturated regimes and the well-known activity-rotation relation, consistent with previous studies. Both the FUV and NUV activity indices exhibit a single-peaked distribution, while the {\rm H$\alpha$} and \rm {Ca \scriptsize{\uppercase\expandafter{\romannumeral2}} \normalsize H$\&$K} indices show a distinct double-peaked distribution. The gap between these peaks suggests a rapid transition from a saturated population to an unsaturated one. The smoothly varying distributions of different subtypes suggest a rotation-dependent dynamo for both early-type (partly convective) to late-type (fully convective) M stars. We identified a group of stars with high UV activity above the saturation regime (log$R^{\prime}_{\rm NUV} > -2.5$) but low chromospheric activity, and the underlying reason is unknown. By calculating the continuously habitable zone and the UV habitable zone for each star, we found about 70\% stars in the total sample and 40\% stars within 100 pc are located in the overlapping region of these two habitable zones, indicating a number of M stars are potentially habitable. Finally, we examined the possibility of UV activity studies of M stars using the China Space Station Telescope.


title: Determinants of LLM-assisted Decision-Making

abstract: Decision-making is a fundamental capability in everyday life. Large Language Models (LLMs) provide multifaceted support in enhancing human decision-making processes. However, understanding the influencing factors of LLM-assisted decision-making is crucial for enabling individuals to utilize LLM-provided advantages and minimize associated risks in order to make more informed and better decisions. This study presents the results of a comprehensive literature analysis, providing a structural overview and detailed analysis of determinants impacting decision-making with LLM support. In particular, we explore the effects of technological aspects of LLMs, including transparency and prompt engineering, psychological factors such as emotions and decision-making styles, as well as decision-specific determinants such as task difficulty and accountability. In addition, the impact of the determinants on the decision-making process is illustrated via multiple application scenarios. Drawing from our analysis, we develop a dependency framework that systematizes possible interactions in terms of reciprocal interdependencies between these determinants. Our research reveals that, due to the multifaceted interactions with various determinants, factors such as trust in or reliance on LLMs, the user's mental model, and the characteristics of information processing are identified as significant aspects influencing LLM-assisted decision-making processes. Our findings can be seen as crucial for improving decision quality in human-AI collaboration, empowering both users and organizations, and designing more effective LLM interfaces. Additionally, our work provides a foundation for future empirical investigations on the determinants of decision-making assisted by LLMs.


title: A case study of sending graph neural networks back to the test bench for applications in high-energy particle physics

abstract: In high-energy particle collisions, the primary collision products usually decay further resulting in tree-like, hierarchical structures with a priori unknown multiplicity. At the stable-particle level all decay products of a collision form permutation invariant sets of final state objects. The analogy to mathematical graphs gives rise to the idea that graph neural networks (GNNs), which naturally resemble these properties, should be best-suited to address many tasks related to high-energy particle physics. In this paper we describe a benchmark test of a typical GNN against neural networks of the well-established deep fully-connected feed-forward architecture. We aim at performing this comparison maximally unbiased in terms of nodes, hidden layers, or trainable parameters of the neural networks under study. As physics case we use the classification of the final state X produced in association with top quark-antiquark pairs in proton-proton collisions at the Large Hadron Collider at CERN, where X stands for a bottom quark-antiquark pair produced either non-resonantly or through the decay of an intermediately produced Z or Higgs boson.


title: RACP: Risk-Aware Contingency Planning with Multi-Modal Predictions

abstract: For an autonomous vehicle to operate reliably within real-world traffic scenarios, it is imperative to assess the repercussions of its prospective actions by anticipating the uncertain intentions exhibited by other participants in the traffic environment. Driven by the pronounced multi-modal nature of human driving behavior, this paper presents an approach that leverages Bayesian beliefs over the distribution of potential policies of other road users to construct a novel risk-aware probabilistic motion planning framework. In particular, we propose a novel contingency planner that outputs long-term contingent plans conditioned on multiple possible intents for other actors in the traffic scene. The Bayesian belief is incorporated into the optimization cost function to influence the behavior of the short-term plan based on the likelihood of other agents' policies. Furthermore, a probabilistic risk metric is employed to fine-tune the balance between efficiency and robustness. Through a series of closed-loop safety-critical simulated traffic scenarios shared with human-driven vehicles, we demonstrate the practical efficacy of our proposed approach that can handle multi-vehicle scenarios.


title: GW Backgrounds associated with PBHs

abstract: PBH formation requires high-density regions in the (random) density field filling the primordial universe. While only the largest (and so rarest) overdensities collapse to form PBHs, the rest cause large anisotropic stresses, which are the source of GWs. We provide an overview of the theoretical aspects of the GW backgrounds associated with PBHs from large primordial fluctuations. We consider GW backgrounds associated with PBH formation, PBH reheating and unresolved PBH binaries. We present several graphical summaries and illustrations for the busy reader.


title: FairBelief -- Assessing Harmful Beliefs in Language Models

abstract: Language Models (LMs) have been shown to inherit undesired biases that might hurt minorities and underrepresented groups if such systems were integrated into real-world applications without careful fairness auditing. This paper proposes FairBelief, an analytical approach to capture and assess beliefs, i.e., propositions that an LM may embed with different degrees of confidence and that covertly influence its predictions. With FairBelief, we leverage prompting to study the behavior of several state-of-the-art LMs across different previously neglected axes, such as model scale and likelihood, assessing predictions on a fairness dataset specifically designed to quantify LMs' outputs' hurtfulness. Finally, we conclude with an in-depth qualitative assessment of the beliefs emitted by the models. We apply FairBelief to English LMs, revealing that, although these architectures enable high performances on diverse natural language processing tasks, they show hurtful beliefs about specific genders. Interestingly, training procedure and dataset, model scale, and architecture induce beliefs of different degrees of hurtfulness.


title: Robustness-Congruent Adversarial Training for Secure Machine Learning Model Updates

abstract: Machine-learning models demand for periodic updates to improve their average accuracy, exploiting novel architectures and additional data. However, a newly-updated model may commit mistakes that the previous model did not make. Such misclassifications are referred to as negative flips, and experienced by users as a regression of performance. In this work, we show that this problem also affects robustness to adversarial examples, thereby hindering the development of secure model update practices. In particular, when updating a model to improve its adversarial robustness, some previously-ineffective adversarial examples may become misclassified, causing a regression in the perceived security of the system. We propose a novel technique, named robustness-congruent adversarial training, to address this issue. It amounts to fine-tuning a model with adversarial training, while constraining it to retain higher robustness on the adversarial examples that were correctly classified before the update. We show that our algorithm and, more generally, learning with non-regression constraints, provides a theoretically-grounded framework to train consistent estimators. Our experiments on robust models for computer vision confirm that (i) both accuracy and robustness, even if improved after model update, can be affected by negative flips, and (ii) our robustness-congruent adversarial training can mitigate the problem, outperforming competing baseline methods.


title: Spatial super-resolution in nanosensing with blinking emitters

abstract: We propose a method of spatial resolution enhancement in metrology (thermometry, magnetometry, pH estimation and similar methods) with blinking fluorescent nanosensors by combining sensing with super-resolution optical fluctuation imaging (SOFI). To demonstrate efficiency of this approach, a model experiment with laser diodes modeling fluctuating nanoemitters and intentional blurring of the image is performed. The 2nd, 3rd, and 4th order cumulant images provide improvement of the contrast and enable successful reconstruction of smaller features of the modeled temperature (or any other physical parameter) distribution relatively to the intensity-based approach. We believe that blinking fluorescent sensing agents being complemented with the developed image analysis technique could be utilized routinely in the life science sector for recognizing the local changes in the spectral response of blinking fluorophores, e.g. delivered targetly to the wanted cell or even organelle. It is extremely useful for the local measurements of living cells' physical parameters changes due to applying any external "forces", including disease effect, aging, healing or response to the treatment.


title: Spot the bot: Coarse-Grained Partition of Semantic Paths for Bots and Humans

abstract: Nowadays, technology is rapidly advancing: bots are writing comments, articles, and reviews. Due to this fact, it is crucial to know if the text was written by a human or by a bot. This paper focuses on comparing structures of the coarse-grained partitions of semantic paths for human-written and bot-generated texts. We compare the clusterizations of datasets of n-grams from literary texts and texts generated by several bots. The hypothesis is that the structures and clusterizations are different. Our research supports the hypothesis. As the semantic structure may be different for different languages, we investigate Russian, English, German, and Vietnamese languages.


title: Designing Chatbots to Support Victims and Survivors of Domestic Abuse

abstract: Objective: Domestic abuse cases have risen significantly over the last four years, in part due to the COVID-19 pandemic and the challenges for victims and survivors in accessing support. In this study, we investigate the role that chatbots - Artificial Intelligence (AI) and rule-based - may play in supporting victims/survivors in situations such as these or where direct access to help is limited. Methods: Interviews were conducted with experts working in domestic abuse support services and organizations (e.g., charities, law enforcement) and the content of websites of related support-service providers was collected. Thematic content analysis was then applied to assess and extract insights from the interview data and the content on victim-support websites. We also reviewed pertinent chatbot literature to reflect on studies that may inform design principles and interaction patterns for agents used to support victims/survivors. Results: From our analysis, we outlined a set of design considerations/practices for chatbots that consider potential use cases and target groups, dialog structure, personality traits that might be useful for chatbots to possess, and finally, safety and privacy issues that should be addressed. Of particular note are situations where AI systems (e.g., ChatGPT, CoPilot, Gemini) are not recommended for use, the value of conveying emotional support, the importance of transparency, and the need for a safe and confidential space. Conclusion: It is our hope that these considerations/practices will stimulate debate among chatbots and AI developers and service providers and - for situations where chatbots are deemed appropriate for use - inspire efficient use of chatbots in the support of survivors of domestic abuse.


title: A Survey of Network Protocol Fuzzing: Model, Techniques and Directions

abstract: As one of the most successful and effective software testing techniques in recent years, fuzz testing has uncovered numerous bugs and vulnerabilities in modern software, including network protocol software. In contrast to other fuzzing targets, network protocol software exhibits its distinct characteristics and challenges, introducing a plethora of research questions that need to be addressed in the design and implementation of network protocol fuzzers. While some research work has evaluated and systematized the knowledge of general fuzzing techniques at a high level, there is a lack of similar analysis and summarization for fuzzing research specific to network protocols. This paper offers a comprehensive exposition of network protocol software's fuzzing-related features and conducts a systematic review of some representative advancements in network protocol fuzzing since its inception. We summarize state-of-the-art strategies and solutions in various aspects, propose a unified protocol fuzzing process model, and introduce the techniques involved in each stage of the model. At the same time, this paper also summarizes the promising research directions in the landscape of protocol fuzzing to foster exploration within the community for more efficient and intelligent modern network protocol fuzzing techniques.


title: Electron-beam annealing of Josephson junctions for frequency tuning of quantum processors

abstract: Superconducting qubits are a promising route to achieving large-scale quantum computers. A key challenge in realising large-scale superconducting quantum processors involves mitigating frequency collisions. In this paper, we present an approach to tuning fixed-frequency qubits with the use of an electron beam to locally anneal the Josephson junction. We demonstrate the ability to both increase and decrease the junction barrier resistance. The technique shows an improvement in wafer scale frequency targetting by assessing the frequency collisions in our qubit architecture. Coherence measurements are also done to evaluate the performance before and after tuning. The tuning process utilises a standard electron beam lithography system, ensuring reproducibility and implementation by any group capable of fabricating these Josephson junctions. This technique has the potential to significantly improve the performance of large-scale quantum computing systems, thereby paving the way for the future of quantum computing.


title: Benchmarking GPT-4 on Algorithmic Problems: A Systematic Evaluation of Prompting Strategies

abstract: Large Language Models (LLMs) have revolutionized the field of Natural Language Processing thanks to their ability to reuse knowledge acquired on massive text corpora on a wide variety of downstream tasks, with minimal (if any) tuning steps. At the same time, it has been repeatedly shown that LLMs lack systematic generalization, which allows to extrapolate the learned statistical regularities outside the training distribution. In this work, we offer a systematic benchmarking of GPT-4, one of the most advanced LLMs available, on three algorithmic tasks characterized by the possibility to control the problem difficulty with two parameters. We compare the performance of GPT-4 with that of its predecessor (GPT-3.5) and with a variant of the Transformer-Encoder architecture recently introduced to solve similar tasks, the Neural Data Router. We find that the deployment of advanced prompting techniques allows GPT-4 to reach superior accuracy on all tasks, demonstrating that state-of-the-art LLMs constitute a very strong baseline also in challenging tasks that require systematic generalization.


title: Utilizing U-Net Architectures with Auxiliary Information for Scatter Correction in CBCT Across Different Field-of-View Settings

abstract: Cone-beam computed tomography (CBCT) has become a vital imaging technique in various medical fields but scatter artifacts are a major limitation in CBCT scanning. This challenge is exacerbated by the use of large flat panel 2D detectors. The scatter-to-primary ratio increases significantly with the increase in the size of FOV being scanned. Several deep learning methods, particularly U-Net architectures, have shown promising capabilities in estimating the scatter directly from the CBCT projections. However, the influence of varying FOV sizes on these deep learning models remains unexplored. Having a single neural network for the scatter estimation of varying FOV projections can be of significant importance towards real clinical applications. This study aims to train and evaluate the performance of a U-Net network on a simulated dataset with varying FOV sizes. We further propose a new method (Aux-Net) by providing auxiliary information, such as FOV size, to the U-Net encoder. We validate our method on 30 different FOV sizes and compare it with the U-Net. Our study demonstrates that providing auxiliary information to the network enhances the generalization capability of the U-Net. Our findings suggest that this novel approach outperforms the baseline U-Net, offering a significant step towards practical application in real clinical settings where CBCT systems are employed to scan a wide range of FOVs.


title: A Quantum Approach to Synthetic Minority Oversampling Technique (SMOTE)

abstract: The paper proposes the Quantum-SMOTE method, a novel solution that uses quantum computing techniques to solve the prevalent problem of class imbalance in machine learning datasets. Quantum-SMOTE, inspired by the Synthetic Minority Oversampling Technique (SMOTE), generates synthetic data points using quantum processes such as swap tests and quantum rotation. The process varies from the conventional SMOTE algorithm's usage of K-Nearest Neighbors (KNN) and Euclidean distances, enabling synthetic instances to be generated from minority class data points without relying on neighbor proximity. The algorithm asserts greater control over the synthetic data generation process by introducing hyperparameters such as rotation angle, minority percentage, and splitting factor, which allow for customization to specific dataset requirements. The approach is tested on a public dataset of TelecomChurn and evaluated alongside two prominent classification algorithms, Random Forest and Logistic Regression, to determine its impact along with varying proportions of synthetic data.


title: Novel Ternary AgIICoIIIF5 Fluoride: Synthesis, Structure and Magnetic Characteristics

abstract: We present a new compound in the silver cobalt fluoride system, featuring paramagnetic silver (d9) and high-spin cobalt (d6), synthesized by solid state method in an autoclave under F2 overpressure. Based on powder X ray diffraction, we determined that AgIICoIIIF5 crystallizes in a monoclinic system with space group C2/c. The calculated fundamental band gap falls in the visible range of the electromagnetic spectrum, and the compound has the character of charge-transfer insulator. AgCoF5 is a ferrimagnet with one predominant superexchange magnetic interaction constant between mixed spin cations (Ag ... Co) of minus 62 meV (SCAN result). Magnetometric measurements conducted on a powdered sample allowed the identification of a transition at 128 K, which could indicate magnetic ordering.


title: Investigating Continual Pretraining in Large Language Models: Insights and Implications

abstract: This paper studies the evolving domain of Continual Learning (CL) in large language models (LLMs), with a focus on developing strategies for efficient and sustainable training. Our primary emphasis is on continual domain-adaptive pretraining, a process designed to equip LLMs with the ability to integrate new information from various domains while retaining previously learned knowledge and enhancing cross-domain knowledge transfer without relying on domain-specific identification. Unlike previous studies, which mostly concentrate on a limited selection of tasks or domains and primarily aim to address the issue of forgetting, our research evaluates the adaptability and capabilities of LLMs to changing data landscapes in practical scenarios. To this end, we introduce a new benchmark designed to measure the adaptability of LLMs to these evolving data environments, offering a comprehensive framework for evaluation. We examine the impact of model size on learning efficacy and forgetting, as well as how the progression and similarity of emerging domains affect the knowledge transfer within these models. Our findings uncover several key insights: (i) when the sequence of domains shows semantic similarity, continual pretraining enables LLMs to better specialize in the current domain compared to stand-alone fine-tuning, (ii) training across a diverse range of domains enhances both backward and forward knowledge transfer, and (iii) smaller models are particularly sensitive to continual pretraining, showing the most significant rates of both forgetting and learning. We posit that our research marks a shift towards establishing a more realistic benchmark for investigating CL in LLMs, and has the potential to play a key role in guiding the direction of future research in the field.


title: Quantum entanglement enabled ellipsometer for phase retardance measurement

abstract: An ellipsometer is a vital precision tool used for measuring optical parameters with wide applications in many fields, including accurate measurements in film thickness, optical constants, structural profiles, etc. However, the precise measurement of photosensitive materials meets huge obstacles because of the excessive input photons, therefore the requirement of enhancing detection accuracy under low incident light intensity is an essential topic in the precision measurement. In this work, by combining a polarization-entangled photon source with a classical transmission-type ellipsometer, the quantum ellipsometer with the PSA (Polarizer-Sample-Analyzer) and the Senarmount method is constructed firstly to measure the phase retardation of the birefringent materials. The experimental results show that the accuracy can reach to nanometer scale at extremely low input intensity, and the stability are within 1% for all specimens tested with a compensator involved. Our work paves the way for precision measurement at low incident light intensity, with potential applications in measuring photosensitive materials, active-biological samples and other remote monitoring scenarios.


title: Beacon, a lightweight deep reinforcement learning benchmark library for flow control

abstract: Recently, the increasing use of deep reinforcement learning for flow control problems has led to a new area of research, focused on the coupling and the adaptation of the existing algorithms to the control of numerical fluid dynamics environments. Although still in its infancy, the field has seen multiple successes in a short time span, and its fast development pace can certainly be partly imparted to the open-source effort that drives the expansion of the community. Yet, this emerging domain still misses a common ground to (i) ensure the reproducibility of the results, and (ii) offer a proper ad-hoc benchmarking basis. To this end, we propose Beacon, an open-source benchmark library composed of seven lightweight 1D and 2D flow control problems with various characteristics, action and observation space characteristics, and CPU requirements. In this contribution, the seven considered problems are described, and reference control solutions are provided. The sources for the following work are available at https://github.com/jviquerat/beacon.


title: Sora Generates Videos with Stunning Geometrical Consistency

abstract: The recently developed Sora model [1] has exhibited remarkable capabilities in video generation, sparking intense discussions regarding its ability to simulate real-world phenomena. Despite its growing popularity, there is a lack of established metrics to evaluate its fidelity to real-world physics quantitatively. In this paper, we introduce a new benchmark that assesses the quality of the generated videos based on their adherence to real-world physics principles. We employ a method that transforms the generated videos into 3D models, leveraging the premise that the accuracy of 3D reconstruction is heavily contingent on the video quality. From the perspective of 3D reconstruction, we use the fidelity of the geometric constraints satisfied by the constructed 3D models as a proxy to gauge the extent to which the generated videos conform to real-world physics rules. Project page: https://sora-geometrical-consistency.github.io/


title: Generative diffusion model for surface structure discovery

abstract: We present a generative diffusion model specifically tailored to the discovery of surface structures. The generative model takes into account substrate registry and periodicity by including masked atoms and $z$-directional confinement. Using a rotational equivariant neural network architecture, we design a method that trains a denoiser-network for diffusion alongside a force-field for guided sampling of low-energy surface phases. An effective data-augmentation scheme for training the denoiser-network is proposed to scale generation far beyond training data sizes. We showcase the generative model by investigating silver-oxide phases on Ag$(111)$ where we are able to rediscover the ``$\mathrm{Ag}_6$ model'' of $p(4\times4)\mathrm{O/Ag}(111)$ that took scientist years to uncover by means of human intuition.


title: Underwater Acoustic Source Seeking Using Time-Difference-of-Arrival Measurements

abstract: The research presented in this paper is aimed at developing a control algorithm for an autonomous surface system carrying a two-sensor array consisting of two acoustic receivers, capable of measuring the time-difference-of-arrival (TDOA) of a quasiperiodic underwater acoustic signal and utilizing this value to steer the system toward the acoustic source in the horizontal plane. Stability properties of the proposed algorithm are analyzed using the Lie bracket approximation technique. Furthermore, simulation results are presented, where particular attention is given to the relationship between the time difference of arrival measurement noise and the sensor baseline - the distance between the two acoustic receivers. Also, the influence of a constant disturbance caused by sea currents is considered. Finally, experimental results in which the algorithm was deployed on two autonomous surface vehicles, each equipped with a single acoustic receiver, are presented. The algorithm successfully steers the vehicle formation toward the acoustic source, despite the measurement noise and intermittent measurements, thus showing the feasibility of the proposed algorithm in real-life conditions.


title: LSPT: Long-term Spatial Prompt Tuning for Visual Representation Learning

abstract: Visual Prompt Tuning (VPT) techniques have gained prominence for their capacity to adapt pre-trained Vision Transformers (ViTs) to downstream visual tasks using specialized learnable tokens termed as prompts. Contemporary VPT methodologies, especially when employed with self-supervised vision transformers, often default to the introduction of new learnable prompts or gated prompt tokens predominantly sourced from the model's previous block. A pivotal oversight in such approaches is their failure to harness the potential of long-range previous blocks as sources of prompts within each self-supervised ViT. To bridge this crucial gap, we introduce Long-term Spatial Prompt Tuning (LSPT) - a revolutionary approach to visual representation learning. Drawing inspiration from the intricacies of the human brain, LSPT ingeniously incorporates long-term gated prompts. This feature serves as temporal coding, curbing the risk of forgetting parameters acquired from earlier blocks. Further enhancing its prowess, LSPT brings into play patch tokens, serving as spatial coding. This is strategically designed to perpetually amass class-conscious features, thereby fortifying the model's prowess in distinguishing and identifying visual categories. To validate the efficacy of our proposed method, we engaged in rigorous experimentation across 5 FGVC and 19 VTAB-1K benchmarks. Our empirical findings underscore the superiority of LSPT, showcasing its ability to set new benchmarks in visual prompt tuning performance.


title: A Neural Rewriting System to Solve Algorithmic Problems

abstract: Modern neural network architectures still struggle to learn algorithmic procedures that require to systematically apply compositional rules to solve out-of-distribution problem instances. In this work, we propose an original approach to learn algorithmic tasks inspired by rewriting systems, a classic framework in symbolic artificial intelligence. We show that a rewriting system can be implemented as a neural architecture composed by specialized modules: the Selector identifies the target sub-expression to process, the Solver simplifies the sub-expression by computing the corresponding result, and the Combiner produces a new version of the original expression by replacing the sub-expression with the solution provided. We evaluate our model on three types of algorithmic tasks that require simplifying symbolic formulas involving lists, arithmetic, and algebraic expressions. We test the extrapolation capabilities of the proposed architecture using formulas involving a higher number of operands and nesting levels than those seen during training, and we benchmark its performance against the Neural Data Router, a recent model specialized for systematic generalization, and a state-of-the-art large language model (GPT-4) probed with advanced prompting strategies.


title: High-rate Generation and State Tomography of Non-Gaussian Quantum States for Ultra-fast Clock Frequency Quantum Processors

abstract: Quantum information processors greatly benefit from high clock frequency to fully harnessing the quantum advantages before they get washed out by the decoherence. In this pursuit, all-optical systems offer unique advantages due to their inherent 100 THz carrier frequency, permitting one to develop THz clock frequency processors. In practice, the bandwidth of the quantum light sources and the measurement devices has been limited to the MHz range and the generation rate of nonclassical states to kHz order -- a tiny fraction of what can be achieved. In this work, we go beyond this limitation by utilizing optical parametric amplifier (OPA) as a squeezed-light source and optical phase-sensitive amplifiers (PSA) to realize high-rate generation of broadband non-Gaussian states and their quantum tomography. Our state generation and measurement system consists of a 6-THz squeezed-light source, a 6-THz PSA, and a 66-GHz homodyne detector. With this system, we have successfully demonstrated non-Gaussian state generation at a 0.9 MHz rate -- almost three orders of magnitude higher than the current state-of-the-art experiments -- with a sub-nanosecond wave packet using continuous-wave laser. The performance is constrained only by the superconducting detector's jitter which currently limits the usable bandwidth of the squeezed light to 1 GHz, rather than the optical and electronic systems. Therefore, if we can overcome the limitation of the timing jitter of superconducting detector, non-Gaussian state generation and detection at GHz rate, or even THz rate, for optical quantum processors might be possible with OPAs.


title: Using Programmable Drone in Educational Projects and Competitions

abstract: The mainstream of educational robotics platforms orbits the various versions of versatile robotics sets and kits, while interesting outliers add new opportunities and extend the possible learning situations. Examples of such are reconfigurable robots, rolling sphere robots, humanoids, swimming, or underwater robots. Another kind within this category are flying drones. While remotely controlled drones were a very attractive target for hobby model makers for quite a long time already, they were seldom used in educational scenarios as robots that are programmed by children to perform various simple tasks. A milestone was reached with the introduction of the educational drone Tello, which can be programmed even in Scratch, or some general-purpose languages such as Node.js or Python. The programs can even have access to the robot sensors that are used by the underlying layers of the controller. In addition, they have the option to acquire images from the drone camera and perform actions based on processing the frames applying computer vision algorithms. We have been using this drone in an educational robotics competition for three years without camera, and after our students have developed several successful projects that utilized a camera, we prepared a new competition challenge that requires the use of the camera. In the article, we summarize related efforts and our experiences with educational drones, and their use in the student projects and competition.


title: A novel image space formalism of Fourier domain interpolation neural networks for noise propagation analysis

abstract: Purpose: To develop an image space formalism of multi-layer convolutional neural networks (CNNs) for Fourier domain interpolation in MRI reconstructions and analytically estimate noise propagation during CNN inference. Theory and Methods: Nonlinear activations in the Fourier domain (also known as k-space) using complex-valued Rectifier Linear Units are expressed as elementwise multiplication with activation masks. This operation is transformed into a convolution in the image space. After network training in k-space, this approach provides an algebraic expression for the derivative of the reconstructed image with respect to the aliased coil images, which serve as the input tensors to the network in the image space. This allows the variance in the network inference to be estimated analytically and to be used to describe noise characteristics. Monte-Carlo simulations and numerical approaches based on auto-differentiation were used for validation. The framework was tested on retrospectively undersampled invivo brain images. Results: Inferences conducted in the image domain are quasi-identical to inferences in the k-space, underlined by corresponding quantitative metrics. Noise variance maps obtained from the analytical expression correspond with those obtained via Monte-Carlo simulations, as well as via an auto-differentiation approach. The noise resilience is well characterized, as in the case of classical Parallel Imaging. Komolgorov-Smirnov tests demonstrate Gaussian distributions of voxel magnitudes in variance maps obtained via Monte-Carlo simulations. Conclusion: The quasi-equivalent image space formalism for neural networks for k-space interpolation enables fast and accurate description of the noise characteristics during CNN inference, analogous to geometry-factor maps in traditional parallel imaging methods.


title: Consistency Matters: Explore LLMs Consistency From a Black-Box Perspective

abstract: Nowadays both commercial and open-source academic LLM have become the mainstream models of NLP. However, there is still a lack of research on LLM consistency, meaning that throughout the various stages of LLM research and deployment, its internal parameters and capabilities should remain unchanged. This issue exists in both the industrial and academic sectors. The solution to this problem is often time-consuming and labor-intensive, and there is also an additional cost of secondary deployment, resulting in economic and time losses. To fill this gap, we build an LLM consistency task dataset and design several baselines. Additionally, we choose models of diverse scales for the main experiments. Specifically, in the LightGBM experiment, we used traditional NLG metrics (i.e., ROUGE, BLEU, METEOR) as the features needed for model training. The final result exceeds the manual evaluation and GPT3.5 as well as other models in the main experiment, achieving the best performance. In the end, we use the best performing LightGBM model as the base model to build the evaluation tool, which can effectively assist in the deployment of business models. Our code and tool demo are available at https://github.com/heavenhellchen/Consistency.git


title: DiffuseKronA: A Parameter Efficient Fine-tuning Method for Personalized Diffusion Models

abstract: In the realm of subject-driven text-to-image (T2I) generative models, recent developments like DreamBooth and BLIP-Diffusion have led to impressive results yet encounter limitations due to their intensive fine-tuning demands and substantial parameter requirements. While the low-rank adaptation (LoRA) module within DreamBooth offers a reduction in trainable parameters, it introduces a pronounced sensitivity to hyperparameters, leading to a compromise between parameter efficiency and the quality of T2I personalized image synthesis. Addressing these constraints, we introduce \textbf{\textit{DiffuseKronA}}, a novel Kronecker product-based adaptation module that not only significantly reduces the parameter count by 35\% and 99.947\% compared to LoRA-DreamBooth and the original DreamBooth, respectively, but also enhances the quality of image synthesis. Crucially, \textit{DiffuseKronA} mitigates the issue of hyperparameter sensitivity, delivering consistent high-quality generations across a wide range of hyperparameters, thereby diminishing the necessity for extensive fine-tuning. Furthermore, a more controllable decomposition makes \textit{DiffuseKronA} more interpretable and even can achieve up to a 50\% reduction with results comparable to LoRA-Dreambooth. Evaluated against diverse and complex input images and text prompts, \textit{DiffuseKronA} consistently outperforms existing models, producing diverse images of higher quality with improved fidelity and a more accurate color distribution of objects, all the while upholding exceptional parameter efficiency, thus presenting a substantial advancement in the field of T2I generative modeling. Our project page, consisting of links to the code, and pre-trained checkpoints, is available at https://diffusekrona.github.io/.


title: $(S_2)$-condition of edge rings for cactus graphs

abstract: A cactus graph is a connected graph in which every block is either an edge or a cycle. In this paper, we will examine cactus graphs where all the blocks are $3$-cycles, i.e., triangular cactus graphs, of diameter $4$. Our main focus is to prove that the corresponding edge ring of this family of graphs is not normal and satisfies Serre's condition $(S_2)$. We use a criterion due to Katth\"an for non-normal affine semigroup rings.


title: Neural Video Compression with Feature Modulation

abstract: The emerging conditional coding-based neural video codec (NVC) shows superiority over commonly-used residual coding-based codec and the latest NVC already claims to outperform the best traditional codec. However, there still exist critical problems blocking the practicality of NVC. In this paper, we propose a powerful conditional coding-based NVC that solves two critical problems via feature modulation. The first is how to support a wide quality range in a single model. Previous NVC with this capability only supports about 3.8 dB PSNR range on average. To tackle this limitation, we modulate the latent feature of the current frame via the learnable quantization scaler. During the training, we specially design the uniform quantization parameter sampling mechanism to improve the harmonization of encoding and quantization. This results in a better learning of the quantization scaler and helps our NVC support about 11.4 dB PSNR range. The second is how to make NVC still work under a long prediction chain. We expose that the previous SOTA NVC has an obvious quality degradation problem when using a large intra-period setting. To this end, we propose modulating the temporal feature with a periodically refreshing mechanism to boost the quality. %Besides solving the above two problems, we also design a single model that can support both RGB and YUV colorspaces. Notably, under single intra-frame setting, our codec can achieve 29.7\% bitrate saving over previous SOTA NVC with 16\% MACs reduction. Our codec serves as a notable landmark in the journey of NVC evolution. The codes are at https://github.com/microsoft/DCVC.


title: Rate Function Modelling of Quantum Many-Body Adiabaticity

abstract: The quantum adiabatic theorem is a fundamental result in quantum mechanics, which has a multitude of applications, both theoretical and practical. Here, we investigate the dynamics of adiabatic processes for interacting quantum many-body systems by analysing the properties of observable-free, intensive quantities. In particular, we study the rate function $f(T)$ in dependence of the ramp time $T$, which gives us a complete characterization of the many-body adiabatic fidelity as a function of $T$ and the strength of the parameter displacement $\Delta \lambda$. This allows us to control and define the notion of adiabaticity in many-body systems. Several key results in the literature regarding the interplay of the thermodynamic and the adiabatic limit are obtained as inferences from the properties of $f(T)$ in the large $T$ limit.


title: Semiclassical approach to spin dynamics of a ferromagnetic S=1 chain

abstract: Motivated by recent experimental progress in the quasi-one-dimensional quantum magnet NiNb$_2$O$_6$, we study the spin dynamics of an S=1 ferromagnetic Heisenberg chain with single-ion anisotropy by using a semiclassical molecular dynamics approach. This system undergoes a quantum phase transition from a ferromagnetic to a paramagnetic state under a transverse magnetic field, and the magnetic responses reflecting this transition is well described by our semiclassical method. We show that at low-temperature the transverse component of the dynamical structure factor depicts clearly the magnon dispersion, and the longitudinal component exhibits two continua associated with single- and two-magnon excitations, respectively. These spin excitation spectra show interesting temperature dependence as effects of magnon interactions.Our findings shed light on experimental detection of spin excitations in a large class of quasi-one-dimensional magnets.


title: CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification

abstract: The advancement of Zero-Shot Learning in the medical domain has been driven forward by using pre-trained models on large-scale image-text pairs, focusing on image-text alignment. However, existing methods primarily rely on cosine similarity for alignment, which may not fully capture the complex relationship between medical images and reports. To address this gap, we introduce a novel approach called Cross-Attention Alignment for Radiology Zero-Shot Classification (CARZero). Our approach innovatively leverages cross-attention mechanisms to process image and report features, creating a Similarity Representation that more accurately reflects the intricate relationships in medical semantics. This representation is then linearly projected to form an image-text similarity matrix for cross-modality alignment. Additionally, recognizing the pivotal role of prompt selection in zero-shot learning, CARZero incorporates a Large Language Model-based prompt alignment strategy. This strategy standardizes diverse diagnostic expressions into a unified format for both training and inference phases, overcoming the challenges of manual prompt design. Our approach is simple yet effective, demonstrating state-of-the-art performance in zero-shot classification on five official chest radiograph diagnostic test sets, including remarkable results on datasets with long-tail distributions of rare diseases. This achievement is attributed to our new image-text alignment strategy, which effectively addresses the complex relationship between medical images and reports. Code and models are available at https://github.com/laihaoran/CARZero.


title: Quantum scaling of the spin lattice relaxation rate in the checkerboard $J$-$Q$ model

abstract: Motivated by recent progress on the experimental realization of proximate deconfined quantum critical point in a frustrated quantum magnet, we study the low-energy spin dynamics of a related checkerboard $J$-$Q$ model by using quantum Monte Carlo simulations. The ground state of this model undergoes a weakly first-order quantum phase transition with an emergent $O(4)$ symmetry between an antiferromagnetic state and a plaquette valence bond solid. The calculated spin lattice relaxation rate of nuclear magnetic resonance, $1/T_1$, exhibits distinct low-temperature behaviors depending on the ground states. With decreasing the temperature, $1/T_1$ rises up on the antiferromagnetic side, characterizing a crossover to the renormalized classical regime, whereas $1/T_1$ drops exponentially on the side of valence bond solid, reflecting the gap opening in the plaquette ordered phase. The extracted spin gap scales with the distance to the transition point as a power-law with an exponent $\phi\approx0.3$, consistent with the scaling ansatz $\phi=\nu z$ with $\nu\approx0.3$ and $z=1$. Near the quantum phase transition, the temperature dependent $1/T_1$ shows a broad crossover regime where a universal scaling $1/T_1\sim T^{\eta}$ with $\eta\approx0.6$ is found. Our results suggest a quantum scaling regime associated with the emergent enhanced symmetry near this first-order quantum phase transition.


title: Comparison of Distances and Entropic Distinguishability Quantifiers for the Detection of Memory Effects

abstract: We consider a recently introduced framework for the description of memory effects based on quantum state distinguishability quantifiers, in which entropic quantifiers can be included. After briefly presenting the approach, we validate it considering the performance of different quantifiers in the characterization of the reduced dynamics of a two-level system undergoing decoherence. We investigate the different behavior of these quantifiers in the dependence on physical features of the model, such as environmental temperature and coupling strength. It appears that the performance of the different quantifiers conveys the same physical information, though with different sensitivities, thus supporting robustness of the approach.


title: PANDAS: Prototype-based Novel Class Discovery and Detection

abstract: Object detectors are typically trained once and for all on a fixed set of classes. However, this closed-world assumption is unrealistic in practice, as new classes will inevitably emerge after the detector is deployed in the wild. In this work, we look at ways to extend a detector trained for a set of base classes so it can i) spot the presence of novel classes, and ii) automatically enrich its repertoire to be able to detect those newly discovered classes together with the base ones. We propose PANDAS, a method for novel class discovery and detection. It discovers clusters representing novel classes from unlabeled data, and represents old and new classes with prototypes. During inference, a distance-based classifier uses these prototypes to assign a label to each detected object instance. The simplicity of our method makes it widely applicable. We experimentally demonstrate the effectiveness of PANDAS on the VOC 2012 and COCO-to-LVIS benchmarks. It performs favorably against the state of the art for this task while being computationally more affordable.


title: Toughness and A{\alpha}-spectral radius in graphs

abstract: Let $\alpha\in[0,1)$, and let $G$ be a connected graph of order $n$ with $n\geq f(\alpha)$, where $f(\alpha)=6$ for $\alpha\in[0,\frac{2}{3}]$ and $f(\alpha)=\frac{4}{1-\alpha}$ for $\alpha\in(\frac{2}{3},1)$. A graph $G$ is said to be $t$-tough if $|S|\geq tc(G-S)$ for each subset $S$ of $V(G)$ with $c(G-S)\geq2$, where $c(G-S)$ is the number of connected components in $G-S$. The $A_{\alpha}$-spectral radius of $G$ is denoted by $\rho_{\alpha}(G)$. In this paper, it is verified that $G$ is a 1-tough graph unless $G=K_1\vee(K_{n-2}\cup K_1)$ if $\rho_{\alpha}(G)\geq\rho_{\alpha}(K_1\vee(K_{n-2}\cup K_1))$, where $\rho_{\alpha}(K_1\vee(K_{n-2}\cup K_1))$ equals the largest root of $x^{3}-((\alpha+1)n+\alpha-3)x^{2}+(\alpha n^{2}+(\alpha^{2}-\alpha-1)n-2\alpha+1)x-\alpha^{2}n^{2}+(3\alpha^{2}-\alpha+1)n-4\alpha^{2}+5\alpha-3=0$. Further, we present an $A_{\alpha}$-spectral radius condition for a graph to be a $t$-tough graph.


title: Symmetry restoration for TDiff scalar fields

abstract: We explore the idea of restoring the full diffeomorphism (Diff) invariance in theories with only transverse diffeomorphisms (TDiff) by the introduction of additional fields. In particular, we consider in detail the case of a TDiff invariant scalar field and how Diff symmetry can be restored preserving locality by introducing an additional vector field. We reobtain the corresponding dynamics and energy-momentum tensor from the covariantized action and analyze the potential and kinetic domination regimes. For the former, the theory describes a cosmological constant-type behaviour, while for the latter we show that the theory can describe an adiabatic perfect fluid whose equation of state and speed of sound is obtained in a straightforward way. Furthermore, the reformulation with the full symmetry allows us to analyze the gravitational properties of the theory beyond those particular regimes. In particular, we find the general expression for the effective speed of sound of the non-adiabatic perfect fluid, which provides us with physically reasonable conditions that should be satisfied by the coupling functions. Finally, we investigate the particular models leading to an adiabatic fluid.


title: Reinforced In-Context Black-Box Optimization

abstract: Black-Box Optimization (BBO) has found successful applications in many fields of science and engineering. Recently, there has been a growing interest in meta-learning particular components of BBO algorithms to speed up optimization and get rid of tedious hand-crafted heuristics. As an extension, learning the entire algorithm from data requires the least labor from experts and can provide the most flexibility. In this paper, we propose RIBBO, a method to reinforce-learn a BBO algorithm from offline data in an end-to-end fashion. RIBBO employs expressive sequence models to learn the optimization histories produced by multiple behavior algorithms and tasks, leveraging the in-context learning ability of large models to extract task information and make decisions accordingly. Central to our method is to augment the optimization histories with regret-to-go tokens, which are designed to represent the performance of an algorithm based on cumulative regret of the histories. The integration of regret-to-go tokens enables RIBBO to automatically generate sequences of query points that satisfy the user-desired regret, which is verified by its universally good empirical performance on diverse problems, including BBOB functions, hyper-parameter optimization and robot control problems.


title: ViTaL: An Advanced Framework for Automated Plant Disease Identification in Leaf Images Using Vision Transformers and Linear Projection For Feature Reduction

abstract: Our paper introduces a robust framework for the automated identification of diseases in plant leaf images. The framework incorporates several key stages to enhance disease recognition accuracy. In the pre-processing phase, a thumbnail resizing technique is employed to resize images, minimizing the loss of critical image details while ensuring computational efficiency. Normalization procedures are applied to standardize image data before feature extraction. Feature extraction is facilitated through a novel framework built upon Vision Transformers, a state-of-the-art approach in image analysis. Additionally, alternative versions of the framework with an added layer of linear projection and blockwise linear projections are explored. This comparative analysis allows for the evaluation of the impact of linear projection on feature extraction and overall model performance. To assess the effectiveness of the proposed framework, various Convolutional Neural Network (CNN) architectures are utilized, enabling a comprehensive evaluation of linear projection's influence on key evaluation metrics. The findings demonstrate the efficacy of the proposed framework, with the top-performing model achieving a Hamming loss of 0.054. Furthermore, we propose a novel hardware design specifically tailored for scanning diseased leaves in an omnidirectional fashion. The hardware implementation utilizes a Raspberry Pi Compute Module to address low-memory configurations, ensuring practicality and affordability. This innovative hardware solution enhances the overall feasibility and accessibility of the proposed automated disease identification system. This research contributes to the field of agriculture by offering valuable insights and tools for the early detection and management of plant diseases, potentially leading to improved crop yields and enhanced food security.


title: Semi-parametric goodness-of-fit testing for INAR models

abstract: Among the various models designed for dependent count data, integer-valued autoregressive (INAR) processes enjoy great popularity. Typically, statistical inference for INAR models uses asymptotic theory that relies on rather stringent (parametric) assumptions on the innovations such as Poisson or negative binomial distributions. In this paper, we present a novel semi-parametric goodness-of-fit test tailored for the INAR model class. Relying on the INAR-specific shape of the joint probability generating function, our approach allows for model validation of INAR models without specifying the (family of the) innovation distribution. We derive the limiting null distribution of our proposed test statistic, prove consistency under fixed alternatives and discuss its asymptotic behavior under local alternatives. By manifold Monte Carlo simulations, we illustrate the overall good performance of our testing procedure in terms of power and size properties. In particular, it turns out that the power can be considerably improved by using higher-order test statistics. We conclude the article with the application on three real-world economic data sets.