title: CLASSLA-web: Comparable Web Corpora of South Slavic Languages Enriched with Linguistic and Genre Annotation

abstract: This paper presents a collection of highly comparable web corpora of Slovenian, Croatian, Bosnian, Montenegrin, Serbian, Macedonian, and Bulgarian, covering thereby the whole spectrum of official languages in the South Slavic language space. The collection of these corpora comprises a total of 13 billion tokens of texts from 26 million documents. The comparability of the corpora is ensured by a comparable crawling setup and the usage of identical crawling and post-processing technology. All the corpora were linguistically annotated with the state-of-the-art CLASSLA-Stanza linguistic processing pipeline, and enriched with document-level genre information via the Transformer-based multilingual X-GENRE classifier, which further enhances comparability at the level of linguistic annotation and metadata enrichment. The genre-focused analysis of the resulting corpora shows a rather consistent distribution of genres throughout the seven corpora, with variations in the most prominent genre categories being well-explained by the economic strength of each language community. A comparison of the distribution of genre categories across the corpora indicates that web corpora from less developed countries primarily consist of news articles. Conversely, web corpora from economically more developed countries exhibit a smaller proportion of news content, with a greater presence of promotional and opinionated texts.


title: HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting

abstract: Holistic understanding of urban scenes based on RGB images is a challenging yet important problem. It encompasses understanding both the geometry and appearance to enable novel view synthesis, parsing semantic labels, and tracking moving objects. Despite considerable progress, existing approaches often focus on specific aspects of this task and require additional inputs such as LiDAR scans or manually annotated 3D bounding boxes. In this paper, we introduce a novel pipeline that utilizes 3D Gaussian Splatting for holistic urban scene understanding. Our main idea involves the joint optimization of geometry, appearance, semantics, and motion using a combination of static and dynamic 3D Gaussians, where moving object poses are regularized via physical constraints. Our approach offers the ability to render new viewpoints in real-time, yielding 2D and 3D semantic information with high accuracy, and reconstruct dynamic scenes, even in scenarios where 3D bounding box detection are highly noisy. Experimental results on KITTI, KITTI-360, and Virtual KITTI 2 demonstrate the effectiveness of our approach.


title: Python Fuzzing for Trustworthy Machine Learning Frameworks

abstract: Ensuring the security and reliability of machine learning frameworks is crucial for building trustworthy AI-based systems. Fuzzing, a popular technique in secure software development lifecycle (SSDLC), can be used to develop secure and robust software. Popular machine learning frameworks such as PyTorch and TensorFlow are complex and written in multiple programming languages including C/C++ and Python. We propose a dynamic analysis pipeline for Python projects using the Sydr-Fuzz toolset. Our pipeline includes fuzzing, corpus minimization, crash triaging, and coverage collection. Crash triaging and severity estimation are important steps to ensure that the most critical vulnerabilities are addressed promptly. Furthermore, the proposed pipeline is integrated in GitLab CI. To identify the most vulnerable parts of the machine learning frameworks, we analyze their potential attack surfaces and develop fuzz targets for PyTorch, TensorFlow, and related projects such as h5py. Applying our dynamic analysis pipeline to these targets, we were able to discover 3 new bugs and propose fixes for them.


title: Intricacies of CO2-Basalt Interactions, Reactive Flow and Carbon Mineralization: Bridging Numerical Forecasts to Empirical Realities

abstract: Subsurface fluid flow and solute transport are pivotal in addressing pressing energy, environmental, and societal challenges, such as geological CO2 storage. Basaltic rocks have gained prominence as suitable geological substrates for injecting substantial CO2 volumes and carbon mineralization, driven by their widespread occurrence, high concentrations of cation-rich silicate minerals, reported fast mineralization rate, and favorable characteristics such as porosity, permeability, and injectivity. The mineralization process within basaltic rocks is intricately linked, involving the dissolution of silicate minerals and the subsequent precipitation of carbonate minerals. Columnar flow and batch surface growth experiments revealed the spontaneous formation of a limited number of large crystals at various locations, rationalized by the overarching influence of probabilistic mineral nucleation. Experiments with CO2-acidified brine versus freshwater prove to be more challenging regarding the sweet spots for heavy carbon mineralization due to clay formation on the surface, particularly smectites. Despite numerical predictions suggesting the formation of MgFeCa-carbonates in CO2-basalt interactions at higher temperatures, our laboratory findings primarily indicated the growth of calcium carbonates. The experimental and numerical outcomes highlight the necessity of a probabilistic approach for accurately modeling reaction kinetics, crystal growth distribution, and the dynamic interplay between reactive flow, geochemical reactions, mineral carbonation, and geometry alteration.


title: Some geometric and topological data-driven methods in robot motion path planning

abstract: Motion path planning is an intrinsically geometric problem which is central for design of robot systems. Since the early years of AI, robotics together with computer vision have been the areas of computer science that drove its development. Many questions that arise, such as existence, optimality, and diversity of motion paths in the configuration space that describes feasible robot configurations, are of topological nature. The recent advances in topological data analysis and related metric geometry, topology and combinatorics have provided new tools to address these engineering tasks. We will survey some questions, issues, recent work and promising directions in data-driven geometric and topological methods with some emphasis on the use of discrete Morse theory.


title: Small Distance Increment Method for Measuring Complex Permittivity With mmWave Radar

abstract: Measuring the complex permittivity of material is essential in many scenarios such as quality check and component analysis. Generally, measurement methods for characterizing the material are based on the usage of vector network analyzer, which is large and not easy for on-site measurement, especially in high frequency range such as millimeter wave (mmWave). In addition, some measurement methods require the destruction of samples, which is not suitable for non-destructive inspection. In this work, a small distance increment (SDI) method is proposed to non-destructively measure the complex permittivity of material. In SDI, the transmitter and receiver are formed as the monostatic radar, which is facing towards the material under test (MUT). During the measurement, the distance between radar and MUT changes with small increments and the signals are recorded at each position. A mathematical model is formulated to depict the relationship among the complex permittivity, distance increment, and measured signals. By fitting the model, the complex permittivity of MUT is estimated. To implement and evaluate the proposed SDI method, a commercial off-the-shelf mmWave radar is utilized and the measurement system is developed. Then, the evaluation was carried out on the acrylic plate. With the proposed method, the estimated complex permittivity of acrylic plate shows good agreement with the literature values, demonstrating the efficacy of SDI method for characterizing the complex permittivity of material.


title: Optimizing Leapover Lengths of L\'evy Flights with Resetting

abstract: We consider a one-dimensional search process under stochastic resetting conditions. A target is located at $b\geq0$ and a searcher, starting from the origin, performs a discrete-time random walk with independent jumps drawn from a heavy-tailed distribution. Before each jump, there is a given probability $r$ of restarting the walk from the initial position. The efficiency of a "myopic search" - in which the search stops upon crossing the target for the first time - is usually characterized in terms of the first-passage time $\tau$. On the other hand, great relevance is encapsulated by the leapover length $l = x_{\tau} - b$, which measures how far from the target the search ends. For symmetric heavy-tailed jump distributions, in the absence of resetting the average leapover is always infinite. Here we show instead that resetting induces a finite average leapover $\ell_b(r)$ if the mean jump length is finite. We compute exactly $\ell_b(r)$ and determine the condition under which resetting allows for nontrivial optimization, i.e., for the existence of $r^*$ such that $\ell_b(r^*)$ is minimal and smaller than the average leapover of the single jump.


title: Diffusion-Driven Self-Supervised Learning for Shape Reconstruction and Pose Estimation

abstract: Fully-supervised category-level pose estimation aims to determine the 6-DoF poses of unseen instances from known categories, requiring expensive mannual labeling costs. Recently, various self-supervised category-level pose estimation methods have been proposed to reduce the requirement of the annotated datasets. However, most methods rely on synthetic data or 3D CAD model for self-supervised training, and they are typically limited to addressing single-object pose problems without considering multi-objective tasks or shape reconstruction. To overcome these challenges and limitations, we introduce a diffusion-driven self-supervised network for multi-object shape reconstruction and categorical pose estimation, only leveraging the shape priors. Specifically, to capture the SE(3)-equivariant pose features and 3D scale-invariant shape information, we present a Prior-Aware Pyramid 3D Point Transformer in our network. This module adopts a point convolutional layer with radial-kernels for pose-aware learning and a 3D scale-invariant graph convolution layer for object-level shape representation, respectively. Furthermore, we introduce a pretrain-to-refine self-supervised training paradigm to train our network. It enables proposed network to capture the associations between shape priors and observations, addressing the challenge of intra-class shape variations by utilising the diffusion mechanism. Extensive experiments conducted on four public datasets and a self-built dataset demonstrate that our method significantly outperforms state-of-the-art self-supervised category-level baselines and even surpasses some fully-supervised instance-level and category-level methods.


title: Posterior Uncertainty Quantification in Neural Networks using Data Augmentation

abstract: In this paper, we approach the problem of uncertainty quantification in deep learning through a predictive framework, which captures uncertainty in model parameters by specifying our assumptions about the predictive distribution of unseen future data. Under this view, we show that deep ensembling (Lakshminarayanan et al., 2017) is a fundamentally mis-specified model class, since it assumes that future data are supported on existing observations only -- a situation rarely encountered in practice. To address this limitation, we propose MixupMP, a method that constructs a more realistic predictive distribution using popular data augmentation techniques. MixupMP operates as a drop-in replacement for deep ensembles, where each ensemble member is trained on a random simulation from this predictive distribution. Grounded in the recently-proposed framework of Martingale posteriors (Fong et al., 2023), MixupMP returns samples from an implicitly defined Bayesian posterior. Our empirical analysis showcases that MixupMP achieves superior predictive performance and uncertainty quantification on various image classification datasets, when compared with existing Bayesian and non-Bayesian approaches.


title: What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blocks

abstract: Despite significant progress, evaluation of explainable artificial intelligence remains elusive and challenging. In this paper we propose a fine-grained validation framework that is not overly reliant on any one facet of these sociotechnical systems, and that recognises their inherent modular structure: technical building blocks, user-facing explanatory artefacts and social communication protocols. While we concur that user studies are invaluable in assessing the quality and effectiveness of explanation presentation and delivery strategies from the explainees' perspective in a particular deployment context, the underlying explanation generation mechanisms require a separate, predominantly algorithmic validation strategy that accounts for the technical and human-centred desiderata of their (numerical) outputs. Such a comprehensive sociotechnical utility-based evaluation framework could allow to systematically reason about the properties and downstream influence of different building blocks from which explainable artificial intelligence systems are composed -- accounting for a diverse range of their engineering and social aspects -- in view of the anticipated use case.


title: Extension of the characterization method for non-Gaussianity in gravitational wave detector with statistical hypothesis test

abstract: In gravitational wave astronomy, non-Gaussian noise, such as scattered light noise disturbs stable interferometer operation, limiting the interferometer's sensitivity, and reducing the reliability of the analyses. In scattered light noise, the non-Gaussian noise dominates the sensitivity in a low frequency range of less than a few hundred Hz, which is sensitive to gravitational waves from compact binary coalescence. This non-Gaussian noise prevents reliable parameter estimation, since several analysis methods are optimized only for Gaussian noise. Therefore, identifying data contaminated by non-Gaussian noise is important. In this work, we extended the conventional method to evaluate non-Gaussian noise, Rayleigh statistic, by using a statistical hypothesis test to determine a threshold for non-Gaussian noise. First, we estimated the distribution of the Rayleigh statistic against Gaussian noise, called the background distribution, and validated that our extension serves as the hypothetical test. Moreover, we investigated the detection efficiency by assuming two non-Gaussian noise models. For example, for the model with strong scattered light noise, the true positive rate was always above 0.7 when the significance level was 0.05. The results showed that our extension can contribute to an initial detection of non-Gaussian noise and lead to further investigation of the origin of the non-Gaussian noise.


title: Tighter Confidence Bounds for Sequential Kernel Regression

abstract: Confidence bounds are an essential tool for rigorously quantifying the uncertainty of predictions. In this capacity, they can inform the exploration-exploitation trade-off and form a core component in many sequential learning and decision-making algorithms. Tighter confidence bounds give rise to algorithms with better empirical performance and better performance guarantees. In this work, we use martingale tail bounds and finite-dimensional reformulations of infinite-dimensional convex programs to establish new confidence bounds for sequential kernel regression. We prove that our new confidence bounds are always tighter than existing ones in this setting. We apply our confidence bounds to the kernel bandit problem, where future actions depend on the previous history. When our confidence bounds replace existing ones, the KernelUCB (GP-UCB) algorithm has better empirical performance, a matching worst-case performance guarantee and comparable computational cost. Our new confidence bounds can be used as a generic tool to design improved algorithms for other kernelised learning and decision-making problems.


title: Small Scale Reflection for the Working Lean User

abstract: We present the design and implementation of the Small Scale Reflection proof methodology and tactic language (a.k.a. SSR) for the Lean 4 proof assistant. Like its Coq predecessor SSReflect, our Lean 4 implementation, dubbed LeanSSR, provides powerful rewriting principles and means for effective management of hypotheses in the proof context. Unlike SSReflect for Coq, LeanSSR does not require explicit switching between the logical and symbolic representation of a goal, allowing for even more concise proof scripts that seamlessly combine deduction steps with proofs by computation. In this paper, we first provide a gentle introduction to the principles of structuring mechanised proofs using LeanSSR. Next, we show how the native support for metaprogramming in Lean 4 makes it possible to develop LeanSSR entirely within the proof assistant, greatly improving the overall experience of both tactic implementers and proof engineers. Finally, we demonstrate the utility of LeanSSR by conducting two case studies: (a) porting a collection of Coq lemmas about sequences from the widely used Mathematical Components library and (b) reimplementing proofs in the finite set library of Lean's mathlib4. Both case studies show significant reduction in proof sizes.


title: Exact and Heuristic Computation of the Scanwidth of Directed Acyclic Graphs

abstract: To measure the tree-likeness of a directed acyclic graph (DAG), a new width parameter that considers the directions of the arcs was recently introduced: scanwidth. We present the first algorithm that efficiently computes the exact scanwidth of general DAGs. For DAGs with one root and scanwidth $k$ it runs in $O(k \cdot n^k \cdot m)$ time. The algorithm also functions as an FPT algorithm with complexity $O(2^{4 \ell - 1} \cdot \ell \cdot n + n^2)$ for phylogenetic networks of level-$\ell$, a type of DAG used to depict evolutionary relationships among species. Our algorithm performs well in practice, being able to compute the scanwidth of synthetic networks up to 30 reticulations and 100 leaves within 500 seconds. Furthermore, we propose a heuristic that obtains an average practical approximation ratio of 1.5 on these networks. While we prove that the scanwidth is bounded from below by the treewidth of the underlying undirected graph, experiments suggest that for networks the parameters are close in practice.


title: To blow-up or not to blow-up for a granular kinetic equation

abstract: A simplified kinetic description of rapid granular media leads to a nonlocal Vlasov-type equation with a convolution integral operator that is of the same form as the continuity equations for aggregation-diffusion macroscopic dynamics. While the singular behavior of these nonlinear continuity equations is well studied in the literature, the extension to the corresponding granular kinetic equation is highly nontrivial. The main question is whether the singularity formed in velocity direction will be enhanced or mitigated by the shear in phase space due to free transport. We present a preliminary study through a meticulous numerical investigation and heuristic arguments. We have numerically developed a structure-preserving method with adaptive mesh refinement that can effectively capture potential blow-up behavior in the solution for granular kinetic equations. We have analytically constructed a finite-time blow-up infinite mass solution and discussed how this can provide insights into the finite mass scenario.


title: Towards Multimodal In-Context Learning for Vision & Language Models

abstract: Inspired by the emergence of Large Language Models (LLMs) that can truly understand human language, significant progress has been made in aligning other, non-language, modalities to be `understandable' by an LLM, primarily via converting their samples into a sequence of embedded language-like tokens directly fed into the LLM (decoder) input stream. However, so far limited attention has been given to transferring (and evaluating) one of the core LLM capabilities to the emerging VLMs, namely the In-Context Learning (ICL) ability, or in other words to guide VLMs to desired target downstream tasks or output structure using in-context image+text demonstrations. In this work, we dive deeper into analyzing the capabilities of some of the state-of-the-art VLMs to follow ICL instructions, discovering them to be somewhat lacking. We discover that even models that underwent large-scale mixed modality pre-training and were implicitly guided to make use of interleaved image and text information (intended to consume helpful context from multiple images) under-perform when prompted with few-shot (ICL) demonstrations, likely due to their lack of `direct' ICL instruction tuning. To test this conjecture, we propose a simple, yet surprisingly effective, strategy of extending a common VLM alignment framework with ICL support, methodology, and curriculum. We explore, analyze, and provide insights into effective data mixes, leading up to a significant 21.03% (and 11.3% on average) ICL performance boost over the strongest VLM baselines and a variety of ICL benchmarks. We also contribute new benchmarks for ICL evaluation in VLMs and discuss their advantages over the prior art.


title: Navigating Compiler Errors with AI Assistance -- A Study of GPT Hints in an Introductory Programming Course

abstract: We examined the efficacy of AI-assisted learning in an introductory programming course at the university level by using a GPT-4 model to generate personalized hints for compiler errors within a platform for automated assessment of programming assignments. The control group had no access to GPT hints. In the experimental condition GPT hints were provided when a compiler error was detected, for the first half of the problems in each module. For the latter half of the module, hints were disabled. Students highly rated the usefulness of GPT hints. In affect surveys, the experimental group reported significantly higher levels of focus and lower levels of confrustion (confusion and frustration) than the control group. For the six most commonly occurring error types we observed mixed results in terms of performance when access to GPT hints was enabled for the experimental group. However, in the absence of GPT hints, the experimental group's performance surpassed the control group for five out of the six error types.


title: A new framework for constrained optimization via feedback control of Lagrange multipliers

abstract: The continuous-time analysis of existing iterative algorithms for optimization has a long history. This work proposes a novel continuous-time control-theoretic framework for equality-constrained optimization. The key idea is to design a feedback control system where the Lagrange multipliers are the control input, and the output represents the constraints. The system converges to a stationary point of the constrained optimization problem through suitable regulation. Regarding the Lagrange multipliers, we consider two control laws: proportional-integral control and feedback linearization. These choices give rise to a family of different methods. We rigorously develop the related algorithms, theoretically analyze their convergence and present several numerical experiments to support their effectiveness concerning the state-of-the-art approaches.


title: Path Planning in a dynamic environment using Spherical Particle Swarm Optimization

abstract: Efficiently planning an Unmanned Aerial Vehicle (UAV) path is crucial, especially in dynamic settings where potential threats are prevalent. A Dynamic Path Planner (DPP) for UAV using the Spherical Vector-based Particle Swarm Optimisation (SPSO) technique is proposed in this study. The UAV is supposed to go from a starting point to an end point through an optimal path according to some flight criteria. Path length, Safety, Attitude and Path Smoothness are all taken into account upon deciding how an optimal path should be. The path is constructed as a set of way-points that stands as re-planning checkpoints. At each path way-point, threats are allowed some constrained random motion, where their exact positions are updated and fed to the SPSO-solver. Four test scenarios are carried out using real digital elevation models. Each test gives different priorities to path length and safety, in order to show how well the SPSO-DPP is capable of generating a safe yet efficient path segments. Finally, a comparison is made to reveal the persistent overall superior performance of the SPSO, in a dynamic environment, over both the Particle Swarm Optimisation (PSO) and the Genetic Algorithm (GA). The methods are compared directly, by averaging costs over multiple runs, and by considering different challenging levels of obstacle motion. SPSO outperformed both PSO and GA, showcasing cost reductions ranging from 330\% to 675\% compared to both algorithms.


title: Two-level systems and harmonic excitations in a mean-field anharmonic quantum glass

abstract: Structural glasses display at low temperature a set of anomalies in thermodynamic observables. The prominent example is the linear-in-temperature scaling of the specific heat, at odds with the Debye cubic scaling found in crystals, due to acoustic phonons. Such an excess of specific heat in amorphous solids is thought of arising from phenomenological soft excitations dubbed tunneling two-level systems (TTLS). Their nature as well as their statistical properties remain elusive from a first-principle viewpoint. In this work we investigate the canonically quantized version of the KHGPS model, a mean-field glass model of coupled anharmonic oscillators, across its phase diagram, with an emphasis on the specific heat. The thermodynamics is solved in a semiclassical expansion. We show that in the replica-symmetric region of the model, up to the marginal glass transition line where replica symmetry gets continuously broken, a disordered version of the Debye approximation holds: the specific heat is dominated by harmonic vibrational excitations inducing a power-law scaling at the transition, ruled by random matrix theory. This mechanism generalizes a previous semiclassical argument in the literature. We then study the marginal glass phase where the semiclassical expansion becomes non-perturbative due to the emergence of instantons that overcome disordered Debye behavior. Inside the glass phase, a variational solution to the instanton approach provides the prevailing excitations as TTLS, which generate a linear specific heat. This phase thus hosts a mix of TTLS and harmonic excitations generated by interactions. We finally suggest to go beyond the variational approximation through an analogy with the spin-boson model.


title: Refined sheaf counting on local K3 surfaces

abstract: We compute all refined sheaf counting invariants -- Vafa-Witten, reduced DT, stable pairs and Gopakumar-Vafa -- for all classes on local $K3$ surfaces. Along the way we develop rank 0 Vafa-Witten theory on $K3$ surfaces. An important feature of the calculation is that the ``instanton contribution" -- of sheaves supported scheme theoretically on $S$ -- to any of the invariants depends only on the square of the class, not its divisibility.


title: Controllability and diffeomorphism groups on manifolds with boundary

abstract: In this article we consider diffeomorphism groups of manifolds with smooth boundary. We show that the diffeomorphism groups of the manifold and its boundary fit into a short exact sequence which admits local sections. In other words, they form an infinite-dimensional fibre bundle. Manifolds with boundary are of interest in numerical analysis and with a view towards applications in machine learning we establish controllability results for families of vector fields. This generalises older results due to Agrachev and Caponigro in the boundary-less case. Our results show in particular that the diffeomorphism group of a manifold with smooth boundary is generated by the image of the exponential map.


title: Towards Controllable Face Generation with Semantic Latent Diffusion Models

abstract: Semantic Image Synthesis (SIS) is among the most popular and effective techniques in the field of face generation and editing, thanks to its good generation quality and the versatility is brings along. Recent works attempted to go beyond the standard GAN-based framework, and started to explore Diffusion Models (DMs) for this task as these stand out with respect to GANs in terms of both quality and diversity. On the other hand, DMs lack in fine-grained controllability and reproducibility. To address that, in this paper we propose a SIS framework based on a novel Latent Diffusion Model architecture for human face generation and editing that is both able to reproduce and manipulate a real reference image and generate diversity-driven results. The proposed system utilizes both SPADE normalization and cross-attention layers to merge shape and style information and, by doing so, allows for a precise control over each of the semantic parts of the human face. This was not possible with previous methods in the state of the art. Finally, we performed an extensive set of experiments to prove that our model surpasses current state of the art, both qualitatively and quantitatively.


title: Instructing Large Language Models to Identify and Ignore Irrelevant Conditions

abstract: Math word problem (MWP) solving requires generating a reasoning path based on a given problem description that often contains irrelevant conditions. Existing chain-of-thought (CoT) prompting methods elicited multi-step reasoning abilities of large language models (LLMs) to solve MWPs. However, they were seriously confused by the irrelevant conditions, resulting in low accuracy. In this paper, we propose a novel approach named I$^3$C that instructs LLMs to identify and ignore irrelevant conditions. It identifies a set of irrelevant condition candidates that have a weak semantic relevance with the question. Then it prompts LLMs to verify the irrelevant conditions. Lastly it instructs the LLMs with the verification on relevant and irrelevant conditions to avoid confusion and improve reasoning paths. Moreover, we propose to select (problem, reasoning paths) pairs as demonstrations to enhance I$^3$C with few-shot reasoning. We develop I$^3$C-Select that selects the most confusing problems based on the semantic relevance measurement. We conduct extensive experiments on eight MWP datasets. I$^3$C can be combined with any CoT prompting methods to improve the performance of solving MWPs. Notably, with GPT-3.5-Turbo and I$^3$C-Select, we achieve an accuracy of 96.0 and 94.1 on GSM-IC2-1K and GSM-ICM-1K, respectively, significantly outperforming the state-of-the-art few-shot prompting method Complex-CoT by +11.7 and +11.1. Our implementation is made publicly available at https://wzy6642.github.io/I3C.github.io/.


title: Acoustoelectric non-local spin wave power detector for studying magnon-phonon coupling

abstract: We have developed a simple detection scheme to study spin waves excited by surface acoustic wave (SAW) in ferromagnetic thin films. Metallic antennas made of Ta and a ferromagnetic element are placed along the SAW propagation path. The SAW excites spin waves in the ferromagnetic element and induces acoustoelectric current in the antennas, which are detected as a DC voltage. The DC voltage takes an extremum at the spin wave resonance condition, which demonstrates that the antenna acts as a non-local spin wave detector. The antennas placed before and after the ferromagnetic element along the SAW propagation path can probe spin wave excitation from reflected and transmitted SAWs, respectively. Interestingly, we find characteristics of spin wave excitations that are different for the reflected and transmitted SAWs: the former excites spin waves with larger frequency with broader linewidth compared to the latter. The results show that the antennas act as a non-local spin wave power detector and can be used to map out the spin wave spectra in a unique way, providing insights into the magnon-phonon coupling in magnetic nanostructures fabricated on phononic SAW devices.


title: Super-resolution of ultrafast pulses via spectral inversion

abstract: The resolution limits of classical spectroscopy can be surpassed by quantum-inspired methods leveraging the information contained in the phase of the complex electromagnetic field. Their counterpart in spatial imaging has been widely discussed and demonstrated; however, the spectral-domain implementations are few and scarce. We experimentally demonstrate a spectroscopic super-resolution method aimed at broadband light (10s to 100s of GHz), and based on the spectral-domain analog of image inversion interferometry. In a proof-of-principle experiment, we study the paradigmatic problem of estimating a small separation between two incoherent spectral features of equal brightness, with a small number of photons per coherence time. On the grounds of asymptotic estimation theory, more than a $2$-fold improvement over the spectral direct imaging is demonstrated in terms of required resources (photons) for a given estimator variance. The setup is based on an actively stabilized Mach-Zehnder-type interferometer with electro-optic time lenses and passive spectral dispersers implementing the inversion. As such, the method promises on-chip integration, good scalability, and further applications e.g. for mode sorting.


title: N-Modal Contrastive Losses with Applications to Social Media Data in Trimodal Space

abstract: The social media landscape of conflict dynamics has grown increasingly multi-modal. Recent advancements in model architectures such as CLIP have enabled researchers to begin studying the interplay between the modalities of text and images in a shared latent space. However, CLIP models fail to handle situations on social media when modalities present in a post expand above two. Social media dynamics often require understanding the interplay between not only text and images, but video as well. In this paper we explore an extension of the contrastive loss function to allow for any number of modalities, and demonstrate its usefulness in trimodal spaces on social media. By extending CLIP into three dimensions we can further aide understanding social media landscapes where all three modalities are present (an increasingly common situation). We use a newly collected public data set of Telegram posts containing all three modalities to train, and then demonstrate the usefulness of, a trimodal model in two OSINT scenarios: classifying a social media artifact post as either pro-Russian or pro-Ukrainian and identifying which account a given artifact originated from. While trimodal CLIP models have been explored before (though not on social media data), we also display a novel quadmodal CLIP model. This model can learn the interplay between text, image, video, and audio. We demonstrate new state-of-the-art baseline results on retrieval for quadmodel models moving forward.


title: Building Brain Tumor Segmentation Networks with User-Assisted Filter Estimation and Selection

abstract: Brain tumor image segmentation is a challenging research topic in which deep-learning models have presented the best results. However, the traditional way of training those models from many pre-annotated images leaves several unanswered questions. Hence methodologies, such as Feature Learning from Image Markers (FLIM), have involved an expert in the learning loop to reduce human effort in data annotation and build models sufficiently deep for a given problem. FLIM has been successfully used to create encoders, estimating the filters of all convolutional layers from patches centered at marker voxels. In this work, we present Multi-Step (MS) FLIM - a user-assisted approach to estimating and selecting the most relevant filters from multiple FLIM executions. MS-FLIM is used only for the first convolutional layer, and the results already indicate improvement over FLIM. For evaluation, we build a simple U-shaped encoder-decoder network, named sU-Net, for glioblastoma segmentation using T1Gd and FLAIR MRI scans, varying the encoder's training method, using FLIM, MS-FLIM, and backpropagation algorithm. Also, we compared these sU-Nets with two State-Of-The-Art (SOTA) deep-learning models using two datasets. The results show that the sU-Net based on MS-FLIM outperforms the other training methods and achieves effectiveness within the standard deviations of the SOTA models.


title: Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Data

abstract: Named Entity Recognition (NER) is a fundamental task to extract key information from texts, but annotated resources are scarce for dialects. This paper introduces the first dialectal NER dataset for German, BarNER, with 161K tokens annotated on Bavarian Wikipedia articles (bar-wiki) and tweets (bar-tweet), using a schema adapted from German CoNLL 2006 and GermEval. The Bavarian dialect differs from standard German in lexical distribution, syntactic construction, and entity information. We conduct in-domain, cross-domain, sequential, and joint experiments on two Bavarian and three German corpora and present the first comprehensive NER results on Bavarian. Incorporating knowledge from the larger German NER (sub-)datasets notably improves on bar-wiki and moderately on bar-tweet. Inversely, training first on Bavarian contributes slightly to the seminal German CoNLL 2006 corpus. Moreover, with gold dialect labels on Bavarian tweets, we assess multi-task learning between five NER and two Bavarian-German dialect identification tasks and achieve NER SOTA on bar-wiki. We substantiate the necessity of our low-resource BarNER corpus and the importance of diversity in dialects, genres, and topics in enhancing model performance.


title: Galois theory and homology in quasi-abelian functor categories

abstract: Given a finite category T, we consider the functor category [T,A], where A can in particular be any quasi-abelian category. Examples of quasi-abelian categories are given by any abelian category but also by non-exact additive categories as the categories of torsion(-free) abelian groups, topological abelian groups, locally compact abelian groups, Banach spaces and Fr\'echet spaces. In this situation, the categories of various internal categorical structures in A, such as the categories of internal n-fold groupoids, are equivalent to functor categories [T,A] for a suitable category T. For a replete full subcategory S of T, we define F to be the full subcategory of [T,A] whose objects are given by the functors G with G(X)=0 for all objects X not in S. We prove that F is a torsion-free Birkhoff subcategory of [T,A]. This allows us to study (higher) central extensions from categorical Galois theory in [T,A] with respect to F and generalized Hopf formulae for homology.


title: Oscillatory integrals and weighted gradient flows

abstract: We investigate estimating scalar oscillatory integrals by integrating by parts in directions based on $(x_1 \partial_{x_1} f(x) ,..., x_n \partial_{x_n}f(x))$, where $f(x)$ is the phase function. We prove a theorem which provides estimates that are uniform with respect to linear perturbations of the phase and investigate some consequences. When the phase function is quasi-homogeneous the theorem gives estimates for the associated surface measure Fourier transforms that are generally not too far off from being sharp. In addition, the theorem provides a new proof, up to endpoints, that the well-known oscillatory integral estimates of Varchenko [V] when the Newton polyhedron of the phase function is nondegenerate extend to corresponding bounds for surface measure Fourier transforms when the index is less than $\frac{1}{2}$. A sharp version of this was originally proven in [G2].


title: Counting coprime pairs in random squares

abstract: Extending the classical Dirichlet's density theorem on coprime pairs, in this paper we describe completely the probability distribution of the number of coprime pairs in random squares of fixed side length in the lattice $\mathbb{N}^2$. The limit behaviour of this distribution as the side length of the random square tends to infinity is also considered.


title: Developing Algorithms for the Internet of Flying Things Through Environments With Varying Degrees of Realism -- Extended Version

abstract: This work discusses the benefits of having multiple simulated environments with different degrees of realism for the development of algorithms in scenarios populated by autonomous nodes capable of communication and mobility. This approach aids the development experience and generates robust algorithms. It also proposes GrADyS-SIM NextGen as a solution that enables development on a single programming language and toolset over multiple environments with varying levels of realism. Finally, we illustrate the usefulness of this approach with a toy problem that makes use of the simulation framework, taking advantage of the proposed environments to iteratively develop a robust solution.


title: Ring nebulae around Wolf-Rayet stars in M33 as seen by SITELLE

abstract: We have conducted an analysis of nebulae around Wolf-Rayet (WR) stars in M33 using data collected by the imaging Fourier transform spectrometer SITELLE at the Canada-France-Hawaii telescope as part of the SIGNALS Large Program. Of the 211 known Wolf-Rayet stars in M33, 178 are located in the fields observed in this study. We present the results of this analysis in the form of a comprehensive summary of all nebulae found around the observed WR stars. Based on three criteria we find to be the most effective for their detection, we detect a clear association with a circumstellar bubble around 33 of them (19\%). Our results show that the presence of bubbles does not correlate with the spectral type of the central star. The mean diameter of the WR nebulae we have found is 21 parsecs.


title: Fast event-driven simulations for soft spheres: from dynamics to Laves phase nucleation

abstract: Conventional molecular dynamics (MD) simulations struggle when simulating particles with steeply varying interaction potentials, due to the need to use a very short time step. Here, we demonstrate that an event-driven Monte Carlo (EDMC) approach first introduced by Peters and de With [Phys. Rev. E 85, 026703 (2012)] represents an excellent substitute for MD in the canonical ensemble. In addition to correctly reproducing the static thermodynamic properties of the system, the EDMC method closely mimics the dynamics of systems of particles interacting via the steeply repulsive Weeks-Chandler-Andersen (WCA) potential. In comparison to time-driven MD simulations, EDMC runs faster by over an order of magnitude at sufficiently low temperatures. Moreover, the lack of a finite time step in EDMC circumvents the need to trade accuracy against simulation speed associated with the choice of time step in MD. We showcase the usefulness of this model to explore the phase behavior of the WCA model at extremely low temperatures, and to demonstrate that spontaneous nucleation and growth of the Laves phases is possible at temperatures significantly lower than previously reported.


title: Hurwitz moduli varieties parameterizing pointed covers of an algebraic curve with a fixed monodromy group

abstract: Given a smooth, projective curve $Y$, a point $y_0 \in Y$, a positive integer $n$, and a transitive subgroup $G$ of the symmetric group $S_{d}$ we study smooth, proper families, parameterized by algebraic varieties, of pointed degree $d$ covers of $(Y,y_0)$, $(X,x_{0})\to (Y,y_0)$, branched in $n$ points of $Y\setminus y_{0}$, whose monodromy group equals $G$. We construct a Hurwitz space $H$, an algebraic variety whose points are in bijective correspondence with the equivalence classes of pointed covers of $(Y,y_0)$ of this type. We construct explicitly a family parameterized by $H$, whose fibers belong to the corresponding equivalence classes, and prove that it is universal. We use classical tools of algebraic topology and of complex algebraic geometry.


title: On Equivalence of Likelihood-Based Confidence Bands for Fatigue-Life and Fatigue-Strength Distributions

abstract: Fatigue data arise in many research and applied areas and there have been statistical methods developed to model and analyze such data. The distributions of fatigue life and fatigue strength are often of interest to engineers designing products that might fail due to fatigue from cyclic-stress loading. Based on a specified statistical model and the maximum likelihood method, the cumulative distribution function (cdf) and quantile function (qf) can be estimated for the fatigue-life and fatigue-strength distributions. Likelihood-based confidence bands then can be obtained for the cdf and qf. This paper provides equivalence results for confidence bands for fatigue-life and fatigue-strength models. These results are useful for data analysis and computing implementation. We show (a) the equivalence of the confidence bands for the fatigue-life cdf and the fatigue-life qf, (b) the equivalence of confidence bands for the fatigue-strength cdf and the fatigue-strength qf, and (c) the equivalence of confidence bands for the fatigue-life qf and the fatigue-strength qf. Then we illustrate the usefulness of those equivalence results with two examples using experimental fatigue data.


title: Strong-coupling critical behavior in three-dimensional lattice Abelian gauge models with charged $N$-component scalar fields and $SO(N)$ symmetry

abstract: We consider a three-dimensional lattice Abelian Higgs gauge model for a charged $N$-component scalar field ${\phi}$, which is invariant under $SO(N)$ global transformations for generic values of the parameters. We focus on the strong-coupling regime, in which the kinetic Hamiltonian term for the gauge field is a small perturbation, which is irrelevant for the critical behavior. The Hamiltonian depends on a parameter $v$ which determines the global symmetry of the model and the symmetry of the low-temperature phases. We present renormalization-group predictions, based on a Landau-Ginzburg-Wilson effective description that relies on the identification of the appropriate order parameter and on the symmetry-breaking patterns that occur at the strong-coupling phase transitions. For $v=0$, the global symmetry group of the model is $SU(N)$; the corresponding model may undergo continuous transitions only for $N=2$. For $v\not=0$, i.e., in the $SO(N)$ symmetric case, continuous transitions (in the Heisenberg universality class) are possible also for $N=3$ and 4. We perform Monte Carlo simulations for $N=2,3,4,6$, to verify the renormalization-group predictions. Finite-size scaling analyses of the numerical data are in full agreement.


title: Robust Numerical Methods for Nonlinear Regression

abstract: Many scientific and engineering applications require fitting regression models that are nonlinear in the parameters. Advances in computer hardware and software in recent decades have made it easier to fit such models. Relative to fitting regression models that are linear in the parameters, however, fitting nonlinear regression models is more complicated. In particular, software like the $\texttt{nls}$ R function requires care in how the model is parameterized and how initial values are chosen for the maximum likelihood iterations. Often special diagnostics are needed to detect and suggest approaches for dealing with identifiability problems that can arise with such model fitting. When using Bayesian inference, there is the added complication of having to specify (often noninformative or weakly informative) prior distributions. Generally, the details for these tasks must be determined for each new nonlinear regression model. This paper provides a step-by-step procedure for specifying these details for any appropriate nonlinear regression model. Following the procedure will result in a numerically robust algorithm for fitting the nonlinear regression model. We illustrate the methods with three different nonlinear models that are used in the analysis of experimental fatigue data and we include two detailed numerical examples.


title: WaveFace: Authentic Face Restoration with Efficient Frequency Recovery

abstract: Although diffusion models are rising as a powerful solution for blind face restoration, they are criticized for two problems: 1) slow training and inference speed, and 2) failure in preserving identity and recovering fine-grained facial details. In this work, we propose WaveFace to solve the problems in the frequency domain, where low- and high-frequency components decomposed by wavelet transformation are considered individually to maximize authenticity as well as efficiency. The diffusion model is applied to recover the low-frequency component only, which presents general information of the original image but 1/16 in size. To preserve the original identity, the generation is conditioned on the low-frequency component of low-quality images at each denoising step. Meanwhile, high-frequency components at multiple decomposition levels are handled by a unified network, which recovers complex facial details in a single step. Evaluations on four benchmark datasets show that: 1) WaveFace outperforms state-of-the-art methods in authenticity, especially in terms of identity preservation, and 2) authentic images are restored with the efficiency 10x faster than existing diffusion model-based BFR methods.


title: BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMs

abstract: This paper presents a novel approach to generating behavior trees for robots using lightweight large language models (LLMs) with a maximum of 7 billion parameters. The study demonstrates that it is possible to achieve satisfying results with compact LLMs when fine-tuned on a specific dataset. The key contributions of this research include the creation of a fine-tuning dataset based on existing behavior trees using GPT-3.5 and a comprehensive comparison of multiple LLMs (namely llama2, llama-chat, and code-llama) across nine distinct tasks. To be thorough, we evaluated the generated behavior trees using static syntactical analysis, a validation system, a simulated environment, and a real robot. Furthermore, this work opens the possibility of deploying such solutions directly on the robot, enhancing its practical applicability. Findings from this study demonstrate the potential of LLMs with a limited number of parameters in generating effective and efficient robot behaviors.


title: Smooth helically symmetric transonic flows with nonzero vorticity in a concentric cylinder

abstract: This paper concerns the structural stability of smooth cylindrical symmetric transonic flows in a concentric cylinder under helically symmetric perturbation of suitable boundary conditions. The deformation-curl decomposition developed by the second author and his collaborator is utilized to effectively decouple the elliptic-hyperbolic mixed structure in the steady compressible Euler equation. A key parameter in the helical symmetry is the step (denoted by $\sigma$), which denotes the magnitude of the translation along the symmetry axis after rotating one full turn. It is shown that the step determines the type of the first order partial differential system satisfied by the radial and vertical velocity. There exists a critical number $\sigma_{*}$ depending only on the background transonic flows, such that if $0<\sigma<\sigma_{*}$, one can prove the existence and uniqueness of smooth helically symmetric transonic flows with nonzero vorticity.


title: A smoothing effect for the fractional Schr\"odinger equations on the circle and observability

abstract: We show that, after a renormalisation, one can define the square of the modulus of the solution of the fractional Schr\"odinger equations on the circle with data in Sobolev spaces of arbitrary negative index. As an application, we obtain observability estimates with rough controls.


title: Neural Parameter Regression for Explicit Representations of PDE Solution Operators

abstract: We introduce Neural Parameter Regression (NPR), a novel framework specifically developed for learning solution operators in Partial Differential Equations (PDEs). Tailored for operator learning, this approach surpasses traditional DeepONets (Lu et al., 2021) by employing Physics-Informed Neural Network (PINN, Raissi et al., 2019) techniques to regress Neural Network (NN) parameters. By parametrizing each solution based on specific initial conditions, it effectively approximates a mapping between function spaces. Our method enhances parameter efficiency by incorporating low-rank matrices, thereby boosting computational efficiency and scalability. The framework shows remarkable adaptability to new initial and boundary conditions, allowing for rapid fine-tuning and inference, even in cases of out-of-distribution examples.


title: Dynamic Density Functional Theory with Inertia and Background Flow

abstract: We present dynamic density functional theory (DDFT) incorporating general inhomogeneous, incompressible, time dependent background flows and inertia, describing externally driven passive colloidal systems out of equilibrium. We start by considering the underlying nonequilibrium Langevin dynamics, including the effect of the local velocity of the surrounding liquid bath, to obtain the nonlinear, nonlocal partial differential equations governing the evolution of the (coarse--grained) density and velocity fields describing the dynamics of colloids. Additionally, we show both with heuristic arguments, and by numerical solution, that our equations and solutions agree with existing DDFTs in the overdamped (high friction) limit. We provide numerical solutions that model the flow of hard spheres, in both unbounded and confined domains, and compare to previously--derived DDFTs with and without the background flow.


title: NovelQA: Benchmarking Question Answering on Documents Exceeding 200K Tokens

abstract: The rapid advancement of Large Language Models (LLMs) has introduced a new frontier in natural language processing, particularly in understanding and processing long-context information. However, the evaluation of these models' long-context abilities remains a challenge due to the limitations of current benchmarks. To address this gap, we introduce NovelQA, a benchmark specifically designed to test the capabilities of LLMs with extended texts. Constructed from English novels, NovelQA offers a unique blend of complexity, length, and narrative coherence, making it an ideal tool for assessing deep textual understanding in LLMs. This paper presents the design and construction of NovelQA, highlighting its manual annotation, and diverse question types. Our evaluation of Long-context LLMs on NovelQA reveals significant insights into the models' performance, particularly emphasizing the challenges they face with multi-hop reasoning, detail-oriented questions, and extremely long input with an average length more than 200,000 tokens. The results underscore the necessity for further advancements in LLMs to improve their long-context comprehension.


title: Inter- and intra-uncertainty based feature aggregation model for semi-supervised histopathology image segmentation

abstract: Acquiring pixel-level annotations is often limited in applications such as histology studies that require domain expertise. Various semi-supervised learning approaches have been developed to work with limited ground truth annotations, such as the popular teacher-student models. However, hierarchical prediction uncertainty within the student model (intra-uncertainty) and image prediction uncertainty (inter-uncertainty) have not been fully utilized by existing methods. To address these issues, we first propose a novel inter- and intra-uncertainty regularization method to measure and constrain both inter- and intra-inconsistencies in the teacher-student architecture. We also propose a new two-stage network with pseudo-mask guided feature aggregation (PG-FANet) as the segmentation model. The two-stage structure complements with the uncertainty regularization strategy to avoid introducing extra modules in solving uncertainties and the aggregation mechanisms enable multi-scale and multi-stage feature integration. Comprehensive experimental results over the MoNuSeg and CRAG datasets show that our PG-FANet outperforms other state-of-the-art methods and our semi-supervised learning framework yields competitive performance with a limited amount of labeled data.


title: ContextVis: Envision Contextual Learning and Interaction with Generative Models

abstract: ContextVis introduces a workflow by integrating generative models to create contextual learning materials. It aims to boost knowledge acquisition through the creation of resources with contextual cues. A case study on vocabulary learning demonstrates the effectiveness of generative models in developing educational resources that enrich language understanding and aid memory retention. The system combines an easy-to-use Dashboard for educators with an interactive Playground for learners, establishing a unified platform for content creation and interaction. Future work may expand to include a wider range of generative models, media formats, and customization features for educators.


title: Understanding the Factors Influencing Self-Managed Enterprises of Crowdworkers: A Comprehensive Review

abstract: This paper investigates the shift in crowdsourcing towards self-managed enterprises of crowdworkers (SMECs), diverging from traditional platform-controlled models. It reviews the literature to understand the foundational aspects of this shift, focusing on identifying key factors that may explain the rise of SMECs, particularly concerning power dynamics and tensions between Online Labor Platforms (OLPs) and crowdworkers. The study aims to guide future research and inform policy and platform development, emphasizing the importance of fair labor practices in this evolving landscape.


title: Multispectral Image Restoration by Generalized Opponent Transformation Total Variation

abstract: Multispectral images (MSI) contain light information in different wavelengths of objects, which convey spectral-spatial information and help improve the performance of various image processing tasks. Numerous techniques have been created to extend the application of total variation regularization in restoring multispectral images, for example, based on channel coupling and adaptive total variation regularization. The primary contribution of this paper is to propose and develop a new multispectral total variation regularization in a generalized opponent transformation domain instead of the original multispectral image domain. Here opponent transformations for multispectral images are generalized from a well-known opponent transformation for color images. We will explore the properties of generalized opponent transformation total variation (GOTTV) regularization and the corresponding optimization formula for multispectral image restoration. To evaluate the effectiveness of the new GOTTV method, we provide numerical examples that showcase its superior performance compared to existing multispectral image total variation methods, using criteria such as MPSNR and MSSIM.


title: TYC 3340-2437-1: A Quadruple System with A Massive Star

abstract: Hierarchical massive quadruple systems are ideal laboratories for examining the theories of star formation, dynamical evolution, and stellar evolution. The successive mergers of hierarchical quadruple systems might explain the mass gap between neutron stars and black holes. Looking for light curves of O-type binaries identified by LAMOST, we find a (2+2) quadruple system: TYC 3340-2437-1, located in the stellar bow-shock nebula (SBN). It has a probability of over 99.99\% being a quadruple system derived from the surface density of the vicinity stars. Its inner orbital periods are 3.390602(89) days and 2.4378(16) days, respectively, and the total mass is about (11.47 + 5.79) + (5.2 + 2.02) = 24.48 $M_{\odot}$. The line-of-sight inclinations of the inner binaries, B$_1$ and B$_2$, are 55.94 and 78.2 degrees, respectively, indicating that they are not co-planar. Based on observations spanning 34 months and the significance of the astrometric excess noise ($D>2$) in Gaia DR3 data, we guess that its outer orbital period might be a few years. If it were true, the quadruple system might form through the disk fragmentation mechanism with outer eccentric greater than zero. This eccentricity could be the cause of both the arc-like feature of the SBN and the noncoplanarity of the inner orbit. The outer orbital period and outer eccentric could be determined with the release of future epoch astrometric data of Gaia.


title: Eden model for Pentagons

abstract: We study topological and geometric properties of a cell growth process in the Euclidean plane, where the cells are regular pentagons. To explore the aesthetic aspects of this model, we employ a laser cutter on various materials to create physical representations for some simulations of the model.


title: Integers and Prime Numbers: Deriving Zipf's Law

abstract: In a prime number decomposition of integers in a given set, the occurrence frequencies of prime numbers are shown to satisfy a general forms of Zipf's law.


title: Is open source software culture enough to make AI a common ?

abstract: Language models (LM or LLM) are increasingly deployed in the field of artificial intelligence (AI) and its applications, but the question arises as to whether they can be a common resource managed and maintained by a community of users. Indeed, the dominance of private companies with exclusive access to massive data and language processing resources can create inequalities and biases in LM, as well as obstacles to innovation for those who do not have the same resources necessary for their implementation. In this contribution, we examine the concept of the commons and its relevance for thinking about LM. We highlight the potential benefits of treating the data and resources needed to create LMs as commons, including increased accessibility, equity, and transparency in the development and use of AI technologies. Finally, we present a case study centered on the Hugging Face platform, an open-source platform for deep learning designed to encourage collaboration and sharing among AI designers.


title: Bootstrap Percolation on the Binomial Random $k$-uniform Hypergraph

abstract: We investigate the behaviour of $r$-neighbourhood bootstrap percolation on the binomial $k$-uniform random hypergraph $H_k(n,p)$ for given integers $k\geq 2$ and $r\geq 2$. In $r$-neighbourhood bootstrap percolation, infection spreads through the hypergraph, starting from a set of initially infected vertices, and in each subsequent step of the process every vertex with at least $r$ infected neighbours becomes infected. For our analysis the set of initially infected vertices is chosen uniformly at random from all sets of given size. In the regime $n^{-1}\ll n^{k-2}p \ll n^{-1/r}$ we establish a threshold such that if the number of initially infected vertices remains below the threshold, then with high probability only a few additional vertices become infected, while if the number of initially infected vertices exceeds the threshold then with high probability almost every vertex becomes infected. In fact we show that the probability of failure decreases exponentially.


title: Automated Data Curation for Robust Language Model Fine-Tuning

abstract: Large Language Models have become the de facto approach to sequence-to-sequence text generation tasks, but for specialized tasks/domains, a pretrained LLM lacks specific capabilities to produce accurate or well-formatted responses. Supervised fine-tuning specializes a LLM by training it on dataset of example prompts with target responses, but real-world data tends to be noisy. While many fine-tuning algorithms exist, here we consider a \emph{data-centric AI} perspective on LLM fine-tuning, studying how to \emph{systematically} curate the training dataset to improve the LLM produced via \emph{any} fine-tuning algorithm. We introduce an automated data curation pipeline CLEAR (Confidence-based LLM Evaluation And Rectification) for instruction tuning datasets, that can be used with any LLM and fine-tuning procedure. CLEAR estimates which training data is low-quality and either filters or corrects it. Automatically identifying which data to filter or correct is done via LLM-derived confidence estimates, to ensure only confident modifications to the dataset. Unlike existing data curation techniques, CLEAR is a comprehensive framework that can improve a dataset (and trained model outputs) without additional fine-tuning computations. We don't assume access to a stronger LLM than the model being fine-tuned (e.g.\ relying on GPT-4 when fine-tuning GPT-3.5), to see whether CLEAR can meaningfully improve the capabilities of any LLM. Experiments reveal that CLEAR consistently improves the performance of fine-tuned models across many datasets and models (like GPT-3.5 and Llama2).


title: Discover and Mitigate Multiple Biased Subgroups in Image Classifiers

abstract: Machine learning models can perform well on in-distribution data but often fail on biased subgroups that are underrepresented in the training data, hindering the robustness of models for reliable applications. Such subgroups are typically unknown due to the absence of subgroup labels. Discovering biased subgroups is the key to understanding models' failure modes and further improving models' robustness. Most previous works of subgroup discovery make an implicit assumption that models only underperform on a single biased subgroup, which does not hold on in-the-wild data where multiple biased subgroups exist. In this work, we propose Decomposition, Interpretation, and Mitigation (DIM), a novel method to address a more challenging but also more practical problem of discovering multiple biased subgroups in image classifiers. Our approach decomposes the image features into multiple components that represent multiple subgroups. This decomposition is achieved via a bilinear dimension reduction method, Partial Least Square (PLS), guided by useful supervision from the image classifier. We further interpret the semantic meaning of each subgroup component by generating natural language descriptions using vision-language foundation models. Finally, DIM mitigates multiple biased subgroups simultaneously via two strategies, including the data- and model-centric strategies. Extensive experiments on CIFAR-100 and Breeds datasets demonstrate the effectiveness of DIM in discovering and mitigating multiple biased subgroups. Furthermore, DIM uncovers the failure modes of the classifier on Hard ImageNet, showcasing its broader applicability to understanding model bias in image classifiers. The code is available at https://github.com/ZhangAIPI/DIM.


title: ViTGaze: Gaze Following with Interaction Features in Vision Transformers

abstract: Gaze following aims to interpret human-scene interactions by predicting the person's focal point of gaze. Prevailing approaches often use multi-modality inputs, most of which adopt a two-stage framework. Hence their performance highly depends on the previous prediction accuracy. Others use a single-modality approach with complex decoders, increasing network computational load. Inspired by the remarkable success of pre-trained plain Vision Transformers (ViTs), we introduce a novel single-modality gaze following framework, ViTGaze. In contrast to previous methods, ViTGaze creates a brand new gaze following framework based mainly on powerful encoders (dec. param. less than 1%). Our principal insight lies in that the inter-token interactions within self-attention can be transferred to interactions between humans and scenes. Leveraging this presumption, we formulate a framework consisting of a 4D interaction encoder and a 2D spatial guidance module to extract human-scene interaction information from self-attention maps. Furthermore, our investigation reveals that ViT with self-supervised pre-training exhibits an enhanced ability to extract correlated information. A large number of experiments have been conducted to demonstrate the performance of the proposed method. Our method achieves state-of-the-art (SOTA) performance among all single-modality methods (3.4% improvement on AUC, 5.1% improvement on AP) and very comparable performance against multi-modality methods with 59% number of parameters less.


title: Quantum Fisher information in a strange metal

abstract: A strange metal is an exotic state of correlated quantum matter; intensive efforts are ongoing to decipher its nature. Here we explore whether the quantum Fisher information (QFI), a concept from quantum metrology, can provide new insight. We use inelastic neutron scattering and quantum Monte Carlo simulations to study a Kondo destruction quantum critical point, where strange metallicity is associated with fluctuations beyond a Landau order parameter. We find that the QFI probed away from magnetic Bragg peaks, where the effect of magnetic ordering is minimized, increases strongly and without a characteristic scale as the strange metal forms with decreasing temperature, evidencing its unusual entanglement properties. Our work opens a new direction for studies across strange metal platforms.


title: Review on the probabilistic construction and Conformal bootstrap in Liouville Theory

abstract: In the paper, we review the recent construction of the Liouville conformal field theory (CFT) from probabilistic methods, and the formalization of the conformal bootstrap. This model has offered a fruitful playground to unify the probabilistic construction of the path integral, the geometric axiomatics of CFT by Segal and the representation theoretical content of the conformal bootstrap. We explain and extract the main steps and ideas behind the construction and resolution of this non-compact CFT.


title: Large-Scale RIS Enabled Air-Ground Channels: Near-Field Modeling and Analysis

abstract: Existing works mainly rely on the far-field planar-wave-based channel model to assess the performance of reconfigurable intelligent surface (RIS)-enabled wireless communication systems. However, when the transmitter and receiver are in near-field ranges, this will result in relatively low computing accuracy. To tackle this challenge, we initially develop an analytical framework for sub-array partitioning. This framework divides the large-scale RIS array into multiple sub-arrays, effectively reducing modeling complexity while maintaining acceptable accuracy. Then, we develop a beam domain channel model based on the proposed sub-array partition framework for large-scale RIS-enabled UAV-to-vehicle communication systems, which can be used to efficiently capture the sparse features in RIS-enabled UAV-to-vehicle channels in both near-field and far-field ranges. Furthermore, some important propagation characteristics of the proposed channel model, including the spatial cross-correlation functions (CCFs), temporal auto-correlation functions (ACFs), frequency correlation functions (CFs), and channel capacities with respect to the different physical features of the RIS and non-stationary properties of the channel model are derived and analyzed. Finally, simulation results are provided to demonstrate that the proposed framework is helpful to achieve a good tradeoff between model complexity and accuracy for investigating the channel propagation characteristics, and therefore providing highly-efficient communications in RIS-enabled UAV-to-vehicle wireless networks.


title: Beyond Point Masses. III. Detecting Haumea's Nonspherical Gravitational Field

abstract: The dwarf planet Haumea is one of the most compelling transneptunian objects (TNOs) to study, hosting two small, dynamically interacting satellites, a family of nearby spectrally unique objects, and a ring system. Haumea itself is extremely oblate due to its 3.9 hour rotation period. Understanding the orbits of Haumea's satellites, named Hi'iaka and Namaka, requires detailed modeling of both satellite-satellite gravitational interactions and satellite interactions with Haumea's nonspherical gravitational field (parameterized here as $J_2$). Understanding both of these effects allows for a detailed probe of the satellites' masses and Haumea's $J_2$ and spin pole. Measuring Haumea's $J_2$ provides information about Haumea's interior, possibly determining the extent of past differentation. In an effort to understand the Haumea system, we have performed detailed non-Keplerian orbit fitting of Haumea's satellites using a decade of new ultra-precise observations. Our fits detect Haumea's $J_2$ and spin pole at $\gtrsim2.5\sigma$ confidence. Degeneracies present in the dynamics prevent us from precisely measuring Haumea's $J_2$ with the current data, but future observations should enable a precise measurement. Our dynamically determined spin pole shows excellent agreement with past results, illustrating the strength of non-Keplerian orbit fitting. We also explore the spin-orbit dynamics of Haumea and its satellites, showing that axial precession of Hi'iaka may be detectable over decadal timescales. Finally, we present an ephemeris of the Haumea system over the coming decade, enabling high-quality observations of Haumea and its satellites for years to come.


title: Beyond Point Masses. II. Non-Keplerian Shape Effects are Detectable in Several TNO Binaries

abstract: About 40 transneptunian binaries (TNBs) have fully determined orbits with about 10 others being solved except for breaking the mirror ambiguity. Despite decades of study almost all TNBs have only ever been analyzed with a model that assumes perfect Keplerian motion (e.g., two point masses). In reality, all TNB systems are non-Keplerian due to non-spherical shapes, possible presence of undetected system components, and/or solar perturbations. In this work, we focus on identifying candidates for detectable non-Keplerian motion based on sample of 45 well-characterized binaries. We use MultiMoon, a non-Keplerian Bayesian inference tool, to analyze published relative astrometry allowing for non-spherical shapes of each TNB system's primary. We first reproduce the results of previous Keplerian fitting efforts with MultiMoon, which serves as a comparison for the non-Keplerian fits and confirms that these fits are not biased by the assumption of a Keplerian orbit. We unambiguously detect non-Keplerian motion in 8 TNB systems across a range of primary radii, mutual orbit separations, and system masses. As a proof of concept for non-Keplerian fitting, we perform detailed fits for (66652) Borasisi-Pabu, possibly revealing a $J_2 \approx 0.44$, implying Borasisi (and/or Pabu) may be a contact binary or an unresolved compact binary. However, full confirmation of this result will require new observations. This work begins the next generation of TNB analyses that go beyond the point mass assumption to provide unique and valuable information on the physical properties of TNBs with implications for their formation and evolution.


title: Total Disentanglement of Font Images into Style and Character Class Features

abstract: In this paper, we demonstrate a total disentanglement of font images. Total disentanglement is a neural network-based method for decomposing each font image nonlinearly and completely into its style and content (i.e., character class) features. It uses a simple but careful training procedure to extract the common style feature from all `A'-`Z' images in the same font and the common content feature from all `A' (or another class) images in different fonts. These disentangled features guarantee the reconstruction of the original font image. Various experiments have been conducted to understand the performance of total disentanglement. First, it is demonstrated that total disentanglement is achievable with very high accuracy; this is experimental proof of the long-standing open question, ``Does `A'-ness exist?'' Hofstadter (1985). Second, it is demonstrated that the disentangled features produced by total disentanglement apply to a variety of tasks, including font recognition, character recognition, and one-shot font image generation.


title: Beyond Point Masses. I. New Non-Keplerian Modeling Tools Applied to Trans-Neptunian Triple (47171) Lempo

abstract: Many details of the formation and evolution of the solar system are best inferred by understanding the orbital and physical properties of small bodies in the solar system. For example, small body binaries are particularly valuable for measuring masses. By extending the models of small body binaries beyond point masses, new information about the shape and spin orientation becomes available. This is particularly informative for Trans-Neptunian multiples (two or more components) where shapes and spin orientations are poorly understood. Going beyond point masses requires modeling tools that no longer assume fixed Keplerian orbits. To this end, we have developed a new n-quadrupole integrator SPINNY (SPIN+N-bodY) and pair it with a Bayesian parameter inference tool MultiMoon, both of which are publicly available. We describe these tools and how they can be used to learn more about solar system small body multiple systems. We then apply them to the unique Trans-Neptunian hierarchical triple system (47171) Lempo, finding a three-point-mass solution for the first time. This solution has two surprises: unequal densities of the inner components and a dynamical configuration apparently unstable on the age of the solar system.


title: Beyond Point Masses. IV. TNO Altjira is Likely a Hierarchical Triple Discovered Through Non-Keplerian Motion

abstract: Dynamically studying Trans-Neptunian Object (TNO) binaries allows us to measure masses and orbits. Most of the known objects appear to have only two components, except (47171) Lempo which is the single known hierarchical triple system with three similar-mass components. Though hundreds of TNOs have been imaged with high-resolution telescopes, no other hierarchical triples (or trinaries) have been found among solar system small bodies, even though they are predicted in planetesimal formation models such as gravitational collapse after the streaming instability. By going beyond the point-mass assumption and modeling TNO orbits as non-Keplerian, we open a new window into the shapes and spins of the components, including the possible presence of unresolved ``inner'' binaries. Here we present evidence for a new hierarchical triple, (148780) Altjira (2001 UQ$_{18}$), based on non-Keplerian dynamical modeling of the two observed components. We incorporate two recent Hubble Space Telescope (HST) observations, leading to a 17 year observational baseline. We present a new open-source Bayesian Point Spread Function (PSF) fitting code called nPSF that provides precise relative astrometry and uncertainties for single images. Our non-Keplerian analysis measures a statistically-significant ($\sim$2.5-$\sigma$) non-spherical shape for Altjira. The measured $J_2$ is best explained as an unresolved inner binary and an example hierarchical triple model gives the best fit to the observed astrometry. Using an updated non-Keplerian ephemeris (which is significantly different from the Keplerian predictions), we show that the predicted mutual event season for Altjira has already begun with several excellent opportunities for observations through $\sim$2030.


title: DDSB: An Unsupervised and Training-free Method for Phase Detection in Echocardiography

abstract: Accurate identification of End-Diastolic (ED) and End-Systolic (ES) frames is key for cardiac function assessment through echocardiography. However, traditional methods face several limitations: they require extensive amounts of data, extensive annotations by medical experts, significant training resources, and often lack robustness. Addressing these challenges, we proposed an unsupervised and training-free method, our novel approach leverages unsupervised segmentation to enhance fault tolerance against segmentation inaccuracies. By identifying anchor points and analyzing directional deformation, we effectively reduce dependence on the accuracy of initial segmentation images and enhance fault tolerance, all while improving robustness. Tested on Echo-dynamic and CAMUS datasets, our method achieves comparable accuracy to learning-based models without their associated drawbacks. The code is available at https://github.com/MRUIL/DDSB


title: Brain volume is a better biomarker of outcomes in ischemic stroke compared to brain atrophy

abstract: Brain parenchymal fraction (BPF) has been used as a surrogate measure of global brain atrophy, and as a biomarker of brain reserve in studies evaluating clinical outcomes after brain injury. Total brain volume at the time of injury has recently been shown to influence functional outcomes, where larger brain volumes are associated with better outcomes. Here, we assess if brain volume at the time of ischemic stroke injury is a better biomarker of functional outcome than BPF. Acute ischemic stroke cases at a single center between 2003 and 2011, with MR neuroimaging obtained within 48 hours from presentation were eligible. Functional outcomes represented by the modified Rankin Score (mRS) at 90 days post admission (mRS<3 deemed a favorable outcome) were obtained via patient interview or per chart review. Deep learning enabled automated segmentation pipelines were used to calculate brain volume, intracranial volume (ICV), and BPF on the acute neuroimaging data. Patient outcomes were modeled through logistic regressions, and model comparison was conducted using the Bayes Information Criterion (BIC). 467 patients with arterial ischemic stroke were included in the analysis. Median age was 65.8 years, and 65.3% were male. In both models, age and a larger stroke lesion volume were associated with worse functional outcomes. Higher BPF and a larger brain volume were both associated with favorable functional outcomes, however, comparison of both models suggested that the brain volume model (BIC=501) explains the data better compared to the BPF model (BIC=511). The extent of global brain atrophy has been regarded as an important biomarker of post-stroke functional outcomes and resilience to acute injury. Here, we demonstrate that a higher global brain volume at the time of injury better explains favorable functional outcomes, which can be directly clinically assessed.


title: Bivariate temporal dependence via mixtures of rotated copulas

abstract: Parametric bivariate copula families have been known to flexibly capture enough various dependence patterns, e.g., either positive or negative dependence in either the lower or upper tails of bivariate distributions. However, to the best of our knowledge, there is not a single parametric model adaptable enough to capture several of these features simultaneously. To address this, we propose a mixture of 4-way rotations of a parametric copula that is able to capture all these features. We illustrate the construction using the Clayton family but the concept is general and can be applied to other families. In order to include dynamic dependence regimes, the approach is extended to a time-dependent sequence of mixture copulas in which the mixture probabilities are allowed to evolve in time via a moving average type of relationship. The properties of the proposed model and its performance are examined using simulated and real data sets.


title: Modeling RIS from Electromagnetic Principles to Communication Systems--Part I: Synthesis and Characterization of a Scalable Anomalous Reflector

abstract: This work aims to build connections between the electromagnetic and communication aspects of Reconfigurable Intelligent Surfaces (RIS) by proposing a methodology to combine outputs from electromagnetic RIS design into an RIS-tailored system-level simulator and a ray tracer. In this first part of the contribution, a periodic anomalous reflector is designed using an algebraic array antenna scattering synthesis technique that enables electromagnetically accurate modeling of scattering surfaces with both static and reconfigurable scattering characteristics. The multi-mode periodic structure, capable of scattering into several anomalous angles through manipulation of reactive loads, is then cropped into finite-sized arrays, and the quantization effects of the load reactances on the array scattering are analyzed. An experimental anomalous reflector is demonstrated with a comparison between simulated and measured scattering performance. In the second part, the simulated receiving and transmitting scattering patterns of the anomalous reflector are utilized to build an electromagnetically consistent path loss model of an RIS into a system-level simulator. Large-scale fading is analyzed in simple scenarios of RIS-assisted wireless networks to verify the communication model, and an indoor scenario measurement using the manufactured anomalous reflector sample to support the simulation analysis. After verifying the connections between electromagnetic and communication aspects through simulations and measurements, the proposed communication model can be used for a broad range of RIS designs to perform large-scale system-level and ray-tracing simulations in realistic scenarios.


title: 2-balanced sequences coding rectangle exchange transformation

abstract: We define a new class of ternary sequences that are 2-balanced. These sequences are obtained by colouring of Sturmian sequences. We show that the class contains sequences of any given letter frequencies. We provide an upper bound on factor and abelian complexity of these sequences. Using the interpretation by rectangle exchange transformation, we prove that for almost all triples of letter frequencies, the upper bound on factor and abelian complexity is reached. The bound on factor complexity is given using a number-theoretical function which we compute explicitly for a class of parameters.


title: Morse Theory for the k-NN Distance Function

abstract: We study the $k$-th nearest neighbor distance function from a finite point-set in $\mathbb{R}^d$. We provide a Morse theoretic framework to analyze the sub-level set topology. In particular, we present a simple combinatorial-geometric characterization for critical points and their indices, along with detailed information about the possible changes in homology at the critical levels. We conclude by computing the expected number of critical points for a homogeneous Poisson process. Our results deliver significant insights and tools for the analysis of persistent homology in order-$k$ Delaunay mosaics, and random $k$-fold coverage.


title: Importance sampling for rare event tracking within the ensemble Kalman filtering framework

abstract: In this work we employ importance sampling (IS) techniques to track a small over-threshold probability of a running maximum associated with the solution of a stochastic differential equation (SDE) within the framework of ensemble Kalman filtering (EnKF). Between two observation times of the EnKF, we propose to use IS with respect to the initial condition of the SDE, IS with respect to the Wiener process via a stochastic optimal control formulation, and combined IS with respect to both initial condition and Wiener process. Both IS strategies require the approximation of the solution of Kolmogorov Backward equation (KBE) with boundary conditions. In multidimensional settings, we employ a Markovian projection dimension reduction technique to obtain an approximation of the solution of the KBE by just solving a one dimensional PDE. The proposed ideas are tested on two illustrative examples: Double Well SDE and Langevin dynamics, and showcase a significant variance reduction compared to the standard Monte Carlo method and another sampling-based IS technique, namely, multilevel cross entropy.


title: Optical Atomic Clock Interrogation Via an Integrated Spiral Cavity Laser

abstract: Optical atomic clocks have demonstrated revolutionary advances in precision timekeeping, but their applicability to the real world is critically dependent on whether such clocks can operate outside a laboratory setting. The challenge to clock portability stems from the many obstacles not only in miniaturizing the underlying components of the clock $-$ namely the ultrastable laser, the frequency comb, and the atomic reference itself $-$ but also in making the clock resilient to environmental fluctuations. Photonic integration offers one compelling solution to simultaneously address the problems of miniaturization and ruggedization, but brings with it a new set of challenges in recreating the functionality of an optical clock using chip-scale building blocks. The clock laser used for atom interrogation is one particular point of uncertainty, as the performance of the meticulously-engineered bulk-cavity stabilized lasers would be exceptionally difficult to transfer to chip. Here we demonstrate that a chip-integrated ultrahigh quality factor (Q) spiral cavity, when interfaced with a 1348 nm seed laser, reaches a fractional frequency instability of $7.5 \times 10^{-14}$, meeting the stability requirements for interrogating the narrow-linewidth transition of $^{88}$Sr$^+$ upon frequency doubling to 674 nm. In addition to achieving the record for laser stability on chip, we use this laser to showcase the operation of a Sr-ion clock with short-term instability averaging down as $3.9 \times 10^{-14} / \sqrt{\tau}$, where $\tau$ is the averaging time. Our demonstration of an optical atomic clock interrogated by an integrated spiral cavity laser opens the door for future advanced clock systems to be entirely constructed using lightweight, portable, and mass-manufacturable integrated optics and electronics.


title: Extraction of trans-helicity worm-gear distributions and opportunities at the Electron-Ion Collider in China

abstract: We present a global analysis of the trans-helicity worm-gear distribution function, $g_{1T}^\perp$, by fitting the longitudinal-transverse double spin asymmetry data of the semi-inclusive deep inelastic scattering. The analysis is performed within the framework of transverse momentum dependent factorization and evolution. It is found that the $u$-quark favors a positive distribution and the $d$-quark favors a negative distribution, which is consistent with previous model calculations and phenomenological extractions. Based on the fit to existing world data, we also study the impact of the proposed electron-ion collider in China and conclude that it can significantly improve the precision of the worm-gear distribution function and hence enhance our understanding of nucleon spin structures.


title: A critical discussion on the $H_0$ tension

abstract: A critical discussion on the $H_0$ Hubble constant tension is presented by considering both early and late-type observations. From recent precise measurements, discrepancies emerge when comparing results for some cosmological quantities obtained at different redshifts. We highlight the most relevant measurements of $H_0$ and propose potential ideas to solve its tension. These solutions concern the exploration of new physics beyond the $\Lambda$CDM model or the evaluation of $H_0$ by other methods. In particular, we focus on the role of the look-back time.


title: Parallel Gaussian process with kernel approximation in CUDA

abstract: This paper introduces a parallel implementation in CUDA/C++ of the Gaussian process with a decomposed kernel. This recent formulation, introduced by Joukov and Kuli\'c (2022), is characterized by an approximated -- but much smaller -- matrix to be inverted compared to plain Gaussian process. However, it exhibits a limitation when dealing with higher-dimensional samples which degrades execution times. The solution presented in this paper relies on parallelizing the computation of the predictive posterior statistics on a GPU using CUDA and its libraries. The CPU code and GPU code are then benchmarked on different CPU-GPU configurations to show the benefits of the parallel implementation on GPU over the CPU.


title: Introducing Combi-Stations in Robotic Mobile Fulfilment Systems: A Queueing-Theory-Based Efficiency Analysis

abstract: In the era of digital commerce, the surge in online shopping and the expectation for rapid delivery have placed unprecedented demands on warehouse operations. The traditional method of order fulfilment, where human order pickers traverse large storage areas to pick items, has become a bottleneck, consuming valuable time and resources. Robotic Mobile Fulfilment Systems (RMFS) offer a solution by using robots to transport storage racks directly to human-operated picking stations, eliminating the need for pickers to travel. This paper introduces combi-stations, a novel type of station that enables both item picking and replenishment, as opposed to traditional separate stations. We analyse the efficiency of combi-stations using queueing theory and demonstrate their potential to streamline warehouse operations. Our results suggest that combi-stations can reduce the number of robots required for stability and significantly reduce order turnover time, indicating a promising direction for future warehouse automation.


title: Investigating Text Shortening Strategy in BERT: Truncation vs Summarization

abstract: The parallelism of Transformer-based models comes at the cost of their input max-length. Some studies proposed methods to overcome this limitation, but none of them reported the effectiveness of summarization as an alternative. In this study, we investigate the performance of document truncation and summarization in text classification tasks. Each of the two was investigated with several variations. This study also investigated how close their performances are to the performance of full-text. We used a dataset of summarization tasks based on Indonesian news articles (IndoSum) to do classification tests. This study shows how the summaries outperform the majority of truncation method variations and lose to only one. The best strategy obtained in this study is taking the head of the document. The second is extractive summarization. This study explains what happened to the result, leading to further research in order to exploit the potential of document summarization as a shortening alternative. The code and data used in this work are publicly available in https://github.com/mirzaalimm/TruncationVsSummarization.


title: Learning Neural Volumetric Pose Features for Camera Localization

abstract: We introduce a novel neural volumetric pose feature, termed PoseMap, designed to enhance camera localization by encapsulating the information between images and the associated camera poses. Our framework leverages an Absolute Pose Regression (APR) architecture, together with an augmented NeRF module. This integration not only facilitates the generation of novel views to enrich the training dataset but also enables the learning of effective pose features. Additionally, we extend our architecture for self-supervised online alignment, allowing our method to be used and fine-tuned for unlabelled images within a unified framework. Experiments demonstrate that our method achieves 14.28% and 20.51% performance gain on average in indoor and outdoor benchmark scenes, outperforming existing APR methods with state-of-the-art accuracy.


title: RelationVLM: Making Large Vision-Language Models Understand Visual Relations

abstract: The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual contents and ground text to them. Nonetheless, current LVLMs still struggle to precisely understand visual relations due to the lack of relevant data. In this work, we present RelationVLM, a large vision-language model capable of comprehending various levels and types of relations whether across multiple images or within a video. Specifically, we devise a multi-stage relation-aware training scheme and a series of corresponding data configuration strategies to bestow RelationVLM with the capabilities of understanding semantic relations, temporal associations and geometric transforms. Extensive case studies and quantitative evaluations show RelationVLM has strong capability in understanding such relations and emerges impressive in-context capability of reasoning from few-shot examples by comparison. This work fosters the advancements of LVLMs by enabling them to support a wider range of downstream applications toward artificial general intelligence.


title: $B$ Physics: From Present to Future Colliders

abstract: These proceedings provide a brief overview of the status of $B$ meson physics, putting particular emphasis on precision tests of the Standard Model with meson mixing data, and on the anomalies in charged- and neutral-current semileptonic $B$ decays. In addition to summarising the current status, some promising directions to be pursued at future collider experiments are highlighted.