title: Automatic Navigation Map Generation for Mobile Robots in Urban Environments

abstract: A fundamental prerequisite for safe and efficient navigation of mobile robots is the availability of reliable navigation maps upon which trajectories can be planned. With the increasing industrial interest in mobile robotics, especially in urban environments, the process of generating navigation maps has become of particular interest, being a labor intensive step of the deployment process. Automating this step is challenging and becomes even more arduous when the perception capabilities are limited by cost considerations. This paper proposes an algorithm to automatically generate navigation maps using a typical navigation-oriented sensor setup: a single top-mounted 3D LiDAR sensor. The proposed method is designed and validated with the urban environment as the main use case: it is shown to be able to produce accurate maps featuring different terrain types, positive obstacles of different heights as well as negative obstacles. The algorithm is applied to data collected in a typical urban environment with a wheeled inverted pendulum robot, showing its robustness against localization, perception and dynamic uncertainties. The generated map is validated against a human-made map.


title: Influence of chemical composition on the room temperature plas-ticity of C15 Ca-Al-Mg Laves phases

abstract: The influence of chemical composition changes on the room temperature mechanical proper-ties in the C15 CaAl2 Laves phase were investigated in two off-stoichiometric compositions with 5.7 at.-% Mg addition (Ca33Al61Mg6) and 10.8 at.-% Mg and 3.0 at.-% Ca addition (Ca36Al53Mg11) and compared to the stoichiometric (Ca33Al67) composition. Cubic Ca-Al-Mg Laves phases with multiple crystallographic orientations were characterised and deformed using nanoindentation. The hardness and indentation modulus were measured to be 4.1 +- 0.3 GPa and 71.3 +- 1.5 GPa for Ca36Al53Mg11, 4.6 +- 0.2 GPa and 80.4 +- 3.8 GPa for Ca33Al61Mg6 and 4.9 +- 0.3 GPa and 85.5 +- 4.0 GPa for Ca33Al67, respectively. The resulting surface traces as well as slip and crack planes, were distinguished on the indentation surfac-es, revealing the activation of several different {11n} slip systems, as further confirmed by conventional transmission electron microscopic observations. Additionally, the deformation mechanisms and corresponding energy barriers of activated slip systems were evaluated by atomistic simulations.


title: AgentGroupChat: An Interactive Group Chat Simulacra For Better Eliciting Emergent Behavior

abstract: Language significantly influences the formation and evolution of Human emergent behavior, which is crucial in understanding collective intelligence within human societies. Considering that the study of how language affects human behavior needs to put it into the dynamic scenarios in which it is used, we introduce AgentGroupChat in this paper, a simulation that delves into the complex role of language in shaping collective behavior through interactive debate scenarios. Central to this simulation are characters engaging in dynamic conversation interactions. To enable simulation, we introduce the Verbal Strategist Agent, utilizing large language models to enhance interaction strategies by incorporating elements of persona and action. We set four narrative scenarios based on AgentGroupChat to demonstrate the simulation's capacity to mimic complex language use in group dynamics. Evaluations focus on aligning agent behaviors with human expectations and the emergence of collective behaviors within the simulation. Results reveal that emergent behaviors materialize from a confluence of factors: a conducive environment for extensive information exchange, characters with diverse traits, high linguistic comprehension, and strategic adaptability. During discussions on ``the impact of AI on humanity'' in AgentGroupChat simulation, philosophers commonly agreed that ``AI could enhance societal welfare with judicious limitations'' and even come to a conclusion that ``the essence of true intelligence encompasses understanding the necessity to constrain self abilities''. Additionally, in the competitive domain of casting for primary roles in films in AgentGroupChat, certain actors were ready to reduce their remuneration or accept lesser roles, motivated by their deep-seated desire to contribute to the project.


title: Advancing 6D Pose Estimation in Augmented Reality -- Overcoming Projection Ambiguity with Uncontrolled Imagery

abstract: This study addresses the challenge of accurate 6D pose estimation in Augmented Reality (AR), a critical component for seamlessly integrating virtual objects into real-world environments. Our research primarily addresses the difficulty of estimating 6D poses from uncontrolled RGB images, a common scenario in AR applications, which lacks metadata such as focal length. We propose a novel approach that strategically decomposes the estimation of z-axis translation and focal length, leveraging the neural-render and compare strategy inherent in the FocalPose architecture. This methodology not only streamlines the 6D pose estimation process but also significantly enhances the accuracy of 3D object overlaying in AR settings. Our experimental results demonstrate a marked improvement in 6D pose estimation accuracy, with promising applications in manufacturing and robotics. Here, the precise overlay of AR visualizations and the advancement of robotic vision systems stand to benefit substantially from our findings.


title: Measurement-only dynamical phase transition of topological and boundary order in toric code and gauge-Higgs models

abstract: We extensively study long-time dynamics and fate of topologically-ordered state in toric code model evolving through projective measurement-only circuit. The circuit is composed of several measurement operators corresponding to each term of toric code Hamiltonian with magnetic-field perturbations, which is a gauge-fixed version of a (2+1)-dimensional gauge-Higgs model. We employ a cylinder geometry with distinct upper and lower boundaries to classify stationary states after long-time measurement dynamics. The appearing stationary states depend on measurement probabilities for each measurement operator. The Higgs, confined and deconfined phases emerge in the time evolution by the circuit. We find that both Higgs and confined phases are separated from the deconfined phase by topological entanglement entropy. We numerically clarify that both Higgs and confined phases are characterized by a long-range order on the boundaries accompanying edge modes, and they shift with each other by a crossover reflecting properties in the bulk phase diagram.


title: Multi-photon super-linear image scanning microscopy using upconversion nanoparticles

abstract: Super-resolution fluorescence microscopy is of great interest in life science studies for visualizing subcellular structures at the nanometer scale. Among various kinds of super-resolution approaches, image scanning microscopy (ISM) offers a doubled resolution enhancement in a simple and straightforward manner, based on the commonly used confocal microscopes. ISM is also suitable to be integrated with multi-photon microscopy techniques, such as two-photon excitation and second-harmonic generation imaging, for deep tissue imaging, but it remains the twofold limited resolution enhancement and requires expensive femtosecond lasers. Here, we present and experimentally demonstrate the super-linear ISM (SL-ISM) to push the resolution enhancement beyond the factor of two, with a single low-power, continuous-wave, and near-infrared laser, by harnessing the emission nonlinearity within the multiphoton excitation process of lanthanide-doped upconversion nanoparticles (UCNPs). Based on a modified confocal microscope, we achieve a resolution of about 120 nm, 1/8th of the excitation wavelength. Furthermore, we demonstrate a parallel detection strategy of SL-ISM with the multifocal structured excitation pattern, to speed up the acquisition frame rate. This method suggests a new perspective for super-resolution imaging or sensing, multi-photon imaging, and deep-tissue imaging with simple, low-cost, and straightforward implementations.


title: Search for $\Delta S=2$ nonleptonic hyperon decays $\Omega^-\to\Sigma^{0}\pi^{-}$ and $\Omega^-\to nK^{-}$

abstract: Using $(27.12 \pm 0.14) \times 10^{8}$ $\psi(3686)$ events collected by the BESIII detector at the center-of-mass energy of $\sqrt{s} = 3.686$ GeV, we search for the first time for two nonleptonic hyperon decays that change strangeness by two units, $\Omega^-\to\Sigma^{0}\pi^-$ and $\Omega^-\to nK^{-}$. No significant signal is observed. The upper limits on their decay branching fractions are determined to be $\mathcal{B}(\Omega^-\to\Sigma^{0}\pi^-) < 5.4\times 10^{-4}$ and $\mathcal{B}(\Omega^-\to nK^{-}) < 2.4\times 10^{-4}$ at the $90\%$ confidence level.


title: SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors

abstract: Current state-of-the-art spatial reasoning-enhanced VLMs are trained to excel at spatial visual question answering (VQA). However, we believe that higher-level 3D-aware tasks, such as articulating dynamic scene changes and motion planning, require a fundamental and explicit 3D understanding beyond current spatial VQA datasets. In this work, we present SpatialPIN, a framework designed to enhance the spatial reasoning capabilities of VLMs through prompting and interacting with priors from multiple 3D foundation models in a zero-shot, training-free manner. Extensive experiments demonstrate that our spatial reasoning-imbued VLM performs well on various forms of spatial VQA and can extend to help in various downstream robotics tasks such as pick and stack and trajectory planning.


title: Stochastic Geometry Models for Texture Synthesis of Machined Metallic Surfaces: Sandblasting and Milling

abstract: Training defect detection algorithms for visual surface inspection systems requires a large and representative set of training data. Often there is not enough real data available which additionally cannot cover the variety of possible defects. Synthetic data generated by a synthetic visual surface inspection environment can overcome this problem. Therefore, a digital twin of the object is needed, whose micro-scale surface topography is modeled by texture synthesis models. We develop stochastic texture models for sandblasted and milled surfaces based on topography measurements of such surfaces. As the surface patterns differ significantly, we use separate modeling approaches for the two cases. Sandblasted surfaces are modeled by a combination of data-based texture synthesis methods that rely entirely on the measurements. In contrast, the model for milled surfaces is procedural and includes all process-related parameters known from the machine settings.


title: An Extended Kuramoto Model for Frequency and Phase Synchronization in Delay-Free Networks with Finite Number of Agents

abstract: Due to its description of a synchronization between oscillators, the Kuramoto model is an ideal choice for a synchronisation algorithm in networked systems. This requires to achieve not only a frequency synchronization but also a phase synchronization - something the standard Kuramoto model can not provide for a finite number of agents. In this case, a remaining phase difference is necessary to offset differences of the natural frequencies. Setting the Kuramoto model into the context of dynamic consensus and making use of the $n$th order discrete average consensus algorithm, this paper extends the standard Kuramoto model in such a way that frequency and phase synchronization are separated. This in turn leads to an algorithm achieve the required frequency and phase synchronization also for a finite number of agents. Simulations show the viability of this extended Kuramoto model.


title: Robustness Verifcation in Neural Networks

abstract: In this paper we investigate formal verification problems for Neural Network computations. Of central importance will be various robustness and minimization problems such as: Given symbolic specifications of allowed inputs and outputs in form of Linear Programming instances, one question is whether there do exist valid inputs such that the network computes a valid output? And does this property hold for all valid inputs? Do two given networks compute the same function? Is there a smaller network computing the same function? The complexity of these questions have been investigated recently from a practical point of view and approximated by heuristic algorithms. We complement these achievements by giving a theoretical framework that enables us to interchange security and efficiency questions in neural networks and analyze their computational complexities. We show that the problems are conquerable in a semi-linear setting, meaning that for piecewise linear activation functions and when the sum- or maximum metric is used, most of them are in P or in NP at most.


title: Gas inflows from cloud to core scales in G332.83-0.55: Hierarchical hub-filament structures and tide-regulated gravitational collapse

abstract: The massive star-forming region G332.83-0.55 contains at least two levels of hub-filament structures. The hub-filament structures may form through the "gravitational focusing" process. High-resolution LAsMA and ALMA observations can directly trace the gas inflows from cloud to core scales. We investigated the effects of shear and tides from the protocluster on the surrounding local dense gas structures. Our results seem to deny the importance of shear and tides from the protocluster. However, for a gas structure, it bears the tidal interactions from all external material, not only the protocluster. To fully consider the tidal interactions, we derived the tide field according to the surface density distribution. Then, we used the average strength of the external tidal field of a structure to measure the total tidal interactions that are exerted on it. For comparison, we also adopted an original pixel-by-pixel computation to estimate the average tidal strength for each structure. Both methods give comparable results. After considering the total tidal interactions, the slope of the $\sigma-N*R$ relation changes from 0.20 to 0.52, close to 0.5 of the pure free-fall gravitational collapse, and the correlation also becomes stronger. Thus, the deformation due to the external tides can effectively slow down the pure free-fall gravitational collapse of gas structures. The external tide tries to tear up the structure, but the external pressure on the structure prevents this process. The counterbalance between the external tide and external pressure hinders the free-fall gravitational collapse of the structure, which can also cause the pure free-fall gravitational collapse to be slowed down. These mechanisms can be called "tide-regulated gravitational collapse."


title: Fast-Poly: A Fast Polyhedral Framework For 3D Multi-Object Tracking

abstract: 3D Multi-Object Tracking (MOT) captures stable and comprehensive motion states of surrounding obstacles, essential for robotic perception. However, current 3D trackers face issues with accuracy and latency consistency. In this paper, we propose Fast-Poly, a fast and effective filter-based method for 3D MOT. Building upon our previous work Poly-MOT, Fast-Poly addresses object rotational anisotropy in 3D space, enhances local computation densification, and leverages parallelization technique, improving inference speed and precision. Fast-Poly is extensively tested on two large-scale tracking benchmarks with Python implementation. On the nuScenes dataset, Fast-Poly achieves new state-of-the-art performance with 75.8% AMOTA among all methods and can run at 34.2 FPS on a personal CPU. On the Waymo dataset, Fast-Poly exhibits competitive accuracy with 63.6% MOTA and impressive inference speed (35.5 FPS). The source code is publicly available at https://github.com/lixiaoyu2000/FastPoly.


title: MedCycle: Unpaired Medical Report Generation via Cycle-Consistency

abstract: Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding space for images and reports, necessitating a specific labeling schema for both. We introduce an innovative approach that eliminates the need for consistent labeling schemas, thereby enhancing data accessibility and enabling the use of incompatible datasets. This approach is based on cycle-consistent mapping functions that transform image embeddings into report embeddings, coupled with report auto-encoding for medical report generation. Our model and objectives consider intricate local details and the overarching semantic context within images and reports. This approach facilitates the learning of effective mapping functions, resulting in the generation of coherent reports. It outperforms state-of-the-art results in unpaired chest X-ray report generation, demonstrating improvements in both language and clinical metrics.


title: Improving probes of $hAA$ coupling in the Type-X two Higgs Doublet Model scenario: the crucial role of $\tau$-jet charge identification

abstract: The exotic decay modes of the already discovered 125-GeV scalar into a pair of light pseudoscalars is a good probe of those new physics scenarios where such pseudoscalars exist. Searches in the mass region where the pseudoscalar ($A$) is lighter than 62.5 GeV have yielded null findings so far. No search has yet examined $m_A > 62.5$ GeV where the cross section is suppressed by the off-shell pseudoscalar. We point out a possible enhancement of the sensitivity of probing $hAA$ coupling in the context of a Type-X two Higgs doublet model. We focus on $h\to A A^{(*)} \to 4\tau$, and select events with two same-sign $\tau$-jets along with a pair of same-sign leptons. This enables much more effective background elimination than in the erstwhile proposed channels. Taking two values of the $\tau\tau A$ coupling into account, we obtain limits on the $hAA$ coupling that can be probed at 2$\sigma$ and 3$\sigma$ significance, for $m_A$ ranging up to 85 GeV. For $m_A < 62.5$ GeV, too, we find the probe through our suggested channel exhibits considerable improvement upon the usual $2\mu 2\tau$-based searches conducted at the LHC. Within this region, achieving the reach of $\lambda_{hAA}$ coupling at 3000 fb$^{-1}$ luminosity using our strategy would require approximately $\sim$ 3.6$\times 10^{5}$ fb$^{-1}$ luminosity using conventional $2\mu 2\tau$-based searches.


title: IndiTag: An Online Media Bias Analysis and Annotation System Using Fine-Grained Bias Indicators

abstract: In the age of information overload and polarized discourse, understanding media bias has become imperative for informed decision-making and fostering a balanced public discourse. This paper presents IndiTag, an innovative online media bias analysis and annotation system that leverages fine-grained bias indicators to dissect and annotate bias in digital content. IndiTag offers a novel approach by incorporating large language models, bias indicator, vector database to automatically detect and interpret bias. Complemented by a user-friendly interface facilitating both automated bias analysis and manual annotation, IndiTag offers a comprehensive platform for in-depth bias examination. We demonstrate the efficacy and versatility of IndiTag through experiments on four datasets encompassing news articles from diverse platforms. Furthermore, we discuss potential applications of IndiTag in fostering media literacy, facilitating fact-checking initiatives, and enhancing the transparency and accountability of digital media platforms. IndiTag stands as a valuable tool in the pursuit of fostering a more informed, discerning, and inclusive public discourse in the digital age. The demonstration video can be accessed from https://youtu.be/Gt2T4T7DYqs. We release an online system for end users and the source code is available at https://github.com/lylin0/IndiTag.


title: HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models

abstract: Recent advancements indicate that scaling up Multimodal Large Language Models (MLLMs) effectively enhances performance on downstream multimodal tasks. The prevailing MLLM paradigm, \emph{e.g.}, LLaVA, transforms visual features into text-like tokens using a \emph{static} vision-language mapper, thereby enabling \emph{static} LLMs to develop the capability to comprehend visual information through visual instruction tuning. Although promising, the \emph{static} tuning strategy~\footnote{The static tuning refers to the trained model with static parameters.} that shares the same parameters may constrain performance across different downstream multimodal tasks. In light of this, we introduce HyperLLaVA, which involves adaptive tuning of the projector and LLM parameters, in conjunction with a dynamic visual expert and language expert, respectively. These experts are derived from HyperNetworks, which generates adaptive parameter shifts through visual and language guidance, enabling dynamic projector and LLM modeling in two-stage training. Our experiments demonstrate that our solution significantly surpasses LLaVA on existing MLLM benchmarks, including MME, MMBench, SEED-Bench, and LLaVA-Bench. ~\footnote{Our project is available on the link https://github.com/DCDmllm/HyperLLaVA}.


title: Improved modelling for dark photon detection with dish antennas

abstract: A vector dark matter candidate, also known as dark photon, would induce an oscillating electric field through kinetic mixing. One detection strategy uses a spherical reflector to focus the induced emission at its center of curvature. On one hand, we investigate the effects of diffraction in this type of experiment from an analytical standpoint, making use of the Kirchhoff integral theorem in the low-curvature dish limit. On the other hand, we estimate the impact of mode-matching, in the case of detection by a pyramidal horn antenna. We show that the expected signal intensity can be significantly reduced compared to usual estimates. Our method is applied to the re-interpretation of the SHUKET experiment data, the results of which are shown to be degraded by a factor of $\sim$~50 due to both diffraction and mode-matching. The analytical method allows optimizing some experimental parameters to gain sensitivity in future runs. Our results can be applied to any dish antenna experiment using a low curvature reflector.


title: String attractors and bi-infinite words

abstract: String attractors are a combinatorial tool coming from the field of data compression. It is a set of positions within a word which intersects an occurrence of every factor. While one-sided infinite words admitting a finite string attractor are eventually periodic, the situation is different for two-sided infinite words. In this paper, we characterise the bi-infinite words admitting a finite string attractor as the characteristic Sturmian words and their morphic images. For words that do not admit finite string attractors, we study the structure and properties of their infinite string attractors.


title: Complex Networks characterization of Indian Water Dam Systems and its topographic response

abstract: In this paper we have taken a Complex Network approach to understand the salient features of Indian Water Dam Networks. Detailed analysis of 15 river basin networks have been carried out. The data has been taken from "River Basin Atlas of India" compiled by the Indian Space Research Organization (ISRO) and Central Water Commission (CWC), Ministry of Water Resources, Government of India. The paper also investigates the correlation between various structural properties of the networks like total number of nodes, Link Density, Clustering Coefficient amongst each other; and also with the Irrigation Potential and topographical features like the Elevation gradient of the region measured in meters. A mathematical model has also been proposed to understand the relation between irrigation potential measured in thousand hectares unit with the number of nodes, i.e. dams and barrages, to get a more quantitative understanding of the system. The paper also tries to observe the response of the network properties to actual topographical features of the region. This lays down a basic foundational work in understanding these water dam networks through a complex network approach over which further work can be done to make the predictions more efficient.


title: Kaluza-Klein Schwinger effect and breakdown of four dimensional effective theory

abstract: We show that electric fields in compactified spaces may cause breakdown of four dimensional (4D) effective description of higher-dimensional theory. We consider a charged massless complex scalar coupled to U(1) gauge theory in $\mathbb{R}^{1,3}\times {\mathbb S}^1$ and discuss the effect of background gauge potential along a compact direction. The electric field produces the charged particle non-perturbatively, which we call Kaluza-Klein (KK) Schwinger effect. We quantitatively show that KK modes can be produced even when the electric field energy is much below the KK scale. The mechanism is rather general and similar phenomena would occur in any compactification models when a gauge potential along compact direction evolves in time and experiences large enough field excursion.


title: Mobile Robot Localization: a Modular, Odometry-Improving Approach

abstract: Despite the number of works published in recent years, vehicle localization remains an open, challenging problem. While map-based localization and SLAM algorithms are getting better and better, they remain a single point of failure in typical localization pipelines. This paper proposes a modular localization architecture that fuses sensor measurements with the outputs of off-the-shelf localization algorithms. The fusion filter estimates model uncertainties to improve odometry in case absolute pose measurements are lost entirely. The architecture is validated experimentally on a real robot navigating autonomously proving a reduction of the position error of more than 90% with respect to the odometrical estimate without uncertainty estimation in a two-minute navigation period without position measurements.


title: Memories of Abdus Salam and the early days of supersymmetry

abstract: I give an account of what it was like to be a PhD student of Abdus Salam and also to take part during the early stages of the development of supersymmetry.


title: Adaptive time step selection for Spectral Deferred Corrections

abstract: Spectral Deferred Corrections (SDC) is an iterative method for the numerical solution of ordinary differential equations. It works by refining the numerical solution for an initial value problem by approximately solving differential equations for the error, and can be interpreted as a preconditioned fixed-point iteration for solving the fully implicit collocation problem. We adopt techniques from embedded Runge-Kutta Methods (RKM) to SDC in order to provide a mechanism for adaptive time step size selection and thus increase computational efficiency of SDC. We propose two SDC-specific estimates of the local error that are generic and require only minimal problem specific tuning. We demonstrate a gain in efficiency over standard SDC with fixed step size, compare efficiency favorably against state-of-the-art adaptive RKM and show that due to its iterative nature, adaptive SDC can cope efficiently with silent data corruption.


title: FACT: Fast and Active Coordinate Initialization for Vision-based Drone Swarms

abstract: Swarm robots have sparked remarkable developments across a range of fields. While it is necessary for various applications in swarm robots, a fast and robust coordinate initialization in vision-based drone swarms remains elusive. To this end, our paper proposes a complete system to recover a swarm's initial relative pose on platforms with size, weight, and power (SWaP) constraints. To overcome limited coverage of field-of-view (FoV), the drones rotate in place to obtain observations. To tackle the anonymous measurements, we formulate a non-convex rotation estimation problem and transform it into a semi-definite programming (SDP) problem, which can steadily obtain global optimal values. Then we utilize the Hungarian algorithm to recover relative translation and correspondences between observations and drone identities. To safely acquire complete observations, we actively search for positions and generate feasible trajectories to avoid collisions. To validate the practicability of our system, we conduct experiments on a vision-based drone swarm with only stereo cameras and inertial measurement units (IMUs) as sensors. The results demonstrate that the system can robustly get accurate relative poses in real time with limited onboard computation resources. The source code is released.


title: Masses and decays of triply-heavy pentaquarks

abstract: In this work, we study masses and decays of triply-heavy pentaquarks $QQQn\bar{n}(Q=b,c)$ in the unified MIT bag model. We construct the color-spin wave functions of the triply-heavy pentaquarks we address and use numerical variational method to compute all ground-state masses of these system. By excluding the scattering states in these configurations, we compute the decay width ratios of each decay channels relative to the maximum width for the compact pentaquark states, obtaining main decay modes of the triply-heavy pentaquark systems.


title: OSVAuto: semi-automatic verifier for functional specifications of operating systems

abstract: We present the design and implementation of a tool for semi-automatic verification of functional specifications of operating system modules. Such verification tasks are traditionally done in interactive theorem provers, where the functionalities of the module are specified at abstract and concrete levels using data such as structures, algebraic datatypes, arrays, maps and so on. In this work, we provide encodings to SMT for these commonly occurring data types. This allows verification conditions to be reduced into a form suitable for SMT solvers. The use of SMT solvers combined with a tactic language allows semi-automatic verification of the specification. We apply the tool to verify functional specification for key parts of the uC-OS/II operating system, based on earlier work giving full verification of the system in Coq. We demonstrate a large reduction in the amount of human effort due to increased level of automation.


title: Uncertainty quantification for data-driven weather models

abstract: Artificial intelligence (AI)-based data-driven weather forecasting models have experienced rapid progress over the last years. Recent studies, with models trained on reanalysis data, achieve impressive results and demonstrate substantial improvements over state-of-the-art physics-based numerical weather prediction models across a range of variables and evaluation metrics. Beyond improved predictions, the main advantages of data-driven weather models are their substantially lower computational costs and the faster generation of forecasts, once a model has been trained. However, most efforts in data-driven weather forecasting have been limited to deterministic, point-valued predictions, making it impossible to quantify forecast uncertainties, which is crucial in research and for optimal decision making in applications. Our overarching aim is to systematically study and compare uncertainty quantification methods to generate probabilistic weather forecasts from a state-of-the-art deterministic data-driven weather model, Pangu-Weather. Specifically, we compare approaches for quantifying forecast uncertainty based on generating ensemble forecasts via perturbations to the initial conditions, with the use of statistical and machine learning methods for post-hoc uncertainty quantification. In a case study on medium-range forecasts of selected weather variables over Europe, the probabilistic forecasts obtained by using the Pangu-Weather model in concert with uncertainty quantification methods show promising results and provide improvements over ensemble forecasts from the physics-based ensemble weather model of the European Centre for Medium-Range Weather Forecasts for lead times of up to 5 days.


title: Condensed vacuum generated by spin-spin interaction as a source of axial current

abstract: We reveal the presence of a new source of axial current due to the condensed vacuum generated by the spin-spin interaction. To show this, we consider a quartic Dirac Lagrangian containing a spin-spin interaction term, possibly originating from torsion in Einstein-Cartan-like theories. We use a mean field approach to analyze the quantized theory. We show that the diagonalization of the field Hamiltonian defines a new vacuum state, energetically favored with respect to the free vacuum. Such a vacuum, which is a condensate of particle-antiparticle pairs, is characterized by a nontrivial expectation value of the axial current operator. The new source of axial current, here obtained, can have effects both at the atomic level and at the astrophysical-cosmological level depending on the origin of the spin-spin interaction term. The condensate may affect the dark sector of the universe at cosmological level and the axial current originated by the vacuum condensate could be analyzed in next table top experiments on graphene


title: Tikhonov regularized exterior penalty dynamics for constrained variational inequalities

abstract: Solving equilibrium problems under constraints is an important problem in optimization and optimal control. In this context an important practical challenge is the efficient incorporation of constraints. We develop a continuous-time method for solving constrained variational inequalities based on a new penalty regulated dynamical system in a general potentially infinite-dimensional Hilbert space. In order to obtain strong convergence of the issued trajectory of our method, we incorporate an explicit Tikhonov regularization parameter in our method, leading to a class of time-varying monotone inclusion problems featuring multiscale aspects. Besides strong convergence, we illustrate the practical efficiency of our developed method in solving constrained min-max problems.


title: Quantum control by the environment: Turing uncomputability, Optimization over Stiefel manifolds, Reachable sets, and Incoherent GRAPE

abstract: The ability to control quantum systems is necessary for many applications of quantum technologies ranging from gate generation in quantum computation to NMR and laser control of chemical reactions. In many practical situations, the controlled quantum systems are open, i.e., interacting with the environment. While often influence of the environment is considered as an obstacle for controlling the systems, in some cases it can be exploited as a useful resource. In this note, we briefly review some results on control of open quantum systems using environment as a resource, including control by engineered environments and by non-selective measurements, Turing uncomputability of discrete quantum control, parametrization of Kraus maps by points of the Stiefel manifolds and corresponding Riemanninan optimization, control by dissipation and time-dependent decoherence rates, reachable sets, and incoherent GRAPE (Gradient Ascent Pulse Engineering) -- inGRAPE -- for gradient-based optimization.


title: Note on Using Singular Value Decomposition to Solve for Single-Phase Flow and Identify Isolated Clusters in Heterogeneous Pore Networks

abstract: Diluted pore networks or networks that are obtained directly from image analysis are commonly used to evaluate flow through complex porous media. These networks are often subjected to singular points and regions, that is, isolated sub-networks that are not connecting the inlet and outlet. These regions impair the invertibility of the modified Laplacian matrix and affect the accuracy and robustness of pore network models. Searching and eliminating these singularities is commonly done by preconditioning or searching algorithms like breadth-first search or depth-first search. Here, we propose using singular value decomposition (SVD) to simultaneously solve for single-phase flow and locate isolated regions. We demonstrate the performance of the method for networks obtained from images of a partially saturated medium, and for diluted networks close to the percolation threshold.


title: Derived categories of quartic double fivefolds

abstract: We construct singular quartic double fivefolds whose Kuznetsov component admits a crepant categorical resolution of singularities by a twisted Calabi--Yau threefold. We also construct rational specializations of these fivefolds where such a resolution exists without a twist. This confirms an instance of a higher-dimensional version of Kuznetsov's rationality conjecture, and of a noncommutative version of Reid's fantasy on the connectedness of the moduli of Calabi--Yau threefolds.


title: Optical Signatures of Moir\'e Trapped Biexcitons

abstract: Atomically thin heterostructures formed by twisted transition metal dichalcogenides can be used to create periodic moir\'e patterns. The emerging moir\'e potential can trap interlayer excitons into arrays of strongly interacting bosons, which form a unique platform to study strongly correlated many-body states. In order to create and manipulate these exotic phases of matter, a microscopic understanding of exciton-exciton interactions and their manifestation in these systems becomes indispensable. Recent density-dependent photoluminescence (PL) measurements have revealed novel spectral features indicating the formation of trapped multi-exciton states providing important information about the interaction strength. In this work, we develop a microscopic theory to model the PL spectrum of trapped multi-exciton complexes focusing on the emission from moir\'e trapped single- and biexcitons. Based on an excitonic Hamiltonian we determine the properties of trapped biexcitons as function of twist angle and use these insights to predict the luminescence spectrum of moir\'e excitons for different densities. We demonstrate how side peaks resulting from transitions to excited states and a life time analysis can be utilized as indicators for moir\'e trapped biexcitons and provide crucial information about the excitonic interaction strength.


title: BanglaNum -- A Public Dataset for Bengali Digit Recognition from Speech

abstract: Automatic speech recognition (ASR) converts the human voice into readily understandable and categorized text or words. Although Bengali is one of the most widely spoken languages in the world, there have been very few studies on Bengali ASR, particularly on Bangladeshi-accented Bengali. In this study, audio recordings of spoken digits (0-9) from university students were used to create a Bengali speech digits dataset that may be employed to train artificial neural networks for voice-based digital input systems. This paper also compares the Bengali digit recognition accuracy of several Convolutional Neural Networks (CNNs) using spectrograms and shows that a test accuracy of 98.23% is achievable using parameter-efficient models such as SqueezeNet on our dataset.


title: An AI-Assisted Skincare Routine Recommendation System in XR

abstract: In recent years, there has been an increasing interest in the use of artificial intelligence (AI) and extended reality (XR) in the beauty industry. In this paper, we present an AI-assisted skin care recommendation system integrated into an XR platform. The system uses a convolutional neural network (CNN) to analyse an individual's skin type and recommend personalised skin care products in an immersive and interactive manner. Our methodology involves collecting data from individuals through a questionnaire and conducting skin analysis using a provided facial image in an immersive environment. This data is then used to train the CNN model, which recognises the skin type and existing issues and allows the recommendation engine to suggest personalised skin care products. We evaluate our system in terms of the accuracy of the CNN model, which achieves an average score of 93% in correctly classifying existing skin issues. Being integrated into an XR system, this approach has the potential to significantly enhance the beauty industry by providing immersive and engaging experiences to users, leading to more efficient and consistent skincare routines.


title: CLIPSwarm: Generating Drone Shows from Text Prompts with Vision-Language Models

abstract: This paper introduces CLIPSwarm, a new algorithm designed to automate the modeling of swarm drone formations based on natural language. The algorithm begins by enriching a provided word, to compose a text prompt that serves as input to an iterative approach to find the formation that best matches the provided word. The algorithm iteratively refines formations of robots to align with the textual description, employing different steps for "exploration" and "exploitation". Our framework is currently evaluated on simple formation targets, limited to contour shapes. A formation is visually represented through alpha-shape contours and the most representative color is automatically found for the input word. To measure the similarity between the description and the visual representation of the formation, we use CLIP [1], encoding text and images into vectors and assessing their similarity. Subsequently, the algorithm rearranges the formation to visually represent the word more effectively, within the given constraints of available drones. Control actions are then assigned to the drones, ensuring robotic behavior and collision-free movement. Experimental results demonstrate the system's efficacy in accurately modeling robot formations from natural language descriptions. The algorithm's versatility is showcased through the execution of drone shows in photorealistic simulation with varying shapes. We refer the reader to the supplementary video for a visual reference of the results.


title: DESIRE-ME: Domain-Enhanced Supervised Information REtrieval using Mixture-of-Experts

abstract: Open-domain question answering requires retrieval systems able to cope with the diverse and varied nature of questions, providing accurate answers across a broad spectrum of query types and topics. To deal with such topic heterogeneity through a unique model, we propose DESIRE-ME, a neural information retrieval model that leverages the Mixture-of-Experts framework to combine multiple specialized neural models. We rely on Wikipedia data to train an effective neural gating mechanism that classifies the incoming query and that weighs the predictions of the different domain-specific experts correspondingly. This allows DESIRE-ME to specialize adaptively in multiple domains. Through extensive experiments on publicly available datasets, we show that our proposal can effectively generalize domain-enhanced neural models. DESIRE-ME excels in handling open-domain questions adaptively, boosting by up to 12% in NDCG@10 and 22% in P@1, the underlying state-of-the-art dense retrieval model.


title: Progressive trajectory matching for medical dataset distillation

abstract: It is essential but challenging to share medical image datasets due to privacy issues, which prohibit building foundation models and knowledge transfer. In this paper, we propose a novel dataset distillation method to condense the original medical image datasets into a synthetic one that preserves useful information for building an analysis model without accessing the original datasets. Existing methods tackle only natural images by randomly matching parts of the training trajectories of the model parameters trained by the whole real datasets. However, through extensive experiments on medical image datasets, the training process is extremely unstable and achieves inferior distillation results. To solve these barriers, we propose to design a novel progressive trajectory matching strategy to improve the training stability for medical image dataset distillation. Additionally, it is observed that improved stability prevents the synthetic dataset diversity and final performance improvements. Therefore, we propose a dynamic overlap mitigation module that improves the synthetic dataset diversity by dynamically eliminating the overlap across different images and retraining parts of the synthetic images for better convergence. Finally, we propose a new medical image dataset distillation benchmark of various modalities and configurations to promote fair evaluations. It is validated that our proposed method achieves 8.33% improvement over previous state-of-the-art methods on average, and 11.7% improvement when ipc=2 (i.e., image per class is 2). Codes and benchmarks will be released.


title: Scaling Diffusion Models to Real-World 3D LiDAR Scene Completion

abstract: Computer vision techniques play a central role in the perception stack of autonomous vehicles. Such methods are employed to perceive the vehicle surroundings given sensor data. 3D LiDAR sensors are commonly used to collect sparse 3D point clouds from the scene. However, compared to human perception, such systems struggle to deduce the unseen parts of the scene given those sparse point clouds. In this matter, the scene completion task aims at predicting the gaps in the LiDAR measurements to achieve a more complete scene representation. Given the promising results of recent diffusion models as generative models for images, we propose extending them to achieve scene completion from a single 3D LiDAR scan. Previous works used diffusion models over range images extracted from LiDAR data, directly applying image-based diffusion methods. Distinctly, we propose to directly operate on the points, reformulating the noising and denoising diffusion process such that it can efficiently work at scene scale. Together with our approach, we propose a regularization loss to stabilize the noise predicted during the denoising process. Our experimental evaluation shows that our method can complete the scene given a single LiDAR scan as input, producing a scene with more details compared to state-of-the-art scene completion methods. We believe that our proposed diffusion process formulation can support further research in diffusion models applied to scene-scale point cloud data.


title: Data-Driven Reduced-Order Unknown-Input Observers

abstract: In this paper we propose a data-driven approach to the design of reduced-order unknown-input observers (rUIOs). We first recall the model-based solution, by assuming a problem set-up slightly different from those traditionally adopted in the literature, in order to be able to easily adapt it to the data-driven scenario. Necessary and sufficient conditions for the existence of a reduced-order unknown-input observer, whose matrices can be derived from a sufficiently rich set of collected historical data, are first derived and then proved to be equivalent to the ones obtained in the model-based framework. Finally, a numerical example is presented, to validate the effectiveness of the proposed scheme.


title: A proof of Ollinger's conjecture: undecidability of tiling the plane with a set of $8$ polyominoes

abstract: We give a proof of Ollinger's conjecture that the problem of tiling the plane with translated copies of a set of $8$ polyominoes is undecidable. The techniques employed in our proof include a different orientation for simulating the Wang tiles in polyomino and a new method for encoding the colors of Wang tiles.


title: Distributed Cooperative Formation Control of Nonlinear Multi-Agent System (UGV) Using Neural Network

abstract: The paper presented in this article deals with the issue of distributed cooperative formation of multi-agent systems (MASs). It proposes the use of appropriate neural network control methods to address formation requirements (uncertainties dynamic model). It considers an adaptive leader-follower distributed cooperative formation control based on neural networks (NNs) developed for a class of second-order nonlinear multi-agent systems and neural networks Neural networks are used to compute system data that inputs layer (position, velocity), hidden layers, and output layer. Through collaboration between leader-follower approaches and neural networks with complex systems or complex conditions receive an effective cooperative formation control method. The sufficient conditions for the system stability were derived using Lyapunov stability theory, graph theory, and state space methods. By simulation, the results of this study can be obtained from the main data of the multi-agent system in formation control and verified that the system can process consistency, stability, reliability, and accuracy in cooperative formation.


title: Iterative Active-Inactive Obstacle Classification for Time-Optimal Collision Avoidance

abstract: Time-optimal obstacle avoidance is a prevalent problem encountered in various fields, including robotics and autonomous vehicles, where the task involves determining a path for a moving vehicle to reach its goal while navigating around obstacles within its environment. This problem becomes increasingly challenging as the number of obstacles in the environment rises. We propose an iterative active-inactive obstacle approach, which involves identifying a subset of the obstacles as "active", that considers solely the effect of the "active" obstacles on the path of the moving vehicle. The remaining obstacles are considered "inactive" and are not considered in the path planning process. The obstacles are classified as 'active' on the basis of previous findings derived from prior iterations. This approach allows for a more efficient calculation of the optimal path by reducing the number of obstacles that need to be considered. The effectiveness of the proposed method is demonstrated with two different dynamic models using the various number of obstacles. The results show that the proposed method is able to find the optimal path in a timely manner, while also being able to handle a large number of obstacles in the environment and the constraints on the motion of the object.


title: A metric counterpart of the Gu-Yung formula

abstract: In this note we consider a generalisation to the metric setting of the recent work [Gu-Yung, JFA 281 (2021), 109075]. In particular, we show that under relatively weak conditions on a metric measure space $(X,d,\nu)$, it holds true that \[ \bigg[ \frac{u(x)-u(y)}{d(x,y)^{\frac{s}{p}}} \bigg]_{L^p_w(X \times X, \nu \otimes \nu)} \approx \| u \|_{L^p(X,\nu)}, \] where $s$ is a generalised dimension associated to $X$ and $[\cdot]_{L^p_w}$ is the weak Lebesgue norm. We provide some counterexamples which show that our assumptions are optimal.


title: Isothermic nets with spherical parameter lines from discrete holomorphic maps

abstract: We prove that all discrete isothermic nets with a family of planar or spherical lines of curvature can be obtained from special discrete holomorphic maps via lifted-folding. This novel approach is a generalization and discretization of a classical method to create planar curvature lines on smooth surfaces. In particular, this technique provides an efficient way to construct discrete isothermic topological tori composed of fundamental pieces from discrete periodic holomorphic maps.


title: On unitary time evolution out of equilibrium

abstract: We consider $d$-dimensional quantum systems which for positive times evolve with a time-independent Hamiltonian in a nonequilibrium state that we keep generic in order to account for arbitrary evolution at negative times. We show how the one-point functions of local operators depend on the coefficients of the expansion of the nonequilibrium state on the basis of energy eigenstates. We express in this way the asymptotic offset and show under which conditions oscillations around this value stay undamped at large times. We also show how, in the case of small quenches, the structure of the general results simplifies and reproduces that known perturbatively.


title: Ultrahigh Frequency and Multi-channel Output in Skyrmion Based Nano-oscillator

abstract: Spintronic nano-oscillators can generate tunable microwave signals that find a wide range of applications in the field of telecommunication to modern neuromorphic computing systems. Among other spintronic devices, a magnetic skyrmion is a promising candidate for the next generation of low-power devices due to its small size and topological stability. In this work, we propose a multi-channel oscillator design based on the synthetic anti-ferromagnetic (SAF) skyrmion pair. The mitigation of the skyrmion Hall effect in SAF and the associated decimation of the Magnus force endows the proposed oscillator with an ultra-high frequency of 41GHz and a multi-channel frequency output driven by the same current. The ultrahigh operational frequency represents an $\sim$342 times improvement compared to the monolayer single skyrmion oscillator featuring a constant uniaxial anisotropy profile. Using micromagnetic simulations, we demonstrate the effectiveness of our proposed multi-channel oscillator design by introducing multi-channel nanotracks along with multiple skyrmions for enhanced frequency operation. The ultrahigh operational frequency and multi-channel output are attributed to three key factors: The oscillator design accounting for a finite spin-flip length of the spacer (such as Ru) material, tangential velocity proportionality on input spin current along with weak dependence on the radius of rotation of the skyrmion-pair, skyrmion interlocking in the channel enabled by the multi-channel high Ku rings and skyrmion-skyrmion repulsion, therefore resulting ultrahigh frequency and multi-channel outputs.


title: Deepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injection

abstract: Deepfake detectors are typically trained on large sets of pristine and generated images, resulting in limited generalization capacity; they excel at identifying deepfakes created through methods encountered during training but struggle with those generated by unknown techniques. This paper introduces a learning approach aimed at significantly enhancing the generalization capabilities of deepfake detectors. Our method takes inspiration from the unique "fingerprints" that image generation processes consistently introduce into the frequency domain. These fingerprints manifest as structured and distinctly recognizable frequency patterns. We propose to train detectors using only pristine images injecting in part of them crafted frequency patterns, simulating the effects of various deepfake generation techniques without being specific to any. These synthetic patterns are based on generic shapes, grids, or auras. We evaluated our approach using diverse architectures across 25 different generation methods. The models trained with our approach were able to perform state-of-the-art deepfake detection, demonstrating also superior generalization capabilities in comparison with previous methods. Indeed, they are untied to any specific generation technique and can effectively identify deepfakes regardless of how they were made.


title: A Unified Optimal Transport Framework for Cross-Modal Retrieval with Noisy Labels

abstract: Cross-modal retrieval (CMR) aims to establish interaction between different modalities, among which supervised CMR is emerging due to its flexibility in learning semantic category discrimination. Despite the remarkable performance of previous supervised CMR methods, much of their success can be attributed to the well-annotated data. However, even for unimodal data, precise annotation is expensive and time-consuming, and it becomes more challenging with the multimodal scenario. In practice, massive multimodal data are collected from the Internet with coarse annotation, which inevitably introduces noisy labels. Training with such misleading labels would bring two key challenges -- enforcing the multimodal samples to \emph{align incorrect semantics} and \emph{widen the heterogeneous gap}, resulting in poor retrieval performance. To tackle these challenges, this work proposes UOT-RCL, a Unified framework based on Optimal Transport (OT) for Robust Cross-modal Retrieval. First, we propose a semantic alignment based on partial OT to progressively correct the noisy labels, where a novel cross-modal consistent cost function is designed to blend different modalities and provide precise transport cost. Second, to narrow the discrepancy in multi-modal data, an OT-based relation alignment is proposed to infer the semantic-level cross-modal matching. Both of these two components leverage the inherent correlation among multi-modal data to facilitate effective cost function. The experiments on three widely-used cross-modal retrieval datasets demonstrate that our UOT-RCL surpasses the state-of-the-art approaches and significantly improves the robustness against noisy labels.


title: Molecular Dynamics Simulations of Microscopic Structural Transition and Macroscopic Mechanical Properties of Magnetic Gels

abstract: Magnetic gels with embedded micro/nano-sized magnetic particles in crosslinked polymer networks can be actuated by external magnetic fields, with changes in their internal microscopic structures and macroscopic mechanical properties. We investigate the responses of such magnetic gels to an external magnetic field, by means of coarse-grained molecular dynamics simulations. We find that the dynamics of magnetic particles are determined by the interplay of between magnetic dipole-dipole interactions, polymer elasticity and thermal fluctuations. The corresponding microscopic structures formed by the magnetic particles such as elongated chains can be controlled by the external magnetic field. Furthermore, the magnetic gels can exhibit reinforced macroscopic mechanical properties, where the elastic modulus increases algebraically with the magnetic moments of the particles in the form of $\propto(m-m_{\mathrm{c}})^{2}$ when magnetic chains are formed. This simulation work can not only serve as a tool for studying the microscopic and the macroscopic responses of the magnetic gels, but also facilitate future fabrications and practical controls of magnetic composites with desired physical properties.


title: From known to unknown: cosmic rays transition from the Sun, the Galaxy, and the Extra-Galaxy

abstract: The Sun stands out as the closest and clearest astrophysical accelerator of cosmic rays, while other objects within and beyond the galaxy remain enigmatic. It is probable that the cosmic ray spectrum and mass components from these celestial sources share similarities, offering a novel approach to study their origin. In this study, we analyze of spectra and mass in the energy range from MeV to 10~EeV. We find: (1) the mean-logarithmic mass $\rm\left\langle lnA \right\rangle$ distribution with energy exhibits much clearer feature structures than the spectra; (2) a 100~TeV bump is presented in the $\rm\left\langle lnA \right\rangle$ distribution; (3) for protons, the knee is located at $\sim2$ PeV, the boundary between the galaxy and extra-galaxy occurs at $\sim30$ PeV, marked by a sharp dip; (4) the all-particle spectrum exhibits hardening at $\sim30$~PeV due to the contribution of nearby galaxies, and the extra-galactic dominate $\sim0.7$~EeV. We hope the LHAASO experiment can perform spectral measurements of individual species to validate our results.


title: Group Extensions for Random Shifts of Finite Type

abstract: Symbolic dynamical theory plays an important role in the research of amenability with a countable group. Motivated by the deep results of Dougall and Sharp, we study the group extensions for topologically mixing random shifts of finite type. For a countable group $G$, we consider the potential connections between relative Gurevi\v{c} pressure (entropy), the spectral radius of random Perron-Frobenius operator and amenability of $G$. Given $G^{\rm ab}$ by the abelianization of $G$ where $G^{\rm ab}=G/[G,G]$, we consider the random group extensions of random shifts of finite type between $G$ and $G^{\rm ab}$. It can be proved that the relative Gurevi\v{c} entropy of random group $G$ extensions is equal to the relative Gurevi\v{c} entropy of random group $G^{\rm ab}$ extensions if and only if $G$ is amenable. Moreover, we establish the relativized variational principle and discuss the unique equilibrium state for random group $\mathbb{Z}^{d}$ extensions.


title: Primordial Black Holes from Effective Field Theory of Stochastic Single Field Inflation at NNNLO

abstract: We present a study of the Effective Field Theory (EFT) generalization of stochastic inflation in a model-independent single-field framework and its impact on primordial black hole (PBH) formation. We show how the Langevin equations for the "soft" modes in quasi de Sitter background is described by the Infra-Red (IR) contributions of scalar perturbations, and the subsequent Fokker-Planck equation driving the probability distribution for the stochastic duration ${\cal N}$, significantly modify in the present EFT picture. An explicit perturbative analysis of the distribution function by implementing the stochastic-$\delta N$ formalism is performed up to the next-to-next-to-next-to-leading order (NNNLO) for both the classical-drift and quantum-diffusion dominated regimes. In the drift-dominated limit, we perturbatively analyse the local non-Gaussianity parameters $(f_{\rm NL}, g_{\rm NL}, \tau_{\rm NL})$ with the EFT-induced modifications. In the diffusion-dominated limit, we numerically compute the probability distribution featuring exponential tails at each order of perturbative treatment.

categories: astro-ph.CO cond-mat.stat-mech gr-qc hep-ph hep-th


title: An Entropy-based Text Watermarking Detection Method

abstract: Text watermarking algorithms for large language models (LLMs) can effectively identify machine-generated texts by embedding and detecting hidden features in the text. Although the current text watermarking algorithms perform well in most high-entropy scenarios, its performance in low-entropy scenarios still needs to be improved. In this work, we opine that the influence of token entropy should be fully considered in the watermark detection process, $i.e.$, the weight of each token during watermark detection should be customized according to its entropy, rather than setting the weights of all tokens to the same value as in previous methods. Specifically, we propose \textbf{E}ntropy-based Text \textbf{W}atermarking \textbf{D}etection (\textbf{EWD}) that gives higher-entropy tokens higher influence weights during watermark detection, so as to better reflect the degree of watermarking. Furthermore, the proposed detection process is training-free and fully automated. From the experiments, we demonstrate that our EWD can achieve better detection performance in low-entropy scenarios, and our method is also general and can be applied to texts with different entropy distributions. Our code and data is available\footnote{\url{https://github.com/luyijian3/EWD}}. Additionally, our algorithm could be accessed through MarkLLM \cite{pan2024markllm}\footnote{\url{https://github.com/THU-BPM/MarkLLM}}.


title: Tensor Quantum Programming

abstract: Running quantum algorithms often involves implementing complex quantum circuits with such a large number of multi-qubit gates that the challenge of tackling practical applications appears daunting. To date, no experiments have successfully demonstrated a quantum advantage due to the ease with which the results can be adequately replicated on classical computers through the use of tensor network algorithms. Additionally, it remains unclear even in theory where exactly these advantages are rooted within quantum systems because the logarithmic complexity commonly associated with quantum algorithms is also present in algorithms based on tensor networks. In this article, we propose a novel approach called Tensor Quantum Programming, which leverages tensor networks for hybrid quantum computing. Our key insight is that the primary challenge of algorithms based on tensor networks lies in their high ranks (bond dimensions). Quantum computing offers a potential solution to this challenge, as an ideal quantum computer can represent tensors with arbitrarily high ranks in contrast to classical counterparts, which indicates the way towards quantum advantage. While tensor-based vector-encoding and state-readout are known procedures, the matrix-encoding required for performing matrix-vector multiplications directly on quantum devices remained unsolved. Here, we developed an algorithm that encodes Matrix Product Operators into quantum circuits with a depth that depends linearly on the number of qubits. It demonstrates effectiveness on up to 50 qubits for several matrices frequently encountered in differential equations, optimization problems, and quantum chemistry. We view this work as an initial stride towards the creation of genuinely practical quantum algorithms.


title: The future of generative AI chatbots in higher education

abstract: The integration of generative Artificial Intelligence (AI) chatbots in higher education institutions (HEIs) is reshaping the educational landscape, offering opportunities for enhanced student support, and administrative and research efficiency. This study explores the future implications of generative AI chatbots in HEIs, aiming to understand their potential impact on teaching and learning, and research processes. Utilizing a narrative literature review (NLR) methodology, this study synthesizes existing research on generative AI chatbots in higher education from diverse sources, including academic databases and scholarly publications. The findings highlight the transformative potential of generative AI chatbots in streamlining administrative tasks, enhancing student learning experiences, and supporting research activities. However, challenges such as academic integrity concerns, user input understanding, and resource allocation pose significant obstacles to the effective integration of generative AI chatbots in HEIs. This study underscores the importance of proactive measures to address ethical considerations, provide comprehensive training for stakeholders, and establish clear guidelines for the responsible use of generative AI chatbots in higher education. By navigating these challenges, and leveraging the benefits of generative AI technologies, HEIs can harness the full potential of generative AI chatbots to create a more efficient, effective, inclusive, and innovative educational environment.


title: Longitudinal changes in deep learning-estimated breast density and their impact on the risk of screen-detected breast cancer: The DeepJoint Algorithm

abstract: Mammography-based screening programs play a crucial role in reducing breast cancer mortality through early detection. Their efficacy is influenced by breast density, a dynamic factor that evolves over time, modifying breast cancer risk. Women with high breast density face increased breast cancer risk, coupled with reduced mammographic sensitivity. In this work, we present the DeepJoint algorithm, a pipeline for quantitative breast density assessment, investigating its association with breast cancer risk. First, we develop a lightweight deep-learning segmentation model that uses processed mammography images acquired from multiple manufacturers to assess quantitative breast density metrics such as dense area and percent density. Then, we fit a joint model to evaluate the association of these metrics with the time-to-breast cancer occurrence using an extensive database of 77,298 women participating in breast cancer screening in the United States. We demonstrate the impact of the current value and slope of the biomarker on breast cancer risk. We also derive individual and dynamic breast cancer risk predictions to describe how the individual longitudinal evolution of dense area and percent density impacts the risk of breast cancer. This innovative approach aligns with the growing interest in personalized risk monitoring during screening, offering valuable insights for improving breast cancer prevention strategies.


title: Antithetic Multilevel Methods for Elliptic and Hypo-Elliptic Diffusions with Applications

abstract: In this paper, we present a new antithetic multilevel Monte Carlo (MLMC) method for the estimation of expectations with respect to laws of diffusion processes that can be elliptic or hypo-elliptic. In particular, we consider the case where one has to resort to time discretization of the diffusion and numerical simulation of such schemes. Motivated by recent developments, we introduce a new MLMC estimator of expectations, which does not require simulation of intractable L\'evy areas but has a weak error of order 2 and achieves the optimal computational complexity. We then show how this approach can be used in the context of the filtering problem associated to partially observed diffusions with discrete time observations. We illustrate with numerical simulations that our new approaches provide efficiency gains for several problems relative to some existing methods.


title: The ALPINE-ALMA [CII] Survey: Dust emission effective radius up to 3 kpc in the Early Universe

abstract: Measurements of the size of dust continuum emission are an important tool for constraining the spatial extent of star formation and hence the build-up of stellar mass. Compact dust emission has generally been observed at Cosmic Noon (z~2-3). However, at earlier epochs, toward the end of the Reionization (z~4-6), only the sizes of a handful of IR-bright galaxies have been measured. In this work, we derive the dust emission sizes of main-sequence galaxies at z~5 from the ALPINE survey. We measure the dust effective radius r_e,FIR in the uv-plane in Band 7 of ALMA for seven ALPINE galaxies with resolved emission and we compare it with rest-frame UV and [CII]158$\mu$m measurements. We study the r_e,FIR-L_IR scaling relation by considering our dust size measurements and all the data in literature at z~4-6. Finally, we compare our size measurements with predictions from simulations. The dust emission in the selected ALPINE galaxies is rather extended (r_e,FIR~1.5-3 kpc), similar to [CII]158 um but a factor of ~2 larger than the rest-frame UV emission. Putting together all the measurements at z~5, spanning 2 decades in luminosity from L_IR ~ 10^11 L_sun to L_IR ~ 10^13 L_sun, the data highlight a steeply increasing trend of the r_e,FIR-L_IR relation at L_IR< 10^12 L_sun, followed by a downturn and a decreasing trend at brighter luminosities. Finally, simulations that extend up to the stellar masses of the ALPINE galaxies considered in the present work predict a sub-set of galaxies (~25% at 10^10 M_sun < M_star < 10^11 M_sun) with sizes as large as those measured.


title: Distance Comparison Operators for Approximate Nearest Neighbor Search: Exploration and Benchmark

abstract: Approximate nearest neighbor search (ANNS) on high-dimensional vectors has become a fundamental and essential component in various machine learning tasks. Prior research has shown that the distance comparison operation is the bottleneck of ANNS, which determines the query and indexing performance. To overcome this challenge, some novel methods have been proposed recently. The basic idea is to estimate the actual distance with fewer calculations, at the cost of accuracy loss. Inspired by this, we also propose that some classical techniques and deep learning models can also be adapted to this purpose. In this paper, we systematically categorize the techniques that have been or can be used to accelerate distance approximation. And to help the users understand the pros and cons of different techniques, we design a fair and comprehensive benchmark, Fudist implements these techniques with the same base index and evaluates them on 16 real datasets with several evaluation metrics. Designed as an independent and portable library, Fudist is orthogonal to the specific index structure and thus can be easily utilized in the current ANNS library to achieve significant improvements.


title: Secure Query Processing with Linear Complexity

abstract: We present LINQ, the first join protocol with linear complexity (in both running time and communication) under the secure multi-party computation model (MPC). It can also be extended to support all free-connex queries, a large class of select-join-aggregate queries, still with linear complexity. This matches the plaintext result for the query processing problem, as free-connex queries are the largest class of queries known to be solvable in linear time in plaintext. We have then built a query processing system based on LINQ, and the experimental results show that LINQ significantly outperforms the state of the art. For example, it can finish a query on three relations with an output size of 1 million tuples in around 100s in the LAN setting, while existing protocols that support the query cannot finish in an hour. Thus LINQ brings MPC query processing closer to practicality.


title: SPDEs on narrow channels and graphs: convergence and large deviations in case of non smooth noise

abstract: We investigate a class of stochastic partial differential equations of reaction-diffusion type defined on graphs, which can be derived as the limit of SPDEs on narrow planar channels. In the first part, we demonstrate that this limit can be achieved under less restrictive assumptions on the regularity of the noise, compared to [4]. In the second part, we establish the validity of a large deviation principle for the SPDEs on the narrow channels and on the graphs, as the width of the narrow channels and the intensity of the noise are jointly vanishing.


title: Novel imprint of a dark photon from the 3-3-1-1 model

abstract: We investigate a dark photon that arises from the UV model based upon $SU(3)_C\otimes SU(3)_L\otimes U(1)_X \otimes U(1)_G$ (3-3-1-1) gauge symmetry, where the last three factors enlarge the electroweak symmetry encompassing electric charge $Q=T_3 - 1/ \sqrt{3}T_8 +X$ and dark charge $D = -2/\sqrt{3} T_8 +G$. It is well-established that this model addresses the questions of family number, neutrino mass, and dark matter. It is shown in this work that if the 3-3-1-1 breaking scale is much bigger than the dark charge breaking scale, the relevant dark gauge boson $Z'$ is uniquely imprinted at TeV, avoiding dangerous FCNC processes, obeying precision electroweak measurements, as well as contributing to collider phenomena, even if no kinetic mixing is presented. The dark matter observables are perhaps governed by the dark charge breaking Higgs field instead of the dark photon.


title: Comment on M. Babiker, J. Yuan, K. Koksal, and V. Lembessis, Optics Communications 554, 130185 (2024)

abstract: In a recent article Babiker et al. [Optics Communications $\mathbf{554}$, 130185 (2024)] claim that cylindrical vector beams (CVBs), also referred to as higher-order Poincar\'e (HOP) beams, possess optical chirality densities which exhibit `superchirality'. Here we show that, on the contrary, CVBs possess less optical chirality density than a corresponding circularly polarized scalar vortex beam and that the `superchiral' results are nonphysical. We also identify a number of issues concerning the derivation and general theory presented.


title: Searching Materials Space for Hydride Superconductors at Ambient Pressure

abstract: We employed a machine-learning assisted approach to search for superconducting hydrides under ambient pressure within an extensive dataset comprising over 150 000 compounds. Our investigation yielded around 50 systems with transition temperatures surpassing 20 K, and some even reaching above 70 K. These compounds have very different crystal structures, with different dimensionality, chemical composition, stoichiometry, and arrangement of the hydrogens. Interestingly, most of these systems displayed slight thermodynamic instability, implying that their synthesis would require conditions beyond ambient equilibrium. Moreover, we found a consistent chemical composition in the majority of these systems, which combines alkali or alkali-earth elements with noble metals. This observation suggests a promising avenue for future experimental investigations into high-temperature superconductivity within hydrides at ambient pressure.


title: Starlink on the Road: A First Look at Mobile Starlink Performance in Central Europe

abstract: Low Earth Orbit Satellite Networks such as Starlink promise to provide world-wide Internet access. While traditionally designed for stationary use, a new dish, released in April 2023 in Europe, provides mobile Internet access including in-motion usage, e.g., while mounted on a car. In this paper, we design and build a mobile measurement setup. Our goal is to fully autonomously conduct continuous Starlink measurements while the car is in motion. We share our practical experiences, including challenges regarding the permanent power supply. We measure the Starlink performance over the span of two months from mid-January to mid-March 2024 when the car is in motion. The measurements consist of all relevant network parameters, such as the download and upload throughput, the RTT, and packet loss, as well as detailed power consumption data. We analyze our dataset to assess Starlink's mobile performance in Central Europe, Germany, and compare it to stationary measurements in proximity. We find that the mobile performance is significantly worse than stationary performance. The power consumption of the new dish is higher, but seems to be more correlated to the heating function of the dish than to the speed of the vehicle.


title: A mathematical foundation for QUMOND

abstract: We link the QUMOND theory with the Helmholtz-Weyl decomposition and introduce a new formula for the gradient of the Mondian potential using singular integral operators. This approach allows us to demonstrate that, under very general assumptions on the mass distribution, the Mondian potential is well-defined, once weakly differentiable, with its gradient given through the Helmholtz-Weyl decomposition. Furthermore, we establish that the gradient of the Mondian potential is an $L^p$ vector field. These findings lay the foundation for a rigorous mathematical analysis of various issues within the realm of QUMOND. Given that the Mondian potential satisfies a second-order partial differential equation, the question arises whether it has second-order derivatives. We affirmatively answer this question in the situation of spherical symmetry, although our investigation reveals that the regularity of the second derivatives is weaker than anticipated. We doubt that a similarly general regularity result can be proven without symmetry assumptions. In conclusion, we explore the implications of our results for numerous problems within the domain of QUMOND, thereby underlining their potential significance and applicability.


title: Improved Baselines for Data-efficient Perceptual Augmentation of LLMs

abstract: The abilities of large language models (LLMs) have recently progressed to unprecedented levels, paving the way to novel applications in a wide variety of areas. In computer vision, LLMs can be used to prime vision-language tasks such image captioning and visual question answering when coupled with pre-trained vision backbones. While different approaches have been explored to interface LLMs with ``perceptual backbones'' that process, e.g., visual or audio data, they are often explored for different tasks, different datasets, and using different perceptual backbones and language models, hindering direct comparison of the interfacing mechanisms. To remedy this lack of comparability between methods, we present an extensive experimental evaluation of different interfacing mechanisms, across multiple tasks (including image, video, and audio captioning as well as visual question answering), datasets and backbones, paying special attention to low-data settings. We find improved performance using existing mechanisms over state-of-the-art results, and identify a new interfacing mechanism that yields (near) optimal results across different tasks, while obtaining a 4x reduction in training time.


title: The Galactic latitude dependency of Faraday complexity in the S-PASS/ATCA RM catalogue

abstract: The S-band Polarisation All Sky Survey (SPASS/ATCA) rotation measure (RM) catalogue is the largest broadband RM catalogue to date, increasing the RM density in the sparse southern sky. Through analysis of this catalogue, we report a latitude dependency of the Faraday complexity of polarised sources in this catalogue within 10$^\circ$ of the Galactic plane towards the inner Galaxy. In this study, we aim to investigate this trend with follow-up observations using the Australia Telescope Compact Array (ATCA). We observe 95 polarised sources from the SPASS/ATCA RM catalogue at 1.1 - 3.1 GHz with ATCA's 6 km configuration. We present Stokes QU fitting results and a comparative analysis with the SPASS/ATCA catalogue. We find an overall decrease in complexity in these sources with the higher angular resolution observations, with a complexity fraction of 42\%, establishing that the majority of the complexity in the SPASS/ATCA sample is due to the mixing-in of diffuse Galactic emission at scales $\theta > 2.8'$. Furthermore, we find a correlation between our observed small-scale complexity $\theta < 2.8'$ and the Galactic spiral arms, which we interpret to be due to Galactic turbulence or small-scale polarised emission. These results emphasise the importance of considering the maximum angular scale to which the observations are sensitive in the classification of Faraday complexity; the effect of which can be more carefully investigated with SKA-precursor and pathfinder arrays (e.g. MeerKAT and ASKAP).


title: VSTAR: Generative Temporal Nursing for Longer Dynamic Video Synthesis

abstract: Despite tremendous progress in the field of text-to-video (T2V) synthesis, open-sourced T2V diffusion models struggle to generate longer videos with dynamically varying and evolving content. They tend to synthesize quasi-static videos, ignoring the necessary visual change-over-time implied in the text prompt. At the same time, scaling these models to enable longer, more dynamic video synthesis often remains computationally intractable. To address this challenge, we introduce the concept of Generative Temporal Nursing (GTN), where we aim to alter the generative process on the fly during inference to improve control over the temporal dynamics and enable generation of longer videos. We propose a method for GTN, dubbed VSTAR, which consists of two key ingredients: 1) Video Synopsis Prompting (VSP) - automatic generation of a video synopsis based on the original single prompt leveraging LLMs, which gives accurate textual guidance to different visual states of longer videos, and 2) Temporal Attention Regularization (TAR) - a regularization technique to refine the temporal attention units of the pre-trained T2V diffusion models, which enables control over the video dynamics. We experimentally showcase the superiority of the proposed approach in generating longer, visually appealing videos over existing open-sourced T2V models. We additionally analyze the temporal attention maps realized with and without VSTAR, demonstrating the importance of applying our method to mitigate neglect of the desired visual change over time.


title: Adversarial Attacks and Defenses in Fault Detection and Diagnosis: A Comprehensive Benchmark on the Tennessee Eastman Process

abstract: Integrating machine learning into Automated Control Systems (ACS) enhances decision-making in industrial process management. One of the limitations to the widespread adoption of these technologies in industry is the vulnerability of neural networks to adversarial attacks. This study explores the threats in deploying deep learning models for fault diagnosis in ACS using the Tennessee Eastman Process dataset. By evaluating three neural networks with different architectures, we subject them to six types of adversarial attacks and explore five different defense methods. Our results highlight the strong vulnerability of models to adversarial samples and the varying effectiveness of defense strategies. We also propose a novel protection approach by combining multiple defense methods and demonstrate it's efficacy. This research contributes several insights into securing machine learning within ACS, ensuring robust fault diagnosis in industrial processes.


title: First Demonstration of 25{\lambda} x 10 Gb/s C+L Band Classical / DV-QKD Co-Existence Over Single Bidirectional Fiber Link

abstract: As quantum key distribution has reached the maturity level for practical deployment, questions about the co-integration with existing classical communication systems are of utmost importance. To this end we demonstrate how the co-propagation of classical and quantum signals can benefit from the development of novel hollow-core fibers. We demonstrate a secure key rate of 330 bit/s for a quantum channel at 1538 nm in the presence of 25 x 10 Gb/s classical channels, transmitted at an aggregated launch power of 12 dBm, spanning over the C+L-band in the same hollow-core fiber link. Furthermore, we show the co-integration of the classical key-distillation channel onto this fiber link, turning it into a bidirectional fiber link and thereby mitigating the need for multiple fibers. We believe this to be an important step towards the deployment and integration of hollow-core fibers together with DV-QKD for the inherently secure telecom network of the future.


title: Effects of dislocation filtering layers on optical properties of third telecom window emitting InAs/InGaAlAs quantum dots grown on silicon substrates

abstract: Integrating light emitters based on III-V materials with silicon-based electronics is crucial for further increase in data transfer rates in communication systems since the indirect bandgap of silicon prevents its direct use as a light source. We investigate here InAs/InGaAlAs quantum dot (QD) structures grown directly on 5{\deg} off-cut Si substrate and emitting light at 1.5 micrometers, compatible with established telecom platform. Using different dislocation defects filtering layers, exploiting strained superlattices and supplementary QD layers, we mitigate the effects of lattice constant and thermal expansion mismatches between III-V materials and Si during growth. Complementary optical spectroscopy techniques, i.e. photoreflectance and temperature-, time- and polarization- resolved photoluminescence, allow us to determine the optical quality and application potential of the obtained structures by comparing them to a reference sample -- state-of-the-art QDs grown on InP. Experimental findings are supported by calculations of excitonic states and optical transitions by combining multiband k.p and configuration-interaction methods. We show that our design of structures prevents the generation of a considerable density of defects, as intended. The emission of Si-based structures appears to be much broader than for the reference dots, due to the creation of different QD populations which might be a disadvantage in particular laser applications, however, could be favourable for others, e.g. in broadly tunable devices, sensors, or optical amplifiers. Eventually, we identify the overall most promising combination of defect filtering layers, discuss its advantages and limitations, and prospects for further improvements.


title: Towards an All-Silicon QKD Transmitter Sourced by a Ge-on-Si Light Emitter

abstract: We demonstrate a novel transmitter concept for quantum key distribution based on the polarization-encoded BB84 protocol, which is sourced by the incoherent light of a forward-biased Ge-on-Si PIN junction. We investigate two architectures for quantum state preparation, including independent polarization encoding through multiple modulators and a simplified approach leveraging on an interferometric polarization modulator. We experimentally prove that the Ge-on-Si light source can accommodate for quantum key generation by accomplishing raw-key rates of 2.15 kbit/s at a quantum bit error ratio of 7.71% at a symbol rate of 1 GHz. We further investigate the impact of depolarization along fiber-based transmission channels in combination with the broadband nature of the incoherent light source. Our results prove the feasibility of a fully-integrated silicon quantum key distribution transmitter, including its light source, for possible short-reach applications in zero-trust intra-datacenter environments.


title: Time-resolved measurement of acoustic density fluctuations using a phase-shifting Mach-Zehnder interferometer

abstract: Phase-shifting interferometry is one of the optical measurement techniques that improves accuracy and resolution by incorporating a controlled phase shift into conventional optical interferometry. In this study, a four-step phase-shifting interferometer is developed to measure the spatio-temporal distribution of acoustic density oscillations of the gas next to a rigid plate. The experimental apparatus consists of a polarizing Mach-Zehnder interferometer with a polarization camera capable of capturing four polarization directions in one shot image and it is used to measure the magnitude and the phase of density fluctuations through a duct of rectangular cross-section connected to a loudspeaker. The results are compared with the well-established thermoacoustic theory describing the thermal coupling between acoustic oscillations and rigid boundaries, and the results show a very good agreement for various ratios of the (frequency-dependent) thermal boundary layer thickness to the plate spacing. This measurement technique could be advantageously employed to analyze more complex heat transfer processes involving the coupling of acoustic oscillations with rigid boundaries.


title: FMM-Attack: A Flow-based Multi-modal Adversarial Attack on Video-based LLMs

abstract: Despite the remarkable performance of video-based large language models (LLMs), their adversarial threat remains unexplored. To fill this gap, we propose the first adversarial attack tailored for video-based LLMs by crafting flow-based multi-modal adversarial perturbations on a small fraction of frames within a video, dubbed FMM-Attack. Extensive experiments show that our attack can effectively induce video-based LLMs to generate incorrect answers when videos are added with imperceptible adversarial perturbations. Intriguingly, our FMM-Attack can also induce garbling in the model output, prompting video-based LLMs to hallucinate. Overall, our observations inspire a further understanding of multi-modal robustness and safety-related feature alignment across different modalities, which is of great importance for various large multi-modal models. Our code is available at https://github.com/THU-Kingmin/FMM-Attack.


title: Absence of strong CP violation

abstract: Quantum Chromodynamics admits a CP-violating contribution to the action, the $\theta$ term, which is expected to give rise to a nonvanishing electric dipole moment of the neutron. Despite intensive search, no CP violations have been found in the strong interaction. This puzzle is referred to as the strong CP problem. There is evidence that CP is conserved in the confining theory, to the extent that color charges are totally screened for $\theta > 0$ at large distances. It is not immediately obvious that this implies a vanishing dipole moment though. With this Letter I will close the gap. It is shown that in the infinite volume hadron correlation functions decouple from the topological charge, expressed in terms of the zero modes. The reason is that hadrons have a limited range of interaction, while the density of zero modes vanishes with the inverse root of the volume, thus reducing the probability of finding a zero mode in the vicinity to zero. This implies, beyond doubt, that CP is conserved in the strong interaction.


title: High-confidence pseudo-labels for domain adaptation in COVID-19 detection

abstract: This paper outlines our submission for the 4th COV19D competition as part of the `Domain adaptation, Explainability, Fairness in AI for Medical Image Analysis' (DEF-AI-MIA) workshop at the Computer Vision and Pattern Recognition Conference (CVPR). The competition consists of two challenges. The first is to train a classifier to detect the presence of COVID-19 from over one thousand CT scans from the COV19-CT-DB database. The second challenge is to perform domain adaptation by taking the dataset from Challenge 1 and adding a small number of scans (some annotated and other not) for a different distribution. We preprocessed the CT scans to segment the lungs, and output volumes with the lungs individually and together. We then trained 3D ResNet and Swin Transformer models on these inputs. We annotated the unlabeled CT scans using an ensemble of these models and chose the high-confidence predictions as pseudo-labels for fine-tuning. This resulted in a best cross-validation mean F1 score of 93.39\% for Challenge 1 and a mean F1 score of 92.15 for Challenge 2.


title: The Mediterraneus Protocol: building an SSI native decentralised ecosystem of digital services

abstract: This paper presents, for the first time, the Mediterraneous protocol. It is designed to support the development of an Internet of digital services, owned by their creators, and consumed by users by presenting their decentralised digital identity and a proof of service purchase. Mediterraneous is Self-Sovereign Identity (SSI) native, integrating the SSI model at the core of its working principles to overcome the limitations resulting from using pseudonyms and centralised access control of existing Web3 solutions.


title: On the flag structure and classification of the holomorphic curves on C*-algebras

abstract: In this note, we will define the formulas of curvature and it's covariant derivatives for holomorphic curves on C*-algebras for the multivariable case. As applications, the unitarily and similarly classification theorems for holomorphic bundle and commuting operator tuples in Cowen-Douglas class are given.


title: Scale Decoupled Distillation

abstract: Logit knowledge distillation attracts increasing attention due to its practicality in recent studies. However, it often suffers inferior performance compared to the feature knowledge distillation. In this paper, we argue that existing logit-based methods may be sub-optimal since they only leverage the global logit output that couples multiple semantic knowledge. This may transfer ambiguous knowledge to the student and mislead its learning. To this end, we propose a simple but effective method, i.e., Scale Decoupled Distillation (SDD), for logit knowledge distillation. SDD decouples the global logit output into multiple local logit outputs and establishes distillation pipelines for them. This helps the student to mine and inherit fine-grained and unambiguous logit knowledge. Moreover, the decoupled knowledge can be further divided into consistent and complementary logit knowledge that transfers the semantic information and sample ambiguity, respectively. By increasing the weight of complementary parts, SDD can guide the student to focus more on ambiguous samples, improving its discrimination ability. Extensive experiments on several benchmark datasets demonstrate the effectiveness of SDD for wide teacher-student pairs, especially in the fine-grained classification task. Code is available at: https://github.com/shicaiwei123/SDD-CVPR2024


title: What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models

abstract: This paper presents a way of enhancing the reliability of Large Multi-modal Models (LMMs) in addressing hallucination, where the models generate cross-modal inconsistent responses. Without additional training, we propose Counterfactual Inception, a novel method that implants counterfactual thinking into LMMs using self-generated counterfactual keywords. Our method is grounded in the concept of counterfactual thinking, a cognitive process where human considers alternative realities, enabling more extensive context exploration. Bridging the human cognition mechanism into LMMs, we aim for the models to engage with and generate responses that span a wider contextual scene understanding, mitigating hallucinatory outputs. We further introduce Plausibility Verification Process (PVP), a simple yet robust keyword constraint that effectively filters out sub-optimal keywords to enable the consistent triggering of counterfactual thinking in the model responses. Comprehensive analyses across various LMMs, including both open-source and proprietary models, corroborate that counterfactual thinking significantly reduces hallucination and helps to broaden contextual understanding based on true visual clues.


title: How Gender Interacts with Political Values: A Case Study on Czech BERT Models

abstract: Neural language models, which reach state-of-the-art results on most natural language processing tasks, are trained on large text corpora that inevitably contain value-burdened content and often capture undesirable biases, which the models reflect. This case study focuses on the political biases of pre-trained encoders in Czech and compares them with a representative value survey. Because Czech is a gendered language, we also measure how the grammatical gender coincides with responses to men and women in the survey. We introduce a novel method for measuring the model's perceived political values. We find that the models do not assign statement probability following value-driven reasoning, and there is no systematic difference between feminine and masculine sentences. We conclude that BERT-sized models do not manifest systematic alignment with political values and that the biases observed in the models are rather due to superficial imitation of training data patterns than systematic value beliefs encoded in the models.