title: Bridging Domains with Approximately Shared Features

abstract: Multi-source domain adaptation aims to reduce performance degradation when applying machine learning models to unseen domains. A fundamental challenge is devising the optimal strategy for feature selection. Existing literature is somewhat paradoxical: some advocate for learning invariant features from source domains, while others favor more diverse features. To address the challenge, we propose a statistical framework that distinguishes the utilities of features based on the variance of their correlation to label $y$ across domains. Under our framework, we design and analyze a learning procedure consisting of learning approximately shared feature representation from source tasks and fine-tuning it on the target task. Our theoretical analysis necessitates the importance of learning approximately shared features instead of only the strictly invariant features and yields an improved population risk compared to previous results on both source and target tasks, thus partly resolving the paradox mentioned above. Inspired by our theory, we proposed a more practical way to isolate the content (invariant+approximately shared) from environmental features and further consolidate our theoretical findings.


title: A Differential Geometric View and Explainability of GNN on Evolving Graphs

abstract: Graphs are ubiquitous in social networks and biochemistry, where Graph Neural Networks (GNN) are the state-of-the-art models for prediction. Graphs can be evolving and it is vital to formally model and understand how a trained GNN responds to graph evolution. We propose a smooth parameterization of the GNN predicted distributions using axiomatic attribution, where the distributions are on a low-dimensional manifold within a high-dimensional embedding space. We exploit the differential geometric viewpoint to model distributional evolution as smooth curves on the manifold. We reparameterize families of curves on the manifold and design a convex optimization problem to find a unique curve that concisely approximates the distributional evolution for human interpretation. Extensive experiments on node classification, link prediction, and graph classification tasks with evolving graphs demonstrate the better sparsity, faithfulness, and intuitiveness of the proposed method over the state-of-the-art methods.


title: Formation of artificial Fermi surfaces with a triangular superlattice on a conventional two dimensional electron gas

abstract: In nearly free electron theory the imposition of a periodic electrostatic potential on free electrons creates the bandstructure of a material, determined by the crystal lattice spacing and geometry. Imposing an artificially designed potential to the electrons confined in a GaAs quantum well makes it possible to engineer synthetic two-dimensional band structures, with electronic properties different from those in the host semiconductor. Here we report the fabrication and study of a tuneable triangular artificial lattice on a GaAs/AlGaAs heterostructure where it is possible to transform from the original GaAs bandstructure and Fermi surface to a new bandstructure with multiple artificial Fermi surfaces simply by altering a gate bias. For weak electrostatic potential modulation magnetotransport measurements reveal quantum oscillations from the GaAs two-dimensional Fermi surface, and classical oscillations due to these electrons scattering from the artificial lattice. Increasing the strength of the modulation reveals new quantum oscillations due to the formation of multiple artificial Fermi surfaces, and ultimately to new classical oscillations of the electrons from the artificial Fermi surface scattering from the superlattice modulation. These results show that low disorder gate-tuneable lateral superlattices can be used to form artificial two dimensional crystals with designer electronic properties.


title: Asymptotic behavior of unstable perturbations of the Fubini-Study metric in Ricci flow

abstract: Kr\"oncke has shown that the Fubini-Study metric is an unstable generalized stationary solution of Ricci flow [Kr\"o20]. In this paper, we carry out numerical simulations which indicate that Ricci flow solutions originating at unstable perturbations of the Fubini-Study metric develop local singularities modeled by the blowdown soliton discovered in [FIK03].


title: Intra-Section Code Cave Injection for Adversarial Evasion Attacks on Windows PE Malware File

abstract: Windows malware is predominantly available in cyberspace and is a prime target for deliberate adversarial evasion attacks. Although researchers have investigated the adversarial malware attack problem, a multitude of important questions remain unanswered, including (a) Are the existing techniques to inject adversarial perturbations in Windows Portable Executable (PE) malware files effective enough for evasion purposes?; (b) Does the attack process preserve the original behavior of malware?; (c) Are there unexplored approaches/locations that can be used to carry out adversarial evasion attacks on Windows PE malware?; and (d) What are the optimal locations and sizes of adversarial perturbations required to evade an ML-based malware detector without significant structural change in the PE file? To answer some of these questions, this work proposes a novel approach that injects a code cave within the section (i.e., intra-section) of Windows PE malware files to make space for adversarial perturbations. In addition, a code loader is also injected inside the PE file, which reverts adversarial malware to its original form during the execution, preserving the malware's functionality and executability. To understand the effectiveness of our approach, we injected adversarial perturbations inside the .text, .data and .rdata sections, generated using the gradient descent and Fast Gradient Sign Method (FGSM), to target the two popular CNN-based malware detectors, MalConv and MalConv2. Our experiments yielded notable results, achieving a 92.31% evasion rate with gradient descent and 96.26% with FGSM against MalConv, compared to the 16.17% evasion rate for append attacks. Similarly, when targeting MalConv2, our approach achieved a remarkable maximum evasion rate of 97.93% with gradient descent and 94.34% with FGSM, significantly surpassing the 4.01% evasion rate observed with append attacks.


title: Designing for Projection-based Communication between Autonomous Vehicles and Pedestrians

abstract: Recent studies have investigated new approaches for communicating an autonomous vehicle's (AV) intent and awareness to pedestrians. This paper adds to this body of work by presenting the design and evaluation of in-situ projections on the road. Our design combines common traffic light patterns with aesthetic visual elements. We describe the iterative design process and the prototyping methods used in each stage. The final design concept was represented as a virtual reality simulation and evaluated with 18 participants in four different street crossing scenarios, which included three scenarios that simulated various degrees of system errors. We found that different design elements were able to support participants' confidence in their decision even when the AV failed to correctly detect their presence. We also identified elements in our design that needed to be more clearly communicated. Based on these findings, the paper presents a series of design recommendations for projection-based communication between AVs and pedestrians.


title: AS-FIBA: Adaptive Selective Frequency-Injection for Backdoor Attack on Deep Face Restoration

abstract: Deep learning-based face restoration models, increasingly prevalent in smart devices, have become targets for sophisticated backdoor attacks. These attacks, through subtle trigger injection into input face images, can lead to unexpected restoration outcomes. Unlike conventional methods focused on classification tasks, our approach introduces a unique degradation objective tailored for attacking restoration models. Moreover, we propose the Adaptive Selective Frequency Injection Backdoor Attack (AS-FIBA) framework, employing a neural network for input-specific trigger generation in the frequency domain, seamlessly blending triggers with benign images. This results in imperceptible yet effective attacks, guiding restoration predictions towards subtly degraded outputs rather than conspicuous targets. Extensive experiments demonstrate the efficacy of the degradation objective on state-of-the-art face restoration models. Additionally, it is notable that AS-FIBA can insert effective backdoors that are more imperceptible than existing backdoor attack methods, including WaNet, ISSBA, and FIBA.


title: From Fitting Participation to Forging Relationships: The Art of Participatory ML

abstract: Participatory machine learning (ML) encourages the inclusion of end users and people affected by ML systems in design and development processes. We interviewed 18 participation brokers -- individuals who facilitate such inclusion and transform the products of participants' labour into inputs for an ML artefact or system -- across a range of organisational settings and project locations. Our findings demonstrate the inherent challenges of integrating messy contextual information generated through participation with the structured data formats required by ML workflows and the uneven power dynamics in project contexts. We advocate for evolution in the role of brokers to more equitably balance value generated in Participatory ML projects for design and development teams with value created for participants. To move beyond `fitting' participation to existing processes and empower participants to envision alternative futures through ML, brokers must become educators and advocates for end users, while attending to frustration and dissent from indirect stakeholders.


title: Joint-Embedding Masked Autoencoder for Self-supervised Learning of Dynamic Functional Connectivity from the Human Brain

abstract: Graph Neural Networks (GNNs) have shown promise in learning dynamic functional connectivity for distinguishing phenotypes from human brain networks. However, obtaining extensive labeled clinical data for training is often resource-intensive, making practical application difficult. Leveraging unlabeled data thus becomes crucial for representation learning in a label-scarce setting. Although generative self-supervised learning techniques, especially masked autoencoders, have shown promising results in representation learning in various domains, their application to dynamic graphs for dynamic functional connectivity remains underexplored, facing challenges in capturing high-level semantic representations. Here, we introduce the Spatio-Temporal Joint Embedding Masked Autoencoder (ST-JEMA), drawing inspiration from the Joint Embedding Predictive Architecture (JEPA) in computer vision. ST-JEMA employs a JEPA-inspired strategy for reconstructing dynamic graphs, which enables the learning of higher-level semantic representations considering temporal perspectives, addressing the challenges in fMRI data representation learning. Utilizing the large-scale UK Biobank dataset for self-supervised learning, ST-JEMA shows exceptional representation learning performance on dynamic functional connectivity demonstrating superiority over previous methods in predicting phenotypes and psychiatric diagnoses across eight benchmark fMRI datasets even with limited samples and effectiveness of temporal reconstruction on missing data scenarios. These findings highlight the potential of our approach as a robust representation learning method for leveraging label-scarce fMRI data.


title: Fine-Grained Pillar Feature Encoding Via Spatio-Temporal Virtual Grid for 3D Object Detection

abstract: Developing high-performance, real-time architectures for LiDAR-based 3D object detectors is essential for the successful commercialization of autonomous vehicles. Pillar-based methods stand out as a practical choice for onboard deployment due to their computational efficiency. However, despite their efficiency, these methods can sometimes underperform compared to alternative point encoding techniques such as Voxel-encoding or PointNet++. We argue that current pillar-based methods have not sufficiently captured the fine-grained distributions of LiDAR points within each pillar structure. Consequently, there exists considerable room for improvement in pillar feature encoding. In this paper, we introduce a novel pillar encoding architecture referred to as Fine-Grained Pillar Feature Encoding (FG-PFE). FG-PFE utilizes Spatio-Temporal Virtual (STV) grids to capture the distribution of point clouds within each pillar across vertical, temporal, and horizontal dimensions. Through STV grids, points within each pillar are individually encoded using Vertical PFE (V-PFE), Temporal PFE (T-PFE), and Horizontal PFE (H-PFE). These encoded features are then aggregated through an Attentive Pillar Aggregation method. Our experiments conducted on the nuScenes dataset demonstrate that FG-PFE achieves significant performance improvements over baseline models such as PointPillar, CenterPoint-Pillar, and PillarNet, with only a minor increase in computational overhead.


title: BoostER: Leveraging Large Language Models for Enhancing Entity Resolution

abstract: Entity resolution, which involves identifying and merging records that refer to the same real-world entity, is a crucial task in areas like Web data integration. This importance is underscored by the presence of numerous duplicated and multi-version data resources on the Web. However, achieving high-quality entity resolution typically demands significant effort. The advent of Large Language Models (LLMs) like GPT-4 has demonstrated advanced linguistic capabilities, which can be a new paradigm for this task. In this paper, we propose a demonstration system named BoostER that examines the possibility of leveraging LLMs in the entity resolution process, revealing advantages in both easy deployment and low cost. Our approach optimally selects a set of matching questions and poses them to LLMs for verification, then refines the distribution of entity resolution results with the response of LLMs. This offers promising prospects to achieve a high-quality entity resolution result for real-world applications, especially to individuals or small companies without the need for extensive model training or significant financial investment.


title: A Naive Model of Covid-19 Spread From A Dry Cough

abstract: Health experts have suggested that social distancing measures are one of the most effective ways of preventing the spread of Covid-19. Research primarily focused on large Covid filled droplets suggested that these droplets can move further than regulated social distancing guidelines (2 meters apart) in the presence of wind. This project aims to model the paths of smaller Covid virions that last longer in the air to see if they also move beyond social distancing norms in the presence of wind. By numerically solving a 2-dimensional Langevin equation for 3000 particles and modeling wind as one-dimensional and steady, velocities were found that translated into particles' positions. With wind, infectious doses of virions appeared to travel farther and faster, increasing the risk of infection before dispersion. The two-dimensional model given implies that social distancing norms are reasonable in cases with no wind, yet not conservative enough when there is wind.


title: Designing a K-state P-bit Engine

abstract: Probabilistic bit (p-bit)-based compute engines utilize the unique capability of a p-bit to probabilistically switch between two states to solve computationally challenging problems. However, when solving problems that require more than two states (e.g., problems such as Max-3-Cut, verifying if a graph is K-partite (K>2) etc.), additional pre-processing steps such as graph reduction are required to make the problem compatible with a two-state p-bit platform. Moreover, this not only increases the problem size by entailing the use of auxiliary variables but can also degrade the solution quality. In this work, we develop a unique framework for implementing a K-state (K>2) p-bit engine. Furthermore, from an implementation standpoint, we show that such a K-state p-bit engine can be implemented using N traditional (2-state) p-bits, and one multi-state p-bit -- a novel concept proposed here. Augmenting traditional p-bit platforms, our approach enables us to solve an archetypal combinatoric problem class requiring multiple states, namely Max-K-Cut (K=3, 4 shown here), without using any additional auxiliary variables. Thus, our work fundamentally advances the functional capability of p-bit engines, enabling them to solve a broader class of computationally challenging problems more efficiently.


title: Distribution of merging and post-merging galaxies in nearby galaxy clusters

abstract: We study the incidence and spatial distribution of galaxies that are currently undergoing gravitational merging (M) or that have signs of a post merger (PM) in six galaxy clusters (A754, A2399, A2670, A3558, A3562, and A3716) within the redshift range, 0.05$\lesssim$$z$$\lesssim$0.08. To this aim, we obtained Dark Energy Camera (DECam) mosaics in $u^{\prime}$, $g^{\prime}$, and $r^{\prime}$-bands covering up to $3\times R_{200}$ of the clusters, reaching 28 mag/arcsec$^2$ surface brightness limits. We visually inspect $u^{\prime}$$g^{\prime}$$r^{\prime}$ color-composite images of volume-limited ($M_r < -20$) cluster-member galaxies to identify whether galaxies are of M or PM types. We find 4% M-type and 7% PM-type galaxies in the galaxy clusters studied. By adding spectroscopic data and studying the projected phase space diagram (PPSD) of the projected clustocentric radius and the line-of-sight velocity, we find that PM-type galaxies are more virialized than M-type galaxies, having 1--5% point higher fraction within the escape-velocity region, while the fraction of M-type was $\sim$10% point higher than PM-type in the intermediate environment. Similarly, on a substructure analysis, M types were found in the outskirt groups, while PM types populated groups in ubiquitous regions of the PPSD. Adopting literature-derived dynamical state indicator values, we observed a higher abundance of M types in dynamically relaxed clusters. This finding suggests that galaxies displaying post-merging features within clusters likely merged in low-velocity environments, including cluster outskirts and dynamically relaxed clusters.


title: Unification of Secret Key Generation and Wiretap Channel Transmission

abstract: This paper presents further insights into a recently developed round-trip communication scheme called ``Secret-message Transmission by Echoing Encrypted Probes (STEEP)''. A legitimate wireless channel between a multi-antenna user (Alice) and a single-antenna user (Bob) in the presence of a multi-antenna eavesdropper (Eve) is focused on. STEEP does not require full-duplex, channel reciprocity or Eve's channel state information, but is able to yield a positive secrecy rate in bits per channel use between Alice and Bob in every channel coherence period as long as Eve's receive channel is not noiseless. This secrecy rate does not diminish as coherence time increases. Various statistical behaviors of STEEP's secrecy capacity due to random channel fading are also illustrated.


title: Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

abstract: Traditional fluorescence microscopy is constrained by inherent trade-offs among resolution, field-of-view, and system complexity. To navigate these challenges, we introduce a simple and low-cost computational multi-aperture miniature microscope, utilizing a microlens array for single-shot wide-field, high-resolution imaging. Addressing the challenges posed by extensive view multiplexing and non-local, shift-variant aberrations in this device, we present SV-FourierNet, a novel multi-channel Fourier neural network. SV-FourierNet facilitates high-resolution image reconstruction across the entire imaging field through its learned global receptive field. We establish a close relationship between the physical spatially-varying point-spread functions and the network's learned effective receptive field. This ensures that SV-FourierNet has effectively encapsulated the spatially-varying aberrations in our system, and learned a physically meaningful function for image reconstruction. Training of SV-FourierNet is conducted entirely on a physics-based simulator. We showcase wide-field, high-resolution video reconstructions on colonies of freely moving C. elegans and imaging of a mouse brain section. Our computational multi-aperture miniature microscope, augmented with SV-FourierNet, represents a major advancement in computational microscopy and may find broad applications in biomedical research and other fields requiring compact microscopy solutions.


title: The role of the short-distance interaction in $e^+e^-\to \gamma X(3872)$

abstract: In this study, we analyze the cross-section data from the $e^+e^-\to \gamma J/\psi\omega$ process to explore both short-distance and long-distance interactions for the radiative transition $Y(4200)\to \gamma X(3872)$. We investigate the short-distance effects through the E1 transition among the $c\bar{c}$ components, and the long-distance effects via hadronic loop diagrams. Our numerical analysis reveals that short-distance interactions play a significantly larger role in the radiative transition than that of the long-distance interactions. This finding underscores the importance of the compact $c\bar{c}$ components in both the initial and final states for accurately understanding the cross-section $\sigma[e^+e^-\to \gamma J/\psi\omega]$. Furthermore, with the help of relative branch ratio $\mathcal{R}$ we estimate the $\Gamma[Y(4200)\to\gamma X(3872)]$ implied in the the experimental study. Finally, we also discuss the possible existence of $\psi(4040)$ signal within the cross-section data.


title: The energy spectrum of a quantum vortex loop moving in a long pipe

abstract: In this study, the problem of the energy spectrum of a quantum vortex loop moving in a thin long pipe is solved for the first time. The vortex filament is described in the Local Induction Approximation. We quantize this dynamic system using a new method, which leads to non-trivial results for circulation $\Gamma$ and energy values $E$. In the final form, we present the spectrum of the vortex loop in the form of a ''Regge trajectory'' $E = E(\Gamma)$. The vortex quantization problem is considered outside of two-fluid hydrodynamics and other conventional approaches.


title: Symmetry Hierarchy and Thermalization Frustration in Graphene Nanoresonators

abstract: As the essential cause of the intrinsic dissipation that limits the quality of graphene nanoresonators, intermodal energy transfer is also a key issue in thermalization dynamics. Typically systems with larger initial energy demand shorter time to be thermalized. However, we find quantitatively that instead of becoming shorter, the equipartition time of the graphene nanoresonator can increase abruptly by one order of magnitude. This thermalization frustration emerges due to the partition of the normal modes based on the hierarchical symmetry, and a sensitive on-off switching of the energy flow channels between symmetry classes controlled by Mathieu instabilities. The results uncover the decisive roles of symmetry in the thermalization at the nanoscale, and may also lead to strategies for improving the performance of graphene nanoresonators.


title: Temporal-Mapping Photography for Event Cameras

abstract: Event cameras, or Dynamic Vision Sensors (DVS) are novel neuromorphic sensors that capture brightness changes as a continuous stream of ``events'' rather than traditional intensity frames. Converting sparse events to dense intensity frames faithfully has long been an ill-posed problem. Previous methods have primarily focused on converting events to video in dynamic scenes or with a moving camera. In this paper, for the first time, we realize events to dense intensity image conversion using a stationary event camera in static scenes. Different from traditional methods that mainly rely on event integration, the proposed Event-Based Temporal Mapping Photography (EvTemMap) measures the time of event emitting for each pixel. Then, the resulting Temporal Matrix is converted to an intensity frame with a temporal mapping neural network. At the hardware level, the proposed EvTemMap is implemented by combining a transmittance adjustment device with a DVS, named Adjustable Transmittance Dynamic Vision Sensor. Additionally, we collected TemMat dataset under various conditions including low-light and high dynamic range scenes. The experimental results showcase the high dynamic range, fine-grained details, and high-grayscale-resolution of the proposed EvTemMap, as well as the enhanced performance on downstream computer vision tasks compared to other methods. The code and TemMat dataset will be made publicly available.


title: Latent Semantic Consensus For Deterministic Geometric Model Fitting

abstract: Estimating reliable geometric model parameters from the data with severe outliers is a fundamental and important task in computer vision. This paper attempts to sample high-quality subsets and select model instances to estimate parameters in the multi-structural data. To address this, we propose an effective method called Latent Semantic Consensus (LSC). The principle of LSC is to preserve the latent semantic consensus in both data points and model hypotheses. Specifically, LSC formulates the model fitting problem into two latent semantic spaces based on data points and model hypotheses, respectively. Then, LSC explores the distributions of points in the two latent semantic spaces, to remove outliers, generate high-quality model hypotheses, and effectively estimate model instances. Finally, LSC is able to provide consistent and reliable solutions within only a few milliseconds for general multi-structural model fitting, due to its deterministic fitting nature and efficiency. Compared with several state-of-the-art model fitting methods, our LSC achieves significant superiority for the performance of both accuracy and speed on synthetic data and real images. The code will be available at https://github.com/guobaoxiao/LSC.


title: On infinite matrices

abstract: We consider linear bounded operators acting in Banach spaces with a basis, such operators can be represented by an infinite matrix. We prove that for an invertible operator there exists a sequence of invertible finite-dimensional operators so that the family of norms of their inverses is uniformly bounded. It leads to the fact that solutions of finite-dimensional equations converge to the solution of initial operator equation with infinite-dimensional matrix.


title: Novel quantum spin liquid ground state in the trimer rhodate Ba$_4$NbRh$_3$O$_{12}$

abstract: Frustrated magnets offer a plethora of exotic magnetic ground states, including quantum spin liquids (QSLs), in which enhanced quantum fluctuations prevent a long-range magnetic ordering of the strongly correlated spins down to lowest temperature. Here we have investigated the trimer based mixed valence hexagonal rhodate Ba$_4$NbRh$_3$O$_{12}$ using a combination of dc and ac magnetization, electrical resistivity, specific heat, and muon spin rotation/relaxation ($\mu$SR) measurements. Despite the substantial antiferromagnetic exchange interactions, as evident from the Weiss temperature ($\theta_{\mathrm{W}}\sim -35$ to -45 K), among the Rh-local moments, neither long-range magnetic ordering nor spin-freezing is observed down to at least 50 mK, in ac-susceptibility, specific heat and ZF-$\mu$SR measurements (down to 0.26 K). We ascribe the absence of any magnetic transition to enhanced quantum fluctuations as a result of geometrical frustration arising out of the edge-sharing equilateral Rh-triangular network in the structure. Our longitudinal-field $\mu$SR result evidences persistent spin fluctuations down to 0.26~K, thus stabilizing a dynamic QSL ground state in Ba$_4$NbRh$_3$O$_{12}$. Furthermore, the magnetic specific heat ($C_{\mathrm{m}}$) data at low-$T$ reveal a significant $T$-linear contribution plus a quadratic $T$-dependence. A $T$-linear behavior is evocative of gapless spin excitations, while the $T^2$-term of $C_{\mathrm{m}}$ may indicate the Dirac QSL phenomenology of the spinon excitations with a linear dispersion.


title: CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendation

abstract: The long-tail recommendation is a challenging task for traditional recommender systems, due to data sparsity and data imbalance issues. The recent development of large language models (LLMs) has shown their abilities in complex reasoning, which can help to deduce users' preferences based on very few previous interactions. However, since most LLM-based systems rely on items' semantic meaning as the sole evidence for reasoning, the collaborative information of user-item interactions is neglected, which can cause the LLM's reasoning to be misaligned with task-specific collaborative information of the dataset. To further align LLMs' reasoning to task-specific user-item interaction knowledge, we introduce collaborative retrieval-augmented LLMs, CoRAL, which directly incorporate collaborative evidence into the prompts. Based on the retrieved user-item interactions, the LLM can analyze shared and distinct preferences among users, and summarize the patterns indicating which types of users would be attracted by certain items. The retrieved collaborative evidence prompts the LLM to align its reasoning with the user-item interaction patterns in the dataset. However, since the capacity of the input prompt is limited, finding the minimally-sufficient collaborative information for recommendation tasks can be challenging. We propose to find the optimal interaction set through a sequential decision-making process and develop a retrieval policy learned through a reinforcement learning (RL) framework, CoRAL. Our experimental results show that CoRAL can significantly improve LLMs' reasoning abilities on specific recommendation tasks. Our analysis also reveals that CoRAL can more efficiently explore collaborative information through reinforcement learning.


title: Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models

abstract: Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research into detecting and mitigating hallucinations of LLMs. Previous studies have mainly concentrated on post-processing techniques for hallucination detection, which tend to be computationally intensive and limited in effectiveness due to their separation from the LLM's inference process. To overcome these limitations, we introduce MIND, an unsupervised training framework that leverages the internal states of LLMs for real-time hallucination detection without requiring manual annotations. Additionally, we present HELM, a new benchmark for evaluating hallucination detection across multiple LLMs, featuring diverse LLM outputs and the internal states of LLMs during their inference process. Our experiments demonstrate that MIND outperforms existing state-of-the-art methods in hallucination detection.


title: On the blowup of solutions for a nonlocal multi-dimensional transport equation

abstract: In this paper, we revisit the problem of finite-time blowup for a multi-dimensional nonlocal transport equation studied in [Dong, Adv. Math. 264 (2014) 747-761]. Inspired by a one-dimensional analogous model considered in [Li-Rodrigo, Adv. Math. 374 (2020) 1-26], we establish a new weighted nonlinear inequality implying the blow-up by a completely real variable based technique.


title: Analysis of Pseudo-Random Number Generators in QMC-SSE Method

abstract: In the quantum Monte Carlo (QMC) method, the Pseudo-Random Number Generator (PRNG) plays a crucial role in determining the computation time. However, the hidden structure of the PRNG may lead to serious issues such as the breakdown of the Markov process. Here, we systematically analyze the performance of the different PRNGs on the widely used QMC method -- stochastic series expansion (SSE) algorithm. To quantitatively compare them, we introduce a quantity called QMC efficiency that can effectively reflect the efficiency of the algorithms. After testing several representative observables of the Heisenberg model in one and two dimensions, we recommend using LCG as the best choice of PRNGs. Our work can not only help improve the performance of the SSE method but also shed light on the other Markov-chain-based numerical algorithms.


title: Quantum double structure in cold atom superfluids

abstract: The theory of topological quantum computation is underpinned by two important classes of models. One is based on non-abelian Chern-Simons theory, which yields the so-called $\rm{SU}(2)_k$ anyon models that often appear in the context of electrically charged quantum fluids. The physics of the other is captured by symmetry broken Yang-Mills theory in the absence of a Chern-Simons term, and results in the so-called quantum double models. Extensive resources have been invested into the search for $\rm{SU}(2)_k$ anyon quasi-particles; in particular the so-called Ising anyons ($k=2$) of which Majorana zero modes are believed to be an incarnation. In contrast to the $\rm{SU}(2)_k$ models, quantum doubles have attracted little attention in experiments despite their pivotal role in the theory of error correction. Beyond topological error correcting codes, the appearance of quantum doubles has been limited to contexts primarily within mathematical physics, and as such, they are of seemingly little relevance for the study of experimentally tangible systems. However, recent works suggest that quantum double anyons may be found in spinor Bose-Einstein condensates. In light of this, the core purpose of this article is to provide a self-contained exposition of the quantum double structure, framed in the context of spinor condensates, by constructing explicitly the quantum doubles for various ground state symmetry groups and discuss their experimental realisability. We also derive analytically an equation for the quantum double Clebsch-Gordan coefficients from which the relevant braid matrices can be worked out. Finally, the existence of a particle-vortex duality is exposed and illuminated upon in this context.


title: Text2QR: Harmonizing Aesthetic Customization and Scanning Robustness for Text-Guided QR Code Generation

abstract: In the digital era, QR codes serve as a linchpin connecting virtual and physical realms. Their pervasive integration across various applications highlights the demand for aesthetically pleasing codes without compromised scannability. However, prevailing methods grapple with the intrinsic challenge of balancing customization and scannability. Notably, stable-diffusion models have ushered in an epoch of high-quality, customizable content generation. This paper introduces Text2QR, a pioneering approach leveraging these advancements to address a fundamental challenge: concurrently achieving user-defined aesthetics and scanning robustness. To ensure stable generation of aesthetic QR codes, we introduce the QR Aesthetic Blueprint (QAB) module, generating a blueprint image exerting control over the entire generation process. Subsequently, the Scannability Enhancing Latent Refinement (SELR) process refines the output iteratively in the latent space, enhancing scanning robustness. This approach harnesses the potent generation capabilities of stable-diffusion models, navigating the trade-off between image aesthetics and QR code scannability. Our experiments demonstrate the seamless fusion of visual appeal with the practical utility of aesthetic QR codes, markedly outperforming prior methods. Codes are available at \url{https://github.com/mulns/Text2QR}


title: FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications

abstract: Acquiring the desired font for various design tasks can be challenging and requires professional typographic knowledge. While previous font retrieval or generation works have alleviated some of these difficulties, they often lack support for multiple languages and semantic attributes beyond the training data domains. To solve this problem, we present FontCLIP: a model that connects the semantic understanding of a large vision-language model with typographical knowledge. We integrate typography-specific knowledge into the comprehensive vision-language knowledge of a pretrained CLIP model through a novel finetuning approach. We propose to use a compound descriptive prompt that encapsulates adaptively sampled attributes from a font attribute dataset focusing on Roman alphabet characters. FontCLIP's semantic typographic latent space demonstrates two unprecedented generalization abilities. First, FontCLIP generalizes to different languages including Chinese, Japanese, and Korean (CJK), capturing the typographical features of fonts across different languages, even though it was only finetuned using fonts of Roman characters. Second, FontCLIP can recognize the semantic attributes that are not presented in the training data. FontCLIP's dual-modality and generalization abilities enable multilingual and cross-lingual font retrieval and letter shape optimization, reducing the burden of obtaining desired fonts.


title: When Crypto Economics Meet Graph Analytics and Learning

abstract: Utilizing graph analytics and learning has proven to be an effective method for exploring aspects of crypto economics such as network effects, decentralization, tokenomics, and fraud detection. However, the majority of existing research predominantly focuses on leading cryptocurrencies, namely Bitcoin (BTC) and Ethereum (ETH), overlooking the vast diversity among the more than 10,000 cryptocurrency projects. This oversight may result in skewed insights. In our paper, we aim to broaden the scope of investigation to encompass the entire spectrum of cryptocurrencies, examining various coins across their entire life cycles. Furthermore, we intend to pioneer advanced methodologies, including graph transfer learning and the innovative concept of "graph of graphs". By extending our research beyond the confines of BTC and ETH, our goal is to enhance the depth of our understanding of crypto economics and to advance the development of more intricate graph-based techniques.


title: Neutrinoless double-$\beta$ decay and double Gamow-Teller transitions

abstract: The neutrinoless double-$\beta$ ($0\nu\beta\beta$) decay and the double Gamow-Teller (DGT) transition are investigated with the state-of-the-art Relativistic Configuration-interaction Density functional theory. A strong linear correlation between the nuclear matrix elements (NMEs) of the $0\nu\beta\beta$ decay and the DGT transition is demonstrated. This linear correlation is found to originate from the similarity of the leading-order term of the $0\nu\beta\beta$-decay operator and the DGT-transition one, as revealed by expanding the $0\nu\beta\beta$-decay operator in terms of the spherical harmonics. The present results provide a strong support to constrain the $0\nu\beta\beta$-decay NMEs through the double charge-exchange reactions.


title: A Survey of Learned Indexes for the Multi-dimensional Space

abstract: A recent research trend involves treating database index structures as Machine Learning (ML) models. In this domain, single or multiple ML models are trained to learn the mapping from keys to positions inside a data set. This class of indexes is known as "Learned Indexes." Learned indexes have demonstrated improved search performance and reduced space requirements for one-dimensional data. The concept of one-dimensional learned indexes has naturally been extended to multi-dimensional (e.g., spatial) data, leading to the development of "Learned Multi-dimensional Indexes". This survey focuses on learned multi-dimensional index structures. Specifically, it reviews the current state of this research area, explains the core concepts behind each proposed method, and classifies these methods based on several well-defined criteria. We present a taxonomy that classifies and categorizes each learned multi-dimensional index, and survey the existing literature on learned multi-dimensional indexes according to this taxonomy. Additionally, we present a timeline to illustrate the evolution of research on learned indexes. Finally, we highlight several open challenges and future research directions in this emerging and highly active field.


title: Ensemble Quadratic Assignment Network for Graph Matching

abstract: Graph matching is a commonly used technique in computer vision and pattern recognition. Recent data-driven approaches have improved the graph matching accuracy remarkably, whereas some traditional algorithm-based methods are more robust to feature noises, outlier nodes, and global transformation (e.g.~rotation). In this paper, we propose a graph neural network (GNN) based approach to combine the advantages of data-driven and traditional methods. In the GNN framework, we transform traditional graph-matching solvers as single-channel GNNs on the association graph and extend the single-channel architecture to the multi-channel network. The proposed model can be seen as an ensemble method that fuses multiple algorithms at every iteration. Instead of averaging the estimates at the end of the ensemble, in our approach, the independent iterations of the ensembled algorithms exchange their information after each iteration via a 1x1 channel-wise convolution layer. Experiments show that our model improves the performance of traditional algorithms significantly. In addition, we propose a random sampling strategy to reduce the computational complexity and GPU memory usage, so the model applies to matching graphs with thousands of nodes. We evaluate the performance of our method on three tasks: geometric graph matching, semantic feature matching, and few-shot 3D shape classification. The proposed model performs comparably or outperforms the best existing GNN-based methods.


title: Prediction of Wort Density with LSTM Network

abstract: Many physical target values in technical processes are error-prone, cumbersome, or expensive to measure automatically. One example of a physical target value is the wort density, which is an important value needed for beer production. This article introduces a system that helps the brewer measure wort density through sensors in order to reduce errors in manual data collection. Instead of a direct measurement of wort density, a method is developed that calculates the density from measured values acquired by inexpensive standard sensors such as pressure or temperature. The model behind the calculation is a neural network, known as LSTM.


title: From Pixel to Cancer: Cellular Automata in Computed Tomography

abstract: AI for cancer detection encounters the bottleneck of data scarcity, annotation difficulty, and low prevalence of early tumors. Tumor synthesis seeks to create artificial tumors in medical images, which can greatly diversify the data and annotations for AI training. However, current tumor synthesis approaches are not applicable across different organs due to their need for specific expertise and design. This paper establishes a set of generic rules to simulate tumor development. Each cell (pixel) is initially assigned a state between zero and ten to represent the tumor population, and a tumor can be developed based on three rules to describe the process of growth, invasion, and death. We apply these three generic rules to simulate tumor development--from pixel to cancer--using cellular automata. We then integrate the tumor state into the original computed tomography (CT) images to generate synthetic tumors across different organs. This tumor synthesis approach allows for sampling tumors at multiple stages and analyzing tumor-organ interaction. Clinically, a reader study involving three expert radiologists reveals that the synthetic tumors and their developing trajectories are convincingly realistic. Technically, we generate tumors at varied stages in 9,262 raw, unlabeled CT images sourced from 68 hospitals worldwide. The performance in segmenting tumors in the liver, pancreas, and kidneys exceeds prevailing literature benchmarks, underlining the immense potential of tumor synthesis, especially for earlier cancer detection. The code and models are available at https://github.com/MrGiovanni/Pixel2Cancer


title: RIS-Enabled Joint Near-Field 3D Localization and Synchronization in SISO Multipath Environments

abstract: Reconfigurable Intelligent Surfaces (RIS) show great promise in the realm of 6th generation (6G) wireless systems, particularly in the areas of localization and communication. Their cost-effectiveness and energy efficiency enable the integration of numerous passive and reflective elements, enabling near-field propagation. In this paper, we tackle the challenges of RIS-aided 3D localization and synchronization in multipath environments, focusing on the near-field of mmWave systems. Specifically, our approach involves formulating a maximum likelihood (ML) estimation problem for the channel parameters. To initiate this process, we leverage a combination of canonical polyadic decomposition (CPD) and orthogonal matching pursuit (OMP) to obtain coarse estimates of the time of arrival (ToA) and angle of departure (AoD) under the far-field approximation. Subsequently, distances are estimated using $l_{1}$-regularization based on a near-field model. Additionally, we introduce a refinement phase employing the spatial alternating generalized expectation maximization (SAGE) algorithm. Finally, a weighted least squares approach is applied to convert channel parameters into position and clock offset estimates. To extend the estimation algorithm to ultra-large (UL) RIS-assisted localization scenarios, it is further enhanced to reduce errors associated with far-field approximations, especially in the presence of significant near-field effects, achieved by narrowing the RIS aperture. Moreover, the Cram\'er-Rao Bound (CRB) is derived and the RIS phase shifts are optimized to improve the positioning accuracy. Numerical results affirm the efficacy of the proposed estimation algorithm.


title: Reliable Spatial-Temporal Voxels For Multi-Modal Test-Time Adaptation

abstract: Multi-modal test-time adaptation (MM-TTA) is proposed to adapt models to an unlabeled target domain by leveraging the complementary multi-modal inputs in an online manner. Previous MM-TTA methods rely on predictions of cross-modal information in each input frame, while they ignore the fact that predictions of geometric neighborhoods within consecutive frames are highly correlated, leading to unstable predictions across time. To fulfill this gap, we propose ReLiable Spatial-temporal Voxels (Latte), an MM-TTA method that leverages reliable cross-modal spatial-temporal correspondences for multi-modal 3D segmentation. Motivated by the fact that reliable predictions should be consistent with their spatial-temporal correspondences, Latte aggregates consecutive frames in a slide window manner and constructs ST voxel to capture temporally local prediction consistency for each modality. After filtering out ST voxels with high ST entropy, Latte conducts cross-modal learning for each point and pixel by attending to those with reliable and consistent predictions among both spatial and temporal neighborhoods. Experimental results show that Latte achieves state-of-the-art performance on three different MM-TTA benchmarks compared to previous MM-TTA or TTA methods.


title: Towards the Uncharted: Density-Descending Feature Perturbation for Semi-supervised Semantic Segmentation

abstract: Semi-supervised semantic segmentation allows model to mine effective supervision from unlabeled data to complement label-guided training. Recent research has primarily focused on consistency regularization techniques, exploring perturbation-invariant training at both the image and feature levels. In this work, we proposed a novel feature-level consistency learning framework named Density-Descending Feature Perturbation (DDFP). Inspired by the low-density separation assumption in semi-supervised learning, our key insight is that feature density can shed a light on the most promising direction for the segmentation classifier to explore, which is the regions with lower density. We propose to shift features with confident predictions towards lower-density regions by perturbation injection. The perturbed features are then supervised by the predictions on the original features, thereby compelling the classifier to explore less dense regions to effectively regularize the decision boundary. Central to our method is the estimation of feature density. To this end, we introduce a lightweight density estimator based on normalizing flow, allowing for efficient capture of the feature density distribution in an online manner. By extracting gradients from the density estimator, we can determine the direction towards less dense regions for each feature. The proposed DDFP outperforms other designs on feature-level perturbations and shows state of the art performances on both Pascal VOC and Cityscapes dataset under various partition protocols. The project is available at https://github.com/Gavinwxy/DDFP.


title: A prediction-based forward-looking vehicle dispatching strategy for dynamic ride-pooling

abstract: For on-demand dynamic ride-pooling services, e.g., Uber Pool and Didi Pinche, a well-designed vehicle dispatching strategy is crucial for platform profitability and passenger experience. Most existing dispatching strategies overlook incoming pairing opportunities, therefore suffer from short-sighted limitations. In this paper, we propose a forward-looking vehicle dispatching strategy, which first predicts the expected distance saving that could be brought about by future orders and then solves a bipartite matching problem based on the prediction to match passengers with partially occupied or vacant vehicles or keep passengers waiting for next rounds of matching. To demonstrate the performance of the proposed strategy, a number of simulation experiments and comparisons are conducted based on the real-world road network and historical trip data from Haikou, China. Results show that the proposed strategy outperform the baseline strategies by generating approximately 31\% more distance saving and 18\% less average passenger detour distance. It indicates the significant benefits of considering future pairing opportunities in dispatching, and highlights the effectiveness of our innovative forward-looking vehicle dispatching strategy in improving system efficiency and user experience for dynamic ride-pooling services.


title: Cross-Diffusion Theory for Overcrowding Dispersal in Interacting Species System

abstract: This work introduces a new class of cross-diffusion systems for studying overcrowding dispersal of two species. The approach, based on proximal minimization energy through a minimum flow process, offers a potential generalization of existing segregation models. Unlike prior methods using PDEs or $W_2$-Wasserstein flows, it establishes a well-posed PDE framework for capturing the interplay between diffusion and concentration gradients. This framework has the potential to significantly improve our understanding of how cross-diffusion shapes spatial patterns, coexistence, and overall distribution of multiple species. Notably, for homogeneous cases, the approach definitely leads to a well-defined PDE grounded in a new general $H^{-1}$-theory specifically developed for overcrowding dispersal. This theory provides a robust foundation for further analysis.


title: RecAI: Leveraging Large Language Models for Next-Generation Recommender Systems

abstract: This paper introduces RecAI, a practical toolkit designed to augment or even revolutionize recommender systems with the advanced capabilities of Large Language Models (LLMs). RecAI provides a suite of tools, including Recommender AI Agent, Recommendation-oriented Language Models, Knowledge Plugin, RecExplainer, and Evaluator, to facilitate the integration of LLMs into recommender systems from multifaceted perspectives. The new generation of recommender systems, empowered by LLMs, are expected to be more versatile, explainable, conversational, and controllable, paving the way for more intelligent and user-centric recommendation experiences. We hope the open-source of RecAI can help accelerate evolution of new advanced recommender systems. The source code of RecAI is available at \url{https://github.com/microsoft/RecAI}.


title: RL-MSA: a Reinforcement Learning-based Multi-line bus Scheduling Approach

abstract: Multiple Line Bus Scheduling Problem (MLBSP) is vital to save operational cost of bus company and guarantee service quality for passengers. Existing approaches typically generate a bus scheduling scheme in an offline manner and then schedule buses according to the scheme. In practice, uncertain events such as traffic congestion occur frequently, which may make the pre-determined bus scheduling scheme infeasible. In this paper, MLBSP is modeled as a Markov Decision Process (MDP). A Reinforcement Learning-based Multi-line bus Scheduling Approach (RL-MSA) is proposed for bus scheduling at both the offline and online phases. At the offline phase, deadhead decision is integrated into bus selection decision for the first time to simplify the learning problem. At the online phase, deadhead decision is made through a time window mechanism based on the policy learned at the offline phase. We develop several new and useful state features including the features for control points, bus lines and buses. A bus priority screening mechanism is invented to construct bus-related features. Considering the interests of both the bus company and passengers, a reward function combining the final reward and the step-wise reward is devised. Experiments at the offline phase demonstrate that the number of buses used of RL-MSA is decreased compared with offline optimization approaches. At the online phase, RL-MSA can cover all departure times in a timetable (i.e., service quality) without increasing the number of buses used (i.e., operational cost).


title: Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategy

abstract: Recently, state space model (SSM) has gained great attention due to its promising performance, linear complexity, and long sequence modeling ability in both language and image domains. However, it is non-trivial to extend SSM to the point cloud field, because of the causality requirement of SSM and the disorder and irregularity nature of point clouds. In this paper, we propose a novel SSM-based point cloud processing backbone, named Point Mamba, with a causality-aware ordering mechanism. To construct the causal dependency relationship, we design an octree-based ordering strategy on raw irregular points, globally sorting points in a z-order sequence and also retaining their spatial proximity. Our method achieves state-of-the-art performance compared with transformer-based counterparts, with 93.4% accuracy and 75.7 mIOU respectively on the ModelNet40 classification dataset and ScanNet semantic segmentation dataset. Furthermore, our Point Mamba has linear complexity, which is more efficient than transformer-based methods. Our method demonstrates the great potential that SSM can serve as a generic backbone in point cloud understanding. Codes are released at https://github.com/IRMVLab/Point-Mamba.


title: Generators for the Algebra of Symmetric Functions

abstract: The algebra of symmetric functions contains several interesting families of symmetric functions indexed by integer partitions or skew partitions. Given a sequence $\{u_n\}$ of symmetric functions taken from one of these families such that $u_n$ is homogeneous of degree $n$, we provide necessary and sufficient conditions for the sequence to form a system of algebraically independent generators for the algebra of symmetric functions.


title: Nonleptonic three-body charmed baryon weak decays with H(15)

abstract: We study the nonleptonic three-body charmed baryon weak decays of $\mathbf{B}_{c}\rightarrow\mathbf{B}_{n}PP^{\prime}$ under the $SU(3)_{F}$ flavor symmetry, where $\mathbf{B}_{c}$ denotes the anti-triplet charmed baryon, comprising $(\Xi^{0}_{c},-\Xi^{+}_{c},\Lambda^{+}_{c})$, and $\mathbf{B}_{n}$ and $P(P^{\prime})$ represent octet baryon and pseudoscalar meson states, respectively. In addition to 12 parameters from the contributions of the color-antisymmetric part of the effective Hamiltonian, denoted as $H(\bar{\mathbf{6}})$, there are 4 parameters from the color-symmetric one, $H(\mathbf{15})$, which were not included in the previous study. With 16 parameters in total and 28 experimental data points, we obtain the minimal $\chi^2$ over degree of freedom of $\chi^{2}/d.o.f=1.5$, which is a great improvement comparing to that without $H(\mathbf{15})$. With the better fitting values, we evaluate the branching ratios and up-down asymmetries of $\mathbf{B}_{c}\rightarrow\mathbf{B}_{n}PP^{\prime}$, which present some interesting results such as $\mathcal{B}\,(\Lambda^{+}_{c}\rightarrow(\Xi(1690)^{0}\rightarrow\Sigma^{+}K^{-})\,K^{+})\equiv(1.5\pm0.4)\times10^{-3}$ and potential $SU(3)$ breaking effects in $\Xi^{+}_{c}\rightarrow p\pi^{+}K^{-}$ and $\Lambda^{+}_{c}\rightarrow \Sigma^{+}\pi^{-}K^{+}$ to be verified by the experiments at BESIII, Belle-II and LHCb.


title: 3D-aware Image Generation and Editing with Multi-modal Conditions

abstract: 3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing methods suffer from poor disentanglement performance of shape and appearance, and lack multi-modal control. In this paper, we propose a novel end-to-end 3D-aware image generation and editing model incorporating multiple types of conditional inputs, including pure noise, text and reference image. On the one hand, we dive into the latent space of 3D Generative Adversarial Networks (GANs) and propose a novel disentanglement strategy to separate appearance features from shape features during the generation process. On the other hand, we propose a unified framework for flexible image generation and editing tasks with multi-modal conditions. Our method can generate diverse images with distinct noises, edit the attribute through a text description and conduct style transfer by giving a reference RGB image. Extensive experiments demonstrate that the proposed method outperforms alternative approaches both qualitatively and quantitatively on image generation and editing.


title: Toward Robust Canine Cardiac Diagnosis: Deep Prototype Alignment Network-Based Few-Shot Segmentation in Veterinary Medicine

abstract: In the cutting-edge domain of medical artificial intelligence (AI), remarkable advances have been achieved in areas such as diagnosis, prediction, and therapeutic interventions. Despite these advances, the technology for image segmentation faces the significant barrier of having to produce extensively annotated datasets. To address this challenge, few-shot segmentation (FSS) has been recognized as one of the innovative solutions. Although most of the FSS research has focused on human health care, its application in veterinary medicine, particularly for pet care, remains largely limited. This study has focused on accurate segmentation of the heart and left atrial enlargement on canine chest radiographs using the proposed deep prototype alignment network (DPANet). The PANet architecture is adopted as the backbone model, and experiments are conducted using various encoders based on VGG-19, ResNet-18, and ResNet-50 to extract features. Experimental results demonstrate that the proposed DPANet achieves the highest performance. In the 2way-1shot scenario, it achieves the highest intersection over union (IoU) value of 0.6966, and in the 2way-5shot scenario, it achieves the highest IoU value of 0.797. The DPANet not only signifies a performance improvement, but also shows an improved training speed in the 2way-5shot scenario. These results highlight our model's exceptional capability as a trailblazing solution for segmenting the heart and left atrial enlargement in veterinary applications through FSS, setting a new benchmark in veterinary AI research, and demonstrating its superior potential to veterinary medicine advances.


title: What is a proper definition of spin current? -- Lessons from the Kane-Mele Model

abstract: Spin current, a key concept in spintronics that carries spin angular momentum, has a non-unique definition due to the non-conservation of spins in solids. While two primary definitions exist -- conventional spin current and conserved spin current -- their validity has not been quantitatively examined. Here, we examine the validity of these definitions of spin current by comparing their spin Hall conductivities to the spin accumulation on edges of materials calculated in a real-time evolution simulation. Employing the Kane-Mele model with the Rashba term, which explicitly violates spin conservation, we reveal that the spin Hall conductivities calculated under both definitions fail to reproduce the simulated results of spin accumulation when the Rashba term is large. Our results suggest that the standard definitions of spin current and the associated spin Hall conductivity do not give an accurate quantitative estimate of spin accumulation. This conclusion indicates that real-time simulations are necessary to accurately estimate spin accumulation on edges/surfaces of materials.


title: Spectroscopic Searches for Evolutionary Orbital Period Changes in WR+OB Binaries: the Case of WR 127 (Hen 3-1772)

abstract: We aim at searching for secular evolution of the orbital period in the short-period binary system WR 127 (WN3b+O9.5V, $P = 9.555^d$). We performed new low-resolution spectroscopic observations of WR 127 on 2.5-m CMO SAI telescope to construct the radial velocity curves of the components suggesting the component masses $M_\mathrm{WR}\sin^3(i) = 11.8\pm1.4$ $M_{\odot}$, $M_\mathrm{O}\sin^3(i)=17.2\pm1.4$ $M_{\odot}$. The comparison with archival radial velocity curves enabled us to calculate the $(O-C)$ plot with accuracy sufficient to search for the orbital period change in WR 127. We report on the reliable detection of a secular increase in the orbital period of WR 127 at a rate of $\dot{P} = 0.83\pm0.14~\mbox{s~yr}^{-1}$ corresponding to the dynamical mass-loss rate from the WR star $\dot{M}_\mathrm{WR} = (2.6\pm0.5)\times 10^{-5}$ $M_{\odot}$ yr$^{-1}$. The mass-loss rate from WR stars in three WR+OB binaries (WR 127, CX Cep and V444 Cyg) as inferred from spectroscopic and photometric measurements suggests a preliminary empirical correlation between the WR star mass and the dynamical mass-loss rate $\dot M_\mathrm{WR}\sim M_\mathrm{WR}^{1.8}$. This relation is important for the understanding of the evolution of massive close binaries with WR stars -- precursors of gravitational-wave binary merging events with neutron stars and black holes.


title: Non-Intrusive Load Monitoring in Smart Grids: A Comprehensive Review

abstract: Non-Intrusive Load Monitoring (NILM) is pivotal in today's energy landscape, offering vital solutions for energy conservation and efficient management. Its growing importance in enhancing energy savings and understanding consumer behavior makes it a pivotal technology for addressing global energy challenges. This paper delivers an in-depth review of NILM, highlighting its critical role in smart homes and smart grids. The significant contributions of this study are threefold: Firstly, it compiles a comprehensive global dataset table, providing a valuable tool for researchers and engineers to select appropriate datasets for their NILM studies. Secondly, it categorizes NILM approaches, simplifying the understanding of various algorithms by focusing on technologies, label data requirements, feature usage, and monitoring states. Lastly, by identifying gaps in current NILM research, this work sets a clear direction for future studies, discussing potential areas of innovation.


title: Relative velocities between $^{13}$CO structures within $^{12}$CO Molecular clouds

abstract: Velocity fields of molecular clouds (MCs) can provide crucial information on the merger and split between clouds, as well as their internal kinematics and maintenance, energy injection and redistribution, even star formation within clouds. Using the CO spectral lines data from the Milky Way Imaging Scroll Painting (MWISP) survey, we measure the relative velocities along the line of sight ($\Delta$V$_{\rm LOS}$) between $^{13}$CO structures within $^{12}$CO MCs. Emphasizing MCs with double and triple $^{13}$CO structures, we find that approximately 70$\%$ of $\Delta$V$_{\rm LOS}$ values are less than $\sim$ 1 km s$^{-1}$, and roughly 10$\%$ of values exceed 2 km s$^{-1}$, with a maximum of $\sim$ 5 km s$^{-1}$. Additionally, we compare $\Delta$V$_{\rm LOS}$ with the internal velocity dispersion of $^{13}$CO structures ($\sigma_{\rm ^{13}CO,in}$) and find that about 40$\%$ of samples in either double or triple regime display distinct velocity discontinuities, i.e. the relative velocities between $^{13}$CO structures are larger than the internal linewidths of $^{13}$CO structures. Among these 40$\%$ samples in the triple regime, 33$\%$ exhibit signatures of combinations through the two-body motion, whereas the remaining 7$\%$ show features of configurations through the multiple-body motion. The $\Delta$V$_{\rm LOS}$ distributions for MCs with double and triple $^{13}$CO structures are similar, as well as their $\Delta$V$_{\rm LOS}$/$\sigma_{\rm ^{13}CO,in}$ distributions. This suggests that relative motions of $^{13}$CO structures within MCs are random and independent of cloud complexities and scales.


title: $^{27}$Al NMR study of the magnetic Weyl semimetal CeAlGe

abstract: Motivated by the recent observations of electronic correlation effect [M. Corasaniti \textit{et al}., Phys. Rev. B \textbf{104}, L121112 (2021)] and topology-stabilized magnetic fluctuations [N. Drucker \textit{et al}., Nat. Commun. \textbf{14}, 5182 (2023)] in the noncentrosymmetric magnetic Weyl semimetal candidate CeAlGe, we performed systematic studies on the local static and dynamic spin susceptibilities by $^{27}$Al nuclear magnetic resonance. Due to the large spin susceptibility from Ce-$4f$ electrons, the theoretically predicted responses from Weyl fermions are overwhelmed. A Knight-shift anomaly is observed below $T^*\sim50$ K, a signature of the onset of coherent Kondo coupling. In addition, an anomalous peak is found in $1/T_1T$ near 15 K, well above the magnetic ordering temperature $T_N \approx 5$ K, which probably is a consequence of topology-stabilized magnetic fluctuations. These results highlight the interplay among electronic correlation, magnetism and band topology in this family of Kondo Weyl semimetals.


title: Hyers-Ulam Stability of Unbounded Closable Operators in Hilbert Spaces

abstract: In this paper, we discuss the Hyers-Ulam stability of closable (unbounded) operators with several interesting examples. We also present results pertaining to the Hyers-Ulam stability of the sum and product of closable operators to have the Hyers-Ulam stability and the necessary and sufficient conditions of the Schur complement and the quadratic complement of $2 \times 2$ block matrix $\mathcal A$ in order to have the Hyers-Ulam stability.


title: AGAThA: Fast and Efficient GPU Acceleration of Guided Sequence Alignment for Long Read Mapping

abstract: With the advance in genome sequencing technology, the lengths of deoxyribonucleic acid (DNA) sequencing results are rapidly increasing at lower prices than ever. However, the longer lengths come at the cost of a heavy computational burden on aligning them. For example, aligning sequences to a human reference genome can take tens or even hundreds of hours. The current de facto standard approach for alignment is based on the guided dynamic programming method. Although this takes a long time and could potentially benefit from high-throughput graphic processing units (GPUs), the existing GPU-accelerated approaches often compromise the algorithm's structure, due to the GPU-unfriendly nature of the computational pattern. Unfortunately, such compromise in the algorithm is not tolerable in the field, because sequence alignment is a part of complicated bioinformatics analysis pipelines. In such circumstances, we propose AGAThA, an exact and efficient GPU-based acceleration of guided sequence alignment. We diagnose and address the problems of the algorithm being unfriendly to GPUs, which comprises strided/redundant memory accesses and workload imbalances that are difficult to predict. According to the experiments on modern GPUs, AGAThA achieves 18.8$\times$ speedup against the CPU-based baseline, 9.6$\times$ against the best GPU-based baseline, and 3.6$\times$ against GPU-based algorithms with different heuristics.


title: Ada-Tracker: Soft Tissue Tracking via Inter-Frame and Adaptive-Template Matching

abstract: Soft tissue tracking is crucial for computer-assisted interventions. Existing approaches mainly rely on extracting discriminative features from the template and videos to recover corresponding matches. However, it is difficult to adopt these techniques in surgical scenes, where tissues are changing in shape and appearance throughout the surgery. To address this problem, we exploit optical flow to naturally capture the pixel-wise tissue deformations and adaptively correct the tracked template. Specifically, we first implement an inter-frame matching mechanism to extract a coarse region of interest based on optical flow from consecutive frames. To accommodate appearance change and alleviate drift, we then propose an adaptive-template matching method, which updates the tracked template based on the reliability of the estimates. Our approach, Ada-Tracker, enjoys both short-term dynamics modeling by capturing local deformations and long-term dynamics modeling by introducing global temporal compensation. We evaluate our approach on the public SurgT benchmark, which is generated from Hamlyn, SCARED, and Kidney boundary datasets. The experimental results show that Ada-Tracker achieves superior accuracy and performs more robustly against prior works. Code is available at https://github.com/wrld/Ada-Tracker.


title: SFT covers for actions of the first Grigorchuk group

abstract: We study symbolic dynamical representations of actions of the first Grigorchuk group $G$, namely its action on the boundary of the infinite rooted binary tree, its representation in the topological full group of a minimal substitutive $\mathbb{Z}$-shift, and its representation as a minimal system of Schreier graphs. We show that the first system admits an SFT cover, and the latter two systems are conjugate to sofic subshifts on $G$, but are not of finite type.


title: Classical action for the height within the Kardar-Parisi-Zhang (KPZ) equation for surface growth

abstract: In this work we write down a classical (not quantum) action for the surface height for the Kardar-Parisi-Zhang (KPZ) equation for surface growth. We do so starting with the regular Martin-Siggia-Rose (MSR) action (which is quantum - contains the constraint field) and integrate out the quantum constraint field exactly. We analyze the classical action, we thereby obtain, within the gaussian and one loop approximations various instabilities to rough surfaces. The gaussian analysis predicts instabilities to rough surfaces below two dimensions while one loop analysis predicts stronger surface stability to roughness and instabilities to roughness below one dimension rather than two dimensions. The one loop analysis shows that the KPZ action is incomplete and that we generate additional terms (not found in the initial classical action) in the action perturbatively. In the supplement we also modify the KPZ equation for growing surfaces to include the effect of surface tilt on the noise (that is have two sources of noise one of which is multiplicatively coupled noise).


title: Financial Default Prediction via Motif-preserving Graph Neural Network with Curriculum Learning

abstract: User financial default prediction plays a critical role in credit risk forecasting and management. It aims at predicting the probability that the user will fail to make the repayments in the future. Previous methods mainly extract a set of user individual features regarding his own profiles and behaviors and build a binary-classification model to make default predictions. However, these methods cannot get satisfied results, especially for users with limited information. Although recent efforts suggest that default prediction can be improved by social relations, they fail to capture the higher-order topology structure at the level of small subgraph patterns. In this paper, we fill in this gap by proposing a motif-preserving Graph Neural Network with curriculum learning (MotifGNN) to jointly learn the lower-order structures from the original graph and higherorder structures from multi-view motif-based graphs for financial default prediction. Specifically, to solve the problem of weak connectivity in motif-based graphs, we design the motif-based gating mechanism. It utilizes the information learned from the original graph with good connectivity to strengthen the learning of the higher-order structure. And considering that the motif patterns of different samples are highly unbalanced, we propose a curriculum learning mechanism on the whole learning process to more focus on the samples with uncommon motif distributions. Extensive experiments on one public dataset and two industrial datasets all demonstrate the effectiveness of our proposed method.


title: The negation of permutation mass function

abstract: Negation is an important perspective of knowledge representation. Existing negation methods are mainly applied in probability theory, evidence theory and complex evidence theory. As a generalization of evidence theory, random permutation sets theory may represent information more precisely. However, how to apply the concept of negation to random permutation sets theory has not been studied. In this paper, the negation of permutation mass function is proposed. Moreover, in the negation process, the convergence of proposed negation method is verified. The trends of uncertainty and dissimilarity after each negation operation are investigated. Numerical examples are used to demonstrate the rationality of the proposed method.


title: Technical Debt Management: The Road Ahead for Successful Software Delivery

abstract: Technical Debt, considered by many to be the 'silent killer' of software projects, has undeniably become part of the everyday vocabulary of software engineers. We know it compromises the internal quality of a system, either deliberately or inadvertently. We understand Technical Debt is not all derogatory, often serving the purpose of expediency. But, it is associated with a clear risk, especially for large and complex systems with extended service life: if we do not properly manage Technical Debt, it threatens to "bankrupt" those systems. Software engineers and organizations that develop software-intensive systems are facing an increasingly more dire future state of those systems if they do not start incorporating Technical Debt management into their day to day practice. But how? What have the wins and losses of the past decade of research and practice in managing Technical Debt taught us and where should we focus next? In this paper, we examine the state of the art in both industry and research communities in managing Technical Debt; we subsequently distill the gaps in industrial practice and the research shortcomings, and synthesize them to define and articulate a vision for what Technical Debt management looks like five years hence.


title: Knowledge-aware Alert Aggregation in Large-scale Cloud Systems: a Hybrid Approach

abstract: Due to the scale and complexity of cloud systems, a system failure would trigger an "alert storm", i.e., massive correlated alerts. Although these alerts can be traced back to a few root causes, the overwhelming number makes it infeasible for manual handling. Alert aggregation is thus critical to help engineers concentrate on the root cause and facilitate failure resolution. Existing methods typically utilize semantic similarity-based methods or statistical methods to aggregate alerts. However, semantic similarity-based methods overlook the causal rationale of alerts, while statistical methods can hardly handle infrequent alerts. To tackle these limitations, we introduce leveraging external knowledge, i.e., Standard Operation Procedure (SOP) of alerts as a supplement. We propose COLA, a novel hybrid approach based on correlation mining and LLM (Large Language Model) reasoning for online alert aggregation. The correlation mining module effectively captures the temporal and spatial relations between alerts, measuring their correlations in an efficient manner. Subsequently, only uncertain pairs with low confidence are forwarded to the LLM reasoning module for detailed analysis. This hybrid design harnesses both statistical evidence for frequent alerts and the reasoning capabilities of computationally intensive LLMs, ensuring the overall efficiency of COLA in handling large volumes of alerts in practical scenarios. We evaluate COLA on three datasets collected from the production environment of a large-scale cloud platform. The experimental results show COLA achieves F1-scores from 0.901 to 0.930, outperforming state-of-the-art methods and achieving comparable efficiency. We also share our experience in deploying COLA in our real-world cloud system, Cloud X.


title: Unified theory for frequency combs in ring and Fabry-Perot quantum cascade lasers: an order-parameter equation approach

abstract: We present a unified model to describe the dynamics of optical frequency combs (OFCs) in quantum cascade lasers (QCLs), incorporating both ring and Fabry-P\'erot (FP) cavity configurations. The model derives a modified complex Ginzburg-Landau equation (CGLE), leveraging an order parameter approach and is capable of capturing the dynamics of both configurations, thus enabling a comparative analysis. In the modified CGLE, a nonlinear integral term appears which is associated with the coupling between counterpropagating fields in the FP cavity and whose suppression yields the ring model, which is known to be properly described by a conventional CGLE. We show that this crucial term holds a key role in inhibiting the formation of harmonic frequency combs (HFCs), associated to multi-peaked localized structures, due to its anti-patterning effect. We provide in support a comprehensive campaign of numerical simulations, in which we observe a higher occurrence of HFCs in the ring configuration compared to the FP case. Furthermore, the simulations demonstrate the model's capability to reproduce experimental observations, including the coexistence of amplitude and frequency modulation, linear chirp, and typical dynamic scenarios observed in QCLs. Finally, we perform a linear stability analysis of the single-mode solution for the ring case, confirming its consistency with numerical simulations and highlighting its predictive power regarding the formation of harmonic combs.


title: Multilingual Turn-taking Prediction Using Voice Activity Projection

abstract: This paper investigates the application of voice activity projection (VAP), a predictive turn-taking model for spoken dialogue, on multilingual data, encompassing English, Mandarin, and Japanese. The VAP model continuously predicts the upcoming voice activities of participants in dyadic dialogue, leveraging a cross-attention Transformer to capture the dynamic interplay between participants. The results show that a monolingual VAP model trained on one language does not make good predictions when applied to other languages. However, a multilingual model, trained on all three languages, demonstrates predictive performance on par with monolingual models across all languages. Further analyses show that the multilingual model has learned to discern the language of the input signal. We also analyze the sensitivity to pitch, a prosodic cue that is thought to be important for turn-taking. Finally, we compare two different audio encoders, contrastive predictive coding (CPC) pre-trained on English, with a recent model based on multilingual wav2vec 2.0 (MMS).


title: Query-guided Prototype Evolution Network for Few-Shot Segmentation

abstract: Previous Few-Shot Segmentation (FSS) approaches exclusively utilize support features for prototype generation, neglecting the specific requirements of the query. To address this, we present the Query-guided Prototype Evolution Network (QPENet), a new method that integrates query features into the generation process of foreground and background prototypes, thereby yielding customized prototypes attuned to specific queries. The evolution of the foreground prototype is accomplished through a \textit{support-query-support} iterative process involving two new modules: Pseudo-prototype Generation (PPG) and Dual Prototype Evolution (DPE). The PPG module employs support features to create an initial prototype for the preliminary segmentation of the query image, resulting in a pseudo-prototype reflecting the unique needs of the current query. Subsequently, the DPE module performs reverse segmentation on support images using this pseudo-prototype, leading to the generation of evolved prototypes, which can be considered as custom solutions. As for the background prototype, the evolution begins with a global background prototype that represents the generalized features of all training images. We also design a Global Background Cleansing (GBC) module to eliminate potential adverse components mirroring the characteristics of the current foreground class. Experimental results on the PASCAL-$5^i$ and COCO-$20^i$ datasets attest to the substantial enhancements achieved by QPENet over prevailing state-of-the-art techniques, underscoring the validity of our ideas.


title: Graph Neural Network with Two Uplift Estimators for Label-Scarcity Individual Uplift Modeling

abstract: Uplift modeling aims to measure the incremental effect, which we call uplift, of a strategy or action on the users from randomized experiments or observational data. Most existing uplift methods only use individual data, which are usually not informative enough to capture the unobserved and complex hidden factors regarding the uplift. Furthermore, uplift modeling scenario usually has scarce labeled data, especially for the treatment group, which also poses a great challenge for model training. Considering that the neighbors' features and the social relationships are very informative to characterize a user's uplift, we propose a graph neural network-based framework with two uplift estimators, called GNUM, to learn from the social graph for uplift estimation. Specifically, we design the first estimator based on a class-transformed target. The estimator is general for all types of outcomes, and is able to comprehensively model the treatment and control group data together to approach the uplift. When the outcome is discrete, we further design the other uplift estimator based on our defined partial labels, which is able to utilize more labeled data from both the treatment and control groups, to further alleviate the label scarcity problem. Comprehensive experiments on a public dataset and two industrial datasets show a superior performance of our proposed framework over state-of-the-art methods under various evaluation metrics. The proposed algorithms have been deployed online to serve real-world uplift estimation scenarios.


title: Real eternal PDE solutions are not complex entire: a quadratic parabolic example

abstract: In parabolic or hyperbolic PDEs, solutions which remain uniformly bounded for all real times $t=r\in\mathbb{R}$ are often called PDE entire or eternal. For example, consider the quadratic parabolic PDE \begin{equation*} \label{*} w_t=w_{xx}+6w^2-\lambda, \tag{*} \end{equation*} for $0<x<\tfrac{1}{2}$, under Neumann boundary conditions. By its gradient-like structure, all real eternal non-equilibrium orbits $\Gamma(r)$ of \eqref{*} are heteroclinic among equilibria $w=W_n(x)$. All nontrivial real $W_n$ are rescaled and properly translated real-valued Weierstrass elliptic functions $W_n(x)=-n^2 \wp(nx+\tfrac{1}{2}\tau),\ n=1,2,3,\ldots$, with lattice periods 1 and the purely imaginary modular parameter $\tau$, and with Morse index $i(W_n)=n$ at $\lambda=\tfrac{1}{2}n^4 g_2(\tau)$. We show that the complex time extensions $\Gamma(r+\mathrm{i}s)$, of the real analytic heteroclinic orbits towards $W_0=-\sqrt{\lambda/6}$, are not complex entire. For any fixed real $r_0$, for example, consider the time-reversible complex-valued solution $\psi(s)$ of the nonlinear and nonconservative quadratic Schr\"odinger equation \begin{equation*} \label{**} \mathrm{i}\psi_s=\psi_{xx}+6\psi^2-\lambda \tag{**} \end{equation*} with real initial condition $\psi_0=\Gamma(r_0)$. Then there exist $r_0$ such that $\psi(s)$ blows up at some finite real times $\pm s^*$. Abstractly, our results are formulated in the setting of analytic semigroups. They are based on Poincar\'e non-resonance of unstable eigenvalues at equilibria $W_n$, near pitchfork bifurcation. Technically, we have to except a discrete set of $\lambda>0$, and are currently limited to unstable dimensions $n\leq22$, or to fast unstable manifolds of dimensions $d<1+\tfrac{1}{\sqrt{2}}n$.


title: Magnetic vortex polarity reversal induced gyrotropic motion spectrum splitting in a ferromagnetic disk

abstract: We investigate the gyrotropic motion of the magnetic vortex core in a chain of a few micron-sized Permalloy disks by electrical resistance measurement with amplitude-modulated magnetic field. We observe a distinctive splitting of the resistance peak due to the resonant vortex-core motion under heightened radio frequency (RF) magnetic field excitation. Our micromagnetic simulation identifies the splitting of the resonant peak as an outcome of vortex polarity reversal under substantial RF amplitudes. This study enhances our understanding of nonlinear magnetic vortex dynamics amidst large RF amplitudes and proposes a potential pathway for spintronic neural computing thanks to their unique and controllable magnetization dynamics.


title: On Asymptotically Almost Periodic Solutions of the parabolic-elliptic Keller-Segel system on real hyperbolic Manifolds

abstract: In this article we investigate the existence, uniqueness and exponential decay of asymptotically almost periodic solutions of the parabolic-elliptic Keller-Segel system on a real hyperbolic manifold. We prove the existence and uniqueness of such solutions in the linear equation case by using the dispersive and smoothing estimates of the heat semigroup. Then we pass to the well-posedness of semi-linear equation case by using the results of linear equation and fixed point arguments. The exponential decay is proven by using Gronwall's inequality.


title: A Lower bound for Secure Domination Number of an Outerplanar Graph

abstract: A subset $S$ of vertices in a graph $G$ is a secure dominating set of $G$ if $S$ is a dominating set of $G$ and, for each vertex $u \not\in S$, there is a vertex $v \in S$ such that $uv$ is an edge and $(S \setminus \{v\}) \cup \{u\}$ is also a dominating set of $G$. The secure domination number of $G$, denoted by $\gamma_{s}(G)$, is the cardinality of a smallest secure dominating sets of $G$. In this paper, we prove that for any outerplanar graph with $n \geq 4$ vertices, $\gamma_{s}(G) \geq (n+4)/5$ and the bound is tight.


title: An Efficient Solution to the 2D Visibility Problem in Cartesian Grid Maps and its Application in Heuristic Path Planning

abstract: This paper introduces a novel, lightweight method to solve the visibility problem for 2D grids. The proposed method evaluates the existence of lines-of-sight from a source point to all other grid cells in a single pass with no preprocessing and independently of the number and shape of obstacles. It has a compute and memory complexity of $\mathcal{O}(n)$, where $n = n_{x}\times{} n_{y}$ is the size of the grid, and requires at most ten arithmetic operations per grid cell. In the proposed approach, we use a linear first-order hyperbolic partial differential equation to transport the visibility quantity in all directions. In order to accomplish that, we use an entropy-satisfying upwind scheme that converges to the true visibility polygon as the step size goes to zero. This dynamic-programming approach allows the evaluation of visibility for an entire grid orders of magnitude faster than typical ray-casting algorithms. We provide a practical application of our proposed algorithm by posing the visibility quantity as a heuristic and implementing a deterministic, local-minima-free path planner, setting apart the proposed planner from traditional methods. Lastly, we provide necessary algorithms and an open-source implementation of the proposed methods.


title: Toward Generalist Anomaly Detection via In-context Residual Learning with Few-shot Sample Prompts

abstract: This paper explores the problem of Generalist Anomaly Detection (GAD), aiming to train one single detection model that can generalize to detect anomalies in diverse datasets from different application domains without any further training on the target data. Some recent studies have shown that large pre-trained Visual-Language Models (VLMs) like CLIP have strong generalization capabilities on detecting industrial defects from various datasets, but their methods rely heavily on handcrafted text prompts about defects, making them difficult to generalize to anomalies in other applications, e.g., medical image anomalies or semantic anomalies in natural images. In this work, we propose to train a GAD model with few-shot normal images as sample prompts for AD on diverse datasets on the fly. To this end, we introduce a novel approach that learns an in-context residual learning model for GAD, termed InCTRL. It is trained on an auxiliary dataset to discriminate anomalies from normal samples based on a holistic evaluation of the residuals between query images and few-shot normal sample prompts. Regardless of the datasets, per definition of anomaly, larger residuals are expected for anomalies than normal samples, thereby enabling InCTRL to generalize across different domains without further training. Comprehensive experiments on nine AD datasets are performed to establish a GAD benchmark that encapsulate the detection of industrial defect anomalies, medical anomalies, and semantic anomalies in both one-vs-all and multi-class setting, on which InCTRL is the best performer and significantly outperforms state-of-the-art competing methods. Code is available at https://github.com/mala-lab/InCTRL.


title: Are you sure? Modelling Drivers' Confidence Judgments in Left-Turn Gap Acceptance Decisions

abstract: When a person makes a decision, it is automatically accompanied by a subjective probability judgment of the decision being correct, in other words, a confidence judgment. A better understanding of the mechanisms responsible for these confidence judgments could provide novel insights into human behavior. However, so far confidence judgments have been mostly studied in simplistic laboratory tasks while little is known about confidence in naturalistic dynamic tasks such as driving. In this study, we made a first attempt of connecting fundamental research on confidence with naturalistic driver behavior. We investigated the confidence of drivers in left-turn gap acceptance decisions in a driver simulator experiment (N=17). We found that confidence in these decisions depends on the size of the gap to the oncoming vehicle. Specifically, confidence increased with the gap size for trials in which the gap was accepted, and decreased with the gap size for rejected gaps. Similarly to more basic tasks, confidence was negatively related to the response times and correlated with action dynamics during decision execution. Finally, we found that confidence judgments can be captured with an extended dynamic drift-diffusion model. In the model, the drift rate of the evidence accumulator as well as the decision boundaries are functions of the gap size. Furthermore, we demonstrated that allowing for post-decision evidence accumulation in the model increases its ability to describe confidence judgments in rejected gap decisions. Overall, our study confirmed that principles known from fundamental confidence research extend to confidence judgments in dynamic decisions during a naturalistic task.


title: QuantTune: Optimizing Model Quantization with Adaptive Outlier-Driven Fine Tuning

abstract: Transformer-based models have gained widespread popularity in both the computer vision (CV) and natural language processing (NLP) fields. However, significant challenges arise during post-training linear quantization, leading to noticeable reductions in inference accuracy. Our study focuses on uncovering the underlying causes of these accuracy drops and proposing a quantization-friendly fine-tuning method, \textbf{QuantTune}. Firstly, our analysis revealed that, on average, 65\% of quantization errors result from the precision loss incurred by the dynamic range amplification effect of outliers across the target Transformer-based models. Secondly, \textbf{QuantTune} adjusts weights based on the deviation of outlier activations and effectively constrains the dynamic ranges of the problematic activations. As a result, it successfully mitigates the negative impact of outliers on the inference accuracy of quantized models. Lastly, \textbf{QuantTune} can be seamlessly integrated into the back-propagation pass in the fine-tuning process without requiring extra complexity in inference software and hardware design. Our approach showcases significant improvements in post-training quantization across a range of Transformer-based models, including ViT, Bert-base, and OPT. QuantTune reduces accuracy drops by 12.09\% at 8-bit quantization and 33.8\% at 7-bit compared to top calibration methods, outperforming state-of-the-art solutions by over 18.84\% across ViT models.


title: Incorporating Improved Sinusoidal Threshold-based Semi-supervised Method and Diffusion Models for Osteoporosis Diagnosis

abstract: Osteoporosis is a common skeletal disease that seriously affects patients' quality of life. Traditional osteoporosis diagnosis methods are expensive and complex. The semi-supervised model based on diffusion model and class threshold sinusoidal decay proposed in this paper can automatically diagnose osteoporosis based on patient's imaging data, which has the advantages of convenience, accuracy, and low cost. Unlike previous semi-supervised models, all the unlabeled data used in this paper are generated by the diffusion model. Compared with real unlabeled data, synthetic data generated by the diffusion model show better performance. In addition, this paper proposes a novel pseudo-label threshold adjustment mechanism, Sinusoidal Threshold Decay, which can make the semi-supervised model converge more quickly and improve its performance. Specifically, the method is tested on a dataset including 749 dental panoramic images, and its achieved leading detect performance and produces a 80.10% accuracy.


title: Detection of Unobserved Common Causes based on NML Code in Discrete, Mixed, and Continuous Variables

abstract: Causal discovery in the presence of unobserved common causes from observational data only is a crucial but challenging problem. We categorize all possible causal relationships between two random variables into the following four categories and aim to identify one from observed data: two cases in which either of the direct causality exists, a case that variables are independent, and a case that variables are confounded by latent confounders. Although existing methods have been proposed to tackle this problem, they require unobserved variables to satisfy assumptions on the form of their equation models. In our previous study (Kobayashi et al., 2022), the first causal discovery method without such assumptions is proposed for discrete data and named CLOUD. Using Normalized Maximum Likelihood (NML) Code, CLOUD selects a model that yields the minimum codelength of the observed data from a set of model candidates. This paper extends CLOUD to apply for various data types across discrete, mixed, and continuous. We not only performed theoretical analysis to show the consistency of CLOUD in terms of the model selection, but also demonstrated that CLOUD is more effective than existing methods in inferring causal relationships by extensive experiments on both synthetic and real-world data.


title: Topological transport of a classical droplet in a lattice of time

abstract: Thouless charge pumps are quantum mechanical devices whose operation relies on topology. They provide the means for transporting quantum matter in space lattices with a single quantum precision. Contrasting space crystals that spontaneously break a continuous spatial translation symmetry and form crystals in space,time crystals have emerged as novel states of matter that organize into time lattices and spontaneously break a discrete time translation symmetry. The utility of Thouless pumps that enable topologically protected quantised transport of electrons and neutral atoms in spatial superlattices leads to the question if corresponding devices exist for time crystals? Here we show that topological pumps can be realized for time solids by transporting droplets of a liquid forward and backward in time lattices and we measure the topological index that characterises such pumping processes. By exploiting a synthetic time dimension classical time crystals can circumvent the quantum tunneling that underpins Thouless charge pumps. Our results establish topological pumping through time instead of space and pave the way for applications of time crystals.

categories: cond-mat.mes-hall cond-mat.quant-gas physics.flu-dyn quant-ph