title: Benchmarking Image Transformers for Prostate Cancer Detection from Ultrasound Data

abstract: PURPOSE: Deep learning methods for classifying prostate cancer (PCa) in ultrasound images typically employ convolutional networks (CNNs) to detect cancer in small regions of interest (ROI) along a needle trace region. However, this approach suffers from weak labelling, since the ground-truth histopathology labels do not describe the properties of individual ROIs. Recently, multi-scale approaches have sought to mitigate this issue by combining the context awareness of transformers with a CNN feature extractor to detect cancer from multiple ROIs using multiple-instance learning (MIL). In this work, we present a detailed study of several image transformer architectures for both ROI-scale and multi-scale classification, and a comparison of the performance of CNNs and transformers for ultrasound-based prostate cancer classification. We also design a novel multi-objective learning strategy that combines both ROI and core predictions to further mitigate label noise. METHODS: We evaluate 3 image transformers on ROI-scale cancer classification, then use the strongest model to tune a multi-scale classifier with MIL. We train our MIL models using our novel multi-objective learning strategy and compare our results to existing baselines. RESULTS: We find that for both ROI-scale and multi-scale PCa detection, image transformer backbones lag behind their CNN counterparts. This deficit in performance is even more noticeable for larger models. When using multi-objective learning, we can improve performance of MIL, with a 77.9% AUROC, a sensitivity of 75.9%, and a specificity of 66.3%. CONCLUSION: Convolutional networks are better suited for modelling sparse datasets of prostate ultrasounds, producing more robust features than transformers in PCa detection. Multi-scale methods remain the best architecture for this task, with multi-objective learning presenting an effective way to improve performance.


title: Study of 26 Galactic open clusters with extended main-sequence turnoffs

abstract: Recent studies indicate that some Galactic open clusters (OCs) exhibit extended main-sequence turnoff (eMSTO) in their colour-magnitude diagrams (CMDs). However, the number of Galactic OCs with eMSTO structures detected so far is limited, and the reasons for their formation are still unclear. This work identifies 26 Galactic OCs with undiscovered eMSTOs and investigates the causes of these features. Stellar population types and fundamental parameters of cluster samples are acquired using CMD fitting methods. Among them, the results of 11 OCs are reliable as the observed CMDs are well-reproduced. We propose the crucial role of stellar binarity and confirm the importance of stellar rotation in reproducing eMSTO morphologies. The results also show that the impact of age spread is important, as it can adequately explain the structure of young OCs and fit the observed CMDs of intermediate-age OCs better.


title: An Execution-time-certified QP Algorithm for $\ell_1$ penalty-based Soft-constrained MPC

abstract: Providing an execution time certificate and handling possible infeasibility in closed-loop are two pressing requirements of Model Predictive Control (MPC). To simultaneously meet these two requirements, this paper uses an $\ell_1$ penalty-based soft-constrained MPC formulation and innovatively transforms the resulting non-smooth QP into a box-constrained QP, which is solved by our previously proposed direct and execution-time certified algorithm with only dimension-dependent (data-independent), simple-calculated and exact number of iterations (Wu and Braatz (2023)). This approach not only overcomes the limitation of our previously proposed algorithm (Wu and Braatz (2023)), only applicable to input-constrained MPC, but also enjoys exact recovery feature (exactly recover the same solution when the original problem is feasible) of $\ell_1$ penalty-based soft-constrained MPC formulation without suffering numerical difficulty of the resulting non-smoothness. Other various real-time QP applications, not limited to MPC, would also benefit from our QP algorithm with execution-time certificate and global feasibility.


title: Multi-AGV Path Planning Method via Reinforcement Learning and Particle Filters

abstract: Thanks to its robust learning and search stabilities,the reinforcement learning (RL) algorithm has garnered increasingly significant attention and been exten-sively applied in Automated Guided Vehicle (AGV) path planning. However, RL-based planning algorithms have been discovered to suffer from the substantial variance of neural networks caused by environmental instability and significant fluctua-tions in system structure. These challenges manifest in slow convergence speed and low learning efficiency. To tackle this issue, this paper presents a novel multi-AGV path planning method named Particle Filters - Double Deep Q-Network (PF-DDQN)via leveraging Particle Filters (PF) and RL algorithm. Firstly, the proposed method leverages the imprecise weight values of the network as state values to formulate thestate space equation.Subsequently, the DDQN model is optimized to acquire the optimal true weight values through the iterative fusion process of neural networksand PF in order to enhance the optimization efficiency of the proposedmethod. Lastly, the performance of the proposed method is validated by different numerical simulations. The simulation results demonstrate that the proposed methoddominates the traditional DDQN algorithm in terms of path planning superiority andtraining time indicator by 92.62% and 76.88%, respectively. Therefore, the proposedmethod could be considered as a vital alternative in the field of multi-AGV path planning.


title: Analytical computation of bifurcation of orbits near collinear libration point in the restricted three-body problem

abstract: A unified analytical solution is presented for constructing the phase space near collinear libration points in the Circular Restricted Three-body Problem (CRTBP), encompassing Lissajous orbits and quasihalo orbits, their invariant manifolds, as well as transit and non-transit orbits. Traditional methods could only derive separate analytical solutions for the invariant manifolds of Lissajous orbits and halo orbits, falling short for the invariant manifolds of quasihalo orbits. By introducing a coupling coefficient {\eta} and a bifurcation equation, a unified series solution for these orbits is systematically developed using a coupling-induced bifurcation mechanism and Lindstedt-Poincar\'e method. Analyzing the third-order bifurcation equation reveals bifurcation conditions for halo orbits, quasihalo orbits, and their invariant manifolds. Furthermore, new families of periodic orbits similar to halo orbits are discovered, and non-periodic/quasi-periodic orbits, such as transit orbits and non-transit orbits, are found to undergo bifurcations. When {\eta} = 0, the series solution describes Lissajous orbits and their invariant manifolds, transit, and non-transit orbits. As {\eta} varies from zero to non-zero values, the solution seamlessly transitions to describe quasihalo orbits and their invariant manifolds, as well as newly bifurcated transit and non-transit orbits. This unified analytical framework provides a more comprehensive understanding of the complex phase space structures near collinear libration points in the CRTBP.


title: TAFormer: A Unified Target-Aware Transformer for Video and Motion Joint Prediction in Aerial Scenes

abstract: As drone technology advances, using unmanned aerial vehicles for aerial surveys has become the dominant trend in modern low-altitude remote sensing. The surge in aerial video data necessitates accurate prediction for future scenarios and motion states of the interested target, particularly in applications like traffic management and disaster response. Existing video prediction methods focus solely on predicting future scenes (video frames), suffering from the neglect of explicitly modeling target's motion states, which is crucial for aerial video interpretation. To address this issue, we introduce a novel task called Target-Aware Aerial Video Prediction, aiming to simultaneously predict future scenes and motion states of the target. Further, we design a model specifically for this task, named TAFormer, which provides a unified modeling approach for both video and target motion states. Specifically, we introduce Spatiotemporal Attention (STA), which decouples the learning of video dynamics into spatial static attention and temporal dynamic attention, effectively modeling the scene appearance and motion. Additionally, we design an Information Sharing Mechanism (ISM), which elegantly unifies the modeling of video and target motion by facilitating information interaction through two sets of messenger tokens. Moreover, to alleviate the difficulty of distinguishing targets in blurry predictions, we introduce Target-Sensitive Gaussian Loss (TSGL), enhancing the model's sensitivity to both target's position and content. Extensive experiments on UAV123VP and VisDroneVP (derived from single-object tracking datasets) demonstrate the exceptional performance of TAFormer in target-aware video prediction, showcasing its adaptability to the additional requirements of aerial video interpretation for target awareness.


title: Determination of output composition in reaction-advection-diffusion systems on network reactors

abstract: We consider reaction-transport processes in open reactors in which systems of first order reactions involving a number of gas species and solid catalysts can occur at localized active regions. Reaction products flow out of the reactor into vacuum conditions and are collected at an exit boundary. The output composition problem (OCP) is to determine the composition (molar fractions) of the collected gas after the reactor is fully emptied. We provide a solution to this problem in the form of a boundary-value problem for a system of time-independent partial differential equations. We then consider network-like reactors, which can be approximated by a network consisting of a collection of nodes and 1-dimensional branches, with reactions taking place at nodes. For these, it is possible to solve the OCP in a simple and effective way, giving explicit formulas for the output composition as a function of the reaction coefficients and parameters associated with the geometric configuration of the system. Several examples are given to illustrate the method.


title: A deep neural network for positioning and inter-crystal scatter identification in multiplexed PET detectors

abstract: Objective: Conventional event positioning algorithms in light-sharing PET detectors are often limited by edge effects and the impact of inter-crystal scattering (ICS). This study explores the feasibility of deep neural network (DNN) techniques for more precise event positioning in finely segmented and highly multiplexed PET detectors with light-sharing. Approach: A DNN was designed for crystal localisation, and trained/tested with light distributions of photoelectric (P) and Compton/photoelectric (CP) events simulated using optical GATE and an efficient analytical method. Using the statistical properties of ICS events from simulation, an energy-guided positioning algorithm was built into the DNN, enabling selection of the unique or first crystal of interaction in P and CP events, respectively. Performance of the DNN was compared with Anger logic using light distributions from simulated 511-keV point sources near the PET detector. Results: Despite coarse photodetector data due to signal multiplexing, the DNN demonstrated a crystal classification accuracy of 90% for P events and 82% for CP events. For crystal positioning, the DNN outperformed Anger logic by at least 34% and 14% for P and CP events, respectively. Further improvement is somewhat constrained by the physics, specifically, the ratio of backward to forward scattering of gamma rays within the crystal array being close to 1. This prevents selecting the first crystal of interaction in CP events with a high degree of certainty. Significance: Light-sharing and multiplexed PET detectors are common in high-resolution PET, yet event positioning can be poor due to edge effects and ICS events. Our study shows that DNN-based event positioning can enhance 2D coincidence event positioning accuracy by nearly a factor of 2 compared to Anger logic. However, further improvements are difficult to foresee without timing information.


title: NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generation

abstract: 3D shape generation aims to produce innovative 3D content adhering to specific conditions and constraints. Existing methods often decompose 3D shapes into a sequence of localized components, treating each element in isolation without considering spatial consistency. As a result, these approaches exhibit limited versatility in 3D data representation and shape generation, hindering their ability to generate highly diverse 3D shapes that comply with the specified constraints. In this paper, we introduce a novel spatial-aware 3D shape generation framework that leverages 2D plane representations for enhanced 3D shape modeling. To ensure spatial coherence and reduce memory usage, we incorporate a hybrid shape representation technique that directly learns a continuous signed distance field representation of the 3D shape using orthogonal 2D planes. Additionally, we meticulously enforce spatial correspondences across distinct planes using a transformer-based autoencoder structure, promoting the preservation of spatial relationships in the generated 3D shapes. This yields an algorithm that consistently outperforms state-of-the-art 3D shape generation methods on various tasks, including unconditional shape generation, multi-modal shape completion, single-view reconstruction, and text-to-shape synthesis.


title: Flows in the Space of Interacting Chiral Boson Theories

abstract: We study interacting theories of $N$ left-moving and $\overline{N}$ right-moving Floreanini-Jackiw bosons in two dimensions. A parameterized family of such theories is shown to enjoy (non-manifest) Lorentz invariance if and only if its Lagrangian obeys a flow equation driven by a function of the energy-momentum tensor. We discuss the canonical quantization of such theories along classical stress tensor flows, focusing on the case of the root-$T \overline{T}$ deformation, where we obtain perturbative results for the deformed spectrum in a certain large-momentum limit. In the special case $N = \overline{N}$, we consider the quantum effective action for the root-$T \overline{T}$-deformed theory by expanding around a general classical background, and we find that the one-loop contribution vanishes for backgrounds with constant scalar gradients. Our analysis can also be interpreted via dual $U(1)$ Chern-Simons theories in three dimensions, which might be used to describe deformations of charged $\mathrm{AdS}_3$ black holes or quantum Hall systems.

categories: hep-th cond-mat.str-el gr-qc math-ph math.MP


title: Boosting Conversational Question Answering with Fine-Grained Retrieval-Augmentation and Self-Check

abstract: Retrieval-Augmented Generation (RAG) aims to generate more reliable and accurate responses, by augmenting large language models (LLMs) with the external vast and dynamic knowledge. Most previous work focuses on using RAG for single-round question answering, while how to adapt RAG to the complex conversational setting wherein the question is interdependent on the preceding context is not well studied. In this paper, we propose a conversation-level RAG approach, which incorporates fine-grained retrieval augmentation and self-check for conversational question answering (CQA). In particular, our approach consists of three components, namely conversational question refiner, fine-grained retriever and self-check based response generator, which work collaboratively for question understanding and relevant information acquisition in conversational settings. Extensive experiments demonstrate the great advantages of our approach over the state-of-the-art baselines. Moreover, we also release a Chinese CQA dataset with new features including reformulated question, extracted keyword, retrieved paragraphs and their helpfulness, which facilitates further researches in RAG enhanced CQA.


title: Evidence for conventional superconductivity in Bi$_2$PdPt and prediction of topological superconductivity in disorder-free $\gamma$-BiPd

abstract: We present comprehensive investigations into the structural, superconducting, and topological properties of Bi$_2$PdPt. Magnetization and heat capacity measurements performed on polycrystalline Bi$_2$PdPt demonstrate a superconducting transition at $\approx$ 0.8 K. Moreover, muon spin relaxation/rotation ($\mu$SR) measurements present evidence for a time reversal symmetry preserving, isotropically gapped superconducting state in Bi$_2$PdPt. We have also performed density-functional theory (DFT) calculations on Bi$_2$PdPt alongside the more general isostructural systems, BiPd$_{x}$Pt$_{1-x}$, of which Bi$_2$PdPt and $\gamma$-BiPd are special cases for $x=0.5$ and $x=1$ respectively. We have calculated the $Z_2$ topological index from our DFT calculations for a range of substitution fractions, $x$, between $x=0$ and $x=1$ characterizing the topology of the band structure. We find a non-trivial topological state when $x>0.75$ and a trivial topological state when $x<0.75$. Therefore our results indicate that BiPd$_{x}$Pt$_{1-x}$ could be a topological superconductor for $x>0.75$.


title: LocalCop: An R package for local likelihood inference for conditional copulas

abstract: Conditional copulas models allow the dependence structure between multiple response variables to be modelled as a function of covariates. LocalCop (Acar & Lysy, 2024) is an R/C++ package for computationally efficient semiparametric conditional copula modelling using a local likelihood inference framework developed in Acar, Craiu, & Yao (2011), Acar, Craiu, & Yao (2013) and Acar, Czado, & Lysy (2019).


title: Sampling Electronic Fock States using Determinantal Quantum Monte Carlo

abstract: Analog quantum simulation based on ultracold atoms in optical lattices has catalyzed significant breakthroughs in the study of quantum many-body systems. These simulations rely on the statistical sampling of electronic Fock states, which are not easily accessible in classical algorithms. In this work, we modify the determinantal quantum Monte Carlo by integrating a Fock-state update mechanism alongside the auxiliary field. This method enables efficient sampling of Fock-state configurations. The Fock-state restrictive sampling scheme further enables the pre-selection of multiple ensembles at no additional computational cost, thereby broadening the scope of simulation to more general systems and models. Employing this method, we analyze static correlations of the Hubbard model up to the fourth order and achieve quantitative agreement with cold-atom experiments. The simulations of dynamical spectroscopies of the Hubbard and Kondo-lattice models further demonstrate the reliability and advantage of this method.


title: An Experimentally Validated Feasible Quantum Protocol for Identity-Based Signature with Application to Secure Email Communication

abstract: Digital signatures are one of the simplest cryptographic building blocks that provide appealing security characteristics such as authenticity, unforgeability, and undeniability. In 1984, Shamir developed the first Identity-based signature (IBS) to simplify public key infrastructure and circumvent the need for certificates. It makes the process uncomplicated by enabling users to verify digital signatures using only the identifiers of signers, such as email, phone number, etc. Nearly all existing IBS protocols rely on several theoretical assumption-based hard problems. Unfortunately, these hard problems are unsafe and pose a hazard in the quantum realm. Thus, designing IBS algorithms that can withstand quantum attacks and ensure long-term security is an important direction for future research. Quantum cryptography (QC) is one such approach. In this paper, we propose an IBS based on QC. Our scheme's security is based on the laws of quantum mechanics. It thereby achieves long-term security and provides resistance against quantum attacks. We verify the proposed design's correctness and feasibility by simulating it in a prototype quantum device and the IBM Qiskit quantum simulator. The implementation code in qiskit with Jupyternotebook is provided in the Annexure. Moreover, we discuss the application of our design in secure email communication.


title: Statistical Inference of Optimal Allocations I: Regularities and their Implications

abstract: In this paper, we develop a functional differentiability approach for solving statistical optimal allocation problems. We first derive Hadamard differentiability of the value function through a detailed analysis of the general properties of the sorting operator. Central to our framework are the concept of Hausdorff measure and the area and coarea integration formulas from geometric measure theory. Building on our Hadamard differentiability results, we demonstrate how the functional delta method can be used to directly derive the asymptotic properties of the value function process for binary constrained optimal allocation problems, as well as the two-step ROC curve estimator. Moreover, leveraging profound insights from geometric functional analysis on convex and local Lipschitz functionals, we obtain additional generic Fr\'echet differentiability results for the value functions of optimal allocation problems. These compelling findings motivate us to study carefully the first order approximation of the optimal social welfare. In this paper, we then present a double / debiased estimator for the value functions. Importantly, the conditions outlined in the Hadamard differentiability section validate the margin assumption from the statistical classification literature employing plug-in methods that justifies a faster convergence rate.


title: Exploring the Deceptive Power of LLM-Generated Fake News: A Study of Real-World Detection Challenges

abstract: Recent advancements in Large Language Models (LLMs) have enabled the creation of fake news, particularly in complex fields like healthcare. Studies highlight the gap in the deceptive power of LLM-generated fake news with and without human assistance, yet the potential of prompting techniques has not been fully explored. Thus, this work aims to determine whether prompting strategies can effectively narrow this gap. Current LLM-based fake news attacks require human intervention for information gathering and often miss details and fail to maintain context consistency. Therefore, to better understand threat tactics, we propose a strong fake news attack method called conditional Variational-autoencoder-Like Prompt (VLPrompt). Unlike current methods, VLPrompt eliminates the need for additional data collection while maintaining contextual coherence and preserving the intricacies of the original text. To propel future research on detecting VLPrompt attacks, we created a new dataset named VLPrompt fake news (VLPFN) containing real and fake texts. Our experiments, including various detection methods and novel human study metrics, were conducted to assess their performance on our dataset, yielding numerous findings.


title: Linear Hybrid Asymmetrical Load-Modulated Balanced Amplifier with Multi-Band Reconfigurability and Antenna-VSWR Resilience

abstract: This paper presents the first-ever highly linear and load-insensitive three-way load-modulation power amplifier (PA) based on reconfigurable hybrid asymmetrical load modulated balanced amplifier (H-ALMBA). Through proper amplitude and phase controls, the carrier, control amplifier (CA), and two peaking balanced amplifiers (BA1 and BA2) can form a linear high-order load modulation over wide bandwidth. Moreover, it is theoretically unveiled that the load modulation behavior of H-ALMBA can be insensitive to load mismatch by leveraging bias reconfiguration and the intrinsic load-insensitivity of balanced topology. Specifically, the PA's linearity and efficiency profiles can be maintained against arbitrary load mismatch through $Z_\mathrm{L}$-dependent reconfiguration of CA supply voltage ($V_\mathrm{DD,CA}$) and turning-on sequence of BA1 and BA2. Based on the proposed theory, an RF-input linear H-ALMBA is developed with GaN transistors and wideband quadrature hybrids. Over the design bandwidth from $1.7$-$2.9$ GHz, an efficiency of $56.8\%$$-$$72.9\%$ at peak power and $49.8\%$$-$$61.2\%$ at $10$-dB PBO are measured together with linear AMAM and AMPM responses. In modulated evaluation with 4G LTE signal, an EVM of $3.1\%$, ACPR of $-39$ dB, and average efficiency of up to $52\%$ are measured. Moreover, the reconfigurable H-ALMBA experimentally maintains an excellent average efficiency and linearity against arbitrary load mismatch at $2:1$ VSWR, and this mismatch-resilient operation can be achieved at any in-band frequencies. The overall measured performance favorably outperforms the state-of-the-art.


title: Since the Scientific Literature Is Multilingual, Our Models Should Be Too

abstract: English has long been assumed the $\textit{lingua franca}$ of scientific research, and this notion is reflected in the natural language processing (NLP) research involving scientific document representation. In this position piece, we quantitatively show that the literature is largely multilingual and argue that current models and benchmarks should reflect this linguistic diversity. We provide evidence that text-based models fail to create meaningful representations for non-English papers and highlight the negative user-facing impacts of using English-only models non-discriminately across a multilingual domain. We end with suggestions for the NLP community on how to improve performance on non-English documents.


title: Beyond Embeddings: The Promise of Visual Table in Visual Reasoning

abstract: Visual representation learning has been a cornerstone in computer vision, involving typical forms such as visual embeddings, structural symbols, and text-based representations. Despite the success of CLIP-type visual embeddings, they often lack access to world knowledge critical for visual reasoning. In this work, we propose Visual Table, a novel form of visual representation tailored for visual reasoning. Visual tables are constructed as hierarchical descriptions of visual scenes, featuring a scene description and multiple object-centric descriptions covering categories, attributes, and knowledge. Thanks to the structural and textual formats, visual tables offer unique advantages over mere visual embeddings, such as interpretability and controllable editing. Furthermore, they deliver instance-level world knowledge and detailed attributes that are essential for visual reasoning. To create visual tables, we develop a generator trained on the dataset with collected, small-scale annotations. Extensive results on 11 visual reasoning benchmarks demonstrate that the generated visual tables significantly outperform previous structural and text-based representations. Moreover, they consistently enhance state-of-the-art multimodal large language models across diverse benchmarks, showcasing their potential for advancing visual reasoning tasks. Our code is available at https://github.com/LaVi-Lab/Visual-Table.


title: Enhancing Metaphor Detection through Soft Labels and Target Word Prediction

abstract: Metaphors play a significant role in our everyday communication, yet detecting them presents a challenge. Traditional methods often struggle with improper application of language rules and a tendency to overlook data sparsity. To address these issues, we integrate knowledge distillation and prompt learning into metaphor detection. Our approach revolves around a tailored prompt learning framework specifically designed for metaphor detection. By strategically masking target words and providing relevant prompt data, we guide the model to accurately predict the contextual meanings of these words. This approach not only mitigates confusion stemming from the literal meanings of the words but also ensures effective application of language rules for metaphor detection. Furthermore, we've introduced a teacher model to generate valuable soft labels. These soft labels provide a similar effect to label smoothing and help prevent the model from becoming over confident and effectively addresses the challenge of data sparsity. Experimental results demonstrate that our model has achieved state-of-the-art performance, as evidenced by its remarkable results across various datasets.


title: Differentially Private Distributed Nonconvex Stochastic Optimization with Quantized Communications

abstract: This paper proposes a new distributed nonconvex stochastic optimization algorithm that can achieve privacy protection, communication efficiency and convergence simultaneously. Specifically, each node adds time-varying privacy noises to its local state to avoid information leakage, and then quantizes its noise-perturbed state before transmitting to improve communication efficiency. By employing the subsampling method controlled through the sample-size parameter, the proposed algorithm reduces the impact of privacy noises, and enhances the differential privacy level. When the global cost function satisfies the Polyak-Lojasiewicz condition, the mean and high-probability convergence rate and the oracle complexity of the proposed algorithm are given. Importantly, the proposed algorithm achieves both the mean convergence and a finite cumulative differential privacy budget over infinite iterations as the sample-size goes to infinity. A numerical example of the distributed training on the "MNIST" dataset is given to show the effectiveness of the algorithm.


title: Statistical inference for multi-regime threshold Ornstein-Uhlenbeck processes

abstract: In this paper, we investigate the parameter estimation for threshold Ornstein$\mathit{-}$Uhlenbeck processes. Least squares method is used to obtain continuous-type and discrete-type estimators for the drift parameters based on continuous and discrete observations, respectively. The strong consistency and asymptotic normality of the proposed least squares estimators are studied. We also propose a modified quadratic variation estimator based on the long-time observations for the diffusion parameters and prove its consistency. Our simulation results suggest that the performance of our proposed estimators for the drift parameters may show improvements compared to generalized moment estimators. Additionally, the proposed modified quadratic variation estimator exhibits potential advantages over the usual quadratic variation estimator with relatively small sample sizes. In particular, our method can be applied to the multi-regime cases ($m>2$), while the generalized moment method only deals with the two regime cases ($m=2$). The U.S. treasury rate data is used to illustrate the theoretical results.


title: Manipulating Neural Path Planners via Slight Perturbations

abstract: Data-driven neural path planners are attracting increasing interest in the robotics community. However, their neural network components typically come as black boxes, obscuring their underlying decision-making processes. Their black-box nature exposes them to the risk of being compromised via the insertion of hidden malicious behaviors. For example, an attacker may hide behaviors that, when triggered, hijack a delivery robot by guiding it to a specific (albeit wrong) destination, trapping it in a predefined region, or inducing unnecessary energy expenditure by causing the robot to repeatedly circle a region. In this paper, we propose a novel approach to specify and inject a range of hidden malicious behaviors, known as backdoors, into neural path planners. Our approach provides a concise but flexible way to define these behaviors, and we show that hidden behaviors can be triggered by slight perturbations (e.g., inserting a tiny unnoticeable object), that can nonetheless significantly compromise their integrity. We also discuss potential techniques to identify these backdoors aimed at alleviating such risks. We demonstrate our approach on both sampling-based and search-based neural path planners.


title: Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation

abstract: Transformers have been the most successful architecture for various speech modeling tasks, including speech separation. However, the self-attention mechanism in transformers with quadratic complexity is inefficient in computation and memory. Recent models incorporate new layers and modules along with transformers for better performance but also introduce extra model complexity. In this work, we replace transformers with Mamba, a selective state space model, for speech separation. We propose dual-path Mamba, which models short-term and long-term forward and backward dependency of speech signals using selective state spaces. Our experimental results on the WSJ0-2mix data show that our dual-path Mamba models of comparably smaller sizes outperform state-of-the-art RNN model DPRNN, CNN model WaveSplit, and transformer model Sepformer. Code: https://github.com/xi-j/Mamba-TasNet


title: Enhancing Generative Class Incremental Learning Performance with Model Forgetting Approach

abstract: This study presents a novel approach to Generative Class Incremental Learning (GCIL) by introducing the forgetting mechanism, aimed at dynamically managing class information for better adaptation to streaming data. GCIL is one of the hot topics in the field of computer vision, and this is considered one of the crucial tasks in society, specifically the continual learning of generative models. The ability to forget is a crucial brain function that facilitates continual learning by selectively discarding less relevant information for humans. However, in the field of machine learning models, the concept of intentionally forgetting has not been extensively investigated. In this study we aim to bridge this gap by incorporating the forgetting mechanisms into GCIL, thereby examining their impact on the models' ability to learn in continual learning. Through our experiments, we have found that integrating the forgetting mechanisms significantly enhances the models' performance in acquiring new knowledge, underscoring the positive role that strategic forgetting plays in the process of continual learning.


title: RoboKeyGen: Robot Pose and Joint Angles Estimation via Diffusion-based 3D Keypoint Generation

abstract: Estimating robot pose and joint angles is significant in advanced robotics, enabling applications like robot collaboration and online hand-eye calibration.However, the introduction of unknown joint angles makes prediction more complex than simple robot pose estimation, due to its higher dimensionality.Previous methods either regress 3D keypoints directly or utilise a render&compare strategy. These approaches often falter in terms of performance or efficiency and grapple with the cross-camera gap problem.This paper presents a novel framework that bifurcates the high-dimensional prediction task into two manageable subtasks: 2D keypoints detection and lifting 2D keypoints to 3D. This separation promises enhanced performance without sacrificing the efficiency innate to keypoint-based techniques.A vital component of our method is the lifting of 2D keypoints to 3D keypoints. Common deterministic regression methods may falter when faced with uncertainties from 2D detection errors or self-occlusions.Leveraging the robust modeling potential of diffusion models, we reframe this issue as a conditional 3D keypoints generation task. To bolster cross-camera adaptability, we introduce theNormalised Camera Coordinate Space (NCCS), ensuring alignment of estimated 2D keypoints across varying camera intrinsics.Experimental results demonstrate that the proposed method outperforms the state-of-the-art render\&compare method and achieves higher inference speed.Furthermore, the tests accentuate our method's robust cross-camera generalisation capabilities.We intend to release both the dataset and code in https://nimolty.github.io/Robokeygen/


title: Toward Interactive Regional Understanding in Vision-Large Language Models

abstract: Recent Vision-Language Pre-training (VLP) models have demonstrated significant advancements. Nevertheless, these models heavily rely on image-text pairs that capture only coarse and global information of an image, leading to a limitation in their regional understanding ability. In this work, we introduce \textbf{RegionVLM}, equipped with explicit regional modeling capabilities, allowing them to understand user-indicated image regions. To achieve this, we design a simple yet innovative architecture, requiring no modifications to the model architecture or objective function. Additionally, we leverage a dataset that contains a novel source of information, namely Localized Narratives, which has been overlooked in previous VLP research. Our experiments demonstrate that our single generalist model not only achieves an interactive dialogue system but also exhibits superior performance on various zero-shot region understanding tasks, without compromising its ability for global image understanding.


title: Simplicity of the contactomorphism group of finite regularity

abstract: For a given coorientable contact manifold $(M^{2n+1},\xi)$, we consider the group $ \operatorname{Cont}_c^{(r,\delta)}(M,\alpha)$ consisting of $C^{r,\delta}$ contactomorphisms with compact support which is equipped with $C^{r,\delta}$-topology of H\"older regularity $(r,\delta)$ for $r \geq 1$ and $0 <\delta \leq 1$. We prove that for all H\"older class exponents with $r > n + 2$ or $r = n+1, \, \frac12 < \delta \leq 1$ (resp. $r < n+1$ or $r = n+1$ and $ 0< \delta <\frac12$), the group is a perfect (and so a simple) group. In particular, $\operatorname{Cont}_c^r(M,\xi)$ is simple for all integer $r \geq 1$. For the case of $\operatorname{Cont}_c^{(r,\delta)}(M,\alpha)$ of general H\"older regularity, we prove the simplicity for all pairs $(r,\delta)$ leaving only the case of $(r,\delta) = (n+1,\frac12)$ open.


title: Developing a Theoretical Model for the Resummation of Infrared Effects in the Pre- and Post-Reconstruction Galaxy Bispectra (https://youtu.be/bHdlIi3jQ4A)

abstract: While substantial progress has been made in studying the pre-reconstruction galaxy bispectrum, investigations of the post-reconstruction bispectrum are still in nascent stages. In this paper, we present a bispectrum model that incorporates one-loop corrections in the Standard Perturbation Theory (SPT), while simultaneously addressing infrared (IR) effects in the post-reconstruction density fluctuations in a non-perturbative approach. This model accurately captures the nonlinear behavior of the Baryon Acoustic Oscillation (BAO) signal within the post-reconstruction bispectrum framework. Furthermore, the incorporation of the one-loop correction extends its applicability to smaller scales. Given that the approach to addressing IR effects remains invariant before and after the reconstruction process, the resulting IR-resummed bispectrum model exhibits uniformity across both scenarios. Throughout this analysis, we achieve a comprehensive and unified description of the bispectrum that seamlessly spans the pre- and post-reconstruction phases. An explanatory video is available at https://youtu.be/bHdlIi3jQ4A.


title: New Constraints on Exotic Spin-Spin-Velocity-Dependent Interactions with Solid-State Quantum Sensors

abstract: We report new experimental results on exotic spin-spin-velocity-dependent interactions between electron spins. We designed an elaborate setup that is equipped with two nitrogen-vacancy (NV) ensembles in diamonds. One of the NV ensembles serves as the spin source, while the other functions as the spin sensor. By coherently manipulating the quantum states of two NV ensembles and their relative velocity at the micrometer scale, we are able to scrutinize exotic spin-spin-velocity-dependent interactions at short force ranges. For a T-violating interaction, $V_6$, new limits on the corresponding coupling coefficient, $f_6$, have been established for the force range shorter than 1 cm. For a P,T-violating interaction, $V_{14}$, new constraints on the corresponding coupling coefficient, $f_{14}$, have been obtained for the force range shorter than 1 km.


title: Analytic Approach for Computation of Topological Number of Integrable Vortex on Torus

abstract: An analytic method to calculate the vortex number on a torus is constructed, focusing on analytic vortex solutions to the Chern-Simons-Higgs theory, whose governing equation is the so-called Jackiw-Pi equation. The equation is one of the integrable vortex equations and is reduced to Liouville's equation. The requirement of continuity of the Higgs field strongly restricts the characteristics and the fundamental domain of the vortices. Also considered are the decompactification limits of the vortices on a torus, in which "flux loss" phenomena occasionally occur.


title: A Deep Learning Framework for Disentangling Triangle Singularity and Pole-Based Enhancements

abstract: Enhancements in the invariant mass distribution or scattering cross-section are usually associated with resonances. However, the nature of exotic signals found near hadron-hadron thresholds remain a puzzle today. In fact, a purely kinematic triangle mechanism is also capable of producing similar structures, but do not correspond to any unstable quantum state. In this paper, we report for the first time, that a deep neural network can be trained to distinguish triangle singularity from pole-based enhancements. We also identify the type of dynamic pole structure that can be misidentified as triangle enhancement. We apply our method to confirm that the $P_\psi^N(4312)^+$ state is not due to a single triangle singularity, and is more favored towards a pole-based interpretation based solely on pure line-shape analysis. Lastly, we argue how our method can be used as a model-selection framework to help in classifying other exotic hadron candidates.


title: Branch-Tuning: Balancing Stability and Plasticity for Continual Self-Supervised Learning

abstract: Self-supervised learning (SSL) has emerged as an effective paradigm for deriving general representations from vast amounts of unlabeled data. However, as real-world applications continually integrate new content, the high computational and resource demands of SSL necessitate continual learning rather than complete retraining. This poses a challenge in striking a balance between stability and plasticity when adapting to new information. In this paper, we employ Centered Kernel Alignment for quantitatively analyzing model stability and plasticity, revealing the critical roles of batch normalization layers for stability and convolutional layers for plasticity. Motivated by this, we propose Branch-tuning, an efficient and straightforward method that achieves a balance between stability and plasticity in continual SSL. Branch-tuning consists of branch expansion and compression, and can be easily applied to various SSL methods without the need of modifying the original methods, retaining old data or models. We validate our method through incremental experiments on various benchmark datasets, demonstrating its effectiveness and practical value in real-world scenarios. We hope our work offers new insights for future continual self-supervised learning research. The code will be made publicly available.


title: DSF-GAN: DownStream Feedback Generative Adversarial Network

abstract: Utility and privacy are two crucial measurements of the quality of synthetic tabular data. While significant advancements have been made in privacy measures, generating synthetic samples with high utility remains challenging. To enhance the utility of synthetic samples, we propose a novel architecture called the DownStream Feedback Generative Adversarial Network (DSF-GAN). This approach incorporates feedback from a downstream prediction model during training to augment the generator's loss function with valuable information. Thus, DSF-GAN utilizes a downstream prediction task to enhance the utility of synthetic samples. To evaluate our method, we tested it using two popular datasets. Our experiments demonstrate improved model performance when training on synthetic samples generated by DSF-GAN, compared to those generated by the same GAN architecture without feedback. The evaluation was conducted on the same validation set comprising real samples. All code and datasets used in this research will be made openly available for ease of reproduction.


title: Non-Hermitian Topology with Generalized Chiral Symmetry

abstract: We study a generalization of chiral symmetry applicable to non-Hermitian systems and its topological consequences on one-dimensional chains. We uncover a rich family of topological phases hosting several chiral flavors characterized not by a single winding number, but a vector of of them. This, in turn, leads to a novel type of bulk-boundary correspondence, where -- in contrast with conventional chiral chains -- some flavors can have topologically stable non-zero charges on both ends. Moreover, we find that the total charge of each flavor can in some cases exceed the magnitude of the highest winding number in the vector invariant. Our work extends the topological classification of the non-Hermitian AIII class along a new axis.


title: Clustering Change Sign Detection by Fusing Mixture Complexity

abstract: This paper proposes an early detection method for cluster structural changes. Cluster structure refers to discrete structural characteristics, such as the number of clusters, when data are represented using finite mixture models, such as Gaussian mixture models. We focused on scenarios in which the cluster structure gradually changed over time. For finite mixture models, the concept of mixture complexity (MC) measures the continuous cluster size by considering the cluster proportion bias and overlap between clusters. In this paper, we propose MC fusion as an extension of MC to handle situations in which multiple mixture numbers are possible in a finite mixture model. By incorporating the fusion of multiple models, our approach accurately captured the cluster structure during transitional periods of gradual change. Moreover, we introduce a method for detecting changes in the cluster structure by examining the transition of MC fusion. We demonstrate the effectiveness of our method through empirical analysis using both artificial and real-world datasets.


title: Image Deraining via Self-supervised Reinforcement Learning

abstract: The quality of images captured outdoors is often affected by the weather. One factor that interferes with sight is rain, which can obstruct the view of observers and computer vision applications that rely on those images. The work aims to recover rain images by removing rain streaks via Self-supervised Reinforcement Learning (RL) for image deraining (SRL-Derain). We locate rain streak pixels from the input rain image via dictionary learning and use pixel-wise RL agents to take multiple inpainting actions to remove rain progressively. To our knowledge, this work is the first attempt where self-supervised RL is applied to image deraining. Experimental results on several benchmark image-deraining datasets show that the proposed SRL-Derain performs favorably against state-of-the-art few-shot and self-supervised deraining and denoising methods.


title: Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decoding

abstract: The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial training costs and extensive medical datasets for full model fine-tuning or high-quality prompts for optimal performance. This paper introduces H-SAM: a prompt-free adaptation of SAM tailored for efficient fine-tuning of medical images via a two-stage hierarchical decoding procedure. In the initial stage, H-SAM employs SAM's original decoder to generate a prior probabilistic mask, guiding a more intricate decoding process in the second stage. Specifically, we propose two key designs: 1) A class-balanced, mask-guided self-attention mechanism addressing the unbalanced label distribution, enhancing image embedding; 2) A learnable mask cross-attention mechanism spatially modulating the interplay among different image regions based on the prior mask. Moreover, the inclusion of a hierarchical pixel decoder in H-SAM enhances its proficiency in capturing fine-grained and localized details. This approach enables SAM to effectively integrate learned medical priors, facilitating enhanced adaptation for medical image segmentation with limited samples. Our H-SAM demonstrates a 4.78% improvement in average Dice compared to existing prompt-free SAM variants for multi-organ segmentation using only 10% of 2D slices. Notably, without using any unlabeled data, H-SAM even outperforms state-of-the-art semi-supervised models relying on extensive unlabeled training data across various medical datasets. Our code is available at https://github.com/Cccccczh404/H-SAM.


title: Recovery of High-energy Low-frequency Quasi-periodic Oscillations from Black Hole X-ray Binary MAXI J1535-571 with a Hilbert-Huang Transform Method

abstract: We propose a method based on the Hilbert-Huang transform (HHT) to recover the high-energy waveform of low-frequency quasi-periodic oscillations (LFQPOs). Based on the method, we successfully obtain the modulation of the phase-folded light curve above 170 keV using the QPO phase reconstructed at lower energies in MAXI J1535-571 with Insight-HXMT observations. A comprehensive simulation study is conducted to demonstrate that such modulation indeed originates from the QPO. Thus the highest energies turn out to significantly exceed the upper limit of ~100 keV for QPOs reported previously using the Fourier method, marking the first opportunity to study QPO properties above 100 keV in this source. Detailed analyses of these high-energy QPO profiles reveal different QPO properties between the 30-100 keV and 100-200 keV energy ranges: the phase lag remains relatively stable, and the amplitude slightly increases below ~100 keV, whereas above this threshold, soft phase lags and a decrease in amplitude are observed. Given the reports of a hard tail detection in broad spectroscopy, we propose that the newly discovered QPO properties above 100 keV are dominated by the hard tail component, possibly stemming from a relativistic jet. Our findings also indicate a strong correlation between the QPOs originating from the jet and corona, supporting the scenario of jet-corona coupling precssion. We emphasize that our proposed HHT-based method can serve as an efficient manner in expanding the high energy band for studying QPOs, thereby enhancing our understanding of their origin.


title: Analysis of solution to an elliptic free boundary value problem equipped with a `bad' data

abstract: We will study a free boundary value problem driven by a source term which is quite {\it irregular}. In the process, we will establish a monotonicity result, and regularity of the solution.


title: DVLO: Deep Visual-LiDAR Odometry with Local-to-Global Feature Fusion and Bi-Directional Structure Alignment

abstract: Information inside visual and LiDAR data is well complementary derived from the fine-grained texture of images and massive geometric information in point clouds. However, it remains challenging to explore effective visual-LiDAR fusion, mainly due to the intrinsic data structure inconsistency between two modalities: Images are regular and dense, but LiDAR points are unordered and sparse. To address the problem, we propose a local-to-global fusion network with bi-directional structure alignment. To obtain locally fused features, we project points onto image plane as cluster centers and cluster image pixels around each center. Image pixels are pre-organized as pseudo points for image-to-point structure alignment. Then, we convert points to pseudo images by cylindrical projection (point-to-image structure alignment) and perform adaptive global feature fusion between point features with local fused features. Our method achieves state-of-the-art performance on KITTI odometry and FlyingThings3D scene flow datasets compared to both single-modal and multi-modal methods. Codes will be released later.


title: Differentially Private Dual Gradient Tracking for Distributed Resource Allocation

abstract: This paper investigates privacy issues in distributed resource allocation over directed networks, where each agent holds a private cost function and optimizes its decision subject to a global coupling constraint through local interaction with other agents. Conventional methods for resource allocation over directed networks require all agents to transmit their original data to neighbors, which poses the risk of disclosing sensitive and private information. To address this issue, we propose an algorithm called differentially private dual gradient tracking (DP-DGT) for distributed resource allocation, which obfuscates the exchanged messages using independent Laplacian noise. Our algorithm ensures that the agents' decisions converge to a neighborhood of the optimal solution almost surely. Furthermore, without the assumption of bounded gradients, we prove that the cumulative differential privacy loss under the proposed algorithm is finite even when the number of iterations goes to infinity. To the best of our knowledge, we are the first to simultaneously achieve these two goals in distributed resource allocation problems over directed networks. Finally, numerical simulations on economic dispatch problems within the IEEE 14-bus system illustrate the effectiveness of our proposed algorithm.


title: RankMamba: Benchmarking Mamba's Document Ranking Performance in the Era of Transformers

abstract: Transformer structure has achieved great success in multiple applied machine learning communities, such as natural language processing (NLP), computer vision (CV) and information retrieval (IR). Transformer architecture's core mechanism -- attention requires $O(n^2)$ time complexity in training and $O(n)$ time complexity in inference. Many works have been proposed to improve the attention mechanism's scalability, such as Flash Attention and Multi-query Attention. A different line of work aims to design new mechanisms to replace attention. Recently, a notable model structure -- Mamba, which is based on state space models, has achieved transformer-equivalent performance in multiple sequence modeling tasks. In this work, we examine \mamba's efficacy through the lens of a classical IR task -- document ranking. A reranker model takes a query and a document as input, and predicts a scalar relevance score. This task demands the language model's ability to comprehend lengthy contextual inputs and to capture the interaction between query and document tokens. We find that (1) Mamba models achieve competitive performance compared to transformer-based models with the same training recipe; (2) but also have a lower training throughput in comparison to efficient transformer implementations such as flash attention. We hope this study can serve as a starting point to explore Mamba models in other classical IR tasks. Our code implementation and trained checkpoints are made public to facilitate reproducibility (https://github.com/zhichaoxu-shufe/RankMamba).


title: BlendX: Complex Multi-Intent Detection with Blended Patterns

abstract: Task-oriented dialogue (TOD) systems are commonly designed with the presumption that each utterance represents a single intent. However, this assumption may not accurately reflect real-world situations, where users frequently express multiple intents within a single utterance. While there is an emerging interest in multi-intent detection (MID), existing in-domain datasets such as MixATIS and MixSNIPS have limitations in their formulation. To address these issues, we present BlendX, a suite of refined datasets featuring more diverse patterns than their predecessors, elevating both its complexity and diversity. For dataset construction, we utilize both rule-based heuristics as well as a generative tool -- OpenAI's ChatGPT -- which is augmented with a similarity-driven strategy for utterance selection. To ensure the quality of the proposed datasets, we also introduce three novel metrics that assess the statistical properties of an utterance related to word count, conjunction use, and pronoun usage. Extensive experiments on BlendX reveal that state-of-the-art MID models struggle with the challenges posed by the new datasets, highlighting the need to reexamine the current state of the MID field. The dataset is available at https://github.com/HYU-NLP/BlendX.


title: Identification and Uses of Deep Learning Backbones via Pattern Mining

abstract: Deep learning is extensively used in many areas of data mining as a black-box method with impressive results. However, understanding the core mechanism of how deep learning makes predictions is a relatively understudied problem. Here we explore the notion of identifying a backbone of deep learning for a given group of instances. A group here can be instances of the same class or even misclassified instances of the same class. We view each instance for a given group as activating a subset of neurons and attempt to find a subgraph of neurons associated with a given concept/group. We formulate this problem as a set cover style problem and show it is intractable and presents a highly constrained integer linear programming (ILP) formulation. As an alternative, we explore a coverage-based heuristic approach related to pattern mining, and show it converges to a Pareto equilibrium point of the ILP formulation. Experimentally we explore these backbones to identify mistakes and improve performance, explanation, and visualization. We demonstrate application-based results using several challenging data sets, including Bird Audio Detection (BAD) Challenge and Labeled Faces in the Wild (LFW), as well as the classic MNIST data.


title: Forbidden complexes for the 3-sphere

abstract: A simplicial complex is said to be {\em critical} (or {\em forbidden}) for the 3-sphere $S^3$ if it cannot be embedded in $S^3$ but after removing any one point, it can be embedded. We show that if a multibranched surface cannot be embedded in $S^3$, it contains a critical complex which is a union of a multibranched surface and a (possibly empty) graph. We exhibit all critical complexes for $S^3$ which are contained in $K_5 \times S^1$ and $K_{3,3} \times S^1$ families. We also classify all critical complexes for $S^3$ which can be decomposed into $G\times S^1$ and $H$, where $G$ and $H$ are graphs. In spite of the above property, there exist complexes which cannot be embedded in $S^3$, but they do not contain any critical complexes. From the property of those examples, we define an equivalence relation on all simplicial complexes $\mathcal{C}$ and a partially ordered set of complexes $(\mathcal{C}/\mathord\sim; \subseteqq)$, and refine the definition of critical. According to the refined definition of critical, we show that if a complex $X$ cannot be embedded in $S^3$, then there exists $[X']\subseteqq [X]$ such that $[X']$ is critical for $[S^3]$.


title: Improving Out-of-Vocabulary Handling in Recommendation Systems

abstract: Recommendation systems (RS) are an increasingly relevant area for both academic and industry researchers, given their widespread impact on the daily online experiences of billions of users. One common issue in real RS is the cold-start problem, where users and items may not contain enough information to produce high-quality recommendations. This work focuses on a complementary problem: recommending new users and items unseen (out-of-vocabulary, or OOV) at training time. This setting is known as the inductive setting and is especially problematic for factorization-based models, which rely on encoding only those users/items seen at training time with fixed parameter vectors. Many existing solutions applied in practice are often naive, such as assigning OOV users/items to random buckets. In this work, we tackle this problem and propose approaches that better leverage available user/item features to improve OOV handling at the embedding table level. We discuss general-purpose plug-and-play approaches that are easily applicable to most RS models and improve inductive performance without negatively impacting transductive model performance. We extensively evaluate 9 OOV embedding methods on 5 models across 4 datasets (spanning different domains). One of these datasets is a proprietary production dataset from a prominent RS employed by a large social platform serving hundreds of millions of daily active users. In our experiments, we find that several proposed methods that exploit feature similarity using LSH consistently outperform alternatives on most model-dataset combinations, with the best method showing a mean improvement of 3.74% over the industry standard baseline in inductive performance. We release our code and hope our work helps practitioners make more informed decisions when handling OOV for their RS and further inspires academic research into improving OOV support in RS.


title: AIR-HLoc: Adaptive Image Retrieval for Efficient Visual Localisation

abstract: State-of-the-art (SOTA) hierarchical localisation pipelines (HLoc) rely on image retrieval (IR) techniques to establish 2D-3D correspondences by selecting the $k$ most similar images from a reference image database for a given query image. Although higher values of $k$ enhance localisation robustness, the computational cost for feature matching increases linearly with $k$. In this paper, we observe that queries that are the most similar to images in the database result in a higher proportion of feature matches and, thus, more accurate positioning. Thus, a small number of images is sufficient for queries very similar to images in the reference database. We then propose a novel approach, AIR-HLoc, which divides query images into different localisation difficulty levels based on their similarity to the reference image database. We consider an image with high similarity to the reference image as an easy query and an image with low similarity as a hard query. Easy queries show a limited improvement in accuracy when increasing $k$. Conversely, higher values of $k$ significantly improve accuracy for hard queries. Given the limited improvement in accuracy when increasing $k$ for easy queries and the significant improvement for hard queries, we adapt the value of $k$ to the query's difficulty level. Therefore, AIR-HLoc optimizes processing time by adaptively assigning different values of $k$ based on the similarity between the query and reference images without losing accuracy. Our extensive experiments on the Cambridge Landmarks, 7Scenes, and Aachen Day-Night-v1.1 datasets demonstrate our algorithm's efficacy, reducing 30\%, 26\%, and 11\% in computational overhead while maintaining SOTA accuracy compared to HLoc with fixed image retrieval.


title: SGDM: Static-Guided Dynamic Module Make Stronger Visual Models

abstract: The spatial attention mechanism has been widely used to improve object detection performance. However, its operation is currently limited to static convolutions lacking content-adaptive features. This paper innovatively approaches from the perspective of dynamic convolution. We propose Razor Dynamic Convolution (RDConv) to address thetwo flaws in dynamic weight convolution, making it hard to implement in spatial mechanism: 1) it is computation-heavy; 2) when generating weights, spatial information is disregarded. Firstly, by using Razor Operation to generate certain features, we vastly reduce the parameters of the entire dynamic convolution operation. Secondly, we added a spatial branch inside RDConv to generate convolutional kernel parameters with richer spatial information. Embedding dynamic convolution will also bring the problem of sensitivity to high-frequency noise. We propose the Static-Guided Dynamic Module (SGDM) to address this limitation. By using SGDM, we utilize a set of asymmetric static convolution kernel parameters to guide the construction of dynamic convolution. We introduce the mechanism of shared weights in static convolution to solve the problem of dynamic convolution being sensitive to high-frequency noise. Extensive experiments illustrate that multiple different object detection backbones equipped with SGDM achieve a highly competitive boost in performance(e.g., +4% mAP with YOLOv5n on VOC and +1.7% mAP with YOLOv8n on COCO) with negligible parameter increase(i.e., +0.33M on YOLOv5n and +0.19M on YOLOv8n).


title: PT-symmetric dynamical confinement: Fermi acceleration, quantum force and Berry phase

abstract: We consider a quantum particle under the dynamical confinement caused by PT-symmetric box with a moving wall. The latter is described in terms of the time-dependent Schr\"{o}dinger equation obeying the time-dependent PT-symmetric boundary conditions. The class of the functions, describing time-dependence of the wall's position and keeping the system as PT-symmetric is found. Physically observable characteristics, such as average kinetic energy and the average quantum force are calculated as a function of time. Also, geometric phase is calculated for the harmonically oscillating wall regime. Experimental realization of the proposed model is discussed.


title: A new dual spectral projected gradient method for log-determinant semidefinite programming with hidden clustering structures

abstract: In this paper, we propose a new efficient method for a sparse Gaussian graphical model with hidden clustering structures by extending a dual spectral projected gradient (DSPG) method proposed by Nakagaki et al.~(2020). We establish the global convergence of the proposed method to an optimal solution, and we show that the projection onto the feasible region can be solved with a low computational complexity by the use of the pool-adjacent-violators algorithm. Numerical experiments on synthesis data and real data demonstrate the efficiency of the proposed method. The proposed method takes 0.91 seconds to achieve a similar solution to the direct application of the DSPG method which takes 4361 seconds.


title: Stability and convergence of the penalty formulation for nonlinear magnetostatics

abstract: The magnetostatic field distribution in a nonlinear medium amounts to the unique minimizer of the magnetic coenergy over all fields that can be generated by the same current. This is a nonlinear saddlepoint problem whose numerical solution can in principle be achieved by mixed finite element methods and appropriate nonlinear solvers. The saddlepoint structure, however, makes the solution cumbersome. A remedy is to split the magnetic field into a known source field and the gradient of a scalar potential which is governed by a convex minimization problem. The penalty approach avoids the use of artificial potentials and Lagrange multipliers and leads to an unconstrained convex minimization problem involving a large parameter. We provide a rigorous justification of the penalty approach by deriving error estimates for the approximation due to penalization. We further highlight the close connections to the Lagrange-multiplier and scalar potential approach. The theoretical results are illustrated by numerical tests for a typical benchmark problem


title: Few-Shot Recalibration of Language Models

abstract: Recent work has uncovered promising ways to extract well-calibrated confidence estimates from language models (LMs), where the model's confidence score reflects how likely it is to be correct. However, while LMs may appear well-calibrated over broad distributions, this often hides significant miscalibration within narrower slices (e.g., systemic over-confidence in math can balance out systemic under-confidence in history, yielding perfect calibration in aggregate). To attain well-calibrated confidence estimates for any slice of a distribution, we propose a new framework for few-shot slice-specific recalibration. Specifically, we train a recalibration model that takes in a few unlabeled examples from any given slice and predicts a curve that remaps confidence scores to be more accurate for that slice. Our trained model can recalibrate for arbitrary new slices, without using any labeled data from that slice. This enables us to identify domain-specific confidence thresholds above which the LM's predictions can be trusted, and below which it should abstain. Experiments show that our few-shot recalibrator consistently outperforms existing calibration methods, for instance improving calibration error for PaLM2-Large on MMLU by 16%, as compared to temperature scaling.


title: Frozen Gaussian approximation for the fractional Schr\"odinger equation

abstract: We develop the frozen Gaussian approximation (FGA) for the fractional Schr\"odinger equation in the semi-classical regime, where the solution is highly oscillatory when the scaled Planck constant $\varepsilon$ is small. This method approximates the solution to the Schr\"odinger equation by an integral representation based on asymptotic analysis and provides a highly efficient computational method for high-frequency wave function evolution. In particular, we revise the standard FGA formula to address the singularities arising in the higher-order derivatives of coefficients of the associated Hamiltonian flow that are second-order continuously differentiable or smooth in conventional FGA analysis. We then establish its convergence to the true solution. Additionally, we provide some numerical examples to verify the accuracy and convergence behavior of the frozen Gaussian approximation method.


title: Identifying the transverse and longitudinal modes of the $K^*$ and $K_{1}$ mesons through their angular dependent decay modes

abstract: Observing the mass shifts of chiral partners will provide invaluable insight into the role of chiral symmetry breaking in the generation of hadron masses. Because both the $K^*$ and $K_1$ mesons have vacuum widths smaller than 100 MeV, they are ideal candidates for realizing mass shift measurements. On the other hand, the different momentum dependence of the longitudinal and transverse modes smear the peak positions. In this work, we analyze the angular dependence of the two-body decays of both the $K^*$ and $K_1$. It is found that the longitudinal and transverse modes of the $K^*$ can be isolated by observing the pseudoscalar decay in either the forward or perpendicular directions, respectively. For the $K_1$ decaying into a vector meson and a pseudoscalar meson, one can accomplish the same goal by further observing the polarization of the vector meson through its angular dependence on the two pseudoscalar meson decay.


title: Exploring the pre-inflationary dynamics in loop quantum cosmology with a DBI scalar field

abstract: Loop quantum cosmology is a symmetry-reduced application of loop quantum gravity. The theory predicts a bounce for the universe at the Planck scale and resolves the singularity of standard cosmology. The dynamics is also governed by an effective Hamiltonian, which predicts a modified Friedmann equation containing the quadratic terms of the energy density. The term plays an essential role in the high energy regime, but the equations return to the standard form in the low energy regime. The evolution of the universe in the pre-inflationary period is studied in the framework of loop quantum cosmology, where the DBI scalar field is assumed to be the dominant component of the universe. Using the numerical method, we provide the evolution of the DBI field. The background evolution shows that there are three phases as: bouncing phase, transition phase and slow-roll inflationary phase. There is also a short period of super-inflation just at the beginning of the bounce phase. The field first climbs the potential and then reaches the turning point where $\dot{\phi}$ disappears and the potential energy becomes the dominant part of the energy density. This is the time when the slow roll inflation begins and the field slowly rolls down the potential. The results indicate that there are a few e-fold expansions in the bounce phase, about $N = 3.5-4$, and the universe experiences about $N = 59$ e-fold expansions in the slow-roll inflation phase.


title: Infrared properties of carbon stars in our Galaxy

abstract: In this study, we explore the characteristics of carbon stars within our Galaxy through a comprehensive analysis of observational data spanning visual and infrared (IR) bands. Leveraging datasets from IRAS, ISO, Akari, MSX, 2MASS, WISE, Gaia DR3, AAVSO, and the SIMBAD object database, we conduct a detailed comparison between the observational data and theoretical models. To facilitate this comparison, we introduce various IR two-color diagrams (2CDs), IR color-magnitude diagrams (CMDs), and spectral energy distributions (SEDs). We find that the CMDs, which utilize the latest distance and extinction data from Gaia DR3 for a substantial number of carbon stars, are very useful to distinguish carbon-rich asymptotic giant branch (CAGB) stars from extrinsic carbon stars that are not in the AGB phase. To enhance the accuracy of our analysis, we employ theoretical radiative transfer models for dust shells around CAGB stars. These theoretical dust shell models demonstrate a commendable ability to approximate the observations of CAGB stars across various SEDs, 2CDs, and CMDs. We present the infrared properties of known pulsating variables and explore the infrared variability of the sample stars by analyzing WISE photometric data spanning the last 14 yr. Additionally, we present a novel catalog of CAGB stars, offering enhanced reliability and a wealth of additional information.


title: Towards Non-Exemplar Semi-Supervised Class-Incremental Learning

abstract: Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize new classes while maintaining the discriminability of old ones. Existing CIL methods have two limitations: a heavy reliance on preserving old data for forgetting mitigation and the need for vast labeled data for knowledge adaptation. To overcome these issues, we propose a non-exemplar semi-supervised CIL framework with contrastive learning and semi-supervised incremental prototype classifier (Semi-IPC). On the one hand, contrastive learning helps the model learn rich representations, easing the trade-off between learning representations of new classes and forgetting that of old classes. On the other hand, Semi-IPC learns a prototype for each class with unsupervised regularization, enabling the model to incrementally learn from partially labeled new data while maintaining the knowledge of old classes. Experiments on benchmark datasets demonstrate the strong performance of our method: without storing any old samples and only using less than 1% of labels, Semi-IPC outperforms advanced exemplar-based methods. We hope our work offers new insights for future CIL research. The code will be made publicly available.


title: 3D Gap Opening in Non-Ideal MHD Protoplanetary Disks: Asymmetric Accretion, Meridional Vortices, and Observational Signatures

abstract: Recent high-angular resolution ALMA observations have revealed rich information about protoplanetary disks, including ubiquitous substructures and three-dimensional gas kinematics at different emission layers. One interpretation of these observations is embedded planets. Previous 3-D planet-disk interaction studies are either based on viscous simulations, or non-ideal magnetohydrodynamics (MHD) simulations with simple prescribed magnetic diffusivities. This study investigates the dynamics of gap formation in 3-D non-ideal MHD disks using non-ideal MHD coefficients from the look-up table that is self-consistently calculated based on the thermo-chemical code. We find a concentration of the poloidal magnetic flux in the planet-opened gap (in agreement with previous work) and enhanced field-matter coupling due to gas depletion, which together enable efficient magnetic braking of the gap material, driving a fast accretion layer significantly displaced from the disk midplane. The fast accretion helps deplete the gap further and is expected to negatively impact the growth of planetary embryos. It also affects the corotation torque by shrinking the region of horseshoe orbits on the trailing side of the planet. Together with the magnetically driven disk wind, the fast accretion layer generates a large, persistent meridional vortex in the gap, which breaks the mirror symmetry of gas kinematics between the top and bottom disk surfaces. Finally, by studying the kinematics at the emission surfaces, we discuss the implications of planets in realistic non-ideal MHD disks on kinematics observations.


title: Efficient Test-Time Adaptation of Vision-Language Models

abstract: Test-time adaptation with pre-trained vision-language models has attracted increasing attention for tackling distribution shifts during the test time. Though prior studies have achieved very promising performance, they involve intensive computation which is severely unaligned with test-time adaptation. We design TDA, a training-free dynamic adapter that enables effective and efficient test-time adaptation with vision-language models. TDA works with a lightweight key-value cache that maintains a dynamic queue with few-shot pseudo labels as values and the corresponding test-sample features as keys. Leveraging the key-value cache, TDA allows adapting to test data gradually via progressive pseudo label refinement which is super-efficient without incurring any backpropagation. In addition, we introduce negative pseudo labeling that alleviates the adverse impact of pseudo label noises by assigning pseudo labels to certain negative classes when the model is uncertain about its pseudo label predictions. Extensive experiments over two benchmarks demonstrate TDA's superior effectiveness and efficiency as compared with the state-of-the-art. The code has been released in \url{https://kdiaaa.github.io/tda/}.


title: Multi-scale Unified Network for Image Classification

abstract: Convolutional Neural Networks (CNNs) have advanced significantly in visual representation learning and recognition. However, they face notable challenges in performance and computational efficiency when dealing with real-world, multi-scale image inputs. Conventional methods rescale all input images into a fixed size, wherein a larger fixed size favors performance but rescaling small size images to a larger size incurs digitization noise and increased computation cost. In this work, we carry out a comprehensive, layer-wise investigation of CNN models in response to scale variation, based on Centered Kernel Alignment (CKA) analysis. The observations reveal lower layers are more sensitive to input image scale variations than high-level layers. Inspired by this insight, we propose Multi-scale Unified Network (MUSN) consisting of multi-scale subnets, a unified network, and scale-invariant constraint. Our method divides the shallow layers into multi-scale subnets to enable feature extraction from multi-scale inputs, and the low-level features are unified in deep layers for extracting high-level semantic features. A scale-invariant constraint is posed to maintain feature consistency across different scales. Extensive experiments on ImageNet and other scale-diverse datasets, demonstrate that MSUN achieves significant improvements in both model performance and computational efficiency. Particularly, MSUN yields an accuracy increase up to 44.53% and diminishes FLOPs by 7.01-16.13% in multi-scale scenarios.


title: Dual Instruction Tuning with Large Language Models for Mathematical Reasoning

abstract: Recent advancements highlight the success of instruction tuning with large language models (LLMs) utilizing Chain-of-Thought (CoT) data for mathematical reasoning tasks. Despite the fine-tuned LLMs, challenges persist, such as incorrect, missing, and redundant steps in CoT generation leading to inaccuracies in answer predictions. To alleviate this problem, we propose a dual instruction tuning strategy to meticulously model mathematical reasoning from both forward and reverse directions. This involves introducing the Intermediate Reasoning State Prediction task (forward reasoning) and the Instruction Reconstruction task (reverse reasoning) to enhance the LLMs' understanding and execution of instructions. Training instances for these tasks are constructed based on existing mathematical instruction tuning datasets. Subsequently, LLMs undergo multi-task fine-tuning using both existing mathematical instructions and the newly created data. Comprehensive experiments validate the effectiveness and domain generalization of the dual instruction tuning strategy across various mathematical reasoning tasks.


title: GeNet: A Graph Neural Network-based Anti-noise Task-Oriented Semantic Communication Paradigm

abstract: Traditional approaches to semantic communication tasks rely on the knowledge of the signal-to-noise ratio (SNR) to mitigate channel noise. Moreover, these methods necessitate training under specific SNR conditions, entailing considerable time and computational resources. In this paper, we propose GeNet, a Graph Neural Network (GNN)-based paradigm for semantic communication aimed at combating noise, thereby facilitating Task-Oriented Communication (TOC). We propose a novel approach where we first transform the input data image into graph structures. Then we leverage a GNN-based encoder to extract semantic information from the source data. This extracted semantic information is then transmitted through the channel. At the receiver's end, a GNN-based decoder is utilized to reconstruct the relevant semantic information from the source data for TOC. Through experimental evaluation, we show GeNet's effectiveness in anti-noise TOC while decoupling the SNR dependency. We further evaluate GeNet's performance by varying the number of nodes, revealing its versatility as a new paradigm for semantic communication. Additionally, we show GeNet's robustness to geometric transformations by testing it with different rotation angles, without resorting to data augmentation.


title: A Mean Field Game of Sequential Testing

abstract: We introduce a mean field game for a family of filtering problems related to the classic sequential testing of the drift of a Brownian motion. To the best of our knowledge this work presents the first treatment of mean field filtering games with stopping and an unobserved common noise in the literature. We show that the game is well-posed, characterize the solution, and establish the existence of an equilibrium under certain assumptions. We also perform numerical studies for several examples of interest.


title: Deciphering Chemical Ordering in High Entropy Materials: A Machine Learning-Accelerated High-throughput Cluster Expansion Approach

abstract: The Cluster Expansion (CE) Method encounters significant computational challenges in multicomponent systems due to the computational expense of generating training data through density functional theory (DFT) calculations. This work aims to refine the cluster and structure selection processes to mitigate these challenges. We introduce a novel method that significantly reduces the computational load associated with the calculation of fitting parameters. This method employs a Graph Neural Network (GNN) model, leveraging the M3GNet network, which is trained using a select subset of DFT calculations at each ionic step. The trained surrogate model excels in predicting the volume and energy of the final structure for a relaxation run. By employing this model, we sample thousands of structures and fit a CE model to the energies of these GNN-relaxed structures. This approach, utilizing a large training dataset, effectively reduces the risk of overfitting, yielding a CE model with a root-mean-square error (RMSE) below 10 meV/atom. We validate our method's effectiveness in two test cases: the (Cr,Hf,Mo,Ta,Ti,Zr)B$_2$ diboride system and the Refractory High-Entropy Alloy (HEA) AlHfNbTaTiZr system. Our findings demonstrate the significant advantages of integrating a GNN model, specifically the M3GNet network, with CE methods for the efficient predictive analysis of chemical ordering in High Entropy Materials. The accelerating capabilities of the hybrid ML-CE approach to investigate the evolution of Short Range Ordering (SRO) in a large number of stoichiometric systems. Finally, we show how it is possible to correlate the strength of chemical ordering to easily accessible alloy parameters.


title: Scaling Enhancement of Photon Blockade in Output Fields

abstract: Photon blockade enhancement is an exciting and promising subject that has been well studied for photons in cavities. However, whether photon blockade can be enhanced in the output fields remains largely unexplored. We show that photon blockade can be greatly enhanced in the mixing output field of a nonlinear cavity and an auxiliary (linear) cavity, where no direct coupling between the nonlinear and auxiliary cavities is needed. We uncover a biquadratic scaling relation between the second-order correlation of the photons in the output field and intracavity nonlinear interaction strength, in contrast to a quadratic scaling relation for the photons in a nonlinear cavity. We identify that this scaling enhancement of photon blockade in the output field is induced by the destructive interference between two of the paths for two photons passing through the two cavities. We then extend the theory to the experimentally feasible Jaynes-Cummings model consisting of a two-level system strongly coupled to one of the two uncoupled cavities, and also predict a biquadratic scaling law in the mixing output field. Our proposed scheme is universal and can be extended to enhance blockade in other bosonic systems.


title: HotStuff-2 vs. HotStuff: The Difference and Advantage

abstract: Byzantine consensus protocols are essential in blockchain technology. The widely recognized HotStuff protocol uses cryptographic measures for efficient view changes and reduced communication complexity. Recently, the main authors of HotStuff introduced an advanced iteration named HotStuff-2. This paper aims to compare the principles and analyze the effectiveness of both protocols, hoping to depict their key differences and assess the potential enhancements offered by HotStuff-2.


title: Selective Mixup Fine-Tuning for Optimizing Non-Decomposable Objectives

abstract: The rise in internet usage has led to the generation of massive amounts of data, resulting in the adoption of various supervised and semi-supervised machine learning algorithms, which can effectively utilize the colossal amount of data to train models. However, before deploying these models in the real world, these must be strictly evaluated on performance measures like worst-case recall and satisfy constraints such as fairness. We find that current state-of-the-art empirical techniques offer sub-optimal performance on these practical, non-decomposable performance objectives. On the other hand, the theoretical techniques necessitate training a new model from scratch for each performance objective. To bridge the gap, we propose SelMix, a selective mixup-based inexpensive fine-tuning technique for pre-trained models, to optimize for the desired objective. The core idea of our framework is to determine a sampling distribution to perform a mixup of features between samples from particular classes such that it optimizes the given objective. We comprehensively evaluate our technique against the existing empirical and theoretically principled methods on standard benchmark datasets for imbalanced classification. We find that proposed SelMix fine-tuning significantly improves the performance for various practical non-decomposable objectives across benchmarks.


title: Super-Resolution of SOHO/MDI Magnetograms of Solar Active Regions Using SDO/HMI Data and an Attention-Aided Convolutional Neural Network

abstract: Image super-resolution has been an important subject in image processing and recognition. Here, we present an attention-aided convolutional neural network (CNN) for solar image super-resolution. Our method, named SolarCNN, aims to enhance the quality of line-of-sight (LOS) magnetograms of solar active regions (ARs) collected by the Michelson Doppler Imager (MDI) on board the Solar and Heliospheric Observatory (SOHO). The ground-truth labels used for training SolarCNN are the LOS magnetograms collected by the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO). Solar ARs consist of strong magnetic fields in which magnetic energy can suddenly be released to produce extreme space weather events, such as solar flares, coronal mass ejections, and solar energetic particles. SOHO/MDI covers Solar Cycle 23, which is stronger with more eruptive events than Cycle 24. Enhanced SOHO/MDI magnetograms allow for better understanding and forecasting of violent events of space weather. Experimental results show that SolarCNN improves the quality of SOHO/MDI magnetograms in terms of the structural similarity index measure (SSIM), Pearson's correlation coefficient (PCC), and the peak signal-to-noise ratio (PSNR).


title: Classical dynamics and semiclassical analysis of excitons in cuprous oxide

abstract: Excitons, as bound states of electrons and holes, embody the solid state analogue of the hydrogen atom, whose quantum spectrum is explained within a classical framework by the Bohr-Sommerfeld atomic model. In a first hydrogenlike approximation the spectra of excitons are also well described by a Rydberg series, however, due to the surrounding crystal environment deviations from this series can be observed. A theoretical treatment of excitons in cuprous oxide needs to include the band structure of the crystal, leading to a prominent fine-structure splitting in the quantum spectra. This is achieved by introducing additional spin degrees of freedom into the system, making the existence and meaningfulness of classical exciton orbits in the physical system a non-trivial question. Recently, we have uncovered the contributions of periodic exciton orbits directly in the quantum mechanical recurrence spectra of cuprous oxide [J. Ertl et al., Phys. Rev. Lett. 129, 067401 (2022)] by application of a scaling technique and fixing the energy of the classical dynamics to a value corresponding to a principle quantum number $n=5$ in the hydrogenlike case. Here, we present a comprehensive derivation of the classical and semiclassical theory of excitons in cuprous oxide. In particular, we investigate the energy dependence of the exciton dynamics. Both the semiclassical and quantum mechanical recurrence spectra exhibit stronger deviations from the hydrogenlike behavior with decreasing energy, which is related to a growing influence of the spin-orbit coupling and thus a higher velocity of the secular motion of the exciton orbits. The excellent agreement between semiclassical and quantum mechanical exciton recurrence spectra demonstrates the validity of the classical and semiclassical approach to excitons in cuprous oxide.


title: Complete moment convergence of moving average processes for $m$-widely acceptable sequence under sub-linear expectations

abstract: In this article, the complete moment convergence for the partial sum of moving average processes $\{X_n=\sum_{i=-\infty}^{\infty}a_iY_{i+n},n\ge 1\}$ is estabished under some proper conditions, where $\{Y_i,-\infty<i<\infty\}$ is a sequence of $m$-widely acceptable ($m$-WA) random variables, which is stochastically dominated by a random variable $Y$ in sub-linear expectations space $(\Omega,\HH,\ee)$ and $\{a_i,-\infty<i<\infty\}$ is an absolutely summable sequence of real numbers. The results extend the relevant results in probability space to those under sub-linear expectations.


title: A Recommender System for NFT Collectibles with Item Feature

abstract: Recommender systems have been actively studied and applied in various domains to deal with information overload. Although there are numerous studies on recommender systems for movies, music, and e-commerce, comparatively less attention has been paid to the recommender system for NFTs despite the continuous growth of the NFT market. This paper presents a recommender system for NFTs that utilizes a variety of data sources, from NFT transaction records to external item features, to generate precise recommendations that cater to individual preferences. We develop a data-efficient graph-based recommender system to efficiently capture the complex relationship between each item and users and generate node(item) embeddings which incorporate both node feature information and graph structure. Furthermore, we exploit inputs beyond user-item interactions, such as image feature, text feature, and price feature. Numerical experiments verify the performance of the graph-based recommender system improves significantly after utilizing all types of item features as side information, thereby outperforming all other baselines.


title: Sm-Nd Isotope Data Compilation from Geoscientific Literature Using an Automated Tabular Extraction Method

abstract: The rare earth elements Sm and Nd significantly address fundamental questions about crustal growth, such as its spatiotemporal evolution and the interplay between orogenesis and crustal accretion. Their relative immobility during high-grade metamorphism makes the Sm-Nd isotopic system crucial for inferring crustal formation times. Historically, data have been disseminated sporadically in the scientific literature due to complicated and costly sampling procedures, resulting in a fragmented knowledge base. However, the scattering of critical geoscience data across multiple publications poses significant challenges regarding human capital and time. In response, we present an automated tabular extraction method for harvesting tabular geoscience data. We collect 10,624 Sm-Nd data entries from 9,138 tables in over 20,000 geoscience publications using this method. We manually selected 2,118 data points from it to supplement our previously constructed global Sm-Nd dataset, increasing its sample count by over 20\%. Our automatic data collection methodology enhances the efficiency of data acquisition processes spanning various scientific domains. Furthermore, the constructed Sm-Nd isotopic dataset should motivate the research of classifying global orogenic belts.


title: Mutual Information Optimization for SIM-Based Holographic MIMO Systems

abstract: In the context of emerging stacked intelligent metasurface (SIM)-based holographic MIMO (HMIMO) systems, a fundamental problem is to study the mutual information (MI) between transmitted and received signals to establish their capacity. However, direct optimization or analytical evaluation of the MI, particularly for discrete signaling, is often intractable. To address this challenge, we adopt the channel cutoff rate (CR) as an alternative optimization metric for the MI maximization. In this regard, we propose an alternating projected gradient method (APGM), which optimizes the CR of a SIM-based HMIMO system by adjusting signal precoding and the phase shifts across the transmit and receive SIMs in a layer-by-layer basis. Simulation results indicate that the proposed algorithm significantly enhances the CR, achieving substantial gains proportional to those observed for the corresponding MI. This justifies the effectiveness of using the channel CR for the MI optimization. Moreover, we demonstrate that the integration of digital precoding, even on a modest scale, has a significant impact on the ultimate performance of SIM-aided systems.


title: Comparison of different methods for identification of dominant oscillation mode

abstract: This paper introduces and compares the various techniques for identification and analysis of low frequency oscillations in a power system. Inter-area electromechanical oscillations are the focus of this paper. After multiresolution decomposition of characteristic signals, physical characteristics of system oscillations in signal components are identified and presented using the Fourier transform, Prony method, Matrix Pencil Analysis Method, S-transform, Global Wavelet Spectrum and Hilbert Huang transform (Hilbert Marginal Spectrum) in time-frequency domain representation. The analyses were performed on real frequency signals obtained from FNET GridEye system during the earthquake that triggered the shutdown of the North Anna Nuclear Generating Station in the east coast of the United States. In addition, according to the obtained results the proposed methods have proven to be reliable for identification of the model parameters of low-frequency oscillation in power systems. The relevant analyses are carried out in MATLAB coding environment.