PPTFormer: Pseudo Multi-Perspective Transformer for UAV Segmentation
<|reference_start|>PPTFormer: Pseudo Multi-Perspective Transformer for UAV Segmentation: The ascension of Unmanned Aerial Vehicles (UAVs) in various fields necessitates effective UAV image segmentation, which faces challenges due to the dynamic perspectives of UAV-captured images. Traditional segmentation algorithms falter as they cannot accurately mimic the complexity of UAV perspectives, and the cost of obtaining multi-perspective labeled datasets is prohibitive. To address these issues, we introduce the PPTFormer, a novel \textbf{P}seudo Multi-\textbf{P}erspective \textbf{T}rans\textbf{former} network that revolutionizes UAV image segmentation. Our approach circumvents the need for actual multi-perspective data by creating pseudo perspectives for enhanced multi-perspective learning. The PPTFormer network boasts Perspective Representation, novel Perspective Prototypes, and a specialized encoder and decoder that together achieve superior segmentation results through Pseudo Multi-Perspective Attention (PMP Attention) and fusion. Our experiments demonstrate that PPTFormer achieves state-of-the-art performance across five UAV segmentation datasets, confirming its capability to effectively simulate UAV flight perspectives and significantly advance segmentation precision. This work presents a pioneering leap in UAV scene understanding and sets a new benchmark for future developments in semantic segmentation.<|reference_end|>
@article{ji2024pptformer:,
    title={PPTFormer: Pseudo Multi-Perspective Transformer for UAV Segmentation},
    author={Deyi Ji, Wenwei Jin, Hongtao Lu, Feng Zhao},
    journal={arXiv preprint arXiv:2406.19632},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.19632},
    primaryClass={cs.CV}
}