Point Transformer V3: Simpler, Faster, Stronger
This paper is not motivated to seek innovation within the attention
mechanism. Instead, it focuses on overcoming the existing trade-offs between
accuracy and efficiency within the context of point cloud processing,
leveraging the power of scale. Drawing inspiration from recent advances in 3D
large-scale representation learning, we recognize that model performance is
more influenced by scale than by intricate design. Therefore, we present Point
Transformer V3 (PTv3), which prioritizes simplicity and efficiency over the
accuracy of certain mechanisms that are minor to the overall performance after
scaling, such as replacing the precise neighbor search by KNN with an efficient
serialized neighbor mapping of point clouds organized with specific patterns.
This principle enables significant scaling, expanding the receptive field from
16 to 1024 points while remaining efficient (a 3x increase in processing speed
and a 10x improvement in memory efficiency compared with its predecessor,
PTv2). PTv3 attains state-of-the-art results on over 20 downstream tasks that
span both indoor and outdoor scenarios. Further enhanced with multi-dataset
joint training, PTv3 pushes these results to a higher level.
657fd7ca156fdf03010c5675
Xiaoyang Wu
admin_assigned
2023-12-18T10:25:14.387Z
643e5d6a1d0e956d94bb3608
https://cdn-avatars.huggingface.co/v1/production/uploads/643e5d6a1d0e956d94bb3608/mTnu7Dts2RmDklHlp9Gqu.jpeg
Xiaoyang Wu
user
Gofinge
657fd7ca156fdf03010c5676
Li Jiang
657fd7ca156fdf03010c5677
Peng-Shuai Wang
admin_assigned
2023-12-18T10:31:06.386Z
6333aabd5bcc1a4fe14d73de
https://cdn-avatars.huggingface.co/v1/production/uploads/6333aabd5bcc1a4fe14d73de/UclHAK80-kRtRPNJ8o3Dt.jpeg
Peng-Shuai Wang
user
wangps
657fd7ca156fdf03010c5678
Zhijian Liu
admin_assigned
2023-12-18T10:31:14.645Z
650dac79b959b0e1d41d7378
https://cdn-avatars.huggingface.co/v1/production/uploads/650dac79b959b0e1d41d7378/mzbN0MFk3k8b94FQ40I7L.jpeg
Zhijian Liu
user
zhijianliu
657fd7ca156fdf03010c5679
Xihui Liu
claimed_verified
2024-06-03T18:29:53.041Z
65d5ec74cd05bc1eaa125040
/avatars/2de1b1539a86452c2c89570eeb02f5ab.svg
Xihui Liu
user
XihuiLiu
657fd7ca156fdf03010c567a
Yu Qiao
657fd7ca156fdf03010c567b
Wanli Ouyang
657fd7ca156fdf03010c567c
Tong He
claimed_verified
2025-07-17T13:57:05.457Z
6747ede3a9c72aebe1322382
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/inILqQ05sESbYLdsEldJ_.png
Tong He
user
tonghe90
657fd7ca156fdf03010c567d
Hengshuang Zhao
Point Transformer V3: Simpler, Faster, Stronger
This paper is not motivated to seek innovation within the attention
mechanism. Instead, it focuses on overcoming the existing trade-offs between
accuracy and efficiency within the context of point cloud processing,
leveraging the power of scale. Drawing inspiration from recent advances in 3D
large-scale representation learning, we recognize that model performance is
more influenced by scale than by intricate design. Therefore, we present Point
Transformer V3 (PTv3), which prioritizes simplicity and efficiency over the
accuracy of certain mechanisms that are minor to the overall performance after
scaling, such as replacing the precise neighbor search by KNN with an efficient
serialized neighbor mapping of point clouds organized with specific patterns.
This principle enables significant scaling, expanding the receptive field from
16 to 1024 points while remaining efficient (a 3x increase in processing speed
and a 10x improvement in memory efficiency compared with its predecessor,
PTv2). PTv3 attains state-of-the-art results on over 20 downstream tasks that
span both indoor and outdoor scenarios. Further enhanced with multi-dataset
joint training, PTv3 pushes these results to a higher level.
Point Transformer V3 improves efficiency and scaling in point cloud processing, achieving state-of-the-art performance by simplifying neighbor search and expanding receptive field.
Point Transformer V3 PTv3 3D large-scale representation learning neighbor search serialized neighbor mapping receptive field processing speed memory efficiency multi-dataset joint training downstream tasks indoor scenarios outdoor scenarios