P3P: Pseudo-3D Pre-training for Scaling 3D Masked Autoencoders
<|reference_start|>P3P: Pseudo-3D Pre-training for Scaling 3D Masked Autoencoders: 3D pre-training is crucial to 3D perception tasks. However, limited by the difficulties in collecting clean 3D data, 3D pre-training consistently faced data scaling challenges. Inspired by semi-supervised learning leveraging limited labeled data and a large amount of unlabeled data, in this work, we propose a novel self-supervised pre-training framework utilizing the real 3D data and the pseudo-3D data lifted from images by a large depth estimation model. Another challenge lies in the efficiency. Previous methods such as Point-BERT and Point-MAE, employ k nearest neighbors to embed 3D tokens, requiring quadratic time complexity. To efficiently pre-train on such a large amount of data, we propose a linear-time-complexity token embedding strategy and a training-efficient 2D reconstruction target. Our method achieves state-of-the-art performance in 3D classification and few-shot learning while maintaining high pre-training and downstream fine-tuning efficiency.<|reference_end|>
@article{chen2024p3p:,
    title={P3P: Pseudo-3D Pre-training for Scaling 3D Masked Autoencoders},
    author={Xuechao Chen, Ying Chen, Jialin Li, Qiang Nie, Yong Liu, Qixing Huang,
  Yang Li},
    journal={arXiv preprint arXiv:2408.10007},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.10007},
    primaryClass={cs.CV}
}