ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via
  Gaussian Splatting
3D Gaussian Splatting is renowned for its high-fidelity reconstructions and
real-time novel view synthesis, yet its lack of semantic understanding limits
object-level perception. In this work, we propose ObjectGS, an object-aware
framework that unifies 3D scene reconstruction with semantic understanding.
Instead of treating the scene as a unified whole, ObjectGS models individual
objects as local anchors that generate neural Gaussians and share object IDs,
enabling precise object-level reconstruction. During training, we dynamically
grow or prune these anchors and optimize their features, while a one-hot ID
encoding with a classification loss enforces clear semantic constraints. We
show through extensive experiments that ObjectGS not only outperforms
state-of-the-art methods on open-vocabulary and panoptic segmentation tasks,
but also integrates seamlessly with applications like mesh extraction and scene
editing. Project page: https://ruijiezhu94.github.io/ObjectGS_page
68805c4300f4b5a05f2fbe60
Ruijie Zhu
admin_assigned
2025-07-23T13:30:45.047Z
6697ac8427e4e21a3a92da27
https://cdn-avatars.huggingface.co/v1/production/uploads/6697ac8427e4e21a3a92da27/9vn07-1_BBDk9zfDtDpcG.png
Ruijie Zhu
user
RuijieZhu
68805c4300f4b5a05f2fbe61
Mulin Yu
68805c4300f4b5a05f2fbe62
Linning Xu
68805c4300f4b5a05f2fbe63
Lihan Jiang
68805c4300f4b5a05f2fbe64
Yixuan Li
68805c4300f4b5a05f2fbe65
Tianzhu Zhang
admin_assigned
2025-07-23T13:31:27.940Z
662b8d0083de3e26a6d9f1d1
/avatars/d9566ba1881f86413f5de10a45f24673.svg
Tianzhu Zhang
user
ztz1989
68805c4300f4b5a05f2fbe66
Jiangmiao Pang
admin_assigned
2025-07-23T13:31:33.842Z
65783ee6ee33d547aecc3ffc
https://cdn-avatars.huggingface.co/v1/production/uploads/65783ee6ee33d547aecc3ffc/lWZX88c-0dCsN-yB9Jhlf.jpeg
Jiangmiao Pang
user
Jiangmiao
68805c4300f4b5a05f2fbe67
Bo Dai
ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via
  Gaussian Splatting
3D Gaussian Splatting is renowned for its high-fidelity reconstructions and
real-time novel view synthesis, yet its lack of semantic understanding limits
object-level perception. In this work, we propose ObjectGS, an object-aware
framework that unifies 3D scene reconstruction with semantic understanding.
Instead of treating the scene as a unified whole, ObjectGS models individual
objects as local anchors that generate neural Gaussians and share object IDs,
enabling precise object-level reconstruction. During training, we dynamically
grow or prune these anchors and optimize their features, while a one-hot ID
encoding with a classification loss enforces clear semantic constraints. We
show through extensive experiments that ObjectGS not only outperforms
state-of-the-art methods on open-vocabulary and panoptic segmentation tasks,
but also integrates seamlessly with applications like mesh extraction and scene
editing. Project page: https://ruijiezhu94.github.io/ObjectGS_page
ObjectGS is an object-aware framework that combines 3D scene reconstruction with semantic understanding, enabling precise object-level reconstruction and outperforming state-of-the-art methods in segmentation and integration tasks.
3D Gaussian Splatting ObjectGS neural Gaussians one-hot ID encoding classification loss open-vocabulary segmentation panoptic segmentation mesh extraction scene editing