WildGaussians: 3D Gaussian Splatting in the Wild
While the field of 3D scene reconstruction is dominated by NeRFs due to their
photorealistic quality, 3D Gaussian Splatting (3DGS) has recently emerged,
offering similar quality with real-time rendering speeds. However, both methods
primarily excel with well-controlled 3D scenes, while in-the-wild data -
characterized by occlusions, dynamic objects, and varying illumination -
remains challenging. NeRFs can adapt to such conditions easily through
per-image embedding vectors, but 3DGS struggles due to its explicit
representation and lack of shared parameters. To address this, we introduce
WildGaussians, a novel approach to handle occlusions and appearance changes
with 3DGS. By leveraging robust DINO features and integrating an appearance
modeling module within 3DGS, our method achieves state-of-the-art results. We
demonstrate that WildGaussians matches the real-time rendering speed of 3DGS
while surpassing both 3DGS and NeRF baselines in handling in-the-wild data, all
within a simple architectural framework.
66908e3fd9bea967d8c81afc
Jonas Kulhanek
claimed_verified
2024-07-15T09:00:56.376Z
5f982721777efc07d7f1e228
https://cdn-avatars.huggingface.co/v1/production/uploads/5f982721777efc07d7f1e228/GhFops14sTmASRX4bDFRT.png
Jonáš Kulhánek
user
jkulhanek
66908e3fd9bea967d8c81afd
Songyou Peng
admin_assigned
2024-07-12T12:13:25.247Z
620cb0722d8bc91e1cf2e6e7
https://cdn-avatars.huggingface.co/v1/production/uploads/1644998719617-noauth.jpeg
Songyou Peng
user
syp
66908e3fd9bea967d8c81afe
Zuzana Kukelova
66908e3fd9bea967d8c81aff
Marc Pollefeys
claimed_verified
2025-02-25T09:42:27.564Z
67b5fa179782a5e2fd2cb26a
/avatars/62c38f29ec641e001eeddf840bea21a0.svg
Marc Pollefeys
user
mapo1
66908e3fd9bea967d8c81b00
Torsten Sattler
admin_assigned
2024-07-12T12:13:47.086Z
63105b1a7d9fc84aba584162
/avatars/d67c8ad72fec8595c2dff7de5dc21964.svg
Torsten Sattler
user
tsattler
WildGaussians: 3D Gaussian Splatting in the Wild
While the field of 3D scene reconstruction is dominated by NeRFs due to their
photorealistic quality, 3D Gaussian Splatting (3DGS) has recently emerged,
offering similar quality with real-time rendering speeds. However, both methods
primarily excel with well-controlled 3D scenes, while in-the-wild data -
characterized by occlusions, dynamic objects, and varying illumination -
remains challenging. NeRFs can adapt to such conditions easily through
per-image embedding vectors, but 3DGS struggles due to its explicit
representation and lack of shared parameters. To address this, we introduce
WildGaussians, a novel approach to handle occlusions and appearance changes
with 3DGS. By leveraging robust DINO features and integrating an appearance
modeling module within 3DGS, our method achieves state-of-the-art results. We
demonstrate that WildGaussians matches the real-time rendering speed of 3DGS
while surpassing both 3DGS and NeRF baselines in handling in-the-wild data, all
within a simple architectural framework.
WildGaussians enhances real-time 3DGS rendering with robust DINO features and appearance modeling to handle in-the-wild data challenges.
NeRFs 3D Gaussian Splatting 3DGS WildGaussians DINO features appearance modeling photorealistic quality real-time rendering occlusions dynamic objects varying illumination per-image embedding vectors explicit representation shared parameters in-the-wild data