title: AuraFusion360: Augmented Unseen Region Alignment for Reference-based
    360° Unbounded Scene Inpainting
summary: Three-dimensional scene inpainting is crucial for applications from virtual
  reality to architectural visualization, yet existing methods struggle with view
  consistency and geometric accuracy in 360{\deg} unbounded scenes. We present
  AuraFusion360, a novel reference-based method that enables high-quality object
  removal and hole filling in 3D scenes represented by Gaussian Splatting. Our
  approach introduces (1) depth-aware unseen mask generation for accurate
  occlusion identification, (2) Adaptive Guided Depth Diffusion, a zero-shot
  method for accurate initial point placement without requiring additional
  training, and (3) SDEdit-based detail enhancement for multi-view coherence. We
  also introduce 360-USID, the first comprehensive dataset for 360{\deg}
  unbounded scene inpainting with ground truth. Extensive experiments demonstrate
  that AuraFusion360 significantly outperforms existing methods, achieving
  superior perceptual quality while maintaining geometric accuracy across
  dramatic viewpoint changes. See our project page for video results and the
  dataset at https://kkennethwu.github.io/aurafusion360/.
paper_authors._id: 67a9889dc1fbde5146aba8b1
paper_authors.name: Chung-Ho Wu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-02-10T16:08:15.192Z
paper_authors._id: 65d70288ca16ef9ba7f72542
paper_authors.avatarUrl: /avatars/8ceec128b7e7be6d1b4c615b9eced98d.svg
paper_authors.fullname: Chung-Ho Wu
paper_authors.type: user
paper_authors.user: kkennethwu
paper_authors._id: 67a9889dc1fbde5146aba8b2
paper_authors.name: Yang-Jung Chen
paper_authors._id: 67a9889dc1fbde5146aba8b3
paper_authors.name: Ying-Huan Chen
paper_authors._id: 67a9889dc1fbde5146aba8b4
paper_authors.name: Jie-Ying Lee
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-18T09:34:52.729Z
paper_authors._id: 655f1770f74fa124d1172ec1
paper_authors.avatarUrl: /avatars/e4413693c34974fac75a438ffe2cc630.svg
paper_authors.fullname: Jay Lee
paper_authors.type: user
paper_authors.user: jayinnn
paper_authors._id: 67a9889dc1fbde5146aba8b5
paper_authors.name: Bo-Hsu Ke
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-02-10T16:08:43.078Z
paper_authors._id: 67173302fd698e5b2a9c91dd
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/7_5xqQEShNkkKpGbjFIjG.png
paper_authors.fullname: Bo-Hsu Ke
paper_authors.type: user
paper_authors.user: Hentci
paper_authors._id: 67a9889dc1fbde5146aba8b6
paper_authors.name: Chun-Wei Tuan Mu
paper_authors._id: 67a9889dc1fbde5146aba8b7
paper_authors.name: Yi-Chuan Huang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-02-10T16:09:08.174Z
paper_authors._id: 665d84f05fdfe8f923fb0fe2
paper_authors.avatarUrl: /avatars/71fa629eda3d34d5d854055f2a905b53.svg
paper_authors.fullname: Yichuan Huang
paper_authors.type: user
paper_authors.user: yichuan-huang
paper_authors._id: 67a9889dc1fbde5146aba8b8
paper_authors.name: Chin-Yang Lin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-02-10T16:09:19.714Z
paper_authors._id: 66b9d0996f861799b80b457a
paper_authors.avatarUrl: /avatars/31d4989c5e0983283a6a8e8a152b82e6.svg
paper_authors.fullname: CY Lin
paper_authors.type: user
paper_authors.user: chinyanglin
paper_authors._id: 67a9889dc1fbde5146aba8b9
paper_authors.name: Min-Hung Chen
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-10T09:49:50.370Z
paper_authors._id: 64ae22dd1aee69ece065cdcd
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64ae22dd1aee69ece065cdcd/JG7QaHIrr4i2k4uwR4pZK.png
paper_authors.fullname: Min-Hung Chen
paper_authors.type: user
paper_authors.user: cmhungsteve
paper_authors._id: 67a9889dc1fbde5146aba8ba
paper_authors.name: Yen-Yu Lin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-02-10T16:09:38.418Z
paper_authors._id: 65cd7863b2e8d2486a01bd49
paper_authors.avatarUrl: /avatars/33a9c978924e69bcc5db1e620ff3c0f7.svg
paper_authors.fullname: YenYu Lin
paper_authors.type: user
paper_authors.user: Yenyu
paper_authors._id: 67a9889dc1fbde5146aba8bb
paper_authors.name: Yu-Lun Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-02-10T16:09:49.464Z
paper_authors._id: 6459d5da3b6fafd9664807ab
paper_authors.avatarUrl: /avatars/57430d1bbde3a2fe5586e5fbcafb0e74.svg
paper_authors.fullname: Yu-Lun Liu
paper_authors.type: user
paper_authors.user: yulunliu
paper_title: AuraFusion360: Augmented Unseen Region Alignment for Reference-based
    360° Unbounded Scene Inpainting
paper_summary: Three-dimensional scene inpainting is crucial for applications from virtual
  reality to architectural visualization, yet existing methods struggle with view
  consistency and geometric accuracy in 360{\deg} unbounded scenes. We present
  AuraFusion360, a novel reference-based method that enables high-quality object
  removal and hole filling in 3D scenes represented by Gaussian Splatting. Our
  approach introduces (1) depth-aware unseen mask generation for accurate
  occlusion identification, (2) Adaptive Guided Depth Diffusion, a zero-shot
  method for accurate initial point placement without requiring additional
  training, and (3) SDEdit-based detail enhancement for multi-view coherence. We
  also introduce 360-USID, the first comprehensive dataset for 360{\deg}
  unbounded scene inpainting with ground truth. Extensive experiments demonstrate
  that AuraFusion360 significantly outperforms existing methods, achieving
  superior perceptual quality while maintaining geometric accuracy across
  dramatic viewpoint changes. See our project page for video results and the
  dataset at https://kkennethwu.github.io/aurafusion360/.
paper_ai_keywords: Gaussian Splatting depth-aware unseen mask generation Adaptive Guided Depth Diffusion zero-shot method SDEdit-based detail enhancement multi-view coherence 360-USID superior perceptual quality geometric accuracy viewpoint changes