title: PanoDreamer: 3D Panorama Synthesis from a Single Image
summary: In this paper, we present PanoDreamer, a novel method for producing a
  coherent 360^circ 3D scene from a single input image. Unlike existing
  methods that generate the scene sequentially, we frame the problem as
  single-image panorama and depth estimation. Once the coherent panoramic image
  and its corresponding depth are obtained, the scene can be reconstructed by
  inpainting the small occluded regions and projecting them into 3D space. Our
  key contribution is formulating single-image panorama and depth estimation as
  two optimization tasks and introducing alternating minimization strategies to
  effectively solve their objectives. We demonstrate that our approach
  outperforms existing techniques in single-image 360^circ scene
  reconstruction in terms of consistency and overall quality.
paper_authors._id: 67571984b7e7a3a88b153420
paper_authors.name: Avinash Paliwal
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-18T13:48:37.553Z
paper_authors._id: 66f1849b811e666a828556b4
paper_authors.avatarUrl: /avatars/d01d9233a3e229223e1226d84270e1f8.svg
paper_authors.fullname: Avinash Paliwal
paper_authors.type: user
paper_authors.user: avinashpaliwal
paper_authors._id: 67571984b7e7a3a88b153421
paper_authors.name: Xilong Zhou
paper_authors._id: 67571984b7e7a3a88b153422
paper_authors.name: Andrii Tsarov
paper_authors._id: 67571984b7e7a3a88b153423
paper_authors.name: Nima Khademi Kalantari
paper_title: PanoDreamer: 3D Panorama Synthesis from a Single Image
paper_summary: In this paper, we present PanoDreamer, a novel method for producing a
  coherent 360^circ 3D scene from a single input image. Unlike existing
  methods that generate the scene sequentially, we frame the problem as
  single-image panorama and depth estimation. Once the coherent panoramic image
  and its corresponding depth are obtained, the scene can be reconstructed by
  inpainting the small occluded regions and projecting them into 3D space. Our
  key contribution is formulating single-image panorama and depth estimation as
  two optimization tasks and introducing alternating minimization strategies to
  effectively solve their objectives. We demonstrate that our approach
  outperforms existing techniques in single-image 360^circ scene
  reconstruction in terms of consistency and overall quality.
paper_ai_summary: A new method, PanoDreamer, reconstructs a 360° 3D scene from a single image by formulating panorama and depth estimation as optimization tasks and using alternating minimization.
paper_ai_keywords: single-image panorama depth estimation optimization tasks alternating minimization