title: ShowRoom3D: Text to High-Quality 3D Room Generation Using 3D Priors
summary: We introduce ShowRoom3D, a three-stage approach for generating high-quality
  3D room-scale scenes from texts. Previous methods using 2D diffusion priors to
  optimize neural radiance fields for generating room-scale scenes have shown
  unsatisfactory quality. This is primarily attributed to the limitations of 2D
  priors lacking 3D awareness and constraints in the training methodology. In
  this paper, we utilize a 3D diffusion prior, MVDiffusion, to optimize the 3D
  room-scale scene. Our contributions are in two aspects. Firstly, we propose a
  progressive view selection process to optimize NeRF. This involves dividing the
  training process into three stages, gradually expanding the camera sampling
  scope. Secondly, we propose the pose transformation method in the second stage.
  It will ensure MVDiffusion provide the accurate view guidance. As a result,
  ShowRoom3D enables the generation of rooms with improved structural integrity,
  enhanced clarity from any view, reduced content repetition, and higher
  consistency across different perspectives. Extensive experiments demonstrate
  that our method, significantly outperforms state-of-the-art approaches by a
  large margin in terms of user study.
paper_authors._id: 658513e42189951844e7397b
paper_authors.name: Weijia Mao
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-22T12:05:28.131Z
paper_authors._id: 63f320ee0be81bdc5d8ecb88
paper_authors.avatarUrl: /avatars/9d08cff6ed23a51887c869947bc03228.svg
paper_authors.fullname: Mao Weijia
paper_authors.type: user
paper_authors.user: benzweijia
paper_authors._id: 658513e42189951844e7397c
paper_authors.name: Yan-Pei Cao
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-22T12:05:38.257Z
paper_authors._id: 638066faf022c8a5803f7eb8
paper_authors.avatarUrl: /avatars/4cfd699c3f6c5461b12b7dc5e3fe183d.svg
paper_authors.fullname: Yanpei Cao
paper_authors.type: user
paper_authors.user: pookiefoof
paper_authors._id: 658513e42189951844e7397d
paper_authors.name: Jia-Wei Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-22T12:06:22.545Z
paper_authors._id: 64230048a73327caad9d8241
paper_authors.avatarUrl: /avatars/ac115f1a21c743db7c925f0e18451145.svg
paper_authors.fullname: Jiawei Liu
paper_authors.type: user
paper_authors.user: JiaweiLIU
paper_authors._id: 658513e42189951844e7397e
paper_authors.name: Zhongcong Xu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-22T12:06:29.413Z
paper_authors._id: 631c2bed7f7a1b6cb9f6b114
paper_authors.avatarUrl: /avatars/97d2c0b6123691ea27157ebf8da59b45.svg
paper_authors.fullname: Zhongcong Xu
paper_authors.type: user
paper_authors.user: zcxu-eric
paper_authors._id: 658513e42189951844e7397f
paper_authors.name: Mike Zheng Shou
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-22T12:06:41.146Z
paper_authors._id: 63a55320ce5763e06f78519c
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1671779060549-noauth.jpeg
paper_authors.fullname: Mike Shou
paper_authors.type: user
paper_authors.user: mikeshou
paper_title: ShowRoom3D: Text to High-Quality 3D Room Generation Using 3D Priors
paper_summary: We introduce ShowRoom3D, a three-stage approach for generating high-quality
  3D room-scale scenes from texts. Previous methods using 2D diffusion priors to
  optimize neural radiance fields for generating room-scale scenes have shown
  unsatisfactory quality. This is primarily attributed to the limitations of 2D
  priors lacking 3D awareness and constraints in the training methodology. In
  this paper, we utilize a 3D diffusion prior, MVDiffusion, to optimize the 3D
  room-scale scene. Our contributions are in two aspects. Firstly, we propose a
  progressive view selection process to optimize NeRF. This involves dividing the
  training process into three stages, gradually expanding the camera sampling
  scope. Secondly, we propose the pose transformation method in the second stage.
  It will ensure MVDiffusion provide the accurate view guidance. As a result,
  ShowRoom3D enables the generation of rooms with improved structural integrity,
  enhanced clarity from any view, reduced content repetition, and higher
  consistency across different perspectives. Extensive experiments demonstrate
  that our method, significantly outperforms state-of-the-art approaches by a
  large margin in terms of user study.
paper_ai_summary: ShowRoom3D generates high-quality 3D room-scale scenes from texts using a 3D diffusion prior and a progressive view selection process, improving structural integrity and clarity across different perspectives.
paper_ai_keywords: MVDiffusion NeRF 3D diffusion prior progressive view selection pose transformation 3D room-scale scenes