title: LDM3D: Latent Diffusion Model for 3D
summary: This research paper proposes a Latent Diffusion Model for 3D (LDM3D) that
  generates both image and depth map data from a given text prompt, allowing
  users to generate RGBD images from text prompts. The LDM3D model is fine-tuned
  on a dataset of tuples containing an RGB image, depth map and caption, and
  validated through extensive experiments. We also develop an application called
  DepthFusion, which uses the generated RGB images and depth maps to create
  immersive and interactive 360-degree-view experiences using TouchDesigner. This
  technology has the potential to transform a wide range of industries, from
  entertainment and gaming to architecture and design. Overall, this paper
  presents a significant contribution to the field of generative AI and computer
  vision, and showcases the potential of LDM3D and DepthFusion to revolutionize
  content creation and digital experiences. A short video summarizing the
  approach can be found at https://t.ly/tdi2.
paper_authors._id: 6466d92acdea48159aa50ea4
paper_authors.name: Gabriela Ben Melech Stan
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2023-05-20T07:01:12.409Z
paper_authors._id: 63174cfddc97a974718f373a
paper_authors.avatarUrl: /avatars/f5a1d5d90abf8aafe8864bc4f1b076cc.svg
paper_authors.fullname: gabriela ben melech
paper_authors.type: user
paper_authors.user: gabsm
paper_authors._id: 6466d92acdea48159aa50ea5
paper_authors.name: Diana Wofk
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2024-09-03T17:05:44.455Z
paper_authors._id: 66d740a519214d743cc30335
paper_authors.avatarUrl: /avatars/bc0839af30a183d5fae0a353d02733e2.svg
paper_authors.fullname: Diana Wofk
paper_authors.type: user
paper_authors.user: dwofk
paper_authors._id: 6466d92acdea48159aa50ea6
paper_authors.name: Scottie Fox
paper_authors._id: 6466d92acdea48159aa50ea7
paper_authors.name: Alex Redden
paper_authors._id: 6466d92acdea48159aa50ea8
paper_authors.name: Will Saxton
paper_authors._id: 6466d92acdea48159aa50ea9
paper_authors.name: Jean Yu
paper_authors.status: extracted_pending
paper_authors.statusLastChangedAt: 2023-05-19T02:04:28.167Z
paper_authors._id: 61041e8e7d91607780688a39
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1627659976701-61041e8e7d91607780688a39.png
paper_authors.fullname: Jean Yu
paper_authors.type: user
paper_authors.user: jean1yu
paper_authors._id: 6466d92acdea48159aa50eaa
paper_authors.name: Estelle Aflalo
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2024-12-18T08:42:40.260Z
paper_authors._id: 64575266900b28f7841090e5
paper_authors.avatarUrl: /avatars/13dc0a370bb24271653c352897a2673e.svg
paper_authors.fullname: Estelle Aflalo
paper_authors.type: user
paper_authors.user: estellea
paper_authors._id: 6466d92acdea48159aa50eab
paper_authors.name: Shao-Yen Tseng
paper_authors._id: 6466d92acdea48159aa50eac
paper_authors.name: Fabio Nonato
paper_authors._id: 6466d92acdea48159aa50ead
paper_authors.name: Matthias Muller
paper_authors._id: 6466d92acdea48159aa50eae
paper_authors.name: Vasudev Lal
paper_authors.status: extracted_pending
paper_authors.statusLastChangedAt: 2023-05-19T02:04:28.167Z
paper_authors._id: 6454021413dba495b2dfebd1
paper_authors.avatarUrl: /avatars/16f019f7c321aa24000364a50a1975fe.svg
paper_authors.fullname: Vasudev Lal
paper_authors.type: user
paper_authors.user: vasudevlal
paper_title: LDM3D: Latent Diffusion Model for 3D
paper_summary: This research paper proposes a Latent Diffusion Model for 3D (LDM3D) that
  generates both image and depth map data from a given text prompt, allowing
  users to generate RGBD images from text prompts. The LDM3D model is fine-tuned
  on a dataset of tuples containing an RGB image, depth map and caption, and
  validated through extensive experiments. We also develop an application called
  DepthFusion, which uses the generated RGB images and depth maps to create
  immersive and interactive 360-degree-view experiences using TouchDesigner. This
  technology has the potential to transform a wide range of industries, from
  entertainment and gaming to architecture and design. Overall, this paper
  presents a significant contribution to the field of generative AI and computer
  vision, and showcases the potential of LDM3D and DepthFusion to revolutionize
  content creation and digital experiences. A short video summarizing the
  approach can be found at https://t.ly/tdi2.
paper_ai_summary: Latent Diffusion Model for 3D (LDM3D) generates RGBD images from text prompts and is used to create immersive 360-degree-view experiences.
paper_ai_keywords: Latent Diffusion Model for 3D LDM3D RGBD images depth map fine-tuning TouchDesigner 360-degree-view generative AI computer vision content creation digital experiences