GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided
  Generative Gaussian Splatting
We present GALA3D, generative 3D GAussians with LAyout-guided control, for
effective compositional text-to-3D generation. We first utilize large language
models (LLMs) to generate the initial layout and introduce a layout-guided 3D
Gaussian representation for 3D content generation with adaptive geometric
constraints. We then propose an object-scene compositional optimization
mechanism with conditioned diffusion to collaboratively generate realistic 3D
scenes with consistent geometry, texture, scale, and accurate interactions
among multiple objects while simultaneously adjusting the coarse layout priors
extracted from the LLMs to align with the generated scene. Experiments show
that GALA3D is a user-friendly, end-to-end framework for state-of-the-art
scene-level 3D content generation and controllable editing while ensuring the
high fidelity of object-level entities within the scene. Source codes and
models will be available at https://gala3d.github.io/.
65cadb0805cc358d07f5dca4
Xiaoyu Zhou
65cadb0805cc358d07f5dca5
Xingjian Ran
65cadb0805cc358d07f5dca6
Yajiao Xiong
admin_assigned
2024-02-13T13:50:48.407Z
658976866cf9325ae6e3a10f
/avatars/85ef8bdc24191ee3ce3eb277d0223aad.svg
yajiao xiong
user
yajiao
65cadb0805cc358d07f5dca7
Jinlin He
65cadb0805cc358d07f5dca8
Zhiwei Lin
65cadb0805cc358d07f5dca9
Yongtao Wang
65cadb0805cc358d07f5dcaa
Deqing Sun
65cadb0805cc358d07f5dcab
Ming-Hsuan Yang
GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided
  Generative Gaussian Splatting
We present GALA3D, generative 3D GAussians with LAyout-guided control, for
effective compositional text-to-3D generation. We first utilize large language
models (LLMs) to generate the initial layout and introduce a layout-guided 3D
Gaussian representation for 3D content generation with adaptive geometric
constraints. We then propose an object-scene compositional optimization
mechanism with conditioned diffusion to collaboratively generate realistic 3D
scenes with consistent geometry, texture, scale, and accurate interactions
among multiple objects while simultaneously adjusting the coarse layout priors
extracted from the LLMs to align with the generated scene. Experiments show
that GALA3D is a user-friendly, end-to-end framework for state-of-the-art
scene-level 3D content generation and controllable editing while ensuring the
high fidelity of object-level entities within the scene. Source codes and
models will be available at https://gala3d.github.io/.
GALA3D is a generative framework for 3D content that uses large language models and conditioned diffusion for layout-guided, compositional scene generation, ensuring high fidelity and realistic object interactions.
large language models LLMs layout-guided 3D Gaussian object-scene compositional optimization conditioned diffusion .scene-level 3D content generation controllable editing high fidelity object-level entities