title: SynCity: Training-Free Generation of 3D Worlds
summary: We address the challenge of generating 3D worlds from textual descriptions.
  We propose SynCity, a training- and optimization-free approach, which leverages
  the geometric precision of pre-trained 3D generative models and the artistic
  versatility of 2D image generators to create large, high-quality 3D spaces.
  While most 3D generative models are object-centric and cannot generate
  large-scale worlds, we show how 3D and 2D generators can be combined to
  generate ever-expanding scenes. Through a tile-based approach, we allow
  fine-grained control over the layout and the appearance of scenes. The world is
  generated tile-by-tile, and each new tile is generated within its world-context
  and then fused with the scene. SynCity generates compelling and immersive
  scenes that are rich in detail and diversity.
paper_authors._id: 67dd8e2b0824309332ce3b97
paper_authors.name: Paul Engstler
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-24T08:53:16.508Z
paper_authors._id: 62262603a8218a9b862b18cc
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1648321672399-62262603a8218a9b862b18cc.jpeg
paper_authors.fullname: Paul Engstler
paper_authors.type: user
paper_authors.user: paulengstler
paper_authors._id: 67dd8e2b0824309332ce3b98
paper_authors.name: Aleksandar Shtedritski
paper_authors._id: 67dd8e2b0824309332ce3b99
paper_authors.name: Iro Laina
paper_authors._id: 67dd8e2b0824309332ce3b9a
paper_authors.name: Christian Rupprecht
paper_authors._id: 67dd8e2b0824309332ce3b9b
paper_authors.name: Andrea Vedaldi
paper_title: SynCity: Training-Free Generation of 3D Worlds
paper_summary: We address the challenge of generating 3D worlds from textual descriptions.
  We propose SynCity, a training- and optimization-free approach, which leverages
  the geometric precision of pre-trained 3D generative models and the artistic
  versatility of 2D image generators to create large, high-quality 3D spaces.
  While most 3D generative models are object-centric and cannot generate
  large-scale worlds, we show how 3D and 2D generators can be combined to
  generate ever-expanding scenes. Through a tile-based approach, we allow
  fine-grained control over the layout and the appearance of scenes. The world is
  generated tile-by-tile, and each new tile is generated within its world-context
  and then fused with the scene. SynCity generates compelling and immersive
  scenes that are rich in detail and diversity.
paper_ai_summary: SynCity combines 3D and 2D generative models to create large, high-quality, and immersive 3D worlds from textual descriptions.
paper_ai_keywords: 3D generative models 2D image generators object-centric models tile-based approach scene fusion world-context