title: HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation
summary: Scene-level 3D generation represents a critical frontier in multimedia and
  computer graphics, yet existing approaches either suffer from limited object
  categories or lack editing flexibility for interactive applications. In this
  paper, we present HiScene, a novel hierarchical framework that bridges the gap
  between 2D image generation and 3D object generation and delivers high-fidelity
  scenes with compositional identities and aesthetic scene content. Our key
  insight is treating scenes as hierarchical "objects" under isometric views,
  where a room functions as a complex object that can be further decomposed into
  manipulatable items. This hierarchical approach enables us to generate 3D
  content that aligns with 2D representations while maintaining compositional
  structure. To ensure completeness and spatial alignment of each decomposed
  instance, we develop a video-diffusion-based amodal completion technique that
  effectively handles occlusions and shadows between objects, and introduce shape
  prior injection to ensure spatial coherence within the scene. Experimental
  results demonstrate that our method produces more natural object arrangements
  and complete object instances suitable for interactive applications, while
  maintaining physical plausibility and alignment with user inputs.
paper_authors._id: 6805bfc5e332a61dd90160b0
paper_authors.name: Wenqi Dong
paper_authors._id: 6805bfc5e332a61dd90160b1
paper_authors.name: Bangbang Yang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-04-22T09:52:51.612Z
paper_authors._id: 63d748ff6f49aa82306b7e48
paper_authors.avatarUrl: /avatars/9f0b8b8a09b14d76e52ed1bd312e6b63.svg
paper_authors.fullname: BB Yang
paper_authors.type: user
paper_authors.user: ybbbbt
paper_authors._id: 6805bfc5e332a61dd90160b2
paper_authors.name: Zesong Yang
paper_authors._id: 6805bfc5e332a61dd90160b3
paper_authors.name: Yuan Li
paper_authors._id: 6805bfc5e332a61dd90160b4
paper_authors.name: Tao Hu
paper_authors._id: 6805bfc5e332a61dd90160b5
paper_authors.name: Hujun Bao
paper_authors._id: 6805bfc5e332a61dd90160b6
paper_authors.name: Yuewen Ma
paper_authors._id: 6805bfc5e332a61dd90160b7
paper_authors.name: Zhaopeng Cui
paper_title: HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation
paper_summary: Scene-level 3D generation represents a critical frontier in multimedia and
  computer graphics, yet existing approaches either suffer from limited object
  categories or lack editing flexibility for interactive applications. In this
  paper, we present HiScene, a novel hierarchical framework that bridges the gap
  between 2D image generation and 3D object generation and delivers high-fidelity
  scenes with compositional identities and aesthetic scene content. Our key
  insight is treating scenes as hierarchical "objects" under isometric views,
  where a room functions as a complex object that can be further decomposed into
  manipulatable items. This hierarchical approach enables us to generate 3D
  content that aligns with 2D representations while maintaining compositional
  structure. To ensure completeness and spatial alignment of each decomposed
  instance, we develop a video-diffusion-based amodal completion technique that
  effectively handles occlusions and shadows between objects, and introduce shape
  prior injection to ensure spatial coherence within the scene. Experimental
  results demonstrate that our method produces more natural object arrangements
  and complete object instances suitable for interactive applications, while
  maintaining physical plausibility and alignment with user inputs.
paper_ai_summary: A hierarchical framework called HiScene combines 2D image and 3D object generation using video-diffusion for amodal completion and shape priors to produce coherent, high-fidelity, interactive 3D scenes.
paper_ai_keywords: hierarchical framework 2D image generation 3D object generation isometric views video-diffusion amodal completion spatial coherence compositional identities aesthetic scene content natural object arrangements physical plausibility user inputs