title: 3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian
    Splatting
summary: Scene image editing is crucial for entertainment, photography, and
  advertising design. Existing methods solely focus on either 2D individual
  object or 3D global scene editing. This results in a lack of a unified approach
  to effectively control and manipulate scenes at the 3D level with different
  levels of granularity. In this work, we propose 3DitScene, a novel and unified
  scene editing framework leveraging language-guided disentangled Gaussian
  Splatting that enables seamless editing from 2D to 3D, allowing precise control
  over scene composition and individual objects. We first incorporate 3D
  Gaussians that are refined through generative priors and optimization
  techniques. Language features from CLIP then introduce semantics into 3D
  geometry for object disentanglement. With the disentangled Gaussians, 3DitScene
  allows for manipulation at both the global and individual levels,
  revolutionizing creative expression and empowering control over scenes and
  objects. Experimental results demonstrate the effectiveness and versatility of
  3DitScene in scene image editing. Code and online demo can be found at our
  project homepage: https://zqh0253.github.io/3DitScene/.
paper_authors._id: 6657280448d3684f173e81aa
paper_authors.name: Qihang Zhang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-14T07:49:09.480Z
paper_authors._id: 63047acc41387c7f11756284
paper_authors.avatarUrl: /avatars/a184fca1ee2d98b81e1917aecc3cdca7.svg
paper_authors.fullname: i3h
paper_authors.type: user
paper_authors.user: qihang
paper_authors._id: 6657280448d3684f173e81ab
paper_authors.name: Yinghao Xu
paper_authors._id: 6657280448d3684f173e81ac
paper_authors.name: Chaoyang Wang
paper_authors.status: extracted_pending
paper_authors.statusLastChangedAt: 2024-05-29T13:05:10.067Z
paper_authors._id: 64c166de11f3f1d23a99c6fd
paper_authors.avatarUrl: /avatars/d4730f70a6f1cb51266862c7a8d54f77.svg
paper_authors.fullname: Chaoyang Wang
paper_authors.type: user
paper_authors.user: cwang9
paper_authors._id: 6657280448d3684f173e81ad
paper_authors.name: Hsin-Ying Lee
paper_authors._id: 6657280448d3684f173e81ae
paper_authors.name: Gordon Wetzstein
paper_authors._id: 6657280448d3684f173e81af
paper_authors.name: Bolei Zhou
paper_authors._id: 6657280448d3684f173e81b0
paper_authors.name: Ceyuan Yang
paper_title: 3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian
    Splatting
paper_summary: Scene image editing is crucial for entertainment, photography, and
  advertising design. Existing methods solely focus on either 2D individual
  object or 3D global scene editing. This results in a lack of a unified approach
  to effectively control and manipulate scenes at the 3D level with different
  levels of granularity. In this work, we propose 3DitScene, a novel and unified
  scene editing framework leveraging language-guided disentangled Gaussian
  Splatting that enables seamless editing from 2D to 3D, allowing precise control
  over scene composition and individual objects. We first incorporate 3D
  Gaussians that are refined through generative priors and optimization
  techniques. Language features from CLIP then introduce semantics into 3D
  geometry for object disentanglement. With the disentangled Gaussians, 3DitScene
  allows for manipulation at both the global and individual levels,
  revolutionizing creative expression and empowering control over scenes and
  objects. Experimental results demonstrate the effectiveness and versatility of
  3DitScene in scene image editing. Code and online demo can be found at our
  project homepage: https://zqh0253.github.io/3DitScene/.
paper_ai_keywords: language-guided disentangled Gaussian Splatting 3D Gaussians generative priors optimization techniques CLIP object disentanglement disentangled Gaussians