3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian
  Splatting
Scene image editing is crucial for entertainment, photography, and
advertising design. Existing methods solely focus on either 2D individual
object or 3D global scene editing. This results in a lack of a unified approach
to effectively control and manipulate scenes at the 3D level with different
levels of granularity. In this work, we propose 3DitScene, a novel and unified
scene editing framework leveraging language-guided disentangled Gaussian
Splatting that enables seamless editing from 2D to 3D, allowing precise control
over scene composition and individual objects. We first incorporate 3D
Gaussians that are refined through generative priors and optimization
techniques. Language features from CLIP then introduce semantics into 3D
geometry for object disentanglement. With the disentangled Gaussians, 3DitScene
allows for manipulation at both the global and individual levels,
revolutionizing creative expression and empowering control over scenes and
objects. Experimental results demonstrate the effectiveness and versatility of
3DitScene in scene image editing. Code and online demo can be found at our
project homepage: https://zqh0253.github.io/3DitScene/.
6657280448d3684f173e81aa
Qihang Zhang
claimed_verified
2024-10-14T07:49:09.480Z
63047acc41387c7f11756284
/avatars/a184fca1ee2d98b81e1917aecc3cdca7.svg
i3h
user
qihang
6657280448d3684f173e81ab
Yinghao Xu
6657280448d3684f173e81ac
Chaoyang Wang
extracted_pending
2024-05-29T13:05:10.067Z
64c166de11f3f1d23a99c6fd
/avatars/d4730f70a6f1cb51266862c7a8d54f77.svg
Chaoyang Wang
user
cwang9
6657280448d3684f173e81ad
Hsin-Ying Lee
6657280448d3684f173e81ae
Gordon Wetzstein
6657280448d3684f173e81af
Bolei Zhou
6657280448d3684f173e81b0
Ceyuan Yang
3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian
  Splatting
Scene image editing is crucial for entertainment, photography, and
advertising design. Existing methods solely focus on either 2D individual
object or 3D global scene editing. This results in a lack of a unified approach
to effectively control and manipulate scenes at the 3D level with different
levels of granularity. In this work, we propose 3DitScene, a novel and unified
scene editing framework leveraging language-guided disentangled Gaussian
Splatting that enables seamless editing from 2D to 3D, allowing precise control
over scene composition and individual objects. We first incorporate 3D
Gaussians that are refined through generative priors and optimization
techniques. Language features from CLIP then introduce semantics into 3D
geometry for object disentanglement. With the disentangled Gaussians, 3DitScene
allows for manipulation at both the global and individual levels,
revolutionizing creative expression and empowering control over scenes and
objects. Experimental results demonstrate the effectiveness and versatility of
3DitScene in scene image editing. Code and online demo can be found at our
project homepage: https://zqh0253.github.io/3DitScene/.
3DitScene uses language-guided disentangled Gaussian Splatting for unified 2D and 3D scene editing, offering precise control at both global and individual levels.
3DitScene Gaussian Splatting generative priors optimization techniques CLIP object disentanglement