title: Image Sculpting: Precise Object Editing with 3D Geometry Control
summary: We present Image Sculpting, a new framework for editing 2D images by
  incorporating tools from 3D geometry and graphics. This approach differs
  markedly from existing methods, which are confined to 2D spaces and typically
  rely on textual instructions, leading to ambiguity and limited control. Image
  Sculpting converts 2D objects into 3D, enabling direct interaction with their
  3D geometry. Post-editing, these objects are re-rendered into 2D, merging into
  the original image to produce high-fidelity results through a coarse-to-fine
  enhancement process. The framework supports precise, quantifiable, and
  physically-plausible editing options such as pose editing, rotation,
  translation, 3D composition, carving, and serial addition. It marks an initial
  step towards combining the creative freedom of generative models with the
  precision of graphics pipelines.
paper_authors._id: 65961c518bd8ed3949c44980
paper_authors.name: Jiraphon Yenphraphai
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-01-22T10:31:43.883Z
paper_authors._id: 63daa44df03c3d71ef33da2d
paper_authors.avatarUrl: /avatars/3193967d40b82a7d678b58a8e4d0ec1a.svg
paper_authors.fullname: Jiraphon Yenphraphai
paper_authors.type: user
paper_authors.user: domejiraphon
paper_authors._id: 65961c518bd8ed3949c44981
paper_authors.name: Xichen Pan
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-01-17T21:18:06.834Z
paper_authors._id: 63172831c92fd6fee3181f50
paper_authors.avatarUrl: /avatars/0f57068a138cb181e9451bfc1ed3d1c0.svg
paper_authors.fullname: Xichen Pan
paper_authors.type: user
paper_authors.user: xcpan
paper_authors._id: 65961c518bd8ed3949c44982
paper_authors.name: Sainan Liu
paper_authors._id: 65961c518bd8ed3949c44983
paper_authors.name: Daniele Panozzo
paper_authors._id: 65961c518bd8ed3949c44984
paper_authors.name: Saining Xie
paper_title: Image Sculpting: Precise Object Editing with 3D Geometry Control
paper_summary: We present Image Sculpting, a new framework for editing 2D images by
  incorporating tools from 3D geometry and graphics. This approach differs
  markedly from existing methods, which are confined to 2D spaces and typically
  rely on textual instructions, leading to ambiguity and limited control. Image
  Sculpting converts 2D objects into 3D, enabling direct interaction with their
  3D geometry. Post-editing, these objects are re-rendered into 2D, merging into
  the original image to produce high-fidelity results through a coarse-to-fine
  enhancement process. The framework supports precise, quantifiable, and
  physically-plausible editing options such as pose editing, rotation,
  translation, 3D composition, carving, and serial addition. It marks an initial
  step towards combining the creative freedom of generative models with the
  precision of graphics pipelines.