title: Toon3D: Seeing Cartoons from a New Perspective
summary: In this work, we recover the underlying 3D structure of non-geometrically
  consistent scenes. We focus our analysis on hand-drawn images from cartoons and
  anime. Many cartoons are created by artists without a 3D rendering engine,
  which means that any new image of a scene is hand-drawn. The hand-drawn images
  are usually faithful representations of the world, but only in a qualitative
  sense, since it is difficult for humans to draw multiple perspectives of an
  object or scene 3D consistently. Nevertheless, people can easily perceive 3D
  scenes from inconsistent inputs! In this work, we correct for 2D drawing
  inconsistencies to recover a plausible 3D structure such that the newly warped
  drawings are consistent with each other. Our pipeline consists of a
  user-friendly annotation tool, camera pose estimation, and image deformation to
  recover a dense structure. Our method warps images to obey a perspective camera
  model, enabling our aligned results to be plugged into novel-view synthesis
  reconstruction methods to experience cartoons from viewpoints never drawn
  before. Our project page is https://toon3d.studio/.
paper_authors._id: 6646c47aa30e3f066b45a2d0
paper_authors.name: Ethan Weber
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-17T10:17:17.992Z
paper_authors._id: 6378485d9e1c10ecc27dc48e
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6378485d9e1c10ecc27dc48e/Wnv495k1VdGyAuDvgiSeP.png
paper_authors.fullname: Ethan Weber
paper_authors.type: user
paper_authors.user: ethanweber
paper_authors._id: 6646c47aa30e3f066b45a2d1
paper_authors.name: Riley Peterlinz
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-05-20T07:38:31.170Z
paper_authors._id: 6647cf7fe98cc94717981117
paper_authors.avatarUrl: /avatars/dea87dbcb73dee1185aa1b08b3138035.svg
paper_authors.fullname: Riley Peterlinz
paper_authors.type: user
paper_authors.user: cardiacmangoes
paper_authors._id: 6646c47aa30e3f066b45a2d2
paper_authors.name: Rohan Mathur
paper_authors._id: 6646c47aa30e3f066b45a2d3
paper_authors.name: Frederik Warburg
paper_authors._id: 6646c47aa30e3f066b45a2d4
paper_authors.name: Alexei A. Efros
paper_authors._id: 6646c47aa30e3f066b45a2d5
paper_authors.name: Angjoo Kanazawa
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-17T10:18:35.997Z
paper_authors._id: 6478cf7150ff7001631679c3
paper_authors.avatarUrl: /avatars/65ec385a9cc44c972e6caf952e759ff1.svg
paper_authors.fullname: Angjoo Kanazawa
paper_authors.type: user
paper_authors.user: akanazawa
paper_title: Toon3D: Seeing Cartoons from a New Perspective
paper_summary: In this work, we recover the underlying 3D structure of non-geometrically
  consistent scenes. We focus our analysis on hand-drawn images from cartoons and
  anime. Many cartoons are created by artists without a 3D rendering engine,
  which means that any new image of a scene is hand-drawn. The hand-drawn images
  are usually faithful representations of the world, but only in a qualitative
  sense, since it is difficult for humans to draw multiple perspectives of an
  object or scene 3D consistently. Nevertheless, people can easily perceive 3D
  scenes from inconsistent inputs! In this work, we correct for 2D drawing
  inconsistencies to recover a plausible 3D structure such that the newly warped
  drawings are consistent with each other. Our pipeline consists of a
  user-friendly annotation tool, camera pose estimation, and image deformation to
  recover a dense structure. Our method warps images to obey a perspective camera
  model, enabling our aligned results to be plugged into novel-view synthesis
  reconstruction methods to experience cartoons from viewpoints never drawn
  before. Our project page is https://toon3d.studio/.
paper_ai_keywords: 3D structure hand-drawn images cartoons anime 3D rendering engine 2D drawing inconsistencies dense structure camera pose estimation image deformation perspective camera model novel-view synthesis reconstruction methods