Toon3D: Seeing Cartoons from a New Perspective
In this work, we recover the underlying 3D structure of non-geometrically
consistent scenes. We focus our analysis on hand-drawn images from cartoons and
anime. Many cartoons are created by artists without a 3D rendering engine,
which means that any new image of a scene is hand-drawn. The hand-drawn images
are usually faithful representations of the world, but only in a qualitative
sense, since it is difficult for humans to draw multiple perspectives of an
object or scene 3D consistently. Nevertheless, people can easily perceive 3D
scenes from inconsistent inputs! In this work, we correct for 2D drawing
inconsistencies to recover a plausible 3D structure such that the newly warped
drawings are consistent with each other. Our pipeline consists of a
user-friendly annotation tool, camera pose estimation, and image deformation to
recover a dense structure. Our method warps images to obey a perspective camera
model, enabling our aligned results to be plugged into novel-view synthesis
reconstruction methods to experience cartoons from viewpoints never drawn
before. Our project page is https://toon3d.studio/.
6646c47aa30e3f066b45a2d0
Ethan Weber
admin_assigned
2024-05-17T10:17:17.992Z
6378485d9e1c10ecc27dc48e
https://cdn-avatars.huggingface.co/v1/production/uploads/6378485d9e1c10ecc27dc48e/Wnv495k1VdGyAuDvgiSeP.png
Ethan Weber
user
ethanweber
6646c47aa30e3f066b45a2d1
Riley Peterlinz
claimed_verified
2024-05-20T07:38:31.170Z
6647cf7fe98cc94717981117
/avatars/dea87dbcb73dee1185aa1b08b3138035.svg
Riley Peterlinz
user
cardiacmangoes
6646c47aa30e3f066b45a2d2
Rohan Mathur
6646c47aa30e3f066b45a2d3
Frederik Warburg
6646c47aa30e3f066b45a2d4
Alexei A. Efros
6646c47aa30e3f066b45a2d5
Angjoo Kanazawa
admin_assigned
2024-05-17T10:18:35.997Z
6478cf7150ff7001631679c3
/avatars/65ec385a9cc44c972e6caf952e759ff1.svg
Angjoo Kanazawa
user
akanazawa
Toon3D: Seeing Cartoons from a New Perspective
In this work, we recover the underlying 3D structure of non-geometrically
consistent scenes. We focus our analysis on hand-drawn images from cartoons and
anime. Many cartoons are created by artists without a 3D rendering engine,
which means that any new image of a scene is hand-drawn. The hand-drawn images
are usually faithful representations of the world, but only in a qualitative
sense, since it is difficult for humans to draw multiple perspectives of an
object or scene 3D consistently. Nevertheless, people can easily perceive 3D
scenes from inconsistent inputs! In this work, we correct for 2D drawing
inconsistencies to recover a plausible 3D structure such that the newly warped
drawings are consistent with each other. Our pipeline consists of a
user-friendly annotation tool, camera pose estimation, and image deformation to
recover a dense structure. Our method warps images to obey a perspective camera
model, enabling our aligned results to be plugged into novel-view synthesis
reconstruction methods to experience cartoons from viewpoints never drawn
before. Our project page is https://toon3d.studio/.
A pipeline combining camera pose estimation and image deformation corrects 2D drawing inconsistencies in hand-drawn cartoons to recover plausible 3D structures for novel-view synthesis.
camera pose estimation image deformation perspective camera model novel-view synthesis hand-drawn cartoons 3D structure 2D drawing inconsistencies