DrawingSpinUp: 3D Animation from Single Character Drawings
Animating various character drawings is an engaging visual content creation
task. Given a single character drawing, existing animation methods are limited
to flat 2D motions and thus lack 3D effects. An alternative solution is to
reconstruct a 3D model from a character drawing as a proxy and then retarget 3D
motion data onto it. However, the existing image-to-3D methods could not work
well for amateur character drawings in terms of appearance and geometry. We
observe the contour lines, commonly existing in character drawings, would
introduce significant ambiguity in texture synthesis due to their
view-dependence. Additionally, thin regions represented by single-line contours
are difficult to reconstruct (e.g., slim limbs of a stick figure) due to their
delicate structures. To address these issues, we propose a novel system,
DrawingSpinUp, to produce plausible 3D animations and breathe life into
character drawings, allowing them to freely spin up, leap, and even perform a
hip-hop dance. For appearance improvement, we adopt a removal-then-restoration
strategy to first remove the view-dependent contour lines and then render them
back after retargeting the reconstructed character. For geometry refinement, we
develop a skeleton-based thinning deformation algorithm to refine the slim
structures represented by the single-line contours. The experimental
evaluations and a perceptual user study show that our proposed method
outperforms the existing 2D and 3D animation methods and generates high-quality
3D animations from a single character drawing. Please refer to our project page
(https://lordliang.github.io/DrawingSpinUp) for the code and generated
animations.
66e8303b89d2a8527c891d52
Jie Zhou
claimed_verified
2024-10-28T11:27:09.543Z
6499763410f1f8fed8f6c590
/avatars/cd02cb9abb899ffdec7056079c89da96.svg
ZHOU Jie
user
LordLiang
66e8303b89d2a8527c891d53
Chufeng Xiao
admin_assigned
2024-09-17T07:55:00.849Z
63a2ca27dca41424cb8387a3
/avatars/ae9bec9c2326184e94faa8d6fd98f2da.svg
X
user
Chufeng
66e8303b89d2a8527c891d54
Miu-Ling Lam
66e8303b89d2a8527c891d55
Hongbo Fu
admin_assigned
2024-09-17T07:54:45.373Z
662cd8b9322afcbae53fb06e
/avatars/9847f5c2282d49e61e76a0a303e0b2b1.svg
fuhongbo
user
fuhongbo
DrawingSpinUp: 3D Animation from Single Character Drawings
Animating various character drawings is an engaging visual content creation
task. Given a single character drawing, existing animation methods are limited
to flat 2D motions and thus lack 3D effects. An alternative solution is to
reconstruct a 3D model from a character drawing as a proxy and then retarget 3D
motion data onto it. However, the existing image-to-3D methods could not work
well for amateur character drawings in terms of appearance and geometry. We
observe the contour lines, commonly existing in character drawings, would
introduce significant ambiguity in texture synthesis due to their
view-dependence. Additionally, thin regions represented by single-line contours
are difficult to reconstruct (e.g., slim limbs of a stick figure) due to their
delicate structures. To address these issues, we propose a novel system,
DrawingSpinUp, to produce plausible 3D animations and breathe life into
character drawings, allowing them to freely spin up, leap, and even perform a
hip-hop dance. For appearance improvement, we adopt a removal-then-restoration
strategy to first remove the view-dependent contour lines and then render them
back after retargeting the reconstructed character. For geometry refinement, we
develop a skeleton-based thinning deformation algorithm to refine the slim
structures represented by the single-line contours. The experimental
evaluations and a perceptual user study show that our proposed method
outperforms the existing 2D and 3D animation methods and generates high-quality
3D animations from a single character drawing. Please refer to our project page
(https://lordliang.github.io/DrawingSpinUp) for the code and generated
animations.
A new system, DrawingSpinUp, reconstructs 3D models from 2D character drawings and applies motion data to generate high-quality 3D animations.
image-to-3D 3D reconstruction contour lines texture synthesis view-dependence skeleton-based thinning deformation 3D animation retargeting appearance improvement