AniDoc: Animation Creation Made Easier
The production of 2D animation follows an industry-standard workflow,
encompassing four essential stages: character design, keyframe animation,
in-betweening, and coloring. Our research focuses on reducing the labor costs
in the above process by harnessing the potential of increasingly powerful
generative AI. Using video diffusion models as the foundation, AniDoc emerges
as a video line art colorization tool, which automatically converts sketch
sequences into colored animations following the reference character
specification. Our model exploits correspondence matching as an explicit
guidance, yielding strong robustness to the variations (e.g., posture) between
the reference character and each line art frame. In addition, our model could
even automate the in-betweening process, such that users can easily create a
temporally consistent animation by simply providing a character image as well
as the start and end sketches. Our code is available at:
https://yihao-meng.github.io/AniDoc_demo.
67639f320e317931ea6264d5
Yihao Meng
admin_assigned
2024-12-20T09:37:35.334Z
656084f44e8918182d4f07c8
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/akAvCUCi7eR31PWOXrVPw.jpeg
Yihao Meng
user
Yhmeng1106
67639f320e317931ea6264d6
Hao Ouyang
67639f320e317931ea6264d7
Hanlin Wang
claimed_verified
2024-12-20T08:33:32.732Z
665f059a8947302aa2c63afe
/avatars/50f560285946532321a0bd526494148d.svg
hanlin wang
user
hlwang06
67639f320e317931ea6264d8
Qiuyu Wang
claimed_verified
2024-12-19T18:01:15.483Z
64981bea09cea550852652af
/avatars/df528e9008972c8e5ae4d278e617476c.svg
Qiuyu Wang
user
qiuyuu
67639f320e317931ea6264d9
Wen Wang
67639f320e317931ea6264da
Ka Leong Cheng
admin_assigned
2024-12-20T09:38:12.463Z
64acd2ec39fcfebff8c79c00
/avatars/9419384846b92182f2c47ce2fbd0f8d3.svg
Ka Leong Cheng
user
felixcheng97
67639f320e317931ea6264db
Zhiheng Liu
admin_assigned
2024-12-20T09:38:32.280Z
6479925ab77e18dbf640bd67
/avatars/bb52ecd22ca4b49157f8668be35409e7.svg
Zhiheng Liu
user
Johanan0528
67639f320e317931ea6264dc
Yujun Shen
67639f320e317931ea6264dd
Huamin Qu
AniDoc: Animation Creation Made Easier
The production of 2D animation follows an industry-standard workflow,
encompassing four essential stages: character design, keyframe animation,
in-betweening, and coloring. Our research focuses on reducing the labor costs
in the above process by harnessing the potential of increasingly powerful
generative AI. Using video diffusion models as the foundation, AniDoc emerges
as a video line art colorization tool, which automatically converts sketch
sequences into colored animations following the reference character
specification. Our model exploits correspondence matching as an explicit
guidance, yielding strong robustness to the variations (e.g., posture) between
the reference character and each line art frame. In addition, our model could
even automate the in-betweening process, such that users can easily create a
temporally consistent animation by simply providing a character image as well
as the start and end sketches. Our code is available at:
https://yihao-meng.github.io/AniDoc_demo.
AniDoc uses video diffusion models to automate colorization and in-betweening in 2D animation, improving efficiency by leveraging correspondence matching.
video diffusion models correspondence matching anidoc keyframe animation in-betweening colorization line art temporal consistency