title: AniDoc: Animation Creation Made Easier
summary: The production of 2D animation follows an industry-standard workflow,
  encompassing four essential stages: character design, keyframe animation,
  in-betweening, and coloring. Our research focuses on reducing the labor costs
  in the above process by harnessing the potential of increasingly powerful
  generative AI. Using video diffusion models as the foundation, AniDoc emerges
  as a video line art colorization tool, which automatically converts sketch
  sequences into colored animations following the reference character
  specification. Our model exploits correspondence matching as an explicit
  guidance, yielding strong robustness to the variations (e.g., posture) between
  the reference character and each line art frame. In addition, our model could
  even automate the in-betweening process, such that users can easily create a
  temporally consistent animation by simply providing a character image as well
  as the start and end sketches. Our code is available at:
  https://yihao-meng.github.io/AniDoc_demo.
paper_authors._id: 67639f320e317931ea6264d5
paper_authors.name: Yihao Meng
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-20T09:37:35.334Z
paper_authors._id: 656084f44e8918182d4f07c8
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/akAvCUCi7eR31PWOXrVPw.jpeg
paper_authors.fullname: Yihao Meng
paper_authors.type: user
paper_authors.user: Yhmeng1106
paper_authors._id: 67639f320e317931ea6264d6
paper_authors.name: Hao Ouyang
paper_authors._id: 67639f320e317931ea6264d7
paper_authors.name: Hanlin Wang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-12-20T08:33:32.732Z
paper_authors._id: 665f059a8947302aa2c63afe
paper_authors.avatarUrl: /avatars/50f560285946532321a0bd526494148d.svg
paper_authors.fullname: hanlin wang
paper_authors.type: user
paper_authors.user: hlwang06
paper_authors._id: 67639f320e317931ea6264d8
paper_authors.name: Qiuyu Wang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-12-19T18:01:15.483Z
paper_authors._id: 64981bea09cea550852652af
paper_authors.avatarUrl: /avatars/df528e9008972c8e5ae4d278e617476c.svg
paper_authors.fullname: Qiuyu Wang
paper_authors.type: user
paper_authors.user: qiuyuu
paper_authors._id: 67639f320e317931ea6264d9
paper_authors.name: Wen Wang
paper_authors._id: 67639f320e317931ea6264da
paper_authors.name: Ka Leong Cheng
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-20T09:38:12.463Z
paper_authors._id: 64acd2ec39fcfebff8c79c00
paper_authors.avatarUrl: /avatars/9419384846b92182f2c47ce2fbd0f8d3.svg
paper_authors.fullname: Ka Leong Cheng
paper_authors.type: user
paper_authors.user: felixcheng97
paper_authors._id: 67639f320e317931ea6264db
paper_authors.name: Zhiheng Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-20T09:38:32.280Z
paper_authors._id: 6479925ab77e18dbf640bd67
paper_authors.avatarUrl: /avatars/bb52ecd22ca4b49157f8668be35409e7.svg
paper_authors.fullname: Zhiheng Liu
paper_authors.type: user
paper_authors.user: Johanan0528
paper_authors._id: 67639f320e317931ea6264dc
paper_authors.name: Yujun Shen
paper_authors._id: 67639f320e317931ea6264dd
paper_authors.name: Huamin Qu
paper_title: AniDoc: Animation Creation Made Easier
paper_summary: The production of 2D animation follows an industry-standard workflow,
  encompassing four essential stages: character design, keyframe animation,
  in-betweening, and coloring. Our research focuses on reducing the labor costs
  in the above process by harnessing the potential of increasingly powerful
  generative AI. Using video diffusion models as the foundation, AniDoc emerges
  as a video line art colorization tool, which automatically converts sketch
  sequences into colored animations following the reference character
  specification. Our model exploits correspondence matching as an explicit
  guidance, yielding strong robustness to the variations (e.g., posture) between
  the reference character and each line art frame. In addition, our model could
  even automate the in-betweening process, such that users can easily create a
  temporally consistent animation by simply providing a character image as well
  as the start and end sketches. Our code is available at:
  https://yihao-meng.github.io/AniDoc_demo.
paper_ai_summary: AniDoc uses video diffusion models to automate colorization and in-betweening in 2D animation, improving efficiency by leveraging correspondence matching.
paper_ai_keywords: video diffusion models correspondence matching anidoc keyframe animation in-betweening colorization line art temporal consistency