title: FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations
summary: Sketch animations offer a powerful medium for visual storytelling, from
  simple flip-book doodles to professional studio productions. While traditional
  animation requires teams of skilled artists to draw key frames and in-between
  frames, existing automation attempts still demand significant artistic effort
  through precise motion paths or keyframe specification. We present FlipSketch,
  a system that brings back the magic of flip-book animation -- just draw your
  idea and describe how you want it to move! Our approach harnesses motion priors
  from text-to-video diffusion models, adapting them to generate sketch
  animations through three key innovations: (i) fine-tuning for sketch-style
  frame generation, (ii) a reference frame mechanism that preserves visual
  integrity of input sketch through noise refinement, and (iii) a dual-attention
  composition that enables fluid motion without losing visual consistency. Unlike
  constrained vector animations, our raster frames support dynamic sketch
  transformations, capturing the expressive freedom of traditional animation. The
  result is an intuitive system that makes sketch animation as simple as doodling
  and describing, while maintaining the artistic essence of hand-drawn animation.
paper_authors._id: 673df3308f9f9408fe5b8d41
paper_authors.name: Hmrishav Bandyopadhyay
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-11-20T15:31:23.868Z
paper_authors._id: 638c81fa61eb51017518fa31
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/f0eCrzBrxz7Y9n25WkZ2v.png
paper_authors.fullname: Hmrishav Bandyopadhyay
paper_authors.type: user
paper_authors.user: Hmrishav
paper_authors._id: 673df3308f9f9408fe5b8d42
paper_authors.name: Yi-Zhe Song
paper_title: FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations
paper_summary: Sketch animations offer a powerful medium for visual storytelling, from
  simple flip-book doodles to professional studio productions. While traditional
  animation requires teams of skilled artists to draw key frames and in-between
  frames, existing automation attempts still demand significant artistic effort
  through precise motion paths or keyframe specification. We present FlipSketch,
  a system that brings back the magic of flip-book animation -- just draw your
  idea and describe how you want it to move! Our approach harnesses motion priors
  from text-to-video diffusion models, adapting them to generate sketch
  animations through three key innovations: (i) fine-tuning for sketch-style
  frame generation, (ii) a reference frame mechanism that preserves visual
  integrity of input sketch through noise refinement, and (iii) a dual-attention
  composition that enables fluid motion without losing visual consistency. Unlike
  constrained vector animations, our raster frames support dynamic sketch
  transformations, capturing the expressive freedom of traditional animation. The
  result is an intuitive system that makes sketch animation as simple as doodling
  and describing, while maintaining the artistic essence of hand-drawn animation.
paper_ai_keywords: motion priors text-to-video diffusion models fine-tuning sketch-style frame generation reference frame mechanism noise refinement dual-attention composition raster frames sketch transformations dynamic sketch transformations