title: Framer: Interactive Frame Interpolation
summary: We propose Framer for interactive frame interpolation, which targets
  producing smoothly transitioning frames between two images as per user
  creativity. Concretely, besides taking the start and end frames as inputs, our
  approach supports customizing the transition process by tailoring the
  trajectory of some selected keypoints. Such a design enjoys two clear benefits.
  First, incorporating human interaction mitigates the issue arising from
  numerous possibilities of transforming one image to another, and in turn
  enables finer control of local motions. Second, as the most basic form of
  interaction, keypoints help establish the correspondence across frames,
  enhancing the model to handle challenging cases (e.g., objects on the start and
  end frames are of different shapes and styles). It is noteworthy that our
  system also offers an "autopilot" mode, where we introduce a module to estimate
  the keypoints and refine the trajectory automatically, to simplify the usage in
  practice. Extensive experimental results demonstrate the appealing performance
  of Framer on various applications, such as image morphing, time-lapse video
  generation, cartoon interpolation, etc. The code, the model, and the interface
  will be released to facilitate further research.
paper_authors._id: 671afe2645299f98b4755eff
paper_authors.name: Wen Wang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-28T11:04:21.866Z
paper_authors._id: 63f089456309c84d5f47f951
paper_authors.avatarUrl: /avatars/04b926a7f2ad091ee00fef0c59903492.svg
paper_authors.fullname: Wen Wang
paper_authors.type: user
paper_authors.user: wwen1997
paper_authors._id: 671afe2645299f98b4755f00
paper_authors.name: Qiuyu Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-25T11:42:49.440Z
paper_authors._id: 64981bea09cea550852652af
paper_authors.avatarUrl: /avatars/df528e9008972c8e5ae4d278e617476c.svg
paper_authors.fullname: Qiuyu Wang
paper_authors.type: user
paper_authors.user: qiuyuu
paper_authors._id: 671afe2645299f98b4755f01
paper_authors.name: Kecheng Zheng
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-25T11:42:42.768Z
paper_authors._id: 64252045a4f3051f54dd1d53
paper_authors.avatarUrl: /avatars/0e423a3291091be3b4736a14da3ce495.svg
paper_authors.fullname: kecheng zheng
paper_authors.type: user
paper_authors.user: zkcys001
paper_authors._id: 671afe2645299f98b4755f02
paper_authors.name: Hao Ouyang
paper_authors._id: 671afe2645299f98b4755f03
paper_authors.name: Zhekai Chen
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-10-25T09:30:03.697Z
paper_authors._id: 62d812e143df7719860d05d1
paper_authors.avatarUrl: /avatars/412f7ec5c9f54990f4b562652d3e2c59.svg
paper_authors.fullname: zhekai chen
paper_authors.type: user
paper_authors.user: Azily
paper_authors._id: 671afe2645299f98b4755f04
paper_authors.name: Biao Gong
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-25T11:42:12.527Z
paper_authors._id: 644fcbea4f7316588267dc80
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/644fcbea4f7316588267dc80/w8-2Gkaw9BN9VzppNXrTP.jpeg
paper_authors.fullname: Biao Gong
paper_authors.type: user
paper_authors.user: BiaoGong
paper_authors._id: 671afe2645299f98b4755f05
paper_authors.name: Hao Chen
paper_authors._id: 671afe2645299f98b4755f06
paper_authors.name: Yujun Shen
paper_authors._id: 671afe2645299f98b4755f07
paper_authors.name: Chunhua Shen
paper_title: Framer: Interactive Frame Interpolation
paper_summary: We propose Framer for interactive frame interpolation, which targets
  producing smoothly transitioning frames between two images as per user
  creativity. Concretely, besides taking the start and end frames as inputs, our
  approach supports customizing the transition process by tailoring the
  trajectory of some selected keypoints. Such a design enjoys two clear benefits.
  First, incorporating human interaction mitigates the issue arising from
  numerous possibilities of transforming one image to another, and in turn
  enables finer control of local motions. Second, as the most basic form of
  interaction, keypoints help establish the correspondence across frames,
  enhancing the model to handle challenging cases (e.g., objects on the start and
  end frames are of different shapes and styles). It is noteworthy that our
  system also offers an "autopilot" mode, where we introduce a module to estimate
  the keypoints and refine the trajectory automatically, to simplify the usage in
  practice. Extensive experimental results demonstrate the appealing performance
  of Framer on various applications, such as image morphing, time-lapse video
  generation, cartoon interpolation, etc. The code, the model, and the interface
  will be released to facilitate further research.
paper_ai_keywords: frame interpolation keypoints trajectory human interaction local motions correspondence autopilot mode image morphing time-lapse video generation cartoon interpolation