Framer: Interactive Frame Interpolation
We propose Framer for interactive frame interpolation, which targets
producing smoothly transitioning frames between two images as per user
creativity. Concretely, besides taking the start and end frames as inputs, our
approach supports customizing the transition process by tailoring the
trajectory of some selected keypoints. Such a design enjoys two clear benefits.
First, incorporating human interaction mitigates the issue arising from
numerous possibilities of transforming one image to another, and in turn
enables finer control of local motions. Second, as the most basic form of
interaction, keypoints help establish the correspondence across frames,
enhancing the model to handle challenging cases (e.g., objects on the start and
end frames are of different shapes and styles). It is noteworthy that our
system also offers an "autopilot" mode, where we introduce a module to estimate
the keypoints and refine the trajectory automatically, to simplify the usage in
practice. Extensive experimental results demonstrate the appealing performance
of Framer on various applications, such as image morphing, time-lapse video
generation, cartoon interpolation, etc. The code, the model, and the interface
will be released to facilitate further research.
671afe2645299f98b4755eff
Wen Wang
claimed_verified
2024-10-28T11:04:21.866Z
63f089456309c84d5f47f951
/avatars/04b926a7f2ad091ee00fef0c59903492.svg
Wen Wang
user
wwen1997
671afe2645299f98b4755f00
Qiuyu Wang
admin_assigned
2024-10-25T11:42:49.440Z
64981bea09cea550852652af
/avatars/df528e9008972c8e5ae4d278e617476c.svg
Qiuyu Wang
user
qiuyuu
671afe2645299f98b4755f01
Kecheng Zheng
admin_assigned
2024-10-25T11:42:42.768Z
64252045a4f3051f54dd1d53
/avatars/0e423a3291091be3b4736a14da3ce495.svg
kecheng zheng
user
zkcys001
671afe2645299f98b4755f02
Hao Ouyang
671afe2645299f98b4755f03
Zhekai Chen
claimed_verified
2024-10-25T09:30:03.697Z
62d812e143df7719860d05d1
/avatars/412f7ec5c9f54990f4b562652d3e2c59.svg
zhekai chen
user
Azily
671afe2645299f98b4755f04
Biao Gong
admin_assigned
2024-10-25T11:42:12.527Z
644fcbea4f7316588267dc80
https://cdn-avatars.huggingface.co/v1/production/uploads/644fcbea4f7316588267dc80/w8-2Gkaw9BN9VzppNXrTP.jpeg
Biao Gong
user
BiaoGong
671afe2645299f98b4755f05
Hao Chen
671afe2645299f98b4755f06
Yujun Shen
671afe2645299f98b4755f07
Chunhua Shen
Framer: Interactive Frame Interpolation
We propose Framer for interactive frame interpolation, which targets
producing smoothly transitioning frames between two images as per user
creativity. Concretely, besides taking the start and end frames as inputs, our
approach supports customizing the transition process by tailoring the
trajectory of some selected keypoints. Such a design enjoys two clear benefits.
First, incorporating human interaction mitigates the issue arising from
numerous possibilities of transforming one image to another, and in turn
enables finer control of local motions. Second, as the most basic form of
interaction, keypoints help establish the correspondence across frames,
enhancing the model to handle challenging cases (e.g., objects on the start and
end frames are of different shapes and styles). It is noteworthy that our
system also offers an "autopilot" mode, where we introduce a module to estimate
the keypoints and refine the trajectory automatically, to simplify the usage in
practice. Extensive experimental results demonstrate the appealing performance
of Framer on various applications, such as image morphing, time-lapse video
generation, cartoon interpolation, etc. The code, the model, and the interface
will be released to facilitate further research.
Framer is an interactive frame interpolation system that allows users to customize transitions between images using keypad manipulation and includes an autopilot mode for automatic keypoint estimation.
frame interpolation keypoint interactive autopilot image morphing time-lapse video generation cartoon interpolation