Open-Sora Plan: Open-Source Large Video Generation Model
We introduce Open-Sora Plan, an open-source project that aims to contribute a
large generation model for generating desired high-resolution videos with long
durations based on various user inputs. Our project comprises multiple
components for the entire video generation process, including a Wavelet-Flow
Variational Autoencoder, a Joint Image-Video Skiparse Denoiser, and various
condition controllers. Moreover, many assistant strategies for efficient
training and inference are designed, and a multi-dimensional data curation
pipeline is proposed for obtaining desired high-quality data. Benefiting from
efficient thoughts, our Open-Sora Plan achieves impressive video generation
results in both qualitative and quantitative evaluations. We hope our careful
design and practical experience can inspire the video generation research
community. All our codes and model weights are publicly available at
https://github.com/PKU-YuanGroup/Open-Sora-Plan.
674e8961ef38dd7bfb7d1add
Bin Lin
claimed_verified
2024-12-03T11:15:00.619Z
6367a8175bb06007ea099b8f
https://cdn-avatars.huggingface.co/v1/production/uploads/6367a8175bb06007ea099b8f/IjG7HyWyWRlVt_XwRbxRW.jpeg
linbin
user
LanguageBind
674e8961ef38dd7bfb7d1ade
Yunyang Ge
admin_assigned
2024-12-03T13:49:41.403Z
646de6402fd5a8eb8c518aa6
https://cdn-avatars.huggingface.co/v1/production/uploads/646de6402fd5a8eb8c518aa6/HYWb8-fT1kTm-ROBr1-0X.jpeg
yunyangge
user
yunyangge
674e8961ef38dd7bfb7d1adf
Xinhua Cheng
admin_assigned
2024-12-03T13:49:48.039Z
645b4026f9d4ec91fdd516ce
/avatars/fb6556ab973764af5c44980f4e8fcc71.svg
Xinhua Cheng
user
cxh0519
674e8961ef38dd7bfb7d1ae0
Zongjian Li
674e8961ef38dd7bfb7d1ae1
Bin Zhu
674e8961ef38dd7bfb7d1ae2
Shaodong Wang
674e8961ef38dd7bfb7d1ae3
Xianyi He
claimed_verified
2025-05-18T08:48:10.337Z
6688f94517f8d8f81c2def5f
/avatars/1064ccd62539a8ca2ec86fc87c818296.svg
hexianyi
user
pkuhexianyi
674e8961ef38dd7bfb7d1ae4
Yang Ye
674e8961ef38dd7bfb7d1ae5
Shenghai Yuan
claimed_verified
2024-12-03T11:14:50.136Z
63468720dd6d90d82ccf3450
https://cdn-avatars.huggingface.co/v1/production/uploads/63468720dd6d90d82ccf3450/tVBFlmZNz8FRMkOrDaDID.jpeg
YSH
user
BestWishYsh
674e8961ef38dd7bfb7d1ae6
Liuhan Chen
admin_assigned
2024-12-03T13:51:17.509Z
65c0588569429d85dc594a85
/avatars/822203d982519b999247a53235e30c39.svg
liuhan
user
LiuhanChen
674e8961ef38dd7bfb7d1ae7
Tanghui Jia
674e8961ef38dd7bfb7d1ae8
Junwu Zhang
admin_assigned
2024-12-03T13:51:03.908Z
64979385e486365ca6b3c030
/avatars/589344a9db41873d78452560cca3d234.svg
Junwu Zhang
user
junwuzhang
674e8961ef38dd7bfb7d1ae9
Zhenyu Tang
admin_assigned
2024-12-03T13:51:24.244Z
63c09aa88d1175e3399e906e
/avatars/a1b8a89e83275f049f7bf75af9086d84.svg
Zhenyu Tang
user
royjames
674e8961ef38dd7bfb7d1aea
Yatian Pang
674e8961ef38dd7bfb7d1aeb
Bin She
674e8961ef38dd7bfb7d1aec
Cen Yan
674e8961ef38dd7bfb7d1aed
Zhiheng Hu
674e8961ef38dd7bfb7d1aee
Xiaoyi Dong
674e8961ef38dd7bfb7d1aef
Lin Chen
claimed_verified
2024-12-03T11:14:52.541Z
64b02ec0e5000ae8a572ced5
https://cdn-avatars.huggingface.co/v1/production/uploads/64b02ec0e5000ae8a572ced5/6ifLntBU2ICQK7SW8WxKU.png
Lin Chen
user
Lin-Chen
674e8961ef38dd7bfb7d1af0
Zhang Pan
674e8961ef38dd7bfb7d1af1
Xing Zhou
674e8961ef38dd7bfb7d1af2
Shaoling Dong
674e8961ef38dd7bfb7d1af3
Yonghong Tian
674e8961ef38dd7bfb7d1af4
Li Yuan
claimed_verified
2025-04-04T07:11:08.109Z
66135a5e50350afe76beebce
/avatars/370a4b83949355feb050c2cb0425c264.svg
yl2488
user
yl2488
Open-Sora Plan: Open-Source Large Video Generation Model
We introduce Open-Sora Plan, an open-source project that aims to contribute a
large generation model for generating desired high-resolution videos with long
durations based on various user inputs. Our project comprises multiple
components for the entire video generation process, including a Wavelet-Flow
Variational Autoencoder, a Joint Image-Video Skiparse Denoiser, and various
condition controllers. Moreover, many assistant strategies for efficient
training and inference are designed, and a multi-dimensional data curation
pipeline is proposed for obtaining desired high-quality data. Benefiting from
efficient thoughts, our Open-Sora Plan achieves impressive video generation
results in both qualitative and quantitative evaluations. We hope our careful
design and practical experience can inspire the video generation research
community. All our codes and model weights are publicly available at
https://github.com/PKU-YuanGroup/Open-Sora-Plan.
Open-Sora Plan is an open-source project that generates high-resolution, long-duration videos from various inputs using a Wavelet-Flow Variational Autoencoder, Joint Image-Video Skiparse Denoiser, and condition controllers.
Wavelet-Flow Variational Autoencoder Joint Image-Video Skiparse Denoiser condition controllers