editing [15, 22, 23, 38]. Because video diffusion models
are most often derived from text-to-image diffusion mod-
els [46, 51], additional tasks and modalities are added via
inference tricks [40], architectural changes [22, 38] and
adapter layers [27, 80]. Although these models are com-
posable after training, they are not trained end-to-end in a
uniﬁed model. Our multitask pretraining strategy in a sin-
gle model improves the performance and provides zero-shot
video generation capabilities.
VideoPoet