VideoPoet: A Large Language Model for Zero-Shot Video Generation

Dan Kondratyuk*

Rachel Hornung
Yong Cheng

Meera Hahn

Lijun Yu*
Hartwig Adam
Ming-Chang Chiu

Xiuye Gu*
Hassan Akbari
Josh Dillon

Anja Hauth

David Hendon

Jos´e Lezama*
Yair Alon
Irfan Essa
Alonso Martinez

Jonathan Huang
Vighnesh Birodkar

Agrim Gupta
David Minnen

David Ross
Krishna Somandepalli

Grant Schindler
Huisheng Wang

Mikhail Sirotenko

Kihyuk Sohn

Jimmy Yan

Ming-Hsuan Yang

Xuan Yang

Bryan Seybold*

Lu Jiang*

GOOGLE RESEARCH

Figure 1. We propose VideoPoet, a versatile video generator that conditions on multiple types of inputs and performs a variety of video
generation tasks. To see video and audio output from the model, please see http://sites.research.google/videopoet/.

Abstract

lighting VideoPoet’s ability to generate high-ﬁdelity mo-
tions.
VideoPoet