7. LLM’s Capabilities in Video Generation

In this section we highlight several notable capabilities we
discover from the pretrained VideoPoet, shedding light on
the Large Language Models (LLMs)’s promising potential
in video generation.

11

Original Video

Masked Video

Inpainted Video from Text Prompt

Prompt: A blue dragon walking along a ridge

Figure 8. Example of zero-shot video editing via task chain-
ing (inpainting and text-to-video) – the original video is ﬁrst in-
painted and then edited via a text prompt.

Animated from Still Image

Stylized Video

Prompt: An oil painting of a snowman with a red hat

opening their mouth to yawn

Figure 9. Example of zero-shot video editing via task chaining
(text conditioned image-to-video and stylization) – the original
painting is ﬁrst animated via a text prompt and then stylized via
another text prompt.

Control-a-video preferredVideoPoet preferredText FidelityVideo QualityNo preferenceStylization30%60%10%35%65%0%Original Video
VideoPoet