Because the MAGVIT-v2 tokenizer that we use encodes
the ﬁrst frame independently of the subsequent frames, we
can encode an image without any padding as the ﬁrst frame
of a video. We can then predict the remaining tokens for
subsequent frames to produce a video from any image as
shown in Figure 11.4
VideoPoet