9

order so as to not bias raters). Not all methods generate
videos at the same size or aspect ratio, so we resize each
video to a ﬁxed area while maintaining its original aspect
ratio. Raters are then asked to compare the videos along 5
dimensions and report whether the two videos are similar
or one is better than the other. Speciﬁcally, we ask raters
to consider (1) text ﬁdelity (which video follows the text
prompt most faithfully), (2) video quality, (3) motion “in-
terestingness”, (4) motion realism and (5) temporal consis-
tency. Raters are required to undergo a training consisting
of going over a collection of “training examples” for each
of these ﬁve dimensions.
VideoPoet