• Paired Training Data. We collect and use paired video
and music data to achieve learning-based control, while
CMT does not use paired data and manually designs empir-
ical rule-based relations trained with music dataset only.
• Video-music Relations. V-MusProd considers semantic,
color, and rhythmic relations, while CMT only consid-
ers rhythmic relations. For rhythmic relations, we keep
timing control and add tempo control. We discard den-
sity and strength since these two local controls markedly
hurt music quality. They are more suitable for multi-track
music where some tracks (e.g. drum and bass) serve as
arrangements for others (e.g. piano and guitar).

• Music Priors. We adopt music priors of chords, melody,
and accompaniment, three important factors for music
composition that are consistent with human composition
process. CMT only uses simu-note as music theory priors,
which is simply for computational modeling and inconsis-
tent with common music composition procedures.
VideoBackgroundMusicGeneration