sic generation task. Our framework is shown in Fig. 4, which
consists of a video controller and a music generator. The
video controller extracts visual and rhythmic features and
fuses them as the contextual input of the music generator.
The music generator decouples the music generation process
into three progressive stages that are independently trained:
Chord, Melody, and Accompaniment. At inference time,
melody and accompaniment tracks are merged together to
form a complete music piece. The progressive generation
pipeline allows for the use of decoupling control on different
generation stages, which improves the correspondence be-
tween videos and music. We elaborate on each component
in the following subsections.
4.1. Video Controller
VideoBackgroundMusicGeneration