MelodyAccom.ChordCMEmCMMetadataVideo“But you only need the light when it‘s burning low, Only miss the sun when it starts to snow...”Tempo: 120Lyrics: Genre: Pop00.050.10.150.20.25CMCM7Dm7EmEm7FMFM7GMAmAm7frequencyPopMandopopR&B/SoulAlternativeHip-Hop/RapC MajorCMCM7Dm7EmEm7FMFM7GMAmAm7(a)(b)A minor(a)(b)PopMandopopAlternativeHip-Hop/RapR&B/SoulDance(b)(c)Figure 4: Illustration of our method V-MusProd. Left: We group multiple music attributes into one event-based token (each
column). Different colors indicate different types of tokens. Right: We extract semantic, color, and motion features to guide
the music generation process. The three types of features serve as inputs for different stages of the decoupled music generation
model, which contains Chord, Melody, and Accompaniment Transformers.
VideoBackgroundMusicGeneration