Table 6: Comparison with previous video-conditional music generation methods.

(C,M,A) transformer hidden size
(C,M,A) transformer feed-forward size
(C,M,A) transformer attention heads
(C,M,A) transformer dropout rate
(C,M,A) transformer activation
(C,M,A) beat resolution
(C) color encoder layers
(C) semantic encoder layers
(C) fusion encoder layers
(M,A) encoder layers
(M,A) decoder layers
(C) color feature size
(C) semantic feature size
(M,A) timing encoding size
(C,M,A) initial learning rate
(C,M,A) optimizer
(C,M,A) decoder layers
(C,M) number of epochs
(A) number of epochs
(C) batch size
(M) batch size
(A) batch size
(C) decoder embedding size
(barbeat, type, root, quality)
(M,A) decoder embedding size
(barbeat, type, pitch, duration)
(M) encoder embedding size
(barbeat, type, chroma)
(A) encoder embedding size
(barbeat, type, pitch, duration, chroma)

512
2048

8
0.1
gelu
220
2
2
2
4
6

3072
512
256
1e-4
Adam

4
200
400
8
10
3

128, 32, 128, 64

128, 32, 512, 128

128, 32, 128
VideoBackgroundMusicGeneration