model, along with the new MuVi-Sync dataset, presents a promising step for

∗Corresponding author.
Email addresses: kjysmu@gmail.com (Jaeyong Kang ), sporia@sutd.edu.sg (Soujanya

Poria), dorien_herremans@sutd.edu.sg (Dorien Herremans)

Preprint submitted to Elsevier

November 3, 2023

the new task of music generation for videos.

Keywords: Generative AI, Music Generation, Transformer, Multimodal,

Affective Computing, Music Video Matching

1. Introduction

In today’s digital era, social media platforms such as YouTube have revolu-

tionized the way that videos are consumed and shared. These platforms have

given rise to a new form of entertainment, where captivating visuals are often

complemented by carefully curated background music. While the advancements

in mobile device technology have made it easier than ever to capture high-quality

videos, the challenge of finding suitable background music that perfectly aligns
Video2Music