B.2 Reasoning for Training Strategy

Using the initial training stage, the model undergoes train-
ing with the objective of comprehending diverse modali-
ties by leveraging extensive captioning datasets for music,
image, and video. The subsequent training stage focuses
on refining the LLaMA 2 model’s capability to condition
music generation based on input captions.
These dual training stages equip the model with the abil-
ity to grasp various modalities and generate distinct music
conditions based on input captions. This proficiency sig-
nificantly contributes to the final training stage.
In this
ultimate phase, the model leverages the trained Multi-
modal Understanding Adapters and Output Projection
layers to bridge the gap between them, honing the LLaMA
2 model’s skills through the utilization of multi-modal
music generation and music understanding datasets.

B.3 Model Training Parameters
M2UGen