LLaMA and our M2UGen models have been trained on
the MusicQA dataset [47], demonstrating impressive mu-
sic understanding capabilities. It is worth noting that our
model still outperforms the MU-LLaMA model. One pos-
sible reason is that, in addition to the MusicQA dataset,
we also have the MUCaps dataset for text-music align-
ment training, which contributes to enhancing our model’s
music understanding abilities. However, since the MU-
Caps dataset is generated by the MU-LLaMA model,
there may be limitations on further improving our model’s
music understanding capabilities. This could be one of the
factors preventing our model from significantly surpass-
ing MU-LLaMA, which implies that in our future work,
we may need to explore other music datasets to make fur-
ther improvements.

5.2 Text to Music Generation
M2UGen