Text to music

#89
by mapujana - opened

Dear community,

I am exploring how to convert text (from a book or random letters) into music melody,
can this be done with MusicGen?

thnaks

This is amazing how do i make something like this? I have a potential vc lined up and would love to collaborate with someone.

This comment has been hidden

Are you talking about the site I posted? If so let me know.

Yes thats correct can you e-mail me at [email protected] ?

I’ve also been experimenting with lyrics-to-music generation using MusicGen models. The rhythm issue you mentioned is quite common, especially with shorter prompts or less descriptive input.

One thing I found helpful is structuring the lyrics in a clear verse/chorus format and keeping the prompt more genre-specific (e.g., “emotional pop ballad with slow tempo”).

If you’re curious, I built a simple web-based tool around this concept that uses MusicGen under the hood — it allows users to paste lyrics and instantly get a melody: https://lyricstosongai.com

Would love feedback if you try it!

Sign up or log in to comment