Example Text Prompts in Our Dataset
Nr. 415 (Premium Edition), german hip hop, 2 of 7, 2012,
XATAR, Konnekt
30 Años de Exitos, Mundanzas, 2 of 6, latin pop, Lupita
D’Alessio, 2011
emo rap 2018 Runaway Lil Peep 4 of 5
Alone, Pt. II (Remixes) 2020 electro house Alone, Pt. II -
Da Tweekaz Remix Alan Walker

Table 6: Example text prompts in our dataset.

A.3 Model Architecture and Parameters
Our diffusion autoencoder has 185M parameters,
with 7 nested U-Net blocks of increasing channel
count ([256, 512, 512, 512, 1024, 1024, 1024]), for
which we downsample each time by 2, except for
the first block ([1, 2, 2, 2, 2, 2, 2]). This makes the
compression factor for our autoencoder to be 64x.
Depending on the desired speed/quality tradeoff,
more or less compression can be applied in this
first stage. Following our single GPU constraint,
we find that 64x compression factor is a good bal-
ance to make sure the second stage can work on
MOUSAI