Improving the Structure

D.2
We find that increasing the number of attention
blocks (e.g., from a total of 4 – 8 to a total of
32+) in the latent diffusion model can improve
the general structure of the songs, thanks to the
long-context view. If the model is trained without
attention blocks, the context provided by the U-
Net is not large enough to learn any meaningful
long-term structure.
Moûsai