Try to remove the last relu activation in your model, which should make the output more diverse.
Also, I’m not sure if it’s a good idea to re-sample the data in the training loop, as your model won’t be able to learn these random samples.
I could pretty easy overfit your model after applying these two changes.