I’m implementing VAE(Variational autoencoder) with a  prior different from unit Gaussian. Unfortunately I keep  getting nans after every few epochs. I have tried reducing the learning rate and clipping gradient.
Any help would be greatly appreciated. Thanks.