title: Variational Autoencoders: MSE vs BCE
body: <p>I'm working with a Variational Autoencoder and I have seen that there are people who uses MSE Loss and some people who uses BCE Loss, does anyone know if one is more correct that the another and why?</p>
  <p>As far as I understand, if you assume that the latent space vector of the VAE follows a Gaussian distribution, you should use MSE Loss. If you assume it follows a multinomial distribution, you should use BCE. Also, BCE is biased towards 0.5.</p>
  <p>Could someone clarify me this concept? I know that it's related with the Lower Variational Bound term of the expectancy of information...</p>
  <p>Thank you so much!</p>