@eric_zhu If you allow negative sign on MSELoss your model will have difficulty converging, as MSME is always positive and to reduce the loss, it will just keep making the variables larger and larger, which is why you are seeing extremely negative loss
I dont think you can use MSME loss as a replacement for the ELBO loss mentioned in the paper