Thanks for your response!
The task in hand is to train the model to have a variance of one. So, I have a target class one, and I am training the model through MSELoss and Stochastic Gradient descent. The issue is I am not able to train the model. It never converges.