That’s weird. As far as I understand the training and validation losses are different if you are using nn.MSELoss but similar if you implement this loss function manually. Is that correct?
If so, could you post your implementation, and if possible a small code snippet reproducing this issue?