This might explain the noise, but you could double check it by calculating the mean and std using the loss for all samples in the validation set once.



 WeiQin_Chuah:

But intuitively validation is just to check if our model is converging right, so I can ignore the noise as long as it shows that my model is doing its job. Correct me on this if I am wrong.


Yes, that’s correct. The validation loss should give you a signal about your model performance on unseen data.