HI. I realized my training loss is slightly different from the one that is calculated during training. Even though I added a full batch to make sure it’s not an average of the losses in each mini-batch. However, the validation loss gives the same value. I’m not using any fancy stuff such as batch normalization or so.