Solved by Nikronic in post #8 
              
              
                Ow! In first post I asked about training loss or test loss, now I can get what you mean. Actually, after training for a while you are trying to validate your model so, this can be considered as testing. You have to use same configuration with testing which is using model.eval and torch.no_grad for l…