wayne:

I should add this “net.train()” after the validation everytime, or I just did something wrong?


You should call model.train() again before continuing with the training.
This will make sure to set all layers to training mode again, which would change the behavior of e.g. dropout and batchnorm layers.