Yes it is correct. For example if you have dropout in your model, model.eval() will disable it. You have to explicitly change the model state back to training again by calling model.train() To enable dropout during training loop.