Solved by ptrblck in post #2 
              
              
                Yes, this is a common technique and is called early stopping. You would store the model’s state_dict for the lowest validation loss (or highest validation accuracy). 

No, you shouldn’t do it, since mixing the training and validation set would give you a better “validation” loss than you would expe…