Solved by tom in post #2 
              
              
                I don’t know if this is from posting here, but you would want the model.eval() to happen outside the training loop, right? Also, you would want the validation to happen on the validation loop, probably. 
torch.no_grad() saves memory and, sometimes, time, but the recorded autograd graphs should be de…