Solved by ptrblck in post #2 
              
              
                model.eval() does not disable the gradient calculations, but only changes the behavior of some layers (such as batchnorm and dropout), so I wouldn’t expect to see any issues with Autograd.