Solved by ptrblck in post #2 
              
              
                If you are trying to reproduce the evaluation performance, I would recommend to call model.eval() so that dropout would be disabled and the internal batchnorm stats would be used. 
The official ImageNet code has also an evaluation mode, which should reproduce the numbers.