Solved by ptrblck in post #2 
              
              
                I guess you might have some dropout or batchnorm layers in your model, which are still active even though the trainable parameters are frozen. 
Calling model.eval() will use the running stats in batch norm layers (instead of using the current batch stats and updating the running estimates) and dropo…