Solved by ptrblck in post #2 
              
              
                train()/eval() will change the behavior of some layers and are used during training and evaluatio, respectively. E.g. batchnorm layers will use the running stats to normalize the input during evaluation instead of the input activation stats and dropout layers will be disabled during evaluation. 
Set…