Solved by soulitzer in post #2 
              
              
                .eval() does not freeze your layers. It puts your layers in “evaluation mode” (in contrast to training mode) which should only be done if you are testing/validating your model. To freeze layers while training, you should set requires_grad of layers 4,5,6 to false. 

To freeze parts of your model, si…