Solved by ptrblck in post #2 
              
              
                It depends on the architecture of the model and you can check the internal modules in the model definition. 
E.g. torchvision.models are implemented here.