Solved by ptrblck in post #2 
              
              
                You would just have to set pretrained=True and self.features will contain all pretrained parameters. 
Of course self.fc will be randomly initialized, since you recreate it with your custom number of classes.