Solved by ptrblck in post #6 
              
              
                Yes, this will also work: 
class NewNet(nn.Module):
    def __init__(self):
        super().__init__()
        resnet = models.resnet50()
        self.conv1 = resnet.conv1
        self.bn1 = resnet.bn1
        
    def forward(self, x):
        x = self.conv1(x)
        x = self.bn1(x)
        retur…