Solved by RicCu in post #2 
              
              
                Use 
self.resnet = nn.Sequential(*list(self.pretrained_resnet.children())[:-1]).cuda()

resnet.modules() returns all modules recursively, but you only want the immediate children of resnet