Solved by Napam in post #2 
              
              
                You can simply pass an OrderedDict with net.named_children() to nn.Sequential like this: 
new_classifier = nn.Sequential(OrderedDict(list(net.named_children())[:-1]))

:^)