Solved by fmassa in post #49 
              
              
                Because of the way Inception_v3 is structured, you would need to do some more manual work to get the layers that you want. 
Something on the lines of 
class MyInceptionFeatureExtractor(nn.Module):
    def __init__(self, inception, transform_input=False):
        super(MyInceptionFeatureExtractor, se…