@ptrblck Once again thanks a lot for you input. I was curious about one last thing. In the above code you gave:
x = Variable(torch.FloatTensor(8, 3, 256, 256))
for feat in model.features:
     x = feat(x)

Is there a way to also access the name of each block/layer if that exists. I would expect sth like feat.name but that doesn’t exist.
I would really hope that pytorch developers really reconsider adding those features such as easily manipulating layers e.g. layer.pop, layer.push. layer.get, layer.name. That would also made the entry barrier much lower especially for anyone coming from a keras background.