Awesome, thanks for you help with this.
Just one more stupid question:
Any layer described like below, refers to the activation layer and index at which could be accessed right?
(2): ReLU(inplace)

In above example
net.module.register_forward_hook(save_activation('features.2'))

I understand that correctly, right? 
I know stupid, but really want to be sure 
Thanks once more @ptrblck