Cool. Just register the hook on shotcut does help. So if I want to pass out any feature map inside the bottlenek, I just register it after the specific layer, am I right?
i.e. register_forward_hook on Bottleneck.bn3 can give me the final feature map of Bottleneck?
But one more question, what if I want this out before this line 2? Right after computing out += residual