I try to replicate the net2net 4 torch code in pytorch and here where I stuck. It uses m.output to reach the last feedforward state to compute BatchNorm statistics but as far as I see, it is not possible in Pytorch. Do you have any other alternative method that you might like to suggest? especially @smth