Solved by albanD in post #4 
              
              
                Does moving the pooling layer from the model definition (in the constructor) to the forward method bring any advantage in terms of memory consumption? 

The answer is indeed no. 
I’m not familiar how torchsummary works, bu it might indeed be an artefact of it. 

While I have you here, may I also as…