Solved by ptrblck in post #13 
              
              
                Your new use case seems to use the penultimate activation tensors as an extracted feature. 
While your approach would return the feature tensor before the pooling layer (which will thus be bigger), my proposed approach would apply the pooling and thus yield a smaller activation. 
I don’t know, how y…