Solved by ptrblck in post #4 
              
              
                You are right. In the original model adaptive pooling is used in the forward method. 
Have a look at this line of code. 
Did you add it to your model as well?