Solved by Nikronic in post #2 
              
              
                Hi, 

About this question the answer is yes. The reason is that when you set model.eval() PyTorch removes all dropout layers (do not update mean/variance in batch norm). Here is a small snippet to test: 
class Test(nn.Module):
    def __init__(self, pool_size=(4, 4)):
        super(Test, self).__ini…