Solved by yoshy in post #2 
              
              
                As expected, it was very simple. F.dropout doesn’t disable dropout for eval mode. From stackoverflow: 

Both are completely equivalent in terms of applying dropout and even though the differences in usage are not that big, there are some reasons to favour the nn.Dropout over nn.functional.dropout: 
…