Solved by smth in post #2 
              
              
                you can set your whole network to .eval() mode, but then set your dropout layers to .train() mode. 
You can use the apply function to achieve this for example: 
http://pytorch.org/docs/master/nn.html#torch.nn.Module.apply