Solved by SimonW in post #2 
              
              
                Assuming that you are using the dropout modules. 
model.eval()
for m in model.modules():
  if m.__class__.__name__.startswith('Dropout'):
    m.train()