Just figured this out by myself :-D.
It turns out there is a variable in nn.Module called training and model.train()  and model.eval() essentially makes it True/False (default True)
from torch import nn

model  = nn.Module()
model.training
# True
model.eval()
model.training
# False