Oh gee thanks. Did some search on the .eval() method. So it turns out that to evaluate we should
# Evaluation mode
model.eval()

with torch.no_grad():
    ...
    out_data = model(data)
    ...

and then turn the training method back on
# Training mode
...
model.train()
...

Again, first  time me doing this.