Make sure to call model.eval() before running the validation loop.
This makes sure to disable dropout layers and use the running stats of batchnorm layers instead of the current batch mean and stddev.