You don’t have to retrain the model, but just set it to evaluation mode via model.eval().
This will make sure to e.g. disable dropout and use the estimated stats in batchnorm layers instead of the batch stats.