Remember that you must call  model.eval()  to set dropout and batch normalization layers to evaluation mode before running inference. Failing to do this will yield inconsistent inference results. Source 7.