The tutorial should really do model_ft.eval() before testing… It’s using BN layers so batch size do matter when in training  mode.
Edit: just submitted an issue for this https://github.com/pytorch/tutorials/issues/203 34. I’ll do a PR tomorrow.