Since you don’t want to train the resnet, did you also call model.eval() before using it (or just for the validation)?
Did you process the validation images in a different way than the training images?