Without seeing the code it’s hard to debug, but you could check:

your image loading and make sure all images are loaded in RGB format (which is the default in PyTorch, as it’s using PIL)
make sure the same preprocessing is applied (same resizing, normalization etc.)
call model.eval() after creating the instance and loading the state_dict.