Are you using any transformations inside your dataloader?
I could imagine, that you might use some normalizations only in your trainloader but not in your val_loader and therefore the images are not normalized properly inside your validation script.