Did you check the data splits between the training and validation sets?
Could maybe “simpler” samples have landed in the validation set or are you using aggressive data augmentation techniques during training?