You might want to check that the data augmentations are the same across the training and validation set. Beyond that you might want to go down to just a single example first to check that the examples are indeed identical.