The network seems to be overfitting. Also if any garbage data is present, that could show up in your train loss.

You can apply more augmentations to train.
Dropouts can help.
Like you said, you can check your val data distribution and also look for any errors in it.