I used iterative stratification to balance distributions of multilabel data across splits for cross validation. And then I chose 1 fold/5folds  to be the validation fold. So, normally there is no data leakage. Now, concerning the “simpler” samples, I have no idea. Do people normally go through the samples one by one to see?