With no information about the DataLoader as well as the way you are feeding your batches to your model during training, it’s really difficult to say. But one hypothesis could be that if you are feeding your samples X and labels y to the DataLoader, it is most likely returning a tuple of (X, y) which you may be feeding directly (without splitting) into the model during training. I hope this makes sense to you.