How did you use this subset of 6400 samples?
Did you use a Subset or RandomSubsetSampler?
Depending on the approach, you might have selected some particular classes and left out others.
However, if you’ve used some break statement inside the training loop for the DataLoader (which was supposed to use all data), it would be unlikely to just get a subset of classes.