BramVanroy:

Shuffle is not enabled in the default dataloaders in the trainer.


That is incorrect. The training dataloader is always defined with shuffle=True (more precisely with a random sampler because we have to handle distributed training, but that’s the same as not passing a sampler and pass shuffle=True).