It’s a matter of how do you save images rather than dataloader itself.
Shuffling just shuffles a list of indices. It seems your system is slower accessing non-sequential lists of indices.
How do you do so?