Thanks for the reply. The seed should not be an issue I think because I manually set the seed at the start of the whole script (for random, torch, and numpy). Just to be sure, I’ll set the seed in that function, too. However, I moved away from using load_dataset because of this issue 8, so I can’t test whether the cache_file_name works.