One way is to write your custom DataLoader with seed value (which will be same for every usage).
And log number of times you have iterated over the dataloader before stopping. When you start again, you need to iterate till the last time using log.
this link 126 might be helpful for random seed based data loader