lbhm:

So changing something in the original dataset I created before the start of training would not work in my understanding as it does not alter the dataset copies in the worker processes.


This is correct (if you are using multiple workers in the DataLoader), but note that you should still be able to manipulate the underlying loader.dataset after each epoch and before starting a new one as long as you are not using persistent_workers=True.