Solved by ptrblck in post #6 
              
              
                The DataLoader uses multiprocessing to load the batches asynchronously while the training takes place. 
However, if you have some heavy preprocessing in your Dataset or the data loading is IO bound, you might notice small freezes as the workers can’t keep up processing the data fast enough. 
You cou…