Solved by ptrblck in post #2 
              
              
                Data augmentation is applied on the fly for each batch during training. 
If you are using a Dataset and pass it to a DataLoader with multiple workers, the data loading and processing would be executed in the background while the model is training. 
I would have a look at torchaudio which ships with…