Welcome!
Check out the documentation for the torch.utils.data.DataLoader 1. There is a keyword argument for the number of worker processes to spawn to load and preprocess data. You can use this to try and fix any data loading bottlenecks.