I believe the bottle neck is in data loading. I’m using Dataset folder to load data in batches. What do you mean by using synthetic data?
would increasing the number of workers in the Dataloader method increase the number workload on the GPU?