That seems like an awful lot of num_workers. I haven’t used any AWS GPUs but when I run locally I typically have the num_workers=8, which is plenty for most models to bottleneck elsewhere.
Is it possible that the code is bottlenecked elsewhere than the GPU / data reading?