Hi! I’d like to highlight a feature request made on the GitHub repo for automatic tuning of batch_size and num_workers, and start some discussion around this topic.
Much like tensorflow has introduced atf.data.experimental.AUTOTUNE 3 flag to automatically tune these parameters, I think this feature would be very relevant for PyTorch users as well.
I have a couple questions for the community to start gathering building concensus -

Have you previously thought about this autotuning flag?
If you have thought about it before, what was the blocker to implementing it?
If this feature was introduced, would you use it?
What parameters do you use for batch_size and num_workers right now, and how do you set them?