Cool! Thanks!
My hunch is that at the very least one can put num_workers = 2 and always get a benefit. As long as there is at least a single GPU and 2 real CPUs.
That is the sort of minimal advice I was hoping to hear. I know this is not for sure but I trust its probably right.