Thanks for the information!
I was just wondering if pre-loading the whole dataset onto the GPU might help, but it seems to be too large.
Did the caching speed up anything in the second and following epochs or did you see approx. the same GPU utilization?
If your current caching didn’t help, could you try to remove it and set the number of workers higher to see if you can get any performance advantages?