I believe I am facing the same issue. Can you point me to an example of how load all training data to the GPU in the data loader? My images are currently on disk in labeled subdirectories (about 25,000 images).
Also - if the push to GPU is implemented within the data loader, I assume that this removes the ability to be device-agnostic, right?
(BTW, I have only one GPU device.)