@apaszke I wonder if there’s a prefetch option on GPU in PyTorch, just as in Caffe https://github.com/BVLC/caffe/blob/master/src/caffe/proto/caffe.proto#L670-L672 181. For example, my model is small, and I can trade GPU memory for using fewer workers or less fast HDD. Is this possible in PyTorch? This is especially an issue if I train multiple small models on PyTorch on separate cards of a single machine, as I run out of workers.