Hi Demtris,
Thank you very much for you detailed answer!
As you said, we are reading a large text file that won’t fit in RAM and I will definitely try your recommended LMDB and see what happens.
I understand your point about “loading with CPU adds almost no overhead while training on GPU” and I am curious if there is a simple way of writing a dataloader that can load data independently (e.g, using a queue storing batches loaded like what has been done in TensorFlow )