Hello,
In that case the only solution for you is to optimize the part of the code responsible for reading data (Dataset.__getitem__). If it’s possible load all the data into RAM at once, instead of reading from drive at each batch. Also note that when number of workers is different from 1, you have multiple processes loading data at once, so this corresponds to your initial question I guess