Hi @ptrblck , I have the same issue. I was thinking if it would be good to do the following:
use functools.lru_cache( ) on __getitem__ and iterate over the dataloader once so that all getitem are cached. Now increase the num_workers from 0 to some value, and expect the cached data is shared across the processes.
Will this work ?