Hi,
I have solved it using a great post - DataLoader, when num_worker >0, there is bug - #16 by piojanu 9
Basically, since my HDF5 were different (each file, different X / Y files), I had to separately load them.