Hi, similar problem here, I have a very large dataset (1200000 images) and it cannot fit into memory and using indexing like in this example.
I also tried using h5py file to create dataset.
The training goes well with shuffle=False and getting slower and slower with shuffle=True
Can you give me some advice on how to solve the problem?
Thanks a lot
Here is my question 2