Hi @user123
If you have large dataset, you’ll need to write your own dataset to lazy load examples. Also consider using datasets 58 library. It allows you to memory map dataset and cache the processed data, by memory mapping it won’t take too much RAM and by caching you can reuse the processed dataset.