Hi Ross,
Thanks for the reply! The Nvidia’s DALI is a good way to reading the TFRecord and MXNet format.
However, I have the following questions:

Does PyTorch has its own recordIO so that we do not need the TFRecord format?
If the files in a folder is NOT in TFRecord or MXNet format, but in user defined format, such as label key1: value_list1 key2: value_list2 ...,  then what is the recommend way to read the files by PyTorch. Note that there are multiple files in the folder and the total size of  files is large that cannot be put into memory.

Thanks very much!
Yin