According to my thoughts, the possible reason should

reading many small files from disk is slower than read a large file
what do you think?
If the problem is this what is possible solution of this problem in pytorch?