Hi!
I generated a data set, which contains 10 numpy files, and each .npy file have 10000 samples. Are there any examples to load these kind of data sets for training?
The tutorial here http://pytorch.org/tutorials/beginner/data_loading_tutorial.html 85 is very simple, but in my case, there are multiple splits of files. How could I easily create a FaceLandmarksDataset alike from Dataset base class?
I also read this example https://github.com/pytorch/vision/blob/master/torchvision/datasets/cifar.py 25, it seems all batch data are needed to first load into memory, which might be unpractical for large scale data, right?
Thanks.