Solved by ptrblck in post #2 
              
              
                You could write a custom Dataset and lazily load each numpy array in the __getitem__. This tutorial might be a good starter.