I have video data stored in a Numpy array each of shape (1, 16, 100, 100, 3). The array is huge and every time I load it, I get a memory error.
Is there a way using Pytorch to load these videos in batches without actually loading the Numpy array so that I don’t get the memory error.
Thanks.