hmm, okay I guess the question that I have formed here is:
If I have a data set that is so big that I cannot load it onto my machines RAM, can I stream it batch by batch to a model object as if the stream were all one dataloader in RAM? Or do models need to be trained off of one giant dataloader?
I’ll go look around.