Solved by albanD in post #10 
              
              
                Ho for that, the answer is definitely yes for the first and no for the second. 
Our dataloaders under the hood do the exact same thing of loading things from the disk actually in some cases. 
So the fact that memory is in ram or is read on the fly does not change at all how the training is going to …