Solved by ptrblck in post #2 
              
              
                I don’t think this is a better approach and I would stick to separate DataLoaders for each split. 
Why do you think it might be a better approach?