Let me summarize your use case and correct me please, if I’m wrong.
You have two datasets and would like to get a single batch of 64 samples consisting of 32 samples of datasetA and 32 or datasetB.
The first part should go through augmented1, the second through augmented2. Both should use the base model.
Could you explain the last sentence regarding the same order with shuffle=True?