Yes, you could create the iterators via:
iter1 = iter(loader1)
iter2 = iter(loader2)
...

and get the batches via: batch = next(iter1) etc.
Note that you would have to catch the exception once the iterator is done and would have to recreate the iterators afterwards.