After reading a little bit, I am creating them like this (I changed this from the original code I sent previously in this thread):
train_sampler, valid_sampler = DistributedSampler(train_ds), DistributedSampler(valid_ds)

train_loader = idist.auto_dataloader(
        train_ds, batch_size=bs, num_workers=n_workers, sampler=train_sampler, drop_last=True
)

test_loader = idist.auto_dataloader(
       valid_ds, batch_size=bs, num_workers=n_workers, sampler=valid_sampler
)