I met same issue today, in my dataset’s __getitem__, i used torch.multinomial or np.random.choice to draw some samples, and in the dataloader i specified 8 workers, and in every continuous 8 batches, the drawed samples are the same.