I cannot reproduce the hang using torchvision.datasets.FakeData.
That being said, note that you are trying to use 60 total processes to load the data and also set the number of threads to 40 via torch.set_num_threads. Depending on your node I would assume this could create multiple issues.