@ptrblck
My dataloaders work very well on a single GPU, so I guess there is nothing wrong with it.
My code hangs in the first iteration
Here is part of my code.
In the first iteration, the “First checkpoint” is printed out but the “Second checkpoint” doesn’t.
The whole program is hung there.
for ids, Cw, Cc, Qw, Qc, a in tqdm.tqdm(train_loader):
    optimizer.zero_grad()
    print("First checkpoint")
    pred1, pred2 = model(Cw, Cc, Qw, Qc)
    print("Second checkpoint")
    torch.cuda.empty_cache()
    loss1 = F.cross_entropy(pred1, a[:, 0])
    loss2 = F.cross_entropy(pred2, a[:, 1])

This is cuda version information.
>>>print(torch.version.cuda)
>>>8.0.61

I’m not an English native.
Hopefully my description is clear enough.
Thank you.