Hi albanD
I just noticed there is a need to use DataParallel. However, simply wrapping my network with it cause trouble:
File:…/torch/nn/parallel/parallel_apply.py/ line 67, in parallel_apply raise output
IndexError:index 5 is out of range for dimension 0 (of size 5)
How I wrap it:
net = torch.nn.DataParallel(net, device_ids=[0, 1, 2, 3]).cuda()
I am traceing back to parallel_apply.py code. Please let me know if you have any idea.
Thanks