Had the same problem, thank you for figuring it out.
The error message could be a lot clearer.

RuntimeError: all tensors must be on device[0]

should be something like;

RuntimeError: Model already contains a DataParallel submodule