Could you post a small code snippet reproducing this error?
It’s strange, that your loss suddenly increases using DataParallel while it was decreasing using a single GPU.
Did you change any other parts of your code, e.g. unintentionally removing optimizer.zero_grad() or moving it out of the training loop?