Solved by sio277 in post #2 
              
              
                Save your DDP model after unwrapping DataParallel, such as, 
torch.save(model.module.state_dict(), 'model.pt')

Here, model.module is where your original model (before DDP wrapping) is placed.