The author has used Tesla P100 GPU (FYI).
It has given error I have also tried with both of these too with changes you have described.
model = torch.nn.DataParallel(model, device_ids=None).cuda()
model = torch.nn.DataParallel(model, device_ids=args.gpus).cuda()

With MGPUs.png1405×859 160 KB