ptrblck:

f you are using DistributedDataParallel , you would have to make su


Thanks @ptrblck, in nn.DataParallel if we use 2 GPUs, checkpoint saves the data from default device (i.e GPU-0), right? GPU-2 data is not important?