Thanks a lot.
do you mean simply doing :
self.model = nn.DataParallel(self.model)
self.model.load_state_dict(checkpoint['model'])

but would it not crash when done on CPU mode?
(it still generates the same error by the way)