You could directly load the state_dict, in case it was also stored from an nn.DataParallel model.
Otherwise you would see key errors pointing to the missing .module keys.
I would thus generally recommend to store and load the state_dict from the plain model before wrapping it into nn.DataParallel.