In your load_model method you are removing the module names of nn.DataParallel. Is this still needed in your current code snippet? Could you check the new_state_dict and see if the names are still valid?