If network is a “standard” model, i.e. not wrapped in nn.DataParallel, the workflow should be fine.
Once you wrap your model in nn.DataParallel, you would have to load the state_dict via network.module.load_state_dict.
I’m not sure I understand the question correctly, but why do you think it should thrown an error?