Hi, I create a model and then wrap it in Data Parallel.
model = DataParallel(model)
Now, can I resume the model from a checkpoint using load_state_dict()?
model.load_state_dict(checkpoint[‘model_state_dict’])
will the new model weights be broadcasted across all gpus?