Yes, that’s possible.
If you are training a multi-GPU model, you should store the model.module.state_dict() as explained here 150 to remove the .module attributes, which might create errors when trying to load it back on a standard model.