I’m not sure if there is a better way than to prune the model and save the state_dict with the new model definition.
If you would like to keep the same model definition, you could work with masks to prune the parameters, but I guess that’s not really what you want.