I think that is a different issue. I want to update all parameters. I just want to be able to keep in memory a copy of a previous state_dict.
I solved it saving the state_dict in disk and then loading it, but still I wonder how to do it in memory.