Thanks! Stupid mistake. My bad.
Unfortunately, deepcopy throws the following error:
“Only Tensors created explicitly by the user (graph leaves) support the deepcopy protocol at the moment”

UPD: Actually deepcopy on model.state_dict() works fine! Thanks anyway.