I don’t see any obstacles for that, as long as you clone model tensors cleanly. I’d try something like model2.load_state_dict({k:v.detach().cpu().clone() for k,v in model.state_dict().items()}) (clone() may be unwarranted as cpu() already copies)