Thanks! But how do I do that for all parameters?
Like this?
for param, pi in zip(net.parameters(), p_new):
        del param
        param = pi

I guess no.
Also, after the update I want to do a forward pass. Will I be able to do that?