Closest “solution”(not) I’ve found so far is to use copy_:
with torch.no_grad():
    for i, p in enumerate(net.parameters():
        p.copy_(new_params[i])

But this gives back a RuntimeError that size of the tensor needs to match. Seems like I’m getting close to cracking this egg. Just need to know the right command to overwrite the layer sizes.