Glad to know!
What about remove the .clone().
I mean just use net2[1].grad = net1[1].grad and they will point to the same address in memory, and I am not sure if it will use less memory than the present implementation, you could have a try