Hi,
Yes this is quite far from what nn.Modules were built for so it’s not super easy 
The thing to keep in mind here is that the original Module and the cloned one should NOT be the same.
In particular, the cloned one cannot use nn.Parameter() because these can only contain leaf Tensors (that don’t have history).
So you most likely want to make sure that you delete each parameter and re-assign the field with a clone of the value in the other module.