Seeing from learn2learn implementation of MAML, turns out we can manually do in-place update of the parameters (not using .copy_()) to maintain the computational graph. However, it requires us to recursively check the ._parameters property of each _modules of our model. This is the manual in-place update 5 and this is the recursive part 3.