What about using allow_unused=True?
grad_info = torch.autograd.grad(loss_meta_train, self.model.module.params(), create_graph=True, allow_unused=True)

The question is quite similar to RuntimeError: One of the differentiated Tensors appears to not have been used in the graph. Set allow_unused=True if this is the desired behavior 5