I was looking at the famous paper MAML (Model Agnostic Meta-Learning) and they say they use Hessian-Vector products. How do they use them:


in mathematics? i.e. how do the Hessian vector products get involved in the update rule?


in the code. How do they update the parameters being learned?


Or is there a nice example of how Hessian Vector products are used in (meta) training?

cross posted:

https://www.quora.com/unanswered/What-is-an-example-of-using-the-Hessian-vector-product-in-learning-using-PyTorch 12
https://www.reddit.com/r/pytorch/comments/dhcn8c/what_is_an_example_of_using_hessian_vector/ 17
What is an example of using Hessian Vector Product in Learning using Pytorch?