Hi,
Yes this is a limitation of AD that it only does “vector times Jacobian” product. If you want to get the full jacobian you will need to use special code.
Note that if you use nightly builds of pytorch, we added this here 9.