I have the exact same issue. I need to compute jacobian many times, and it’s terribly slow to have that many backward passes.
The python Autograd library 603 is much better for jacobian. I was thinking if I could do the same with pytorch.
I hope they implement jacobian soon.