It is technically possible now, depending on the operators that your model uses. However, the real speed-up of forward-over-reverse Hessian comes from being able to vectorize over the forward (otherwise you’d have to compute the forward O(numel) times). The ability to compute vectorized jvp should be in master soon, but is not ready at the moment.