That would be faster but consume much more memory. That might be ok in your case though !
You can do the same for the “forward mode trick” as well I guess. But not sure this will make the Jacobian computation faster than this one.