Yeah, that sounds pretty bad. I found this tracking issue for your particular problem (computing a Jacobian efficiently): https://github.com/pytorch/pytorch/issues/23475 27 so you can subscribe to that. Unfortunately I don’t have any suggestions for easy ways to speed your case up