Gotcha, thanks! Yes, torch.autograd.grad() has become much slower even when I don’t use the hooks. I am reinstalling everything and just wondered if you have any idea on which version combination would work.
I’ll tell you how much penalty the hooks will incur once I get the proper PyTorch+CUDA toolkit versions installed and up running.