I’m tried this with a Quadro RTX 6000 and I also got someone else to try it with a GeForce 2080 Ti on a different machine altogether, and it failed both times. I believe I was able to narrow the issue and find a minimal code that breaks, it is related to calling autograd on a JIT compiled graph that uses torch.exp(x**2). It breaks with precompiled pytorch, without using libtorch at all, so I suspect my cuda installation is not the issue, but I guess there could be something weird going on with my driver still. I reported this at https://github.com/pytorch/pytorch/issues/47304 7.