I’m afraid I never got to the bottom of this. I currently am just hacking it by transferring matrices to the CPU to do the cholesky then sending them back to the GPU.
For reference I am using torch 1.1.0 and CUDA version 9.0