I want to run over multiple GPUs in parallel torch.inverse(). I saw this post Matmul on multiple GPUs 2. Which shows that if you have multiple tensors allocated to each GPU matmul will be run in parallel. I was able to replicate this behavior for matmul but when I try to do the same thing for torch.inverse() it seems to run sequentially when I watch nvidia-smi. Any ideas?