As a side note, when I check the pytorch/build/lib directory and run ldd on some of the libraries there, I see that some of them point to libcublas.so from my conda environment but libcublasLt.so from my usr/local/cuda directory. Could this be a source of the problem?

Screenshot 2022-01-02 at 18.07.101682×812 372 KB