As the pre-build conda packages, yes. I currently have pytorch 1.8.1 but in the past I also tried the nightly version and had the same issue.
But, it  seems that the issue I am encountering while trying to install from source is different from the problem I have with the conda binaries.
Anyway, main goal is to get an environment on which I would be able to use cuda with pytorch