Nikhil_Chhabra:

I have a confusion whether in 2021 we still need to have CUDA toolkit installed in system before we install pytorch gpu version


This wasn’t the case before and you would still only need to install the NVIDIA driver to run GPU workloads using the PyTorch binaries with the appropriately specified cudatoolkit version.
One limitation to this is that you would still need a locally installed CUDA toolkit to build custom CUDA extensions or PyTorch from source.



 Nikhil_Chhabra:

And if conda installs the toolkit does pip3 also does that?


Yes, but the pip wheels are statically linking it instead of depending on the conda cudatoolkit.