I think when you install PyTorch, cuda and other software come bundled with it. So, you don’t have to manually install cuda to use PyTorch. The only catch is that your driver must be updated to whatever version is required by cuda.
Need confirmation on this tho.