I think you have to install cuda separately. The cuda version selection is to make sure that you install a pytorch build that is compatible with the cuda version that you have.
If you never use .cuda() nor torch.cuda.FloatTensor and friends, then everything should run fine on the CPU.