I would advice you to just set up a fresh python environment using the latest conda-distribution and then do pip install transformers and it should work. I have set up multiple non-GPU VMs (both Amazon Linux and Ubuntu) in the last week that way and it has worked without any mucking around with either torch or cuda-versions.