Arda_Tumay:

I really looked at similar questions and I inferred that PyTorch 0.4 is a very old version and I need to build it from source to run with CUDA 11.


The K80 wouldn’t need CUDA11, so you should be able to build the extension with the matching CUDA version which is used for your PyTorch build.



 Arda_Tumay:

Moreover, Cuda codes are previously compiled with these options, “-x cu -Xcompiler -fPIC -arch=sm_60”.
At this point, I confused. I am not sure sm_60 is a right architecture for Tesla K80.


No, the K80 has the compute capability 3.7, so building for sm_60 won’t work on this device.



 Arda_Tumay:

Or if I need to build pytorch 0.4 from sources, how do I build it with CUDA 11 support?


This won’t be easily possible, since the CUDA11 support landed in PyTorch ~1.7. In any case you wouldn’t need CUDA11 as described before.