Solved by ptrblck in post #2 
              
              
                I guess you haven’t used PTX and only built PyTorch for sm_75. 
You could use TORCH_CUDA_ARCH_LIST="6.1 7.5" python setup.py install to build for both architectures. You can also add +PTX after each architecture to ship with PTX.