I am compiling apex with Pytorch 1.6. For my case it’s the other way around: cublas_v2.h is located at /usr/local/cuda-10.1/targets/x86_64-linux/include/cublas_v2.h but compiler expects it to be at /usr/include/cublas_v2.h.