It should work as long as your driver is new enough to use the CUDA toolkit.
Based on your description I guess you are not able to run any workload on the CentOS7 machine or are other models (using cublas and cudnn) working fine?