Hi,
Could you provide the following informations please:

Where is your cuda install? Is there both one global and one local? like /usr/local/cuda and /your/loca/cuda/ ?
What is the content of the lib64 folder in it (or each install if you have more than one). Especially all the ls -la libcudnn* files?
What is the result of echo $LD_LIBRARY_PATH ?