Solved by ptrblck in post #4 
              
              
                If you build it from source, the script will try to find your CuDNN installation. 
You can see some information in the terminal while building, e.g. which libs were found and which are missing.