Sorry for the late reply @ptrblck… just saw the reply today, I replaced my stable downloads with the nightly and the CMake file contains exactly what you suggested. However, I get an error saying  -
-- Caffe2: CUDA detected: 10.2
-- Caffe2: CUDA nvcc is: /usr/local/cuda/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda
-- Caffe2: Header version is: 10.2
-- Could NOT find CUDNN (missing: CUDNN_LIBRARY_PATH) 
CMake Warning at /home/atharva/libtorch/libtorch/share/cmake/Caffe2/public/cuda.cmake:109 (message):
  Caffe2: Cannot find cuDNN library.  Turning the option off
Call Stack (most recent call first):
  /home/atharva/libtorch/libtorch/share/cmake/Caffe2/Caffe2Config.cmake:88 (include)
  /home/atharva/libtorch/libtorch/share/cmake/Torch/TorchConfig.cmake:40 (find_package)
  CMakeLists.txt:5 (find_package)


-- Autodetected CUDA architecture(s):  7.5
-- Added CUDA NVCC flags for: -gencode;arch=compute_75,code=sm_75
CMake Error at /home/atharva/libtorch/libtorch/share/cmake/Caffe2/Caffe2Config.cmake:96 (message):
  Your installed Caffe2 version uses cuDNN but I cannot find the cuDNN
  libraries.  Please set the proper cuDNN prefixes and / or install cuDNN.
Call Stack (most recent call first):
  /home/atharva/libtorch/libtorch/share/cmake/Torch/TorchConfig.cmake:40 (find_package)
  CMakeLists.txt:5 (find_package)


-- Configuring incomplete, errors occurred!
See also "/home/atharva/CLionProjects/TorchTest/CMakeFiles/CMakeOutput.log".
See also "/home/atharva/CLionProjects/TorchTest/CMakeFiles/CMakeError.log".

My cuddn.h is in /usr/local/cuda/include and
My cudnn.so and .a files are in /usr/local/cuda/lib64…
Do we need to provide any other option while running CMake ?
TIA