cudnn_is_available() would not return False, if you disable the usage of cuDNN as in fact it’s still available.
You can profile the code via e.g. Nsight Systems or the PyTorch profiler to see the kernels.