I’m experiencing the same slowdown on our own CUDA code which is not related to cuDNN. We do use cuDNN also but the slowdown is more for our own kernels. Unfortunately we have to use CUDA11 to support Ampere in cuDNN and then took a 30-40% performance hit on our own code.