Thanks for the model definition! Could you post the input shapes you are using as well, please?



 Kingsmove:

Finally, by the way, though I do not quite understand the linked binary… as it seems that the problem happens on cudnn, I just remember that I installed the cudnn library through


Your local CUDA toolkit and cudnn library won’t be used, if you’ve installed the conda binaries or the pip wheels.
You could indeed build from source and compare the speed. If you are seeing a speedup it might come from a different cudnn version and/or from the usage of the missing xmma kernels in the binary.
Once you provide the input shapes, I could check the model perf. using the latest cudnn release as well as internal versions.