Different GPU architectures can use different kernel implementations.
Based on



 ptrblck:

I was able to reproduce and narrow down this issue to a faulty kernel in cudnn.
I’ve also tested the next release candidate and the issue is gone, so my only advice for you is not to use this particular convolution in mixed-precision training. 


a particular kernel for this architecture was broken in cudnn 7.6.5.32 and fixed in cudnn>=8.0.