Ok that’s weird, can you let me know which exact versions of cudnn, torch, CUDA, you used?
Was it the same test code?
Btw: The final production code will run on a T4 card. I haven’t tried to verify tensor-op use on that GPU though.