In the meantime, I tried to use cudnn from C++ directly to verify Tensor Cores work in general on this computer and setup.
I was able to run the cudnnConvolutionForward cudnn method with 3D image and filter and the profiler confirms it’s using the xmma new::gemm::kernel which makes extensive use of tensor cores as I can see from the metrics.
So in general it should work. Haven’t managed from pytorch though…