I read through https://docs.nvidia.com/cuda/cublas/index.html 11 and found
CUBLAS_COMPUTE_32F_FAST_16F is used for
cublasGemmEx and cublasLtMatmul,
“Allows the library to use Tensor Cores with automatic down-conversion and 16-bit half-precision compute for 32-bit input and output matrices.”
Thought the conversion is supported. Maybe I am wrong ? Thanks.