Many thanks @ngimel!
Sorry, have one more question on this… Am i right that implementation is here 4 and what should be changed is c, CUDA_R_16F to c, CUDA_R_32F?
What i unfortunately don’t know (despite reading tutorial 3) is how to create a simple extension, which accepts just 3 tensors (easy bit) and would call cublasGemmEx at the end. Basically missing a link between these two parts (high-level and low-level). Seems that one step back (from THCBlas.cu) is here, but don’t see atm how to ‘adapt’ it. Might be you can kindly provide a link to some simple (or not so) example… Many thanks in advance!
Guess alternative would ‘simply’ be calling data_ptr() on 3 tensors (inputs and output) and passing it directly to cublasGemmEx 1?