As you’ve already partly exaplained:

volta: GPU architecture
s = accumulator type: single precision in this case
gemm: kernel type: matrix multiplication in this case
128: number of elements per CTA in M dimension of the C matrix
32: number of elements per CTA in N dimension of the C matrix
nn: storage mode for A and B matrices, respectively: “normal” or “no-transpose” (column-major) in your case




 hohohihi:

By using that pyprof result, can i figure out how many SMs are used? how many warps are activated in that SM?


You could probably use Nsight Compute to profile this kernel in more detail.