GemmBatchedEx https://docs.nvidia.com/cuda/cublas/index.html#cublas-GemmBatchedEx 9 should be able to do what you want, because it accepts an array of pointers, so B pointers could be repeating in a loop, but cublasGemmBatchedEx is not used in pytorch backend because preparing aforementioned lists of pointers is somewhat painful unless really necessary.