Thanks for your answer!
By spelling of the contraction, do you mean writing the operation as an einsum ?
Using another library and writing the backward seems like a somewhat pain-free solution too, but I was wondering if there would be a way to indicate to cuBLAS which kernel to call. In the end, I suspect we might have to go that route.
Cheers,
Seb