I’m a bit confused about what you’re doing here.
What are these timings here for?
Also you mean that just using the kernels by themselves is faster than when using them embedding in the rest of the code?
Maybe you’re not using the same input sizes? Or not testing the backward kernel?