Hi, I’ve read this tutorial https://pytorch.org/tutorials/advanced/cpp_extension.html 1.
But I feel weird about the speed result.

image1176×454 27.9 KB

It says CUDA-based C++ code is slower than custom CUDA kernel. The two method both run codes on cuda device in c++ with the same operator. Why there is a speed gap between them?
Thank you.