Enamex:

Perhaps some documentation on guiding the JIT towards similar performance to writing fused kernels?


There is indeed ongoing work in the different JIT backends, which use code generation to create (fused) kernels. I’m a bit familiar with the internals of the nvfuser work, but unfortunately cannot link to a proper documentation, as it’s still in an early stage.
In any case, I believe to see more code generation approaches in the future, which would make writing custom operations easier in the framework