Well, so if you push your autograd function to C++ you can wrap the function with a JIT operator. You cannot currently do that in Python, though.
I once made a prototype of a scripteable function interface, but I never pushed it to the point where it was a mergeable PR.