Solved by ptrblck in post #2 
              
              
                libtorch is the C++ frontend while custom C++/CUDA extensions can be used in Python as modules or functional ops. Yes, both can be used for inference. 


@tom’s general rule is: “As long as your operands are reasonably large (say 100s of elements, not single elements), Python and Data “administrat…