I’d say, if you stick with a single thread, you would be fine with using python in most cases, but since you probably want to use multithreading (to have some background workers in other threads or simply forward the model in multiple threads), you would have to switch to multiprocessing in python, which has some hard limitations due to the GIL.
Also it is not that easy to setup python on most devices (like mobile or embedded devices, but it is virtually always possible to compile binaries [if you put enough effort to it]).