@valhalla the bot is not replying for me. Anyway, I tried run the backend script in colab here 9. And working fine but in some cases the bot is questioning and answering itself. Inference time is good in colab.