Hi Karthik, one option would be to serve it with our hosted inference API for example with our startup plan here: https://huggingface.co/pricing 6. We would take care of the optimizations for you. If you have any question, feel free to write an email to api-enterprise@huggingface.co.