Can i get the API for this so I can make an app with it?
Hey all, I am pretty new to the field of AI app development, and I am mainly targeting the method of getting an AI API and implementing it within the app I make. Can I do the same with this particular model?
https://huggingface.co/google/gemma-2-2b-it/discussions/21?inference_api=true should be able to help you out :)
Just note that the free Inference API is subject to rate limits and usage demands. If you need an inference solution for production, check out Inference Endpoints instead.
Very few models are "plug and play" with inference endpoints and usually need a sample "handler.py" file after cloning the repository for it to work properly. Is this documentation you can provide to support more seamless deployments? Qwen models are the only ones that deploy seamlessly that I've tried.
Hi @riggscodes , Sorry for late response. Yes, you can integrate this particular AI model into your app via the OpenAI API. OpenAI provides clear documentation and client libraries to help you get started, and there are plenty of tools to help you manage the integration. Just keep in mind API costs, rate limits, and security when developing and deploying your app.v
Thank you.