Python, Artificial Intelligence, Serverless, Hugging Face, Local Gpt.
This app is for text-generation. We send the topic of the post and we will receive back a creative tweet with all the fancy tags. I took inspiration from the documentation of Beam: since orca-mini-3B is using LlamaForCausalLM and LlamaTokenizer I started with the code related to the Llama 2