NLP, Llm, Prompt Engineering, Chatbots.
point is the cost of the subsequent calls to the NLP API for each prompt. Don’t worry, we’ve got you covered! Of course, any evaluation of prompt means using LLMs several times: for resampling and also for getting the answer for each sample. That’s a lot of calls and a lot of money per question!