Data Science, AI, Llm, OpenAI, Deep Dives.
we often need to handcraft a new prompt. Lack framework to conduct testing: Instead of the usual train-test regime in typical data science applications to pick the model which maximizes a certain metric like AUC, with LLMs we arrive at the best prompt via trial and error, often without an objective