Retrieval Augmented, Evaluation Metric, Large Language Models, Llmops, Llm Evaluation.
response by simply adding a line to the LLM prompt template of “if relevant content is not provided and no conclusive solution is found, respond that the answer is unknown.” In some cases the correct answer is that the answer does not exist. Diagram by author Scenario 3: Bad Response, Mixed