Llm, Mlflow, Arize Phoenix, Llamaindex.
results = mlflow.evaluate( logged_model.model_uri, eval_df, targets="ground_truth", model_type="question-answering", extra_metrics=[answer_similarity(), answer_relevance()] ) Once you run the code will generate the answer for the questions that are provided and compare them with the ground truth