evaluation[Liu, 2023].
Independent Evaluation
Independent evaluation includes assessing the retrieval mod-
ule and the generation (read/synthesis) module.

1. Retrieval Module

A suite of metrics that measure the effectiveness of sys-
tems (like search engines, recommendation systems, or
information retrieval systems) in ranking items accord-
ing to queries or tasks are commonly used to evaluate
the performance of the RAG retrieval module. Exam-
ples include Hit Rate, MRR, NDCG, Precision, etc.

2. Generation Module

The generation module here refers to the enhanced or
synthesized input formed by supplementing the retrieved
documents into the query, distinct from the final an-
swer/response generation, which is typically evaluated
end-to-end. The evaluation metrics for the generation
module mainly focus on context relevance, measuring
the relatedness of retrieved documents to the query ques-
tion.
Retrieval-AugmentedGenerationforLargeLanguageModels-ASurvey