Context
Relevance

Faithfulness

Answer
Relevance

Noise

Robustness

Negative
Rejection

Information
Integration

Counterfactual

Robustness

✓

✓

✓

✓

✓

✓
✓

✓

✓

✓

Accuracy
EM
Recall
Precision
R-Rate
Cosine Similarity
Hit Rate
MRR
NDCG

✓

✓
✓

✓
✓
✓

Table 3: Summary of evaluation frameworks

Evaluation Framework

Evaluation Targets

Evaluation Aspects

Quantitative Metrics

RGB†

RECALL†

RAGAS‡

ARES‡

TruLens‡

Retrieval Quality
Generation Quality

Noise Robustness
Negative Rejection

Information Integration

Counterfactual Robustness

Accuracy

EM

Accuracy
Accuracy

Generation Quality Counterfactual Robustness R-Rate (Reappearance Rate)

Retrieval Quality
Generation Quality

Retrieval Quality
Generation Quality

Retrieval Quality
Generation Quality

Context Relevance

Faithfulness

Answer Relevance
Context Relevance

Faithfulness

Answer Relevance
Context Relevance

Faithfulness

Answer Relevance

Cosine Similarity

Accuracy
Accuracy
Accuracy

*
*

*
*
*
RAG forLargeLanguageModels-ASurvey