Prometheus: Inducing Fine-grained Evaluation Capability in Language
  Models
Recently, using a powerful proprietary Large Language Model (LLM) (e.g.,
GPT-4) as an evaluator for long-form responses has become the de facto
standard. However, for practitioners with large-scale evaluation tasks and
custom criteria in consideration (e.g., child-readability), using proprietary
LLMs as an evaluator is unreliable due to the closed-source nature,
uncontrolled versioning, and prohibitive costs. In this work, we propose
Prometheus, a fully open-source LLM that is on par with GPT-4's evaluation
capabilities when the appropriate reference materials (reference answer, score
rubric) are accompanied. We first construct the Feedback Collection, a new
dataset that consists of 1K fine-grained score rubrics, 20K instructions, and
100K responses and language feedback generated by GPT-4. Using the Feedback
Collection, we train Prometheus, a 13B evaluator LLM that can assess any given
long-form text based on customized score rubric provided by the user.
Experimental results show that Prometheus scores a Pearson correlation of 0.897
with human evaluators when evaluating with 45 customized score rubrics, which
is on par with GPT-4 (0.882), and greatly outperforms ChatGPT (0.392).
Furthermore, measuring correlation with GPT-4 with 1222 customized score
rubrics across four benchmarks (MT Bench, Vicuna Bench, Feedback Bench, Flask
Eval) shows similar trends, bolstering Prometheus's capability as an evaluator
LLM. Lastly, Prometheus achieves the highest accuracy on two human preference
benchmarks (HHH Alignment & MT Bench Human Judgment) compared to open-sourced
reward models explicitly trained on human preference datasets, highlighting its
potential as an universal reward model. We open-source our code, dataset, and
model at https://github.com/kaistAI/Prometheus.
65289af6aeb01f59a14fbd72
Seungone Kim
claimed_verified
2023-10-13T07:52:08.713Z
6469949654873f0043b09c22
https://cdn-avatars.huggingface.co/v1/production/uploads/6469949654873f0043b09c22/Lk7IJAR16Wa_sGJ2g81AQ.jpeg
Seungone Kim
user
seungone
65289af6aeb01f59a14fbd73
Jamin Shin
claimed_verified
2025-04-24T12:41:34.230Z
6188cf3293317afcd1c2df7f
/avatars/95621801d5b3f3c1a681f1ad6cc66c6a.svg
Jay Shin
user
jshin49
65289af6aeb01f59a14fbd74
Yejin Cho
65289af6aeb01f59a14fbd75
Joel Jang
admin_assigned
2023-10-13T08:39:42.278Z
613e1a9267835521a6816b04
/avatars/49edaa425bbce04dff92bbfb12a6b41c.svg
Joel Jang
user
wkddydpf
65289af6aeb01f59a14fbd76
Shayne Longpre
admin_assigned
2023-10-13T08:39:49.890Z
61f4283a81c4d30f58140242
/avatars/a1cf1ef1fd442c36ed65c68e51919fed.svg
Shayne Longpre
user
Shayne
65289af6aeb01f59a14fbd77
Hwaran Lee
claimed_verified
2023-10-13T14:42:58.184Z
65294f43375b3a8bc1351acd
/avatars/0105b9b152bc897dd36d0d9b8a590ddf.svg
Hwaran Lee
user
hwaranlee
65289af6aeb01f59a14fbd78
Sangdoo Yun
admin_assigned
2023-10-13T08:40:05.477Z
648ac415718bc0670a5a5f56
/avatars/27189e289b808ef01689ff2abb7a56bf.svg
Sangdoo Yun
user
oodgnas
65289af6aeb01f59a14fbd79
Seongjin Shin
admin_assigned
2023-10-13T08:40:18.610Z
631b8731824f2502e353ccdb
/avatars/7b053800e3cf35b61d4af15180618f23.svg
SHIN SEONGJIN
user
optimalc
65289af6aeb01f59a14fbd7a
Sungdong Kim
admin_assigned
2023-10-13T08:40:27.204Z
6084ebe956f7623a0b849153
/avatars/c56fb056800c145e5a8234e27b6b5a31.svg
Sungdong kim
user
dsksd
65289af6aeb01f59a14fbd7b
James Thorne
admin_assigned
2023-10-13T08:41:03.493Z
63b54db5889aa6707f08f2d1
https://cdn-avatars.huggingface.co/v1/production/uploads/63b54db5889aa6707f08f2d1/zUnyx-8Zabxr54poZtUo4.jpeg
James Thorne
user
j6mes
65289af6aeb01f59a14fbd7c
Minjoon Seo
admin_assigned
2023-10-13T08:41:11.137Z
621f05ba970615ad5861ceb1
/avatars/7e1902aa71369a524afda9b0a9e88e22.svg
Minjoon Seo
user
minjoon
Prometheus: Inducing Fine-grained Evaluation Capability in Language
  Models
Recently, using a powerful proprietary Large Language Model (LLM) (e.g.,
GPT-4) as an evaluator for long-form responses has become the de facto
standard. However, for practitioners with large-scale evaluation tasks and
custom criteria in consideration (e.g., child-readability), using proprietary
LLMs as an evaluator is unreliable due to the closed-source nature,
uncontrolled versioning, and prohibitive costs. In this work, we propose
Prometheus, a fully open-source LLM that is on par with GPT-4's evaluation
capabilities when the appropriate reference materials (reference answer, score
rubric) are accompanied. We first construct the Feedback Collection, a new
dataset that consists of 1K fine-grained score rubrics, 20K instructions, and
100K responses and language feedback generated by GPT-4. Using the Feedback
Collection, we train Prometheus, a 13B evaluator LLM that can assess any given
long-form text based on customized score rubric provided by the user.
Experimental results show that Prometheus scores a Pearson correlation of 0.897
with human evaluators when evaluating with 45 customized score rubrics, which
is on par with GPT-4 (0.882), and greatly outperforms ChatGPT (0.392).
Furthermore, measuring correlation with GPT-4 with 1222 customized score
rubrics across four benchmarks (MT Bench, Vicuna Bench, Feedback Bench, Flask
Eval) shows similar trends, bolstering Prometheus's capability as an evaluator
LLM. Lastly, Prometheus achieves the highest accuracy on two human preference
benchmarks (HHH Alignment & MT Bench Human Judgment) compared to open-sourced
reward models explicitly trained on human preference datasets, highlighting its
potential as an universal reward model. We open-source our code, dataset, and
model at https://github.com/kaistAI/Prometheus.
Prometheus, an open-source LLM, matches GPT-4's evaluation capabilities using customized score rubrics and outperforms ChatGPT across various benchmarks.
Large Language Model LLM GPT-4 child-readability Feedback Collection score rubrics instructions long-form text Pearson correlation human evaluators ChatGPT MT Bench Vicuna Bench Feedback Bench Flask Eval HHH Alignment MT Bench Human Judgment universal reward model