• RATING-B: The response is acceptable but has
minor errors or imperfections that can be im-
proved.
• RATING-C: The response is relevant and re-
sponds to the instruction, but it has signiﬁcant
errors in the content. For example, GPT3 might
generate a valid output ﬁrst, but continue to gen-
erate other irrelevant things.
• RATING-D: The response is irrelevant or invalid,
includingrepetitionoftheinput,totallyirrelevant
output, etc.
SELF-INSTRUCT- Aligning Language Model with Self Generated Instructions