uch training
data can give improved results. In this data, the input prompt asks the model to evaluate
the quality of a given response to a particular instruction. The provided evaluation result
response consists of chain-of-thought reasoning (a justification), followed by a final score (in
our experiments out of 5). The format we choose for these prompts is given in Figure 2. This
thus serves as training data for the LLM to perform the role of a reward model. Subsequently
this will be referred to as Evalua