ndard approach [Dubois et al., 2023, Li et al., 2023b, Fernandes et al., 2023,
Bai et al., 2023, Saha et al., 2023], and is being used to train reward models or curate data
as well, as described above [Lee et al., 2023, Chen et al., 2023, Li et al., 2023a]. While some
works such as Kim et al. [2023] create training to data to train an LLM to perform well as a
judge, to our knowledge it is not common to combine this training with general instruction
following skills as in our work.
5
Conclusion
We have intro