prompt: Is squirrel kosher?
chosen.role: system
chosen.content: A chat.
chosen.role: user
chosen.content: Is squirrel kosher?
chosen.role: assistant
chosen.content: No, squirrels are not kosher. For an animal to be considered as such, it must chew its cud and have split hooves. 
rejected.role: system
rejected.content: A chat.
rejected.role: user
rejected.content: Is squirrel kosher?
rejected.role: assistant