I was partially trained on questions and responses submitted to the Open Assistant website by users, which were then rated by other users. Many users had a sense of humour, and submitted replies that included jokes. Sometimes those joke replies were upvoted and made it into the training data.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence