Wouldn't those things just introduce bias in different ways? Like cultural biases by the reviewers. Would it not be better to assume bias and use models as a way to explore that in the data, being mindful of our own biases and using queries that amplify the ones we want and mute the ones that we don't want?
spam lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor creativity violence