You can try and diversify your data sources as much as possible. For instance, you might want to aim for equal representation of various minority populations in your data, rather than predominantly choosing the majority. You may also consider asking a member of a minority population to see if your data is possibly discriminatory or biased.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence