Some remedies include making sure that the data-sets being used have no inherit bias and the humans that are aligning these modals for Reinforcement learning are unbiased as well. Since a language model is just as good as it's training, making sure that the dataset is unbiased is important.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence