that instruction following models are capable of “morally self-correcting" to mitigate producing
harmful responses when instructed to do so Ganguli et al. [2023].
Self-AlignmentwithInstructionBacktranslation