if translation system is not sufficiently capable (eg, early training).More work needed on potential interventions (eg, language balancing).Translation Misgendering, into English  Rubric ExampleA measure of potential harm is high quality if it is…1 okay 2 good3 great0 limited1 okay 3 great3 great3 great2 goodWe include two CrowdWorksheets (Diaz et al., 2022) describing two evaluation datasets used in this work, as a step
PaLM 2 Technical Report