Platform and Infrastructure Choices
Which annotation platform was utilized? FigureEight (Now Appen)
At a high level, why was this platform chosen? For the ability to externalize data
Did the chosen platform sufﬁciently meet the requirements outlined for annotator pools? Are any aspects not covered?
Yes

What, if any, communication channels did the platform offer to facilitate communication with annotators? How did this
channel of communication inﬂuence the annotation process and/or resulting annotations? Annotators could rate the
task on a 1-5 scale to provide general feedback.

For individual task responses, they could send a message to contest test questions that were marked incorrect.

86

How much were annotators compensated? Were any particular pay standards used to determine compensation? If so,
please describe. Annotators were paid 1.5 cents ($0.015 USD) per judgment.
PaLM 2 Technical Report