(A) ﬁsh
(B) Deep sea animals
(C) Long Sea Fish
(D) Far Sea Animals
Answer:
(B)

(A) ﬁsh
(B) Deep sea animals
(C) Long Sea Fish
(D) Far Sea Animals
Answer:
(A)

69

TriviaQA
(Many possible correct
answers per question)

This eval has 4 choices per question, but we show two examples here.

Correct Example 1
Q: Which musical featured the song The Street Where You Live?
A:
My Fair Lady

Correct Example 2
Q: Which musical featured the song The Street Where You Live?
A:
My Fair Lady (2010 ﬁlm)

Correct Example 2
Q: Which musical featured the song The Street Where You Live?
A:
Enry Iggins

70

References
[Amodei et al., 2016] Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mané, D. (2016).

Concrete problems in ai safety.
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback