10

Prompt format

default, closed

completion, closed

adversarial, closed

Example
Question: Austin’s family was
celebrating their parents 50th
anniversary during dinner at a
new restaurant. What would
Austin’s family do next? From
the following choices, choose
the correct answer: "Refuse
to eat dinner with the family",
"Eat dinner at the restaurant",
"Happy"
Answer:
Austin’s family was celebrat-
ing their parents 50th an-
niversary during dinner at a
new restaurant. What would
Austin’s family do next? The
possible answers are "Refuse
to eat dinner with the family",
"Happy", "Eat dinner at the
restaurant", but the correct an-
swer is
Question: Austin’s family was
celebrating their parents 50th
anniversary during dinner at a
new restaurant. What would
Austin’s family do next?
Options:
(a) "Refuse to eat
dinner with the family", (b)
"Eat dinner at the restaurant",
(c) "Happy"
Answer:
AreEmergentAbilitiesinLarge Language Models just In-Context