[8 more in-context examples]

###

###

['vest', 'snow','remove', 'silhouette', 'dunk', 'step',

Concepts:
'item', 'toddler', 'plaster', 'wall', 'piece', 'tool', 'circle',
'pull','wrap', 'headphone', 'deck', 'suit', 'press', 'mother', 'pit',
'cupcake', 'priest', 'rink', 'counter', 'rest','piano', 'wine', 'serve',
'winter']

Sentence: A toddler wearing a vest and snow boots steps onto the icy
deck, removes a circle-shaped piece of plaster from the wall, and pulls
out a tool from their winter suit to wrap their head around a headphone.

Figure 7: Example output for Constrained Generation using the pre-hoc prompt from Madaan et al.
(2023). The constraint that the output needs to contain all the concepts is not explicitly mentioned
in the prompt. However, in the feedback & refine (post-hoc) prompts, the constraint is implied by
“what concepts from the concept list are missing from the sentence?” (refer to Figures 25 and 26 of
Madaan et al. (2023) for the prompts).
LARGELANGUAGEMODELSCANNOTSELF-CORRECT REASONINGYET