The items collected by ReAct [29] in each trial is

• Trial 1: ‘bamboo’, ‘dirt’, ‘sand’, ‘wheat_seeds’;
• Trial 2: ‘dirt’, ‘rabbit’, ‘spruce_log’, ‘spruce_sapling’;
• Trial 3: ‘dirt’, ‘pointed_dripstone’;

The items collected by Reflexion [30] in each trial is

• Trial 1: ‘crafting_table’, ‘orange_tulip’, ‘oak_planks’, ‘oak_log’, ‘dirt’;
• Trial 2: ‘spruce_log’, ‘dirt’, ‘clay_ball’, ‘sand’, ‘gravel’;
• Trial 3: ‘wheat_seeds’, ‘oak_log’, ‘dirt’, ‘birch_log’, ‘sand’.

The items collected by AutoGPT [28] in each trial is

39

Figure A.2: Map coverage: Two bird’s eye views of Minecraft maps. VOYAGER is able to traverse
2.3× longer distances compared to baselines while crossing diverse terrains. Trajectories are plotted
based on the positions where each agent interacts with GPT-4.

• Trial 1: ‘feather’, ‘oak_log’, ‘leather’, ‘stick’, ‘porkchop’, ‘chicken’, ‘crafting_table’,

‘wheat_seeds’, ‘oak_planks’, ‘dirt’, ‘mutton’;

• Trial 2:
VOYAGER- An Open-Ended Embodied Agent with Large Language Models