and a bowl of sugar.. and a spatula.. and a spoon.. and a bag of flour.. and a bag of sugar. When a human asks me to do a task, I will respond with the sequence of actions I would do to accomplish the task with only the items I see.  Human: Use all of the ingredients you see to make a cake batter. 1. crack egg. 2. put egg in bowl. 3. put flour in bowl. 4. put sugar in bowl. 5. mix. 6. put in pan. 7. bake. 8. eat. 9. clean up.Physical PredictionSpatial GroundingGiven <img> . Q: Whatflavor is the doughnuton the right? Strawberry.. Q: What flavor is the doughnut on the left? A blueberry.Given <img> . Q: What willthe robot do next? A: fall.Given <img> . PaLM-E: An Embodied Multimodal Language Model
PaLM-E- An Embodied Multimodal Language Model