Given <img> .What is the human trying to do and what can the robot do to help?A: reach cookie. robot could get cookie.Visually-conditioned Jokes + Few-shot promptingI see (image omitted). Description: A cow sitting on a rug. Joke: Why is the cow sitting on a rug? Because it wants to be a cow-ch! … I see <img>. Description: a donkey is carrying a dog, cat, and rooster. Joke: what do you call a donkey with a rooster on his back. A rooster booster. Assistive RoboticsPhysical ReasoningGiven <img> . Q: Which of these objects is best for climbing up high?A: ladder.Robot Visual Perception, Dialogue, and PlanningRobot: I am a robot operating in a kitchen. Given <img>, what do I see? a bowl of eggs, a bowl of Robot InitiativeGiven <img>. Q: If a robot wanted to be useful here, what steps should it take? A: clean table..pick up trash.. pick up chairs.. wipe chairs.. put chairs down.Zero-shot Multimodal Chain-of-ThoughtGiven <img>. Q: Can I go down this street on a bicycle, yes or no? A: Let’s
PaLM-E- An Embodied Multimodal Language Model