• Sensory perception and processing. The physical environment introduces a rich tapestry of
sensory inputs with real-world objects. It incorporates visual [120; 333], auditory [375; 377]
and spatial senses. While this diversity enhances interactivity and sensory immersion, it also
introduces the complexity of simultaneous perception. Agents must process sensory inputs to
interact effectively with their surroundings.
TheRiseandPotentialofLargeLanguageModel BasedAgents