title: V-IRL: Grounding Virtual Intelligence in Real Life
summary: There is a sensory gulf between the Earth that humans inhabit and the digital
  realms in which modern AI agents are created. To develop AI agents that can
  sense, think, and act as flexibly as humans in real-world settings, it is
  imperative to bridge the realism gap between the digital and physical worlds.
  How can we embody agents in an environment as rich and diverse as the one we
  inhabit, without the constraints imposed by real hardware and control? Towards
  this end, we introduce V-IRL: a platform that enables agents to scalably
  interact with the real world in a virtual yet realistic environment. Our
  platform serves as a playground for developing agents that can accomplish
  various practical tasks and as a vast testbed for measuring progress in
  capabilities spanning perception, decision-making, and interaction with
  real-world data across the entire globe.
paper_authors._id: 65c1bcb4786ebd1614fe9354
paper_authors.name: Jihan Yang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-02-07T11:19:38.385Z
paper_authors._id: 6304baf041387c7f1177a5d2
paper_authors.avatarUrl: /avatars/795c63f2394080eec78ca7981d4a1f78.svg
paper_authors.fullname: Jihan Yang
paper_authors.type: user
paper_authors.user: jihanyang
paper_authors._id: 65c1bcb4786ebd1614fe9355
paper_authors.name: Runyu Ding
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-02-13T08:10:24.560Z
paper_authors._id: 641c0012999935676ec73a86
paper_authors.avatarUrl: /avatars/7cdcf709d7c7c1f145f2dc9b5e3e698f.svg
paper_authors.fullname: Runyu_Ding
paper_authors.type: user
paper_authors.user: dxx977
paper_authors._id: 65c1bcb4786ebd1614fe9356
paper_authors.name: Ellis Brown
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-02-06T14:58:03.624Z
paper_authors._id: 626dc5105f7327906f0b2a4e
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/626dc5105f7327906f0b2a4e/QCSzuwYqsv8ozRnusVb-F.jpeg
paper_authors.fullname: Ellis Brown
paper_authors.type: user
paper_authors.user: ellisbrown
paper_authors._id: 65c1bcb4786ebd1614fe9357
paper_authors.name: Xiaojuan Qi
paper_authors._id: 65c1bcb4786ebd1614fe9358
paper_authors.name: Saining Xie
paper_title: V-IRL: Grounding Virtual Intelligence in Real Life
paper_summary: There is a sensory gulf between the Earth that humans inhabit and the digital
  realms in which modern AI agents are created. To develop AI agents that can
  sense, think, and act as flexibly as humans in real-world settings, it is
  imperative to bridge the realism gap between the digital and physical worlds.
  How can we embody agents in an environment as rich and diverse as the one we
  inhabit, without the constraints imposed by real hardware and control? Towards
  this end, we introduce V-IRL: a platform that enables agents to scalably
  interact with the real world in a virtual yet realistic environment. Our
  platform serves as a playground for developing agents that can accomplish
  various practical tasks and as a vast testbed for measuring progress in
  capabilities spanning perception, decision-making, and interaction with
  real-world data across the entire globe.
paper_ai_summary: V-IRL provides a virtual platform for AI to interact with the real world, enhancing realism for development and testing in perception, decision-making, and interaction.
paper_ai_keywords: V-IRL