Answers.Body: <p>Yes, there are actually quite a few examples of this:</p>
  <p><a href="https://www.deepmind.com/publications/open-ended-learning-leads-to-generally-capable-agents" rel="nofollow noreferrer">https://www.deepmind.com/publications/open-ended-learning-leads-to-generally-capable-agents</a></p>
  <p><a href="https://ieeexplore.ieee.org/abstract/document/9089532/" rel="nofollow noreferrer">https://ieeexplore.ieee.org/abstract/document/9089532/</a></p>
  <p>One alternative use for these kinds of methodologies is when real-world experience comes at a premium(ex. robotic system).</p>
  <p>In these cases it is very useful to bootstrap your way towards a effective agent by creating a simulated environment and training until convergence(whatever that means for your situation).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-01T08:19:47.747Z
Answers.LastActivityDate: 2022-07-01T08:19:47.747Z
Answers.UserDisplayName: hisairnessag3
Body: <p>There is emerging effort for Third Wave Artificial Intelligence (Artificial General Intelligence) (<a href="http://hlc.doc.ic.ac.uk/3AI_HLC_2019.html" rel="nofollow noreferrer">http://hlc.doc.ic.ac.uk/3AI_HLC_2019.html</a> and <a href="https://www.darpa.mil/work-with-us/ai-next-campaign" rel="nofollow noreferrer">https://www.darpa.mil/work-with-us/ai-next-campaign</a>) and it covers the open-ended life-long machine learning as well. Currently machine learning agents are being run on quite immutable and simple games like Atari and Go. But what about the efforts to build and run machine learning adaptable agents (or even teams of them) in the virtual worlds (like Second Life) which are complex, expanding and in which the interaction with human representatives happens? Are there efforts to do that?</p>
  <p>I have found some articles from 2005-2009, but Google gives no recent literature on queries like <code>Reinforcement Learning Second Life</code> etc.</p>
  <p>So - maybe there are some efforts to do this, but I can not just Google it.</p>
  <p>My question is - are there references for machine learning agents for virtual worlds and if not - what are the obstacles for trying to build them? There are little risks or costs for building them for virtual worlds?</p>
  <p><a href="https://meta-guide.com/embodiment/secondlife-npc-artificial-intelligence" rel="nofollow noreferrer">https://meta-guide.com/embodiment/secondlife-npc-artificial-intelligence</a> is some bibliography and it is lacking recent research, for example.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-09-07T22:24:12.083Z
Comments.Text: To clarify, you're asking about agents that can "live" inside a virtual world and not necessarily about **any** research on **artificial general intelligence**, right?
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-06T02:39:19.587Z
Comments.Text: I have spent several days looking exactly at the same question. First, let me say that I am very far from this field. It seems that now embodied AI research shifted from game-like virtual worlds to small indoor simulated environments. "A survey of embodied AI: from simulators to research tasks" is an example with plenty of references. So it appears that now this kind of research has more applied nature, eyeing deployment to household assistant robots.
Comments.UserDisplayName: Moysey Abramowitz
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-06T02:41:55.337Z
Comments.Text: The only example of the kind of research I was looking for (and apparently @TomR too) and was able to find was Microsoft Project Malmo, but it does not seem very active.
Comments.UserDisplayName: Moysey Abramowitz
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-06T02:47:50.153Z
Comments.Text: Similarly to @TomR, I am kind of puzzled by the lack of this type of research. For me as a non-expert, it seems that such embodied AI research using open-ended virtual worlds, populated with human players, could be one of the few currently realistic ways to get actually intelligent AI in near future. I would appreciate response from somebody more knowledgeable than me.
Comments.UserDisplayName: Moysey Abramowitz
Tags: <reinforcement-learning><reference-request><game-ai><agi><intelligent-agent>
Title: Use of virtual worlds (e.g. Second Life) for training Artificial General Intelligence agents?
UserDisplayName: TomR
ThreadText: # Use of virtual worlds (e.g. Second Life) for training Artificial General Intelligence agents?
  
  (Asked by: username_0 on 2020-09-07)
  
  There is emerging effort for Third Wave Artificial Intelligence (Artificial General Intelligence) (<http://hlc.doc.ic.ac.uk/3AI_HLC_2019.html> and <https://www.darpa.mil/work-with-us/ai-next-campaign>) and it covers the open-ended life-long machine learning as well. Currently machine learning agents are being run on quite immutable and simple games like Atari and Go. But what about the efforts to build and run machine learning adaptable agents (or even teams of them) in the virtual worlds (like Second Life) which are complex, expanding and in which the interaction with human representatives happens? Are there efforts to do that?
  
  I have found some articles from 2005-2009, but Google gives no recent literature on queries like `Reinforcement Learning Second Life` etc.
  
  So - maybe there are some efforts to do this, but I can not just Google it.
  
  My question is - are there references for machine learning agents for virtual worlds and if not - what are the obstacles for trying to build them? There are little risks or costs for building them for virtual worlds?
  
  <https://meta-guide.com/embodiment/secondlife-npc-artificial-intelligence> is some bibliography and it is lacking recent research, for example.
  
  **Tags:** reinforcement-learning, reference-request, game-ai, agi, intelligent-agent
  > **Comments:**
  > **username_1**: To clarify, you're asking about agents that can "live" inside a virtual world and not necessarily about **any** research on **artificial general intelligence**, right?  
  > **username_2**: I have spent several days looking exactly at the same question. First, let me say that I am very far from this field. It seems that now embodied AI research shifted from game-like virtual worlds to small indoor simulated environments. "A survey of embodied AI: from simulators to research tasks" is an example with plenty of references. So it appears that now this kind of research has more applied nature, eyeing deployment to household assistant robots.  
  > **username_2**: The only example of the kind of research I was looking for (and apparently @TomR too) and was able to find was Microsoft Project Malmo, but it does not seem very active.  
  > **username_2**: Similarly to @TomR, I am kind of puzzled by the lack of this type of research. For me as a non-expert, it seems that such embodied AI research using open-ended virtual worlds, populated with human players, could be one of the few currently realistic ways to get actually intelligent AI in near future. I would appreciate response from somebody more knowledgeable than me.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_3 on 2022-07-01. Score: 1
  
  Yes, there are actually quite a few examples of this:
  
  <https://www.deepmind.com/publications/open-ended-learning-leads-to-generally-capable-agents>
  
  <https://ieeexplore.ieee.org/abstract/document/9089532/>
  
  One alternative use for these kinds of methodologies is when real-world experience comes at a premium(ex. robotic system).
  
  In these cases it is very useful to bootstrap your way towards a effective agent by creating a simulated environment and training until convergence(whatever that means for your situation).
  
  
  ---
  
  