Answers.Body: <p>There is <a href="https://ai.googleblog.com/2019/06/introducing-google-research-football.html" rel="nofollow noreferrer">Google Research Football</a>, which is an open-source platform to develop reinforcement learning algorithms to play a game similar to FIFA or PES, although the football simulation is not as realistic as the current versions of FIFA or PES. You can play this game against different RL agents (e.g. DQN or IMPALA) and, of course, you can even develop your own RL agents and play against them. <a href="https://www.youtube.com/watch?v=F8DcgFDT9sc&amp;feature=emb_title" rel="nofollow noreferrer">Here</a> is a video that illustrates the environment. <a href="https://github.com/google-research/football" rel="nofollow noreferrer">Here is the code and instructions to use it</a>.</p>
  <p>As far as I know, there isn't yet an AI that plays simulated football at a human-level (i.e. as good as the best human players). For example, I can regularly (although not always) beat the legendary level-AI at FIFA, but I also don't know the details about this AI (which could also be rule-based).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-08-30T00:52:28.113Z
Answers.Text: Of course, although you are looking for something more complex than a board game and that is just human-level (rather than superhuman), I think it is important to mention AlphaGo (and related algorithms/models/systems).
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-08-30T00:43:52.517Z
Answers.LastActivityDate: 2020-08-30T13:18:41.313Z
Answers.LastEditDate: 2020-08-30T13:18:41.313Z
Answers.UserDisplayName: nbro
Answers.Body: <p><a href="https://arxiv.org/pdf/1702.06230.pdf" rel="nofollow noreferrer">Beating the World’s Best at Super Smash Bros. Melee with Deep Reinforcement
  Learning</a></p>
  <p>Firoiu, Whitney, Tenenbaum created a RL agent that plays and defeats professional players in Super Smash Bros Melee. The RL agent first played against the built-in AI, and then via self-play.</p>
  <p>Only one character playing on a single stage was trained. The character picked (Captain Falcon) has no &quot;projectile attacks&quot; to simplify training.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-08-27T17:56:05.330Z
Answers.LastActivityDate: 2020-08-30T04:18:21.740Z
Answers.LastEditDate: 2020-08-30T04:18:21.740Z
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.Body: <p>Not sure if this fits your requirements of the AI playing <em>with</em> the player, but I still wanted to mention it because to me it is the quintessential AI-based game:</p>
  <p><a href="https://play.aidungeon.io/main/landing" rel="nofollow noreferrer">AIDungeon</a>, which is a text based story-telling game, where you can do literally anything. It's using GPT-2/GPT-3(paid) and has blown my mind several times. You've probably heard of it, but in case you haven't give it a try, only takes a couple of minutes to see what it can do.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-05T04:44:59.663Z
Answers.Text: i didn't find this to be nearly as playable as or interesting as the (very) handful amount of other text based rpgs have been
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-06T04:51:13.543Z
Answers.Text: i have decided to award this answer with the bounty, since i have since found it to be quite expressive and interesting. however, it seems to lack coherency and breaks at times. its has given me very interesting dialogues however, but as i don't quite consider it to be a game, i will not mark this as the "correct" answer
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-02T15:32:39.447Z
Answers.LastActivityDate: 2020-09-02T15:32:39.447Z
Answers.UserDisplayName: Frederic
Answers.Body: <p>I don't know about specific game titles but in terms of research University of Malta has a strong team working with application of machine learning to games. The key figure there used to be <a href="http://yannakakis.net/" rel="nofollow noreferrer">Georgios N. Yannakakis</a> who published a lot of good papers and even wrote a <a href="https://www.springer.com/gp/book/9783319635187" rel="nofollow noreferrer">book</a> about content generation, smart game agents and, imho the most interesting, player modelling.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-05T04:42:21.817Z
Answers.Text: unfortunately this is paywalled, so i can't quite assess whatever is being discussed here, but thank you for the link. a paper mentioned in an article that introduces the book cites the paper "Predicting Player Behavior in Tomb Raider: Underworld" by Mahlmann et al. but i didn't find the object of prediction (when the player decides to stop) as very interesting.
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-09-02T08:23:22.650Z
Answers.LastActivityDate: 2020-09-02T08:23:22.650Z
Answers.UserDisplayName: conscious_process
Answers.Body: <p>There are many games where AI involved but less of them against the human player such as playing the video game. For example in <a href="https://science.sciencemag.org/content/364/6443/859" rel="nofollow noreferrer">this paper</a>, they proposed a three-dimensional multiplayer first-person video game called Quake III Arena in Capture the Flag mode. Also, <a href="https://link.springer.com/article/10.1007/s13218-020-00647-w" rel="nofollow noreferrer">this paper</a> and <a href="https://uhra.herts.ac.uk/handle/2299/22881" rel="nofollow noreferrer">this paper</a> show many games where AI involved and they show which kind of games that a human player can play against. I recommend also <a href="https://github.com/datamllab/awesome-game-ai" rel="nofollow noreferrer">Awesome-Game-AI</a>.</p>
  <p><a href="https://i.sstatic.net/EdmKr.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/EdmKr.png" alt="enter image description here" /></a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-08-31T08:21:01.483Z
Answers.LastActivityDate: 2020-09-03T15:23:39.340Z
Answers.LastEditDate: 2020-09-03T15:23:39.340Z
Answers.UserDisplayName: I_Al-thamary
Body: <p>Are there any examples of single player games that use modern ML technique in its games? By this I mean AI that plays with or against the human player, and not just play the game by itself (like Atari).</p>
  <p>&quot;Modern ML techniques&quot; is a vague term, but for example, Neural Networks, Reinforcement Learning, or probabilistic methods. Basically anything that goes above and beyond traditional search methods that most games use nowadays.</p>
  <p>Ideally, the AI would be:</p>
  <ul>
  <li>widely available (i.e. not like the OpenAI Five, which was only available for a limited amount of time and requires a high amount of computational power)</li>
  <li>human level (not overpowered)</li>
  </ul>
  <p>Ideally, the game would be:</p>
  <ul>
  <li>symmetrical (the AI has the same agent capabilities as the player, though answers similar to <a href="https://left4dead.fandom.com/wiki/The_Director" rel="nofollow noreferrer">The Director</a> would be very interesting as well)</li>
  <li>&quot;complex environment&quot; (more complex than, say, a board game, but a CIV5 game might work)</li>
  </ul>
  <p>But any answer would be appreciated, as some of the criteria above are quite vauge.</p>
  <p>Edit: the ideal cases listed above are not meant to discourage other answers, nor are they intended to be of strictly inclusionary (ie: any game would need to satisfy all of the above requirements)</p>
  
Tags: <game-ai><reference-request>
Title: Examples of single player games that use modern ML techniques in the AI?
UserDisplayName: k.c. sayz 'k.c sayz'
ThreadText: # Examples of single player games that use modern ML techniques in the AI?
  
  (Asked by: username_0 on 2020-08-27)
  
  Are there any examples of single player games that use modern ML technique in its games? By this I mean AI that plays with or against the human player, and not just play the game by itself (like Atari).
  
  "Modern ML techniques" is a vague term, but for example, Neural Networks, Reinforcement Learning, or probabilistic methods. Basically anything that goes above and beyond traditional search methods that most games use nowadays.
  
  Ideally, the AI would be:
  
  * widely available (i.e. not like the OpenAI Five, which was only available for a limited amount of time and requires a high amount of computational power)
  * human level (not overpowered)
  
  Ideally, the game would be:
  
  * symmetrical (the AI has the same agent capabilities as the player, though answers similar to [The Director](https://left4dead.fandom.com/wiki/The_Director) would be very interesting as well)
  * "complex environment" (more complex than, say, a board game, but a CIV5 game might work)
  
  But any answer would be appreciated, as some of the criteria above are quite vauge.
  
  Edit: the ideal cases listed above are not meant to discourage other answers, nor are they intended to be of strictly inclusionary (ie: any game would need to satisfy all of the above requirements)
  
  **Tags:** game-ai, reference-request
  
  ---
  
  ## 5 answers
  
  ### Answer by username_1 on 2020-08-30. Score: 5
  
  There is [Google Research Football](https://ai.googleblog.com/2019/06/introducing-google-research-football.html), which is an open-source platform to develop reinforcement learning algorithms to play a game similar to FIFA or PES, although the football simulation is not as realistic as the current versions of FIFA or PES. You can play this game against different RL agents (e.g. DQN or IMPALA) and, of course, you can even develop your own RL agents and play against them. [Here](https://www.youtube.com/watch?v=F8DcgFDT9sc&feature=emb_title) is a video that illustrates the environment. [Here is the code and instructions to use it](https://github.com/google-research/football).
  
  As far as I know, there isn't yet an AI that plays simulated football at a human-level (i.e. as good as the best human players). For example, I can regularly (although not always) beat the legendary level-AI at FIFA, but I also don't know the details about this AI (which could also be rule-based).
  
  > **Comments:**
  > **username_1**: Of course, although you are looking for something more complex than a board game and that is just human-level (rather than superhuman), I think it is important to mention AlphaGo (and related algorithms/models/systems).  
  
  ---
  
  ### Answer by username_0 on 2020-08-27. Score: 1
  
  [Beating the World’s Best at Super Smash Bros. Melee with Deep Reinforcement
  Learning](https://arxiv.org/pdf/1702.06230.pdf)
  
  Firoiu, Whitney, Tenenbaum created a RL agent that plays and defeats professional players in Super Smash Bros Melee. The RL agent first played against the built-in AI, and then via self-play.
  
  Only one character playing on a single stage was trained. The character picked (Captain Falcon) has no "projectile attacks" to simplify training.
  
  
  ---
  
  ### Answer by username_2 on 2020-09-02. Score: 0
  
  Not sure if this fits your requirements of the AI playing *with* the player, but I still wanted to mention it because to me it is the quintessential AI-based game:
  
  [AIDungeon](https://play.aidungeon.io/main/landing), which is a text based story-telling game, where you can do literally anything. It's using GPT-2/GPT-3(paid) and has blown my mind several times. You've probably heard of it, but in case you haven't give it a try, only takes a couple of minutes to see what it can do.
  
  > **Comments:**
  > **username_0**: i didn't find this to be nearly as playable as or interesting as the (very) handful amount of other text based rpgs have been  
  > **username_0**: i have decided to award this answer with the bounty, since i have since found it to be quite expressive and interesting. however, it seems to lack coherency and breaks at times. its has given me very interesting dialogues however, but as i don't quite consider it to be a game, i will not mark this as the "correct" answer  
  
  ---
  
  ### Answer by username_3 on 2020-09-02. Score: 0
  
  I don't know about specific game titles but in terms of research University of Malta has a strong team working with application of machine learning to games. The key figure there used to be [Georgios N. Yannakakis](http://yannakakis.net/) who published a lot of good papers and even wrote a [book](https://www.springer.com/gp/book/9783319635187) about content generation, smart game agents and, imho the most interesting, player modelling.
  
  > **Comments:**
  > **username_0**: unfortunately this is paywalled, so i can't quite assess whatever is being discussed here, but thank you for the link. a paper mentioned in an article that introduces the book cites the paper "Predicting Player Behavior in Tomb Raider: Underworld" by Mahlmann et al. but i didn't find the object of prediction (when the player decides to stop) as very interesting.  
  
  ---
  
  ### Answer by username_4 on 2020-08-31. Score: 0
  
  There are many games where AI involved but less of them against the human player such as playing the video game. For example in [this paper](https://science.sciencemag.org/content/364/6443/859), they proposed a three-dimensional multiplayer first-person video game called Quake III Arena in Capture the Flag mode. Also, [this paper](https://link.springer.com/article/10.1007/s13218-020-00647-w) and [this paper](https://uhra.herts.ac.uk/handle/2299/22881) show many games where AI involved and they show which kind of games that a human player can play against. I recommend also [Awesome-Game-AI](https://github.com/datamllab/awesome-game-ai).
  
  [![enter image description here](https://i.sstatic.net/EdmKr.png)](https://i.sstatic.net/EdmKr.png)
  
  
  ---
  
  