Body: <p>If an Atari game's rewards can be between <span class="math-container">$-100$</span> and <span class="math-container">$100$</span>, when can we say an agent learned to play this game? Should it get the reward very close to <span class="math-container">$100$</span> for each instance of the game? Or it is fine if it gets a low score (say <span class="math-container">$-100$</span>) at some instances? In other words, if we plot the agent's score versus number of episodes, how should the plot look like? From this plot, when can we say the agent is not stable for this task?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-06-06T07:19:53.890Z
Comments.Text: The rewards don't have to define limits of optimality at all (e.g. think of a task with 20 time steps, and some number of them could get this reward - so you would be interested in finding a total reward maybe up to 2000, but the environment structure could make the true limit much lower). Any chance you could focus on a specific example where you want to understand optimality? I don't think there is a general answer here . . .
Comments.UserDisplayName: Neil Slater
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-06-06T20:13:24.900Z
Comments.Text: @NeilSlater I added more details. I specifically want to know about the case where the task is an Attari game.
Comments.UserDisplayName: user491626
Tags: <reinforcement-learning><atari-games>
Title: When can we say an RL algorithm learns an Atari game?
UserDisplayName: user491626
ThreadText: # When can we say an RL algorithm learns an Atari game?
  
  (Asked by: username_0 on 2018-06-05)
  
  If an Atari game's rewards can be between $-100$ and $100$, when can we say an agent learned to play this game? Should it get the reward very close to $100$ for each instance of the game? Or it is fine if it gets a low score (say $-100$) at some instances? In other words, if we plot the agent's score versus number of episodes, how should the plot look like? From this plot, when can we say the agent is not stable for this task?
  
  **Tags:** reinforcement-learning, atari-games
  
  > **Comments:**
  > **username_1**: The rewards don't have to define limits of optimality at all (e.g. think of a task with 20 time steps, and some number of them could get this reward - so you would be interested in finding a total reward maybe up to 2000, but the environment structure could make the true limit much lower). Any chance you could focus on a specific example where you want to understand optimality? I don't think there is a general answer here . . .  
  > **username_0**: @username_1 I added more details. I specifically want to know about the case where the task is an Attari game.  
  
  ---
  
  ## 0 answers
  
  