Answers.Body: <p>They train the agent multiple times, then plot the mean +- standard deviation of the agent performance (the shaded region is representing the standard deviation).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-12-15T22:19:22.950Z
Answers.LastActivityDate: 2021-12-15T22:19:22.950Z
Answers.UserDisplayName: Taw
Body: <p>In most of the reinforcement learning literature, I see that there is a shaded area in the graphs. I couldn't understand what it exactly represents?</p>
  <p>For example, from the A3C paper:</p>
  <p><a href="https://i.sstatic.net/b3HF8.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/b3HF8.png" alt="enter image description here" /></a></p>
  <p>Or another example from the PPO paper:</p>
  <p><a href="https://i.sstatic.net/qZBTd.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/qZBTd.png" alt="enter image description here" /></a></p>
  <p>Is it for multiple runs or it's for something else? How I can reproduce such graphs (which library and what type of data from my training episode do I need)?</p>
  
Tags: <reinforcement-learning><papers>
Title: What is the meaning of the shaded area in the reinforcement learning literature graphs?
UserDisplayName: Saeid Ghafouri
ThreadText: # What is the meaning of the shaded area in the reinforcement learning literature graphs?
  
  (Asked by: username_0 on 2021-12-15)
  
  In most of the reinforcement learning literature, I see that there is a shaded area in the graphs. I couldn't understand what it exactly represents?
  
  For example, from the A3C paper:
  
  [![enter image description here](https://i.sstatic.net/b3HF8.png)](https://i.sstatic.net/b3HF8.png)
  
  Or another example from the PPO paper:
  
  [![enter image description here](https://i.sstatic.net/qZBTd.png)](https://i.sstatic.net/qZBTd.png)
  
  Is it for multiple runs or it's for something else? How I can reproduce such graphs (which library and what type of data from my training episode do I need)?
  
  **Tags:** reinforcement-learning, papers
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2021-12-15. Score: 2 | Accepted answer
  
  They train the agent multiple times, then plot the mean +- standard deviation of the agent performance (the shaded region is representing the standard deviation).
  
  
  ---
  
  