<p>They train the agent multiple times, then plot the mean +- standard deviation of the agent performance (the shaded region is representing the standard deviation).</p>

CC BY-SA 4.0
2021-12-15T22:19:22.950Z
2021-12-15T22:19:22.950Z
Taw
<p>In most of the reinforcement learning literature, I see that there is a shaded area in the graphs. I couldn't understand what it exactly represents?</p>
<p>For example, from the A3C paper:</p>
<p><a href="https://i.sstatic.net/b3HF8.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/b3HF8.png" alt="enter image description here" /></a></p>
<p>Or another example from the PPO paper:</p>
<p><a href="https://i.sstatic.net/qZBTd.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/qZBTd.png" alt="enter image description here" /></a></p>
<p>Is it for multiple runs or it's for something else? How I can reproduce such graphs (which library and what type of data from my training episode do I need)?</p>

<reinforcement-learning><papers>
What is the meaning of the shaded area in the reinforcement learning literature graphs?
Saeid Ghafouri
# What is the meaning of the shaded area in the reinforcement learning literature graphs?

(Asked by: username_0 on 2021-12-15)

In most of the reinforcement learning literature, I see that there is a shaded area in the graphs. I couldn't understand what it exactly represents?

For example, from the A3C paper:

[![enter image description here](https://i.sstatic.net/b3HF8.png)](https://i.sstatic.net/b3HF8.png)

Or another example from the PPO paper:

[![enter image description here](https://i.sstatic.net/qZBTd.png)](https://i.sstatic.net/qZBTd.png)

Is it for multiple runs or it's for something else? How I can reproduce such graphs (which library and what type of data from my training episode do I need)?

**Tags:** reinforcement-learning, papers


---

## 1 answers

### Answer by username_1 on 2021-12-15. Score: 2 | Accepted answer

They train the agent multiple times, then plot the mean +- standard deviation of the agent performance (the shaded region is representing the standard deviation).


---

