<p>Yes, it is the state of the memory; this would mainly involve variables, since the code would be in ROM. Since it is only 128 bytes in size, the screen memory would also not be included in this.</p>

<p>The idea is that all information relevant to the game is captured in these 128 bytes; they represent the <em>state</em> of the game world at any given time. Movements of the ball, the game controller position, etc are all encoded there.</p>

<p>For machine learning it is not actually relevant <em>which</em> bytes are representing which value, as any optimisation of outcomes will treat all these 128 bytes as parameters describing the state. A machine learning system will pick up the optimal configuration through the learning process, eg that the 'racket' position should always near the ball x-coordinate. That will just be a correlation of two bytes, no matter which ones they actually are.</p>

CC BY-SA 4.0
2020-06-01T10:30:20.187Z
and what does this information represents?what state of memory i don't understand this term at all, please help me
dato nefaridze
CC BY-SA 4.0
2020-06-01T10:31:39.663Z
if you were given array of 128 numbers and told to build neural network, isn't it important what these 128 numbers represents?it's very abstract to me.
dato nefaridze
CC BY-SA 4.0
2020-06-01T10:35:55.120Z
@datonefaridze see update
Oliver Mason
CC BY-SA 4.0
2020-06-01T10:25:33.440Z
2020-06-01T10:35:39.413Z
2020-06-01T10:35:39.413Z
Oliver Mason
<p>I have encountered the gym environment and decided to create AI that plays breakout. Here is the link: <a href="https://gym.openai.com/envs/Breakout-ram-v0/" rel="nofollow noreferrer">https://gym.openai.com/envs/Breakout-ram-v0/</a>.</p>

<p>The documentation says that the state is represented as a RAM state, but what is the RAM in this context? Is it the random access memory? What does the RAM state represent?</p>

<reinforcement-learning><deep-rl><implementation><gym>
What is a RAM state in the gym's breakout-ram environment?
dato nefaridze
# What is a RAM state in the gym's breakout-ram environment?

(Asked by: username_0 on 2020-06-01)

I have encountered the gym environment and decided to create AI that plays breakout. Here is the link: <https://gym.openai.com/envs/Breakout-ram-v0/>.

The documentation says that the state is represented as a RAM state, but what is the RAM in this context? Is it the random access memory? What does the RAM state represent?

**Tags:** reinforcement-learning, deep-rl, implementation, gym


---

## 1 answers

### Answer by username_1 on 2020-06-01. Score: 2 | Accepted answer

Yes, it is the state of the memory; this would mainly involve variables, since the code would be in ROM. Since it is only 128 bytes in size, the screen memory would also not be included in this.

The idea is that all information relevant to the game is captured in these 128 bytes; they represent the *state* of the game world at any given time. Movements of the ball, the game controller position, etc are all encoded there.

For machine learning it is not actually relevant *which* bytes are representing which value, as any optimisation of outcomes will treat all these 128 bytes as parameters describing the state. A machine learning system will pick up the optimal configuration through the learning process, eg that the 'racket' position should always near the ball x-coordinate. That will just be a correlation of two bytes, no matter which ones they actually are.

> **Comments:**
> **username_0**: and what does this information represents?what state of memory i don't understand this term at all, please help me  
> **username_0**: if you were given array of 128 numbers and told to build neural network, isn't it important what these 128 numbers represents?it's very abstract to me.  
> **username_1**: @datonefaridze see update  

---

