Answers.Body: <p>Yes, it is the state of the memory; this would mainly involve variables, since the code would be in ROM. Since it is only 128 bytes in size, the screen memory would also not be included in this.</p>
  
  <p>The idea is that all information relevant to the game is captured in these 128 bytes; they represent the <em>state</em> of the game world at any given time. Movements of the ball, the game controller position, etc are all encoded there.</p>
  
  <p>For machine learning it is not actually relevant <em>which</em> bytes are representing which value, as any optimisation of outcomes will treat all these 128 bytes as parameters describing the state. A machine learning system will pick up the optimal configuration through the learning process, eg that the 'racket' position should always near the ball x-coordinate. That will just be a correlation of two bytes, no matter which ones they actually are.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-06-01T10:30:20.187Z
Answers.Text: and what does this information represents?what state of memory i don't understand this term at all, please help me
Answers.UserDisplayName: dato nefaridze
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-06-01T10:31:39.663Z
Answers.Text: if you were given array of 128 numbers and told to build neural network, isn't it important what these 128 numbers represents?it's very abstract to me.
Answers.UserDisplayName: dato nefaridze
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-06-01T10:35:55.120Z
Answers.Text: @datonefaridze see update
Answers.UserDisplayName: Oliver Mason
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-06-01T10:25:33.440Z
Answers.LastActivityDate: 2020-06-01T10:35:39.413Z
Answers.LastEditDate: 2020-06-01T10:35:39.413Z
Answers.UserDisplayName: Oliver Mason
Body: <p>I have encountered the gym environment and decided to create AI that plays breakout. Here is the link: <a href="https://gym.openai.com/envs/Breakout-ram-v0/" rel="nofollow noreferrer">https://gym.openai.com/envs/Breakout-ram-v0/</a>.</p>
  
  <p>The documentation says that the state is represented as a RAM state, but what is the RAM in this context? Is it the random access memory? What does the RAM state represent?</p>
  
Tags: <reinforcement-learning><deep-rl><implementation><gym>
Title: What is a RAM state in the gym's breakout-ram environment?
UserDisplayName: dato nefaridze
ThreadText: # What is a RAM state in the gym's breakout-ram environment?
  
  (Asked by: username_0 on 2020-06-01)
  
  I have encountered the gym environment and decided to create AI that plays breakout. Here is the link: <https://gym.openai.com/envs/Breakout-ram-v0/>.
  
  The documentation says that the state is represented as a RAM state, but what is the RAM in this context? Is it the random access memory? What does the RAM state represent?
  
  **Tags:** reinforcement-learning, deep-rl, implementation, gym
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-06-01. Score: 2 | Accepted answer
  
  Yes, it is the state of the memory; this would mainly involve variables, since the code would be in ROM. Since it is only 128 bytes in size, the screen memory would also not be included in this.
  
  The idea is that all information relevant to the game is captured in these 128 bytes; they represent the *state* of the game world at any given time. Movements of the ball, the game controller position, etc are all encoded there.
  
  For machine learning it is not actually relevant *which* bytes are representing which value, as any optimisation of outcomes will treat all these 128 bytes as parameters describing the state. A machine learning system will pick up the optimal configuration through the learning process, eg that the 'racket' position should always near the ball x-coordinate. That will just be a correlation of two bytes, no matter which ones they actually are.
  
  > **Comments:**
  > **username_0**: and what does this information represents?what state of memory i don't understand this term at all, please help me  
  > **username_0**: if you were given array of 128 numbers and told to build neural network, isn't it important what these 128 numbers represents?it's very abstract to me.  
  > **username_1**: @username_0 see update  
  
  ---
  
  