Answers.Body: <p>When reading about RL and RL agents/algorithms, you always need to keep in mind that, <em>typically</em>, the RL agent/algorithm is trying to <strong>maximize the reward</strong> (or something equivalent, such as minimizing the regret) in the long run (i.e also the reward that you may receive in the future): that's its (mathematical) goal. Whether that  <em>also</em> corresponds to the <em>high-level</em> goal (e.g. reaching some physical location in some world) that the (human) designer of the so-called <em>reward function</em> (i.e. the function that gives the reward to RL agent) had in mind is a different story.</p>
  <p>To maximize the reward, the RL agent interacts with the environment by taking actions, receiving rewards, and moving to other states. Initially, the RL agent does not know which actions lead to more rewards, so it may take random actions (this is known as <em>exploration</em>). Once it starts to understand the dynamics of the environment, it may start to take only the actions that lead to high reward (this is known as <em>exploitation</em>).</p>
  <p>To answer your question directly, the RL agent can indeed take actions without knowing the dynamics of the environment. However, initially, it may need to take some random actions (which may lead to low rewards), so that to get more rewards in the long run.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-11-07T01:39:22.710Z
Answers.LastActivityDate: 2020-11-07T10:41:15.387Z
Answers.LastEditDate: 2020-11-07T10:41:15.387Z
Answers.UserDisplayName: nbro
Body: <p>I am studying RL. I was thinking whether a new state value or the observation is provided by the environment before the agent actually implements the action.</p>
  <p>Take the maze problem as an example. Each state consists of all the available cells information, provided by the environment. But what if the environment is unknown? For example, there is a maze with an unknown destination cell. The agent needs to find the destination cell. The state is 1 or 0, meaning the destination reached or not. But the environment, which is the maze, can only provide the state at cell <span class="math-container">$i$</span> which is 0 or 1 only when the agent reaches cell <span class="math-container">$i$</span>.</p>
  <p>Can this still be solved by RL? I am confused about the environment setup.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-11-06T21:12:34.083Z
Comments.Text: I think you're using the numbers $0$ and $1$ to denote "reward". Is this correct? Btw, I've changed your title to be what I think is your question. Please, make sure that's really your question. If not, feel free to edit your post again.
Comments.UserDisplayName: nbro
Tags: <reinforcement-learning><environment>
Title: How can reinforcement learning be applied when the goal location or environment is unknown?
UserDisplayName: sue
ThreadText: # How can reinforcement learning be applied when the goal location or environment is unknown?
  
  (Asked by: username_0 on 2020-11-06)
  
  I am studying RL. I was thinking whether a new state value or the observation is provided by the environment before the agent actually implements the action.
  
  Take the maze problem as an example. Each state consists of all the available cells information, provided by the environment. But what if the environment is unknown? For example, there is a maze with an unknown destination cell. The agent needs to find the destination cell. The state is 1 or 0, meaning the destination reached or not. But the environment, which is the maze, can only provide the state at cell $i$ which is 0 or 1 only when the agent reaches cell $i$.
  
  Can this still be solved by RL? I am confused about the environment setup.
  
  **Tags:** reinforcement-learning, environment
  > **Comments:**
  > **username_1**: I think you're using the numbers $0$ and $1$ to denote "reward". Is this correct? Btw, I've changed your title to be what I think is your question. Please, make sure that's really your question. If not, feel free to edit your post again.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-11-07. Score: 1
  
  When reading about RL and RL agents/algorithms, you always need to keep in mind that, *typically*, the RL agent/algorithm is trying to **maximize the reward** (or something equivalent, such as minimizing the regret) in the long run (i.e also the reward that you may receive in the future): that's its (mathematical) goal. Whether that *also* corresponds to the *high-level* goal (e.g. reaching some physical location in some world) that the (human) designer of the so-called *reward function* (i.e. the function that gives the reward to RL agent) had in mind is a different story.
  
  To maximize the reward, the RL agent interacts with the environment by taking actions, receiving rewards, and moving to other states. Initially, the RL agent does not know which actions lead to more rewards, so it may take random actions (this is known as *exploration*). Once it starts to understand the dynamics of the environment, it may start to take only the actions that lead to high reward (this is known as *exploitation*).
  
  To answer your question directly, the RL agent can indeed take actions without knowing the dynamics of the environment. However, initially, it may need to take some random actions (which may lead to low rewards), so that to get more rewards in the long run.
  
  
  ---
  
  