Answers.Body: <p>If you learn a policy or a value function from experience (that is, interaction with an environment), that's RL. In the case of AlphaGo, the MCTS is used to acquire the experience.</p>
  
  <p>RL could in fact be considered supervised learning (SL) or, more specifically, <a href="https://ai.stackexchange.com/q/10623/2444">self-supervised learning</a>, where the experience corresponds to the labels in SL, especially nowadays with techniques like <a href="https://ai.stackexchange.com/q/6579/2444">experience replay</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-07T17:21:59.100Z
Answers.LastActivityDate: 2019-06-07T17:28:08.770Z
Answers.LastEditDate: 2019-06-07T17:28:08.770Z
Answers.UserDisplayName: nbro
Body: <p>AlphaGo Zero (<a href="https://deepmind.com/blog/alphago-zero-learning-scratch/" rel="nofollow noreferrer">https://deepmind.com/blog/alphago-zero-learning-scratch/</a>) has several key components that contribute to it's success:</p>
  
  <ol>
  <li>A Monte Carlo Tree Search Algorithm that allows it to better search and learn from the state space of Go</li>
  <li>A Deep Neural Network architecture that learns the value and policies of given states, to better inform the MCTS.  </li>
  </ol>
  
  <p>My question is, how is this Reinforcement Learning?  Or rather, what aspects of this algorithm specifically make it a Reinforcement Learning problem?  Couldn't this just be considered a Supervised Learning problem?  </p>
  
Tags: <reinforcement-learning><monte-carlo-tree-search><supervised-learning><alphago-zero><go>
Title: How Does AlphaGo Zero Implement Reinforcement Learning?
UserDisplayName: SeeDerekEngineer
ThreadText: # How Does AlphaGo Zero Implement Reinforcement Learning?
  
  (Asked by: username_0 on 2019-06-07)
  
  AlphaGo Zero (<https://deepmind.com/blog/alphago-zero-learning-scratch/>) has several key components that contribute to it's success:
  
  1. A Monte Carlo Tree Search Algorithm that allows it to better search and learn from the state space of Go
  2. A Deep Neural Network architecture that learns the value and policies of given states, to better inform the MCTS.
  
  My question is, how is this Reinforcement Learning? Or rather, what aspects of this algorithm specifically make it a Reinforcement Learning problem? Couldn't this just be considered a Supervised Learning problem?
  
  **Tags:** reinforcement-learning, monte-carlo-tree-search, supervised-learning, alphago-zero, go
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-06-07. Score: 4 | Accepted answer
  
  If you learn a policy or a value function from experience (that is, interaction with an environment), that's RL. In the case of AlphaGo, the MCTS is used to acquire the experience.
  
  RL could in fact be considered supervised learning (SL) or, more specifically, [self-supervised learning](https://ai.stackexchange.com/q/10623/2444), where the experience corresponds to the labels in SL, especially nowadays with techniques like [experience replay](https://ai.stackexchange.com/q/6579/2444).
  
  
  ---
  
  