Reinforcement Learning, Monte Carlo Method, Machine Learning, Artificial Intelligence.
In particular, suppose we wish to estimate Vπ(s), the value of a state s under policy π, given a set of episodes obtained by following π and passing through s. Each occurrence of state s in an episode is called a visit to s. Of course, s may be visited multiple times in the same episode; let us