Reinforcement Learning, Monte Carlo Method, Machine Learning.
Estimates for each state in Monte Carlo methods are independent because the estimate for each state does not build upon the estimate of any other state, as is the case in DP. The computational expense of estimating the value of a single state is independent of the number of states because we can