Reinforcement Learning, Machine Learning, Monte Carlo, Data Science, Thoughts And Theory.
for estimation of value functions have significant advantages: every state is estimated independently and does not depend on values of other states; the algorithmic complexity for updating a single state depends on the number of episodes and not on the total number of states. Since it is up to us