Reinforcement Learning, Machine Learning, Monte Carlo Method, Temporal Difference, Data Science.
constant-alpha MC evaluations. Source: figure by the author The two algorithms’ different ways of estimating values become pretty apparent in the image above. The MC method is loyal to the returns of the path, so the values on each path directly represent how it ends. Nevertheless, the TD method