Reinforcement Learning, Machine Learning, Monte Carlo, Data Science, Thoughts And Theory.
exist two versions of the MC algorithm for V-function estimation: The first-visit MC method: only returns of the first visits to a state are considered; The every-visit MC method: returns during all visits to a state are considered. The first-visit MC method pseudocode. Source: Reinforcement