Reinforcement Learning, Machine Learning, Monte Carlo, Data Science, Thoughts And Theory.
the estimated V-function is enough to find the optimal policy: by being at any state, we can always choose an action such that the sum of the action’s reward (given by p(s’, r | s, a)) and next state’s return will be maximal. In model-free methods (which is the MC case), having the V-function only