Reinforcement Learning, Machine Learning, Monte Carlo, Data Science, Thoughts And Theory.
is not sufficient. The component we miss here is the reward of choosing any action in every state. Thus, we cannot estimate the overall return by taking a certain action. At the same time, we cannot use the Bellman equation which could establish the relationship between v- and q-values: in this