Reinforcement Learning, Machine Learning, Monte Carlo, Data Science, Thoughts And Theory.
V-function estimation By definition, the v-value of a state corresponds to the expected return the agent receives by starting from that state. With the information from the agent’s experience, we can average all returns after visits to that state. This way, the computed average value will represent