Reinforcement Learning, Monte Carlo Method, Machine Learning.
estimate action values Qπ(s, a). It is the expected return when starting in state s and taking action a, and thereafter following policy π. Similar to policy evaluation, we also have Every-Visit MC and First-Visit MC methods for estimating action values. The Every-Visit MC method estimates the