Reinforcement Learning, Monte Carlo Method, Machine Learning.
value of a state-action pair as the average of the returns that have followed visits to the state in which the action was selected. The First-Visit MC method averages the returns following the first time in each episode that the state was visited and the action was selected. Both methods converge