Reinforcement Learning, Monte Carlo Method, Machine Learning.
pseudo-code for First-Visit MC is as follows: Initialize: π← policy to be evaluated V← an arbitrary state-value function Return(s)← an empty list, for all s∈S Repeat forever: Generate an episode using π For each state s appearing in the episode: 1) R← returns following the first occurrence of s; 2)