Reinforcement Learning, Monte Carlo Method, Machine Learning.
improvement is done by deterministically choosing an action with maximal Q value. The pseudo-code for First-Visit MC with exploring start is as follows: Initialize, for all s∈S,a∈A(s): Q(s,a)← arbitrary π(s)← arbitrary Return(s,a)← empty list Repeat forever: Generate an episode using exploring