Reinforcement Learning, Monte Carlo Method, Machine Learning.
episode is a sequence of steps. Each occurrence of state s in an episode is called a visit to s. Example: Episode 1: s1​→s3​→s4​→s5​→s2​→s1​→end Episode 2: s2​→s3​→s4​→s5​→s1​→s2​→end Episode 3: s1​→s4​→s5​→s3​→s2​→s5​→end … The first episode visits state s1​ at the first step and last step, the