Reinforcement Learning, Machine Learning, Monte Carlo Method, Temporal Difference, Data Science.
straightforward, we can set up a simple Gridworld test environment with two fixed trajectories, run both algorithms on the setup until converged, and check how they update the values differently. First we can setup the testing environment with the following codes: Figure 1 Left: environment setup.