alexis-jacq:

action_scores


Thanks so much! I’d like to explain why I change the game rule. It is because that one episode may take too long to terminate. As I want to avoid too long episode, I added another another rule. But, you’re right, the original version doesn’t terminate an episode after walking down the cliff.
Your suggestion on one-hot representation of state is really really helpful! Thanks so much for this, I ignored this detail.
If you don’t mind, I would like to discuss the code you gave. I implement the tabular-based TD method in my repo here 13. Both of Q-learning and Sarsa work fine. The only reason I use NN is want to implement simple policy gradient methods first and then move on to deep RL.
Thanks so much for your help!!!