Reinforcement Learning, Machine Learning, Monte Carlo, Data Science, Thoughts And Theory.
episodes and not on the number of states. it is almost impossible to theoretically estimate transition probabilities in many environment settings for every state and action to obtain the environment’s dynamics. At the same time, MC methods do not need this information and can elegantly learn from