Reinforcement Learning, Machine Learning, Monte Carlo Method, Temporal Difference, Data Science.
value by weighing the actual returns observed without making estimates during the episode; however, MC methods have high variance, especially when the number of samples is low. On the contrary, TD methods have biases because they use bootstrapping, and the bias can vary based on the actual