Artificial Intelligence, Machine Learning, Data Science, Reinforcement Learning, OpenAI.
with environments with sparse rewards (Like MountainCar where every reward is -1 except when you reach the top, you get a 0) Why? The more frequently we update, the lower the variance will be for the reward. For example: If an episode has 5k+ steps and if we are updating after getting the final