Artificial Intelligence, Machine Learning, Data Science, Reinforcement Learning, OpenAI.
taking the same action for similar looking states. So, if in the previous step for state S, action A yielded high rewards, and now we are at state S1 very similar (but not the same) to S, but taking action A yields the worst rewards, the model gets confused. To counter this, Experience Replay comes