Artificial Intelligence, Machine Learning, Data Science, Reinforcement Learning, OpenAI.
into the picture Implement batch updates rather than single updates. Update the model with a mix of new and old memories i.e. retraining/replaying old samples alongside new samples while training the agent That is why we are using a Deque. So if you observe the logic, The Deque length(2000) is big