Artificial Intelligence, Machine Learning, Data Science, Reinforcement Learning, OpenAI.
compared to the batch(200) we are training the model on. Hence, for every epoch, after the deque reaches length=2000, new memories are pushed in and the older ones are popped out (as Queues work on the principle of FIFO i.e. First In First Out) Hence, the deque maintains a mix of old and new