In RL, the data is not static but keeps growing due to new samples explored by the agent.
I would like to use DataLoader for preparing/loading data from a replay buffer more efficiently. However, it seems that the concept of DataLoader is not well designed for non-stationary data.
So, what would be the best way to extract/load/transform data from a large replay buffer efficiently?
Thanks.