Thanks for your response!
The thing is I actually do want to preserve history, but only for specific rows.
If I’m not mistaken, using your example the entire history will be deleted.
In the example above I delete the history of the first 2 rows every odd steps, and delete the history of the last 2 rows every even step. That way, in theory, the maximum length of history should be 2 steps. However the entire history is preserved.
If I delete the history for all rows the same time (async_reset = false), it will not preserve the history.
Is there a way to implement such a thing, or must I separate it into two separate LSTM calls?
My main motivation is implementing the A2C algorithm where I use BPTT through all timestamps since the beginning of the game, and the problem is that games end in different times for different agents.
Only other solution I can currently think of is to implement A3C instead, unless I am missing something.
Thanks again