I want it to reset every episode (and the episodes have always the same number of steps).
So if my episode has 100 steps.
The step 50 would have 50 gradients accumulated and step 101 would have just one gradient.
I guess it will work, thanks.