Solved by engelnico in post #4 
              
              
                I think i misunderstood your first question, I’m sorry… 
There are usually two different modes for LSTM, stateless and stateful. 
Stateless Mode updates the parameters for one batch and when the next batch comes, it will initialize the states again (with zeros). Therefore, the “cell memory” is reset…