Solved by tom in post #2 
              
              
                You don’t get the cell state (h_t, c_t) from the LSTM for intermediates. 
Thus you would want to loop over t yourself, using either LSTM with sequence length of 1 or LSTMCell. 
Best regards 
Thomas