@bfeeny If you see the documentation for LSTM or the documented comments in this tutorial 20 you will notice that ula is all hidden states whereas the output is just the last hidden state. The OP is doing a many-to-one model.