Solved by vdw in post #4 
              
              
                Re #1: No, I was talking solely about LSTM. It wraps an LSTMCell to support multiple layers, dropout, bidirectionality, etc. An LSTMCell only ever takes just one word as input. LSTM is a full layer allowing for whole sequences as output. It’s just that no-one is stoping you to give it sequences of l…