Solved by vdw in post #4 
              
              
                Ah, OK…got it. Yes, in this case you use the LSTM as decoder. 
Anyway, generating the words step by step is the way for any X-to-sequence model. You can, of course, during training time give the whole sequence to the LSTM in case of Teacher Forcing. But training the whole network using only Teacher …