Solved by vdw in post #2 
              
              
                Your right, since the output of the encoder is just a sentence embedding, you can use an existing encoding sentence embedding and use only the decoder part. 
A couple of days ago, there was this post about the implementation in a paper, where the embedding came from CNN and was fed into an LSTM deco…