I am here just for the correction. I believe this is a RNN Seq-2-Seq network which uses GRU units, not a LTSM Seq2Seq network. GRU units generally take fewer parameters than LSTM, as they do not have an output gate.