Hmmm. Kind of looks ok.

what happens if you train on eg just two examples?
what do you mean by ‘error looks quite high’?  I think my own criterion for getting working on two examples would be, something like: decoder gets at least first 2-3 words/characters (depending on if word or character model) correct.

By the way, when I tried a simple encoder-decoder, I added ‘teacher forcing’ to both the encoder and decoder. In Sean Robertson’s gtutorial, he adds it to at least the decoder, http://pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.html 10
I have some working seq2seq code here: https://github.com/hughperkins/pub-prototyping/blob/master/papers/attention/seq2seq_noattention_trainbyparts.py 4