Solved by vdw in post #2 
              
              
                That the output is another sentence from the training data is very odd. Something garbled would just mean that the training fails somewhere. But you really get a proper sentences as output, just not the input one. 
Did you try to iteratively build the model. Any Seq2Seq model for machine translation…