@cabada , I don’t know if your model architecture might get good results.
I’d suggest you look into this tutorial: Text generation with an RNN  |  TensorFlow 19
The tutorial uses charprediction but I think you can adapt it to word prediction.