UPDATE: The network is working, in the sense that it does not give me other types of errors, but I have another big problem. After 1000/1500 epochs it start overfitting. 2 hidden layers with 128 units, inputs are sentences of 30 words each. I’m training with word embeddings of 64 dimensions, and with the 5 books of games of thrones.
if for example the seed after training is “Hodor is” the LSTM returns me something like this 'Hodor is a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch i am not a man of the night watch…
Any suggestion about a possible problem?