Machine Learning, NLP, Deep Learning, Artificial Intelligence, AI.
softmax layer followed by argmax to yield the next word. Decoding RNN hidden state The RNN is trained by making it predict the next word in a sentence at each time step. Training is done by back-propagating the cross-entropy loss between the output distribution of the softmax layer and the target