Machine Learning, Deep Learning, Artificial Intelligence, NLP, AI.
distribution over the next word. This can be achieved using an RNN by feeding in a word at each time step and obtaining the final hidden state. The final hidden state of the RNN is then mapped to a probability distribution using a feed-forward network followed by softmax. There is still one piece