Machine Learning, Markov Chains, Statistics, NLP, Fun.
index of the next word. If I normalize each word vector, I will then have a probability distribution for the next word, given the previous k tokens. Confusing? Let’s see an example with a small corpus. Training our chain: toy example. Let’s imagine my corpus is the following sentence. This sentence