Machine Learning, Markov Chains, Statistics, NLP, Fun.
the last n characters we’ve seen, and try to predict the next one. I’ve already gone in-depth on this for my LSTM for Text Generation article, to mixed results. In this experiment, I will instead choose to use the previous k words as my current state, and model the probabilities of the next token.