Machine Learning, Markov Chains, Statistics, NLP, Fun.
preprocessing, plus loading the corpus: We will start training our Markov Chain right away, but first let’s look at our dataset: We have over 2 million tokens, representing over 32000 distinct words! That’s a pretty big corpus for a single writer. If only he could add 800k more… Training our chain