Machine Learning, Data Science, Mathematics, Markov Chains, Towards Data Science.
understand what Markov chains are. In the second section, we will discuss the special case of finite state space Markov chains. Then, in the third section we will discuss some elementary properties of Markov chains and will illustrate these properties with many little examples. Finally, in the