Machine Learning, Data Science, Mathematics, Markov Chains, Towards Data Science.
will use graphical representation to illustrate some of the properties bellow. However, one should keep in mind that these properties are not necessarily limited to the finite state space case. Reducibility, periodicity, transience and recurrence Let’s start, in this subsection, with some classical