Machine Learning, Data Science, Mathematics, Markov Chains, Towards Data Science.
transition matrix is given by where 0.0 values have been replaced by ‘.’ for readability. Before any further computation, we can notice that this Markov chain is irreducible as well as aperiodic and, so, after a long run the system converges to a stationary distribution. As we already saw, we can