Machine Learning, Data Science, Mathematics, Markov Chains, Towards Data Science.
the following one is as easy as right multiplying the row probability vector of the initial step by the matrix p. This also implies that we have The random dynamic of a finite state space Markov chain can easily be represented as a valuated oriented graph such that each node in the graph is a state