Mathematics, Probability, Data Science, Stochastic Process, Artificial Intelligence.
contains the transition probability leading to 1. You may have noticed that this essentially amounts taking the dot product of the first row and the second column. That’s actually exactly it! In fact, if we do this for every entry, then we can get the two-step ahead probabilities for all P(i, j).