Mathematics, Probability, Data Science, Stochastic Process, Artificial Intelligence.
from 0, as that's the typical way of indexing matrices for stochastic processes. R indexing, however, starts from 1. I did this for the sake of consistency. You only need to keep this in mind should you explore this in you own R Notebook To get three-step probabilities, we do it again: