Starbucks, Machine Learning, Markov Chains, Data Science, Editors Pick.
it: Image by author In the notation above we have that the probability of being, at time t, in the space s_t (O, M, L) is only dependent on the state that we are at time t-1. The thing that we need to keep in mind in our specific experiment is that this probability has to be time-dependent too.