Machine Learning, Data Science, Mathematics, Markov Chains, Towards Data Science.
probability of any realisation of the process can then be computed in a recurrent way. Assume for example that we want to know the probability for the first 3 states of the process to be (s0, s1, s2). So, we want to compute the probability Here, we use the law of total probability stating that the