Mathematics, Probability, Data Science, Stochastic Process, Artificial Intelligence.
probability of the coin landing on heads is .5, and tails is .5. If the coins lands on heads, the ‘state’ of the world is unchanged, while if the coin lands on tails, the ‘state’ has changed. This can be modeled with the matrix below: A simple transition matrix. Or, a more visual approach: The same