Probability, Statistics, Markov Chains, Markov Chain Monte Carlo, Markov.
of transitions, interesting long-term behaviors emerge. If the chain is both irreducible and aperiodic, it will eventually reach a steady state where the probabilities of being in each state stabilize. These probabilities form the stationary distribution. You can explore a JavaScript simulation of