Probability, Statistics, Markov Chains, Markov Chain Monte Carlo, Markov.
following conditional probability representation for a first-order Markov chain, where the transition depends solely on the current state. There are also higher order Markov chains where the transition depends on a sequence of past states. Markov property for first-order Markov chain. Markov