Data Science, Sampling, Statistics, Machine Learning, Artificial Intelligence.
future states are independent of past states, given the current state. MCMC are used when it is not possible to draw samples from p(x) but rather only able to evaluate p(x) up to a normalising constant. I will not go into details on Markov Chains, however, interested readers can find a good