the third condition is slightly more tricky

here's an example of a markov chain that *doesn't* satisfy it: the classic random walk on the integers

start at zero and flip a ; on heads, go up one, and on tails go down one