Machine Learning, Markov Decision Process, Reinforcement Learning.
action being taken. However, the new state depends only on the previous state. It has no dependence on the history of states in the past. Given the Markov state, define transition probability. Given that our agent is in some state s, there is a probability to go to the first state, another