Machine Learning.
formalised as MDPs e.g Optimal control deals with continuous MDP Partially observable can be converted into MDPs Bandits are MDPs with one state, take action receive reward, end of task. “Future is independent of past given the present” Markov Property: A state is Markov iff P[St+1 | St] = P[St+1 |