A Markov decision process (MDP) is a mathematical framework  for modeling decision making in cases where outcomes are not entirely under the control of decision makers. MDPs are used in a variety of disciplines, such as robotics and economics.