Machine Learning, Reinforcement Learning, AI, Artificial Intelligence.
important addition: the concept of states. In MDPs, actions that the agent takes do not just determine reward but also influence the next state the agent enters. In the bandit problem, the goal was to learn q*(a) or the optimal action. In a MDP the goal is to learn either q*(s,a) — the optimal