Machine Learning, Mdp, Markov Chains, Reinforcement Learning.
set of states, S is not always finite. Also, not all states are directly reachable from every other state (think of a directed graph data structure). A state is a node in a graph data structure. Actions This is self-descriptive. An action is how an agent gets from one state s to another state s’.