Reinforcement Learning, Artificial Intelligence, Machine Learning, Data Science, Statistics.
the same state-action pair can result in diverse successive state-reward pairs, averaging over all combinations is necessary to assess the action’s value in a particular state. Assuming knowledge of the environment model p(s′,r∣s,a), the action-value function becomes the expected reward over all