Reinforcement Learning, Artificial Intelligence, Machine Learning, Data Science, Statistics.
vπ(s′) denotes the expected future rewards if you start from state s′. To account for uncertainty in s′, future rewards are discounted by a factor γ: This nested equation can be recursively expanded, where qπ(s′,a) becomes r′+γvπ(s′′). The discount factor γ determines the significance of future