Artificial Intelligence, Reinforcement Learning, Machine Learning, Neural Networks, Markov Chains.
q_(s,a) of Markov Decision Processes indicates the expected output from the agent assuming they execute action and follow policy, π starting from state, s. This can be expressed as such. Written as Bellmen Expectation Equations (see above for notation explained) looks something like this.