Machine Learning.
qπ(s,a)=Eπ[Rt+1+γqπ(St+1,At+1)|St =s,At =a] From above the current state value V(s) relates the state value of the next step. Optimal state-value function: Is the maximum value function over all policies. v∗(s) = max vπ(s) Optimal action-value function: is the maximum action-value function over all