Machine Learning.
Uncertainty about future may not be fully represented. Possible to use un discounted MRP (i.e 𝛾 = 1) e.g if all sequences terminate. Value function: Long term value of being in a state. Expected reward starting from that state. V(S) = E [ Gt | St = s] Bellman Equation for MRPs: Value function can