.
recent estimates. 12. Give the TD Update Equation. ➥v^(st​) ← (1−α) v^(st​) + α[rt+1 ​+ γv^(st+1​)] 13. How can you estimate a policy’s value function without knowing the state transition function? ➥e.g. by taking actions in an environment and directly observing the resulting state 3. The Env class