.
is hopefully well-explained in the toggles below Note: the arrow in 𝑣^(𝑠𝑡)←expressionv^(st​)←expression simply means the expression on the right is updating our estimator on the left side of the arrow — the value function estimate for this state. Let’s briefly consider each term in this expression: