.
introducing. It learns a value function estimate directly from interacting with the environment — without needing to know the state transition function. In Tutorial 2, we saw that the value function changes based on which policy we follow. Stated more concretely, following one policy will give us a