Reinforcement Learning, Monte Carlo Method, Machine Learning.
have considered methods for estimating the value functions for a policy given an infinite supply of episodes generated using that policy. Suppose now that all we have are episodes generated from a different policy. That is, we wish to estimate Vπ and Qπ, but all we have are episodes following b,