Reinforcement Learning, Monte Carlo Method, Machine Learning.
π≈π∗: This is the general Off-Policy MC algorithm, we also have some variants: Image source Notice that the target policy π could be deterministic and when that happens, the IS(Importance Sampling) ratio will be ≥1 along the trajectory where the behavior policy b happened to have taken the same