Reinforcement Learning, Monte Carlo Method, Machine Learning.
samples of variable X from behavior policy distribution b: In order to get the expected value of variable X under distribution π, we implement the following transformation: Where ρ(X) is called Importance Sampling Ratio. It is the ratio of the probability of variable X under π divided by the