Machine Learning, Deep Learning, Artificial Intelligence, NLP, AI.
algorithm Let’s look at the expression for the gradient again: Notice that 𝜇(s) is essentially the probability of state s occurring while following policy 𝜋. So, the outer summation is just an expectation (over 𝜋) of the value of the inner summation. So why not do the same thing for the inner