Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
our REINFORCE gradient for the unrelaxed model by the right hand side of equation **, we would have a baseline-subtracted REINFORCE estimator with an extra term. Equation *** The right hand side is almost what we want: REINFORCE estimator with a baseline subtracted. However there’s an extra term so