Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
subtracted the gradient of the surrogate function (replacing one term with the REINFORCE trick and the other term with the Reparameterization trick) to keep estimator unbiased. The only difference here is the surrogate is c_ϕ instead of f(σ_λ()). Because c_ϕ is just a neural network, it is