Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
function is learned. More specifically, the authors let the surrogate function be a second neural network c_ϕ parameterized by ϕ. Remember that a good baseline for the REINFORCE algorithm is one that is correlated with f(b). Therefore, we expect a good learned surrogate function c_ϕ to correlate