Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
construct something that looks like the second term on the right hand side. An idea is to use the gradient estimator of the relaxed model (where we have replaced b with y). After all, f(y) must be quite correlated with f(b) and should act as a good baseline. Here is the gradient of the relaxed