Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
REINFORCE estimator of the unrelaxed gradient, subtracting the REINFORCE estimator of the relaxed gradient, and adding back the Reparameterization estimator of the relaxed gradient. Phew! Here is the REBAR gradient: We’ve replaced expectations over b with expectations over u to get a formula that