Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
intermediate values like 0.5 and use REBAR. Plots of the surrogate function for different gradient estimators are shown below. u is the probability of choosing b=1. The blue and green lines show the fixed surrogate function of REINFORCE and REBAR respectively. The red line shows the learned