Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
with the Gumbel softmax approximation we derived earlier. **** Recall that equation *** was derived by applying the REINFORCE trick to the relaxed gradient and equation **** was derived by applying the Reparameterization trick. In summary the REBAR gradient estimator is calculated by taking the