Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
trick which we have already seen with the Gumbel softmax estimator and the REINFORCE trick. Recall that REINFORCE works by bringing the derivative inside the expectation and introducing the log p(b|θ) term. Also recall that we can introduce a baseline to the REINFORCE gradient estimator to reduce