Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
equation into one with lower variance. If f is differentiable, we can directly take the derivative: The right hand side is the gradient estimator for Gumbel softmax. We replace the expectation over b with the expectation over u by noting that b = H(z(θ, u)). Furthermore, we make an approximation by