Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
not depend on θ. In this light, the Gumbel softmax gradient estimator can be seen as the Reparameterization trick applied to a continuous relaxation of the Bernoulli (multinoulli) distribution. For the RELAX method, we need to do a bit more work. Let’s define another variable ẑ which is the