Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
Reparameterization trick, Gumbel softmax looks a lot like it but for discrete latent variables. Recall that REINFORCE samples a 1-hot vector from our π distribution. To construct our 0.9999-hot vector for Gumbel softmax, we need to select values for each index in the vector. The ith element in our