Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
where u_i is drawn from a uniform distribution. Hence the name Gumbel softmax. There’s also a “Gumbel hardmax” equation which takes the argmax of the indices instead of applying a softmax function: It turns out that by taking a “Gumbel hardmax” sample, we are directly sampling from the multinoulli