Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
rewritten as α in the diagram. G is the sample from the Gumbel distribution. In a, we see that Gumbel max converts a single sampling process to sampling for all dimensions plus argmax. The sampling process has been reparameterized so that the actual sampling part (blue) is separate from the