Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
temperatures and the expected distribution of the samples for that temperature. In our visualization, the bottom row shows a typical sample from the Gumbel softmax distribution. As we can see, a typical sample at low temperatures is almost 1-hot. The top row shows the expected value of the sample.