Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
it can be shown that Gumbel softmax with nonzero τ can be interpreted as entropy penalization. In practice the authors of the Gumbel softmax paper suggest starting at a high temperature and annealing to a low temperature. Here is the probability density function of the Gumbel softmax distribution