Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
but it has been shown to have good empirical results. For a more theoretical argument, let’s revisit the age-old bias-variance trade off. Here is what a sample from the Gumbel softmax distribution looks like for different temperatures: Visualization of a typical sample for different gumbel