Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
optimal performance. This is also partly true for Gumbel softmax: use too low of a temperature and you’re effectively doing REINFORCE, use too high of a temperature and you won’t learn because your samples don’t represent your π distribution. To hit home the point, if the temperature τ is learned,