Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
the simplex (1-hot) because we are sampling directly from the multinoulli distribution. Here is another interpretation of Gumbel softmax samples. These are diagrams of the Gumbel softmax probability density for k=3 dimensions. Recall that a simplex (subspace defined by the equation x_1 + x_2 + … =