Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
distribution π (this is perhaps not super obvious because we’ve introduce logs and g_i in the sampling process). Therefore, the soft version approximately samples from the multinoulli distribution. Sampling from the Gumbel softmax is an approximation to sampling from the multinoulli distribution