Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
of Gumbel softmax samples is not equal to the expected value of the multinoulli samples unless the temperature τ goes to 0 (at which point Gumbel softmax becomes “Gumbel hardmax”). In the face of all these approximations you might be slightly skeptical as to why the Gumbel softmax woud work at all