Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
using z here to mean something different than z in the Gumbel formulation. It is an simply intermediate value used to compute the sample, not the hard sample. y: the soft sample. We use y in a similar manner to our Gumbel softmax formulation. The logistic function plays the role of the softmax and