Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
in all its glory, note it only depends on the probabilities π and τ: Gumbel softmax pdf for temperature τ. The main point of using Gumbel softmax is it makes everything fully differentiable. Let’s call 1-hot samples z and Gumbel soft samples y. Before when we sampled 1-hot vectors z we couldn’t