Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
0.9999-hot action vector y is determined by the following equation: As you’ll notice, this is the softmax function applied to this weird log(π_i + g_i) term. τ is the temperature of the softmax. The g_i term is actually a random value drawn from the Gumbel distribution which is just −log(−log(u_i))