Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
through argmax operations but we do know how to differentiate through softmax. Simplex in 3D. Visualization of Gumbel samples for a problem with 3 actions. The temperature is 0 for the left-most image and increases towards the right. For the 0 temperature case, samples must be one of the corners of