Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
logistic function instead of the Heaviside function. For the Gumbel softmax trick, this is the end of the story. Having defined a continuous relaxation of our sampling process, we can do backpropagation. To be concrete what this means, let’s define f as the environment function which determines the