Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
is used to compute the soft sample from the logit. H(z): the Heaviside function, this function is 1 if z>0 and 0 if z<0. The heaviside function plays the role of the argmax for the Gumbel formulation. The hard sample is computed from the Heaviside function applied to the logit. u: a uniform random