Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
note that the gradient estimator is unbiased for any temperature λ of the softmax function. The authors suggested learning λ during training rather than setting an annealing schedule ahead of time as you would for Gumbel softmax. The algorithm for backpropation using the REBAR gradient is: Sample u