Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
Gumbel softmax is a biased, low-variance (well at least lower than REINFORCE) gradient estimator. REBAR tries to one-up Gumbel softmax by being both unbiased and low-variance. The main disadvantage of REBAR is its implementation complexity. While Gumbel softmax can be implemented in a few lines of