Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
expects over u and v only (z is implictly dependent on u and ẑ is implicitly dependent on v). Finally b is calculated as H(z). The authors introduce a hyperparameter η which scales the baseline/control variate. I believe this is tuned. To relate REBAR back to Gumbel softmax, it’s interesting to