Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
in a single gradient calculation. RELAX solves these problems at the cost of computing second order derivatives. The authors introduce the term “surrogate function” to describe function used to baseline the gradient estimator. For REBAR, the surrogate function was f(σ_λ()). For RELAX, the surrogate