Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
with f(b). While RELAX is a generalization of REBAR to arbitrary surrogate functions, it might be conceptually easier to think of it as learning a Q-function c_ϕ alongside the policy network p_θ. However, as we will see there are some subtle differences between c_ϕ and the Q-function in