Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
optimize ϕ. Intuition tells us c_ϕ should be correlated with f and we can explicitly force c_ϕ towards f by minimizing the L2 loss [f(b)−c_ϕ(b)]². This is analogous to how the Q-function is trained in RL. However, recall that we have both a REINFORCE term and a Reparameterization term in LAX.