Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
and v. Compute z using u, θ. Compute b using z. Compute ẑ using b and v, θ. Query the environment where ever there is a f() in the REBAR formula. Backprop through the d/dθ in the REBAR formula. Note that when we do d/dθ f(σ_λ(ẑ)) ẑ is a function of both θ and b. We should backprop through θ but not