Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
use ẑ will be clear in a moment. Here is an overview of the dependency between the variables. The only thing missing from this graph is the soft sample y. You can compute y from the logit z by replacing H with σ_λ. To derive the REBAR gradient estimator, we need two tricks: the Reparameterization