Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
can make the expectation in terms of b, it’s not clear that setting c = f(σ_λ(z)) will leave the gradient unbiased. First we tackle problem number 1; problem 2 will eventually sort itself out. It can be shown that by introducing the after-the-fact logit variable ẑ, we an rewrite equation * into a