Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
using the soft sample y instead of b and σ_λ instead of H. Note that had we used the hard sample instead of the soft sample, the right hand side would be equal to the left hand side. We were able to bring the derivative into the expectation because we are now expecting over u which unlike b does