Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
this gradient is biased. This doesn’t work because remember REBAR is supposed to be an unbiased gradient estimator. To get around this problem, we invoke a common trick in mathematics: add and subtract the same thing! Consider: This is equation *** with the relaxed gradient added back in. This