Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
The problem becomes harder to solve as t approaches 0.5, i.e. b=0.4,0.45,0.49,0.499 because for any given trial the reward signal is almost the same between b=0 and b=1. The authors considered the difficult problem of b=0.499. Because the environment function is known, we can evaluate it at