Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
Picking the decision with higher pay-off (b=1) half the time (θ=0.5) is definitely better than picking it none of the time (θ=0). Recall that we have two d/dθ f() terms in REBAR. These terms have an extrema at θ=0.5 and can get our model stuck at that value which is not what we want. RELAX learns a