Model Selection, Reinforcement Learning, Deep Learning.
a has been selected prior to time t (the denominator in (2.1)), and the number c > 0 controls the degree of exploration. If Nₜ(a) = 0, then a is considered to be a maximizing action. The idea of this upper confidence bound (UCB) action selection is that the square-root term is a measure of the