Mathematics, Optimization, Data Science, Machine Learning, Duality.
just bᵀy. Minimizing the upper bound For this theoretical upper bound to be any good in signaling that the optimization has converged, it must be tight against the objective function itself. Otherwise, one could think of an unrealistically high upper bound that the objective function can never