Artificial Intelligence, Technology, Conference, Iclr 2020, Neural Networks.
clarifies that it is not realistic to prove stronger convergence results without adding further assumptions since gradient descent is a first-order optimization method. Practically, the paper indicates that training with more time can enlarge the normalized margin and thus improve the (L2-)