Artificial Intelligence, Technology, Conference, Iclr 2020, Neural Networks.
normalized margin, and it can be proved that this margin is non-decreasing during training for both gradient flow and gradient descent. A constrained margin maximization problem is constructed and it is shown that the optimization, both gradient flow, and gradient descent, passes through an