Artificial Intelligence, Technology, Conference, Iclr 2020, Neural Networks.
Gradient Descent Maximizes the Margin of Homogeneous Neural Networks. ICLR. Let’s further examine the training process with the loss-based learning rate scheduler. The table below lists several snapshots noted as model-1, model-2, etc., and their performance. The training accuracy of all five