Artificial Intelligence, Technology, Conference, Iclr 2020, Neural Networks.
training for a different number of epochs. Model-1 to model-4 are the snapshots taken when the loss decreases below 10^{−10}, 10^{−15}, 10^{−20}, 10^{−120}, respectively. Model-5 is the snapshot when the loss is 10^{−882}. source: Lyu, K. and Li, J. (2020). Gradient Descent Maximizes the Margin of