Deep Learning, Artificial Intelligence, Computer Science, Machine Learning, Pytorch.
backward passes two times to compute the sharpness awareness gradient. Other than that SAM has also proved its effect on the recently published NFNETS, which is a current State of the Art for ImageNet, In the future, we can expect more and more papers utilizing this technique to achieve better