Deep Learning, Artificial Intelligence, Computer Science, Machine Learning, Pytorch.
loss value) Since computing neighborhood parameters in addition to computing a single parameter, the loss landscape is flatter comparing to other optimization methods, which in turn increases generalization of the model. (Left)) A sharp minimum to which a ResNet trained with SGD converged. (Right)