Machine Learning, Deep Learning, Gradient Descent, Neural Networks, Learning Rate.
result in a large change in loss. In this loss function below, through training, we’ve landed in a local minimum. Image 5: Approaching a local minimum If we test this network on a different dataset, however, the loss function might be slightly different. A small shift of the loss function in this