Artificial Intelligence, Machine Learning, Deep Learning, Neural Networks.
plateaus, ridges, etc. If the function encounters a “hole”, it might falsely believe it to be the minimum value. On the other hand, if it encounters a long plateau, the function might endlessly take small steps along the plateau and never arrive at a minima. The struggles of Gradient Descent |