Neural Networks, Gradient Descent.
could be mistaken as an optimum point (slope is zero). However empirically it is pretty good in practice with few adaptations, like using adaptive learning rates and tracking momentum. This is well covered in this article https://www.ruder.io/optimizing-gradient-descent/ Practically how this