Neural Networks, Gradient Descent.
In Neural Networks the optimisation problem is the Loss or Cost Function. If our neural network is supposed to give y_expected for an input x, and it gives y_output, the loss function in its most simple form is nothing but y_expected -y_output = 0 To remove negatives we square this and take its