Neural Networks, Gradient Descent.
minimum, based on a predefined convergence criterion or after a set number of iterations. The step size/ learning rate etc important. In the theoretical example below we will find the minimum for using the above gradient descent algorithm. Note that the derivative of x² is 2x. import numpy as np