Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
optimize neural networks. Gradient descent algorithm updates the parameters by moving in the direction opposite to the gradient of the objective function with respect to the network parameters. Gradient descent algorithm for single sigmoid neuron works like this, Learning Algorithm Parameter update