Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
variable. Training a deep neural network to find the best parameters of that network is an iterative process, but training deep neural networks on a large data set iteratively is very slow. So what we need is that by having a good optimization algorithm to update the parameters (weights and biases)