Artificial Intelligence, Machine Learning, Deep Learning, Neural Networks.
update The math of gradient descent is actually quite simple. Gradient descent iteratively updates the value of a parameter (say θ) by taking a small ‘step’ in the direction of the slope of the loss J(∇J(θ​)). The length or the value of this ‘step’ is determined by a hyperparameter called the