Artificial Intelligence, Deep Learning, Machine Learning, Gradient Descent, Optimization.
we are using Mini-Batch or Stochastic gradient descent key point to note is that we are approximating the derivatives with respect to loss function, we are not computing the true derivatives of the loss function. Number of updates (steps) made to the parameters in one epoch, Batch Gradient Descent