Optimization, Learning Parameters, Gradient Descent, Stochastic Gradient, Deep Learning.
slow!! Can we do something better? Yes, let’s look at stochastic gradient descent. Stochastic Gradient Descent Stochastic gradient descent (often shortened to SGD) is an iterative method for optimizing a differentiable objective function, a stochastic approximation of gradient descent optimization.