Sgd, Machine Learning, Stochastic Gradient.
selecting a small batch of data points at each iteration and computing the gradient on this batch. This allows SGD to converge much faster and scale to large datasets. Implementing SGD in Python Here I am providing code of SGD with batch size = 1, we can extend it easily to any k value just by