When we use SGD algorithm to update the parameters in the model, we use only one sample to feed the model each time, it it right?
But in PyTorch, even when we use SGD, we have to set batch_size and its value can not be 1.
What puzzles me is, when use SGD and batch_size is not 1, what exactly is the algorithm of the program? Is it still SGD?