Solved by ptrblck in post #2 
              
              
                The larger the batch size, the less noise the parameter updates will include. 
Often this noise is beneficial to reach a better final accuracy, but it might depend on your use case. 
You could find some articles, which compare gradient descent, batch gradient descent, and stochastic gradient descent…