Machine Learning, Regression, Data Science.
training will bounce around. Good is 40 to 100. Larger batches require smaller learning rates. For small batch size, training will bounce around and for large learning rate, training will take a long time . Default rate is 0.2 or 1/sqrt(num_of_features). There are different ways to implement