Machine Learning, Artificial Intelligence, Data Science, Programming, Technology.
certainly does exist, if you increase the batch size and do nothing else. If you just increase batch sizes w/o changing anything else, your model will get stuck in sharper minima. That is the reason behind the generalization gap This was shown by the paper On Large-Batch Training for Deep Learning: