Machine Learning, Artificial Intelligence, Data Science, Programming, Technology.
Generalization Gap and Sharp Minima. This trade-off can be mitigated with techniques like “Ghost Batch Normalization”, as suggested in the paper “Train longer, generalize better: closing the generalization gap in large batch training of neural networks”. There are also other techniques to overcome