So the full-batch version is basically overfitting while the mini-batch is unable to do that (since our data is just noise and there are no real patterns to learn)?
Can this insight be of any use when working on real but very noisy data?