Solved by Nikronic in post #2 
              
              
                Hi, 
If you run a deep (depends on data) model for many epochs for a small proportion of data, like a batch of data, model will overfit. Overfitting means that model focused too much on that small data that just memorized everything. 
Bests