yea, this is the case. My first network i trained, was clearly overfitted, because it detected the same grid each passthrough. I have augmented the data with random flips and random 90 degree rotations.