Why are you using a batch size of 1 and steps_per_epoch=1? It means that every epoch you train your model on exactly one train image and evaluate it on 50 validation images (since validation_steps=50).