A simple way testing if your model can reach a global minimum (i.e. overfit) is simply reducing drastically your training data. Train your model in 10 images for a lot of epochs and tell me what happens.