So the dice goes from 0.6 to 0.8 for training in the first 5 epochs but for validation, it sticks to 1e-4 for first two epochs followed by moving to 0.2 and then coming back to 0.1.
Although, at first, it seems like a classic case of overfitting, but I have a training set of 200000 images as compared to 30000 for validation and I have also turned on augmentation for it.
Thoughts?