Yes the learning curve of setup 4 looks weird for me.
But I suspect the timing of LR decay because setup 1 seems very good without LR decay, I mean, there are no plateau and hints of overfitting.
So how about training your model longer e.g. 100 or 200 epochs then applying LR decay?