It looks like the predictions jump from [0, 0] to [0.5, 0.5].
Are you using the same model but with another last layer?
Did your previous model learn the correct regression using a sigmoid at the end?
Did you think about using your pre-trained model and just add an additional “snout/tail” layer?