Did you subtract the prediction, i.e. the binary image, from the target or the probabilities?
Could you check the min and max of the error image?
Maybe the range is quite low, but your plot lib has scaled it up?