The output of your model will most likely not have the same normalization as your input.
Correct me, if I misunderstood the use case, but I assume your model outputs a 2-channel activation containing the class logits for each pixel.
Did you “denormalize” this output using the mentioned formula?
Could you try to get the predictions via torch.argmax(output, 1) and try to plot this instead?