I think the maximal values might be in channel0. In your example output tensor, it looks like channel0 has positive values, while channel1 seems to only have negative values.
At least in the numbers you’ve posted.
Could this be the case, i.e. your model just predicts background for all pixels?