Solved by tom in post #4 
              
              
                You want the y_true to have shape (1, 2, 256, 256) if you want to measure the L1 loss between measures. The one_hot way is to set (_, CLASS, _, ) to one and (, 1- CLASS, ,) to 0.