I saw your issue on a Pytorch U-Net implementation (https://github.com/milesial/Pytorch-UNet/issues/126 17), I have the exact same problem with U-Net! Atm i’m getting a fairly high dice coefficient (> 0.8), but poor predicted segmentation masks. I looked through the mask predictions and negative samples are definitely skewing the accuracy evaluation & learning process!