Yeah, I think the mask is the problem as described earlier.
Could you upload one sample somewhere else? I need some account to download the image from your university.
I guess you are currently loading a “normal” image using a specific color code for certain classes, so that we would need a mapping to decode them to class indices.
Which dataset are you using? Did you create it yourself?