The more important question is, why does your target contain these values?
If your goal is a segmentation, each target values should represent a class.
Could you explain a bit more about the target, i.e. how did you load it etc.?